MMN elicitation during natural sleep to violations of an auditory pattern

Language experience shapes predictive coding of rhythmic sound sequences

Perceptual systems heavily rely on prior knowledge and predictions to make sense of the environment. Predictions can originate from multiple sources of information, including contextual short-term priors, based on isolated temporal situations, and context-independent long-term priors, arising from extended exposure to statistical regularities. While the effects of short-term predictions on auditory perception have been well-documented, how long-term predictions shape early auditory processing is poorly understood. To address this, we recorded magnetoencephalography data from native speakers of two languages with different word orders (Spanish: functor-initial vs Basque: functor-final) listening to simple sequences of binary sounds alternating in duration with occasional omissions. We hypothesized that, together with contextual transition probabilities, the auditory system uses the characteristic prosodic cues (duration) associated with the native language's word order as an internal model to generate long-term predictions about incoming non-linguistic sounds. Consistent with our hypothesis, we found that the amplitude of the mismatch negativity elicited by sound omissions varied orthogonally depending on the speaker's linguistic background and was most pronounced in the left auditory cortex. Importantly, listening to binary sounds alternating in pitch instead of duration did not yield group differences, confirming that the above results were driven by the hypothesized long-term 'duration' prior. These findings show that experience with a given language can shape a fundamental aspect of human perception - the neural processing of rhythmic sounds - and provides direct evidence for a long-term predictive coding system in the auditory cortex that uses auditory schemes learned over a lifetime to process incoming sound sequences.

Auditory change detection and visual selective attention: association between MMN and N2pc

While the auditory and visual systems each provide distinct information to our brain, they also work together to process and prioritize input to address ever-changing conditions. Previous studies highlighted the trade-off between auditory change detection and visual selective attention; however, the relationship between them is still unclear. Here, we recorded electroencephalography signals from 106 healthy adults in three experiments. Our findings revealed a positive correlation at the population level between the amplitudes of event-related potential indices associated with auditory change detection (mismatch negativity) and visual selective attention (posterior contralateral N2) when elicited in separate tasks. This correlation persisted even when participants performed a visual task while disregarding simultaneous auditory stimuli. Interestingly, as visual attention demand increased, participants whose posterior contralateral N2 amplitude increased the most exhibited the largest reduction in mismatch negativity, suggesting a within-subject trade-off between the two processes. Taken together, our results suggest an intimate relationship and potential shared mechanism between auditory change detection and visual selective attention. We liken this to a total capacity limit that varies between individuals, which could drive correlated individual differences in auditory change detection and visual selective attention, and also within-subject competition between the two, with task-based modulation of visual attention causing within-participant decrease in auditory change detection sensitivity.

Neural complexity and the spectral slope characterise auditory processing in wakefulness and sleep

Auditory processing and the complexity of neural activity can both indicate residual consciousness levels and differentiate states of arousal. However, how measures of neural signal complexity manifest in neural activity following environmental stimulation and, more generally, how the electrophysiological characteristics of auditory responses change in states of reduced consciousness remain under-explored. Here, we tested the hypothesis that measures of neural complexity and the spectral slope would discriminate stages of sleep and wakefulness not only in baseline electroencephalography (EEG) activity but also in EEG signals following auditory stimulation. High-density EEG was recorded in 21 participants to determine the spatial relationship between these measures and between EEG recorded pre- and post-auditory stimulation. Results showed that the complexity and the spectral slope in the 2-20 Hz range discriminated between sleep stages and had a high correlation in sleep. In wakefulness, complexity was strongly correlated to the 20-40 Hz spectral slope. Auditory stimulation resulted in reduced complexity in sleep compared to the pre-stimulation EEG activity and modulated the spectral slope in wakefulness. These findings confirm our hypothesis that electrophysiological markers of arousal are sensitive to sleep/wake states in EEG activity during baseline and following auditory stimulation. Our results have direct applications to studies using auditory stimulation to probe neural functions in states of reduced consciousness.

Cardio-audio synchronization elicits neural and cardiac surprise responses in human wakefulness and sleep

The human brain can encode auditory regularities with fixed sound-to-sound intervals and with sound onsets locked to cardiac inputs. Here, we investigated auditory and cardio-audio regularity encoding during sleep, when bodily and environmental stimulus processing may be altered. Using electroencephalography and electrocardiography in healthy volunteers (N = 26) during wakefulness and sleep, we measured the response to unexpected sound omissions within three regularity conditions: synchronous, where sound and heartbeat are temporally coupled, isochronous, with fixed sound-to-sound intervals, and a control condition without regularity. Cardio-audio regularity encoding manifested as a heartbeat deceleration upon omissions across vigilance states. The synchronous and isochronous sequences induced a modulation of the omission-evoked neural response in wakefulness and N2 sleep, the former accompanied by background oscillatory activity reorganization. The violation of cardio-audio and auditory regularity elicits cardiac and neural responses across vigilance states, laying the ground for similar investigations in altered consciousness states such as coma and anaesthesia.

Mismatch negativity generation in subjects at risk for psychosis: source analysis is more sensitive than surface electrodes in risk prediction

Background

Deficits of mismatch negativity (MMN) in patients with schizophrenia have been demonstrated many times and there is growing evidence that alterations of MMN already exist in individuals at risk for psychosis. The present study examines differences in MMN between subjects fulfilling ultra-high risk (UHR) or only basic symptoms criteria and it addresses the question, if MMN source analysis can improve prediction of transition to psychosis.

Methods

The MMN to duration, frequency, and intensity deviants was recorded in 50 healthy controls and 161 individuals at risk for psychosis classified into three subgroups: only basic symptoms (n = 74), only ultra-high risk (n = 13) and persons who fulfill both risk criteria (n = 74). Based on a three-source model of MMN generation, we conducted an MMN source analysis and compared the amplitudes of surface electrodes and sources among the three groups.

Results

Significant differences in MMN generation among the four groups were revealed at surface electrodes Cz and C4 (p < 0.05) and at the frontal source (p < 0.001) for duration deviant stimuli. The 15 subjects from the risk groups who subsequently developed a manifest psychosis had a significantly lower MMN amplitude at frontal source (p = 0.019) without showing significant differences at surface electrodes. Low activity at frontal MMN source increased the risk of transition to manifest disease by the factor 3.12 in UHR subjects.

Conclusion

MMN activity differed significantly between subjects presenting only basic symptoms and subjects which additionally meet UHR criteria. The largest differences between groups as well as between individuals with and without transition were observed at the frontal source. The present results suggest that source analysis is more sensitive than surface electrodes in psychosis risk prediction by MMN.

Disrupted neural tracking of sound localization during non-rapid eye movement sleep

Spatial hearing in humans is a high-level auditory process that is crucial to rapid sound localization in the environment. Both neurophysiological models with animals and neuroimaging evidence from human subjects in the wakefulness stage suggest that the localization of auditory objects is mainly located in the posterior auditory cortex. However, whether this cognitive process is preserved during sleep remains unclear. To fill this research gap, we investigated the sleeping brain's capacity to identify sound locations by recording simultaneous electroencephalographic (EEG) and magnetoencephalographic (MEG) signals during wakefulness and non-rapid eye movement (NREM) sleep in human subjects. Using the frequency-tagging paradigm, the subjects were presented with a basic syllable sequence at 5 Hz and a location change that occurred every three syllables, resulting in a sound localization shift at 1.67 Hz. The EEG and MEG signals were used for sleep scoring and neural tracking analyses, respectively. Neural tracking responses at 5 Hz reflecting basic auditory processing were observed during both wakefulness and NREM sleep, although the responses during sleep were weaker than those during wakefulness. Cortical responses at 1.67 Hz, which correspond to the sound location change, were observed during wakefulness regardless of attention to the stimuli but vanished during NREM sleep. These results for the first time indicate that sleep preserves basic auditory processing but disrupts the higher-order brain function of sound localization.

Neuroscientific Evidence for Processing Without Awareness

The extent to which we are affected by perceptual input of which we are unaware is widely debated. By measuring neural responses to sensory stimulation, neuroscientific data could complement behavioral results with valuable evidence. Here we review neuroscientific findings of processing of high-level information, as well as interactions with attention and memory. Although the results are mixed, we find initial support for processing object categories and words, possibly to the semantic level, as well as emotional expressions. Robust neural evidence for face individuation and integration of sentences or scenes is lacking. Attention affects the processing of stimuli that are not consciously perceived, and such stimuli may exogenously but not endogenously capture attention when relevant, and be maintained in memory over time. Sources of inconsistency in the literature include variability in control for awareness as well as individual differences, calling for future studies that adopt stricter measures of awareness and probe multiple processes within subjects.

EEG-based visual deviance detection in freely behaving mice

The mouse is widely used as an experimental model to study visual processing. To probe how the visual system detects changes in the environment, functional paradigms in freely behaving mice are strongly needed. We developed and validated the first EEG-based method to investigate visual deviance detection in freely behaving mice. Mice with EEG implants were exposed to a visual deviant detection paradigm that involved changes in light intensity as standard and deviant stimuli. By subtracting the standard from the deviant evoked waveform, deviant detection was evident as bi-phasic negativity (starting around 70 ms) in the difference waveform. Additionally, deviance-associated evoked (beta/gamma) and induced (gamma) oscillatory responses were found. We showed that the results were stimulus-independent by applying a "flip-flop" design and the results showed good repeatability in an independent measurement. Together, we put forward a validated, easy-to-use paradigm to measure visual deviance processing in freely behaving mice.

Balancing Prediction and Surprise: A Role for Active Sleep at the Dawn of Consciousness?

The brain is a prediction machine. Yet the world is never entirely predictable, for any animal. Unexpected events are surprising, and this typically evokes prediction error signatures in mammalian brains. In humans such mismatched expectations are often associated with an emotional response as well, and emotional dysregulation can lead to cognitive disorders such as depression or schizophrenia. Emotional responses are understood to be important for memory consolidation, suggesting that positive or negative 'valence' cues more generally constitute an ancient mechanism designed to potently refine and generalize internal models of the world and thereby minimize prediction errors. On the other hand, abolishing error detection and surprise entirely (as could happen by generalization or habituation) is probably maladaptive, as this might undermine the very mechanism that brains use to become better prediction machines. This paradoxical view of brain function as an ongoing balance between prediction and surprise suggests a compelling approach to study and understand the evolution of consciousness in animals. In particular, this view may provide insight into the function and evolution of 'active' sleep. Here, we propose that active sleep - when animals are behaviorally asleep but their brain seems awake - is widespread beyond mammals and birds, and may have evolved as a mechanism for optimizing predictive processing in motile creatures confronted with constantly changing environments. To explore our hypothesis, we progress from humans to invertebrates, investigating how a potential role for rapid eye movement (REM) sleep in emotional regulation in humans could be re-examined as a conserved sleep function that co-evolved alongside selective attention to maintain an adaptive balance between prediction and surprise. This view of active sleep has some interesting implications for the evolution of subjective awareness and consciousness in animals.

Automatic Sensory Predictions: A Review of Predictive Mechanisms in the Brain and Their Link to Conscious Processing

The human brain has the astonishing capacity of integrating streams of sensory information from the environment and forming predictions about future events in an automatic way. Despite being initially developed for visual processing, the bulk of predictive coding research has subsequently focused on auditory processing, with the famous mismatch negativity signal as possibly the most studied signature of a surprise or prediction error (PE) signal. Auditory PEs are present during various consciousness states. Intriguingly, their presence and characteristics have been linked with residual levels of consciousness and return of awareness. In this review we first give an overview of the neural substrates of predictive processes in the auditory modality and their relation to consciousness. Then, we focus on different states of consciousness - wakefulness, sleep, anesthesia, coma, meditation, and hypnosis - and on what mysteries predictive processing has been able to disclose about brain functioning in such states. We review studies investigating how the neural signatures of auditory predictions are modulated by states of reduced or lacking consciousness. As a future outlook, we propose the combination of electrophysiological and computational techniques that will allow investigation of which facets of sensory predictive processes are maintained when consciousness fades away.

The effects of sleep on objective measures of gap detection using a time-efficient multi-deviant paradigm

Auditory temporal resolution, measured through gap detection, is critical for the perception of speech. A time-efficient multi-deviant paradigm has previously been developed for gap detection. The purpose of the present study was to determine if this multi-deviant paradigm could be used for gap detection during NREM sleep. ERPs were recorded in 10 young adults while awake and during the first two hours of NREM sleep. A multi-deviant paradigm was employed with six different deviants varying in gap duration, ranging from 2 to 40 ms. During waking, a DRN was observed for the 10, 20, 30 and 40 ms gaps. The DRN was absent during sleep. A P2 was present in NREM for the 20, 30 and 40 ms gaps followed by a P3a to the 30 and 40 ms gaps. An N350 was observed following the 10, 20, 30 and 40 ms gaps. Previous studies have reported significant ERPs to gaps having shorter durations than the present study. The multi-deviant paradigm may not be suitable for the determination of gap threshold during sleep. Nevertheless, it provides an exquisite means to determine perceptibility and the extent of processing of longer duration, supra-threshold gaps during sleep.

Event-related potentials in insomnia reflect altered perception of sleep

STUDY OBJECTIVES

Insomnia is defined by the subjective complaint of poor sleep as well as daytime impairments. Since polysomnography (PSG) typically shows only modest sleep impairment, some still unidentified property of sleep, not mirrored in PSG, may be modified in insomnia.One possible mechanistic hypothesis is that insomnia patients may be more sensitive to inevitably occurring internal or external stimuli during the night, causing brief sleep disruptions then perceived as wake time.

METHODS

Auditory event-related potentials (ERP) to low intensity (50 dB SPL) synthesized guitar tones played continuously throughout two nights of polysomnographically registered sleep were obtained in fifty patients with insomnia disorder (ID, without comorbidities) and 50 age- and sex- matched good sleeper controls (GSC) for each sleep stage and NREM/REM cycle. Phasic and tonic REM were treated as separate stages. Latencies and amplitudes of components P1, N1 and P2 were measured and analyzed by multivariate repeated-measures ANCOVA including effects of group, night, cycle and age.

RESULTS

ID showed reduced P2 amplitudes relative to GSC specifically in phasic REM sleep. The same reduction also correlated with the amount of sleep misperception across groups. Independent component analysis showed a frontal negativity to contribute most to this group difference.

CONCLUSIONS

The present finding can be interpreted as increased mismatch negativity (MMN) in ID, reflecting automated detection of change in the auditory system and a concomitant orienting response. Specifically phasic REM sleep appears to be vulnerable to sensory afferences in ID patients, possibly contributing to the perception of being awake.

Reactivation during sleep with incomplete reminder cues rather than complete ones stabilizes long-term memory in humans

Reactivation by reminder cues labilizes memories during wakefulness, requiring reconsolidation to persist. In contrast, during sleep, cued reactivation seems to directly stabilize memories. In reconsolidation, incomplete reminders are more effective in reactivating memories than complete reminders by inducing a mismatch, i.e. a discrepancy between expected and actual events. Whether mismatch is likewise detected during sleep is unclear. Here we test whether cued reactivation during sleep is more effective for mismatch-inducing incomplete than complete reminders. We first establish that only incomplete but not complete reminders labilize memories during wakefulness. When complete or incomplete reminders are presented during 40-min sleep, both reminders are equally effective in stabilizing memories. However, when extending the retention interval for another 7 hours (following 40-min sleep), only incomplete but not complete reminders stabilize memories, regardless of the extension containing wakefulness or sleep. We propose that, during sleep, only incomplete reminders initiate long-term memory stabilization via mismatch detection.

Forcato et al. show that incomplete reminder cues rather than complete ones stabilize human memories during sleep. This study suggests that only incomplete reminders initiate long-term memory stabilization via mismatch detection during sleep.

Electrophysiological evidence of preserved hearing at the end of life

This study attempts to answer the question: “Is hearing the last to go?” We present evidence of hearing among unresponsive actively dying hospice patients. Individual ERP (MMN, P3a, and P3b) responses to deviations in auditory patterns are reported for conscious young, healthy control participants, as well as for hospice patients, both when the latter were conscious, and again when they became unresponsive to their environment. Whereas the MMN (and perhaps too the P3a) is considered an automatic response to auditory irregularities, the P3b is associated with conscious detection of oddball targets. All control participants, and most responsive hospice patients, evidenced a “local” effect (either a MMN, a P3a, or both) and some a “global” effect (P3b) to deviations in tone, or deviations in auditory pattern. Importantly, most unresponsive patients showed evidence of MMN responses to tone changes, and some showed a P3a or P3b response to either tone or pattern changes. Thus, their auditory systems were responding similarly to those of young, healthy controls just hours from end of life. Hearing may indeed be one of the last senses to lose function as humans die.

Aberrant Prestimulus Oscillations in Developmental Dyslexia Support an Underlying Attention Shifting Deficit

Developmental dyslexia (DD) impairs reading and writing acquisition in 5–10% of children, compromising schooling, academic success, and everyday adult life. DD associates with reduced phonological skills, evident from a reduced auditory mismatch negativity (MMN) in the electroencephalogram (EEG). It was argued that such phonological deficits are secondary to an underlying deficit in the shifting of attention to upcoming speech sounds. Here, we tested whether the aberrant MMN in individuals with DD is a function of EEG correlates of prestimulus attention shifting; based on prior findings, we focused prestimulus analyses on alpha-band oscillations. We administered an audio–visual oddball paradigm to school children with and without DD. Children with DD showed EEG markers of deficient attention switching (i.e., increased prestimulus alpha-band intertrial phase coherence [ITPC]) to precede and predict their reduced MMN—aberrantly increased ITPC predicted an aberrantly reduced MMN. In interaction, ITPC and MMN predicted reading abilities, such that poor readers showed both high ITPC and a reduced MMN, the reverse being true in good readers. Prestimulus ITPC may be an overlooked biomarker of deficient attention shifting in DD. The findings support the proposal that an attention shifting deficit underlies phonological deficits in DD, entailing new opportunities for targeted intervention.

THE EFFECTS OF HYPNOSIS AND HYPNOTIC SUGGESTIONS ON THE MISMATCH NEGATIVITY IN HIGHLY HYPNOTIZABLE SUBJECTS

The neural mechanisms associated with hypnosis were investigated in a group of 9 high hypnotizable subjects by measuring the mismatch negativity (MMN) component of the auditory event-related potential (ERP). ERPs were recorded using a passive oddball paradigm to sinusoidal standard and deviant tone stimuli of 500 and 520 Hz, respectively, in four conditions: prehypnosis, neutral hypnosis, hypnotic suggestion for altering the tone perception, and posthypnotic conditions. Earlier studies have indicated that hypnosis and hypnotic suggestions might have an effect on MMN, but the results of our study contradict these results: No statistically significant differences were found between the conditions in the MMN amplitudes.

Evidence of P3a During Sleep, a Process Associated With Intrusions Into Consciousness in the Waking State

The present study examines processes associated with intrusions into consciousness during an unconscious state, natural sleep. The definition of sleep is still much debated. Almost all researchers agree that sleep onset represents a gradual loss of consciousness of the external environment. For sleep to be beneficial, it needs to remain as undisturbed as possible. Nevertheless, unlike other unconsciousness states, sleep is reversible. For purposes of survival, it is critical that the sleeper be able to “detect” and perhaps become conscious of highly relevant biological or personal information. Therefore, even in sleep, the brain must decide whether a new incoming stimulus is relevant and if so, may require an arousal to wakefulness, or whether it is irrelevant and can be gated to prevent disruption of sleep. Event-related potentials (ERPs) were used to measure the extent processing of auditory stimuli some of which elicited an ERP component, the P3a, in the waking state. The P3a is associated with processes resulting in the interruption of frontal central executive, leading to conscious awareness. Very little research has focused on the occurrence of the P3a during sleep. A multi-feature paradigm was used to examine the processing of a frequently occurring “standard” stimulus and six rarely occurring different “deviant” stimuli during wakefulness, NREM, and REM sleep. A P3a was elicited by novel environmental sounds and white noise bursts in the waking state, replicating previous studies. Other deviant stimuli (changes in pitch, intensity, duration) failed to do so. The ERPs indicated that processing of the stimuli that did not elicit a P3a in wakefulness were much inhibited during both NREM and REM sleep. Surprisingly, those deviants that did elicit a P3a in wakefulness continued to do so in stage N2 and REM sleep. The subject did not, however, awaken. These results suggest processes leading to consciousness in wakefulness may still remain active during sleep possibly allowing subjects to act on potentially highly relevant input. This may also explain how sleep can be reversed if the stimulus input is sufficiently critical.

A Machine Learning Framework for Automatic and Continuous MMN Detection With Preliminary Results for Coma Outcome Prediction

Mismatch negativity (MMN) is a component of the event-related potential (ERP) that is elicited through an odd-ball paradigm. The existence of the MMN in a coma patient has a good correlation with coma emergence; however, this component can be difficult to detect. Previously, MMN detection was based on visual inspection of the averaged ERPs by a skilled clinician, a process that is expensive and not always feasible in practice. In this paper, we propose a practical machine learning (ML) based approach for detection of MMN component, thus, improving the accuracy of prediction of emergence from coma. Furthermore, the method can operate on an automatic and continuous basis thus alleviating the need for clinician involvement. The proposed method is capable of the MMN detection over intervals as short as two minutes. This finer time resolution enables identification of waxing and waning cycles of a conscious state. An auditory odd-ball paradigm was applied to 22 healthy subjects and 2 coma patients. A coma patient is tested by measuring the similarity of the patient's ERP responses with the aggregate healthy responses. Because the training process for measuring similarity requires only healthy subjects, the complexity and practicality of training procedure of the proposed method are greatly improved relative to training on coma patients directly. Since there are only two coma patients involved with this study, the results are reported on a very preliminary basis. Preliminary results indicate we can detect the MMN component with an accuracy of 92.7% on healthy subjects. The method successfully predicted emergence in both coma patients when conventional methods failed. The proposed method for collecting training data using exclusively healthy subjects is a novel approach that may prove useful in future, unrelated studies where ML methods are used.

Processing of auditory novelty across the cortical hierarchy: An intracranial electrophysiology study

Under the predictive coding hypothesis, specific spatiotemporal patterns of cortical activation are postulated to occur during sensory processing as expectations generate feedback predictions and prediction errors generate feedforward signals. Establishing experimental evidence for this information flow within cortical hierarchy has been difficult, especially in humans, due to spatial and temporal limitations of non-invasive measures of cortical activity. This study investigated cortical responses to auditory novelty using the local/global deviant paradigm, which engages the hierarchical network underlying auditory predictive coding over short ('local deviance'; LD) and long ('global deviance'; GD) time scales. Electrocorticographic responses to auditory stimuli were obtained in neurosurgical patients from regions of interest (ROIs) including auditory, auditory-related and prefrontal cortex. LD and GD effects were assayed in averaged evoked potential (AEP) and high gamma (70-150 Hz) signals, the former likely dominated by local synaptic currents and the latter largely reflecting local spiking activity. AEP LD effects were distributed across all ROIs, with greatest percentage of significant sites in core and non-core auditory cortex. High gamma LD effects were localized primarily to auditory cortex in the superior temporal plane and on the lateral surface of the superior temporal gyrus (STG). LD effects exhibited progressively longer latencies in core, non-core, auditory-related and prefrontal cortices, consistent with feedforward signaling. The spatial distribution of AEP GD effects overlapped that of LD effects, but high gamma GD effects were more restricted to non-core areas. High gamma GD effects had shortest latencies in STG and preceded AEP GD effects in most ROIs. This latency profile, along with the paucity of high gamma GD effects in the superior temporal plane, suggest that the STG plays a prominent role in initiating novelty detection signals over long time scales. Thus, the data demonstrate distinct patterns of information flow in human cortex associated with auditory novelty detection over multiple time scales.

Early enhanced processing and delayed habituation to deviance sounds in autism spectrum disorder

Children with autism spectrum disorder (ASD) exhibit difficulties processing and encoding sensory information in daily life. Cognitive response to environmental change in control individuals is naturally dynamic, meaning it habituates or reduces over time as one becomes accustomed to the deviance. The origin of atypical response to deviance in ASD may relate to differences in this dynamic habituation. The current study of 133 children and young adults with and without ASD examined classic electrophysiological responses (MMN and P3a), as well as temporal patterns of habituation (i.e., N1 and P3a change over time) in response to a passive auditory oddball task. Individuals with ASD showed an overall heightened sensitivity to change as exhibited by greater P3a amplitude to novel sounds. Moreover, youth with ASD showed dynamic ERP differences, including slower attenuation of the N1 response to infrequent tones and the P3a response to novel sounds. Dynamic ERP responses were related to parent ratings of auditory sensory-seeking behaviors, but not general cognition. As the first large-scale study to characterize temporal dynamics of auditory ERPs in ASD, our results provide compelling evidence that heightened response to auditory deviance in ASD is largely driven by early sensitivity and prolonged processing of auditory deviance.

Great Expectations: Is there Evidence for Predictive Coding in Auditory Cortex?

Predictive coding is possibly one of the most influential, comprehensive, and controversial theories of neural function. While proponents praise its explanatory potential, critics object that key tenets of the theory are untested or even untestable. The present article critically examines existing evidence for predictive coding in the auditory modality. Specifically, we identify five key assumptions of the theory and evaluate each in the light of animal, human and modeling studies of auditory pattern processing. For the first two assumptions - that neural responses are shaped by expectations and that these expectations are hierarchically organized - animal and human studies provide compelling evidence. The anticipatory, predictive nature of these expectations also enjoys empirical support, especially from studies on unexpected stimulus omission. However, for the existence of separate error and prediction neurons, a key assumption of the theory, evidence is lacking. More work exists on the proposed oscillatory signatures of predictive coding, and on the relation between attention and precision. However, results on these latter two assumptions are mixed or contradictory. Looking to the future, more collaboration between human and animal studies, aided by model-based analyses will be needed to test specific assumptions and implementations of predictive coding - and, as such, help determine whether this popular grand theory can fulfill its expectations.

Initial uncertainty impacts statistical learning in sound sequence processing

This paper features two studies confirming a lasting impact of first learning on how subsequent experience is weighted in early relevance-filtering processes. In both studies participants were exposed to sequences of sound that contained a regular pattern on two different timescales. Regular patterning in sound is readily detected by the auditory system and used to form "prediction models" that define the most likely properties of sound to be encountered in a given context. The presence and strength of these prediction models is inferred from changes in automatically elicited components of auditory evoked potentials. Both studies employed sound sequences that contained both a local and longer-term pattern. The local pattern was defined by a regular repeating pure tone occasionally interrupted by a rare deviating tone (p=0.125) that was physically different (a 30msvs. 60ms duration difference in one condition and a 1000Hz vs. 1500Hz frequency difference in the other). The longer-term pattern was defined by the rate at which the two tones alternated probabilities (i.e., the tone that was first rare became common and the tone that was first common became rare). There was no task related to the tones and participants were asked to ignore them while focussing attention on a movie with subtitles. Auditory-evoked potentials revealed long lasting modulatory influences based on whether the tone was initially encountered as rare and unpredictable or common and predictable. The results are interpreted as evidence that probability (or indeed predictability) assigns a differential information-value to the two tones that in turn affects the extent to which prediction models are updated and imposed. These effects are exposed for both common and rare occurrences of the tones. The studies contribute to a body of work that reveals that probabilistic information is not faithfully represented in these early evoked potentials and instead exposes that predictability (or conversely uncertainty) may trigger value-based learning modulations even in task-irrelevant incidental learning.

Abnormal Complex Auditory Pattern Analysis in Schizophrenia Reflected in an Absent Missing Stimulus Mismatch Negativity

The simple mismatch negativity (MMN) to tones deviating physically (in pitch, loudness, duration, etc.) from repeated standard tones is robustly reduced in schizophrenia. Although generally interpreted to reflect memory or cognitive processes, simple MMN likely contains some activity from non-adapted sensory cells, clouding what process is affected in schizophrenia. Research in healthy participants has demonstrated that MMN can be elicited by deviations from abstract auditory patterns and complex rules that do not cause sensory adaptation. Whether persons with schizophrenia show abnormalities in the complex MMN is unknown. Fourteen schizophrenia participants and 16 matched healthy underwent EEG recording while listening to 400 groups of 6 tones 330 ms apart, separated by 800 ms. Occasional deviant groups were missing the 4th or 6th tone (50 groups each). Healthy participants generated a robust response to a missing but expected tone. The schizophrenia group was significantly impaired in activating the missing stimulus MMN, generating no significant activity at all. Schizophrenia affects the ability of "primitive sensory intelligence" and pre-attentive perceptual mechanisms to form implicit groups in the auditory environment. Importantly, this deficit must relate to abnormalities in abstract complex pattern analysis rather than sensory problems in the disorder. The results indicate a deficit in parsing of the complex auditory scene which likely impacts negatively on successful social navigation in schizophrenia. Knowledge of the location and circuit architecture underlying the true novelty-related MMN and its pathophysiology in schizophrenia will help target future interventions.

Visual Task Demands and the Auditory Mismatch Negativity: An Empirical Study and a Meta-Analysis

Because the auditory system is particularly useful in monitoring the environment, previous research has examined whether task-irrelevant, auditory distracters are processed even if subjects focus their attention on visual stimuli. This research suggests that attentionally demanding visual tasks decrease the auditory mismatch negativity (MMN) to simultaneously presented auditory distractors. Because a recent behavioral study found that high visual perceptual load decreased detection sensitivity of simultaneous tones, we used a similar task (n = 28) to determine if high visual perceptual load would reduce the auditory MMN. Results suggested that perceptual load did not decrease the MMN. At face value, these nonsignificant findings may suggest that effects of perceptual load on the MMN are smaller than those of other demanding visual tasks. If so, effect sizes should differ systematically between the present and previous studies. We conducted a selective meta-analysis of published studies in which the MMN was derived from the EEG, the visual task demands were continuous and varied between high and low within the same task, and the task-irrelevant tones were presented in a typical oddball paradigm simultaneously with the visual stimuli. Because the meta-analysis suggested that the present (null) findings did not differ systematically from previous findings, the available evidence was combined. Results of this meta-analysis confirmed that demanding visual tasks reduce the MMN to auditory distracters. However, because the meta-analysis was based on small studies and because of the risk for publication biases, future studies should be preregistered with large samples (n > 150) to provide confirmatory evidence for the results of the present meta-analysis. These future studies should also use control conditions that reduce confounding effects of neural adaptation, and use load manipulations that are defined independently from their effects on the MMN.

Modulation of pre-attentive spectro-temporal feature processing in the human auditory system by HD-tDCS

The present study examined the functional lateralization of the human auditory cortex (AC) for pre-attentive spectro-temporal feature processing. By using high-definition transcranial direct current stimulation (HD-tDCS), we systematically modulated neuronal activity of the bilateral AC. We assessed the influence of anodal and cathodal HD-tDCS delivered over the left or right AC on auditory mismatch negativity (MMN) in response to temporal as well as spectral deviants in 12 healthy subjects. The results showed that MMN to temporal deviants was significantly enhanced by anodal HD-tDCS applied over the left AC only. Our data indicate a left hemispheric dominance for the pre-attentive processing of low-level temporal information.

A rapid event-related potential (ERP) method for point-of-care evaluation of brain function: development of the Halifax Consciousness Scanner

BACKGROUND

Event-related potentials (ERPs) may provide a non-invasive index of brain function for a range of clinical applications. However, as a lab-based technique, ERPs are limited by technical challenges that prevent full integration into clinical settings.

NEW METHOD

To translate ERP capabilities from the lab to clinical applications, we have developed methods like the Halifax Consciousness Scanner (HCS). HCS is essentially a rapid, automated ERP evaluation of brain functional status. The present study describes the ERP components evoked from auditory tones and speech stimuli. ERP results were obtained using a 5-min test in 100 healthy individuals. The HCS sequence was designed to evoke the N100, the mismatch negativity (MMN), P300, the early negative enhancement (ENE), and the N400. These components reflected sensation, perception, attention, memory, and language perception, respectively. Component detection was examined at group and individual levels, and evaluated across both statistical and classification approaches.

RESULTS

All ERP components were robustly detected at the group level. At the individual level, nonparametric statistical analyses showed reduced accuracy relative to support vector (SVM) machine classification, particularly for speech-based ERPs. Optimized SVM results were MMN: 95.6%; P300: 99.0%; ENE: 91.8%; and N400: 92.3%.

CONCLUSIONS

A spectrum of individual-level ERPs can be obtained in a very short time. Machine learning classification improved detection accuracy across a large healthy control sample. Translating ERPs into clinical applications is increasingly possible at the individual level.

Visual mismatch negativity: a predictive coding view

An increasing number of studies investigate the visual mismatch negativity (vMMN) or use the vMMN as a tool to probe various aspects of human cognition. This paper reviews the theoretical underpinnings of vMMN in the light of methodological considerations and provides recommendations for measuring and interpreting the vMMN. The following key issues are discussed from the experimentalist's point of view in a predictive coding framework: (1) experimental protocols and procedures to control "refractoriness" effects; (2) methods to control attention; (3) vMMN and veridical perception.

Mismatch negativity (MMN) as an index of cognitive dysfunction

Cognition is often affected in a variety of neuropsychiatric, neurological, and neurodevelopmental disorders. The neural discriminative response, reflected in mismatch negativity (MMN) and its magnetoencephalographic equivalent (MMNm), has been used as a tool to study a variety of disorders involving auditory cognition. MMN/MMNm is an involuntary brain response to auditory change or, more generally, to pattern regularity violation. For a number of disorders, MMN/MMNm amplitude to sound deviance has been shown to be attenuated or the peak-latency of the component prolonged compared to controls. This general finding suggests that while not serving as a specific marker to any particular disorder, MMN may be useful for understanding factors of cognition in various disorders, and has potential to serve as an indicator of risk. This review presents a brief history of the MMN, followed by a description of how MMN has been used to index auditory processing capability in a range of neuropsychiatric, neurological, and neurodevelopmental disorders. Finally, we suggest future directions for research to further enhance our understanding of the neural substrate of deviance detection that could lead to improvements in the use of MMN as a clinical tool.

Large-scale synchronized activity during vocal deviance detection in the zebra finch auditory forebrain

Auditory systems bias responses to sounds that are unexpected on the basis of recent stimulus history, a phenomenon that has been widely studied using sequences of unmodulated tones (mismatch negativity; stimulus-specific adaptation). Such a paradigm, however, does not directly reflect problems that neural systems normally solve for adaptive behavior. We recorded multiunit responses in the caudomedial auditory forebrain of anesthetized zebra finches (Taeniopygia guttata) at 32 sites simultaneously, to contact calls that recur probabilistically at a rate that is used in communication. Neurons in secondary, but not primary, auditory areas respond preferentially to calls when they are unexpected (deviant) compared with the same calls when they are expected (standard). This response bias is predominantly due to sites more often not responding to standard events than to deviant events. When two call stimuli alternate between standard and deviant roles, most sites exhibit a response bias to deviant events of both stimuli. This suggests that biases are not based on a use-dependent decrease in response strength but involve a more complex mechanism that is sensitive to auditory deviance per se. Furthermore, between many secondary sites, responses are tightly synchronized, a phenomenon that is driven by internal neuronal interactions rather than by the timing of stimulus acoustic features. We hypothesize that this deviance-sensitive, internally synchronized network of neurons is involved in the involuntary capturing of attention by unexpected and behaviorally potentially relevant events in natural auditory scenes.

A neuronal model of predictive coding accounting for the mismatch negativity

The mismatch negativity (MMN) is thought to index the activation of specialized neural networks for active prediction and deviance detection. However, a detailed neuronal model of the neurobiological mechanisms underlying the MMN is still lacking, and its computational foundations remain debated. We propose here a detailed neuronal model of auditory cortex, based on predictive coding, that accounts for the critical features of MMN. The model is entirely composed of spiking excitatory and inhibitory neurons interconnected in a layered cortical architecture with distinct input, predictive, and prediction error units. A spike-timing dependent learning rule, relying upon NMDA receptor synaptic transmission, allows the network to adjust its internal predictions and use a memory of the recent past inputs to anticipate on future stimuli based on transition statistics. We demonstrate that this simple architecture can account for the major empirical properties of the MMN. These include a frequency-dependent response to rare deviants, a response to unexpected repeats in alternating sequences (ABABAA…), a lack of consideration of the global sequence context, a response to sound omission, and a sensitivity of the MMN to NMDA receptor antagonists. Novel predictions are presented, and a new magnetoencephalography experiment in healthy human subjects is presented that validates our key hypothesis: the MMN results from active cortical prediction rather than passive synaptic habituation.

Cross-diagnostic comparison of duration mismatch negativity and P3a in bipolar disorder and schizophrenia

OBJECTIVES

Bipolar disorder and schizophrenia share common pathophysiological processes and may have similar perceptual abnormalities. Mismatch negativity (MMN) and P3a - event-related potentials associated with auditory preattentional processing - have been extensively studied in schizophrenia, but rarely in bipolar disorder. Furthermore, MMN and P3a have not been examined between diagnostic subgroups of patients with bipolar disorder. We evaluated MMN and P3a in patients with bipolar disorder compared to patients with schizophrenia and healthy controls.

METHODS

MMN and P3a were assessed in 52 bipolar disorder patients, 30 schizophrenia patients, and 27 healthy control subjects during a duration-deviant auditory oddball paradigm.

RESULTS

Significant MMN and P3a amplitude reductions were present in patients with bipolar disorder and schizophrenia relative to controls. The MMN reduction was more prominent in patients with schizophrenia than bipolar disorder, at a trend level. P3a did not differ significantly between patient groups. There were no MMN or P3a differences between patients with bipolar I (n = 34) and bipolar II (n = 18) disorder. Patients with bipolar I disorder failed to show lateralized MMN, in contrast to the other groups. No MMN or P3a differences were found between patients with bipolar disorder taking (n = 12) and not taking (n = 40) lithium, as well as between those taking (n = 30) and not taking (n = 22) antipsychotic medications.

CONCLUSIONS

Patients with bipolar disorder showed deficits in preattentive auditory processing, including MMN deficits that are less severe and P3a deficits that are slightly more pronounced, than those seen in schizophrenia.

Arousal modulates auditory attention and awareness: insights from sleep, sedation, and disorders of consciousness

The interplay between attention and consciousness is frequently tested in altered states of consciousness, including transitions between stages of sleep and sedation, and in pathological disorders of consciousness (DoC; the vegetative and minimally conscious states; VS and MCS). One of the most widely used tasks to assess cognitive processing in this context is the auditory oddball paradigm, where an infrequent change in a sequence of sounds elicits, in awake subjects, a characteristic EEG event-related potential called the mismatch negativity, followed by the classic P300 wave. The latter is further separable into the slightly earlier, anterior P3a and the later, posterior P3b, thought to be linked to task-irrelevant "bottom-up" and task-oriented "top-down" attention, respectively. We discuss here the putative dissociations between attention and awareness in DoC, sedation and sleep, bearing in mind the recently emerging evidence from healthy volunteers and patients. These findings highlight the neurophysiological and cognitive parallels (and differences) across these three distinct variations in levels of consciousness, and inform the theoretical framework for interpreting the role of attention therein.

Electromagnetic correlates of musical expertise in processing of tone patterns

Using magnetoencephalography (MEG), we investigated the influence of long term musical training on the processing of partly imagined tone patterns (imagery condition) compared to the same perceived patterns (perceptual condition). The magnetic counterpart of the mismatch negativity (MMNm) was recorded and compared between musicians and non-musicians in order to assess the effect of musical training on the detection of deviants to tone patterns. The results indicated a clear MMNm in the perceptual condition as well as in a simple pitch oddball (control) condition in both groups. However, there was no significant mismatch response in either group in the imagery condition despite above chance behavioral performance in the task of detecting deviant tones. The latency and the laterality of the MMNm in the perceptual condition differed significantly between groups, with an earlier MMNm in musicians, especially in the left hemisphere. In contrast the MMNm amplitudes did not differ significantly between groups. The behavioral results revealed a clear effect of long-term musical training in both experimental conditions. The obtained results represent new evidence that the processing of tone patterns is faster and more strongly lateralized in musically trained subjects, which is consistent with other findings in different paradigms of enhanced auditory neural system functioning due to long-term musical training.

Finding the missing stimulus mismatch negativity (MMN): emitted MMN to violations of an auditory gestalt

Deviations from repetitive auditory stimuli evoke a mismatch negativity (MMN). Counterintuitively, omissions of repetitive stimuli do not. Violations of patterns reflecting complex rules also evoke MMN. To detect a MMN to missing stimuli, we developed an auditory gestalt task using one stimulus. Groups of six pips (50 ms duration, 330 ms stimulus onset asynchrony [SOA], 400 trials), were presented with an intertrial interval (ITI) of 750 ms while subjects (n=16) watched a silent video. Occasional deviant groups had missing 4th or 6th tones (50 trials each). Missing stimuli evoked a MMN (p<.05). The missing 4th (-0.8 µV, p<.01) and the missing 6th stimuli (-1.1 µV, p<.05) were more negative than standard 6th stimuli (0.3 µV). MMN can be elicited by a missing stimulus at long SOAs by violation of a gestalt grouping rule. Patterned stimuli appear more sensitive to omissions and ITI than homogenous streams.

The mismatch negativity (MMN)--a unique window to disturbed central auditory processing in ageing and different clinical conditions

In this article, we review clinical research using the mismatch negativity (MMN), a change-detection response of the brain elicited even in the absence of attention or behavioural task. In these studies, the MMN was usually elicited by employing occasional frequency, duration or speech-sound changes in repetitive background stimulation while the patient was reading or watching videos. It was found that in a large number of different neuropsychiatric, neurological and neurodevelopmental disorders, as well as in normal ageing, the MMN amplitude was attenuated and peak latency prolonged. Besides indexing decreased discrimination accuracy, these effects may also reflect, depending on the specific stimulus paradigm used, decreased sensory-memory duration, abnormal perception or attention control or, most importantly, cognitive decline. In fact, MMN deficiency appears to index cognitive decline irrespective of the specific symptomatologies and aetiologies of the different disorders involved.

The involvement of noradrenaline in rapid eye movement sleep mentation

Noradrenaline, one of the main brain monoamines, has powerful central influences on forebrain neurobiological processes which support the mental activities occurring during the sleep-waking cycle. Noradrenergic neurons are activated during waking, decrease their firing rate during slow wave sleep, and become silent during rapid eye movement (REM) sleep. Although a low level of noradrenaline is still maintained during REM sleep because of diffuse extrasynaptic release without rapid withdrawal, the decrease observed during REM sleep contributes to the mentation disturbances that occur during dreaming, which principally resemble symptoms of schizophrenia but seemingly also of attention deficit hyperactivity disorder.

Activations of human auditory cortex during visual and auditory selective attention tasks with varying difficulty

The present study was designed to directly test the hypothesis that suppression of activations to task-irrelevant sounds contributes to the attention-related modulations of auditory cortex (AC) activations observed in previous fMRI studies. Subjects selectively attended to auditory (broadband noise bursts with pitch) or visual (Gabor gratings) asynchronous fast-rate stimulus streams concurrently presented to left-ear, right-ear, above-fixation, or below-fixation. Auditory and visual task difficulty was parametrically manipulated in three levels. Behavioral data obtained during fMRI indicated that subjects achieved acceptable performance levels in all tasks and that the task-difficulty manipulation was effective. Consistent with previous studies, AC activations strongly depended on the direction of attention. AC activations to sounds were higher during auditory than during visual tasks and AC activations were higher in the hemisphere contralateral to the attended ear. However, the effects of task difficulty on AC activations were weak or non-existent. In particular, increasing task difficulty was not associated with a systematic decrease of AC activations in areas that were modulated by attention. These results suggest that suppression of AC activations to task-irrelevant sounds is likely to be small or negligible as compared with the strong activation enhancements observed in fMRI during active auditory tasks.