A generic deviance detection principle for cortical On/Off responses, omission response, and mismatch negativity

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Extensive representation of sensory deviance in the responses to auditory gaps in unanesthetized rats

Unexpected changes in incoming sensory streams are associated with large errors in predicting the deviant stimulus relative to a memory trace of past stimuli. Mismatch negativity (MMN) in human studies and the release from stimulus-specific adaptation (SSA) in animal models correlate with prediction errors and deviance detection.¹ In human studies, violation of expectations elicited by an unexpected stimulus omission resulted in an omission MMN.^2,3,4,5 These responses are evoked after the expected occurrence time of the omitted stimulus, implying that they reflect the violation of a temporal expectancy.⁶ Because they are often time locked to the end of the omitted stimulus,^4,6,7 they resemble off responses. Indeed, suppression of cortical activity after the termination of the gap disrupts gap detection, suggesting an essential role for offset responses.⁸ Here, we demonstrate that brief gaps in short noise bursts in the auditory cortex of unanesthetized rats frequently evoke offset responses. Importantly, we show that omission responses are elicited when these gaps are expected but are omitted. These omission responses, together with the release from SSA of both onset and offset responses to rare gaps, form a rich and varied representation of prediction-related signals in the auditory cortex of unanesthetized rats, extending substantially and refining the representations described previously in anesthetized rats.

Neuronal responses to omitted tones in the auditory brain: A neuronal correlate for predictive coding

Prediction provides key advantages for survival, and cognitive studies have demonstrated that the brain computes multilevel predictions. Evidence for predictions remains elusive at the neuronal level because of the complexity of separating neural activity into predictions and stimulus responses. We overcome this challenge by recording from single neurons from cortical and subcortical auditory regions in anesthetized and awake preparations, during unexpected stimulus omissions interspersed in a regular sequence of tones. We find a subset of neurons that responds reliably to omitted tones. In awake animals, omission responses are similar to anesthetized animals, but larger and more frequent, indicating that the arousal and attentional state levels affect the degree to which predictions are neuronally represented. Omission-sensitive neurons also responded to frequency deviants, with their omission responses getting emphasized in the awake state. Because omission responses occur in the absence of sensory input, they provide solid and empirical evidence for the implementation of a predictive process.

Omission responses in local field potentials in rat auditory cortex

BACKGROUND

Non-invasive recordings of gross neural activity in humans often show responses to omitted stimuli in steady trains of identical stimuli. This has been taken as evidence for the neural coding of prediction or prediction error. However, evidence for such omission responses from invasive recordings of cellular-scale responses in animal models is scarce. Here, we sought to characterise omission responses using extracellular recordings in the auditory cortex of anaesthetised rats. We profiled omission responses across local field potentials (LFP), analogue multiunit activity (AMUA), and single/multi-unit spiking activity, using stimuli that were fixed-rate trains of acoustic noise bursts where 5% of bursts were randomly omitted.

RESULTS

Significant omission responses were observed in LFP and AMUA signals, but not in spiking activity. These omission responses had a lower amplitude and longer latency than burst-evoked sensory responses, and omission response amplitude increased as a function of the number of preceding bursts.

CONCLUSIONS

Together, our findings show that omission responses are most robustly observed in LFP and AMUA signals (relative to spiking activity). This has implications for models of cortical processing that require many neurons to encode prediction errors in their spike output.

Simultaneous mnemonic and predictive representations in the auditory cortex

Recent studies have shown that stimulus history can be decoded via the use of broadband sensory impulses to reactivate mnemonic representations.^1-4. However, memories of previous stimuli can also be used to form sensory predictions about upcoming stimuli.^5,6 Predictive mechanisms allow the brain to create a probable model of the outside world, which can be updated when errors are detected between the model predictions and external inputs. ^7-10 Direct recordings in the auditory cortex of awake mice established neural mechanisms for how encoding mechanisms might handle working memory and predictive processes without "overwriting" recent sensory events in instances where predictive mechanisms are triggered by oddballs within a sequence.¹¹ However, it remains unclear whether mnemonic and predictive information can be decoded from cortical activity simultaneously during passive, implicit sequence processing, even in anesthetized models. Here, we recorded neural activity elicited by repeated stimulus sequences using electrocorticography (ECoG) in the auditory cortex of anesthetized rats, where events within the sequence (referred to henceforth as "vowels," for simplicity) were occasionally replaced with a broadband noise burst or omitted entirely. We show that both stimulus history and predicted stimuli can be decoded from neural responses to broadband impulses, at overlapping latencies but based on independent and uncorrelated data features. We also demonstrate that predictive representations are dynamically updated over the course of stimulation.

Neural Substrates and Models of Omission Responses and Predictive Processes

Predictive coding theories argue that deviance detection phenomena, such as mismatch responses and omission responses, are generated by predictive processes with possibly overlapping neural substrates. Molecular imaging and electrophysiology studies of mismatch responses and corollary discharge in the rodent model allowed the development of mechanistic and computational models of these phenomena. These models enable translation between human and non-human animal research and help to uncover fundamental features of change-processing microcircuitry in the neocortex. This microcircuitry is characterized by stimulus-specific adaptation and feedforward inhibition of stimulus-selective populations of pyramidal neurons and interneurons, with specific contributions from different interneuron types. The overlap of the substrates of different types of responses to deviant stimuli remains to be understood. Omission responses, which are observed both in corollary discharge and mismatch response protocols in humans, are underutilized in animal research and may be pivotal in uncovering the substrates of predictive processes. Omission studies comprise a range of methods centered on the withholding of an expected stimulus. This review aims to provide an overview of omission protocols and showcase their potential to integrate and complement the different models and procedures employed to study prediction and deviance detection.This approach may reveal the biological foundations of core concepts of predictive coding, and allow an empirical test of the framework's promise to unify theoretical models of attention and perception.

Cortical Microcircuit Mechanisms of Mismatch Negativity and Its Underlying Subcomponents

In the neocortex, neuronal processing of sensory events is significantly influenced by context. For instance, responses in sensory cortices are suppressed to repetitive or redundant stimuli, a phenomenon termed “stimulus-specific adaptation” (SSA). However, in a context in which that same stimulus is novel, or deviates from expectations, neuronal responses are augmented. This augmentation is termed “deviance detection” (DD). This contextual modulation of neural responses is fundamental for how the brain efficiently processes the sensory world to guide immediate and future behaviors. Notably, context modulation is deficient in some neuropsychiatric disorders such as schizophrenia (SZ), as quantified by reduced “mismatch negativity” (MMN), an electroencephalography waveform reflecting a combination of SSA and DD in sensory cortex. Although the role of NMDA-receptor function and other neuromodulatory systems on MMN is established, the precise microcircuit mechanisms of MMN and its underlying components, SSA and DD, remain unknown. When coupled with animal models, the development of powerful precision neurotechnologies over the past decade carries significant promise for making new progress into understanding the neurobiology of MMN with previously unreachable spatial resolution. Currently, rodent models represent the best tool for mechanistic study due to the vast genetic tools available. While quantifying human-like MMN waveforms in rodents is not straightforward, the “oddball” paradigms used to study it in humans and its underlying subcomponents (SSA/DD) are highly translatable across species. Here we summarize efforts published so far, with a focus on cortically measured SSA and DD in animals to maintain relevance to the classically measured MMN, which has cortical origins. While mechanistic studies that measure and contrast both components are sparse, we synthesize a potential set of microcircuit mechanisms from the existing rodent, primate, and human literature. While MMN and its subcomponents likely reflect several mechanisms across multiple brain regions, understanding fundamental microcircuit mechanisms is an important step to understand MMN as a whole. We hypothesize that SSA reflects adaptations occurring at synapses along the sensory-thalamocortical pathways, while DD depends on both SSA inherited from afferent inputs and resulting disinhibition of non-adapted neurons arising from the distinct physiology and wiring properties of local interneuronal subpopulations and NMDA-receptor function.