Cortical mapping of mismatch responses to independent acoustic features

Omission responses in local field potentials in rat auditory cortex

BACKGROUND

Non-invasive recordings of gross neural activity in humans often show responses to omitted stimuli in steady trains of identical stimuli. This has been taken as evidence for the neural coding of prediction or prediction error. However, evidence for such omission responses from invasive recordings of cellular-scale responses in animal models is scarce. Here, we sought to characterise omission responses using extracellular recordings in the auditory cortex of anaesthetised rats. We profiled omission responses across local field potentials (LFP), analogue multiunit activity (AMUA), and single/multi-unit spiking activity, using stimuli that were fixed-rate trains of acoustic noise bursts where 5% of bursts were randomly omitted.

RESULTS

Significant omission responses were observed in LFP and AMUA signals, but not in spiking activity. These omission responses had a lower amplitude and longer latency than burst-evoked sensory responses, and omission response amplitude increased as a function of the number of preceding bursts.

CONCLUSIONS

Together, our findings show that omission responses are most robustly observed in LFP and AMUA signals (relative to spiking activity). This has implications for models of cortical processing that require many neurons to encode prediction errors in their spike output.

Hierarchical Deviant Processing in Auditory Cortex of Awake Mice

Detecting patterns, and noticing unexpected pattern changes, in the environment is a vital aspect of sensory processing. Adaptation and prediction error responses are two components of neural processing related to these tasks, and previous studies in the auditory system in rodents show that these two components are partially dissociable in terms of the topography and latency of neural responses to sensory deviants. However, many previous studies have focused on repetitions of single stimuli, such as pure tones, which have limited ecological validity. In this study, we tested whether the auditory cortical activity shows adaptation to repetition of more complex sound patterns (bisyllabic pairs). Specifically, we compared neural responses to violations of sequences based on single stimulus probability only, against responses to more complex violations based on stimulus order. We employed an auditory oddball paradigm and monitored the auditory cortex (ACtx) activity of awake mice (N=8) using wide-field calcium imaging. We found that cortical responses were sensitive both to single stimulus probabilities and to more global stimulus patterns, as mismatch signals were elicited following both substitution deviants and transposition deviants. Notably, A2 area elicited larger mismatch signaling to those deviants than primary ACtx (A1), which suggests a hierarchical gradient of prediction error signaling in the auditory cortex. Such a hierarchical gradient was observed for late but not early peaks of calcium transients to deviants, suggesting that the late part of the deviant response may reflect prediction error signaling in response to more complex sensory pattern violations.

Predictive encoding of pure tones and FM-sweeps in the human auditory cortex

Expectations substantially influence perception, but the neural mechanisms underlying this influence are not fully understood. A prominent view is that sensory neurons encode prediction error with respect to expectations on upcoming sensory input. Although the encoding of prediction error has been previously demonstrated in the human auditory cortex (AC), previous studies often induced expectations using stimulus repetition, potentially confounding prediction error with neural habituation. These studies also measured AC as a single population, failing to consider possible predictive specializations of different AC fields. Moreover, the few studies that considered prediction error to stimuli other than pure tones yielded conflicting results. Here, we used functional magnetic resonance imaging (fMRI) to systematically investigate prediction error to subjective expectations in auditory cortical fields Te1.0, Te1.1, Te1.2, and Te3, and two types of stimuli: pure tones and frequency modulated (FM) sweeps. Our results show that prediction error is elicited with respect to the participants' expectations independently of stimulus repetition and similarly expressed across auditory fields. Moreover, despite the radically different strategies underlying the decoding of pure tones and FM-sweeps, both stimulus modalities were encoded as prediction error in most fields of AC. Altogether, our results provide unequivocal evidence that predictive coding is the general encoding mechanism in AC.

Modelling mouse auditory response dynamics along a continuum of consciousness using a deep recurrent neural network

Objective Understanding neurophysiological changes that accompany transitions between anaesthetized and conscious states is a key objective of anesthesiology and consciousness science. This study aimed to characterize the dynamics of auditory-evoked potential morphology in mice along a continuum of consciousness. Approach Epidural field potentials were recorded from above the primary auditory cortices of two groups of laboratory mice: urethane-anaesthetized (A, n = 14) and conscious (C, n = 17). Both groups received auditory stimulation in the form of a repeated pure-tone stimulus, before and after receiving 10 mg/kg i.p. ketamine (AK and CK). Evoked responses were then ordered by ascending sample entropy into AK, A, CK, and C, considered to reflect physiological correlates of awareness. These data were used to train a recurrent neural network (RNN) with an input parameter encoding state. Model outputs were compared with grand-average event-related potential (ERP) waveforms. Subsequently, the state parameter was varied to simulate changes in the ERP that occur during transitions between states, and relationships with dominant peak amplitudes were quantified. Main results The RNN synthesized output waveforms that were in close agreement with grand-average ERPs for each group (r2 > 0.9, p < 0.0001). Varying the input state parameter generated model outputs reflecting changes in ERP morphology predicted to occur between states. Positive peak amplitudes within 25 to 50 ms, and negative peak amplitudes within 50 to 75 ms post-stimulus-onset, were found to display a sigmoidal characteristic during the transition from anaesthetized to conscious states. In contrast, negative peak amplitudes within 0 to 25 ms displayed greater linearity. Significance This study demonstrates a method for modelling changes in ERP morphology that accompany transitions between states of consciousness using a RNN. In future studies, this approach may be applied to human data to support the clinical use of ERPs to predict transition to consciousness.

Frontotemporal network in automatic / pre-attentive detection of abstract change: An event-related optical signal (EROS) study

The human brain constantly monitors the environment for unexpected changes. Under the prediction violation account, the Inferior Frontal Cortex (IFC) is involved in prediction-related processes for deviance detection processes in the Superior Temporal Cortex (STC). Consistent with this account, previous studies revealed an IFC-to-STC-followed-by-IFC mismatch response pattern to physical changes using event-related optical signals (EROS). However, detecting physical changes can be achieved by direct comparison of physical features between stimuli without making predictions, thus direct evidence supporting the prediction nature of the IFC-STC network in pre-attentive change detection was lacking. To address this issue, this study examined the EROS mismatch responses of the IFC-STC network when detecting the violation of an abstract rule. The rule "the higher the frequency of a tone, the stronger the intensity" established by standards was violated by deviants of 12 deviance levels. When deviants were preceded by a short train of standards, early IFC, STC, and late IFC EROS mismatch responses linearly increased with the deviance levels. When deviants were preceded by a longer train of standards, the STC but not the early or late IFC EROS mismatch responses were elicited by all the deviants without modulation by deviance levels. These results demonstrate a functional role of the IFC in the abstract change detection when insufficient rule-conforming information could be extracted from the preceding standards and are consistent with the predictive violation account of pre-attentive change detection.

Roving oddball paradigm elicits sensory gating, frequency sensitivity, and long-latency response in common marmosets

Mismatch negativity (MMN) is a candidate biomarker for neuropsychiatric disease. Understanding the extent to which it reflects cognitive deviance-detection or purely sensory processes will assist practitioners in making informed clinical interpretations. This study compares the utility of deviance-detection and sensory-processing theories for describing MMN-like auditory responses of a common marmoset monkey during roving oddball stimulation. The following exploratory analyses were performed on an existing dataset: responses during the transition and repetition sequence of the roving oddball paradigm (standard -> deviant/S1 -> S2 -> S3) were compared; long-latency potentials evoked by deviant stimuli were examined using a double-epoch waveform subtraction; effects of increasing stimulus repetitions on standard and deviant responses were analyzed; and transitions between standard and deviant stimuli were divided into ascending and descending frequency changes to explore contributions of frequency-sensitivity. An enlarged auditory response to deviant stimuli was observed. This decreased exponentially with stimulus repetition, characteristic of sensory gating. A slow positive deflection was viewed over approximately 300–800 ms after the deviant stimulus, which is more difficult to ascribe to afferent sensory mechanisms. When split into ascending and descending frequency transitions, the resulting difference waveforms were disproportionally influenced by descending frequency deviant stimuli. This asymmetry is inconsistent with the general deviance-detection theory of MMN. These findings tentatively suggest that MMN-like responses from common marmosets are predominantly influenced by rapid sensory adaptation and frequency preference of the auditory cortex, while deviance-detection may play a role in long-latency activity.

A Critical Review of the Deviance Detection Theory of Mismatch Negativity

Mismatch negativity (MMN) is a component of the difference waveform derived from passive auditory oddball stimulation. Since its inception in 1978, this has become one of the most popular event-related potential techniques, with over two-thousand published studies using this method. This is a testament to the ingenuity and commitment of generations of researchers engaging in basic, clinical and animal research. Despite this intensive effort, high-level descriptions of the mechanisms theorized to underpin mismatch negativity have scarcely changed over the past four decades. The prevailing deviance detection theory posits that MMN reflects inattentive detection of difference between repetitive standard and infrequent deviant stimuli due to a mismatch between the unexpected deviant and a memory representation of the standard. Evidence for these mechanisms is inconclusive, and a plausible alternative sensory processing theory considers fundamental principles of sensory neurophysiology to be the primary source of differences between standard and deviant responses evoked during passive oddball stimulation. By frequently being restated without appropriate methods to exclude alternatives, the potentially flawed deviance detection theory has remained largely dominant, which could lead some researchers and clinicians to assume its veracity implicitly. It is important to have a more comprehensive understanding of the source(s) of MMN generation before its widespread application as a clinical biomarker. This review evaluates issues of validity concerning the prevailing theoretical account of mismatch negativity and the passive auditory oddball paradigm, highlighting several limitations regarding its interpretation and clinical application.

Do Auditory Mismatch Responses Differ Between Acoustic Features?

Mismatch negativity (MMN) is the electroencephalographic (EEG) waveform obtained by subtracting event-related potential (ERP) responses evoked by unexpected deviant stimuli from responses evoked by expected standard stimuli. While the MMN is thought to reflect an unexpected change in an ongoing, predictable stimulus, it is unknown whether MMN responses evoked by changes in different stimulus features have different magnitudes, latencies, and topographies. The present study aimed to investigate whether MMN responses differ depending on whether sudden stimulus change occur in pitch, duration, location or vowel identity, respectively. To calculate ERPs to standard and deviant stimuli, EEG signals were recorded in normal-hearing participants (N = 20; 13 males, 7 females) who listened to roving oddball sequences of artificial syllables. In the roving paradigm, any given stimulus is repeated several times to form a standard, and then suddenly replaced with a deviant stimulus which differs from the standard. Here, deviants differed from preceding standards along one of four features (pitch, duration, vowel or interaural level difference). The feature levels were individually chosen to match behavioral discrimination performance. We identified neural activity evoked by unexpected violations along all four acoustic dimensions. Evoked responses to deviant stimuli increased in amplitude relative to the responses to standard stimuli. A univariate (channel-by-channel) analysis yielded no significant differences between MMN responses following violations of different features. However, in a multivariate analysis (pooling information from multiple EEG channels), acoustic features could be decoded from the topography of mismatch responses, although at later latencies than those typical for MMN. These results support the notion that deviant feature detection may be subserved by a different process than general mismatch detection.

Learning boosts the decoding of sound sequences in rat auditory cortex

Continuous acoustic streams, such as speech signals, can be chunked into segments containing reoccurring patterns (e.g., words). Noninvasive recordings of neural activity in humans suggest that chunking is underpinned by low-frequency cortical entrainment to the segment presentation rate, and modulated by prior segment experience (e.g., words belonging to a familiar language). Interestingly, previous studies suggest that also primates and rodents may be able to chunk acoustic streams. Here, we test whether neural activity in the rat auditory cortex is modulated by previous segment experience. We recorded subdural responses using electrocorticography (ECoG) from the auditory cortex of 11 anesthetized rats. Prior to recording, four rats were trained to detect familiar triplets of acoustic stimuli (artificial syllables), three were passively exposed to the triplets, while another four rats had no training experience. While low-frequency neural activity peaks were observed at the syllable level, no triplet-rate peaks were observed. Notably, in trained rats (but not in passively exposed and naïve rats), familiar triplets could be decoded more accurately than unfamiliar triplets based on neural activity in the auditory cortex. These results suggest that rats process acoustic sequences, and that their cortical activity is modulated by the training experience even under subsequent anesthesia.

•

Rats could behaviourally differentiate acoustic stimulus triplets after training.

•

Learning relatively increased auditory cortical entrainment to triplets.

•

Learning improved decoding of familiar stimuli based on auditory cortical activity.