Effects of a violation of an expected increase or decrease in intensity on detection of change within an auditory pattern

Auditory Processing of Intonational Rises and Falls in German: Rises Are Special in Attention Orienting

This article investigates the processing of intonational rises and falls when presented unexpectedly in a stream of repetitive auditory stimuli. It examines the neurophysiological correlates (ERPs) of attention to these unexpected stimuli through the use of an oddball paradigm where sequences of repetitive stimuli are occasionally interspersed with a deviant stimulus, allowing for elicitation of an MMN. Whereas previous oddball studies on attention toward unexpected sounds involving pitch rises were conducted on nonlinguistic stimuli, the present study uses as stimuli lexical items in German with naturalistic intonation contours. Results indicate that rising intonation plays a special role in attention orienting at a pre-attentive processing stage, whereas contextual meaning (here a list of items) is essential for activating attentional resources at a conscious processing stage. This is reflected in the activation of distinct brain responses: Rising intonation evokes the largest MMN, whereas falling intonation elicits a less pronounced MMN followed by a P3 (reflecting a conscious processing stage). Subsequently, we also find a complex interplay between the phonological status (i.e., accent/head marking vs. boundary/edge marking) and the direction of pitch change in their contribution to attention orienting: Attention is not oriented necessarily toward a specific position in prosodic structure (head or edge). Rather, we find that the intonation contour itself and the appropriateness of the contour in the linguistic context are the primary cues to two core mechanisms of attention orienting, pre-attentive and conscious orientation respectively, whereas the phonological status of the pitch event plays only a supplementary role.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Late N1 and Post Imperative Negative Variation analysis depending on the previous trial history in paradigms of increasing auditory complexity

Predictive coding reflects the ability of the human brain to extract environmental patterns in order to reformulate previous expectations. The present report analyzes through the late N1 auditory component and the post imperative negative variation (PINV) the updating of predictions regarding the characteristics of a new trial, depending on the previous trial history, complexity, and type of trial (standard or deviant). Data were obtained from 31 healthy subjects recorded in a previous study, based on two paradigms composed of stimulus sequences of decreasing or increasing frequencies intermingled with the sporadic appearance of unexpected tone endings. Our results showed a higher amplitude for the most complex condition and deviant trials for both the late N1 and the PINV components. Additionally, the N1 and PINV presented a different amplitude response to the standard and deviant trials as a function of previous trial history, suggesting a continuous updating of trial categorization. The results suggest that the late N1 and PINV components are involved in the generation of an internal model about the rules of external auditory stimulation.

Can intensity modulation of the auditory response explain intensity-decrement mismatch negativity?

Mismatch negativity (MMN) elicited by decrements in sound pressure level has been asserted as evidence for its dependence upon general deviance detection, while refuting the proposition that it is simply caused by modulating the intrinsic sensory response with different physical properties of sound. However, reports of intensity-decrement MMN are sparse compared with MMN to stimulus frequency or duration changes, and verifying the mechanisms that shape difference waveform morphology is essential for their responsible use as clinical biomarkers. In the present study, open-access EEG data from 40 healthy young adults recorded during an intensity-decrement oddball paradigm was analyzed to establish the effects of transitions between different level stimuli on the auditory evoked response. Standard stimuli were 80 dB and deviant stimuli were 70 dB. Event-related potentials were extracted from standards after standards (sS), deviants after standards (sD), and standards after deviants (dS). Mean amplitude across a recommended measurement window for MMN (125 to 225 ms) was calculated for each ERP waveform. This revealed statistically significant negative amplitude shift elicited by lower-intensity deviant stimuli, as expected, and an opposite direction, positive amplitude shift elicited by higher-intensity standard stimuli that followed lower-intensity deviants, relative to standard stimuli presented consecutively. These findings indicate that intensity-modulation of the auditory response influences cortical activity measured during the latency range of MMN. To what extent the hypothesized deviance detection mechanisms may also contribute is uncertain and remains to be elucidated.

The effects of sleep on objective measures of gap detection using a time-efficient multi-deviant paradigm

Auditory temporal resolution, measured through gap detection, is critical for the perception of speech. A time-efficient multi-deviant paradigm has previously been developed for gap detection. The purpose of the present study was to determine if this multi-deviant paradigm could be used for gap detection during NREM sleep. ERPs were recorded in 10 young adults while awake and during the first two hours of NREM sleep. A multi-deviant paradigm was employed with six different deviants varying in gap duration, ranging from 2 to 40 ms. During waking, a DRN was observed for the 10, 20, 30 and 40 ms gaps. The DRN was absent during sleep. A P2 was present in NREM for the 20, 30 and 40 ms gaps followed by a P3a to the 30 and 40 ms gaps. An N350 was observed following the 10, 20, 30 and 40 ms gaps. Previous studies have reported significant ERPs to gaps having shorter durations than the present study. The multi-deviant paradigm may not be suitable for the determination of gap threshold during sleep. Nevertheless, it provides an exquisite means to determine perceptibility and the extent of processing of longer duration, supra-threshold gaps during sleep.

Making Sense of Mismatch Negativity

Evoked potentials provide valuable insight into brain processes that are integral to our ability to interact effectively and efficiently in the world. The mismatch negativity (MMN) component of the evoked potential has proven highly informative on the ways in which sensitivity to regularity contributes to perception and cognition. This review offers a compendium of research on MMN with a view to scaffolding an appreciation for its use as a tool to explore the way regularities contribute to predictions about the sensory environment over many timescales. In compiling this work, interest in MMN as an index of sensory encoding and memory are addressed, as well as attention. Perspectives on the possible underlying computational processes are reviewed as well as recent observations that invite consideration of how MMN relates to how we learn, what we learn, and why.

The Neuronal Basis of Predictive Coding Along the Auditory Pathway: From the Subcortical Roots to Cortical Deviance Detection

In this review, we attempt to integrate the empirical evidence regarding stimulus-specific adaptation (SSA) and mismatch negativity (MMN) under a predictive coding perspective (also known as Bayesian or hierarchical-inference model). We propose a renewed methodology for SSA study, which enables a further decomposition of deviance detection into repetition suppression and prediction error, thanks to the use of two controls previously introduced in MMN research: the many-standards and the cascade sequences. Focusing on data obtained with cellular recordings, we explain how deviance detection and prediction error are generated throughout hierarchical levels of processing, following two vectors of increasing computational complexity and abstraction along the auditory neuraxis: from subcortical toward cortical stations and from lemniscal toward nonlemniscal divisions. Then, we delve into the particular characteristics and contributions of subcortical and cortical structures to this generative mechanism of hierarchical inference, analyzing what is known about the role of neuromodulation and local microcircuitry in the emergence of mismatch signals. Finally, we describe how SSA and MMN are occurring at similar time frame and cortical locations, and both are affected by the manipulation of N-methyl- D-aspartate receptors. We conclude that there is enough empirical evidence to consider SSA and MMN, respectively, as the microscopic and macroscopic manifestations of the same physiological mechanism of deviance detection in the auditory cortex. Hence, the development of a common theoretical framework for SSA and MMN is all the more recommendable for future studies. In this regard, we suggest a shared nomenclature based on the predictive coding interpretation of deviance detection.

Dysfunction of Pre-Attentive Visual Information Processing in Drug-Naïve Women, But Not Men, During the Initial Episode of Major Depressive Disorder

Women are twice as likely as men to develop depression. Few studies have explored gender difference in cognitive function of patients with MDD. The gender difference in the pre-attentive information processing of MDD patients is still poorly understood. To examine the gender differences in change detection, 30 medication-free MDD patients (15 women) and 30 age and education matched controls (15 women) were recruited. The deviant-standard reverse oddball paradigm (50 ms/150 ms) was used to obtain the visual mismatch negativity (vMMN) in first episode MDD patients. Compared to men with MDD, women with MDD showed a significantly decreased increment vMMN, while no gender difference in decrement vMMN was found. The increment vMMN amplitude in MDD women was smaller than in healthy women, whereas no difference was found in decrement vMMN. Neither increment nor decrement vMMN differed between MDD men and healthy men. The mean amplitude of increment vMMN was not correlated with symptoms of MDD in MDD patients and MDD women. To conclude, the dysfunction of visual information processing existed at pre-attentive stage in MDD women.

Mismatch negativity (MMN) as an index of cognitive dysfunction

Cognition is often affected in a variety of neuropsychiatric, neurological, and neurodevelopmental disorders. The neural discriminative response, reflected in mismatch negativity (MMN) and its magnetoencephalographic equivalent (MMNm), has been used as a tool to study a variety of disorders involving auditory cognition. MMN/MMNm is an involuntary brain response to auditory change or, more generally, to pattern regularity violation. For a number of disorders, MMN/MMNm amplitude to sound deviance has been shown to be attenuated or the peak-latency of the component prolonged compared to controls. This general finding suggests that while not serving as a specific marker to any particular disorder, MMN may be useful for understanding factors of cognition in various disorders, and has potential to serve as an indicator of risk. This review presents a brief history of the MMN, followed by a description of how MMN has been used to index auditory processing capability in a range of neuropsychiatric, neurological, and neurodevelopmental disorders. Finally, we suggest future directions for research to further enhance our understanding of the neural substrate of deviance detection that could lead to improvements in the use of MMN as a clinical tool.

Event-related potential measures of a violation of an expected increase and decrease in intensity

Unexpected physical increases in the intensity of a frequently occurring “standard” auditory stimulus are experienced as obtrusive. This could either be because of a physical change, the increase in intensity of the “deviant” stimulus, or a psychological change, the violation of the expectancy for the occurrence of the lower intensity standard stimulus. Two experiments were run in which event-related potentials (ERPs) were recorded to determine whether “psychological” increments (violation of an expectancy for a lower intensity) would be processed differently than psychological decrements (violation of an expectancy for a higher intensity). Event-related potentials (ERPs) were recorded while subjects were presented with auditory tones that alternated between low and high intensity. The subjects ignored the auditory stimuli while watching a video. Deviants were created by repeating the same stimulus. In the first experiment, pairs of stimuli alternating in intensity, were presented in separate increment (H-L…H-L…H-H…H-L, in which H = 80 dB SPL and L = 60 dB SPL) and decrement conditions (L-H…L-H…L-L… L-H, in which H = 90 dB SPL and L = 80 dB SPL). The paradigm employed in the second experiment consisted of an alternating intensity pattern (H-L-H-L-H-H-H-L) or (H-L-H-L-L-L-H-L). Importantly, the stimulus prior to the deviant (the standard) and the actual deviants in both increment and decrement conditions in both experiments were physically identical (80 dB SPL tones). The repetition of the lower intensity tone therefore acted as a psychological rather than a physical decrement (a higher intensity tone was expected) while the repetition of the higher intensity tone acted as a psychological increment (a lower intensity tone was expected). The psychological increments in both experiments elicited a larger amplitude mismatch negativity (MMN) than the decrements. Thus, regardless of whether an acoustic change signals a physical increase in intensity or violates an expected decrease in intensity, a large MMN will be elicited.