Memory trace formation for abstract auditory features and its consequences in different attentional contexts

Correlation of motor-auditory cross-modal and auditory unimodal N1 and mismatch responses of schizophrenic patients and normal subjects: an MEG study

Introduction

It has been suggested that the positive symptoms of schizophrenic patients (hallucinations, delusions, and passivity experience) are caused by dysfunction of their internal and external sensory prediction errors. This is often discussed as related to dysfunction of the forward model that executes self-monitoring. Several reports have suggested that dysfunction of the forward model in schizophrenia causes misattributions of self-generated thoughts and actions to external sources. There is some evidence that the forward model can be measured using the electroencephalography (EEG) and magnetoencephalography (MEG) components such as N1 (m) and mismatch negativity (MMN) (m). The objective in this MEG study is to investigate differences in the N1m and MMNm-like activity generated in motor-auditory cross-modal tasks in normal control (NC) subjects and schizophrenic (SC) patients, and compared that activity with N1m and MMNm in the auditory unimodal task.

Methods

The N1m and MMNm/MMNm-like activity were recorded in 15 SC patients and 12 matched NC subjects. The N1m-attenuation effects and peak amplitude of MMNm/MMNm-like activity of the NC and SC groups were compared. Additionally, correlations between MEG measures (N1m suppression rate, MMNm, and MMNm-like activity) and clinical variables (Positive and Negative Syndrome Scale (PANSS) scores and antipsychotic drug (APD) dosages) in SC patients were investigated.

Results

It was found that (i) there was no significant difference in N1m-attenuation for the NC and SC groups, and that (ii) MMNm in the unimodal task in the SC group was significantly smaller than that in the NC group. Further, the MMNm-like activity in the cross-modal task was smaller than that of the MMNm in the unimodal task in the NC group, but there was no significant difference in the SC group. The PANSS positive symptoms and general psychopathology score were moderately negatively correlated with the amplitudes of the MMNm-like activity, and the APD dosage was moderately negatively correlated with the N1m suppression rate. However, none of these correlations reached statistical significance.

Discussion

The findings suggest that schizophrenic patients perform altered predictive processes differently from healthy subjects in latencies reflecting MMNm, depending on whether they are under forward model generation or not. This may support the hypothesis that schizophrenic patients tend to misattribute their inner experience to external agents, thus leading to the characteristic schizophrenia symptoms.

Effects of iron supplementation on neural indices of habituation in Bangladeshi children

BACKGROUND

Iron deficiency and anemia have been associated with poor cognition in children, yet the effects of iron supplementation on neurocognition remain unclear.

OBJECTIVE

We aimed to examine the effects of supplementation with iron on neural indices of habituation using auditory event-related brain potentials (ERPs).

METHODS

This substudy was nested within a 3-arm, double-blind, double-dummy, individual randomized trial in Bangladesh, in which 3300 8-mo-old children were randomly selected to receive 3 mo of daily iron syrup (12.5 mg iron), multiple micronutrient powders (MNPs) (including 12.5 mg iron), or placebo. Children were assessed after 3 mo of intervention (mo 3) and 9 mo thereafter (mo 12). The neurocognitive substudy comprised a randomly selected subset of children from the main trial. Brain activity elicited during an auditory roving oddball task was recorded using electroencephalography to provide an index of habituation. The differential response to a novel (deviant) compared with a repeated (standard) sound was examined. The primary outcome was the amplitude of the mismatch response (deviant minusstandard tone waveforms) at mo 3. Secondary outcomes included the deviant and standard tone-evoked amplitudes, N2 amplitude differences, and differences in mean amplitudes evoked by deviant tones presented in the second compared with first half of the oddball sequence at mo 3 and 12.

RESULTS

Data were analyzed from 329 children at month 3 and 363 at mo 12. Analyses indicated no treatment effects of iron interventions compared with placebo on the amplitude of the mismatch response (iron syrup compared with placebo: mean difference (MD) = 0.07μV [95% CI: -1.22, 1.37]; MNPs compared with placebo: MD = 0.58μV [95% CI: -0.74, 1.90]) nor any secondary ERP outcomes at mo 3 or 12, despite improvements in hemoglobin and ferritin concentrations from iron syrup and MNPs in this nested substudy.

CONCLUSION

In Bangladeshi children with >40% anemia prevalence, iron or MNP interventions alone are insufficient to improve neural indices of habituation. This trial was registered at the Australian New Zealand Clinical Trials Registry as ACTRN12617000660381.

Distraction by violation of sensory predictions: Functional distinction between deviant sounds and unexpected silences

It has been established that participants performing a continuous categorization task respond significantly slower following the presentation of unexpected, task-irrelevant, auditory stimuli, compared to a repetitive (standard) sound. Evidence indicates that such distraction emerges because of the violation of sensory predictions. This has typically been studied by measuring the impact of replacing the repeated sound by a different sound on rare and unpredictable trials. Here, we examine the impact of a different type of violation: the mere omission of the standard sound. Capitalizing upon the recent finding that deviant sounds exert distinct effects on response times as a function of whether participants produced or withheld a response on the previous trial, we present the results of an experiment seeking to disentangle two potential effects of sound omission: deviance distraction and the removal of an unspecific warning signal. The results indicate that deviant sound and the unexpected omission of the standard sound impact response times through, at least partially, distinct mechanisms. Deviant sounds affect performance by triggering the orienting of attention towards a new sensory input. Sound omissions, in contrast, appear to affect performance in part because responses no longer benefit from an unspecific warning signal to prepare for action.

Formant-invariant voice and pitch representations are pre-attentively formed from constantly varying speech and non-speech stimuli

The present study investigated whether listeners can form abstract voice representations while ignoring constantly changing phonological information and if they can use the resulting information to facilitate voice change detection. Further, the study aimed at understanding whether the use of abstraction is restricted to the speech domain or can be deployed also in non‐speech contexts. We ran an electroencephalogram (EEG) experiment including one passive and one active oddball task, each featuring a speech and a rotated speech condition. In the speech condition, participants heard constantly changing vowels uttered by a male speaker (standard stimuli) which were infrequently replaced by vowels uttered by a female speaker with higher pitch (deviant stimuli). In the rotated speech condition, participants heard rotated vowels, in which the natural formant structure of speech was disrupted. In the passive task, the mismatch negativity was elicited after the presentation of the deviant voice in both conditions, indicating that listeners could successfully group together different stimuli into a formant‐invariant voice representation. In the active task, participants showed shorter reaction times (RTs), higher accuracy and a larger P3b in the speech condition with respect to the rotated speech condition. Results showed that whereas at a pre‐attentive level the cognitive system can track pitch regularities while presumably ignoring constantly changing formant information both in speech and in rotated speech, at an attentive level the use of such information is facilitated for speech. This facilitation was also testified by a stronger synchronisation in the theta band (4–7 Hz), potentially pointing towards differences in encoding/retrieval processes.

Late N1 and Post Imperative Negative Variation analysis depending on the previous trial history in paradigms of increasing auditory complexity

Predictive coding reflects the ability of the human brain to extract environmental patterns in order to reformulate previous expectations. The present report analyzes through the late N1 auditory component and the post imperative negative variation (PINV) the updating of predictions regarding the characteristics of a new trial, depending on the previous trial history, complexity, and type of trial (standard or deviant). Data were obtained from 31 healthy subjects recorded in a previous study, based on two paradigms composed of stimulus sequences of decreasing or increasing frequencies intermingled with the sporadic appearance of unexpected tone endings. Our results showed a higher amplitude for the most complex condition and deviant trials for both the late N1 and the PINV components. Additionally, the N1 and PINV presented a different amplitude response to the standard and deviant trials as a function of previous trial history, suggesting a continuous updating of trial categorization. The results suggest that the late N1 and PINV components are involved in the generation of an internal model about the rules of external auditory stimulation.

Differential effects of gender on mismatch negativity to violations of simple and pattern acoustic regularities

INTRODUCTION

The effects of gender on the mismatch negativity (MMN) potential have been studied using simple frequency deviants. However, the effects of gender on MMN to violations of abstract regularities have not yet been studied. Here, we addressed this issue and compared the effects of gender on simple and pattern frequency MMNs.

METHODS

MMN response was recorded from 29 healthy young adults, 14 females (mean age = 26.20 ± 2.17) and 15 males (mean age = 27.57 ± 2.24), using 32 scalp electrodes during simple and pattern frequency oddball paradigms and the mean amplitude, peak latency, and scalp topography of MMN evoked by each paradigm were compared between the two genders.

RESULTS

The peak latency of simple MMN was significantly longer in females (p < .05); however, its mean amplitude and topography were similar between the two genders (p > .05). There were no significant differences in peak latency, mean amplitude, and scalp topography of pattern MMN between the two genders (p > .05).

CONCLUSIONS

Based on the obtained results, gender differently affects simple and pattern MMN. These findings may provide preliminary evidence for distinct effects of gender on various types of MMN.

Auditory Pattern Representations Under Conditions of Uncertainty-An ERP Study

The auditory system is able to recognize auditory objects and is thought to form predictive models of them even though the acoustic information arriving at our ears is often imperfect, intermixed, or distorted. We investigated implicit regularity extraction for acoustically intact versus disrupted six-tone sound patterns via event-related potentials (ERPs). In an exact-repetition condition, identical patterns were repeated; in two distorted-repetition conditions, one randomly chosen segment in each sound pattern was replaced either by white noise or by a wrong pitch. In a roving-standard paradigm, sound patterns were repeated 1-12 times (standards) in a row before a new pattern (deviant) occurred. The participants were not informed about the roving rule and had to detect rarely occurring loudness changes. Behavioral detectability of pattern changes was assessed in a subsequent behavioral task. Pattern changes (standard vs. deviant) elicited mismatch negativity (MMN) and P3a, and were behaviorally detected above the chance level in all conditions, suggesting that the auditory system extracts regularities despite distortions in the acoustic input. However, MMN and P3a amplitude were decreased by distortions. At the level of MMN, both types of distortions caused similar impairments, suggesting that auditory regularity extraction is largely determined by the stimulus statistics of matching information. At the level of P3a, wrong-pitch distortions caused larger decreases than white-noise distortions. Wrong-pitch distortions likely prevented the engagement of restoration mechanisms and the segregation of disrupted from true pattern segments, causing stronger informational interference with the relevant pattern information.

Change detection of auditory tonal patterns defined by absolute versus relative pitch information. A combined behavioural and EEG study

The human auditory system often relies on relative pitch information to extract and identify auditory objects; such as when the same melody is played in different keys. The current study investigated the mental chronometry underlying the active discrimination of unfamiliar melodic six-tone patterns by measuring behavioural performance and event-related potentials (ERPs). In a roving standard paradigm, such patterns were either repeated identically within a stimulus train, carrying absolute frequency information about the pattern, or shifted in pitch (transposed) between repetitions, so only relative pitch information was available to extract the pattern identity. Results showed that participants were able to use relative pitch to detect when a new melodic pattern occurred. Though in the absence of absolute pitch sensitivity significantly decreased and behavioural reaction time to pattern changes increased. Mismatch-Negativity (MMN), an ERP indicator of auditory deviance detection, was elicited at approximately 206 ms after stimulus onset at frontocentral electrodes, even when only relative pitch was available to inform pattern discrimination. A P3a was elicited in both conditions, comparable in amplitude and latency. Increased latencies but no differences in amplitudes of N2b, and P3b suggest that processing at higher levels is affected when, in the absence of absolute pitch cues, relative pitch has to be extracted to inform pattern discrimination. Interestingly, the response delay of approximately 70 ms on the behavioural level, already fully manifests at the level of N2b. This is in accordance with recent findings on implicit auditory learning processes and suggests that in the absence of absolute pitch cues a slowing of target selection rather than a slowing of the auditory pattern change detection process causes the deterioration in behavioural performance.

The critical role of the inferior frontal cortex in establishing a prediction model for generating subsequent mismatch negativity (MMN): A TMS-EEG study

BACKGROUND

The prediction violation account of automatic or pre-attentive change detection assumed that the inferior frontal cortex (IFC) is involved in establishing a prediction model for detecting unexpected changes. Evidence supporting the IFC's contribution to prediction model is mainly based on the Mismatch Negativity (MMN) to deviants violating predictions that are established based on the frequently presented standard events. However, deviant detection involves processes, such as events comparison, other than prediction model establishment.

OBJECTIVE

The current study investigated the critical role of the IFC in establishing a prediction model during standards processing for subsequent deviant detection.

METHODS

Transcranial Magnetic Stimulation (TMS) was applied at the IFC to disrupt the processing of the initial 2 or 5 standards of a 3-, 6-, or 9-standard train, while the MMN responses to pitch deviant presented after the standard trains were recorded and compared.

RESULTS

An abolishment of MMN was only observed when TMS was delivered to the IFC at the initial 2 standards of the 3-standard train, but not at the initial 5 standards, or when TMS at the vertex or TMS sound recording was applied. The MMNs were also preserved when IFC TMS, vertex TMS, or TMS sound recording was applied at the initial 2 or 5 standards of longer trains.

CONCLUSION

The IFC plays a critical role in processing the initial standards of a short standard train for subsequent deviant detection. This result is consistent with the prediction violation account that the IFC is important for establishing the prediction model.

Distraction by auditory novelty during reading: Evidence for disruption in saccade planning, but not saccade execution

Novel or unexpected sounds that deviate from an otherwise repetitive sequence of the same sound cause behavioural distraction. Recent work has suggested that distraction also occurs during reading as fixation durations increased when a deviant sound was presented at the fixation onset of words. The present study tested the hypothesis that this increase in fixation durations occurs due to saccadic inhibition. This was done by manipulating the temporal onset of sounds relative to the fixation onset of words in the text. If novel sounds cause saccadic inhibition, they should be more distracting when presented during the second half of fixations when saccade programming usually takes place. Participants read single sentences and heard a 120 ms sound when they fixated five target words in the sentence. On most occasions (p = .9), the same sine wave tone was presented (“standard”), while on the remaining occasions (p = .1) a new sound was presented (“novel”). Critically, sounds were played, on average, either during the first half of the fixation (0 ms delay) or during the second half of the fixation (120 ms delay). Consistent with the saccadic inhibition hypothesis (SIH), novel sounds led to longer fixation durations in the 120 ms compared to the 0 ms delay condition. However, novel sounds did not generally influence the execution of the subsequent saccade. These results suggest that unexpected sounds have a rapid influence on saccade planning, but not saccade execution.

Neural discrimination of speech sound changes in a variable context occurs irrespective of attention and explicit awareness

To process complex stimuli like language, our auditory system must tolerate large acoustic variance, like speaker variability, and still be sensitive enough to discriminate between phonemes and to detect complex sound relationships in, e.g., prosodic cues. Our study determined discrimination of speech sounds in input mimicking natural speech variability, and detection of deviations in regular pitch relationships (rule violations) between speech sounds. We investigated the automaticity and the influence of attention and explicit awareness on these changes by recording the neurophysiological mismatch negativity (MMN) and P3a as well as task performance from 21 adults. The results showed neural discrimination of phonemes and rule violations as indicated by MMN and P3a, regardless of whether the sounds were attended or not, even when participants could not explicitly describe the rule. While small sample size precluded statistical analysis of some outcomes, we still found preliminary associations between the MMN amplitudes, task performance, and emerging explicit awareness of the rule. Our results highlight the automaticity of processing complex aspects of speech as a basis for the emerging conscious perception and explicit awareness of speech properties. While MMN operates at the implicit processing level, P3a appears to work at the borderline of implicit and explicit.

The effect of illusionary perception on mismatch negativity (MMN): An electroencephalography study

Mismatch negativity (MMN) is a unique brain response elicited by any discernible change of features in a tone sequence. Although the occurrence of MMN is dependent upon the difference of a stimulus parameter, such as frequency or intensity, recent studies have suggested that MMN occurs as a result of a comparison between an internal representation created by perception and an incoming tone. The present study aimed to investigate MMN occurs based upon the physical properties of stimuli or as a result of the perception of the scale illusion. A scale illusion occurs during presentation of ascending and descending musical scales between C4 and C5. The tones of these scales are presented to the right and left ear alternately using a dichotic listening paradigm. Although the ascending/descending sequences are alternated between ears after each tone, we perceive the illusion of progressively ascending/descending tones as being separated by ear. The experiment was designed as an oddball task using the illusionary sequence and three different types of tone sequences as control conditions. Brain response to these sequences and infrequently presented deviants was measured using electroencephalography (EEG). All of the control sequences showed MMN in response to the deviant. However, the illusionary sequence did not result in a significant MMN. These results suggest that in the case of scale illusion, the occurrence of MMN is based upon the representation of tones created by perception, but not upon the physical properties of a tone sequence.

An algorithmic information theory of consciousness

Providing objective metrics of conscious state is of great interest across multiple research and clinical fields-from neurology to artificial intelligence. Here we approach this challenge by proposing plausible mechanisms for the phenomenon of structured experience. In earlier work, we argued that the experience we call reality is a mental construct derived from information compression. Here we show that algorithmic information theory provides a natural framework to study and quantify consciousness from neurophysiological or neuroimaging data, given the premise that the primary role of the brain is information processing. We take as an axiom that "there is consciousness" and focus on the requirements for structured experience: we hypothesize that the existence and use of compressive models by cognitive systems, e.g. in biological recurrent neural networks, enables and provides the structure to phenomenal experience. Self-awareness is seen to arise naturally (as part of a better model) in cognitive systems interacting bidirectionally with the external world. Furthermore, we argue that by running such models to track data, brains can give rise to apparently complex (entropic but hierarchically organized) data. We compare this theory, named KT for its basis on the mathematical theory of Kolmogorov complexity, to other information-centric theories of consciousness. We then describe methods to study the complexity of the brain's output streams or of brain state as correlates of conscious state: we review methods such as (i) probing the brain through its input streams (e.g. event-related potentials in oddball paradigms or mutual algorithmic information between world and brain), (ii) analyzing spontaneous brain state, (iii) perturbing the brain by non-invasive transcranial stimulation, and (iv) quantifying behavior (e.g. eye movements or body sway).

On the Globality of Motor Suppression: Unexpected Events and Their Influence on Behavior and Cognition

Unexpected events are part of everyday experience. They come in several varieties-action errors, unexpected action outcomes, and unexpected perceptual events-and they lead to motor slowing and cognitive distraction. While different varieties of unexpected events have been studied largely independently, and many different mechanisms are thought to explain their effects on action and cognition, we suggest a unifying theory. We propose that unexpected events recruit a fronto-basal-ganglia network for stopping. This network includes specific prefrontal cortical nodes and is posited to project to the subthalamic nucleus, with a putative global suppressive effect on basal-ganglia output. We argue that unexpected events interrupt action and impact cognition, partly at least, by recruiting this global suppressive network. This provides a common mechanistic basis for different types of unexpected events; links the literatures on motor inhibition, performance monitoring, attention, and working memory; and is relevant for understanding clinical symptoms of distractibility and mental inflexibility.

How regularity representations of short sound patterns that are based on relative or absolute pitch information establish over time: An EEG study

The recognition of sound patterns in speech or music (e.g., a melody that is played in different keys) requires knowledge about pitch relations between successive sounds. We investigated the formation of regularity representations for sound patterns in an event-related potential (ERP) study. A pattern, which consisted of six concatenated 50 ms tone segments differing in fundamental frequency, was presented 1, 2, 3, 6, or 12 times and then replaced by another pattern by randomly changing the pitch of the tonal segments (roving standard paradigm). In an absolute repetition condition, patterns were repeated identically, whereas in a transposed condition, only the pitch relations of the tonal segments of the patterns were repeated, while the entire patterns were shifted up or down in pitch. During ERP measurement participants were not informed about the pattern repetition rule, but were instructed to discriminate rarely occurring targets of lower or higher sound intensity. EPRs for pattern changes (mismatch negativity, MMN; and P3a) and for pattern repetitions (repetition positivity, RP) revealed that the auditory system is able to rapidly extract regularities from unfamiliar complex sound patterns even when absolute pitch varies. Yet, enhanced RP and P3a amplitudes, and improved behavioral performance measured in a post-hoc test, in the absolute as compared with the transposed condition suggest that it is more difficult to encode patterns without absolute pitch information. This is explained by dissociable processing of standards and deviants as well as a back propagation mechanism to early sensory processing stages, which is effective after less repetitions of a standard stimulus for absolute pitch.

Age-Related Declines in Early Sensory Memory: Identification of Rapid Auditory and Visual Stimulus Sequences

Age-related temporal-processing declines of rapidly presented sequences may involve contributions of sensory memory. This study investigated recall for rapidly presented auditory (vowel) and visual (letter) sequences presented at six different stimulus onset asynchronies (SOA) that spanned threshold SOAs for sequence identification. Younger, middle-aged, and older adults participated in all tasks. Results were investigated at both equivalent performance levels (i.e., SOA threshold) and at identical physical stimulus values (i.e., SOAs). For four-item sequences, results demonstrated best performance for the first and last items in the auditory sequences, but only the first item for visual sequences. For two-item sequences, adults identified the second vowel or letter significantly better than the first. Overall, when temporal-order performance was equated for each individual by testing at SOA thresholds, recall accuracy for each position across the age groups was highly similar. These results suggest that modality-specific processing declines of older adults primarily determine temporal-order performance for rapid sequences. However, there is some evidence for a second amodal processing decline in older adults related to early sensory memory for final items in a sequence. This selective deficit was observed particularly for longer sequence lengths and was not accounted for by temporal masking.

Can auditory deviant stimuli temporarily suspend cognitive processing? Evidence from patients with anxiety

While anxiety is typically thought to increase distractibility, this notion mostly derives from studies using emotionally loaded distractors presented in the same modality as the target stimuli and tasks involving crosstalk interference. We examined whether pathological anxiety might also increase distractibility for emotionally neutral irrelevant sounds presented prior to target stimuli in a task where these stimuli do not compete for selection. Patients with anxiety and control participants categorized visual digits preceded by task-irrelevant sounds that changed on rare trials (auditory deviance). Both groups exhibited an equivalent increase in response times following a deviant sound but patients showed a reduction of response accuracy, which was entirely due to an increase in response omissions. We conclude that the involuntary capture of attention by unexpected stimuli may, in patients with anxiety, result in a temporary suspension of cognitive activity.

Sound segregation via embedded repetition is robust to inattention

The segregation of sound sources from the mixture of sounds that enters the ear is a core capacity of human hearing, but the extent to which this process is dependent on attention remains unclear. This study investigated the effect of attention on the ability to segregate sounds via repetition. We utilized a dual task design in which stimuli to be segregated were presented along with stimuli for a "decoy" task that required continuous monitoring. The task to assess segregation presented a target sound 10 times in a row, each time concurrent with a different distractor sound. McDermott, Wrobleski, and Oxenham (2011) demonstrated that repetition causes the target sound to be segregated from the distractors. Segregation was queried by asking listeners whether a subsequent probe sound was identical to the target. A control task presented similar stimuli but probed discrimination without engaging segregation processes. We present results from 3 different decoy tasks: a visual multiple object tracking task, a rapid serial visual presentation (RSVP) digit encoding task, and a demanding auditory monitoring task. Load was manipulated by using high- and low-demand versions of each decoy task. The data provide converging evidence of a small effect of attention that is nonspecific, in that it affected the segregation and control tasks to a similar extent. In all cases, segregation performance remained high despite the presence of a concurrent, objectively demanding decoy task. The results suggest that repetition-based segregation is robust to inattention.

Temporal dynamics of contingency extraction from tonal and verbal auditory sequences

Consecutive sound events are often to some degree predictive of each other. Here we investigated the brain's capacity to detect contingencies between consecutive sounds by means of electroencephalography (EEG) during passive listening. Contingencies were embedded either within tonal or verbal stimuli. Contingency extraction was measured indirectly via the elicitation of the mismatch negativity (MMN) component of the event-related potential (ERP) by contingency violations. MMN results indicate that structurally identical forms of predictability can be extracted from both tonal and verbal stimuli. We also found similar generators to underlie the processing of contingency violations across stimulus types, as well as similar performance in an active-listening follow-up test. However, the process of passive contingency extraction was considerably slower (twice as many rule exemplars were needed) for verbal than for tonal stimuli These results suggest caution in transferring findings on complex predictive regularity processing obtained with tonal stimuli directly to the speech domain.

Happiness increases distraction by auditory deviant stimuli

Rare and unexpected changes (deviants) in an otherwise repeated stream of task-irrelevant auditory distractors (standards) capture attention and impair behavioural performance in an ongoing visual task. Recent evidence indicates that this effect is increased by sadness in a task involving neutral stimuli. We tested the hypothesis that such effect may not be limited to negative emotions but reflect a general depletion of attentional resources by examining whether a positive emotion (happiness) would increase deviance distraction too. Prior to performing an auditory-visual oddball task, happiness or a neutral mood was induced in participants by means of the exposure to music and the recollection of an autobiographical event. Results from the oddball task showed significantly larger deviance distraction following the induction of happiness. Interestingly, the small amount of distraction typically observed on the standard trial following a deviant trial (post-deviance distraction) was not increased by happiness. We speculate that happiness might interfere with the disengagement of attention from the deviant sound back towards the target stimulus (through the depletion of cognitive resources and/or mind wandering) but help subsequent cognitive control to recover from distraction.

Spatial auditory regularity encoding and prediction: Human middle-latency and long-latency auditory evoked potentials

By encoding acoustic regularities present in the environment, the human brain can generate predictions of what is likely to occur next. Recent studies suggest that deviations from encoded regularities are detected within 10-50ms after stimulus onset, as indicated by electrophysiological effects in the middle latency response (MLR) range. This is upstream of previously known long-latency (LLR) signatures of deviance detection such as the mismatch negativity (MMN) component. In the present study, we created predictable and unpredictable contexts to investigate MLR and LLR signatures of the encoding of spatial auditory regularities and the generation of predictions from these regularities. Chirps were monaurally delivered in an either regular (predictable: left-right-left-right) or a random (unpredictable left/right alternation or repetition) manner. Occasional stimulus omissions occurred in both types of sequences. Results showed that the Na component (peaking at 34ms after stimulus onset) was attenuated for regular relative to random chirps, albeit no differences were observed for stimulus omission responses in the same latency range. In the LLR range, larger chirp-and omission-evoked responses were elicited for the regular than for the random condition, and predictability effects were more prominent over the right hemisphere. We discuss our findings in the framework of a hierarchical organization of spatial regularity encoding. This article is part of a Special Issue entitled SI: Prediction and Attention.

The role of temporal structure in the investigation of sensory memory, auditory scene analysis, and speech perception: a healthy-aging perspective

Listening situations with multiple talkers or background noise are common in everyday communication and are particularly demanding for older adults. Here we review current research on auditory perception in aging individuals in order to gain insights into the challenges of listening under noisy conditions. Informationally rich temporal structure in auditory signals--over a range of time scales from milliseconds to seconds--renders temporal processing central to perception in the auditory domain. We discuss the role of temporal structure in auditory processing, in particular from a perspective relevant for hearing in background noise, and focusing on sensory memory, auditory scene analysis, and speech perception. Interestingly, these auditory processes, usually studied in an independent manner, show considerable overlap of processing time scales, even though each has its own 'privileged' temporal regimes. By integrating perspectives on temporal structure processing in these three areas of investigation, we aim to highlight similarities typically not recognized.

The semantic aftermath of distraction by deviant sounds: Crosstalk interference is mediated by the predictability of semantic congruency

Rare changes in a stream of otherwise repeated task-irrelevant sounds break through selective attention and disrupt performance in an unrelated visual task. This deviance distraction effect emerges because deviant sounds violate the cognitive system's predictions. In this study we sought to examine whether predictability also mediate the so-called semantic effect whereby behavioral performance suffers from the clash between the involuntary semantic evaluation of irrelevant sounds and the voluntary processing of visual targets (e.g., when participants must categorize a right visual arrow following the presentation of the deviant sound "left"). By manipulating the conditional probabilities of the congruent and incongruent deviant sounds in a left/right arrow categorization task, we elicited implicit predictions about the upcoming target and related response. We observed a linear increase of the semantic effect with the proportion of congruent deviant trials (i.e., as deviant sounds increasingly predicted congruent targets). We conclude that deviant sounds affect response times based on a combination of crosstalk interference and two types of prediction violations: stimulus violations (violations of predictions regarding the identity of upcoming irrelevant sounds) and semantic violations (violations of predictions regarding the target afforded by deviant sounds). We report a three-parameter model that captures all key features of the observed RTs. Overall, our results fit with the view that the brain builds forward models of the environment in order to optimize cognitive processing and that control of one's attention and actions is called upon when predictions are violated. This article is part of a Special Issue entitled SI: Prediction and Attention.

Stimulus-specific adaptation and deviance detection in the auditory system: experiments and models

Stimulus-specific adaptation (SSA) is the reduction in the response to a common stimulus that does not generalize, or only partially generalizes, to other, rare stimuli. SSA has been proposed to be a correlate of 'deviance detection', an important computational task of sensory systems. SSA is ubiquitous in the auditory system: It is found both in cortex and in subcortical stations, and it has been demonstrated in many mammalian species as well as in birds. A number of models have been suggested in the literature to account for SSA in the auditory domain. In this review, the experimental literature is critically examined in relationship to these models. While current models can all account for auditory SSA to some degree, none is fully compatible with the available findings.

Timing matters: the processing of pitch relations

The human central auditory system can automatically extract abstract regularities from a variant auditory input. To this end, temporarily separated events need to be related. This study tested whether the timing between events, falling either within or outside the temporal window of integration (~350 ms), impacts the extraction of abstract feature relations. We utilized tone pairs for which tones within but not across pairs revealed a constant pitch relation (e.g., pitch of second tone of a pair higher than pitch of first tone, while absolute pitch values varied across pairs). We measured the mismatch negativity (MMN; the brain's error signal to auditory regularity violations) to second tones that rarely violated the pitch relation (e.g., pitch of second tone lower). A Short condition in which tone duration (90 ms) and stimulus onset asynchrony between the tones of a pair were short (110 ms) was compared to two conditions, where this onset asynchrony was long (510 ms). In the Long Gap condition, the tone durations were identical to Short (90 ms), but the silent interval was prolonged by 400 ms. In Long Tone, the duration of the first tone was prolonged by 400 ms, while the silent interval was comparable to Short (20 ms). Results show a frontocentral MMN of comparable amplitude in all conditions. Thus, abstract pitch relations can be extracted even when the within-pair timing exceeds the integration period. Source analyses indicate MMN generators in the supratemporal cortex. Interestingly, they were located more anterior in Long Gap than in Short and Long Tone. Moreover, frontal generator activity was found for Long Gap and Long Tone. Thus, the way in which the system automatically registers irregular abstract pitch relations depends on the timing of the events to be linked. Pending that the current MMN data mirror established abstract rule representations coding the regular pitch relation, neural processes building these templates vary with timing.

A neurocomputational model of the mismatch negativity

The mismatch negativity (MMN) is an event related potential evoked by violations of regularity. Here, we present a model of the underlying neuronal dynamics based upon the idea that auditory cortex continuously updates a generative model to predict its sensory inputs. The MMN is then modelled as the superposition of the electric fields evoked by neuronal activity reporting prediction errors. The process by which auditory cortex generates predictions and resolves prediction errors was simulated using generalised (Bayesian) filtering--a biologically plausible scheme for probabilistic inference on the hidden states of hierarchical dynamical models. The resulting scheme generates realistic MMN waveforms, explains the qualitative effects of deviant probability and magnitude on the MMN - in terms of latency and amplitude--and makes quantitative predictions about the interactions between deviant probability and magnitude. This work advances a formal understanding of the MMN and--more generally--illustrates the potential for developing computationally informed dynamic causal models of empirical electromagnetic responses.

Effects of musical training and event probabilities on encoding of complex tone patterns

BACKGROUND

The human auditory cortex automatically encodes acoustic input from the environment and differentiates regular sound patterns from deviant ones in order to identify important, irregular events. The Mismatch Negativity (MMN) response is a neuronal marker for the detection of sounds that are unexpected, based on the encoded regularities. It is also elicited by violations of more complex regularities and musical expertise has been shown to have an effect on the processing of complex regularities. Using magnetoencephalography (MEG), we investigated the MMN response to salient or less salient deviants by varying the standard probability (70%, 50% and 35%) of a pattern oddball paradigm. To study the effects of musical expertise in the encoding of the patterns, we compared the responses of a group of non-musicians to those of musicians.

RESULTS

We observed significant MMN in all conditions, including the least salient condition (35% standards), in response to violations of the predominant tone pattern for both groups. The amplitude of MMN from the right hemisphere was influenced by the standard probability. This effect was modulated by long-term musical training: standard probability changes influenced MMN amplitude in the group of non-musicians only.

CONCLUSION

This study indicates that pattern violations are detected automatically, even if they are of very low salience, both in non-musicians and musicians, with salience having a stronger impact on processing in the right hemisphere of non-musicians. Long-term musical training influences this encoding, in that non-musicians benefit to a greater extent from a good signal-to-noise ratio (i.e. high probability of the standard pattern), while musicians are less dependent on the salience of an acoustic environment.

Behavioral Distraction by Auditory Deviance Is Mediated by the Sound’s Informational Value *Li and Parmentier share the first authorship of this study

Sounds deviating from an otherwise repetitive background in some task-irrelevant respect (deviant sounds among standard sounds) capture attention in an obligatory fashion and result in behavioral distraction in an ongoing task. Traditionally, such distraction has been considered as the ineluctable consequence of the deviant sound’s low probability of occurrence relative to that of the standard. Recent evidence from a cross-modal oddball task challenged this idea by showing that deviant sounds only yield distraction in a visual task when auditory distractors (standards and deviants) announce with certainty the imminent presentation of a target stimulus (event information), regardless of whether they predict the target’s temporal onset (temporal information). The present study sought to test for the first time whether this finding may be generalized to a purely auditory oddball task in which distractor and target information form part of the same perceptual stimulus. Participants were asked to judge whether a sound starting from a central location moved left or right while ignoring rare and unpredictable changes in the sound’s identity. By manipulating the temporal and probabilistic relationship between sound onset and movement onset, we disentangled the roles of event and temporal information and found that, as in the auditory-visual oddball task, deviance distraction is mediated by the extent to which distractor information harbingers the presentation of the target information (event information). This finding suggests that the provision of event information by auditory distractors is a fundamental prerequisite of behavioral deviance distraction.

Modelling trial-by-trial changes in the mismatch negativity

The mismatch negativity (MMN) is a differential brain response to violations of learned regularities. It has been used to demonstrate that the brain learns the statistical structure of its environment and predicts future sensory inputs. However, the algorithmic nature of these computations and the underlying neurobiological implementation remain controversial. This article introduces a mathematical framework with which competing ideas about the computational quantities indexed by MMN responses can be formalized and tested against single-trial EEG data. This framework was applied to five major theories of the MMN, comparing their ability to explain trial-by-trial changes in MMN amplitude. Three of these theories (predictive coding, model adjustment, and novelty detection) were formalized by linking the MMN to different manifestations of the same computational mechanism: approximate Bayesian inference according to the free-energy principle. We thereby propose a unifying view on three distinct theories of the MMN. The relative plausibility of each theory was assessed against empirical single-trial MMN amplitudes acquired from eight healthy volunteers in a roving oddball experiment. Models based on the free-energy principle provided more plausible explanations of trial-by-trial changes in MMN amplitude than models representing the two more traditional theories (change detection and adaptation). Our results suggest that the MMN reflects approximate Bayesian learning of sensory regularities, and that the MMN-generating process adjusts a probabilistic model of the environment according to prediction errors.

The ability to predict one's environment is crucial for adaptive and proactive behaviour. It requires learning a mental model that captures the environment's statistical regularities. A process of this sort is thought to be reflected by the mismatch negativity (MMN) potential, a non-invasive electrophysiological measure of the neural response to regularity violation by sensory stimuli. However, the exact computational processes reflected by the MMN remain a matter of debate. We developed a modelling framework in which competing hypotheses about these processes can be objectively compared by their ability to predict single-trial MMN amplitudes. We applied this framework to formalize five major MMN theories and propose a unifying view on three distinct theories which explain the MMN as a reflection of prediction errors, model adjustment, and novelty detection, respectively. We assessed our models of the five theories with EEG data from eight healthy volunteers. Our results are consistent with the idea that the MMN arises from prediction error driven adjustments of a probabilistic mental model of the environment.

A sparse neural code for some speech sounds but not for others

The precise neural mechanisms underlying speech sound representations are still a matter of debate. Proponents of 'sparse representations' assume that on the level of speech sounds, only contrastive or otherwise not predictable information is stored in long-term memory. Here, in a passive oddball paradigm, we challenge the neural foundations of such a 'sparse' representation; we use words that differ only in their penultimate consonant ("coronal" [t] vs. "dorsal" [k] place of articulation) and for example distinguish between the German nouns Latz ([lats]; bib) and Lachs ([laks]; salmon). Changes from standard [t] to deviant [k] and vice versa elicited a discernible Mismatch Negativity (MMN) response. Crucially, however, the MMN for the deviant [lats] was stronger than the MMN for the deviant [laks]. Source localization showed this difference to be due to enhanced brain activity in right superior temporal cortex. These findings reflect a difference in phonological 'sparsity': Coronal [t] segments, but not dorsal [k] segments, are based on more sparse representations and elicit less specific neural predictions; sensory deviations from this prediction are more readily 'tolerated' and accordingly trigger weaker MMNs. The results foster the neurocomputational reality of 'representationally sparse' models of speech perception that are compatible with more general predictive mechanisms in auditory perception.

Regularity extraction from non-adjacent sounds

The regular behavior of sound sources helps us to make sense of the auditory environment. Regular patterns may, for instance, convey information on the identity of a sound source (such as the acoustic signature of a train moving on the rails). Yet typically, this signature overlaps in time with signals emitted from other sound sources. It is generally assumed that auditory regularity extraction cannot operate upon this mixture of signals because it only finds regularities between adjacent sounds. In this view, the auditory environment would be grouped into separate entities by means of readily available acoustic cues such as separation in frequency and location. Regularity extraction processes would then operate upon the resulting groups. Our new experimental evidence challenges this view. We presented two interleaved sound sequences which overlapped in frequency range and shared all acoustic parameters. The sequences only differed in their underlying regular patterns. We inserted deviants into one of the sequences to probe whether the regularity was extracted. In the first experiment, we found that these deviants elicited the mismatch negativity (MMN) component. Thus the auditory system was able to find the regularity between the non-adjacent sounds. Regularity extraction was not influenced by sequence cohesiveness as manipulated by the relative duration of tones and silent inter-tone-intervals. In the second experiment, we showed that a regularity connecting non-adjacent sounds was discovered only when the intervening sequence also contained a regular pattern, but not when the intervening sounds were randomly varying. This suggests that separate regular patterns are available to the auditory system as a cue for identifying signals coming from distinct sound sources. Thus auditory regularity extraction is not necessarily confined to a processing stage after initial sound grouping, but may precede grouping when other acoustic cues are unavailable.

Cortical responses to changes in acoustic regularity are differentially modulated by attentional load

This study investigates how acoustic change-events are represented in a listener's brain when attention is strongly focused elsewhere. Using magneto-encephalography (MEG) we examine whether cortical responses to different kinds of changes in stimulus statistics are similarly influenced by attentional load, and whether the processing of such acoustic changes in auditory cortex depends on modality-specific or general processing resources. We investigated these issues by examining cortical responses to two basic forms of acoustic transitions: (1) Violations of a simple acoustic pattern and (2) the emergence of a regular pattern from a random one. To simulate a complex sensory environment, these patterns were presented concurrently with streams of auditory and visual decoys. Listeners were required to perform tasks of high- and low-attentional-load in these domains. Results demonstrate that while auditory attentional-load does not influence the cortical representation of simple violations of regularity, it significantly reduces the magnitude of responses to the emergence of a regular acoustic pattern, suggesting a fundamentally skewed representation of the unattended auditory scene. In contrast, visual attentional-load had no effect on either transition response, consistent with the hypothesis that processing resources necessary for change detection are modality-specific.

Electrophysiological evidence for age effects on sensory memory processing of tonal patterns

In older adults, difficulties processing complex auditory scenes, such as speech comprehension in noisy environments, might be due to a specific impairment of temporal processing at early, automatic processing stages involving auditory sensory memory (ASM). Even though age effects on auditory temporal processing have been well-documented, there is a paucity of research on how ASM processing of more complex tone-patterns is altered by age. In the current study, age effects on ASM processing of temporal and frequency aspects of two-tone patterns were investigated using a passive listening protocol. The P1 component, the mismatch negativity (MMN) and the P3a component of event-related brain potentials (ERPs) to tone frequency and temporal pattern deviants were recorded in younger and older adults as a measure of auditory event detection, ASM processing, and attention switching, respectively. MMN was elicited with smaller amplitude to both frequency and temporal deviants in older adults. Furthermore, P3a was elicited only in the younger adults. In conclusion, the smaller MMN amplitude indicates that automatic processing of both frequency and temporal aspects of two-tone patterns is impaired in older adults. The failure to initiate an attention switch, suggested by the absence of P3a, indicates that impaired ASM processing of patterns may lead to less distractibility in older adults. Our results suggest age-related changes in ASM processing of patterns that cannot be explained by an inhibitory deficit.

Why are auditory novels distracting? Contrasting the roles of novelty, violation of expectation and stimulus change

Past studies show that novel auditory stimuli, presented in the context of an otherwise repeated sound, capture participants' attention away from a focal task, resulting in measurable behavioral distraction. Novel sounds are traditionally defined as rare and unexpected but past studies have not sought to disentangle these concepts directly. Using a cross-modal oddball task, we contrasted these aspects orthogonally by manipulating the base rate and conditional probabilities of sound events. We report for the first time that behavioral distraction does not result from a sound's novelty per se but from the violation of the cognitive system's expectation based on the learning of conditional probabilities and, to some extent, the occurrence of a perceptual change from one sound to another.

From sounds to words: a neurocomputational model of adaptation, inhibition and memory processes in auditory change detection

Most animals detect sudden changes in trains of repeated stimuli but only some can learn a wide range of sensory patterns and recognise them later, a skill crucial for the evolutionary success of higher mammals. Here we use a neural model mimicking the cortical anatomy of sensory and motor areas and their connections to explain brain activity indexing auditory change and memory access. Our simulations indicate that while neuronal adaptation and local inhibition of cortical activity can explain aspects of change detection as observed when a repeated unfamiliar sound changes in frequency, the brain dynamics elicited by auditory stimulation with well-known patterns (such as meaningful words) cannot be accounted for on the basis of adaptation and inhibition alone. Specifically, we show that the stronger brain responses observed to familiar stimuli in passive oddball tasks are best explained in terms of activation of memory circuits that emerged in the cortex during the learning of these stimuli. Such memory circuits, and the activation enhancement they entail, are absent for unfamiliar stimuli. The model illustrates how basic neurobiological mechanisms, including neuronal adaptation, lateral inhibition, and Hebbian learning, underlie neuronal assembly formation and dynamics, and differentially contribute to the brain's major change detection response, the mismatch negativity.

Relationships between sensory "gating out" and sensory "gating in" of auditory evoked potentials in schizophrenia: a pilot study

The interrelationship between the ability to inhibit incoming redundant input (gating out) and the ability of the brain to respond when the stimulus changes (gating in), has not been extensively examined. We administered a battery of auditory evoked potential tests to a group of chronic, medicated schizophrenia patients (N=12) and a group of healthy subjects (N=12) in order to examine relationships between "gating out" measures (suppression with repetition of the P50, N100, and P200 evoked responses), and the mismatch negativity (MMN) and the P300 event related potentials as measures of "gating in". Gating ratios for N100 and P200 in a visual attention paired-click task differed significantly between groups. Mismatch negativity and P300 potential amplitudes were also significantly reduced in the patient group. When including all subjects (N=24) a negative correlation was found between the P50 gating and the amplitude of the MMN. In healthy subjects this correlation was significantly stronger compared to schizophrenia patients. While no significant correlation was noted between the amplitudes of the P300 and any gating measures when all 24 subjects were included, a significant negative correlation was seen between the P200 gating and the P300 amplitudes in schizophrenia patients; an opposite trend was noted in healthy subjects. Finally, a positive correlation was seen between the P300 and MMN (to abstract deviance) amplitudes in healthy subjects, but the opposite was found in patients. These results suggest that further study of these interrelationships could inform the understanding of information processing abnormalities in schizophrenia.