Attentional orienting and reorienting is indicated by human event-related brain potentials

Distraction by unexpected sounds: comparing response repetition and response switching

Numerous studies using oddball tasks have shown that unexpected sounds presented in a predictable or repeated sequence (deviant vs. standard sounds) capture attention and negatively impact ongoing behavioral performance. Here, we examine an aspect of this effect that has gone relatively unnoticed: the impact of deviant sounds is stronger for response repetitions than for response switches. Our approach was two-fold. First, we carried out a simulation to estimate the likelihood that stimuli sequences used in past work may not have used balanced proportions of response repetition and switch trials. More specifically, we sought to determine whether the larger distraction effect for response repetitions may have reflected a rarer, and thereby more surprising, occurrence of such trials. To do so, we simulated 10,000 stimuli sets for a 2-AFC task with a proportion of deviant trial of 0.1 or 0.16. Second, we carried out a 2-AFC oddball task in which participants judged the duration of a tone (short vs. long). We carefully controlled the sequence of stimuli to ensure to balance the proportions of response repetitions and response switches across the standard and deviant conditions. The results of the stimuli simulation showed that, contrary to our concerns, response switches were more likely than response repetitions when left uncontrolled for. This suggests that the larger distraction found for response repetition in past work may in fact have been underestimated. In the tone duration judgment task, the results showed a large impact of the response type on distraction as measured by response times: Deviants sounds significantly delayed response repetitions but notably accelerated switches. These findings suggest that deviant sound hinder response repetition and encourage or bias the cognitive system towards a change of responses. We discuss these findings in relation to the adaptive nature of the involuntary detection of unexpected stimuli and in relation to the notion of partial repetition costs. We argue that results are in line with the binding account as well as with the signaling theory.

Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates

The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.

Effect of Auditory Distractors on Speech Recognition and Listening Effort

OBJECTIVES

Everyday listening environments are filled with competing noise and distractors. Although significant research has examined the effect of competing noise on speech recognition and listening effort, little is understood about the effect of distraction. The framework for understanding effortful listening recognizes the importance of attention-related processes in speech recognition and listening effort; however, it underspecifies the role that they play, particularly with respect to distraction. The load theory of attention predicts that resources will be automatically allocated to processing a distractor, but only if perceptual load in the listening task is low enough. If perceptual load is high (i.e., listening in noise), then resources that would otherwise be allocated to processing a distractor are used to overcome the increased perceptual load and are unavailable for distractor processing. Although there is ample evidence for this theory in the visual domain, there has been little research investigating how the load theory of attention may apply to speech processing. In this study, we sought to measure the effect of distractors on speech recognition and listening effort and to evaluate whether the load theory of attention can be used to understand a listener's resource allocation in the presence of distractors.

DESIGN

Fifteen adult listeners participated in a monosyllabic words repetition task. Test stimuli were presented in quiet or in competing speech (+5 dB signal-to-noise ratio) and in distractor or no distractor conditions. In conditions with distractors, auditory distractors were presented before the target words on 24% of the trials in quiet and in noise. Percent-correct was recorded as speech recognition, and verbal response time (VRT) was recorded as a measure of listening effort.

RESULTS

A significant interaction was present for speech recognition, showing reduced speech recognition when distractors were presented in the quiet condition but no effect of distractors when noise was present. VRTs were significantly longer when distractors were present, regardless of listening condition.

CONCLUSIONS

Consistent with the load theory of attention, distractors significantly reduced speech recognition in the low-perceptual load condition (i.e., listening in quiet) but did not impact speech recognition scores in conditions of high perceptual load (i.e., listening in noise). The increases in VRTs in the presence of distractors in both low- and high-perceptual load conditions (i.e., quiet and noise) suggest that the load theory of attention may not apply to listening effort. However, the large effect of distractors on VRT in both conditions is consistent with the previous work demonstrating that distraction-related shifts of attention can delay processing of the target task. These findings also fit within the framework for understanding effortful listening, which proposes that involuntary attentional shifts result in a depletion of cognitive resources, leaving less resources readily available to process the signal of interest; resulting in increased listening effort (i.e., elongated VRT).

The Effects of Total Sleep Deprivation on Attention Capture Processes in Young and Older Adults: An ERP Study

BACKGROUND

The present study investigated whether sleep deprivation affects attention capture in young and older adults using event-related potentials (ERPs).

METHODS

Eleven young adults (20-30 y) and nine older adults (60-70 y) were tested following both normal sleep (NS) and total sleep deprivation (TSD). ERPs were recorded during an auditory discrimination task consisting of standard and deviant stimuli.

RESULTS

Deviant stimuli elicited the MMN, P3a, and RON ERPs. TSD attenuated the differences in reaction times between standards and deviants in young adults but not older adults. The P3a was attenuated in older adults compared to young adults. Older adults had a larger RON amplitude compared to young adults following NS, but not TSD.

CONCLUSIONS

The reduced P3a and the absence of behavioral performance alteration in the older group suggests that older adults may utilize different neural processing strategies compared to younger adults to compensate for age-related declines in neural resources for attention capture. Sleep loss influenced age-related differences on the RON, suggesting that older adults may have reduced access to compensatory strategies following sleep loss.

Measures of tonic and phasic activity of the locus coeruleus-norepinephrine system in children with autism spectrum disorder: An event-related potential and pupillometry study

A growing body of research suggests that locus coeruleus-norepinephrine (LC-NE) system may function differently in individuals with autism spectrum disorder (ASD). Understanding the dynamics of both tonic (resting pupil diameter) and phasic (pupil dilation response [PDR] and event-related potential [ERP]) indices may provide meaningful insights about the nature of LC-NE function in ASD. Twenty-four children with ASD and 27 age- and nonverbal-IQ matched typically developing (TD) children completed two experiments: (1) a resting eye-tracking task to measure tonic pupil diameter, and (2) a three-stimulus oddball paradigm to measure phasic responsivity using PDR and ERP. Consistent with prior reports, our results indicate that children with ASD exhibit increased tonic (resting pupil diameter) and reduced phasic (PDR and ERP) activity of the LC-NE system compared to their TD peers. For both groups, decreased phasic responsivity was associated with increased resting pupil diameter. Lastly, tonic and phasic LC-NE indices were primarily related to measures of attention-deficit/hyperactivity disorder (ADHD), and not ASD, symptomatology. These findings expand our understanding of neurophysiological differences present in ASD and demonstrate that aberrant LC-NE activation may be associated with atypical arousal and decreased responsivity to behaviorally-relevant information in ASD.

A Guided Tutorial on Modelling Human Event-Related Potentials with Recurrent Neural Networks

In cognitive neuroscience research, computational models of event-related potentials (ERP) can provide a means of developing explanatory hypotheses for the observed waveforms. However, researchers trained in cognitive neurosciences may face technical challenges in implementing these models. This paper provides a tutorial on developing recurrent neural network (RNN) models of ERP waveforms in order to facilitate broader use of computational models in ERP research. To exemplify the RNN model usage, the P3 component evoked by target and non-target visual events, measured at channel Pz, is examined. Input representations of experimental events and corresponding ERP labels are used to optimize the RNN in a supervised learning paradigm. Linking one input representation with multiple ERP waveform labels, then optimizing the RNN to minimize mean-squared-error loss, causes the RNN output to approximate the grand-average ERP waveform. Behavior of the RNN can then be evaluated as a model of the computational principles underlying ERP generation. Aside from fitting such a model, the current tutorial will also demonstrate how to classify hidden units of the RNN by their temporal responses and characterize them using principal component analysis. Statistical hypothesis testing can also be applied to these data. This paper focuses on presenting the modelling approach and subsequent analysis of model outputs in a how-to format, using publicly available data and shared code. While relatively less emphasis is placed on specific interpretations of P3 response generation, the results initiate some interesting discussion points.

Atypical prediction error learning is associated with prodromal symptoms in individuals at clinical high risk for psychosis

Reductions in the auditory mismatch negativity (MMN) have been well-demonstrated in schizophrenia rendering it a promising biomarker for understanding the emergence of psychosis. According to the predictive coding theory of psychosis, MMN impairments may reflect disturbances in hierarchical information processing driven by maladaptive precision-weighted prediction errors (pwPEs) and enhanced belief updating. We applied a hierarchical Bayesian model of learning to single-trial EEG data from an auditory oddball paradigm in 31 help-seeking antipsychotic-naive high-risk individuals and 23 healthy controls to understand the computational mechanisms underlying the auditory MMN. We found that low-level sensory and high-level volatility pwPE expression correlated with EEG amplitudes, coinciding with the timing of the MMN. Furthermore, we found that prodromal positive symptom severity was associated with increased expression of sensory pwPEs and higher-level belief uncertainty. Our findings provide support for the role of pwPEs in auditory MMN generation, and suggest that increased sensory pwPEs driven by changes in belief uncertainty may render the environment seemingly unpredictable. This may predispose high-risk individuals to delusion-like ideation to explain this experience. These results highlight the value of computational models for understanding the pathophysiological mechanisms of psychosis.

The Effect of Cognitive Load on Auditory Susceptibility During Automated Driving

OBJECTIVE

We experimentally test the effect of cognitive load on auditory susceptibility during automated driving.

BACKGROUND

In automated vehicles, auditory alerts are frequently used to request human intervention. To ensure safe operation, human drivers need to be susceptible to auditory information. Previous work found reduced susceptibility during manual driving and in a lesser amount during automated driving. However, in practice, drivers also perform nondriving tasks during automated driving, of which the associated cognitive load may further reduce susceptibility to auditory information. We therefore study the effect of cognitive load during automated driving on auditory susceptibility.

METHOD

Twenty-four participants were driven in a simulated automated car. Concurrently, they performed a task with two levels of cognitive load: repeat a noun or generate a verb that expresses the use of this noun. Every noun was followed by a probe stimulus to elicit a neurophysiological response: the frontal P3 (fP3), which is a known indicator for the level of auditory susceptibility.

RESULTS

The fP3 was significantly lower during automated driving with cognitive load compared with without. The difficulty level of the cognitive task (repeat or generate) showed no effect.

CONCLUSION

Engaging in other tasks during automated driving decreases auditory susceptibility as indicated by a reduced fP3.

APPLICATION

Nondriving task can create additional cognitive load. Our study shows that performing such tasks during automated driving reduces the susceptibility for auditory alerts. This can inform designers of semi-automated vehicles (SAE levels 3 and 4), where human intervention might be needed.

Modeling Distraction: How Stimulus-driven Attention Capture Influences Goal-directed Behavior

The importance of paying attention to a task at hand is emphasized from an early age and extends throughout life. The costs of attentional focus, however, include the potential to miss important changes in the environment, so some process for monitoring nontask information is essential. In this study, a model of latent cognitive variables was applied to data obtained from a two-alternative forced-choice task where participants identified the longer of two sounds. Using an adaptive procedure task, accuracy was maintained at a higher or lower level creating two difficulties, and the sounds were heard either where frequency changes in the sound were rare or common (oddball and multistandard conditions, respectively). Frequency changes created stimulus-driven "distraction" effects in the oddball sequence only, and cognitive modeling (using the linear ballistic accumulator) attributed these effects to slowed accumulation of evidence about tone length on these trials. Concurrent recording of auditory ERPs revealed these delays in evidence accumulation to be related to the amplitude of N2 or mismatch negativity period and P300 response components. In contrast, the response time on trials after a rare frequency change was associated with increased caution in decision-making. Results support the utility of mapping behavioral and ERP measures of performance to latent cognitive processes that contribute to performance and are consistent with a momentary diversion of resources to evaluate the deviant sound feature and remodel predictions about sound.

Decoding violated sensory expectations from the auditory cortex of anaesthetised mice: Hierarchical recurrent neural network depicts separate 'danger' and 'safety' units

The ability to respond appropriately to sensory information received from the external environment is among the most fundamental capabilities of central nervous systems. In the auditory domain, processes underlying this behaviour are studied by measuring auditory‐evoked electrophysiology during sequences of sounds with predetermined regularities. Identifying neural correlates of ensuing auditory novelty responses is supported by research in experimental animals. In the present study, we reanalysed epidural field potential recordings from the auditory cortex of anaesthetised mice during frequency and intensity oddball stimulation. Multivariate pattern analysis (MVPA) and hierarchical recurrent neural network (RNN) modelling were adopted to explore these data with greater resolution than previously considered using conventional methods. Time‐wise and generalised temporal decoding MVPA approaches revealed previously underestimated asymmetry between responses to sound‐level transitions in the intensity oddball paradigm, in contrast with tone frequency changes. After training, the cross‐validated RNN model architecture with four hidden layers produced output waveforms in response to simulated auditory inputs that were strongly correlated with grand‐average auditory‐evoked potential waveforms (r² > .9). Units in hidden layers were classified based on their temporal response properties and characterised using principal component analysis and sample entropy. These demonstrated spontaneous alpha rhythms, sound onset and offset responses and putative ‘safety’ and ‘danger’ units activated by relatively inconspicuous and salient changes in auditory inputs, respectively. The hypothesised existence of corresponding biological neural sources is naturally derived from this model. If proven, this could have significant implications for prevailing theories of auditory processing.

A Special Role of Syllables, But Not Vowels or Consonants, for Nonadjacent Dependency Learning

Successful language processing entails tracking (morpho)syntactic relationships between distant units of speech, so-called nonadjacent dependencies (NADs). Many cues to such dependency relations have been identified, yet the linguistic elements encoding them have received little attention. In the present investigation, we tested whether and how these elements, here syllables, consonants, and vowels, affect behavioral learning success as well as learning-related changes in neural activity in relation to item-specific NAD learning. In a set of two EEG studies with adults, we compared learning under conditions where either all segment types (Experiment 1) or only one segment type (Experiment 2) was informative. The collected behavioral and ERP data indicate that, when all three segment types are available, participants mainly rely on the syllable for NAD learning. With only one segment type available for learning, adults also perform most successfully with syllable-based dependencies. Although we find no evidence for successful learning across vowels in Experiment 2, dependencies between consonants seem to be identified at least passively at the phonetic-feature level. Together, these results suggest that successful item-specific NAD learning may depend on the availability of syllabic information. Furthermore, they highlight consonants' distinctive power to support lexical processes. Although syllables show a clear facilitatory function for NAD learning, the underlying mechanisms of this advantage require further research.

Standard Tone Stability as a Manipulation of Precision in the Oddball Paradigm: Modulation of Prediction Error Responses to Fixed-Probability Deviants

Electrophysiological sensory deviance detection signals, such as the mismatch negativity (MMN), have been interpreted from the predictive coding framework as manifestations of prediction error (PE). From a frequentist perspective of the classic oddball paradigm, deviant stimuli are unexpected because of their low probability. However, the amount of PE elicited by a stimulus can be dissociated from its probability of occurrence: when the observer cannot make confident predictions, any event holds little surprise value, no matter how improbable. Here we tested the hypothesis that the magnitude of the neural response elicited to an improbable sound (D) would scale with the precision of the prediction derived from the repetition of another sound (S), by manipulating repetition stability. We recorded the Electroencephalogram (EEG) from 20 participants while passively listening to 4 types of isochronous pure tone sequences differing in the probability of the S tone (880 Hz) while holding constant the probability of the D tone [1,046 Hz; p(D) = 1/11]: Oddball [p(S) = 10/11]; High confidence (7/11); Low confidence (4/11); and Random (1/11). Tones of 9 different frequencies were equiprobably presented as fillers [p(S) + p(D) + p(F) = 1]. Using a mass-univariate non-parametric, cluster-based correlation analysis controlling for multiple comparisons, we found that the amplitude of the deviant-elicited ERP became more negative with increasing S probability, in a time-electrode window consistent with the MMN (ca. 120–200 ms; frontal), suggesting that the strength of a PE elicited to an improbable event indeed increases with the precision of the predictive model.

Auditory spatial attention gradients and cognitive control as a function of vigilance

Selection and effort are central to attention, yet it is unclear whether they draw on a common pool of cognitive resources, and if so, whether there are differences for early versus later stages of cognitive processing. This study assessed effort by quantifying the vigilance decrement, and spatial processing at early and later stages as a function of time-on-task. Participants performed an auditory spatial attention task, with occasional "catch" trials requiring no response. Psychophysiological measures included bilateral cerebral blood flow (transcranial Doppler), pupil dilation, and blink rate. The shape of attention gradients using reaction time indexed early processing, and did not significantly vary over time. Later stimulus-response conflict was comparable over time, except for a reduction to left hemispace stimuli. Target and catch trial accuracy decreased with time, with a more abrupt decrease for catch versus target trials. Diffusion decision modeling found progressive decreases in information accumulation rate and non-decision time, and the adoption of more liberal response criteria. Cerebral blood flow increased from baseline and then decreased over time, particularly in the left hemisphere. Blink rate steadily increased over time, while pupil dilation increased only at the beginning and then returned towards baseline. The findings suggest dissociations between resources for selectivity and effort. Measures of high subjective effort and temporal declines in catch trial accuracy and cerebral blood flow velocity suggest a standard vigilance decrement was evident in parallel with preserved selection. Different attentional systems and classes of computations that may account for dissociations between selectivity versus effort are discussed.

The influence of variability on mismatch negativity amplitude

Mismatch Negativity (MMN) to pattern deviations reveals exquisite pattern detection ability in the brain. MMN amplitude is proposed to be precision-weighted, being inversely proportional to variability within a patterned sound sequence. Two experiments were conducted to determine whether pattern variability, shown to influence MMN to simple pattern deviance, also extends to MMN elicited to abstract pattern deviants. Participants were presented with 3-tone triplet sequences that were defined by regular frequency ascendance with adjacent (A<B<C) or non-adjacent (A<C) dependency. The triplets were defined by an abstract pattern in that the starting frequency of A roamed randomly between 500-3700 Hz. Using variants of these sequences over two studies the results show that MMN was elicited to rare A > C deviants for adjacent and non-adjacent dependencies, was smaller for the latter, was impervious to variance in tone loudness, but showed prolonged sensitivity to the level of variability at sequence onset.

Auditory Pattern Representations Under Conditions of Uncertainty-An ERP Study

The auditory system is able to recognize auditory objects and is thought to form predictive models of them even though the acoustic information arriving at our ears is often imperfect, intermixed, or distorted. We investigated implicit regularity extraction for acoustically intact versus disrupted six-tone sound patterns via event-related potentials (ERPs). In an exact-repetition condition, identical patterns were repeated; in two distorted-repetition conditions, one randomly chosen segment in each sound pattern was replaced either by white noise or by a wrong pitch. In a roving-standard paradigm, sound patterns were repeated 1-12 times (standards) in a row before a new pattern (deviant) occurred. The participants were not informed about the roving rule and had to detect rarely occurring loudness changes. Behavioral detectability of pattern changes was assessed in a subsequent behavioral task. Pattern changes (standard vs. deviant) elicited mismatch negativity (MMN) and P3a, and were behaviorally detected above the chance level in all conditions, suggesting that the auditory system extracts regularities despite distortions in the acoustic input. However, MMN and P3a amplitude were decreased by distortions. At the level of MMN, both types of distortions caused similar impairments, suggesting that auditory regularity extraction is largely determined by the stimulus statistics of matching information. At the level of P3a, wrong-pitch distortions caused larger decreases than white-noise distortions. Wrong-pitch distortions likely prevented the engagement of restoration mechanisms and the segregation of disrupted from true pattern segments, causing stronger informational interference with the relevant pattern information.

Deviant consonance and dissonance capture attention differently only when task demand is high: An ERP study with three-stimulus oddball paradigm

The current study investigated whether consonance (imperfect consonance: major third) and dissonance (minor second) would capture attention differently when they occurred as chords (combinations of two tones) that were deviant from their context. In addition, we also examined how task demand would modulate these chords' attentional capture. For this investigation, we used an auditory three-stimulus oddball paradigm in which these chords were presented as deviant stimuli (5% each) among frequent standard (80%) and infrequent target (10%) pure tones. The task difficulty was manipulated by changing pitch intervals between standard and target tones. The results showed that these chords elicited dual-peak P3a, and that consonance enhanced the late phase of P3a compared to dissonance, only when the task demand was high. These findings revealed that deviant consonance and dissonance captured attention differently; in particular, consonance captured attention more strongly than dissonance, and this effect was induced by high task demand. This attentional capture difference between the chord categories was induced through enhanced focus of attention on the pitch dimension of oddball stimuli. In addition, the deviant chords might have been processed by a mechanism similar to that which processes novel stimuli, and these chords' differences might have affected not the novelty detection process, but a process which orients attentional resources to deviant chords, which were recognized as novel stimuli.

Evaluation of multi-feature auditory deviance detection in Parkinson's disease: a mismatch negativity study

Behavioral studies on auditory deviance detection in patients with Parkinson's disease (PD) have reported contradictory results. The primary aim of this study was to investigate auditory deviance detection of multiple auditory features in patients with PD by means of objective and reliable electroencephalographic (EEG) measurements. Twelve patients with early-stage PD and twelve age- and gender-matched healthy controls (HCs) were included in this study. Patients with PD participated without their regular dopaminergic medication. All subjects underwent an audiometric screening and performed a passive multi-feature mismatch negativity (MMN) paradigm. Repeated-measures analysis of variance (ANOVA) demonstrated no significant differences between patients with PD and HCs regarding MMN mean amplitude and latency for frequency, duration and gap deviants. Nevertheless, a trend towards increased MMN mean amplitude and latency was found in response to intensity deviants in patients with PD compared to HCs. Increased intensity MMN amplitude may indicate that more neural resources are allocated to the processing of intensity deviances in patients with PD compared to HCs. The interpretation of this intensity-specific MMN alteration is further discussed in the context of a compensatory mechanism for auditory intensity processing and involuntary attention switching in PD.

Human Brain Ages With Hierarchy-Selective Attenuation of Prediction Errors

From the perspective of predictive coding, our brain embodies a hierarchical generative model to realize perception, which proactively predicts the statistical structure of sensory inputs. How are these predictive processes modified as we age? Recent research suggested that aging leads to decreased weighting of sensory inputs and increased reliance on predictions. Here we investigated whether this age-related shift from sensorium to predictions occurs at all levels of hierarchical message passing. We recorded the electroencephalography responses with an auditory local-global paradigm in a cohort of 108 healthy participants from 3 groups: seniors, adults, and adolescents. The detection of local deviancy seems largely preserved in older individuals at earlier latency (including the mismatch negativity followed by the P3a but not the reorienting negativity). In contrast, the detection of global deviancy is clearly compromised in older individuals, as they showed worse task performance and attenuated P3b. Our findings demonstrate that older brains show little decline in sensory (i.e., first-order) prediction errors but significant diminution in contextual (i.e., second-order) prediction errors. Age-related deficient maintenance of auditory information in working memory might affect whether and how lower-level prediction errors propagate to the higher level.

Neurophysiological correlates of abnormal auditory processing in episodic migraine during the interictal period

BACKGROUND

The characteristics of the hypersensitivity to auditory stimuli during the interictal period in episodic migraine are discussed. The combined use of event-related potentials, time-frequency power and phase-synchronization can provide relevant information about the time-course of sensory-attentional processing in migraine and its underlying mechanisms.

OBJECTIVE

The aim of this nested case-control study was to examine these processes in young, female, episodic migraine patients interictally and compare them to controls using an active auditory oddball task.

METHOD

We recorded, using 20 channels, the electrophysiological brain activity of 21 women with episodic migraine without aura and 21 healthy matched controls without family history of migraine, during a novelty oddball paradigm. We collected sociodemographic and clinical data as well as scores related to disability, quality of life, anxiety and depression. We calculated behavioural measures including reaction times, hit rates and false alarms. Spectral power and phase-synchronization of oscillatory activity as well as event-related potentials were obtained for standard stimuli. For target and novel stimuli, event-related potentials were acquired.

RESULTS

There were no significant differences at the behavioural level. In migraine patients, we found an increased phase-synchronization at the theta frequency range and a higher N1 response to standard trials. No differences were observed in spectral power. No evidence for a lack of habituation in any of the measures was seen between migraine patients and controls. The Reorienting Negativity was reduced in migraine patients as compared to controls on novel but not on target trials.

CONCLUSION

Our findings suggest that migraine patients process stimuli as more salient, seem to allocate more of their attentional resources to their surrounding environment, and have less available resources to reorient attention back to the main task.

One-week phonemic training rebuilds the memory traces of merged phonemes in merged speakers

The phonemic merger is a unique phenomenon which is referred to as acoustically very different phonemes are recognized as the same phoneme. In our previous study, we demonstrated that the merged speakers had lost the ability to discriminate the merged phonemes pre-attentively, as revealed by their failure in mismatch negativity (MMN) elicitation in the oddball stream of the merged phonemes /n/-/l/. In this study, we investigated the recovery of the discrimination ability via phonemic training and found that the merged speakers regained the ability of discriminating merged phonemes pre-attentively, after a 7-day /n/-/l/ phonemic training, as revealed by the reactivation of MMN brain response to the /n/-/l/ phoneme categories. Our finding indicates that separate memory traces of merged phonemes could be rebuilt during the training process.

Auditory attention alterations in migraine: A behavioral and MEG/EEG study

OBJECTIVES

To evaluate alterations of top-down and/or bottom-up attention in migraine and their cortical underpinnings.

METHODS

19 migraineurs between attacks and 19 matched control participants performed a task evaluating jointly top-down and bottom-up attention, using visually-cued target sounds and unexpected task-irrelevant distracting sounds. Behavioral responses and magneto- and electro-encephalography signals were recorded. Event-related potentials and fields were processed and source reconstruction was applied to event-related fields.

RESULTS

At the behavioral level, neither top-down nor bottom-up attentional processes appeared to be altered in migraine. However, migraineurs presented heightened evoked responses following distracting sounds (orienting component of the N1 and Re-Orienting Negativity, RON) and following target sounds (orienting component of the N1), concomitant to an increased recruitment of the right temporo-parietal junction. They also displayed an increased effect of the cue informational value on target processing resulting in the elicitation of a negative difference (Nd).

CONCLUSIONS

Migraineurs appear to display increased bottom-up orienting response to all incoming sounds, and an enhanced recruitment of top-down attention.

SIGNIFICANCE

The interictal state in migraine is characterized by an exacerbation of the orienting response to attended and unattended sounds. These attentional alterations might participate to the peculiar vulnerability of the migraine brain to all incoming stimuli.

Neural Indices of Vowel Discrimination in Monolingual and Bilingual Infants and Children

OBJECTIVES

To examine maturation of neural discriminative responses to an English vowel contrast from infancy to 4 years of age and to determine how biological factors (age and sex) and an experiential factor (amount of Spanish versus English input) modulate neural discrimination of speech.

DESIGN

Event-related potential (ERP) mismatch responses (MMRs) were used as indices of discrimination of the American English vowels [ε] versus [I] in infants and children between 3 months and 47 months of age. A total of 168 longitudinal and cross-sectional data sets were collected from 98 children (Bilingual Spanish-English: 47 male and 31 female sessions; Monolingual English: 48 male and 42 female sessions). Language exposure and other language measures were collected. ERP responses were examined in an early time window (160 to 360 msec, early MMR [eMMR]) and late time window (400 to 600 msec, late MMR).

RESULTS

The eMMR became more negative with increasing age. Language experience and sex also influenced the amplitude of the eMMR. Specifically, bilingual children, especially bilingual females, showed more negative eMMR compared with monolingual children and with males. However, the subset of bilingual children with more exposure to English than Spanish compared with those with more exposure to Spanish than English (as reported by caretakers) showed similar amplitude of the eMMR to their monolingual peers. Age was the only factor that influenced the amplitude of the late MMR. More negative late MMR was observed in older children with no difference found between bilingual and monolingual groups.

CONCLUSIONS

Consistent with previous studies, our findings revealed that biological factors (age and sex) and language experience modulated the amplitude of the eMMR in young children. The early negative MMR is likely to be the mismatch negativity found in older children and adults. In contrast, the late MMR amplitude was influenced only by age and may be equivalent to the Nc in infants and to the late negativity observed in some auditory passive oddball designs.

The Relationship Between Attentional Capture by Speech and Nonfluent Speech Under Delayed Auditory Feedback: A Pilot Examination of a Dual-Task Using Auditory or Tactile Stimulation

Delayed auditory feedback (DAF) leads to nonfluent speech where the voice of a speaker is heard after a delay. Previous studies suggested the involvement of attention to auditory feedback in speech disfluency. To date, there are no studies that have revealed the relationship between attention and nonfluent speech by controlling the attention allocated to the delayed own voice. This study examined these issues under three conditions: a single task where the subject was asked to read aloud under DAF (single DAF task), a dual task where the subject was asked to read aloud while reacting to a pure tone (auditory DAF task), and a dual task where the subject was asked to read aloud while reacting to the vibration of their finger (tactile DAF task). The subjects also performed the single and dual tasks (auditory/tactile) under nonaltered auditory feedback where no delayed voices were involved. Results showed that the nonfluency rate under the auditory DAF task was significantly greater than that under the single DAF task. In contrast, the nonfluency rate under the tactile DAF task was significantly lower compared with that of the single DAF task. Speech became nonfluent when attention was captured by the same modality stimulus, i.e., auditory tone. In contrast, speech became fluent when attention was allocated to the stimulus that is irreverent to auditory modality, i.e., tactile vibration. This indicates that nonfluent speech under DAF is involved in attention capture owing to the delayed own voice.

Task difficulty modulates voluntary attention allocation, but not distraction in an auditory distraction paradigm

Keeping task-relevant sensory events in the focus of attention while ignoring irrelevant ones is crucial for optimizing task behavior. This attention-distraction balance might change with the perceptual demands of the ongoing task: while easy tasks might be performed with low attentional effort, difficult ones require enhanced attention. The goal of the present study was to investigate how task difficulty affected allocation of attention and distractibility in an auditory distraction paradigm. Participants performed a tone duration discrimination task in which tones were rarely, occasionally presented at a rare pitch (distracters), and task difficulty was manipulated by the duration difference between short and long tones. Short tones were consistently 200 ms long, while long tone duration was 400 ms in the easy, and 260 ms in the difficult condition. Behavioral results and deviant-minus-standard event-related potential (ERP) waveforms suggested similar magnitudes of distraction in both conditions. ERPs without such a subtraction showed that tone onsets were preceded by a negative-going trend, suggesting that participants prepared for tone onsets. In the difficult condition, N1 amplitudes to tone onsets were enhanced, indicating that participants invested more attentional resources. Increased difficulty also slowed down tone offset processing as reflected by significantly delayed offset-related P1 and N1/N2 waveforms. These results suggest that although task difficulty compels participants to attend the tones more strongly, this does not have significant impact on distraction-related processing.

Making Sense of Mismatch Negativity

Evoked potentials provide valuable insight into brain processes that are integral to our ability to interact effectively and efficiently in the world. The mismatch negativity (MMN) component of the evoked potential has proven highly informative on the ways in which sensitivity to regularity contributes to perception and cognition. This review offers a compendium of research on MMN with a view to scaffolding an appreciation for its use as a tool to explore the way regularities contribute to predictions about the sensory environment over many timescales. In compiling this work, interest in MMN as an index of sensory encoding and memory are addressed, as well as attention. Perspectives on the possible underlying computational processes are reviewed as well as recent observations that invite consideration of how MMN relates to how we learn, what we learn, and why.

Impaired Sensory Processing During Low-Oxygen Exposure: A Noninvasive Approach to Detecting Changes in Cognitive States

The ability to detect novelty in our environment is a critical sensory function. A reliable set of event-related potentials (ERP), known as the auditory deviance response (ADR), are elicited in the absence of directed attention and indexes functionally relevant networks. The ADR consists of three peaks: mismatch negativity (MMN), P3a, and reorienting negativity (RON) that are sequentially evoked in response to unattended changes in repetitive background stimulation. While previous studies have established the ADR's sensitivity to a range of pharmacologic and nonpharmacologic interventions and are leading candidate biomarkers of perturbations of the central nervous system (CNS), here we sought to determine if ADR peaks are sensitive to decreases in breathable oxygen. Participants performed a visuomotor tracking task while EEG was recorded during two 27-min sessions. The two sessions differed in the amount of environmental oxygen available: 10.6% O₂ (hypoxia) versus 20.4% O₂ (normoxia). ERPs were measured while a series of identical, or "standard," tones combined with occasional "oddball," tones, were presented. MMN, P3a, and RON were assessed in response to the oddball compared to the standard stimuli. Behavioral impairment during hypoxia was demonstrated by a deficit in tracking performance compared to the normoxia condition. Whereas no changes were detected in the MMN or RON, the amplitude of the P3a component was significantly reduced during hypoxia compared to normoxia, within the first 9 min of exposure. To our knowledge, this is the first study to demonstrate the effect of low oxygen exposure on passively elicited neural measures of early sensory processing. This study demonstrates that passively elicited EEG measures, reflecting preattentive auditory processing, are disrupted by acute hypoxia. Results have implications for the development of biomarkers for the noninvasive assessment of CNS perturbations.

Neurophysiological Biomarkers in Schizophrenia-P50, Mismatch Negativity, and TMS-EMG and TMS-EEG

Impaired early auditory processing is a well characterized finding in schizophrenia that is theorized to contribute to clinical symptoms, cognitive impairment, and social dysfunction in patients. Two neurophysiological measures of early auditory processing, P50 gating ("P50") and mismatch negativity (MMN), which measure sensory gating and detection of change in auditory stimuli, respectively, are consistently shown to be impaired in patients with schizophrenia. Transcranial magnetic stimulation (TMS) may also be a potential method by which sensory processing can be assessed, since TMS paradigms can be used to measure GABA_B-mediated cortical inhibition that is linked with sensory gating. In this review, we examine the potential of P50, MMN and two TMS paradigms, cortical silent period (CSP) and long-interval intracortical inhibition (LICI), as endophenotypes as well as their ability to be used as predictive markers for interventions targeted at cognitive and psychosocial functioning. Studies consistently support a link between MMN, P50, and cognitive dysfunction, with robust evidence for a link between MMN and psychosocial functioning in schizophrenia as well. Importantly, studies have demonstrated that MMN can be used to predict performance in social and cognitive training tasks. A growing body of studies also supports the potential of MMN to be used as an endophenotype, and future studies are needed to determine if MMN can be used as an endophenotype specifically in schizophrenia. P50, however, has weaker evidence supporting its use as an endophenotype. While CSP and LICI are not as extensively investigated, growing evidence is supporting their potential to be used as an endophenotype in schizophrenia. Future studies that assess the ability of P50, MMN, and TMS neurophysiological measures to predict performance in cognitive and social training programs may identify markers that inform clinical decisions in the treatment of neurocognitive impairments in schizophrenia.

Same or different pitch? Effects of musical expertise, pitch difference, and auditory task on the pitch discrimination ability of musicians and non-musicians

Musical expertise promotes both the perception and the processing of music. The aim of the present study was to analyze if musicians compared to non-musicians already have auditory processing advantages at the neural level. 50 musicians and 50 non-musicians worked on a task to determine the individual auditory difference threshold (individual JND threshold). A passive oddball paradigm followed while the EEG activity was recorded. Frequent standard sounds (528 hertz [Hz]) and rare deviant sounds (individual JND threshold, 535 Hz, and 558 Hz) were presented in the oddball paradigm. The mismatch negativity (MMN) and the P3a were used as indicators of auditory discrimination skills for frequency differences. Musicians had significantly smaller individual JND thresholds than non-musicians, but musicians were not faster than non-musicians. Musicians and non-musicians showed both the MMN and the P3a at the 535 Hz and 558 Hz condition. In the individual JND threshold condition, non-musicians, whose individual JND threshold was at 539.8 Hz (and therefore even above the deviant sound of 535 Hz), predictably showed the MMN and the P3a. Musicians, whose individual JND threshold was at 531.1 Hz (and thus close to the standard sound of 528 Hz), showed no MMN and P3a-although they were behaviorally able to differentiate frequencies individually within their JND threshold range. This may indicate a key role of attention in triggering the MMN during the detection of frequency differences in the individual JND threshold range (see Tervaniemi et al. in Exp Brain 161:1-10, 2005).

Predictive coding and adaptive behavior in patients with genetically determined cerebellar ataxia--A neurophysiology study

Genetically determined cerebellar ataxias (CA) are a heterogeneous group of disorders with progressive decline of cerebellar functions. The cerebellum influences internal forward models that play a role in cognitive control, but whether these processes are dysfunctional in CA is unclear. Here, we examined sensory predictive coding processes and response adaptation in CA and healthy controls (HC) using behavioral tests with concomitant EEG recordings. N = 23 patients and N = 29 age- and sex-matched HC were studied. Sensory prediction coding was tested with an auditory distraction paradigm and error-related behavioral adaptation with a visual flanker task. As neurophysiological markers we studied different event-related potentials: the P3a for orientation of attention; the N2 and the error-related negativity (ERN) for cognitive adaptation processes/consequences of response errors; error-related positivity (Pe) for error-awareness; the mismatch negativity (MMN) for sensory predictive coding; and reorientation negativity (RON) for reorientation after unexpected events. Overall reaction times were slower in patients compared to HC, but error rates did not differ. Both in patients and HC, P3a amplitudes were larger in distraction trials, but the P3a amplitude was smaller in patients compared to HC. The MMN as well as behavioral and EEG-correlates of response adaptation (ERN/N2) did not differ between groups, while the Pe was attenuated in patients. During sensory predictive coding, RON amplitudes were significantly larger in HC compared to patients. In HC, but not in patients, RON amplitudes were also larger in deviant compared to frequent trials. Processes generating internal forward models are largely intact in genetically determined CA, whereas updating of mental models and error awareness are disturbed in these patients.

Emotional Influences on Cognitive Flexibility Depend on Individual Differences: A Combined Micro-Phenomenological and Psychophysiological Study

Imagine a scenario where you are cooking and suddenly, the contents of the pot start to come out, and the oven bell rings. You would have to stop what you are doing and start responding to the changing demands, switching between different objects, operations and mental sets. This ability is known as cognitive flexibility. Now, add to this scenario a strong emotional atmosphere that invades you as you spontaneously recall a difficult situation you had that morning. How would you behave? Recent studies suggest that emotional states do modulate cognitive flexibility, but these findings are still controversial. Moreover, there is a lack of evidence regarding the underlying brain processes. The purpose of the present study was, therefore, to examine such interaction while monitoring changes in ongoing cortical activity using EEG. In order to answer this question, we used two musical stimuli to induce emotional states (positive/high arousal/open stance and negative/high arousal/closed stance). Twenty-nine participants performed two blocks of the Madrid Card Sorting Task in a neutral silence condition and then four blocks while listening to the counterbalanced musical stimuli. To explore this interaction, we used a combination of first-person (micro-phenomenological interview) and third-person (behavior and EEG) approaches. Our results show that compared to the positive stimuli and silence condition, negative stimuli decrease reaction times (RTs) for the shift signal. Our data show that the valance of the first emotional block is determinant in the RTs of the subsequent blocks. Additionally, the analysis of the micro-phenomenological interview and the integration of first- and third-person data show that the emotional disposition generated by the music could facilitate task performance for some participants or hamper it for others, independently of its emotional valence. When the emotional disposition hampered task execution, RTs were slower, and the P300 potential showed a reduced amplitude compared to the facilitated condition. These findings show that the interaction between emotion and cognitive flexibility is more complex than previously thought and points to a new way of understanding the underlying mechanisms by incorporating an in-depth analysis of individual subjective experience.

Spatiotemporal Dynamics of Attention Networks Revealed by Representational Similarity Analysis of EEG and fMRI

The fronto-parietal attention networks have been extensively studied with functional magnetic resonance imaging (fMRI), but spatiotemporal dynamics of these networks are not well understood. We measured event-related potentials (ERPs) with electroencephalography (EEG) and collected fMRI data from identical experiments where participants performed visual and auditory discrimination tasks separately or simultaneously and with or without distractors. To overcome the low temporal resolution of fMRI, we used a novel ERP-based application of multivariate representational similarity analysis (RSA) to parse time-averaged fMRI pattern activity into distinct spatial maps that each corresponded, in representational structure, to a short temporal ERP segment. Discriminant analysis of ERP-fMRI correlations revealed 8 cortical networks-2 sensory, 3 attention, and 3 other-segregated by 4 orthogonal, temporally multifaceted and spatially distributed functions. We interpret these functions as 4 spatiotemporal components of attention: modality-dependent and stimulus-driven orienting, top-down control, mode transition, and response preparation, selection and execution.

Neural Underpinnings of Early Speech Perception and Emergent Literacy

Mismatch negativity (MMN) is an event-related potential component used to index automatic auditory change detection. Thus, MMN provides an excellent tool to assess the speech sensitivity of infants and children. Although MMN is well established in adults, the polarity and latency of mismatch responses (MMRs) in infants are highly inconsistent across studies. This paper aims to provide a comprehensive review of MMN studies of speech perception in early infancy. In particular, data from a series of MMN studies of Mandarin lexical tone, vowels, and initial consonants will be presented to demonstrate how phonological saliency, size of deviance, and neural maturation modulate MMRs in early infancy. These data suggest that MMN and positive MMRs index different functional characteristics and may provide information on when and how children's speech perception becomes automatic at different developmental stages. By using MMN to index sensitivity to speech discrimination, dyslexic children usually show reduced or absent MMN, which supports the relationship between phonological sensitivity and literacy. However, children with attention deficit/hyperactivity disorder showed the typical MMN, but attenuated P3a and enhanced late discriminative negativity. Taken together, the MMR characteristics, including amplitude, peak latency, and the transition of polarity, may be used to index the maturation of speech development and for the early identification of children with atypical language development.

A Signature of Passivity? An Explorative Study of the N3 Event- Related Potential Component in Passive Oddball Tasks

BACKGROUND

Many passive oddball experiments show a sharp negative deflection N3 after P3b, peaking between 400 and 500 ms, but this wave has never been analyzed properly. We conducted five passive oddball experiments, in which the number of deviants (i.e., one or two), their alleged meaning, and their distinctiveness varied.

RESULTS

Mastoid- or common-referenced waveforms showed a fronto-central N3 in all experiments. The data were CSD (Current Source Density) transformed and underwent a Principal Component Analysis (PCA). The PCA revealed N3 containing two subcomponents with very stable peak latencies of about 415 and 455 ms, respectively. Both topography of the subcomponents and their variation with experimental conditions were very similar, indicating a midfrontal sink and a posterior temporal source. An analysis of P3a and P3b components replicated previously known effects.

CONCLUSION

We discuss the similarities and differences between the passive N3 and other components including the MMN, N1, late positive Slow Wave, and reorienting negativity. We also make general hypotheses about a possible functional meaning of N3; on this basis, specific hypotheses are formulated and further experiments are suggested to test these hypotheses.

Music Training Positively Influences the Preattentive Perception of Voice Onset Time in Children with Dyslexia: A Longitudinal Study

Previous results showed a positive influence of music training on linguistic abilities at both attentive and preattentive levels. Here, we investigate whether six months of active music training is more efficient than painting training to improve the preattentive processing of phonological parameters based on durations that are often impaired in children with developmental dyslexia (DD). Results were also compared to a control group of Typically Developing (TD) children matched on reading age. We used a Test–Training–Retest procedure and analysed the Mismatch Negativity (MMN) and the N1 and N250 components of the Event-Related Potentials to syllables that differed in Voice Onset Time (VOT), vowel duration, and vowel frequency. Results were clear-cut in showing a normalization of the preattentive processing of VOT in children with DD after music training but not after painting training. They also revealed increased N250 amplitude to duration deviant stimuli in children with DD after music but not painting training, and no training effect on the preattentive processing of frequency. These findings are discussed in view of recent theories of dyslexia pointing to deficits in processing the temporal structure of speech. They clearly encourage the use of active music training for the rehabilitation of children with language impairments.

Examining the Role of Spatial Changes in Bimodal and Uni-Modal To-Be-Ignored Stimuli and How They Affect Short-Term Memory Processes

This study examines the potential vulnerability of short-term memory processes to distraction by spatial changes within to-be-ignored bimodal, vibratory, and auditory stimuli. Participants were asked to recall sequences of serially presented digits or locations of dots while being exposed to to-be-ignored stimuli. On unexpected occasions, the bimodal to-be-ignored sequence, vibratory to-be-ignored sequence, or auditory to-be-ignored sequence changed their spatial origin from one side of the body (e.g., ear and arm, arm only, ear only) to the other. It was expected that the bimodal stimuli would make the spatial change more salient compared to that of the uni-modal stimuli and that this, in turn, would yield an increase in distraction of serial short-term memory in both the verbal and spatial domains. Our results support this assumption as a disruptive effect of the spatial deviant was only observed when presented within the bimodal to-be-ignored sequence: uni-modal to-be-ignored sequences, whether vibratory: or auditory, had no impact on either verbal or spatial short-term memory. Implications for models of attention capture and the potential special attention capturing role of bimodal stimuli are discussed.

Attenuated mismatch negativity in patients with first-episode antipsychotic-naive schizophrenia using a source-resolved method

BACKGROUND

Mismatch negativity (MMN) is a measure of pre-attentive auditory information processing related to change detection. Traditional scalp-level EEG methods consistently find attenuated MMN in patients with chronic but not first-episode schizophrenia. In the current paper, we use a source-resolved method to assess MMN and hypothesize that more subtle changes can be identified with this analysis method.

METHOD

Fifty-six first-episode antipsychotic-naïve schizophrenia (FEANS) patients (31 males, 25 females, mean age 24.6) and 64 matched controls (37 males, 27 females, mean age 24.8) were assessed for duration-, frequency- and combined-type MMN and P3a as well as 4 clinical, 3 cognitive and 3 psychopathological measures. To evaluate and correlate MMN at source-level, independent component analysis (ICA) was applied to the continuous EEG data to derive equivalent current dipoles which were clustered into 19 clusters based on cortical location.

RESULTS

No scalp channel group MMN or P3a amplitude differences were found. Of the localized clusters, several were in or near brain areas previously suggested to be involved in the MMN response, including frontal and anterior cingulate cortices and superior temporal and inferior frontal gyri. For duration deviants, MMN was attenuated at the right superior temporal gyrus in patients compared to healthy controls (p = 0.01), as was P3a at the superior frontal cortex (p = 0.01). No individual patient correlations with clinical, cognitive, or psychopathological measures survived correction for multiple comparisons.

CONCLUSION

Attenuated source-localized MMN and P3a peak contributions can be identified in FEANS patients using a method based on independent component analysis (ICA). This indicates that deficits in pre-attentive auditory information processing are present at this early stage of schizophrenia and are not the result of disease chronicity or medication. This is to our knowledge the first study on FEANS patients using this more detailed method.

Pre-attentive Mismatch Response and Involuntary Attention Switching to a Deviance in an Earlier-Than-Usual Auditory Stimulus: An ERP Study

An acoustic stimulus elicits an electroencephalographic response called auditory event-related potential (ERP). When some members of a stream of standard auditory stimuli are replaced randomly by a deviant stimulus and this stream is presented to a subject who ignores the stimuli, two different ERPs to deviant and standard stimuli are recorded. If the ERP to standard stimuli is subtracted from the ERP to deviant stimuli, the difference potential (DP) waveform typically exhibits a series of negative-positive-negative deflections called mismatch negativity (MMN), P3a, and reorienting negativity (RON), which are associated with pre-attentive change detection, involuntary attention switching, and reorienting of attention, respectively. The aim of the present study was to investigate how these pre-attentive processes are affected if the change occurs earlier than its usual timing implied by isochronous standard stimuli. In the MMN paradigm employed, 15% of the standards were randomly replaced by deviant stimuli which differed either in their pitch, their earlier onset time, or in both. Event-related responses to these three deviants [timely pitch change (R_TP), earlier onset (R_EO), earlier pitch change (R_EP)] and to standards (R_S) were recorded from 10 reading subjects. To maintain identical stimulation histories for the responses subtracted from each other, "deviant-standard" difference potentials (DP) for "timely" and "early" pitch deviances were derived as follows: DP_TP = R_TP - R_S and DP_EP = R_EP - R_EO. Interestingly, the MMN components of the DPs to timely and early pitch deviances had similar amplitudes, indicating that regularity of stimulus timing does not provide any benefit for the pre-attentive auditory change detection mechanism. However, different scalp current density (SCD) dynamics of the MMN/P3a complexes, elicited by timely and early pitch deviances, suggested that an auditory change in a stimulus occurring earlier-than-usual initiates a faster and more effective call-for-attention and causes stronger attention switching than a timely change. SCD results also indicated that the temporal, frontal, and parietal MMN components are simultaneously present rather than emerging sequentially in time, supporting the MMN models based on parallel deviance processing in the respective cortices. Similarity of the RONs to timely and early pitch deviances indicated that reorienting of attention is of the same strength in two cases.

Distraction by deviant sounds during reading: An eye-movement study

Oddball studies have shown that sounds unexpectedly deviating from an otherwise repeated sequence capture attention away from the task at hand. While such distraction is typically regarded as potentially important in everyday life, previous work has so far not examined how deviant sounds affect performance on more complex daily tasks. In this study, we developed a new method to examine whether deviant sounds can disrupt reading performance by recording participants’ eye movements. Participants read single sentences in silence and while listening to task-irrelevant sounds. In the latter condition, a 50-ms sound was played contingent on the fixation of five target words in the sentence. On most occasions, the same tone was presented (standard sound), whereas on rare and unexpected occasions it was replaced by white noise (deviant sound). The deviant sound resulted in significantly longer fixation durations on the target words relative to the standard sound. A time-course analysis showed that the deviant sound began to affect fixation durations around 180 ms after fixation onset. Furthermore, deviance distraction was not modulated by the lexical frequency of target words. In summary, fixation durations on the target words were longer immediately after the presentation of the deviant sound, but there was no evidence that it interfered with the lexical processing of these words. The present results are in line with the recent proposition that deviant sounds yield a temporary motor suppression and suggest that deviant sounds likely inhibit the programming of the next saccade.

The impact of spoken action words on performance in a cross-modal oddball task

In this study a cross-modal oddball task was employed to study the effect that words spoken either non-urgently or urgently would have on a digit categorization task and if women would exhibit greater behavioral inhibitory control. The words were unrelated to the task itself, but related to the action required to complete the task. Forty participants (21 women) conducted a computerized categorization task while exposed to a sinewave tone as a standard stimulus (75% of the trials) or a to-be ignored word (press, stop) spoken either non-urgently or urgently as unexpected auditory deviant stimulus (6.25% trials for each category). Urgent words had sharp intonation and an average fundamental frequency (F₀) ranging from 191.9 (stop) to 204.6 (press) Hz. Non-urgent words had low intonation with average F₀ ranging from 103.9.9 (stop) to 120.3 (press) Hz. As expected, deviant distraction and longer response times were found by exposure to the word stop, but deviant distraction was not found to be significant with the word press or due to intonation. While the results showed that women had in general longer reaction times, there were no gender differences found related to the deviant distraction caused by word or intonation. The present results do not support the hypothesis that women have greater behavioral inhibitory control, but there was evidence that the meaning of the word could influence response times.

Susceptibility to audio signals during autonomous driving

We investigate how susceptible human drivers are to auditory signals in three situations: when stationary, when driving, or when being driven by an autonomous vehicle. Previous research has shown that human susceptibility is reduced when driving compared to when being stationary. However, it is not known how susceptible humans are under autonomous driving conditions. At the same time, good susceptibility is crucial under autonomous driving conditions, as such systems might use auditory signals to communicate a transition of control from the automated vehicle to the human driver. We measured susceptibility using a three-stimulus auditory oddball paradigm while participants experienced three driving conditions: stationary, autonomous, or driving. We studied susceptibility through the frontal P3 (fP3) Electroencephalography Event-Related Potential response (EEG ERP response). Results show that the fP3 component is reduced in autonomous compared to stationary conditions, but not as strongly as when participants drove themselves. In addition, the fP3 component is further reduced when the oddball task does not require a response (i.e., in a passive condition, versus active). The implication is that, even in a relatively simple autonomous driving scenario, people's susceptibility of auditory signals is not as high as would be beneficial for responding to auditory stimuli.

Visual mismatch response and fMRI signal adaptation correlate in the occipital-temporal cortex

Several electrophysiological studies found response differences to a given stimulus when it is repeated frequently as compared to when it occurs rarely in oddball sequences. Initially defined in acoustic perception, such difference also exists in the visual modality and is referred to as visual mismatch negativity (vMMN). However, the repetition of a stimulus also leads to the reduction of the blood oxygen-level dependent (BOLD) signal (fMRI adaptation, fMRIa) when compared to alternating stimuli in fMRI experiments. So far no study compared the vMMN to fMRIa within the same paradigm and participants. Here we tested the possible connection between fMRIa and vMMN in a visual oddball paradigm in two separate sessions, acquiring electrophysiological and neuroimaging data for real and false characters from the same participants. We found significant visual mismatch response (vMM) as well as fMRIa for both character types. Importantly, the magnitude of the vMM over the CP1 electrode cluster showed a significant correlation with the fMRIa within the letter form area, for real characters. This finding suggests that similar neural mechanisms are responsible for the two phenomena.

Investigating Deviance Distraction and the Impact of the Modality of the To-Be-Ignored Stimuli

It has been suggested that deviance distraction is caused by unexpected sensory events in the to-be-ignored stimuli violating the cognitive system's predictions of incoming stimuli. The majority of research has used methods where the to-be-ignored expected (standards) and the unexpected (deviants) stimuli are presented within the same modality. Less is known about the behavioral impact of deviance distraction when the to-be-ignored stimuli are presented in different modalities (e.g., standard and deviants presented in different modalities). In three experiments using cross-modal oddball tasks with mixed-modality to-be-ignored stimuli, we examined the distractive role of unexpected auditory deviants presented in a continuous stream of expected standard vibrations. The results showed that deviance distraction seems to be dependent upon the to-be-ignored stimuli being presented within the same modality, and that the simplest omission of something expected; in this case, a standard vibration may be enough to capture attention and distract performance.

The Duration of Auditory Sensory Memory for Vowel Processing: Neurophysiological and Behavioral Measures

Speech perception behavioral research suggests that rates of sensory memory decay are dependent on stimulus properties at more than one level (e.g., acoustic level, phonemic level). The neurophysiology of sensory memory decay rate has rarely been examined in the context of speech processing. In a lexical tone study, we showed that long-term memory representation of lexical tone slows the decay rate of sensory memory for these tones. Here, we tested the hypothesis that long-term memory representation of vowels slows the rate of auditory sensory memory decay in a similar way to that of lexical tone. Event-related potential (ERP) responses were recorded to Mandarin non-words contrasting the vowels /i/ vs. /u/ and /y/ vs. /u/ from first-language (L1) Mandarin and L1 American English participants under short and long interstimulus interval (ISI) conditions (short ISI: an average of 575 ms, long ISI: an average of 2675 ms). Results revealed poorer discrimination of the vowel contrasts for English listeners than Mandarin listeners, but with different patterns for behavioral perception and neural discrimination. As predicted, English listeners showed the poorest discrimination and identification for the vowel contrast /y/ vs. /u/, and poorer performance in the long ISI condition. In contrast to Yu et al. (2017), however, we found no effect of ISI reflected in the neural responses, specifically the mismatch negativity (MMN), P3a and late negativity ERP amplitudes. We did see a language group effect, with Mandarin listeners generally showing larger MMN and English listeners showing larger P3a. The behavioral results revealed that native language experience plays a role in echoic sensory memory trace maintenance, but the failure to find an effect of ISI on the ERP results suggests that vowel and lexical tone memory traces decay at different rates.

Highlights:

We examined the interaction between auditory sensory memory decay and language experience.

We compared MMN, P3a, LN and behavioral responses in short vs. long interstimulus intervals.

We found that different from lexical tone contrast, MMN, P3a, and LN changes to vowel contrasts are not influenced by lengthening the ISI to 2.6 s.

We also found that the English listeners discriminated the non-native vowel contrast with lower accuracy under the long ISI condition.

Food words distract the hungry: Evidence of involuntary semantic processing of task-irrelevant but biologically-relevant unexpected auditory words

Rare changes in a stream of otherwise repeated task-irrelevant sounds break through selective attention and disrupt performance in an unrelated visual task by triggering shifts of attention to and from the deviant sound (deviance distraction). Evidence indicates that the involuntary orientation of attention to unexpected sounds is followed by their semantic processing. However, past demonstrations relied on tasks in which the meaning of the deviant sounds overlapped with features of the primary task. Here we examine whether such processing is observed when no such overlap is present but sounds carry some relevance to the participants’ biological need to eat when hungry. We report the results of an experiment in which hungry and satiated participants partook in a cross-modal oddball task in which they categorized visual digits (odd/even) while ignoring task-irrelevant sounds. On most trials the irrelevant sound was a sinewave tone (standard sound). On the remaining trials, deviant sounds consisted of spoken words related to food (food deviants) or control words (control deviants). Questionnaire data confirmed state (but not trait) differences between the two groups with respect to food craving, as well as a greater desire to eat the food corresponding to the food-related words in the hungry relative to the satiated participants. The results of the oddball task revealed that food deviants produced greater distraction (longer response times) than control deviants in hungry participants while the reverse effect was observed in satiated participants. This effect was observed in the first block of trials but disappeared thereafter, reflecting semantic saturation. Our results suggest that (1) the semantic content of deviant sounds is involuntarily processed even when sharing no feature with the primary task; and that (2) distraction by deviant sounds can be modulated by the participants’ biological needs.

Event-Related Potential Measures of Attention Capture in Adolescent Inpatients With Acute Suicidal Behavior

Impaired executive functions, modulated by the frontal lobes, have been suggested to be associated with suicidal behavior. The present study examines one of these executive functions, attentional control, maintaining attention to the task-at-hand. A group of inpatient adolescents with acute suicidal behavior and healthy controls were studied using a passively presented auditory optimal paradigm. This "optimal" paradigm consisted of a series of frequently presented homogenous pure tone "standards" and different "deviants," constructed by changing one or more features of the standard. The optimal paradigm has been shown to be a more time-efficient replacement to the traditional oddball paradigm, which makes it suitable for use in clinical populations. The extent of processing of these "to-be-ignored" auditory stimuli was measured by recording event-related potentials (ERPs). The P3a ERP component is thought to reflect processes associated with the capturing of attention. Rare and novel stimuli may result in an executive decision to switch attention away from the current cognitive task and toward a probe of the potentially more relevant "interrupting" auditory input. On the other hand, stimuli that are quite similar to the standard should not elicit P3a. The P3a has been shown to be larger in immature brains in early compared to later adolescence. An overall enhanced P3a was observed in the suicidal group. The P3a was larger in this group for both the environmental sound and white noise deviants, although only the environmental sound P3a attained significance. Other deviants representing only a small change from the standard did not elicit a P3a in healthy controls. They did elicit a small P3a in the suicidal group. These findings suggest a lowered threshold for the triggering of the involuntary switch of attention in these patients, which may play a role in their reported distractibility. The enhanced P3a is also suggestive of an immature frontal central executive and may provide a promising marker for early identification of some of the risk factors for some of the cognitive difficulties linked to suicidality.

Impact of Spatial and Verbal Short-Term Memory Load on Auditory Spatial Attention Gradients

Short-term memory load can impair attentional control, but prior work shows that the extent of the effect ranges from being very general to very specific. One factor for the mixed results may be reliance on point estimates of memory load effects on attention. Here we used auditory attention gradients as an analog measure to map-out the impact of short-term memory load over space. Verbal or spatial information was maintained during an auditory spatial attention task and compared to no-load. Stimuli were presented from five virtual locations in the frontal azimuth plane, and subjects focused on the midline. Reaction times progressively increased for lateral stimuli, indicating an attention gradient. Spatial load further slowed responses at lateral locations, particularly in the left hemispace, but had little effect at midline. Verbal memory load had no (Experiment 1), or a minimal (Experiment 2) influence on reaction times. Spatial and verbal load increased switch costs between memory encoding and attention tasks relative to the no load condition. The findings show that short-term memory influences the distribution of auditory attention over space; and that the specific pattern depends on the type of information in short-term memory.

Neurophysiological differentiation between preattentive and attentive processing of emotional expressions on French vowels

The present electrophysiological study investigated the processing of emotional prosody by minimizing as much as possible the effect of emotional information conveyed by the lexical-semantic context. Emotionally colored French vowels (i.e., happiness, sadness, fear, and neutral) were presented in a mismatch negativity (MMN) oddball paradigm. Both the MMN, i.e., an event-related potential (ERP) component thought to reflect preattentive change detection, and the P3a, i.e., an ERP marker of involuntary orientation of attention toward deviant stimuli, were significantly modulated by the emotional deviants compared to the neutral ones. Critically, the largest amplitude (MMN, P3a) and the shortest peak latency (MMN) were observed for fear deviants, all other things being equal. Taken together, the present findings lend support to a sequential neurocognitive model of emotion processing (Scherer, 2001) which postulates, among other checks, a first stage of automatic emotion detection (MMN) followed by a second stage of subjective evaluation of the stimulus or event (P3a). Consistently with previous studies, our data suggest that among the six universal emotions, fear could have a special status probably because of its adaptive role in the evolution of the human species.