The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function

Lower frequency range of auditory input facilitates stream segregation in older adults

The current study investigated the effect of lower frequency input on stream segregation acuity in older, normal hearing adults. Using event-related brain potentials (ERPs) and perceptual performance measures, we previously showed that stream segregation abilities were less proficient in older compared to younger adults. However, in that study we used frequency ranges greater than 1500 Hz. In the current study, we lowered the target frequency range below 1500 Hz and found similar stream segregation abilities in younger and older adults. These results indicate that the perception of complex auditory scenes is influenced by the spectral content of the auditory input and suggest that lower frequency ranges of input in older adults may facilitate listening ability in complex auditory environments. These results also have implications for the advancement of prosthetic devices.

Habituation of Central and Electrodermal Responses to an Auditory Two-Stimulus Oddball Paradigm

The orienting reaction (OR) towards a new stimulus is subject to habituation, i.e., progressively attenuates with stimulus repetition. The skin conductance responses (SCRs) are known to represent a reliable measure of OR at the peripheral level. Yet, it is still a matter of debate which of the P3 subcomponents is the most likely to represent the central counterpart of the OR. The aim of the present work was to study habituation, recovery, and dishabituation phenomena intrinsic to a two-stimulus auditory oddball paradigm, one of the most-used paradigms both in research and clinic, by simultaneously recording SCRs and P3 in twenty healthy volunteers. Our findings show that the target stimulus was capable of triggering a more marked OR, as indexed by both SCRs and P3, compared to the standard stimulus, that could be due to its affective saliency and relevance for task completion; the application of temporal principal components analysis (PCA) to the P3 complex allowed us to identify several subcomponents including both early and late P3a (eP3a; lP3a), P3b, novelty P3 (nP3), and both a positive and a negative Slow Wave (+SW; -SW). Particularly, lP3a and P3b subcomponents showed a similar behavior to that observed for SCRs , suggesting them as central counterparts of OR. Finally, the P3 evoked by the first standard stimulus after the target showed a significant dishabituation phenomenon which could represent a sign of the local stimulus change. However, it did not reach a sufficient level to trigger an SCR/OR since it did not represent a salient event in the context of the task.

Human brain dynamics dissociate early perceptual and late motor-related stages of affordance processing

Affordances, the opportunities for action offered by the environment to an agent, are vital for meaningful behaviour and exist in every interaction with the environment. There is an ongoing debate in the field about whether the perception of affordances is an automated process. Some studies suggest that affordance perception is an automated process that is independent from the visual context and bodily interaction with the environment, whereas others argue that it is modulated by the visual and motor context in which affordances are perceived. The present paper aims to resolve this debate by examining affordance automaticity from the perspective of sensorimotor time windows. To investigate the impact of different forms of bodily interactions with an environment, that is, the movement context (physical vs. joystick movement), we replicated a previous study on affordance perception in which participants actively moved through differently wide doors in an immersive 3D virtual environment. In the present study, we displayed the same environment on a 2D screen with participants moving through doors of different widths using the keys on a standard keyboard. We compared components of the event-related potential (ERP) from the continuously recorded electroencephalogram (EEG) that were previously reported to be related to affordance perception of architectural transitions (passable and impassable doors). Comparing early sensory and later motor-related ERPs, our study replicated ERPs reflecting early affordance perception but found differences in later motor-related components. These results indicate a shift from automated perception of affordances during early sensorimotor time windows to movement context dependence of affordance perception at later stages, suggesting that affordance perception is a dynamic and flexible process that changes over sensorimotor stages.

Psychological and Brain Responses to Artificial Intelligence's Violation of Community Ethics

Human moral reactions to artificial intelligence (AI) agents' behavior constitute an important aspect of modern-day human-AI relationships. Although previous studies have mainly focused on autonomy ethics, this study investigates how individuals judge AI agents' violations of community ethics (including betrayals and subversions) compared with human violations. Participants' behavioral responses, event-related potentials (ERPs), and individual differences were assessed. Behavioral findings reveal that participants rated AI agents' community-violating actions less morally negative than human transgressions, possibly because AI agents are commonly perceived as having less agency than human adults. The ERP N1 component showed the same pattern with moral rating scores, indicating the modulation effect of human-AI differences on initial moral intuitions. Moreover, the level of social withdrawal correlated with a smaller N1 in the human condition but not in the AI condition. The N2 and P2 components were sensitive to the difference between the loyalty/betrayal and authority/subversion domains but not human/AI differences. Individual levels of moral sense and autistic traits also influenced behavioral data, especially on the loyalty/betrayal domain. In our opinion, these findings offer insights for predicting moral responses to AI agents and guiding ethical AI development aligned with human moral values.

Aging effects on the neural representation and perception of consonant transition cues

Older listeners have difficulty processing temporal cues that are important for word discrimination, and deficient processing may limit their ability to benefit from these cues. Here, we investigated aging effects on perception and neural representation of the consonant transition and the factors that contribute to successful perception. To further understand the neural mechanisms underlying the changes in processing from brainstem to cortex, we also examined the factors that contribute to exaggerated amplitudes in cortex. We enrolled 30 younger normal-hearing and 30 older normal-hearing participants who met the criteria of clinically normal hearing. Perceptual identification functions were obtained for the words BEAT and WHEAT on a 7-step continuum of consonant-transition duration. Auditory brainstem responses (ABRs) were recorded to click stimuli and frequency-following responses (FFRs) and cortical auditory-evoked potentials were recorded to the endpoints of the BEAT-WHEAT continuum. Perceptual performance for identification of BEAT vs. WHEAT did not differ between younger and older listeners. However, both subcortical and cortical measures of neural representation showed age group differences, such that FFR phase locking was lower but cortical amplitudes (P1 and N1) were higher in older compared to younger listeners. ABR Wave I amplitude and FFR phase locking, but not audiometric thresholds, predicted early cortical amplitudes. Phase locking to the transition region and early cortical peak amplitudes (P1) predicted performance on the perceptual identification function. Overall, results suggest that the neural representation of transition durations and cortical overcompensation may contribute to the ability to perceive transition duration contrasts. Cortical overcompensation appears to be a maladaptive response to decreased neural firing/synchrony.

Non-invasive measurement of rat auditory evoked fields using an optically pumped atomic magnetometer: Effects of task manipulation

Optically pumped magnetometers (OPMs) have become a favorable tool for magnetoencephalography (MEG) measurement, offering a non-invasive method of measurement. OPMs do not require cryogenic environments, sensors can be more closely aligned with the brain. We employed a passive single-stimulus paradigm in conjunction with OPMs with a sensitivity of 20 fT/Hz to investigate the auditory response of rats to inter-stimulus interval (ISI) and frequencies, recording the rat auditory event-related magnetic fields (ERMFs). Our findings include: (1) Auditory evoked fields can be detected non-invasively by OPMs; (2) The amplitude of the rat auditory ERMFs varies with changes in ISI, with more pronounced amplitude changes observed after 5 s; (3) When the sound stimulus frequency is altered at the same ISI, the amplitude of the rats ERMFs changes with frequency, indicating significant differences in attention. Our method offers a valuable tool for the clinical application of a single stimulus paradigm and opens up a new avenue for research on the brain magnetic field detections.

Narrative as active inference: an integrative account of cognitive and social functions in adaptation

While the ubiquity and importance of narratives for human adaptation is widely recognized, there is no integrative framework for understanding the roles of narrative in human adaptation. Research has identified several cognitive and social functions of narratives that are conducive to well-being and adaptation as well as to coordinated social practices and enculturation. In this paper, we characterize the cognitive and social functions of narratives in terms of active inference, to support the claim that one of the main adaptive functions of narrative is to generate more useful (i.e., accurate, parsimonious) predictions for the individual, as well as to coordinate group action (over multiple timescales) through shared predictions about collective behavior. Active inference is a theory that depicts the fundamental tendency of living organisms to adapt by proactively inferring the causes of their sensations (including their own actions). We review narrative research on identity, event segmentation, episodic memory, future projections, storytelling practices, enculturation, and master narratives. We show how this research dovetails with the active inference framework and propose an account of the cognitive and social functions of narrative that emphasizes that narratives are for the future-even when they are focused on recollecting or recounting the past. Understanding narratives as cognitive and cultural tools for mutual prediction in social contexts can guide research on narrative in adaptive behavior and psychopathology, based on a parsimonious mechanistic model of some of the basic adaptive functions of narrative.

Auditory Processing of Intonational Rises and Falls in German: Rises Are Special in Attention Orienting

This article investigates the processing of intonational rises and falls when presented unexpectedly in a stream of repetitive auditory stimuli. It examines the neurophysiological correlates (ERPs) of attention to these unexpected stimuli through the use of an oddball paradigm where sequences of repetitive stimuli are occasionally interspersed with a deviant stimulus, allowing for elicitation of an MMN. Whereas previous oddball studies on attention toward unexpected sounds involving pitch rises were conducted on nonlinguistic stimuli, the present study uses as stimuli lexical items in German with naturalistic intonation contours. Results indicate that rising intonation plays a special role in attention orienting at a pre-attentive processing stage, whereas contextual meaning (here a list of items) is essential for activating attentional resources at a conscious processing stage. This is reflected in the activation of distinct brain responses: Rising intonation evokes the largest MMN, whereas falling intonation elicits a less pronounced MMN followed by a P3 (reflecting a conscious processing stage). Subsequently, we also find a complex interplay between the phonological status (i.e., accent/head marking vs. boundary/edge marking) and the direction of pitch change in their contribution to attention orienting: Attention is not oriented necessarily toward a specific position in prosodic structure (head or edge). Rather, we find that the intonation contour itself and the appropriateness of the contour in the linguistic context are the primary cues to two core mechanisms of attention orienting, pre-attentive and conscious orientation respectively, whereas the phonological status of the pitch event plays only a supplementary role.

Exploring the Differences Between an Immature and a Mature Human Auditory System Through Auditory Late Responses in Quiet and in Noise

Children are disadvantaged compared to adults when they perceive speech in a noisy environment. Noise reduces their ability to extract and understand auditory information. Auditory-Evoked Late Responses (ALRs) offer insight into how the auditory system can process information in noise. This study investigated how noise, signal-to-noise ratio (SNR), and stimulus type affect ALRs in children and adults. Fifteen participants from each group with normal hearing were studied under various conditions. The findings revealed that both groups experienced delayed latencies and reduced amplitudes in noise but that children had fewer identifiable waves than adults. Babble noise had a significant impact on both groups, limiting the analysis to one condition: the /da/ stimulus at +10 dB SNR for the P1 wave. P1 amplitude was greater in quiet for children compared to adults, with no stimulus effect. Children generally exhibited longer latencies. N1 latency was longer in noise, with larger amplitudes in white noise compared to quiet for both groups. P2 latency was shorter with the verbal stimulus in quiet, with larger amplitudes in children than adults. N2 latency was shorter in quiet, with no amplitude differences between the groups. Overall, noise prolonged latencies and reduced amplitudes. Different noise types had varying impacts, with the eight-talker babble noise causing more disruption. Children's auditory system responded similarly to adults but may be more susceptible to noise. This research emphasizes the need to understand noise's impact on children's auditory development, given their exposure to noisy environments, requiring further exploration of noise parameters in children.

Auditory change detection and visual selective attention: association between MMN and N2pc

While the auditory and visual systems each provide distinct information to our brain, they also work together to process and prioritize input to address ever-changing conditions. Previous studies highlighted the trade-off between auditory change detection and visual selective attention; however, the relationship between them is still unclear. Here, we recorded electroencephalography signals from 106 healthy adults in three experiments. Our findings revealed a positive correlation at the population level between the amplitudes of event-related potential indices associated with auditory change detection (mismatch negativity) and visual selective attention (posterior contralateral N2) when elicited in separate tasks. This correlation persisted even when participants performed a visual task while disregarding simultaneous auditory stimuli. Interestingly, as visual attention demand increased, participants whose posterior contralateral N2 amplitude increased the most exhibited the largest reduction in mismatch negativity, suggesting a within-subject trade-off between the two processes. Taken together, our results suggest an intimate relationship and potential shared mechanism between auditory change detection and visual selective attention. We liken this to a total capacity limit that varies between individuals, which could drive correlated individual differences in auditory change detection and visual selective attention, and also within-subject competition between the two, with task-based modulation of visual attention causing within-participant decrease in auditory change detection sensitivity.

A Review of Childhood Developmental Changes in Attention as Indexed in the Electrical Activity of the Brain

This review aims to present age-related changes in the neuroelectric responses of typically developing children (TDC) who are presumed to meet developmental stages appropriately. The review is based on findings from the frequently used neuropsychological tasks of active attention, where attention is deliberately focused versus passive attention where attention is drawn to a stimulus, facilitatory attention, which enhances the processing of a stimulus versus inhibitory attention, which suppresses the processing of a stimulus. The review discusses the early and late stages of attentional selectivity that correspond to early and late information processing. Age-related changes in early attentional selectivity were quantitatively represented in latencies of the event-related potential (ERP) components. Age-related changes in late attentional selectivity are also qualitatively represented by structural and functional reorganization of attentional processing and the brain areas involved. The purely bottom-up or top-down processing is challenged with age-related findings on difficult tasks that ensure a high cognitive load. TDC findings on brain oscillatory activity are enriched by findings from attention deficit hyperactivity disorder (ADHD). The transition from the low to fast oscillations in TDC and ADHD confirmed the maturational lag hypothesis. The deviant topographical localization of the oscillations confirmed the maturational deviance model. The gamma-based match and utilization model integrates all levels of attentional processing. According to these findings and theoretical formulations, brain oscillations can potentially display the human brain's wholistic-integrative functions.

Is source-resolved magnetoencephalographic mismatch negativity a viable biomarker for early psychosis?

Mismatch negativity (MMN) is an auditory event-related response reflecting the pre-attentive detection of novel stimuli and is a biomarker of cortical dysfunction in schizophrenia (SZ). MMN to pitch (pMMN) and to duration (dMMN) deviant stimuli are impaired in chronic SZ, but it is less clear if MMN is reduced in first-episode SZ, with inconsistent findings in scalp-level EEG studies. Here, we investigated the neural generators of pMMN and dMMN with MEG recordings in 26 first-episode schizophrenia spectrum (FEsz) and 26 matched healthy controls (C). We projected MEG inverse solutions into precise functionally meaningful auditory cortex areas. MEG-derived MMN sources were in bilateral primary auditory cortex (A1) and belt areas. In A1, pMMN FEsz reduction showed a trend towards statistical significance (F(1,50) = 3.31; p = .07), and dMMN was reduced in FEsz (F(1,50) = 4.11; p = .04). Hypothesis-driven comparisons at each hemisphere revealed dMMN reduction in FEsz occurred in the left (t(56) = 2.23; p = .03; d = .61) but not right (t(56) = 1.02; p = .31; d = .28) hemisphere, with a moderate effect size. The added precision of MEG source solution with high-resolution MRI and parcellation of A1 may be requisite to detect the emerging pathophysiology and indicates a critical role for left hemisphere pathology at psychosis onset. However, the moderate effect size in left A1, albeit larger than reported in scalp MMN meta-analyses, casts doubt on the clinical utility of MMN for differential diagnosis, as a majority of patients will overlap with the healthy individual's distribution.

Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network

Selective attention-related top-down modulation plays a significant role in separating relevant speech from irrelevant background speech when vocal attributes separating concurrent speakers are small and continuously evolving. Electrophysiological studies have shown that such top-down modulation enhances neural tracking of attended speech. Yet, the specific cortical regions involved remain unclear due to the limited spatial resolution of most electrophysiological techniques. To overcome such limitations, we collected both electroencephalography (EEG) (high temporal resolution) and functional magnetic resonance imaging (fMRI) (high spatial resolution), while human participants selectively attended to speakers in audiovisual scenes containing overlapping cocktail party speech. To utilise the advantages of the respective techniques, we analysed neural tracking of speech using the EEG data and performed representational dissimilarity-based EEG-fMRI fusion. We observed that attention enhanced neural tracking and modulated EEG correlates throughout the latencies studied. Further, attention-related enhancement of neural tracking fluctuated in predictable temporal profiles. We discuss how such temporal dynamics could arise from a combination of interactions between attention and prediction as well as plastic properties of the auditory cortex. EEG-fMRI fusion revealed attention-related iterative feedforward-feedback loops between hierarchically organised nodes of the ventral auditory object related processing stream. Our findings support models where attention facilitates dynamic neural changes in the auditory cortex, ultimately aiding discrimination of relevant sounds from irrelevant ones while conserving neural resources.

Assessing mismatch negativity (MMN) and P3b within-individual sensitivity - A comparison between the local-global paradigm and two specialized oddball sequences

Mismatch negativity (MMN) and P3b are well known for their clinical utility. There exists no gold standard, however, for acquiring them as EEG markers of consciousness in clinical settings. This may explain why the within-individual sensitivity of MMN/P3b paradigms is often quite poor and why seemingly identical EEG markers can behave differently across Disorders of consciousness (DoC) studies. Here, we compare two traditional paradigms for MMN or P3b assessment with the recently more popular local-global paradigm that promises to assess MMN and P3b orthogonally within one oddball sequence. All three paradigms were administered to healthy participants (N = 15) with concurrent EEG. A clear MMN and local effect were found for 15/15 participants. The P3b and global effect were found for 14/15 and 13/15 participants, respectively. There were no systematic differences between the global effect and P3b. Indeed, P3b amplitude was highly correlated across paradigms. The local effect differed clearly from the MMN, however. It occurred earlier than MMN and was followed by a much more prominent P3a. The peak latencies and amplitudes were also not correlated across paradigms. Caution should therefore be exercised when comparing the local effect and MMN across studies. We conclude that the within-individual MMN sensitivity is adequate for both the local-global and a dedicated MMN paradigm. The within-individual sensitivity of P3b was lower than expected for both the local-global and a dedicated P3b paradigm, which may explain the often-low sensitivity of P3b paradigms in patients with DoC.

Classification of Targets and Distractors in an Audiovisual Attention Task Based on Electroencephalography

Within the broader context of improving interactions between artificial intelligence and humans, the question has arisen regarding whether auditory and rhythmic support could increase attention for visual stimuli that do not stand out clearly from an information stream. To this end, we designed an experiment inspired by pip-and-pop but more appropriate for eliciting attention and P3a-event-related potentials (ERPs). In this study, the aim was to distinguish between targets and distractors based on the subject's electroencephalography (EEG) data. We achieved this objective by employing different machine learning (ML) methods for both individual-subject (IS) and cross-subject (CS) models. Finally, we investigated which EEG channels and time points were used by the model to make its predictions using saliency maps. We were able to successfully perform the aforementioned classification task for both the IS and CS scenarios, reaching classification accuracies up to 76%. In accordance with the literature, the model primarily used the parietal-occipital electrodes between 200 ms and 300 ms after the stimulus to make its prediction. The findings from this research contribute to the development of more effective P300-based brain-computer interfaces. Furthermore, they validate the EEG data collected in our experiment.

Time-resolved dynamic computational modeling of human EEG recordings reveals gradients of generative mechanisms for the MMN response

Despite attempts to unify the different theoretical accounts of the mismatch negativity (MMN), there is still an ongoing debate on the neurophysiological mechanisms underlying this complex brain response. On one hand, neuronal adaptation to recurrent stimuli is able to explain many of the observed properties of the MMN, such as its sensitivity to controlled experimental parameters. On the other hand, several modeling studies reported evidence in favor of Bayesian learning models for explaining the trial-to-trial dynamics of the human MMN. However, direct comparisons of these two main hypotheses are scarce, and previous modeling studies suffered from methodological limitations. Based on reports indicating spatial and temporal dissociation of physiological mechanisms within the timecourse of mismatch responses in animals, we hypothesized that different computational models would best fit different temporal phases of the human MMN. Using electroencephalographic data from two independent studies of a simple auditory oddball task (n = 82), we compared adaptation and Bayesian learning models' ability to explain the sequential dynamics of auditory deviance detection in a time-resolved fashion. We first ran simulations to evaluate the capacity of our design to dissociate the tested models and found that they were sufficiently distinguishable above a certain level of signal-to-noise ratio (SNR). In subjects with a sufficient SNR, our time-resolved approach revealed a temporal dissociation between the two model families, with high evidence for adaptation during the early MMN window (from 90 to 150-190 ms post-stimulus depending on the dataset) and for Bayesian learning later in time (170-180 ms or 200-220ms). In addition, Bayesian model averaging of fixed-parameter models within the adaptation family revealed a gradient of adaptation rates, resembling the anatomical gradient in the auditory cortical hierarchy reported in animal studies.

Divergent auditory activation in relation to inhibition task performance in children and adults

Adults and children show remarkable differences in cortical auditory activation which, in children, have shown relevance for cognitive performance, specifically inhibitory control. However, it has not been tested whether these differences translate to functional differences in response inhibition between adults and children. We recorded auditory responses of adults and school-aged children (6-14 years) using combined magneto- and electroencephalography (M/EEG) during passive listening conditions and an auditory Go/No-go task. The associations between auditory cortical responses and inhibition performance measures diverge between adults and children; while in children the brain-behavior associations are not significant, or stronger responses are beneficial, adults show negative associations between auditory cortical responses and inhibitory performance. Furthermore, we found differences in brain responses between adults and children; the late (~200 ms post stimulation) adult peak activation shifts from auditory to frontomedial areas. In contrast, children show prolonged obligatory responses in the auditory cortex. Together this likely translates to a functional difference between adults and children in the cortical resources for performance consistency in auditory-based cognitive tasks.

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Spatiotemporal dynamics across visual cortical laminae support a predictive coding framework for interpreting mismatch responses

Context modulates neocortical processing of sensory data. Unexpected visual stimuli elicit large responses in primary visual cortex (V1)-a phenomenon known as deviance detection (DD) at the neural level, or "mismatch negativity" (MMN) when measured with EEG. It remains unclear how visual DD/MMN signals emerge across cortical layers, in temporal relation to the onset of deviant stimuli, and with respect to brain oscillations. Here we employed a visual "oddball" sequence-a classic paradigm for studying aberrant DD/MMN in neuropsychiatric populations-and recorded local field potentials in V1 of awake mice with 16-channel multielectrode arrays. Multiunit activity and current source density profiles showed that although basic adaptation to redundant stimuli was present early (50 ms) in layer 4 responses, DD emerged later (150-230 ms) in supragranular layers (L2/3). This DD signal coincided with increased delta/theta (2-7 Hz) and high-gamma (70-80 Hz) oscillations in L2/3 and decreased beta oscillations (26-36 Hz) in L1. These results clarify the neocortical dynamics elicited during an oddball paradigm at a microcircuit level. They are consistent with a predictive coding framework, which posits that predictive suppression is present in cortical feed-back circuits, which synapse in L1, whereas "prediction errors" engage cortical feed-forward processing streams, which emanate from L2/3.

Mismatch negativity generation in subjects at risk for psychosis: source analysis is more sensitive than surface electrodes in risk prediction

Background

Deficits of mismatch negativity (MMN) in patients with schizophrenia have been demonstrated many times and there is growing evidence that alterations of MMN already exist in individuals at risk for psychosis. The present study examines differences in MMN between subjects fulfilling ultra-high risk (UHR) or only basic symptoms criteria and it addresses the question, if MMN source analysis can improve prediction of transition to psychosis.

Methods

The MMN to duration, frequency, and intensity deviants was recorded in 50 healthy controls and 161 individuals at risk for psychosis classified into three subgroups: only basic symptoms (n = 74), only ultra-high risk (n = 13) and persons who fulfill both risk criteria (n = 74). Based on a three-source model of MMN generation, we conducted an MMN source analysis and compared the amplitudes of surface electrodes and sources among the three groups.

Results

Significant differences in MMN generation among the four groups were revealed at surface electrodes Cz and C4 (p < 0.05) and at the frontal source (p < 0.001) for duration deviant stimuli. The 15 subjects from the risk groups who subsequently developed a manifest psychosis had a significantly lower MMN amplitude at frontal source (p = 0.019) without showing significant differences at surface electrodes. Low activity at frontal MMN source increased the risk of transition to manifest disease by the factor 3.12 in UHR subjects.

Conclusion

MMN activity differed significantly between subjects presenting only basic symptoms and subjects which additionally meet UHR criteria. The largest differences between groups as well as between individuals with and without transition were observed at the frontal source. The present results suggest that source analysis is more sensitive than surface electrodes in psychosis risk prediction by MMN.

Prognosis of consciousness disorders in the intensive care unit

Assessments of consciousness are a critical part of prognostic algorithms for critically ill patients suffering from severe brain injuries. There have been significant advances in the field of coma science over the past two decades, providing clinicians with more advanced and precise tools for diagnosing and prognosticating disorders of consciousness (DoC). Advanced neuroimaging and electrophysiological techniques have vastly expanded our understanding of the biological mechanisms underlying consciousness, and have helped identify new states of consciousness. One of these, termed cognitive motor dissociation, can predict functional recovery at 1 year post brain injury, and is present in up to 15-20% of patients with DoC. In this chapter, we review several tools that are used to predict DoC, describing their strengths and limitations, from the neurological examination to advanced imaging and electrophysiologic techniques. We also describe multimodal assessment paradigms that can be used to identify covert consciousness and thus help recognize patients with the potential for future recovery and improve our prognostication practices.

Spatiotemporal dynamics across visual cortical laminae support a predictive coding framework for interpreting mismatch responses

Context modulates neocortical processing of sensory data. Unexpected visual stimuli elicit large responses in primary visual cortex (V1) -- a phenomenon known as deviance detection (DD) at the neural level, or "mismatch negativity" (MMN) when measured with EEG. It remains unclear how visual DD/MMN signals emerge across cortical layers, in temporal relation to the onset of deviant stimuli, and with respect to brain oscillations. Here we employed a visual "oddball" sequence - a classic paradigm for studying aberrant DD/MMN in neuropsychiatric populations - and recorded local field potentials in V1 of awake mice with 16-channel multielectrode arrays. Multiunit activity and current source density profiles showed that while basic adaptation to redundant stimuli was present early (50ms) in layer 4 responses, DD emerged later (150-230ms) in supragranular layers (L2/3). This DD signal coincided with increased delta/theta (2-7Hz) and high-gamma (70-80Hz) oscillations in L2/3 and decreased beta oscillations (26-36hz) in L1. These results clarify the neocortical dynamics elicited during an oddball paradigm at a microcircuit level. They are consistent with a predictive coding framework, which posits that predictive suppression is present in cortical feed-back circuits, which synapse in L1, while "prediction errors" engage cortical feed-forward processing streams, which emanate from L2/3.

Speech prosody supports speaker selection and auditory stream segregation in a multi-talker situation

To process speech in a multi-talker environment, listeners need to segregate the mixture of incoming speech streams and focus their attention on one of them. Potentially, speech prosody could aid the segregation of different speakers, the selection of the desired speech stream, and detecting targets within the attended stream. For testing these issues, we recorded behavioral responses and extracted event-related potentials and functional brain networks from electroencephalographic signals recorded while participants listened to two concurrent speech streams, performing a lexical detection and a recognition memory task in parallel. Prosody manipulation was applied to the attended speech stream in one group of participants and to the ignored speech stream in another group. Naturally recorded speech stimuli were either intact, synthetically F0-flattened, or prosodically suppressed by the speaker. Results show that prosody - especially the parsing cues mediated by speech rate - facilitates stream selection, while playing a smaller role in auditory stream segmentation and target detection.

Immediate effects and duration of a short and single application of transcutaneous auricular vagus nerve stimulation on P300 event related potential

Introduction

Transcutaneous auricular vagus nerve stimulation (taVNS) is a neuromodulatory technique that stimulates the auricular branch of the vagus nerve. The modulation of the locus coeruleus-norepinephrine (LC-NE) network is one of the potential working mechanisms of this method. Our aims were 1-to investigate if short and single applications of taVNS can modulate the P300 cognitive event-related potential (ERP) as an indirect marker that reflects NE brain activation under control of the LC, and 2-to evaluate the duration of these changes.

Methods

20 healthy volunteers executed an auditory oddball paradigm to obtain P300 and reaction time (RT) values. Then a 7 min active or sham taVNS period was initiated and simultaneously a new P300 paradigm was performed. We successively repeated the paradigm on 4 occasions with different time intervals up to 56 min after the stimulation onset.

Results

During active taVNS an immediate and significant effect of increasing the amplitude and reducing the latency of P300, as well as a shortening in the RT was observed. This effect was prolonged in time up to 28 min. The values then returned to pre-stimulation levels. Sham stimulation did not generate changes.

Discussion

Our results, demonstrate differential facilitating effects in a concrete time window after taVNS. Literature about the modulatory effect of taVNS over P300 ERP shows a wide spread of results. There is not a standardized system for taVNS and currently the great heterogeneity of stimulation approaches concerning targets and parameters, make it difficult to obtain conclusions about this relationship. Our study was designed optimizing several stimulation settings, such as a customized earbud stimulator, enlarged stimulating surface, simultaneous stimulation over the cymba and cavum conchae, a Delayed Biphasic Pulse Burst and current controlled stimulation that adjusted the output voltage and guaranteed the administration of a preset electrical dose. Under our stimulation conditions, targeting vagal nerve fibers via taVNS modulates the P300 in healthy participants. The optimal settings of modulatory function of taVNS on P300, and their interdependency is insufficiently studied in the literature, but our data provides several easily optimizable parameters, that will produce more robust results in future.

Mismatch Negativity and Auditory Brain Stem Response in Children with Autism Spectrum Disorders and Language Disorders

Objective

Language disorders (LD) in autism spectrum disorders (ASD) are highly variable and has a severe impact on the level of functioning in autistic children. Early diagnosis of these language disorders is essential for early interventions for children at risk. The electrophysiological measurements are considered valuable tools for determining language disabilities in children with ASD. This study aimed to study and compare ABR and MMN in autistic children with language disorders.

Methods

This study included a group of typically developing children and a group of children diagnosed with autistic spectrum disorders and language disorders. Both groups were matching according to age and gender. After confirming bilateral normal peripheral hearing sensitivity, ABR was done and both absolute and interpeak wave latencies were correlated. MMN using frequency oddball paradigms were also obtained and correlated.

Results

More abnormalities were reported in ABR test results in the form of delayed absolute latencies and prolonged interpeak intervals. Also, we reported prolonged latencies of MMN. Consequently, both ABR and MMN are complementary test in evaluating autistic children with language disorders.

Conclusion

Our results support the hypothesis of remarkable dysfunction in basic auditory sound processing that may impact the linguistic development of autistic children.

Differentiated processing of emotional cues in adolescents and young adults with ICD-11 PTSD and complex PTSD after child abuse

BACKGROUND

The recent update of the International Classification of Diseases 11th revision (ICD-11) introduced the diagnosis of complex posttraumatic stress disorder (CPTSD) as a distinct entity from posttraumatic stress disorder (PTSD). Because psychophysiological alterations are a core diagnostic feature of PTSD and CPTSD, the aim of the current study was to examine potential distinctive patterns in cortical and cardiac responses to emotional words in adolescent and young adult patients with PTSD and CPTSD.

METHOD

Event-related potentials and heart rate responses were studied in 81 adolescent and young adult participants, of which 17 individuals were diagnosed with ICD-11 PTSD and 32 individuals with CPTSD, each after childhood sexual and/or physical abuse. Thirty-two individuals served as healthy controls. The paradigm consisted of a passive reading task with neutral, positive, physically threatening, and socially threatening words.

RESULTS

Differentiated early processing of emotional words was indicated by differences on P1 and left EPN components. Additionally, PTSD and CPTSD patients presented with specific patterns of heart rate responses to emotional words. In CPTSD patients, heart rate reactions to emotional words were more variable than in PTSD patients.

CONCLUSIONS

These findings provide early evidence of differentiated cortical and cardiac response patterns in adolescent and young adult patients with CPTSD and PTSD, supporting a nosological distinction between PTSD and complex PTSD. However, due to small and unequal sample sizes, findings presented in the current study are preliminary and require future research.

Study of event-related potentials by withdrawal friction on the fingertip

OBJECTIVES

The lack of understanding about the brain's reaction processes in perceiving touch and separation between skin and object surfaces is a barrier to the development of existing brain-computer interface technologies and virtual haptics. These technologies are limited in their ability to advance. It leaves prosthesis users with a limited amount of tactile information that they can feel. This study aims to determine whether distinct surface aspects of various items trigger different reactions from the brain when friction is removed from the surface.

METHODS

When friction is suddenly removed from the surface of an item, a technique called event-related potential, (ERP) is used to study the features of people's EEGs. It is done after the subject has actively explored the object's surface. A 64-channels EEG collecting system was utilized to acquire EEG data from the individuals. [Corrections added on 5 December 2022, after first online publication: The preceding sentence has been updated.] The event-related potentials for friction removal were generated using the Oddball paradigm, and the samples consisted of sandpaper with three distinct degrees of roughness. We utilized a total of 20 participants, 10 of whom were male, and 10 of whom were female, with a mean age of 21 years.

RESULTS

It was discovered that the P3 component of event-related potentials, which is essential for cognition, was noticeably absent in the friction withdrawal response for various roughnesses. It was the case regardless of whether the surface was smooth or rough. Moreover, there was no statistically significant difference between the P1 andP2 components, which suggests that the brain could not recognize the surface properties of objects with varying roughness as the friction withdrawal was being performed.

CONCLUSIONS

It has been demonstrated that tactile recognition does not occur after friction withdrawal. The findings of this paper could have significant repercussions for future research involving the study of haptic perception and brain-computer interaction in prosthetic hands. It is a step toward future research on the mechanisms underlying human tactile perception, so think of it as preparation.

Distraction by deviant sounds is modulated by the environmental context

Evidence shows that participants performing a continuous visual categorization task respond slower following the presentation of a task-irrelevant sound deviating from an otherwise repetitive or predictable auditory context (deviant sound among standard sounds). Here, for the first time, we explored the role of the environmental context (instrumentalized as a task-irrelevant background picture) in this effect. In two experiments, participants categorized left/right arrows while ignoring irrelevant sounds and background pictures of forest and city scenes. While equiprobable across the task, sounds A and B were presented with probabilities of .882 and .118 in the forest context, respectively, and with the reversed probabilities in the city context. Hence, neither sound constituted a deviant sound at task-level, but each did within a specific context. In Experiment 1, where each environmental context (forest and city scene) consisted of a single picture each, participants were significantly slower in the visual task following the presentation of the sound that was unexpected within the current context (context-dependent distraction). Further analysis showed that the cognitive system reset its sensory predictions even for the first trial of a change in environmental context. In Experiment 2, the two contexts (forest and city) were implemented using sets of 32 pictures each, with the background picture changing on every trial. Here too, context-dependent deviance distraction was observed. However, participants took a trial to fully reset their sensory predictions upon a change in context. We conclude that irrelevant sounds are incidentally processed in association with the environmental context (even though these stimuli belong to different sensory modalities) and that sensory predictions are context-dependent.

Repetitive Anodal TDCS to the Frontal Cortex Increases the P300 during Working Memory Processing

Transcranial direct current stimulation (TDCS) is a technique with which neuronal activity, and therefore potentially behavior, is modulated by applying weak electrical currents to the scalp. Application of TDCS to enhance working memory (WM) has shown promising but also contradictory results, and little emphasis has been placed on repeated stimulation protocols, in which effects are expected to be increased. We aimed to characterize potential behavioral and electrophysiological changes induced by TDCS during WM training and evaluate whether repetitive anodal TDCS has a greater modulatory impact on the processes underpinning WM than single-session stimulation. We examined the effects of single-session and repetitive anodal TDCS to the dorsolateral prefrontal cortex (DLPFC), targeting the frontal-parietal network, during a WM task in 20 healthy participants. TDCS had no significant impact on behavioral measures, including reaction time and accuracy. Analyzing the electrophysiological response, the P300 amplitude significantly increased following repetitive anodal TDCS, however, positively correlating with task performance. P300 changes were identified over the parietal cortex, which is known to engage with the frontal cortex during WM processing. These findings support the hypothesis that repetitive anodal TDCS modulates electrophysiological processes underlying WM.

Short-term plasticity of neuro-auditory processing induced by musical active listening training

Although there is strong evidence for the positive effects of musical training on auditory perception, processing, and training-induced neuroplasticity, there is still little knowledge on the auditory and neurophysiological short-term plasticity through listening training. In a sample of 37 adolescents (20 musicians and 17 nonmusicians) that was compared to a control group matched for age, gender, and musical experience, we conducted a 2-week active listening training (AULOS: Active IndividUalized Listening OptimizationS). Using magnetoencephalography and psychoacoustic tests, the short-term plasticity of auditory evoked fields and auditory skills were examined in a pre-post design, adapted to the individual neuro-auditory profiles. We found bilateral, but more pronounced plastic changes in the right auditory cortex. Moreover, we observed synchronization of the auditory evoked P1, N1, and P2 responses and threefold larger amplitudes of the late P2 response, similar to the reported effects of musical long-term training. Auditory skills and thresholds benefited largely from the AULOS training. Remarkably, after training, the mean thresholds improved by 12 dB for bone conduction and by 3-4 dB for air conduction. Thus, our findings indicate a strong positive influence of active listening training on neural auditory processing and perception in adolescence, when the auditory system is still developing.

The hearing hippocampus

The hippocampus has a well-established role in spatial and episodic memory but a broader function has been proposed including aspects of perception and relational processing. Neural bases of sound analysis have been described in the pathway to auditory cortex, but wider networks supporting auditory cognition are still being established. We review what is known about the role of the hippocampus in processing auditory information, and how the hippocampus itself is shaped by sound. In examining imaging, recording, and lesion studies in species from rodents to humans, we uncover a hierarchy of hippocampal responses to sound including during passive exposure, active listening, and the learning of associations between sounds and other stimuli. We describe how the hippocampus' connectivity and computational architecture allow it to track and manipulate auditory information - whether in the form of speech, music, or environmental, emotional, or phantom sounds. Functional and structural correlates of auditory experience are also identified. The extent of auditory-hippocampal interactions is consistent with the view that the hippocampus makes broad contributions to perception and cognition, beyond spatial and episodic memory. More deeply understanding these interactions may unlock applications including entraining hippocampal rhythms to support cognition, and intervening in links between hearing loss and dementia.

Do we parse the background into separate streams in the cocktail party?

In the cocktail party situation, people with normal hearing usually follow a single speaker among multiple concurrent ones. However, there is no agreement in the literature as to whether the background is segregated into multiple streams/speakers. The current study varied the number of concurrent speech streams and investigated target detection and memory for the contents of a target stream as well as the processing of distractors. A male-voiced target stream was either presented alone (single-speech), together with one male-voiced distractor (one-distractor), or a male- and a female-voiced distractor (two-distractor). Behavioral measures of target detection and content tracking performance as well as target- and distractor detection related event-related brain potentials (ERPs) were assessed. We found that the N2 amplitude decreased whereas the P3 amplitude increased from the single-speech to the concurrent speech streams conditions. Importantly, the behavioral effect of distractors differed between the conditions with one vs. two distractor speech streams and the non-zero voltages in the N2 time window for distractor numerals and in the P3 time window for syntactic violations appearing in the non-target speech stream significantly differed between the one- and two-distractor conditions for the same (male) speaker. These results support the notion that the two background speech streams are segregated, as they show that distractors and syntactic violations appearing in the non-target streams are processed even when two speech non-target speech streams are delivered together with the target stream.

Post-error adjustments depend causally on executive attention: Evidence from an intervention study

Detecting and correcting execution errors is crucial for safe and efficient goal-directed behavior. Despite intensive investigations on error processing, the cognitive foundations of this process remain unclear. Based on the presumed relation between executive attention (EA) and error processing, we implemented a seven-day EA intervention by adopting the Posner cueing paradigm to test the potential causal link from EA to error processing in healthy adults. The experimental group (high EA, HEA) was trained on the Posner cueing paradigm, with a ratio of invalid cue (IC) trials to valid cue (VC) trials of 5:1 and a corresponding ratio of 1:1 in the active control group (low EA, LEA). We found that the EA intervention improved EA across intervention sessions. Critically, after the EA intervention, the HEA group showed that post-error accuracy (PEA) was restored to the same level as the post-correct accuracy (in comparison with the LEA group). However, post-error slowing and the flanker effect were not modulated by the EA intervention. Furthermore, we observed that the changes in the accuracy of VC trials positively predicted the changes in PEA and that the two groups were classified according to the changes in PEA with a 61.3% accuracy. Based on these results, we propose that EA causally drives error processing. And the capabilities of the “actively catch” more attention resources and the automatic mismatch processing developed after EA intervention is transferable to error processing, thereby directly resulting in the gains in post-error adjustments. Our work informs the potential cognitive mechanisms underlying this causal link.

Intention-based predictive information modulates auditory deviance processing

The human brain is highly responsive to (deviant) sounds violating an auditory regularity. Respective brain responses are usually investigated in situations when the sounds were produced by the experimenter. Acknowledging that humans also actively produce sounds, the present event-related potential study tested for differences in the brain responses to deviants that were produced by the listeners by pressing one of two buttons. In one condition, deviants were unpredictable with respect to the button-sound association. In another condition, deviants were predictable with high validity yielding correctly predicted deviants and incorrectly predicted (mispredicted) deviants. Temporal principal component analysis revealed deviant-specific N1 enhancement, mismatch negativity (MMN) and P3a. N1 enhancements were highly similar for each deviant type, indicating that the underlying neural mechanism is not affected by intention-based expectation about the self-produced forthcoming sound. The MMN was abolished for predictable deviants, suggesting that the intention-based prediction for a deviant can overwrite the prediction derived from the auditory regularity (predicting a standard). The P3a was present for each deviant type but was largest for mispredicted deviants. It is argued that the processes underlying P3a not only evaluate the deviant with respect to the fact that it violates an auditory regularity but also with respect to the intended sensorial effect of an action. Overall, our results specify current theories of auditory predictive processing, as they reveal that intention-based predictions exert different effects on different deviance-specific brain responses.

Effects of sleep insufficiency on spatial working memory in low-pressure and hypoxic environments

BACKGROUND

This study aimed to investigate the effects of sleep insufficiency on spatial working memory in low-pressure and hypoxic environments.

METHODS

We selected 58 insufficient sleepers and 27 normal sleepers among the college students living in high-altitude areas for a long time to receive a spatial 2-back working memory task, while collecting behavioral and electroencephalograph data. We adopted an independent sample t-test and repeated measures analysis of variance to compare the differences in response time and accuracy, P2 and late positive potential components, and theta band energy values in the spatial working memory task between insufficient and normal sleepers.

RESULTS

We found no significant differences in response time and accuracy between the insufficient sleep group and the normal sleep group; however, the P2 peak value and the early theta band energy value were higher in the insufficient sleep group than in the normal sleep group.

CONCLUSIONS

These results suggest that the spatial working memory ability of individuals with sleep insufficiency was weakened under low-pressure and low-oxygen environment.

Event-related potentials and use of psychotropic medication in major psychiatric disorders

BACKGROUND

Attention deficits measured using event-related potentials (ERPs) have been frequently reported in several major psychiatric disorders, e.g. mood disorder (MD), psychotic disorder (PD) and substance use disorder (SUD). However, comparisons between these specific categories are lacking. Here we investigated if electrophysiological parameters of basic information processing are associated with the above-mentioned categories of psychiatric disorders, or instead were associated with general psychopathology.

METHODS

579 subjects with MD, PD or SUD and healthy controls (HC) were included. Participants were tested in a passive auditory and an active visual oddball paradigm to assess mismatch negativity (MMN), P3A and P3B amplitudes. Additionally, we examined associations between these measures and psychoactive medication treatments.

RESULTS

All patients had significantly lower P3B amplitudes compared to healthy controls, while only SUD patients had lower P3A amplitudes than MD, PD and HC. PD patients also produced significantly less MMN than both MD and SUD patients. Additionally, we found significantly higher P3B amplitude in HC compared to patients without psychopharmacological treatment and patients treated with two or more psychoactive compounds (polypharmacy), but no significant associations with medication on P3A and MMN amplitudes.

CONCLUSIONS

Our results add to the theory that P3B deficits are associated with general psychopathology, whereas P3A and MMN deficits appear to be associated with substance abuse and psychotic disorders respectively.

Mismatch negativity and P3a amplitude in children with familial high risk of schizophrenia or bipolar disorder - A Danish register-based EEG study

BACKGROUND

Infrequent deviants in a rapid sequence of sounds elicit a negative cortical potential over the frontocentral midline (mismatch negativity, MMN) followed by a positive deflection (P3a). Both cortical potentials are consistently attenuated in patients with schizophrenia (SZ), and, to a lesser degree, in patients with bipolar disorder (BP).

OBJECTIVE

Since it is unclear when MMN and P3a deficits arise relative to the emergence of symptoms, we examined whether MMN and P3a alterations are already detectable in children with familial high risk.

METHODS

Using 128-channel electroencephalography, we recorded auditory MMN and P3a evoked by a deviation in sound duration, frequency, or both in 51 children with familial high-risk for SZ (FHR-SZ), 41 children with familial high-risk for BP (FHR-BP), and 39 population-based children (PBC) at a mean age of 12.10.

RESULTS

MMN amplitude evoked by a duration deviant was larger in children with FHR-BP compared to PBC and FHR-SZ. P3a amplitude in response to a duration ∗ frequency deviant was larger in children with FHR-BP compared to children with FHR-SZ, but not compared to PBC. MMN- and P3a-peak latency did not differ between groups.

CONCLUSIONS

At an age of around 12 years, children with FHR-BP display enhanced neural sensitivity to change detection of duration deviants, while FHR-SZ showed a normal response pattern. Longitudinal recordings in high-risk children during adolescence are required to elucidate the temporal trajectories of MMN and P3a responses and how they relate to the emergence of first clinical symptoms in SZ and BP.

Auditory cortex modelled as a dynamical network of oscillators: understanding event-related fields and their adaptation

Adaptation, the reduction of neuronal responses by repetitive stimulation, is a ubiquitous feature of auditory cortex (AC). It is not clear what causes adaptation, but short-term synaptic depression (STSD) is a potential candidate for the underlying mechanism. In such a case, adaptation can be directly linked with the way AC produces context-sensitive responses such as mismatch negativity and stimulus-specific adaptation observed on the single-unit level. We examined this hypothesis via a computational model based on AC anatomy, which includes serially connected core, belt, and parabelt areas. The model replicates the event-related field (ERF) of the magnetoencephalogram as well as ERF adaptation. The model dynamics are described by excitatory and inhibitory state variables of cell populations, with the excitatory connections modulated by STSD. We analysed the system dynamics by linearising the firing rates and solving the STSD equation using time-scale separation. This allows for characterisation of AC dynamics as a superposition of damped harmonic oscillators, so-called normal modes. We show that repetition suppression of the N1m is due to a mixture of causes, with stimulus repetition modifying both the amplitudes and the frequencies of the normal modes. In this view, adaptation results from a complete reorganisation of AC dynamics rather than a reduction of activity in discrete sources. Further, both the network structure and the balance between excitation and inhibition contribute significantly to the rate with which AC recovers from adaptation. This lifetime of adaptation is longer in the belt and parabelt than in the core area, despite the time constants of STSD being spatially homogeneous. Finally, we critically evaluate the use of a single exponential function to describe recovery from adaptation.

Auditory perceptual discomfort and low-hearing tolerance in the first episode psychosis

Awareness of perceptual and sensory changes that might occur in visual, auditory, proprioception, and other senses, in the early stages towards the First Episode Psychosis (FEP), and their subsequent sensorial evolution as the disturb progresses deeper into an acute episode, might be a key element for interrupting the process. In the present study, we investigated hearing discomfort/tolerance to 16 given sound streams. Sixteen people diagnosed with FEP, participated in the experiment. Sixteen frequency sweeps varying in modulation envelopes (sawtooth, sine), order (ascending, descending), duration (4s, 8s), and range (50–8000 Hz, 2–8 kHz) were presented randomly, but always in the same sequence, to FEP and healthy controls (HC). The level of discomfort was estimated by the participant by making a mark across a continuous line whose extremes read “nothing bad” (left) and “too bad” (right). Results showed that ascending sine pure frequency sweeps (p < 0.01) and descending sine pure frequencies sweeps (p < 0.01) caused the maximum discomfort in FEP. Other variables also showed differences between FEP and HC, and FEP were always more intolerant to such pure frequency sweeps than HC. We conclude that this might be useful for very early assessment of people at risk, people with FEP, and people with schizophrenia.

Electrophysiological correlates of the effect of set size on object switching in working memory

Previous studies have revealed the effect of set size (the number of activated items) on object switching in working memory, but the underlying neural mechanism remains unclear. In this study, participants were asked to first remember two (small size) or three (large size) two-digit numbers and the corresponding geometrical figures as different references for numerical comparison and then compare a series of numbers (10-99) to the reference numbers cued by different geometrical figures. The cue repeated or switched across trials. Behavioral results revealed that the switch cost was greater in the large-size condition than in the small-size condition. Event-related potential results showed that in the N2 component, an interaction was observed between set size and transition, with a significant transition effect (switch minus repeat) in the large-size condition and a non-significant transition effect in the small-size condition. The same interaction was observed in the P3 component, with a larger amplitude difference (switch minus repeat) in the large-size condition than in the small-size condition. These results suggested that when set size is increased, the effort to inhibit the irrelevant items increases, resulting in large cost of object switching in working memory.

Action effect predictions in 'what', 'when', and 'whether' intentional actions

It has been proposed that intentional action can be separated into three major types depending on the nature of the action choice - what (selecting what to do), when (selecting when to act) and whether (to perform the action or not). While many theories on action control assume that intentional action involves the prediction of action effects, there has not been any attempt to compare the three types of intentional actions (what, when, whether) with respect to action-effect prediction. Here, we employ an action-effect prediction paradigm where participants select the action on every trial based on either the what (choosing between alternative actions), when (choosing to respond at different time points) or whether (choosing to perform an action or not) action components, and each action choice is followed by either a predicted (standard) or a mispredicted (deviant) tone. We found a significant P2 difference between standard/deviant tones reflecting the formation of action-effect predictions regardless of whether the action choice was based on the 'what', 'when' or 'whether' decision. Furthermore, our analysis revealed that this P2 difference for the prediction effect was not observable in non-action trials within the 'whether' condition, which suggests an action-specific prediction process.

Hyper-Sensitivity to Pitch and Poorer Prosody Processing in Adults With Autism: An ERP Study

Individuals with autism typically experience a range of symptoms, including abnormal sensory sensitivities. However, there are conflicting reports on the sensory profiles that characterize the sensory experience in autism that often depend on the type of stimulus. Here, we examine early auditory processing to simple changes in pitch and later auditory processing of more complex emotional utterances. We measured electroencephalography in 24 adults with autism and 28 controls. First, tones (1046.5Hz/C6, 1108.7Hz/C#6, or 1244.5Hz/D#6) were repeated three times or nine times before the pitch changed. Second, utterances of delight or frustration were repeated three or six times before the emotion changed. In response to the simple pitched tones, the autism group exhibited larger mismatch negativity (MMN) after nine standards compared to controls and produced greater trial-to-trial variability (TTV). In response to the prosodic utterances, the autism group showed smaller P3 responses when delight changed to frustration compared to controls. There was no significant correlation between ERPs to pitch and ERPs to prosody. Together, this suggests that early auditory processing is hyper-sensitive in autism whereas later processing of prosodic information is hypo-sensitive. The impact the different sensory profiles have on perceptual experience in autism may be key to identifying behavioral treatments to reduce symptoms.

Reevaluating the Language of Learning Advantage in Bilingual Arithmetic: An ERP Study on Spoken Multiplication Verification

Many studies of bilingual arithmetic report better performance when verifying arithmetic facts in the language of learning (LA+) over the other language (LA−). This could be due to language-specific memory representations, processes established during learning, or to language and task factors not related to math. The current study builds on a small number of event-related potential (ERP) studies to test this question while controlling language proficiency and eliminating potential task confounds. Adults proficient in two languages verified single-digit multiplications presented as spoken number words in LA+ and LA−, separately. ERPs and correctness judgments were measured from solution onset. Equivalent P300 effects, with larger positive amplitude for correct than incorrect solutions, were observed in both languages (Experiment 1A), even when stimuli presentation rate was shortened to increase difficulty (Experiment 1B). This effect paralleled the arithmetic correctness effect for trials presented as all digits (e.g., 2 4 8 versus 2 4 10), reflecting efficient categorization of the solutions, and was distinct from an N400 generated in a word–picture matching task, reflecting meaning processing (Experiment 2). The findings reveal that the language effects on arithmetic are likely driven by language and task factors rather than differences in memory representation in each language.

Reward magnitude enhances early attentional processing of auditory stimuli

Reward associations are known to shape the brain's processing of visual stimuli, but relatively less is known about how reward associations impact the processing of auditory stimuli. We leveraged the high-temporal resolution of electroencephalography (EEG) and event-related potentials (ERPs) to investigate the influence of low- and high-magnitude stimulus-reward associations in an auditory oddball task. We associated fast, correct detection of certain auditory target stimuli with larger monetary rewards, and other auditory targets with smaller rewards. We found enhanced attentional processing of the more highly rewarded target stimuli, as evidenced by faster behavioral detection of those stimuli compared with lower-rewarded stimuli. Neurally, higher-reward associations enhanced the early sensory processing of auditory targets. Targets associated with higher-magnitude rewards had higher amplitude N1 and mismatch negativity (MMN) ERP components than targets associated with lower-magnitude rewards. Reward did not impact the latency of these early components. Higher-reward magnitude also decreased the latency and increased the amplitude of the longer-latency P3 component, suggesting that reward also can enhance the final processing stages of auditory target stimuli. These results provide insight into how the sensory and attentional neural processing of auditory stimuli is modulated by stimulus-reward associations and the magnitude of those associations, with higher-magnitude reward associations yielding enhanced auditory processing at both early and late stages compared with lower-magnitude reward associations.

Belief in biological origin of race (racial essentialism) increases sensitivities to cultural category changes measured by ERP mismatch negativity (MMN)

The dynamic multicultural view explains culture-specific effects on cognition that cultural knowledge is organized in multiple knowledge systems which are specific to each culture and differentially activated when exposed to related objects or scenes. This view predicts automatic categorizations of environmental information according to the culture-specific knowledge systems. This study investigated whether cultural information could be spontaneously categorized, and the modulation of this process by the belief in the biological origin of race (i.e., racial essentialism) with an event-related brain potential, the visual Mismatch Negativity (vMMN). Deviant pictures of Eastern (Western) culture were randomly presented in a stream of standard Western (Eastern) pictures while participants were playing a video game. Participants who endorse racial essentialism (high group) showed vMMNs to the deviants with high relevance to the Eastern or Western culture and the deviant with low Eastern relevance; while participants with low racial essentialism showed vMMN to the deviant with high Eastern relevance only. These results revealed spontaneous cultural categorization with vMMN and the top-down modulation of spontaneous categorization by personal belief. In addition, this is the first demonstration of MMNs to cultural deviance and the potentials in applying MMNs to study psychological essentialism and social categorization.

Visual Mismatch Negativity Reflects Enhanced Response to the Deviant: Evidence From Event-Related Potentials and Electroencephalogram Time-Frequency Analysis

Automatic detection of information changes in the visual environment is crucial for individual survival. Researchers use the oddball paradigm to study the brain’s response to frequently presented (standard) stimuli and occasionally presented (deviant) stimuli. The component that can be observed in the difference wave is called visual mismatch negativity (vMMN), which is obtained by subtracting event-related potentials (ERPs) evoked by the deviant from ERPs evoked by the standard. There are three hypotheses to explain the vMMN. The sensory fatigue (or refractoriness) hypothesis considers that weakened neural activity caused by repetition results in decreased ERPs of the standard. The memory trace hypothesis proposes that vMMN results from increased responses to the deviant. The predictive coding hypothesis attributes the difference to enhanced responses for deviants and suppression for standards. However, when distinguishing between these effects, previous researchers did not consider the effect of low-level features on the vMMN. In this experiment, we used face sequences composed of different emotions (e.g., neutral and fearful face) and presented an oddball sequence, a reverse oddball sequence, and an equiprobable sequence to participants. The deviant of the oddball sequence was subtracted from the standard of the oddball sequence, the reverse oddball sequence, and the same type of stimulus of the equiprobable sequence to get oddball-vMMN (vMMN1), reverse oddball-vMMN (vMMN2), and equiprobable-vMMN (vMMN3), respectively. The results showed no significant difference between vMMN2 and vMMN3 in 100–350 ms following stimulus onset, while the vMMN effect was significant, indicating that the probability of the standard did not affect vMMN, which supported the memory trace hypothesis. Additionally, the fearful-related vMMN were more negative than the neutral-related vMMN within the range of 100–150 ms, suggesting a negative bias. We analyzed the source location of different vMMNs. There was no significant difference in brain regions between different vMMNs. Time-frequency analysis showed that the deviant had stronger theta-band oscillatory than the standard (visual mismatch oscillatory responses, vMORs). However, there was no difference between vMORs2 and vMORs3, indicating that vMORs reflect an enhanced response to the deviant in terms of neural oscillation, supporting the memory trace hypothesis.