Automatic auditory intelligence: An expression of the sensory–cognitive core of cognitive processes

Native language advantage in electrical brain responses to speech sound changes in passive and active listening condition

It is not clear whether the brain can detect changes in native and non-native speech sounds in both unattended and attended conditions, but this information would be important to understand the nature of potential native language advantage in speech perception. We recorded event-related potentials (ERPs) for changes in duration and in Chinese lexical tone in a repeated vowel /a/ in native speakers of Finnish and Chinese in passive and active listening conditions. ERP amplitudes reflecting deviance detection (mismatch negativity; MMN and N2b) and attentional shifts towards changes in speech sounds (P3a and P3b) were investigated. In the passive listening condition, duration changes elicited increased amplitude in the MMN latency window for both standard and deviant sounds in the Finnish speakers compared to the Chinese speakers, but no group differences were observed for P3a. In passive listening to lexical tones, P3a was increased in amplitude for both standard and deviant stimuli in Chinese speakers compared to Finnish speakers, but the groups did not differ in MMN. In active listening, both tone and duration changes elicited N2b and P3b, but the groups differed only in pattern of results for the deviant type. The results thus suggest an overall increased sensitivity to native speech sounds, especially in passive listening, while the mechanisms of change detection and attentional shifting seem to work well for both native and non-native speech sounds in the attentive mode.

Sensory intelligence for extraction of abstract auditory rules from a speech sound stream in children with cochlear implants

OBJECTIVE

Sensory intelligence in the brain helps listeners automatically extract abstract auditory rules formed by invariant acoustic features from complex speech sound streams, presumably serving as the neural basis for speech comprehension. However, whether this intelligence is deficient in children with cochlear implants (CIs) remains unclear.

METHODS

Mandarin Chinese monosyllables shared a flat lexical tone contour to form an abstract auditory rule but differed in other acoustic features to construct a complex speech sound stream. The abstract rule was occasionally violated by monosyllables with a rising or falling lexical tone.

RESULTS

In normal hearing (NH) children, the abstract auditory rule could be extracted, as revealed by a mismatch negativity (MMN) and a late discriminative negativity (LDN). However, the MMN and LDN were only evoked in CI children with good hearing and speech performance. NH children with a higher speech perception or spatial hearing score had a greater MMN. The LDN was attenuated with increasing age in NH children.

CONCLUSIONS

The sensory intelligence for extraction of auditory abstract rules, associated with speech perception, is deficient in CI children. This intelligence may gradually develop during childhood and adolescence.

SIGNIFICANCE

Deficient sensory intelligence in CI children may aid in understanding poor speech comprehension in complex environments.

Event Related Potentials to Native Speech Contrasts Predicts Word Reading Abilities in Early School-Aged Children

Speech perception skills have been implicated in the development of phoneme-grapheme correspondence, yet the exact nature of speech perception and word reading ability remains unknown. We investigate phonological sensitivity to native (English) and nonnative (Spanish) speech syllables within an auditory oddball paradigm using event related potentials (ERPs) collected from lateral temporal electrode sites in 33 monolingual English-speaking children aged 6-8 years (N=33). We further explore the relationship between ERPs to English word reading abilities for this group. Results revealed that language stimuli (English, Spanish), ERP condition (standard, deviant), and hemisphere (left, right) all influenced the lateral N1 component. ERPs recorded from deviant English stimuli were significantly more negative within the left hemisphere compared to all other recorded ERPs. Mean amplitude differences within the N1 in left lateral electrode sites recorded in response to English phoneme contrasts significantly predicted English word reading abilities within this sample. Results indicate that speech perception of native contrasts recorded in left temporal electrode sites for the N1 component are linked to English word reading abilities in early school-aged children.

Perceptual oddities: assessing the relationship between film editing and prediction processes

During film viewing, humans parse sequences of individual shots into larger narrative structures, often weaving transitions at edit points into an apparently seamless and continuous flow. Editing helps filmmakers manipulate visual transitions to induce feelings of fluency/disfluency, tension/relief, curiosity, expectation and several emotional responses. We propose that the perceptual dynamics induced by film editing can be captured by a predictive processing (PP) framework. We hypothesise that visual discontinuities at edit points produce discrepancies between anticipated and actual sensory input, leading to prediction error. Further, we propose that the magnitude of prediction error depends on the predictability of each shot within the narrative flow, and lay out an account based on conflict monitoring. We test this hypothesis in two empirical studies measuring electroencephalography (EEG) during passive viewing of film excerpts, as well as behavioural responses during an active edit detection task. We report the neural and behavioural modulations at editing boundaries across three levels of narrative depth, showing greater modulations for edits spanning less predictable, deeper narrative transitions. Overall, our contribution lays the groundwork for understanding film editing from a PP perspective. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectivess'.

Neural field theory of adaptive effects on auditory evoked responses and mismatch negativity in multifrequency stimulus sequences

Physiologically based neural field theory (NFT) of the corticothalamic system, including adaptation, is used to calculate the responses evoked by trains of auditory stimuli that differ in frequency. In oddball paradigms, fully distinguishable frequencies lead to different standard (common stimulus) and deviant (rare stimulus) responses; the signal obtained by subtracting the standard response from the deviant is termed the mismatch negativity (MMN). In this analysis, deviant responses are found to correspond to unadapted cortex, whereas the part of auditory cortex that processes the standard stimuli adapts over several stimulus presentations until the final standard response form is achieved. No higher-order memory processes are invoked. In multifrequency experiments, the deviant response approaches the standard one as the deviant frequency approaches that of the standard and analytic criteria for this effect to be obtained. It is shown that these criteria can also be used to understand adaptation in random tone sequences. A method of probing MMNs and adaptation in random tone sequences is suggested to makes more use of such data.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Distinguishing Fine Structure and Summary Representation of Sound Textures from Neural Activity

The auditory system relies on both local and summary representations; acoustic local features exceeding system constraints are compacted into a set of summary statistics. Such compression is pivotal for sound-object recognition. Here, we assessed whether computations subtending local and statistical representations of sounds could be distinguished at the neural level. A computational auditory model was employed to extract auditory statistics from natural sound textures (i.e., fire, rain) and to generate synthetic exemplars where local and statistical properties were controlled. Twenty-four human participants were passively exposed to auditory streams while the electroencephalography (EEG) was recorded. Each stream could consist of short, medium, or long sounds to vary the amount of acoustic information. Short and long sounds were expected to engage local or summary statistics representations, respectively. Data revealed a clear dissociation. Compared with summary-based ones, auditory-evoked responses based on local information were selectively greater in magnitude in short sounds. Opposite patterns emerged for longer sounds. Neural oscillations revealed that local features and summary statistics rely on neural activity occurring at different temporal scales, faster (beta) or slower (theta-alpha). These dissociations emerged automatically without explicit engagement in a discrimination task. Overall, this study demonstrates that the auditory system developed distinct coding mechanisms to discriminate changes in the acoustic environment based on fine structure and summary representations.

Mismatch negativity-stimulation paradigms in past and in future

Mismatch negativity (MMN) studies were initiated as part of a well-controlled experimental research tradition with the aim to identify some key principles of auditory processing and memory. During the past two decades, empirical paradigms have moved toward more ecologically valid ones while retaining rigid experimental control. In this paper, I will introduce this development of MMN stimulation paradigms starting from the paradigms used in basic science and then moving to paradigms that have been particularly relevant for studies on music learning and musical expertise. Via these historical and thematic perspectives, I wish to stimulate paradigm development further to meet the demands of naturalistic ecologically valid studies also when using MMN in the context of event-related potential technique that necessarily requires averaging across several stimulus presentations.

Auditory event-related potentials in separating patients with depressive disorders and non-depressed controls: A narrative review

This narrative review brings together the findings regarding the differences in the auditory event-related potentials (ERPs) between patients with depressive disorder and non-depressed control subjects. These studies' results can inform us of the possible alterations in sensory-cognitive processing in depressive disorders and the potential of using these ERPs in clinical applications. Auditory P3, mismatch negativity (MMN) and loudness dependence of auditory evoked potentials (LDAEP) were the subjects of the investigation. A search in PubMed yielded 84 studies. The findings of the reviewed studies were not highly consistent, but some patterns could be identified. For auditory P3b, the common findings were attenuated amplitude and prolonged latency among depressed patients. Regarding auditory MMN, especially the amplitude of duration deviance MMN was commonly attenuated, and the amplitude of frequency deviance MMN was increased in depressed patients. In LDAEP studies, generally, no differences between depressed patients and non-depressed controls were reported, although some group differences concerning specific depression subtypes were found. This review posits that future research should investigate whether certain stimulus conditions are particularly efficient at separating depressed and non-depressed participant groups. Future studies should contrast responses in different subpopulations of depressed patients, as well as different clinical groups (e.g., depressive disorder and anxiety disorder patients), to investigate the specificity of the auditory ERP alterations for depressive disorders.

Benefits of choir singing on complex auditory encoding in the aging brain: An ERP study

Aging is accompanied by difficulties in auditory information processing, especially in more complex sound environments. Choir singing requires efficient processing of multiple sound features and could, therefore, mitigate the detrimental effects of aging on complex auditory encoding. We recorded auditory event-related potentials during passive listening of sounds in healthy older adult (≥ 60 years) choir singers and nonsinger controls. We conducted a complex oddball condition involving encoding of abstract regularities in combinations of pitch and location features, as well as in two simple oddball conditions, in which only either the pitch or spatial location of the sounds was varied. We analyzed change-related mismatch negativity (MMN) and obligatory P1 and N1 responses in each condition. In the complex condition, the choir singers showed a larger MMN than the controls, which also correlated with better performance in a verbal fluency test. In the simple pitch and location conditions, the choir singers had smaller N1 responses compared to the control subjects, whereas the MMN responses did not differ between groups. These results suggest that regular choir singing is associated both with more enhanced encoding of complex auditory regularities and more effective adaptation to simple sound features.

More efficient formation of longer-term representations for word forms at birth can be linked to better language skills at 2 years

Infants are able to extract words from speech early in life. Here we show that the quality of forming longer-term representations for word forms at birth predicts expressive language ability at the age of two years. Seventy-five neonates were familiarized with two spoken disyllabic pseudowords. We then tested whether the neonate brain predicts the second syllable from the first one by presenting a familiarized pseudoword frequently, and occasionally violating the learned syllable combination by different rare pseudowords. Distinct brain responses were elicited by predicted and unpredicted word endings, suggesting that the neonates had learned the familiarized pseudowords. The difference between responses to predicted and unpredicted pseudowords indexing the quality of word-form learning during familiarization significantly correlated with expressive language scores (the mean length of utterance) at 24 months in the same infant. These findings suggest that 1) neonates can memorize disyllabic words so that a learned first syllable generates predictions for the word ending, and 2) early individual differences in the quality of word-form learning correlate with language skills. This relationship helps early identification of infants at risk for language impairment.

The sound of silence: Predictive error responses to unexpected sound omission in adults

The human auditory system excels at detecting patterns needed for processing speech and music. According to predictive coding, the brain predicts incoming sounds, compares predictions to sensory input, and generates a prediction error whenever a mismatch between the prediction and sensory input occurs. Predictive coding can be indexed in EEG with the mismatch negativity (MMN) and P3a components, two ERP components that are elicited by infrequent deviant sounds (e.g., differing in pitch, duration, loudness) in a stream of frequent sounds. If these components reflect prediction error, they should also be elicited by omitting an expected sound, but few studies have examined this. We compared ERPs elicited by infrequent randomly occurring omissions (unexpected silences) in tone sequences presented at 2 tones/sec to ERPs elicited by frequent, regularly occurring omissions (expected silences) within a sequence of tones and resting state EEG (a constant silence). We found that unexpected silences elicited significant MMN and P3a, although the magnitude of these components was quite small and variable. These results provide evidence for hierarchical predictive coding, indicating that the brain predicts silences as well as sounds.

Caught in the ACTS: Defining Abstract Cognitive Task Sequences as an Independent Process

Cognitive neuroscience currently conflates the study of serial responses (e.g., delay match to sample/nonsample, n-back) with the study of sequential operations. In this essay, our goal is to define and disentangle the latter, termed abstract cognitive task sequences (ACTS). Existing literatures address tasks requiring serial events, including procedural learning of implicit motor responses, statistical learning of predictive relationships, and judgments of attributes. These findings do not describe the behavior and underlying mechanism required to succeed at remembering to evaluate color, then shape; or to multiply, then add. A new literature is needed to characterize these sorts of second-order cognitive demands of studying a sequence of operations. Our second goal is to characterize gaps in knowledge related to ACTS that merit further investigation. In the following sections, we define more precisely what we mean by ACTS and suggest research questions' further investigation would be positioned to address.

High Intellectual Potential and High Functioning Autism: Clinical and Neurophysiological Features in a Pediatric Sample

High Intellectual Potential (HIP) and High Functioning Autism (HFA) are two different conditions sharing some clinical and neurobiological features. The aim of the present study was to characterize a sample of HIP children (n: 16; M/F: 14/2; median age: 10 years) in comparison to those with HFA (n: 17; M/F: 16/1; median age: 13 years) and to neurotypically developed (NTD) children (n: 10; M/F: 4/6; median age: 11 years) from a clinical and neurophysiological perspective. Specifically, a standardized clinical assessment of cognitive and adaptive skills, autistic symptoms, executive functions and behavioral features was performed. Moreover, event-related potentials (ERPs) were recorded, referring specifically to the mismatch negativity (MMN) and P300 paradigm. Our data highlighted the presence of similarities between the intellectually gifted individuals and the ones with autism (i.e., a nonhomogeneous intellective profile, an adaptive skills impairment, subthreshold autistic symptoms and increased perfectionism). Interestingly, a distinct neurophysiological characterization between groups came out, with evidence of a reduced MMN amplitude only in the HFA group. Furthermore, no differences within groups in the P300 component emerged. Therefore, our results start to provide a more informative characterization of the HIP phenotype in comparison to those of HFA and NTD, highlighting the potential role of the MMN amplitude index in helping clinicians and researchers to distinguish between HIP and HFA. Nevertheless, further research on the topic is strongly needed.

Repeated Parental Singing During Kangaroo Care Improved Neural Processing of Speech Sound Changes in Preterm Infants at Term Age

Preterm birth carries a risk for adverse neurodevelopment. Cognitive dysfunctions, such as language disorders may manifest as atypical sound discrimination already in early infancy. As infant-directed singing has been shown to enhance language acquisition in infants, we examined whether parental singing during skin-to-skin care (kangaroo care) improves speech sound discrimination in preterm infants. Forty-five preterm infants born between 26 and 33 gestational weeks (GW) and their parents participated in this cluster-randomized controlled trial (ClinicalTrials ID IRB00003181SK). In both groups, parents conducted kangaroo care during 33-40 GW. In the singing intervention group (n = 24), a certified music therapist guided parents to sing or hum during daily kangaroo care. In the control group (n = 21), parents conducted standard kangaroo care and were not instructed to use their voices. Parents in both groups reported the duration of daily intervention. Auditory event-related potentials were recorded with electroencephalogram at term age using a multi-feature paradigm consisting of phonetic and emotional speech sound changes and a one-deviant oddball paradigm with pure tones. In the multi-feature paradigm, prominent mismatch responses (MMR) were elicited to the emotional sounds and many of the phonetic deviants in the singing intervention group and in the control group to some of the emotional and phonetic deviants. A group difference was found as the MMRs were larger in the singing intervention group, mainly due to larger MMRs being elicited to the emotional sounds, especially in females. The overall duration of the singing intervention (range 15-63 days) was positively associated with the MMR amplitudes for both phonetic and emotional stimuli in both sexes, unlike the daily singing time (range 8-120 min/day). In the oddball paradigm, MMRs for the non-speech sounds were elicited in both groups and no group differences nor connections between the singing time and the response amplitudes were found. These results imply that repeated parental singing during kangaroo care improved auditory discrimination of phonetic and emotional speech sounds in preterm infants at term age. Regular singing routines can be recommended for parents to promote the development of the auditory system and auditory processing of speech sounds in preterm infants.

Differential effects of gender on mismatch negativity to violations of simple and pattern acoustic regularities

INTRODUCTION

The effects of gender on the mismatch negativity (MMN) potential have been studied using simple frequency deviants. However, the effects of gender on MMN to violations of abstract regularities have not yet been studied. Here, we addressed this issue and compared the effects of gender on simple and pattern frequency MMNs.

METHODS

MMN response was recorded from 29 healthy young adults, 14 females (mean age = 26.20 ± 2.17) and 15 males (mean age = 27.57 ± 2.24), using 32 scalp electrodes during simple and pattern frequency oddball paradigms and the mean amplitude, peak latency, and scalp topography of MMN evoked by each paradigm were compared between the two genders.

RESULTS

The peak latency of simple MMN was significantly longer in females (p < .05); however, its mean amplitude and topography were similar between the two genders (p > .05). There were no significant differences in peak latency, mean amplitude, and scalp topography of pattern MMN between the two genders (p > .05).

CONCLUSIONS

Based on the obtained results, gender differently affects simple and pattern MMN. These findings may provide preliminary evidence for distinct effects of gender on various types of MMN.

Musical rhythm effects on visual attention are non-rhythmical: evidence against metrical entrainment

The idea that external rhythms synchronize attention cross-modally has attracted much interest and scientific inquiry. Yet, whether associated attentional modulations are indeed rhythmical in that they spring from and map onto an underlying meter has not been clearly established. Here we tested this idea while addressing the shortcomings of previous work associated with confounding (i) metricality and regularity, (ii) rhythmic and temporal expectations or (iii) global and local temporal effects. We designed sound sequences that varied orthogonally (high/low) in metricality and regularity and presented them as task-irrelevant auditory background in four separate blocks. The participants' task was to detect rare visual targets occurring at a silent metrically aligned or misaligned temporal position. We found that target timing was irrelevant for reaction times and visual event-related potentials. High background regularity and to a lesser extent metricality facilitated target processing across metrically aligned and misaligned positions. Additionally, high regularity modulated auditory background frequencies in the EEG recorded over occipital cortex. We conclude that external rhythms, rather than synchronizing attention cross-modally, confer general, nontemporal benefits. Their predictability conserves processing resources that then benefit stimulus representations in other modalities.

Subjectively different emotional schematic faces not automatically discriminated from the brain's bioelectrical responses

The present study investigates how the brain automatically discriminates emotional schematic faces, as indicated by the mismatch responses, and how reliable these brain responses are. Thirty-three healthy volunteers participated in the vMMN EEG experiment with four experimental sets differing from each other by the type of standard (object with scrambled face features) and the type of deviants (Angry, Happy and Neutral schematic faces) presented. Conscious subjective evaluations of valence, arousal and attention catching of the same stimuli showed clear differentiation of emotional expressions. Deviant faces elicited rather similar vMMN at frontal and occipital sites. Bayesian analyses suggest that vMMN does not differ between angry and happy faces. Neutral faces, however, did not yield statistically significant vMMN at occipital leads. Pearson's correlation and intra-class correlation analyses showed that the brain's reactions to the stimuli were highly stable within individuals across the experimental sets, whereas the mismatch responses were much more variable.

Magnetoencephalography Responses to Unpredictable and Predictable Rare Somatosensory Stimuli in Healthy Adult Humans

Mismatch brain responses to unpredicted rare stimuli are suggested to be a neural indicator of prediction error, but this has rarely been studied in the somatosensory modality. Here, we investigated how the brain responds to unpredictable and predictable rare events. Magnetoencephalography responses were measured in adults frequently presented with somatosensory stimuli (FRE) that were occasionally replaced by two consecutively presented rare stimuli [unpredictable rare stimulus (UR) and predictable rare stimulus (PR); p = 0.1 for each]. The FRE and PR were electrical stimulations administered to either the little finger or the forefinger in a counterbalanced manner between the two conditions. The UR was a simultaneous electrical stimulation to both the forefinger and the little finger (for a smaller subgroup, the UR and FRE were counterbalanced for the stimulus properties). The grand-averaged responses were characterized by two main components: one at 30-100 ms (M55) and the other at 130-230 ms (M150) latency. Source-level analysis was conducted for the primary somatosensory cortex (SI) and the secondary somatosensory cortex (SII). The M55 responses were larger for the UR and PR than for the FRE in both the SI and the SII areas and were larger for the UR than for the PR. For M150, both investigated areas showed increased activity for the UR and the PR compared to the FRE. Interestingly, although the UR was larger in stimulus energy (stimulation of two fingers at the same time) and had a larger prediction error potential than the PR, the M150 responses to these two rare stimuli did not differ in source strength in either the SI or the SII area. The results suggest that M55, but not M150, can possibly be associated with prediction error signals. These findings highlight the need for disentangling prediction error and rareness-related effects in future studies investigating prediction error signals.

Neural Field Theory of Evoked Response Potentials With Attentional Gain Dynamics

A generalized neural field model of large-scale activity in the corticothalamic system is used to predict standard evoked potentials. This model embodies local feedbacks that modulate the gains of neural activity as part of the response to incoming stimuli and thus enables both activity changes and effective connectivity changes to be calculated as parts of a generalized evoked response, and their relative contributions to be determined. The results show that incorporation of gain modulations enables a compact and physically justifiable description of the differences in gain between background-EEG and standard-ERP conditions, with the latter able to be initiated from the background state, rather than requiring distinct parameters as in earlier work. In particular, top-down gains are found to be reduced during an ERP, consistent with recent theoretical suggestions that the role of internal models is diminished in favor of external inputs when the latter change suddenly. The static-gain and modulated-gain system transfer functions are analyzed via control theory in terms of system resonances that were recently shown to implement data filtering whose gain adjustments can be interpreted as attention. These filters are shown to govern early and late features in standard evoked responses and their gain parameters are shown to be dynamically adjusted in a way that implements a form of attention. The results show that dynamically modulated resonant filters responsible for the low-frequency oscillations in an evoked potential response have different parameters than those responsible for low-frequency resting EEG responses, while both responses share similar mid- and high-frequency resonant filters. These results provide a biophysical mechanism by which oscillatory activity in the theta, alpha, and beta frequency ranges of an evoked response are modulated as reflections of attention; notably theta is enhanced and alpha suppressed during the latter parts of the ERP. Furthermore, the model enables the part of the ERP response induced by gain modulations to be estimated and interpreted in terms of attention.

Irrelevant Predictions: Distractor Rhythmicity Modulates Neural Encoding in Auditory Cortex

Dynamic attending theory suggests that predicting the timing of upcoming sounds can assist in focusing attention toward them. However, whether similar predictive processes are also applied to background noises and assist in guiding attention “away” from potential distractors, remains an open question. Here we address this question by manipulating the temporal predictability of distractor sounds in a dichotic listening selective attention task. We tested the influence of distractors’ temporal predictability on performance and on the neural encoding of sounds, by comparing the effects of Rhythmic versus Nonrhythmic distractors. Using magnetoencephalography we found that, indeed, the neural responses to both attended and distractor sounds were affected by distractors’ rhythmicity. Baseline activity preceding the onset of Rhythmic distractor sounds was enhanced relative to nonrhythmic distractor sounds, and sensory response to them was suppressed. Moreover, detection of nonmasked targets improved when distractors were Rhythmic, an effect accompanied by stronger lateralization of the neural responses to attended sounds to contralateral auditory cortex. These combined behavioral and neural results suggest that not only are temporal predictions formed for task-irrelevant sounds, but that these predictions bear functional significance for promoting selective attention and reducing distractibility.

Long-latency auditory evoked potential in children with stuttering

Objective

To analyze the latency and the amplitude values of Mismatch Negativity and P300 cognitive potential in children with stuttering, with no auditory complaints, with auditory thresholds within the normality range, comparing them to the findings of a Control Group.

Methods

A cross-sectional study involving 50 children of both sexes, 15 with stuttering and 35 without stuttering, aged 6 to 11 years, with no diagnosis of ear pathology or other diseases. All children were submitted to peripheral audiological evaluation (meatoscopy, pure tone testing, speech audiometry, and acoustic immittance measures) and a central audiological evaluation (investigation of the Mismatch Negativity and P300 cognitive potential). For the evaluation of fluency, all children with stuttering had a specific history taken and were video recorded in a spontaneous speech. Afterwards, the transcription was done, followed by speech analysis to classify children according the severity of stuttering.

Results

There was a significant difference in the latencies of Mismatch Negativity and P300 cognitive potential, as well as in the amplitude of Mismatch Negativity.

Conclusion

There was a significant delay in the latencies of Mismatch Negativity and P300 cognitive potential, as well as increase in the amplitude of the Mismatch Negativity in children with stuttering when compared to children in the Control Group. Changes in the morphology of the waves were found in the Stuttering Group.

Pearls and pitfalls in brain functional analysis by event-related potentials: a narrative review by the Italian Psychophysiology and Cognitive Neuroscience Society on methodological limits and clinical reliability-part I

Event-related potentials (ERPs) are obtained from the electroencephalogram (EEG) or the magnetoencephalogram (MEG, event-related fields (ERF)), extracting the activity that is time-locked to an event. Despite the potential utility of ERP/ERF in cognitive domain, the clinical standardization of their use is presently undefined for most of procedures. The aim of the present review is to establish limits and reliability of ERP medical application, summarize main methodological issues, and present evidence of clinical application and future improvement. The present section of the review focuses on well-standardized ERP methods, including P300, Contingent Negative Variation (CNV), Mismatch Negativity (MMN), and N400, with a chapter dedicated to laser-evoked potentials (LEPs). One section is dedicated to proactive preparatory brain activity as the Bereitschaftspotential and the prefrontal negativity (BP and pN). The P300 and the MMN potentials have a limited but recognized role in the diagnosis of cognitive impairment and consciousness disorders. LEPs have a well-documented usefulness in the diagnosis of neuropathic pain, with low application in clinical assessment of psychophysiological basis of pain. The other ERP components mentioned here, though largely applied in normal and pathological cases and well standardized, are still confined to the research field. CNV, BP, and pN deserve to be largely tested in movement disorders, just to explain possible functional changes in motor preparation circuits subtending different clinical pictures and responses to treatments.

Mismatch Negativity Elicited by Verbal and Nonverbal Stimuli: Comparison with Potential N1

Introduction  Mismatch negativity (MMN) is a long latency auditory evoked potential, represented by a negative wave, generated after the potential N1 and visualized in a resulting wave. Objective  To identify the time of occurrence of MMN after N1, elicited with verbal and nonverbal stimuli. Methods  Ninety individuals aged between 18 and 56 years old participated in the study, 39 of whom were male and 51 female, with normal auditory thresholds, at least 8 years of schooling, and who did not present auditory processing complaints. All of them underwent audiologic anamnesis, visual inspection of external auditory meatus, pure tone audiometry, speech audiometry, acoustic immittance measures and the dichotic sentence identification test as a screening for alterations in auditory processing, a requirement to participate in the sample. The MMN was applied with two different stimuli, with these being da/ta (verbal) and 750 Hz and 1,000 Hz (nonverbal). Results  There was a statistically significant difference between the latency values of the N1 potential and the MMN with the two stimuli, as well as between the MMN with verbal and nonverbal stimuli, and the latency of the MMN elicited with da/ta being greater than that elicited with 750 Hz and 1,000 Hz, which facilitated its visualization. Conclusion  The time of occurrence of MMN after the N1 elicited with verbal stimuli was 100.4 ms and with nonverbal stimuli 85.5 ms. Thus, the marking of the MMN with verbal stimuli proved to be more distant from N1 compared with the nonverbal stimuli.

Cortical Microcircuit Mechanisms of Mismatch Negativity and Its Underlying Subcomponents

In the neocortex, neuronal processing of sensory events is significantly influenced by context. For instance, responses in sensory cortices are suppressed to repetitive or redundant stimuli, a phenomenon termed “stimulus-specific adaptation” (SSA). However, in a context in which that same stimulus is novel, or deviates from expectations, neuronal responses are augmented. This augmentation is termed “deviance detection” (DD). This contextual modulation of neural responses is fundamental for how the brain efficiently processes the sensory world to guide immediate and future behaviors. Notably, context modulation is deficient in some neuropsychiatric disorders such as schizophrenia (SZ), as quantified by reduced “mismatch negativity” (MMN), an electroencephalography waveform reflecting a combination of SSA and DD in sensory cortex. Although the role of NMDA-receptor function and other neuromodulatory systems on MMN is established, the precise microcircuit mechanisms of MMN and its underlying components, SSA and DD, remain unknown. When coupled with animal models, the development of powerful precision neurotechnologies over the past decade carries significant promise for making new progress into understanding the neurobiology of MMN with previously unreachable spatial resolution. Currently, rodent models represent the best tool for mechanistic study due to the vast genetic tools available. While quantifying human-like MMN waveforms in rodents is not straightforward, the “oddball” paradigms used to study it in humans and its underlying subcomponents (SSA/DD) are highly translatable across species. Here we summarize efforts published so far, with a focus on cortically measured SSA and DD in animals to maintain relevance to the classically measured MMN, which has cortical origins. While mechanistic studies that measure and contrast both components are sparse, we synthesize a potential set of microcircuit mechanisms from the existing rodent, primate, and human literature. While MMN and its subcomponents likely reflect several mechanisms across multiple brain regions, understanding fundamental microcircuit mechanisms is an important step to understand MMN as a whole. We hypothesize that SSA reflects adaptations occurring at synapses along the sensory-thalamocortical pathways, while DD depends on both SSA inherited from afferent inputs and resulting disinhibition of non-adapted neurons arising from the distinct physiology and wiring properties of local interneuronal subpopulations and NMDA-receptor function.

Auditory Mismatch Negativity in Youth Affected by Autism Spectrum Disorder With and Without Attenuated Psychosis Syndrome

The present study investigates the differences in auditory mismatch negativity (MMN) parameters given in a sample of young subjects with autism spectrum disorder (ASD, n = 37) with or without co-occurrent attenuated psychosis syndrome (APS). Our results show that ASD individuals present an MMN decreased amplitude and prolonged latency, without being influenced by concurrent APS. Additionally, when correlating the MMN indexes to clinical features, in the ASD + APS group, we found a negative correlation between the severity of autistic symptoms and the MMN latency in both frequency (f-MMN r = -0.810; p < 0.0001) and duration (d-MMN r = -0.650; p = 0.006) deviants. Thus, our results may provide a more informative characterization of the ASD sub-phenotype when associated with APS, highlighting the need for further longitudinal investigations.

Event-related potentials to task-irrelevant sad faces as a state marker of depression

Negative bias in face processing has been demonstrated in depression, but there are no longitudinal investigations of negative bias in symptom reduction. We recorded event-related potentials (P1 and N170) to task-irrelevant facial expressions in depressed participants who were later provided with a psychological intervention and in never depressed control participants. Follow-up measurements were conducted for the depressed group two and 39 months later. Negative bias was found specifically in the depression group, and was demonstrated as enlarged P1 amplitude to sad faces, which normalized in the follow-up measurements when the participants had fewer symptoms. Because the P1 amplitude recorded at the baseline did not differ between the depression group that recovered and the group that did not recover after the intervention, this brain response did not show potential as a biomarker for treatment response. It could have potential, however, to serve as a state-marker of depression.

Deviance detection in sound frequency in simple and complex sounds in urethane-anesthetized rats

Mismatch negativity (MMN), which is an electrophysiological response demonstrated in humans and animals, reflects memory-based deviance detection in a series of sounds. However, only a few studies on rodents have used control conditions that were sufficient in eliminating confounding factors that could also explain differential responses to deviant sounds. Furthermore, it is unclear if change detection occurs similarly for sinusoidal and complex sounds. In this study, we investigated frequency change detection in urethane-anesthetized rats by recording local-field potentials from the dura above the auditory cortex. We studied change detection in sinusoidal and complex sounds in a series of experiments, controlling for sound frequency, probability, and pattern in a series of sounds. For sinusoidal sounds, the MMN controlled for frequency, adaptation, and pattern, was elicited at approximately 200 ms onset latency. For complex sounds, the MMN controlled for frequency and adaptation, was elicited at 60 ms onset latency. Sound frequency affected the differential responses. MMN amplitude was larger for the sinusoidal sounds than for the complex sounds. These findings indicate the importance of controlling for sound frequency and stimulus probabilities, which have not been fully controlled for in most previous animal and human studies. Future studies should confirm the preference for sinusoidal sounds over complex sounds in rats.

From alternation to repetition: Spatial attention biases contribute to sequential effects in a choice reaction-time task

Observers often take longer to respond to a visual target when it appears at a recently stimulated location than when it appears at a new location in the visual field. This behavioral impairment - known as inhibition of return (IOR) - is mirrored by a reduction of an event-related potential (ERP) component called the N2pc that has been associated with attentional selection. Together, these findings indicate that the mechanism underlying IOR operates to bias covert attention against re-visiting the most recently attended location. The goal of the present study was to determine how this inhibitory attention bias evolves across successive trials of a two-item search task. Initially, targets appearing at previously attended locations were associated with behavioral IOR and a concomitant reduction of the N2pc. After several successive trials, this initial inhibitory bias was superseded by expectancy-based biases associated with "predictable" inter-trial patterns of location repeats or location changes, in some cases leading to faster responses and a larger N2pc when the target location repeated (facilitation of return).  These results provide evidence that biases in the covert deployment of attention are updated dynamically according to the recent selection history and contribute to well-known sequential effects in serial choice reaction-time tasks.

Out of Focus: Facial Feedback Manipulation Modulates Automatic Processing of Unattended Emotional Faces

Facial expressions provide information about an individual's intentions and emotions and are thus an important medium for nonverbal communication. Theories of embodied cognition assume that facial mimicry and resulting facial feedback plays an important role in the perception of facial emotional expressions. Although behavioral and electrophysiological studies have confirmed the influence of facial feedback on the perception of facial emotional expressions, the influence of facial feedback on the automatic processing of such stimuli is largely unexplored. The automatic processing of unattended facial expressions can be investigated by visual expression-related MMN. The expression-related MMN reflects a differential ERP of automatic detection of emotional changes elicited by rarely presented facial expressions (deviants) among frequently presented facial expressions (standards). In this study, we investigated the impact of facial feedback on the automatic processing of facial expressions. For this purpose, participants (n = 19) performed a centrally presented visual detection task while neutral (standard), happy, and sad faces (deviants) were presented peripherally. During the task, facial feedback was manipulated by different pen holding conditions (holding the pen with teeth, lips, or nondominant hand). Our results indicate that automatic processing of facial expressions is influenced and thus dependent on the own facial feedback.

Mismatch Negativity in Children: Reference Values

Introduction  The Mismatch Negativity (MMN) auditory evoked potential evaluation is a promising procedure to assess objectively the ability of auditory discrimination. Objective  To characterize the latency and amplitude values of MMN in children with normal auditory thresholds and without auditory complaints. Methods  Children between 5 and 11 years old participated in the present study. All participants underwent acoustic immittance measurements and tonal and vocal audiometry. The MMN was recorded with the MASBE ATC Plus system (Contronic, Pelotas, RS, Brazil). The electrodes were fixed in Fz (active electrode), Fpz (ground electrode) and in M2 and M1 (references electrodes). The intensity used was 80 dBHL, the frequent stimulus was 1,000 Hz and the rare stimulus was 2,000 Hz. The stimuli were presented in both ears separately. Results  For the female group, the mean latencies and amplitude of MMN were 177.3 ms and 5.01 μV in the right ear (RE) and 182.4 ms and 5.39 μV in the left ear (LE). In the male group, the mean latencies were 194.4 ms in the RE and 183.6 ms in the LE, with an amplitude of 5.11 μV in the RE and 5.83 μV in the LE. There was no statistically significant difference between ears ( p  = 0.867 - latency and p  = 0.178 - amplitude), age ( p  > 0.20) and the gender of the participants ( p  > 0.05). Conclusion  Using the described protocol, the mean latency value of MMN was 184.0 ms for RE and 182.9 ms for LE, and the amplitude was 5.05 μV and 5.56 μV for the left and right ears, respective.

The Neuronal Basis of Predictive Coding Along the Auditory Pathway: From the Subcortical Roots to Cortical Deviance Detection

In this review, we attempt to integrate the empirical evidence regarding stimulus-specific adaptation (SSA) and mismatch negativity (MMN) under a predictive coding perspective (also known as Bayesian or hierarchical-inference model). We propose a renewed methodology for SSA study, which enables a further decomposition of deviance detection into repetition suppression and prediction error, thanks to the use of two controls previously introduced in MMN research: the many-standards and the cascade sequences. Focusing on data obtained with cellular recordings, we explain how deviance detection and prediction error are generated throughout hierarchical levels of processing, following two vectors of increasing computational complexity and abstraction along the auditory neuraxis: from subcortical toward cortical stations and from lemniscal toward nonlemniscal divisions. Then, we delve into the particular characteristics and contributions of subcortical and cortical structures to this generative mechanism of hierarchical inference, analyzing what is known about the role of neuromodulation and local microcircuitry in the emergence of mismatch signals. Finally, we describe how SSA and MMN are occurring at similar time frame and cortical locations, and both are affected by the manipulation of N-methyl- D-aspartate receptors. We conclude that there is enough empirical evidence to consider SSA and MMN, respectively, as the microscopic and macroscopic manifestations of the same physiological mechanism of deviance detection in the auditory cortex. Hence, the development of a common theoretical framework for SSA and MMN is all the more recommendable for future studies. In this regard, we suggest a shared nomenclature based on the predictive coding interpretation of deviance detection.

Auditory-evoked potentials to changes in sound duration in urethane-anaesthetized mice

Spectrotemporally complex sounds carry important information for acoustic communication. Among the important features of these sounds is the temporal duration. An event-related potential called mismatch negativity indexes auditory change detection in humans. An analogous response (mismatch response) has been found to duration changes in speech sounds in rats but not yet in mice. We addressed whether mice show this response, and, if elicited, whether this response is functionally analogous to mismatch negativity or whether adaptation-based models suffice to explain them. Auditory-evoked potentials were epidurally recorded above the mice auditory cortex. The differential response to the changes in a repeated human speech sound /a/ was elicited 53-259 ms post-change (oddball condition). The differential response was observable to the largest duration change (from 200 to 110 ms). Any smaller (from 200 to 120-180 ms at 10 ms steps) duration changes did elicit an observable response. The response to the largest duration change did not robustly differ in amplitude from the response to the change-inducing sound presented without its repetitive background (equiprobable condition). The findings suggest that adaptation may suffice to explain responses to duration changes in spectrotemporally complex sounds in anaesthetized mice. The results pave way for development of a variety of murine models of acoustic communication.

Involuntary sensory enhancement of gain- and loss-associated tones: A general relevance principle

In a recent event-related potential (ERP) study (Folyi et al., 2016), we have demonstrated that sensory processing of task-irrelevant tones is enhanced when they were previously associated with positive or negative (by the means of monetary gains and losses, respectively) affective meaning relative to tones with neutral meaning, as indexed by the enhancement of the auditory N1-amplitude. In the present study, (1) in line with the hypothesis of affective counter-regulation, we investigated whether positive versus negative tones can receive differential attentional enhancement, depending on motivational context (Experiment 1); and (2) whether the early facilitation of positive and negative tones can operate strictly outside of the focus of voluntary attention (Experiment 2). In Experiment 1, we replicated the basic N1 valence effect, but found no moderation by motivational context. In Experiment 2, we found a small valence effect on the N1. By combining data from the three experiments (i.e., our previous experiment and the present ones; N = 72), we found a clear enhancement of N1-amplitudes for valenced tones without moderation by experiment. This pattern of results suggests comparable early attentional enhancement of valenced tones in general: (a) despite different level of concurrent task-relevant attentional and motivational demands in these experiments; and (b) without prioritizing one valence category over another, supporting our claim that the general relevance of the tones with high motivational value that governs early attentional facilitation.

Maturation of Speech-Sound ERPs in 5-6-Year-Old Children: A Longitudinal Study

The maturation of 5-6-year-old children's auditory discrimination - indicated by the development of the auditory event-related-potentials (ERPs) - has not been previously studied in longitudinal settings. For the first time, we present here the results based on extensive dataset collected from 75 children. We followed the 5- to 6-year-olds for 20 months and measured their ERPs four times with the same multifeature paradigm with phonemic stimuli. The amplitude of the mismatch negativity (MMN) response increased during this time for vowel, vowel duration and frequency changes. Furthermore, the P3a component started to mature toward adult-like positivity for the vowel, intensity and frequency deviants and the late discriminative negativity (LDN) component decreased with age for vowel and intensity deviants. All the changes in the components seemed to happen during the second follow-up year, when Finnish children are taught letter symbols and other preliminary academic skills before going to school at the age of seven. Therefore, further studies are needed to clarify if these changes in the auditory discrimination are purely age-related or due to increasing linguistic knowledge of the children.

Event-Related Potentials in the Clinical High-Risk (CHR) State for Psychosis: A Systematic Review

There is emerging evidence that identification and treatment of individuals in the prodromal or clinical high-risk (CHR) state for psychosis can reduce the probability that they will develop a psychotic disorder. Event-related brain potentials (ERPs) are a noninvasive neurophysiological technique that holds promise for improving our understanding of neurocognitive processes underlying the CHR state. We aimed to systematically review the current literature on cognitive ERP studies of the CHR population, in order to summarize and synthesize the results, and their implications for our understanding of the CHR state. Across studies, amplitudes of the auditory P300 and duration mismatch negativity (MMN) ERPs appear reliably reduced in CHR individuals, suggesting that underlying impairments in detecting changes in auditory stimuli are a sensitive early marker of the psychotic disease process. There are more limited data indicating that an earlier-latency auditory ERP response, the N100, is also reduced in amplitude, and in the degree to which it is modulated by stimulus characteristics, in the CHR population. There is also evidence that a number of auditory ERP measures (including P300, MMN and N100 amplitudes, and N100 gating in response to repeated stimuli) can further refine our ability to detect which CHR individuals are most at risk for developing psychosis. Thus, further research is warranted to optimize the predictive power of algorithms incorporating these measures, which could help efforts to target psychosis prevention interventions toward those most in need.

Automatic processing of pragmatic information in the human brain: a mismatch negativity study

Language comprehension involves pragmatic information processing, which allows world knowledge to influence the interpretation of a sentence. This study explored whether pragmatic information can be automatically processed during spoken sentence comprehension. The experiment adopted the mismatch negativity (MMN) paradigm to capture the neurophysiological indicators of automatic processing of spoken sentences. Pragmatically incorrect ('Foxes have wings') and correct ('Butterflies have wings') sentences were used as the experimental stimuli. In condition 1, the pragmatically correct sentence was the deviant and the pragmatically incorrect sentence was the standard stimulus, whereas the opposite case was presented in condition 2. The experimental results showed that, compared with the condition that the pragmatically correct sentence is the deviant stimulus, when the condition that the pragmatically incorrect sentence is the deviant stimulus MMN effects were induced within 60-120 and 220-260 ms. The results indicated that the human brain can monitor for incorrect pragmatic information in the inattentive state and can automatically process pragmatic information at the beginning of spoken sentence comprehension.

Automatic Processing of Changes in Facial Emotions in Dysphoria: A Magnetoencephalography Study

It is not known to what extent the automatic encoding and change detection of peripherally presented facial emotion is altered in dysphoria. The negative bias in automatic face processing in particular has rarely been studied. We used magnetoencephalography (MEG) to record automatic brain responses to happy and sad faces in dysphoric (Beck's Depression Inventory ≥ 13) and control participants. Stimuli were presented in a passive oddball condition, which allowed potential negative bias in dysphoria at different stages of face processing (M100, M170, and M300) and alterations of change detection (visual mismatch negativity, vMMN) to be investigated. The magnetic counterpart of the vMMN was elicited at all stages of face processing, indexing automatic deviance detection in facial emotions. The M170 amplitude was modulated by emotion, response amplitudes being larger for sad faces than happy faces. Group differences were found for the M300, and they were indexed by two different interaction effects. At the left occipital region of interest, the dysphoric group had larger amplitudes for sad than happy deviant faces, reflecting negative bias in deviance detection, which was not found in the control group. On the other hand, the dysphoric group showed no vMMN to changes in facial emotions, while the vMMN was observed in the control group at the right occipital region of interest. Our results indicate that there is a negative bias in automatic visual deviance detection, but also a general change detection deficit in dysphoria.

Influence of Musical Enculturation on Brain Responses to Metric Deviants

The ability to recognize metric accents is fundamental in both music and language perception. It has been suggested that music listeners prefer rhythms that follow simple binary meters, which are common in Western music. This means that listeners expect odd-numbered beats to be strong and even-numbered beats to be weak. In support of this, studies have shown that listeners exposed to Western music show stronger novelty and incongruity related P3 and irregularity detection related mismatch negativity (MMN) brain responses to attenuated odd- than attenuated even-numbered metric positions. Furthermore, behavioral evidence suggests that music listeners' preferences can be changed by long-term exposure to non-Western rhythms and meters, e.g., by listening to African or Balkan music. In our study, we investigated whether it might be possible to measure effects of music enculturation on neural responses to attenuated tones on specific metric positions. We compared the magnetic mismatch negativity (MMNm) to attenuated beats in a “Western group” of listeners (n = 12) mainly exposed to Western music and a “Bicultural group” of listeners (n = 13) exposed for at least 1 year to both Sub-Saharan African music in addition to Western music. We found that in the “Western group” the MMNm was higher in amplitude to deviant tones on odd compared to even metric positions, but not in the “Bicultural group.” In support of this finding, there was also a trend of the “Western group” to rate omitted beats as more surprising on odd than even metric positions, whereas the “Bicultural group” seemed to discriminate less between metric positions in terms of surprise ratings. Also, we observed that the overall latency of the MMNm was significantly shorter in the Bicultural group compared to the Western group. These effects were not biased by possible differences in rhythm perception ability or music training, measured with the Musical Ear Test (MET). Furthermore, source localization analyses suggest that auditory, inferior temporal, sensory-motor, superior frontal, and parahippocampal regions might be involved in eliciting the MMNm to the metric deviants. These findings suggest that effects of music enculturation can be measured on MMNm responses to attenuated tones on specific metric positions.

Visual Mismatch and Predictive Coding: A Computational Single-Trial ERP Study

Predictive coding (PC) posits that the brain uses a generative model to infer the environmental causes of its sensory data and uses precision-weighted prediction errors (pwPEs) to continuously update this model. While supported by much circumstantial evidence, experimental tests grounded in formal trial-by-trial predictions are rare. One partial exception is event-related potential (ERP) studies of the auditory mismatch negativity (MMN), where computational models have found signatures of pwPEs and related model-updating processes. Here, we tested this hypothesis in the visual domain, examining possible links between visual mismatch responses and pwPEs. We used a novel visual "roving standard" paradigm to elicit mismatch responses in humans (of both sexes) by unexpected changes in either color or emotional expression of faces. Using a hierarchical Bayesian model, we simulated pwPE trajectories of a Bayes-optimal observer and used these to conduct a comprehensive trial-by-trial analysis across the time × sensor space. We found significant modulation of brain activity by both color and emotion pwPEs. The scalp distribution and timing of these single-trial pwPE responses were in agreement with visual mismatch responses obtained by traditional averaging and subtraction (deviant-minus-standard) approaches. Finally, we compared the Bayesian model to a more classical change model of MMN. Model comparison revealed that trial-wise pwPEs explained the observed mismatch responses better than categorical change detection. Our results suggest that visual mismatch responses reflect trial-wise pwPEs, as postulated by PC. These findings go beyond classical ERP analyses of visual mismatch and illustrate the utility of computational analyses for studying automatic perceptual processes.SIGNIFICANCE STATEMENT Human perception is thought to rely on a predictive model of the environment that is updated via precision-weighted prediction errors (pwPEs) when events violate expectations. This "predictive coding" view is supported by studies of the auditory mismatch negativity brain potential. However, it is less well known whether visual perception of mismatch relies on similar processes. Here we combined computational modeling and electroencephalography to test whether visual mismatch responses reflected trial-by-trial pwPEs. Applying a Bayesian model to series of face stimuli that violated expectations about color or emotional expression, we found significant modulation of brain activity by both color and emotion pwPEs. A categorical change detection model performed less convincingly. Our findings support the predictive coding interpretation of visual mismatch responses.

Mismatch negativity and psychophysical detection of rising and falling intensity sounds

Human subjects demonstrate a perceptual priority for rising level sounds compared with falling level sounds. The aim of the present study was to investigate whether or not the perceptual preference for rising intensity can be found in the preattentive processing indexed by mismatch negativity (MMN). Reversed oddball stimulation was used to produce MMNs and to test the behavioral discrimination of rising, falling and constant level sounds. Three types of stimuli served as standards or deviants in different blocks: constant level sounds and two kinds of rising/falling sounds with gradual or stepwise change of intensity. The MMN amplitudes were calculated by subtracting ERPs to identical stimuli presented as standard in one block and deviant in another block. Both rising and falling level deviants elicited MMNs which peaked after 250 ms and did not overlap with N1 waves. MMN was elicited by level changes even when the deviants were not discriminated behaviorally. Most importantly, we found dissociation between earlier and later stages of auditory processing: the MMN responses to the level changes were mostly affected by the direction of deviance (increment or decrement) in the sequence, whereas behavioral performance depended on the direction of the level change within the stimuli (rising or falling).

Healthy full-term infants' brain responses to emotionally and linguistically relevant sounds using a multi-feature mismatch negativity (MMN) paradigm

We evaluated the feasibility of a multi-feature mismatch negativity (MMN) paradigm in studying auditory processing of healthy newborns. The aim was to examine the automatic change-detection and processing of semantic and emotional information in speech in newborns. Brain responses of 202 healthy newborns were recorded with a multi-feature paradigm including a Finnish bi-syllabic pseudo-word/ta-ta/as a standard stimulus, six linguistically relevant deviant stimuli and three emotionally relevant stimuli (happy, sad, angry). Clear responses to emotional sounds were found already at the early latency window 100-200 ms, whereas responses to linguistically relevant minor changes and emotional stimuli at the later latency window 300-500 ms did not reach significance. Moreover, significant interaction between gender and emotional stimuli was found in the early latency window. Further studies on using multi-feature paradigms with linguistic and emotional stimuli in newborns are needed, especially those containing of follow-ups, enabling the assessment of the predictive value of early variations between subjects.