Auditory perceptual objects as generative models: Setting the stage for communication by sound

Native language advantage in electrical brain responses to speech sound changes in passive and active listening condition

It is not clear whether the brain can detect changes in native and non-native speech sounds in both unattended and attended conditions, but this information would be important to understand the nature of potential native language advantage in speech perception. We recorded event-related potentials (ERPs) for changes in duration and in Chinese lexical tone in a repeated vowel /a/ in native speakers of Finnish and Chinese in passive and active listening conditions. ERP amplitudes reflecting deviance detection (mismatch negativity; MMN and N2b) and attentional shifts towards changes in speech sounds (P3a and P3b) were investigated. In the passive listening condition, duration changes elicited increased amplitude in the MMN latency window for both standard and deviant sounds in the Finnish speakers compared to the Chinese speakers, but no group differences were observed for P3a. In passive listening to lexical tones, P3a was increased in amplitude for both standard and deviant stimuli in Chinese speakers compared to Finnish speakers, but the groups did not differ in MMN. In active listening, both tone and duration changes elicited N2b and P3b, but the groups differed only in pattern of results for the deviant type. The results thus suggest an overall increased sensitivity to native speech sounds, especially in passive listening, while the mechanisms of change detection and attentional shifting seem to work well for both native and non-native speech sounds in the attentive mode.

Auditory associative word learning in adults: The effects of musical experience and stimulus ordering

Evidence for sequential associative word learning in the auditory domain has been identified in infants, while adults have shown difficulties. To better understand which factors may facilitate adult auditory associative word learning, we assessed the role of auditory expertise as a learner-related property and stimulus order as a stimulus-related manipulation in the association of auditory objects and novel labels. We tested in the first experiment auditorily-trained musicians versus athletes (high-level control group) and in the second experiment stimulus ordering, contrasting object-label versus label-object presentation. Learning was evaluated from Event-Related Potentials (ERPs) during training and subsequent testing phases using a cluster-based permutation approach, as well as accuracy-judgement responses during test. Results revealed for musicians a late positive component in the ERP during testing, but neither an N400 (400-800 ms) nor behavioral effects were found at test, while athletes did not show any effect of learning. Moreover, the object-label-ordering group only exhibited emerging association effects during training, while the label-object-ordering group showed a trend-level late ERP effect (800-1200 ms) during test as well as above chance accuracy-judgement scores. Thus, our results suggest the learner-related property of auditory expertise and stimulus-related manipulation of stimulus ordering modulate auditory associative word learning in adults.

Tracking the habituation of the event-related EEG potential in automatic change detection using an auditory two-tone oddball paradigm

The mismatch negativity and the P3a of the event-related EEG potential reflect the electrocortical response to a deviant stimulus in a series of stimuli. Although both components have been investigated in various paradigms, these paradigms usually incorporate many repetitions of the same deviant, thus leaving open whether both components vary as a function of the deviant's position in a series of deviant stimuli-i.e. whether they are subject to qualitative/quantitative habituation from one instantiation of a deviant to the next. This is so because the detection of mismatch negativity/P3a in the event-related EEG potential requires an averaging over dozens or hundreds of stimuli, i.e. over many instantiations of the deviant per participant. The present study addresses this research gap. We used a two-tone oddball paradigm implementing only a small number of (deviant) stimuli per participant, but applying it to a large number of participants (n > 230). Our data show that the mismatch negativity amplitude exhibits no decrease as a function of the deviant's position in a series of (standard and) deviant stimuli. Importantly, only after the very first deviant stimulus, a distinct P3a could be detected, indicative of an orienting reaction and an attention shift, and thus documenting a dissociation of mismatch negativity and P3a.

Computational Synaptic Modeling of Pitch and Duration Mismatch Negativity in First-Episode Psychosis Reveals Selective Dysfunction of the N-Methyl-D-Aspartate Receptor

Mismatch negativity (MMN) to pitch (pMMN) and to duration (dMMN) deviant stimuli is significantly more attenuated in long-term psychotic illness compared to first-episode psychosis (FEP). It was recently shown that source-modeling of magnetically recorded MMN increases the detection of left auditory cortex MMN deficits in FEP, and that computational circuit modeling of electrically recorded MMN also reveals left-hemisphere auditory cortex abnormalities. Computational modeling using dynamic causal modeling (DCM) can also be used to infer synaptic activity from EEG-based scalp recordings. We measured pMMN and dMMN with EEG from 26 FEP and 26 matched healthy controls (HCs) and used a DCM conductance-based neural mass model including α-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid, N-methyl-D-Aspartate (NMDA), and Gamma-aminobutyric acid receptors to identify any changes in effective connectivity and receptor rate constants in FEP. We modeled MMN sources in bilateral A1, superior temporal gyrus, and inferior frontal gyrus (IFG). No model parameters distinguished groups for pMMN. For dMMN, reduced NMDA receptor activity in right IFG in FEP was detected. This finding is in line with literature of prefrontal NMDA receptor hypofunction in chronic schizophrenia and suggests impaired NMDA-induced synaptic plasticity may be present at psychosis onset where scalp dMMN is only moderately reduced. To the best of our knowledge, this is the first report of impaired NMDA receptor activity in FEP found through computational modeling of dMMN and shows the potential of DCM to non-invasively reveal synaptic-level abnormalities that underly subtle functional auditory processing deficits in early psychosis.

From psychophysiology to brain imaging: forty-five years MMN history of investigating acoustic change sensitivity

Forty-five years have passed since the first publication of the mismatch negativity (MMN) event-related brain potential (ERP) component. The first 10 years of research hardly gained any particular attention of the scientific community interested in acoustic perception. Debates on the nature of sensation versus perception were going on, and the technical possibilities to record ERPs, called in general evoked potentials, were very limited. Subtle changes in pure tone frequency or intensity giving rise to the MMN component were first investigated in humans. The background of the theoretical model developed by Risto Näätänen was the orientation reaction model of E.N. Sokolov published in 1963 so that the MMN was seen first as an electrophysiological correlate of auditory change detection. This fundamental ability of the auditory system seen as crucial for survival led to the development of the first animal model of the MMN (Csépe et al. in Clin Neurophysiol 66: 571-578, 1987). Indeed, it was confirmed that the MMN was the brain correlate of subtle changes detected that might alert to potential threats in the environment and direct the behavioral orientation. The investigations performed after 2000 introduced complex models and more sophisticated methods, both in animal and human studies, so that the MMN method was on the way to become a tool on the first place and not the main goal of research. This approach was further strengthened by the increasing number of studies on different clinical populations aiming at future applications. The aim of our review is to describe and redefine what the MMN may reflect in auditory perception and to show why and how this brain correlate of changes in the auditory scene can be used as a valuable tool in cognitive neuroscience research. We refer to publications selected to underly the argument the MMN cannot be classified anymore as a sign of simple change detection and not all the indicators used to confirm how genuine the MMN elicited by variations of tones are valid for those to  speech contrasts. We provide a fresh view on the broadly used MMN models, provided by some influential publications as well as on the unwritten history of MMN research aiming to give revised picture on what the MMN may truly reflect. We show how the focus and terminology of the MMN research have changed and what kind of misunderstandings and seemingly contradictive results prevent the MMN community to accept a generally usable cognitive model.

The perceptual timescape: Perceptual history on the sub-second scale

There is a high-capacity store of brief time span (∼1000 ms) which information enters from perceptual processing, often called iconic memory or sensory memory. It is proposed that a main function of this store is to hold recent perceptual information in a temporally segregated representation, named the perceptual timescape. The perceptual timescape is a continually active representation of change and continuity over time that endows the perceived present with a perceived history. This is accomplished primarily by two kinds of time marking information: time distance information, which marks all items of information in the perceptual timescape according to how far in the past they occurred, and ordinal temporal information, which organises items of information in terms of their temporal order. Added to that is information about connectivity of perceptual objects over time. These kinds of information connect individual items over a brief span of time so as to represent change, persistence, and continuity over time. It is argued that there is a one-way street of information flow from perceptual processing either to the perceived present or directly into the perceptual timescape, and thence to working memory. Consistent with that, the information structure of the perceptual timescape supports postdictive reinterpretations of recent perceptual information. Temporal integration on a time scale of hundreds of milliseconds takes place in perceptual processing and does not draw on information in the perceptual timescape, which is concerned with temporal segregation, not integration.

Investigating the neurocognitive background of speech perception with a fast multi-feature MMN paradigm

The speech multi-feature MMN (Mismatch Negativity) offers a means to explore the neurocognitive background of the processing of multiple speech features in a short time, by capturing the time-locked electrophysiological activity of the brain known as event-related brain potentials (ERPs). Originating from Näätänen et al. (Clin Neurophysiol 115:140-144, 2004) pioneering work, this paradigm introduces several infrequent deviant stimuli alongside standard ones, each differing in various speech features. In this study, we aimed to refine the multi-feature MMN paradigm used previously to encompass both segmental and suprasegmental (prosodic) features of speech. In the experiment, a two-syllable long pseudoword was presented as a standard, and the deviant stimuli included alterations in consonants (deviation by place or place and mode of articulation), vowels (deviation by place or mode of articulation), and stress pattern in the first syllable of the pseudoword. Results indicated the emergence of MMN components across all segmental and prosodic contrasts, with the expected fronto-central amplitude distribution. Subsequent analyses revealed subtle differences in MMN responses to the deviants, suggesting varying sensitivity to phonetic contrasts. Furthermore, individual differences in MMN amplitudes were noted, partially attributable to participants' musical and language backgrounds. These findings underscore the utility of the multi-feature MMN paradigm for rapid and efficient investigation of the neurocognitive mechanisms underlying speech processing. Moreover, the paradigm demonstrated the potential to be used in further research to study the speech processing abilities in various populations.

Predictions about prosody facilitate lexical access: Evidence from P50/N100 and MMN components

Research into the neural foundation of perception asserts a model where top-down predictions modulate the bottom-up processing of sensory input. Despite becoming increasingly influential in cognitive neuroscience, the precise account of this predictive coding framework remains debated. In this study, we aim to contribute to this debate by investigating how predictions about prosody facilitate speech perception, and to shed light especially on lexical access influenced by simultaneous predictions in different domains, inter alia, prosodic and semantic. Using a passive auditory oddball paradigm, we examined neural responses to prosodic changes, leading to a semantic change as in Dutch nouns canon ['kaːnɔn] 'canon' vs kanon [kaː'nɔn] 'cannon', and used acoustically identical pseudowords as controls. Results from twenty-eight native speakers of Dutch (age range 18-32 years) indicated an enhanced P50/N100 complex to prosodic change in pseudowords as well as an MMN response to both words and pseudowords. The enhanced P50/N100 response to pseudowords is claimed to indicate that all relevant auditory information is still processed by the brain, whereas the reduced response to words might reflect the suppression of information that has already been encoded. The MMN response to pseudowords and words, on the other hand, is best justified by the unification of previously established prosodic representations with sensory and semantic input respectively. This pattern of results is in line with the predictive coding framework acting on multiple levels and is of crucial importance to indicate that predictions about linguistic prosodic information are utilized by the brain as early as 50 ms.

Deviants violating higher-order auditory regularities can become predictive and facilitate behaviour

The human auditory system is believed to represent regularities inherent in auditory information in internal models. Sounds not matching the standard regularity (deviants) elicit prediction error, alerting the system to information not explainable within currently active models. Here, we examine the widely neglected characteristic of deviants bearing predictive information themselves. In a modified version of the oddball paradigm, using higher-order regularities, we set up different expectations regarding the sound following a deviant. Higher-order regularities were defined by the relation of pitch within tone pairs (rather than absolute pitch of individual tones). In a deviant detection task participants listened to oddball sequences including two deviant types following diametrically opposed rules: one occurred mostly in succession (high repetition probability) and the other mostly in isolation (low repetition probability). Participants in Experiment 1 were not informed (naïve), whereas in Experiment 2 they were made aware of the repetition rules. Response times significantly decreased from first to second deviant when repetition probability was high-albeit more in the presence of explicit rule knowledge. There was no evidence of a facilitation effect when repetition probability was low. Significantly more false alarms occurred in response to standards following high compared with low repetition probability deviants, but only in participants aware of the repetition rules. These findings provide evidence that not only deviants violating lower- but also higher-order regularities can inform predictions about auditory events. More generally, they confirm the utility of this new paradigm to gather further insights into the predictive properties of the human brain.

Auditory learning of recurrent tone sequences is present in the newborn's brain

The seemingly effortless ability of our auditory system to rapidly detect new events in a dynamic environment is crucial for survival. Whether the underlying brain processes are innate is unknown. To answer this question, electroencephalography was recorded while regularly patterned (REG) versus random (RAND) tone sequences were presented to sleeping neonates. Regular relative to random sequences elicited differential neural responses after only a single repetition of the pattern indicating the existence of an innate capacity of the auditory system to detect auditory sequential regularities. We show that the newborn auditory system accumulates evidence only somewhat longer than the minimum amount determined by the ideal Bayesian observer model (the prediction from a variable-order Markov chain model) before detecting a repeating pattern. Thus, newborns can quickly form representations for regular features of the sound input, preparing the way for learning the contingencies of the environment.

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Prerequisites of language acquisition in the newborn brain

Learning to decode and produce speech is one of the most demanding tasks faced by infants. Nevertheless, infants typically utter their first words within a year, and phrases soon follow. Here we review cognitive abilities of newborn infants that promote language acquisition, focusing primarily on studies tapping neural activity. The results of these studies indicate that infants possess core adult auditory abilities already at birth, including statistical learning and rule extraction from variable speech input. Thus, the neonatal brain is ready to categorize sounds, detect word boundaries, learn words, and separate speech streams: in short, to acquire language quickly and efficiently from everyday linguistic input.

Why mismatch negativity continues to hold potential in probing altered brain function in schizophrenia

The brain potential known as mismatch negativity (MMN) is one of the most studied indices of altered brain function in schizophrenia. This review looks at what has been learned about MMN in schizophrenia over the last three decades and why the level of interest and activity in this field of research remains strong. A diligent consideration of available evidence suggests that MMN can serve as a biomarker in schizophrenia, but perhaps not the kind of biomarker that early research supposed. This review concludes that MMN measurement is likely to be most useful as a monitoring and response biomarker enabling tracking of an underlying pathology and efficacy of interventions, respectively. The role of, and challenges presented by, pre-clinical models is discussed as well as the merits of different methodologies that can be brought to bear in pursuing a deeper understanding of pathophysiology that might explain smaller MMN in schizophrenia.

Auditory Personalization of EMDR Treatment to Relieve Trauma Effects: A Feasibility Study [EMDR+]

According to the WHO (World Health Organization), Eye Movement Desensitization and Reprocessing (EMDR) is an elective therapy to treat people with post-traumatic stress disorders (PTSD). In line with the personalization of therapeutic strategies, through this pilot study, we assessed in people suffering from the effects of trauma the feasibility, safety, acceptance, and efficacy of EMDR enriched with sound stimulation (by administering neutral sounds synchronized with the guided bilateral alternating stimulation of the gaze) and musical reward (musical listening based on the patients' predisposition and personal tastes). Feasibility, quantified by the number of patients who completed the treatment, was excellent as this was the case in 12 out of the 12 enrolled people with psychological trauma. Safety and acceptance, assessed by self-compiled questionnaires, were excellent, with an absence of side effects and high satisfaction. Efficacy, quantified by the number of EMDR treatment sessions required to reach the optimal scores on the Subjective Units of Disturbance (SUD) and Validity of Cognition (VOC) scales typical of EMDR protocols, revealed an average duration of 8.5 (SD 1.2) sessions, which is well below the 12 sessions considered a standard EMDR treatment duration. EMDR+ appears to be a relevant personalization of EMDR, particularly in music-sensitive people, consolidating the therapeutic alliance through a multisensory communicative bond for trauma treatment.

On the relationship of arousal and attentional distraction by emotional novel sounds

Unexpected and task-irrelevant sounds can impair performance in a task. It has been shown that highly arousing emotional distractor sounds impaired performance less compared to moderately arousing neutral distractor sounds. The present study tests whether these differential emotion-related distraction effects are directly related to an enhancement of arousal evoked by processing of emotional distractor sounds. We disentangled costs of orienting of attention and benefits of increased arousal levels during the presentation of highly arousing emotional and moderately arousing neutral novel sounds that were embedded in a sequence of repeated standard sounds. We used sound-related pupil dilation responses as a marker of arousal and RTs as a marker of distraction in a visual categorization task in 57 healthy young adults. Multilevel analyses revealed increased RT and increased pupil dilation in response to novel vs. standard sounds. Emotional novel sounds reduced distraction effects on the behavioral level and increased pupil dilation responses compared to neutral novel sounds. Bayes Factors revealed strong evidence against an inverse proportional relationship between behavioral distraction effects and sound-related pupil dilation responses for emotional sounds. Given that the activity of the locus coeruleus has been linked to both changes in pupil diameter and arousal, it may embody an indirect relationship as a common antecedent by the release of norepinephrine into brain networks involved in attention control and control of the pupil. The present study provides new insights into the relation of changes in arousal and attentional distraction during the processing of emotional task-irrelevant novel sounds.

Auditory representations for long lasting sounds: Insights from event-related brain potentials and neural oscillations

The basic features of short sounds, such as frequency and intensity including their temporal dynamics, are integrated in a unitary representation. Knowledge on how our brain processes long lasting sounds is scarce. We review research utilizing the Mismatch Negativity event-related potential and neural oscillatory activity for studying representations for long lasting simple versus complex sounds such as sinusoidal tones versus speech. There is evidence for a temporal constraint in the formation of auditory representations: Auditory edges like sound onsets within long lasting sounds open a temporal window of about 350 ms in which the sounds' dynamics are integrated into a representation, while information beyond that window contributes less to that representation. This integration window segments the auditory input into short chunks. We argue that the representations established in adjacent integration windows can be concatenated into an auditory representation of a long sound, thus, overcoming the temporal constraint.

Intention-based predictive information modulates auditory deviance processing

The human brain is highly responsive to (deviant) sounds violating an auditory regularity. Respective brain responses are usually investigated in situations when the sounds were produced by the experimenter. Acknowledging that humans also actively produce sounds, the present event-related potential study tested for differences in the brain responses to deviants that were produced by the listeners by pressing one of two buttons. In one condition, deviants were unpredictable with respect to the button-sound association. In another condition, deviants were predictable with high validity yielding correctly predicted deviants and incorrectly predicted (mispredicted) deviants. Temporal principal component analysis revealed deviant-specific N1 enhancement, mismatch negativity (MMN) and P3a. N1 enhancements were highly similar for each deviant type, indicating that the underlying neural mechanism is not affected by intention-based expectation about the self-produced forthcoming sound. The MMN was abolished for predictable deviants, suggesting that the intention-based prediction for a deviant can overwrite the prediction derived from the auditory regularity (predicting a standard). The P3a was present for each deviant type but was largest for mispredicted deviants. It is argued that the processes underlying P3a not only evaluate the deviant with respect to the fact that it violates an auditory regularity but also with respect to the intended sensorial effect of an action. Overall, our results specify current theories of auditory predictive processing, as they reveal that intention-based predictions exert different effects on different deviance-specific brain responses.

Distinct interacting cortical networks for stimulus-response and repetition-suppression

Non-invasive studies consider the initial neural stimulus response (SR) and repetition suppression (RS) - the decreased response to repeated sensory stimuli - as engaging the same neurons. That is, RS is a suppression of the SR. We challenge this conjecture using electrocorticographic (ECoG) recordings with high spatial resolution in ten patients listening to task-irrelevant trains of auditory stimuli. SR and RS were indexed by high-frequency activity (HFA) across temporal, parietal, and frontal cortices. HFASR and HFARS were temporally and spatially distinct, with HFARS emerging later than HFASR and showing only a limited spatial intersection with HFASR: most HFASR sites did not demonstrate HFARS, and HFARS was found where no HFASR could be recorded. β activity was enhanced in HFARS compared to HFASR cortical sites. θ activity was enhanced in HFASR compared to HFARS sites. Furthermore, HFASR sites propagated information to HFARS sites via transient θ:β phase-phase coupling. In contrast to predictive coding (PC) accounts our results indicate that HFASR and HFARS are functionally linked but have minimal spatial overlap. HFASR might enable stable and rapid perception of environmental stimuli across extended temporal intervals. In contrast HFARS might support efficient generation of an internal model based on stimulus history.

More efficient formation of longer-term representations for word forms at birth can be linked to better language skills at 2 years

Infants are able to extract words from speech early in life. Here we show that the quality of forming longer-term representations for word forms at birth predicts expressive language ability at the age of two years. Seventy-five neonates were familiarized with two spoken disyllabic pseudowords. We then tested whether the neonate brain predicts the second syllable from the first one by presenting a familiarized pseudoword frequently, and occasionally violating the learned syllable combination by different rare pseudowords. Distinct brain responses were elicited by predicted and unpredicted word endings, suggesting that the neonates had learned the familiarized pseudowords. The difference between responses to predicted and unpredicted pseudowords indexing the quality of word-form learning during familiarization significantly correlated with expressive language scores (the mean length of utterance) at 24 months in the same infant. These findings suggest that 1) neonates can memorize disyllabic words so that a learned first syllable generates predictions for the word ending, and 2) early individual differences in the quality of word-form learning correlate with language skills. This relationship helps early identification of infants at risk for language impairment.

Predictability-Based Source Segregation and Sensory Deviance Detection in Auditory Aging

When multiple sound sources are present at the same time, auditory perception is often challenged with disentangling the resulting mixture and focusing attention on the target source. It has been repeatedly demonstrated that background (distractor) sound sources are easier to ignore when their spectrotemporal signature is predictable. Prior evidence suggests that this ability to exploit predictability for foreground-background segregation degrades with age. On a theoretical level, this has been related with an impairment in elderly adults’ capabilities to detect certain types of sensory deviance in unattended sound sequences. Yet the link between those two capacities, deviance detection and predictability-based sound source segregation, has not been empirically demonstrated. Here we report on a combined behavioral-EEG study investigating the ability of elderly listeners (60–75 years of age) to use predictability as a cue for sound source segregation, as well as their sensory deviance detection capacities. Listeners performed a detection task on a target stream that can only be solved when a concurrent distractor stream is successfully ignored. We contrast two conditions whose distractor streams differ in their predictability. The ability to benefit from predictability was operationalized as performance difference between the two conditions. Results show that elderly listeners can use predictability for sound source segregation at group level, yet with a high degree of inter-individual variation in this ability. In a further, passive-listening control condition, we measured correlates of deviance detection in the event-related brain potential (ERP) elicited by occasional deviations from the same spectrotemporal pattern as used for the predictable distractor sequence during the behavioral task. ERP results confirmed neural signatures of deviance detection in terms of mismatch negativity (MMN) at group level. Correlation analyses at single-subject level provide no evidence for the hypothesis that deviance detection ability (measured by MMN amplitude) is related to the ability to benefit from predictability for sound source segregation. These results are discussed in the frameworks of sensory deviance detection and predictive coding.

Sensitivity of neural responses in the inferior colliculus to statistical features of sound textures

Previous psychophysical studies have identified a hierarchy of time-averaged statistics which determine the identity of natural sound textures. However, it is unclear whether the neurons in the inferior colliculus (IC) are sensitive to each of these statistical features in the natural sound textures. We used 13 representative sound textures spanning the space of 3 statistics extracted from over 200 natural textures. The synthetic textures were generated by incorporating the statistical features in a step-by-step manner, in which a particular statistical feature was changed while the other statistical features remain unchanged. The extracellular activity in response to the synthetic texture stimuli was recorded in the IC of anesthetized rats. Analysis of the transient and sustained multiunit activity after each transition of statistical feature showed that the IC units were sensitive to the changes of all types of statistics, although to a varying extent. For example, we found that more neurons were sensitive to the changes in variance than that in the modulation correlations. Our results suggest that the sensitivity of the statistical features in the subcortical levels contributes to the identification and discrimination of natural sound textures.

Shorter Contextual Timescale Rather Than Memory Deficit in Aging

Many aspects of cognitive ability and brain function that change as we age look like deficits on account of measurable differences in comparison to younger adult groups. One such difference occurs in auditory sensory responses that index perceptual learning. Meta-analytic findings show reliable age-related differences in auditory responses to repetitive patterns of sound and to rare violations of those patterns, variously attributed to deficits in auditory sensory memory and inhibition. Here, we determine whether proposed deficits would render older adults less prone to primacy effects, robustly observed in young adults, which present as a tendency for first learning to have a disproportionate influence over later perceptual inference. The results confirm this reduced sensitivity to primacy effects but do not support impairment in auditory sensory memory as the origin of this difference. Instead, the aging brain produces data consistent with shorter timescales of contextual reference. In conclusion, age-related differences observed previously for perceptual inference appear highly context-specific necessitating reconsideration of whether and to what function the notion of deficit should be attributed, and even whether the notion of deficit is appropriate at all.

The auditory brain in action: Intention determines predictive processing in the auditory system-A review of current paradigms and findings

According to the ideomotor theory, action may serve to produce desired sensory outcomes. Perception has been widely described in terms of sensory predictions arising due to top-down input from higher order cortical areas. Here, we demonstrate that the action intention results in reliable top-down predictions that modulate the auditory brain responses. We bring together several lines of research, including sensory attenuation, active oddball, and action-related omission studies: Together, the results suggest that the intention-based predictions modulate several steps in the sound processing hierarchy, from preattentive to evaluation-related processes, also when controlling for additional prediction sources (i.e., sound regularity). We propose an integrative theoretical framework—the extended auditory event representation system (AERS), a model compatible with the ideomotor theory, theory of event coding, and predictive coding. Initially introduced to describe regularity-based auditory predictions, we argue that the extended AERS explains the effects of action intention on auditory processing while additionally allowing studying the differences and commonalities between intention- and regularity-based predictions—we thus believe that this framework could guide future research on action and perception.

Auditory Pattern Representations Under Conditions of Uncertainty-An ERP Study

The auditory system is able to recognize auditory objects and is thought to form predictive models of them even though the acoustic information arriving at our ears is often imperfect, intermixed, or distorted. We investigated implicit regularity extraction for acoustically intact versus disrupted six-tone sound patterns via event-related potentials (ERPs). In an exact-repetition condition, identical patterns were repeated; in two distorted-repetition conditions, one randomly chosen segment in each sound pattern was replaced either by white noise or by a wrong pitch. In a roving-standard paradigm, sound patterns were repeated 1-12 times (standards) in a row before a new pattern (deviant) occurred. The participants were not informed about the roving rule and had to detect rarely occurring loudness changes. Behavioral detectability of pattern changes was assessed in a subsequent behavioral task. Pattern changes (standard vs. deviant) elicited mismatch negativity (MMN) and P3a, and were behaviorally detected above the chance level in all conditions, suggesting that the auditory system extracts regularities despite distortions in the acoustic input. However, MMN and P3a amplitude were decreased by distortions. At the level of MMN, both types of distortions caused similar impairments, suggesting that auditory regularity extraction is largely determined by the stimulus statistics of matching information. At the level of P3a, wrong-pitch distortions caused larger decreases than white-noise distortions. Wrong-pitch distortions likely prevented the engagement of restoration mechanisms and the segregation of disrupted from true pattern segments, causing stronger informational interference with the relevant pattern information.

Word class and word frequency in the MMN looking glass

The effects of lexical meaning and lexical familiarity on auditory deviance detection were investigated by presenting oddball sequences of words, while participants ignored the stimuli. Stimulus sequences were composed of words that were varied in word class (nouns vs. functions words) and frequency of language use (high vs. low frequency) in a factorial design with the roles of frequently presented stimuli (Standards) and infrequently presented ones (Deviants) were fully crossed. Deviants elicited the Mismatch Negativity component of the event-related brain potential. Modulating effects of lexical meaning were obtained, revealing processing advantages for denotationally meaningful items. However, no effect of word frequency was observed. These results demonstrate that an apparently low-level function, such as auditory deviance detection utilizes information from the mental lexicon even for task-irrelevant stimuli.

Computational framework for investigating predictive processing in auditory perception

BACKGROUND

The brain tracks sound sources as they evolve in time, collecting contextual information to predict future sensory inputs. Previous work in predictive coding typically focuses on the perception of predictable stimuli, leaving the implementation of these same neural processes in more complex, real-world environments containing randomness and uncertainty up for debate.

NEW METHOD

To facilitate investigation into the perception of less tightly-controlled listening scenarios, we present a computational model as a tool to ask targeted questions about the underlying predictive processes that connect complex sensory inputs to listener behavior and neural responses. In the modeling framework, observed sound features (e.g. pitch) are tracked sequentially using Bayesian inference. Sufficient statistics are inferred from past observations at multiple time scales and used to make predictions about future observation while tracking the statistical structure of the sensory input.

RESULTS

Facets of the model are discussed in terms of their application to perceptual research, and examples taken from real-world audio demonstrate the model's flexibility to capture a variety of statistical structures along various perceptual dimensions.

COMPARISON WITH EXISTING METHODS

Previous models are often targeted toward interpreting a particular experimental paradigm (e.g., oddball paradigm), perceptual dimension (e.g., pitch processing), or task (e.g., speech segregation), thus limiting their ability to generalize to other domains. The presented model is designed as a flexible and practical tool for broad application.

CONCLUSION

The model is presented as a general framework for generating new hypotheses and guiding investigation into the neural processes underlying predictive coding of complex scenes.

Distraction of attention by novel sounds in children declines fast

New task-irrelevant sounds can distract attention. This study specifies the impact of stimulus novelty and of learning on attention control in three groups of children aged 6–7, 8, and 9–10 years and an adult control group. Participants (N = 179) were instructed to ignore a sound sequence including standard sounds and novel or repeated distractor sounds, while performing a visual categorization task. Distractor sounds impaired performance in children more than in adult controls, demonstrating the long-term development of attention control. Children, but not adults, were more distracted by novel than by repeated sounds, indicating increased sensitivity to novel information. Children, in particular younger children, were highly distracted during the first presentations of novel sounds compared to adults, while no age differences were observed for the last presentations. Results highlight the age-related impact of auditory novel information on attention and characterize the rapid development of attention control mechanisms as a function of age and exposure to irrelevant novel sounds.

Distraction by auditory novelty during reading: Evidence for disruption in saccade planning, but not saccade execution

Novel or unexpected sounds that deviate from an otherwise repetitive sequence of the same sound cause behavioural distraction. Recent work has suggested that distraction also occurs during reading as fixation durations increased when a deviant sound was presented at the fixation onset of words. The present study tested the hypothesis that this increase in fixation durations occurs due to saccadic inhibition. This was done by manipulating the temporal onset of sounds relative to the fixation onset of words in the text. If novel sounds cause saccadic inhibition, they should be more distracting when presented during the second half of fixations when saccade programming usually takes place. Participants read single sentences and heard a 120 ms sound when they fixated five target words in the sentence. On most occasions (p = .9), the same sine wave tone was presented (“standard”), while on the remaining occasions (p = .1) a new sound was presented (“novel”). Critically, sounds were played, on average, either during the first half of the fixation (0 ms delay) or during the second half of the fixation (120 ms delay). Consistent with the saccadic inhibition hypothesis (SIH), novel sounds led to longer fixation durations in the 120 ms compared to the 0 ms delay condition. However, novel sounds did not generally influence the execution of the subsequent saccade. These results suggest that unexpected sounds have a rapid influence on saccade planning, but not saccade execution.

Direct Evidence for Prediction Signals in Frontal Cortex Independent of Prediction Error

Predictive coding (PC) has been suggested as one of the main mechanisms used by brains to interact with complex environments. PC theories posit top-down prediction signals, which are compared with actual outcomes, yielding in turn prediction error (PE) signals, which are used, bottom-up, to modify the ensuing predictions. However, disentangling prediction from PE signals has been challenging. Critically, while many studies found indirect evidence for PC in the form of PE signals, direct evidence for the prediction signal is mostly lacking. Here, we provide clear evidence, obtained from intracranial cortical recordings in human surgical patients, that the human lateral prefrontal cortex evinces prediction signals while anticipating an event. Patients listened to task-irrelevant sequences of repetitive tones including infrequent predictable or unpredictable pitch deviants. The broadband high-frequency amplitude (HFA) was decreased prior to the onset of expected relative to unexpected deviants in the frontal cortex only, and its amplitude was sensitive to the increasing likelihood of deviants following longer trains of standards in the unpredictable condition. Single-trial HFA predicted deviations and correlated with poststimulus response to deviations. These results provide direct evidence for frontal cortex prediction signals independent of PE signals.

Functional connectivity of the frontotemporal network in preattentive detection of abstract changes: Perturbs and observes with transcranial magnetic stimulation and event-related optical signal

Current theories of automatic or preattentive change detection suggest a regularity or prediction violation mechanism involving functional connectivity between the inferior frontal cortex (IFC) and the superior temporal cortex (STC). By disrupting the IFC function with transcranial magnetic stimulation (TMS) and recording the later STC mismatch response with event-related optical signal (EROS), previous study demonstrated a causal IFC-to-STC functional connection in detecting a pitch or physical change. However, physical change detection can be achieved by memory comparison of the physical features and may not necessarily involve regularity/rule extraction and prediction. The current study investigated the IFC-STC functional connectivity in detecting rule violation (i.e., an abstract change). Frequent standard tone pairs with a constant relative pitch difference, but varying pitches, were presented to establish a pitch interval rule. This abstract rule was violated by deviants with reduced relative pitch intervals. The EROS STC mismatch response to the deviants was abolished by the TMS applied at the IFC 80 ms after deviance onset, but preserved in the spatial (TMS on vertex), auditory (TMS sound), and temporal (200 ms after deviance onset) control conditions. These results demonstrate the IFC-STC connection in preattentive abstract change detection and support the regularity or prediction violation account.

Dissociable Neural Information Dynamics of Perceptual Integration and Differentiation during Bistable Perception

At any given moment, we experience a perceptual scene as a single whole and yet we may distinguish a variety of objects within it. This phenomenon instantiates two properties of conscious perception: integration and differentiation. Integration is the property of experiencing a collection of objects as a unitary percept and differentiation is the property of experiencing these objects as distinct from each other. Here, we evaluated the neural information dynamics underlying integration and differentiation of perceptual contents during bistable perception. Participants listened to a sequence of tones (auditory bistable stimuli) experienced either as a single stream (perceptual integration) or as two parallel streams (perceptual differentiation) of sounds. We computed neurophysiological indices of information integration and information differentiation with electroencephalographic and intracranial recordings. When perceptual alternations were endogenously driven, the integrated percept was associated with an increase in neural information integration and a decrease in neural differentiation across frontoparietal regions, whereas the opposite pattern was observed for the differentiated percept. However, when perception was exogenously driven by a change in the sound stream (no bistability), neural oscillatory power distinguished between percepts but information measures did not. We demonstrate that perceptual integration and differentiation can be mapped to theoretically motivated neural information signatures, suggesting a direct relationship between phenomenology and neurophysiology.

Encoding of deterministic and stochastic auditory rules in the human brain: The mismatch negativity mechanism does not reflect basic probability

Regularities in a sequence of sounds can be automatically encoded in a predictive model by the auditory system. When a sound deviates from the one predicted by the model, a mismatch negativity (MMN) is elicited, which is taken to reflect a prediction error at a particular level of the model hierarchy. Although there are many studies on deterministic regularities, only a few have investigated the brain's ability to encode non-deterministic regularities. We studied a simple stochastic regularity: two tone pitches (standards, each occurring on 45% of trials); this regularity was occasionally violated by another tone pitch (deviant, occurring on 10% of trials). We found MMN when the deviant's pitch was outside those of the standards, but not when it was between them. Importantly, when we alternated the occurrence of the same two standards, making them deterministic, the deviant elicited MMN, even when its pitch was between those of the standards. Thus, although the MMN system is extremely powerful in establishing even quite complex deterministic regularities, it fails with a simple stochastic regularity. We argue that the MMN system does not know basic probability.

Neural Signal to Violations of Abstract Rules Using Speech-Like Stimuli

As the evidence of predictive processes playing a role in a wide variety of cognitive domains increases, the brain as a predictive machine becomes a central idea in neuroscience. In auditory processing, a considerable amount of progress has been made using variations of the Oddball design, but most of the existing work seems restricted to predictions based on physical features or conditional rules linking successive stimuli. To characterize the predictive capacity of the brain to abstract rules, we present here two experiments that use speech-like stimuli to overcome limitations and avoid common confounds. Pseudowords were presented in isolation, intermixed with infrequent deviants that contained unexpected phoneme sequences. As hypothesized, the occurrence of unexpected sequences of phonemes reliably elicited an early prediction error signal. These prediction error signals do not seemed to be modulated by attentional manipulations due to different task instructions, suggesting that the predictions are deployed even when the task at hand does not volitionally involve error detection. In contrast, the amount of syllables congruent with a standard pseudoword presented before the point of deviance exerted a strong modulation. Prediction error's amplitude doubled when two congruent syllables were presented instead of one, despite keeping local transitional probabilities constant. This suggests that auditory predictions can be built integrating information beyond the immediate past. In sum, the results presented here further contribute to the understanding of the predictive capabilities of the human auditory system when facing complex stimuli and abstract rules.

Does intra-uterine language experience modulate word stress processing? An ERP study

BACKGROUND

Preterm birth is associated with various risks, including delayed or atypical language development. The prenatal start of prosodic tuning may affect the processing of word stress, an important suprasegmental feature of spoken utterances.

AIM

Our study focused on the expected contribution of intra-uterine experience to word stress processing. We aimed to demonstrate the hypothesized effect of intra-uterine sound exposition on stress sensitivity.

METHOD

We recorded ERP responses of 34 preterm infants elicited by bisyllabic pseudo-words in two oddball conditions by switching the stress pattern (legal vs. illegal) and role (standard vs. deviant).

RESULTS

The mismatch responses found were synchronized to each syllable of the illegally stressed stimuli with no difference between pre- and full-term infants. However, the clear role of the preterm status was demonstrated by the exaggerated processing of the native stress information. The impact of intra-uterine exposure to prosody was confirmed by our finding that moderate-late preterm infants outperformed the very preterm ones.

CONCLUSION

Intra-uterine exposition to prosodic features appears to contribute to the emergence of stable long-term stress representation. When this tuning is missing it is considered a risk for the language acquisition process.

Visual mismatch negativity and stimulus-specific adaptation: the role of stimulus complexity

The present study investigated the function of the brain activity underlying the visual mismatch negativity (vMMN) event-related potential (ERP) component. Snowflake patterns (complex stimuli) were presented as deviants and oblique bar patterns (simple stimuli) as standards, and vice versa in a passive oddball paradigm. Control (equiprobable) sequences of either complex shape patterns or oblique bar patterns with various orientations were also presented. VMMN appeared as the difference between the ERP to the oddball deviant and the ERP to the control (deviant minus control ERP difference). Apart from the shorter latency of the vMMN to the oblique bar pattern as deviant, vMMN to both deviants was similar, i.e., there was no amplitude difference. We attributed the function of the brain processes underlying vMMN to the detection of the infrequent stimulus type (also represented in memory) instead of a call for further processing (a possibility for acquiring more precise representation) of the deviant. An unexpected larger adaptation (control minus standard ERP difference) to the snowflake pattern was also obtained. We suggest that this was due to the acquisition of a more elaborate memory representation of the more complex stimulus.

The potential role of auditory prediction error in decompensated tinnitus: An auditory mismatch negativity study

INTRODUCTION

Some tinnitus subjects habituate to their tinnitus but some others do not and complain of its annoyance tremendously. Normal sensory memory and change detection processes are needed for detecting the tinnitus signal as a prediction error and habituation to tinnitus. The purpose of this study was to compare auditory mismatch negativity as the index of sensory memory and change detection among the studied groups to search for the factors involving in the perception of tinnitus and preventing habituation in decompensated tinnitus subjects.

METHODS

Electroencephalography was recorded from scalp electrodes in compensated tinnitus, decompensated tinnitus, and no tinnitus control subjects. Mismatch negativity was obtained using the oddball paradigm with frequency, duration, and silent gap deviants. Amplitude, latency, and area under the curve of mismatch negativities were compared among the three studied groups.

RESULTS

The results showed lower mismatch negativity amplitude and area under the curve for the higher frequency deviant and for the silent gap deviant in decompensated tinnitus group compared to normal control and compensated tinnitus group.

CONCLUSIONS

This study revealed a deficit in sensory memory and change detection processing in decompensated tinnitus subjects. This causes persistent prediction errors; tinnitus signal is consistently detected as a new signal and activates the brain salience network and consequently prevents habituation to tinnitus. Mismatch negativity is proposed as an index for monitoring tinnitus rehabilitation.

The Neuronal Basis of Predictive Coding Along the Auditory Pathway: From the Subcortical Roots to Cortical Deviance Detection

In this review, we attempt to integrate the empirical evidence regarding stimulus-specific adaptation (SSA) and mismatch negativity (MMN) under a predictive coding perspective (also known as Bayesian or hierarchical-inference model). We propose a renewed methodology for SSA study, which enables a further decomposition of deviance detection into repetition suppression and prediction error, thanks to the use of two controls previously introduced in MMN research: the many-standards and the cascade sequences. Focusing on data obtained with cellular recordings, we explain how deviance detection and prediction error are generated throughout hierarchical levels of processing, following two vectors of increasing computational complexity and abstraction along the auditory neuraxis: from subcortical toward cortical stations and from lemniscal toward nonlemniscal divisions. Then, we delve into the particular characteristics and contributions of subcortical and cortical structures to this generative mechanism of hierarchical inference, analyzing what is known about the role of neuromodulation and local microcircuitry in the emergence of mismatch signals. Finally, we describe how SSA and MMN are occurring at similar time frame and cortical locations, and both are affected by the manipulation of N-methyl- D-aspartate receptors. We conclude that there is enough empirical evidence to consider SSA and MMN, respectively, as the microscopic and macroscopic manifestations of the same physiological mechanism of deviance detection in the auditory cortex. Hence, the development of a common theoretical framework for SSA and MMN is all the more recommendable for future studies. In this regard, we suggest a shared nomenclature based on the predictive coding interpretation of deviance detection.

Can't Ignore-Distraction by Task-Irrelevant Sounds in Early and Middle Childhood

Attention control abilities are relevant for learning success. Little is known about the development of audio-visual attention in early childhood. Four groups of children between the ages of 4 and 10 years and adults performed an audio-visual distraction paradigm (N = 106). Multilevel analyses revealed increased reaction times in a visual categorization task when task-irrelevant novel sounds were presented, demonstrating involuntary distraction of attention. This distraction effect decreased with age and significantly differed between age groups. In addition, the two youngest age groups responded with a delay in trials following a distractor trial, indicating delayed reallocation of attention to the task at hand. Results indicate a significant maturation of audio-visual attention control within a few years during early childhood that continues throughout middle childhood.

Detecting change in stochastic sound sequences

Our ability to parse our acoustic environment relies on the brain's capacity to extract statistical regularities from surrounding sounds. Previous work in regularity extraction has predominantly focused on the brain's sensitivity to predictable patterns in sound sequences. However, natural sound environments are rarely completely predictable, often containing some level of randomness, yet the brain is able to effectively interpret its surroundings by extracting useful information from stochastic sounds. It has been previously shown that the brain is sensitive to the marginal lower-order statistics of sound sequences (i.e., mean and variance). In this work, we investigate the brain's sensitivity to higher-order statistics describing temporal dependencies between sound events through a series of change detection experiments, where listeners are asked to detect changes in randomness in the pitch of tone sequences. Behavioral data indicate listeners collect statistical estimates to process incoming sounds, and a perceptual model based on Bayesian inference shows a capacity in the brain to track higher-order statistics. Further analysis of individual subjects' behavior indicates an important role of perceptual constraints in listeners' ability to track these sensory statistics with high fidelity. In addition, the inference model facilitates analysis of neural electroencephalography (EEG) responses, anchoring the analysis relative to the statistics of each stochastic stimulus. This reveals both a deviance response and a change-related disruption in phase of the stimulus-locked response that follow the higher-order statistics. These results shed light on the brain's ability to process stochastic sound sequences.

Predictive coding in auditory perception: challenges and unresolved questions

Predictive coding is arguably the currently dominant theoretical framework for the study of perception. It has been employed to explain important auditory perceptual phenomena, and it has inspired theoretical, experimental and computational modelling efforts aimed at describing how the auditory system parses the complex sound input into meaningful units (auditory scene analysis). These efforts have uncovered some vital questions, addressing which could help to further specify predictive coding and clarify some of its basic assumptions. The goal of the current review is to motivate these questions and show how unresolved issues in explaining some auditory phenomena lead to general questions of the theoretical framework. We focus on experimental and computational modelling issues related to sequential grouping in auditory scene analysis (auditory pattern detection and bistable perception), as we believe that this is the research topic where predictive coding has the highest potential for advancing our understanding. In addition to specific questions, our analysis led us to identify three more general questions that require further clarification: (1) What exactly is meant by prediction in predictive coding? (2) What governs which generative models make the predictions? and (3) What (if it exists) is the correlate of perceptual experience within the predictive coding framework?

Great Expectations: Is there Evidence for Predictive Coding in Auditory Cortex?

Predictive coding is possibly one of the most influential, comprehensive, and controversial theories of neural function. While proponents praise its explanatory potential, critics object that key tenets of the theory are untested or even untestable. The present article critically examines existing evidence for predictive coding in the auditory modality. Specifically, we identify five key assumptions of the theory and evaluate each in the light of animal, human and modeling studies of auditory pattern processing. For the first two assumptions - that neural responses are shaped by expectations and that these expectations are hierarchically organized - animal and human studies provide compelling evidence. The anticipatory, predictive nature of these expectations also enjoys empirical support, especially from studies on unexpected stimulus omission. However, for the existence of separate error and prediction neurons, a key assumption of the theory, evidence is lacking. More work exists on the proposed oscillatory signatures of predictive coding, and on the relation between attention and precision. However, results on these latter two assumptions are mixed or contradictory. Looking to the future, more collaboration between human and animal studies, aided by model-based analyses will be needed to test specific assumptions and implementations of predictive coding - and, as such, help determine whether this popular grand theory can fulfill its expectations.

Distraction by Novel and Pitch-Deviant Sounds in Children

The control of attention is an important part of our executive functions and enables us to focus on relevant information and to ignore irrelevant information. The ability to shield against distraction by task-irrelevant sounds is suggested to mature during school age. The present study investigated the developmental time course of distraction in three groups of children aged 7–10 years. Two different types of distractor sounds that have been frequently used in auditory attention research—novel environmental and pitch-deviant sounds—were presented within an oddball paradigm while children performed a visual categorization task. Reaction time measurements revealed decreasing distractor-related impairment with age. Novel environmental sounds impaired performance in the categorization task more than pitch-deviant sounds. The youngest children showed a pronounced decline of novel-related distraction effects throughout the experimental session. Such a significant decline as a result of practice was not observed in the pitch-deviant condition and not in older children. We observed no correlation between cross-modal distraction effects and performance in standardized tests of concentration and visual distraction. Results of the cross-modal distraction paradigm indicate that separate mechanisms underlying the processing of novel environmental and pitch-deviant sounds develop with different time courses and that these mechanisms develop considerably within a few years in middle childhood.

3Mo: A Model for Music-Based Biofeedback

In the domain of sports and motor rehabilitation, it is of major importance to regulate and control physiological processes and physical motion in most optimal ways. For that purpose, real-time auditory feedback of physiological and physical information based on sound signals, often termed “sonification,” has been proven particularly useful. However, the use of music in biofeedback systems has been much less explored. In the current article, we assert that the use of music, and musical principles, can have a major added value, on top of mere sound signals, to the benefit of psychological and physical optimization of sports and motor rehabilitation tasks. In this article, we present the 3Mo model to describe three main functions of music that contribute to these benefits. These functions relate the power of music to Motivate, and to Monitor and Modify physiological and physical processes. The model brings together concepts and theories related to human sensorimotor interaction with music, and specifies the underlying psychological and physiological principles. This 3Mo model is intended to provide a conceptual framework that guides future research on musical biofeedback systems in the domain of sports and motor rehabilitation.

Repair or Violation Detection? Pre-Attentive Processing Strategies of Phonotactic Illegality Demonstrated on the Constraint of g-Deletion in German

PURPOSE

Effects of categorical phonotactic knowledge on pre-attentive speech processing were investigated by presenting illegal speech input that violated a phonotactic constraint in German called "g-deletion." The present study aimed to extend previous findings of automatic processing of phonotactic violations and to investigate the role of stimulus context in triggering either an automatic phonotactic repair or a detection of the violation.

METHOD

The mismatch negativity event-related potential component was obtained in 2 identical cross-sectional experiments with speaker variation and 16 healthy adult participants each. Four pseudowords were used as stimuli, 3 of them phonotactically legal and 1 illegal. Stimuli were contrasted pairwise in passive oddball conditions and presented binaurally via headphones. Results were analyzed by means of mixed design analyses of variance.

RESULTS

Phonotactically illegal stimuli were found to be processed differently compared to legal ones. Results indicate evidence for both automatic repair and detection of the phonotactic violation depending on the linguistic context the illegal stimulus was embedded in.

CONCLUSIONS

These findings corroborate notions that categorical phonotactic knowledge is activated and applied even in the absence of attention. Thus, our findings contribute to the general understanding of sublexical phonological processing and may be of use for further developing speech recognition models.