Modeling the auditory scene: predictive regularity representations and perceptual objects

Cutting Through the Noise: Auditory Scenes and Their Effects on Visual Object Processing

Despite the intuitive feeling that our visual experience is coherent and comprehensive, the world is full of ambiguous and indeterminate information. Here we explore how the visual system might take advantage of ambient sounds to resolve this ambiguity. Young adults (ns = 20-30) were tasked with identifying an object slowly fading in through visual noise while a task-irrelevant sound played. We found that participants demanded more visual information when the auditory object was incongruent with the visual object compared to when it was not. Auditory scenes, which are only probabilistically related to specific objects, produced similar facilitation even for unheard objects (e.g., a bench). Notably, these effects traverse categorical and specific auditory and visual-processing domains as participants performed across-category and within-category visual tasks, underscoring cross-modal integration across multiple levels of perceptual processing. To summarize, our study reveals the importance of audiovisual interactions to support meaningful perceptual experiences in naturalistic settings.

Effects of 6-Month Combined Physical Exercise and Cognitive Training on Neuropsychological and Neurophysiological Function in Older Adults with Subjective Cognitive Decline: A Randomized Controlled Trial

Background

Multidomain intervention may delay or ameliorate cognitive decline in older adults at risk of Alzheimer's disease, particularly in the memory and inhibitory functions. However, no study systematically investigates the changes of brain function in cognitively-normal elderly with subjective cognitive decline (SCD) when they receive multidomain intervention.

Objective

We aimed to examine whether a multidomain intervention could improve neuropsychological function and neurophysiological activities related to memory and inhibitory function in SCD subjects.

Methods

Eight clusters with a total of 50 community-dwelling SCD older adults were single-blind, randomized into intervention group, which received physical and cognitive training, or control group, which received treatment as usual. For the neuropsychological function, a composite Z score from six cognitive tests was calculated and compared between two groups. For the neurophysiological activities, event-related potentials (ERPs) of memory function, including mismatch negativity (MMN) and memory-P3, as well as ERPs of inhibitory function, including sensory gating (SG) and inhibition-P3, were measured. Assessments were performed at baseline (T1), end of the intervention (T2), and 6 months after T2 (T3).

Results

For the neuropsychological function, the effect was not observed after the intervention. For the neurophysiological activities, improved MMN responses of ΔT2-T1 were observed in the intervention group versus the control group. The multidomain intervention produced a sustained effect on memory-P3 latencies of ΔT3-T1. However, there were no significant differences in changes of SG and inhibition-P3 between intervention and control groups.

Conclusions

While not impactful on neuropsychological function, multidomain intervention enhances specific neurophysiological activities associated with memory function.

Evidence for proactive and retroactive temporal pattern analysis in simultaneous maskinga)

Amplitude modulation (AM) of a masker reduces its masking on a simultaneously presented unmodulated pure-tone target, which likely involves dip listening. This study tested the idea that dip-listening efficiency may depend on stimulus context, i.e., the match in AM peakedness (AMP) between the masker and a precursor or postcursor stimulus, assuming a form of temporal pattern analysis process. Masked thresholds were measured in normal-hearing listeners using Schroeder-phase harmonic complexes as maskers and precursors or postcursors. Experiment 1 showed threshold elevation (i.e., interference) when a flat cursor preceded or followed a peaked masker, suggesting proactive and retroactive temporal pattern analysis. Threshold decline (facilitation) was observed when the masker AMP was matched to the precursor, irrespective of stimulus AMP, suggesting only proactive processing. Subsequent experiments showed that both interference and facilitation (1) remained robust when a temporal gap was inserted between masker and cursor, (2) disappeared when an F0-difference was introduced between masker and precursor, and (3) decreased when the presentation level was reduced. These results suggest an important role of envelope regularity in dip listening, especially when masker and cursor are F0-matched and, therefore, form one perceptual stream. The reported effects seem to represent a time-domain variant of comodulation masking release.

Carrier-frequency specific omission-related neural activity in ordered sound sequences is independent of omission-predictability

Regularities in our surroundings lead to predictions about upcoming events. Previous research has shown that omitted sounds during otherwise regular tone sequences elicit frequency-specific neural activity related to the upcoming but omitted tone. We tested whether this neural response is depending on the unpredictability of the omission. Therefore, we recorded magnetencephalography (MEG) data while participants listened to ordered or random tone sequences with omissions occurring either ordered or randomly. Using multivariate pattern analysis shows that the frequency-specific neural pattern during omission within ordered tone sequences occurs independent of the regularity of the omissions. These results suggest that the auditory predictions based on sensory experiences are not immediately updated by violations of those expectations.

Space as a scaffold for rotational generalisation of abstract concepts

Learning invariances allows us to generalise. In the visual modality, invariant representations allow us to recognise objects despite translations or rotations in physical space. However, how we learn the invariances that allow us to generalise abstract patterns of sensory data ('concepts') is a longstanding puzzle. Here, we study how humans generalise relational patterns in stimulation sequences that are defined by either transitions on a nonspatial two-dimensional feature manifold, or by transitions in physical space. We measure rotational generalisation, i.e., the ability to recognise concepts even when their corresponding transition vectors are rotated. We find that humans naturally generalise to rotated exemplars when stimuli are defined in physical space, but not when they are defined as positions on a nonspatial feature manifold. However, if participants are first pre-trained to map auditory or visual features to spatial locations, then rotational generalisation becomes possible even in nonspatial domains. These results imply that space acts as a scaffold for learning more abstract conceptual invariances.

Conceptual framework for tinnitus: a cognitive model in practice

Tinnitus is a conscious attended awareness perception of sourceless sound. Widespread theoretical and evidence-based neurofunctional and psychological models have tried to explain tinnitus-related distress considering the influence of psychological and cognitive factors. However, tinnitus models seem to be less focused on causality, thereby easily misleading interpretations. Also, they may be incapable of individualization. This study proposes a Conceptual Cognitive Framework (CCF) providing insight into cognitive mechanisms involved in the predisposition, precipitation, and perpetuation of tinnitus and consequent cognitive-emotional disturbances. The current CCF for tinnitus relies on evaluative conditional learning and appraisal, generating negative valence (emotional value) and arousal (cognitive value) to annoyance, distress, and distorted perception. The suggested methodology is well-defined, reproducible, and accessible, which can help foster future high-quality clinical databases. Perceived tinnitus through the perpetual-learning process can always lead to annoyance, but only in the clinical stage directly cause annoyance. In the clinical stage, tinnitus perception can lead indirectly to distress only with experiencing annoyance either with ("I n d - 1 C " = 1.87; 95% CI 1.18-2.72)["1st indirect path in the Clinical stage model": Tinnitus Loudness → Attention Bias → Cognitive-Emotional Value → Annoyance → Clinical Distress]or without ("I n d - 2 C "= 2.03; 95% CI 1.02-3.32)[ "2nd indirect path in the Clinical stage model": Tinnitus Loudness → Annoyance → Clinical Distress] the perpetual-learning process. Further real-life testing of the CCF is expected to express a meticulous, decision-supporting platform for cognitive rehabilitation and clinical interventions. Furthermore, the suggested methodology offers a reliable platform for CCF development in other cognitive impairments and supports the causal clinical data models. It may also enhance our knowledge of psychological disorders and complicated comorbidities by supporting the design of different rehabilitation interventions and comprehensive frameworks in line with the "preventive medicine" policy.

Investigating the neurocognitive background of speech perception with a fast multi-feature MMN paradigm

The speech multi-feature MMN (Mismatch Negativity) offers a means to explore the neurocognitive background of the processing of multiple speech features in a short time, by capturing the time-locked electrophysiological activity of the brain known as event-related brain potentials (ERPs). Originating from Näätänen et al. (Clin Neurophysiol 115:140-144, 2004) pioneering work, this paradigm introduces several infrequent deviant stimuli alongside standard ones, each differing in various speech features. In this study, we aimed to refine the multi-feature MMN paradigm used previously to encompass both segmental and suprasegmental (prosodic) features of speech. In the experiment, a two-syllable long pseudoword was presented as a standard, and the deviant stimuli included alterations in consonants (deviation by place or place and mode of articulation), vowels (deviation by place or mode of articulation), and stress pattern in the first syllable of the pseudoword. Results indicated the emergence of MMN components across all segmental and prosodic contrasts, with the expected fronto-central amplitude distribution. Subsequent analyses revealed subtle differences in MMN responses to the deviants, suggesting varying sensitivity to phonetic contrasts. Furthermore, individual differences in MMN amplitudes were noted, partially attributable to participants' musical and language backgrounds. These findings underscore the utility of the multi-feature MMN paradigm for rapid and efficient investigation of the neurocognitive mechanisms underlying speech processing. Moreover, the paradigm demonstrated the potential to be used in further research to study the speech processing abilities in various populations.

Neural encoding of musical expectations in a non-human primate

The appreciation of music is a universal trait of humankind.1,2,3 Evidence supporting this notion includes the ubiquity of music across cultures4,5,6,7 and the natural predisposition toward music that humans display early in development.8,9,10 Are we musical animals because of species-specific predispositions? This question cannot be answered by relying on cross-cultural or developmental studies alone, as these cannot rule out enculturation.11 Instead, it calls for cross-species experiments testing whether homologous neural mechanisms underlying music perception are present in non-human primates. We present music to two rhesus monkeys, reared without musical exposure, while recording electroencephalography (EEG) and pupillometry. Monkeys exhibit higher engagement and neural encoding of expectations based on the previously seeded musical context when passively listening to real music as opposed to shuffled controls. We then compare human and monkey neural responses to the same stimuli and find a species-dependent contribution of two fundamental musical features-pitch and timing12-in generating expectations: while timing- and pitch-based expectations13 are similarly weighted in humans, monkeys rely on timing rather than pitch. Together, these results shed light on the phylogeny of music perception. They highlight monkeys' capacity for processing temporal structures beyond plain acoustic processing, and they identify a species-dependent contribution of time- and pitch-related features to the neural encoding of musical expectations.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Neural signatures of automatic repetition detection in temporally regular and jittered acoustic sequences

Detection of repeating patterns within continuous sound streams is crucial for efficient auditory perception. Previous studies demonstrated a remarkable sensitivity of the human auditory system to periodic repetitions in unfamiliar, meaningless sounds. Automatic repetition detection was reflected in different EEG markers, including sustained activity, neural synchronisation, and event-related responses to pattern occurrences. The current study investigated how listeners' attention and the temporal regularity of a sound modulate repetition perception, and how this influence is reflected in different EEG markers that were previously suggested to subserve dissociable functions. We reanalysed data of a previous study in which listeners were presented with sequences of unfamiliar artificial sounds that either contained repetitions of a certain sound segment or not. Repeating patterns occurred either regularly or with a temporal jitter within the sequences, and participants' attention was directed either towards the pattern repetitions or away from the auditory stimulation. Across both regular and jittered sequences during both attention and in-attention, pattern repetitions led to increased sustained activity throughout the sequence, evoked a characteristic positivity-negativity complex in the event-related potential, and enhanced inter-trial phase coherence of low-frequency oscillatory activity time-locked to repeating pattern onsets. While regularity only had a minor (if any) influence, attention significantly strengthened pattern repetition perception, which was consistently reflected in all three EEG markers. These findings suggest that the detection of pattern repetitions within continuous sounds relies on a flexible mechanism that is robust against in-attention and temporal irregularity, both of which typically occur in naturalistic listening situations. Yet, attention to the auditory input can enhance processing of repeating patterns and improve repetition detection.

Implicit auditory memory in older listeners: From encoding to 6-month retention

Any listening task, from sound recognition to sound-based communication, rests on auditory memory which is known to decline in healthy ageing. However, how this decline maps onto multiple components and stages of auditory memory remains poorly characterised. In an online unsupervised longitudinal study, we tested ageing effects on implicit auditory memory for rapid tone patterns. The test required participants (younger, aged 20-30, and older adults aged 60-70) to quickly respond to rapid regularly repeating patterns emerging from random sequences. Patterns were novel in most trials (REGn), but unbeknownst to the participants, a few distinct patterns reoccurred identically throughout the sessions (REGr). After correcting for processing speed, the response times (RT) to REGn should reflect the information held in echoic and short-term memory before detecting the pattern; long-term memory formation and retention should be reflected by the RT advantage (RTA) to REGr vs REGn which is expected to grow with exposure. Older participants were slower than younger adults in detecting REGn and exhibited a smaller RTA to REGr. Computational simulations using a model of auditory sequence memory indicated that these effects reflect age-related limitations both in early and long-term memory stages. In contrast to ageing-related accelerated forgetting of verbal material, here older adults maintained stable memory traces for REGr patterns up to 6 months after the first exposure. The results demonstrate that ageing is associated with reduced short-term memory and long-term memory formation for tone patterns, but not with forgetting, even over surprisingly long timescales.

Auditory learning of recurrent tone sequences is present in the newborn's brain

The seemingly effortless ability of our auditory system to rapidly detect new events in a dynamic environment is crucial for survival. Whether the underlying brain processes are innate is unknown. To answer this question, electroencephalography was recorded while regularly patterned (REG) versus random (RAND) tone sequences were presented to sleeping neonates. Regular relative to random sequences elicited differential neural responses after only a single repetition of the pattern indicating the existence of an innate capacity of the auditory system to detect auditory sequential regularities. We show that the newborn auditory system accumulates evidence only somewhat longer than the minimum amount determined by the ideal Bayesian observer model (the prediction from a variable-order Markov chain model) before detecting a repeating pattern. Thus, newborns can quickly form representations for regular features of the sound input, preparing the way for learning the contingencies of the environment.

Habituation, Adaptation and Prediction Processes in Neurodevelopmental Disorders: A Comprehensive Review

Habituation, the simplest form of learning preserved across species and evolution, is characterized by a response decrease as a stimulus is repeated. This adaptive function has been shown to be altered in some psychiatric and neurodevelopmental disorders such as autism spectrum disorder (ASD), attention-deficit/hyperactivity disorder (ADHD) or schizophrenia. At the brain level, habituation is characterized by a decrease in neural activity as a stimulation is repeated, referred to as neural adaptation. This phenomenon influences the ability to make predictions and to detect change, two processes altered in some neurodevelopmental and psychiatric disorders. In this comprehensive review, the objectives are to characterize habituation, neural adaptation, and prediction throughout typical development and in neurodevelopmental disorders; and to evaluate their implication in symptomatology, specifically in sensitivity to change or need for sameness. A summary of the different approaches to investigate adaptation will be proposed, in which we report the contribution of animal studies as well as electrophysiological studies in humans to understanding of underlying neuronal mechanisms.

Extensive representation of sensory deviance in the responses to auditory gaps in unanesthetized rats

Unexpected changes in incoming sensory streams are associated with large errors in predicting the deviant stimulus relative to a memory trace of past stimuli. Mismatch negativity (MMN) in human studies and the release from stimulus-specific adaptation (SSA) in animal models correlate with prediction errors and deviance detection.¹ In human studies, violation of expectations elicited by an unexpected stimulus omission resulted in an omission MMN.^2,3,4,5 These responses are evoked after the expected occurrence time of the omitted stimulus, implying that they reflect the violation of a temporal expectancy.⁶ Because they are often time locked to the end of the omitted stimulus,^4,6,7 they resemble off responses. Indeed, suppression of cortical activity after the termination of the gap disrupts gap detection, suggesting an essential role for offset responses.⁸ Here, we demonstrate that brief gaps in short noise bursts in the auditory cortex of unanesthetized rats frequently evoke offset responses. Importantly, we show that omission responses are elicited when these gaps are expected but are omitted. These omission responses, together with the release from SSA of both onset and offset responses to rare gaps, form a rich and varied representation of prediction-related signals in the auditory cortex of unanesthetized rats, extending substantially and refining the representations described previously in anesthetized rats.

Neural mechanisms of temporal and rhythmic structure processing in non-musicians

Music is increasingly being used as a therapeutic tool in the field of rehabilitation medicine and psychophysiology. One of the main key components of music is its temporal organization. The characteristics of neurocognitive processes during music perception of meter in different tempo variations technique have been studied by using the event-related potentials technique. The study involved 20 volunteers (6 men, the median age of the participants was 23  years). The participants were asked to listen to 4 experimental series that differed in tempo (fast vs. slow) and meter (duple vs. triple). Each series consisted of 625 audio stimuli, 85% of which were organized with a standard metric structure (standard stimulus) while 15% included unexpected accents (deviant stimulus). The results revealed that the type of metric structure influences the detection of the change in stimuli. The analysis showed that the N200 wave occurred significantly faster for stimuli with duple meter and fast tempo and was the slowest for stimuli with triple meter and fast pace.

Neuroimaging evidence for the direct role of auditory scene analysis in object perception

Auditory Scene Analysis (ASA) refers to the grouping of acoustic signals into auditory objects. Previously, we have shown that perceived musicality of auditory sequences varies with high-level organizational features. Here, we explore the neural mechanisms mediating ASA and auditory object perception. Participants performed musicality judgments on randomly generated pure-tone sequences and manipulated versions of each sequence containing low-level changes (amplitude; timbre). Low-level manipulations affected auditory object perception as evidenced by changes in musicality ratings. fMRI was used to measure neural activation to sequences rated most and least musical, and the altered versions of each sequence. Next, we generated two partially overlapping networks: (i) a music processing network (music localizer) and (ii) an ASA network (base sequences vs. ASA manipulated sequences). Using Representational Similarity Analysis, we correlated the functional profiles of each ROI to a model generated from behavioral musicality ratings as well as models corresponding to low-level feature processing and music perception. Within overlapping regions, areas near primary auditory cortex correlated with low-level ASA models, whereas right IPS was correlated with musicality ratings. Shared neural mechanisms that correlate with behavior and underlie both ASA and music perception suggests that low-level features of auditory stimuli play a role in auditory object perception.

On the relationship of arousal and attentional distraction by emotional novel sounds

Unexpected and task-irrelevant sounds can impair performance in a task. It has been shown that highly arousing emotional distractor sounds impaired performance less compared to moderately arousing neutral distractor sounds. The present study tests whether these differential emotion-related distraction effects are directly related to an enhancement of arousal evoked by processing of emotional distractor sounds. We disentangled costs of orienting of attention and benefits of increased arousal levels during the presentation of highly arousing emotional and moderately arousing neutral novel sounds that were embedded in a sequence of repeated standard sounds. We used sound-related pupil dilation responses as a marker of arousal and RTs as a marker of distraction in a visual categorization task in 57 healthy young adults. Multilevel analyses revealed increased RT and increased pupil dilation in response to novel vs. standard sounds. Emotional novel sounds reduced distraction effects on the behavioral level and increased pupil dilation responses compared to neutral novel sounds. Bayes Factors revealed strong evidence against an inverse proportional relationship between behavioral distraction effects and sound-related pupil dilation responses for emotional sounds. Given that the activity of the locus coeruleus has been linked to both changes in pupil diameter and arousal, it may embody an indirect relationship as a common antecedent by the release of norepinephrine into brain networks involved in attention control and control of the pupil. The present study provides new insights into the relation of changes in arousal and attentional distraction during the processing of emotional task-irrelevant novel sounds.

Working memory and sensory memory in subclinical high schizotypy: An avenue for understanding schizophrenia?

The search for robust, reliable biomarkers of schizophrenia remains a high priority in psychiatry. Biomarkers are valuable because they can reveal the underlying mechanisms of symptoms and monitor treatment progress and may predict future risk of developing schizophrenia. Despite the existence of various promising biomarkers that relate to symptoms across the schizophrenia spectrum, and despite published recommendations encouraging multivariate metrics, they are rarely investigated simultaneously within the same individuals. In those with schizophrenia, the magnitude of purported biomarkers is complicated by comorbid diagnoses, medications and other treatments. Here, we argue three points. First, we reiterate the importance of assessing multiple biomarkers simultaneously. Second, we argue that investigating biomarkers in those with schizophrenia-related traits (schizotypy) in the general population can accelerate progress in understanding the mechanisms of schizophrenia. We focus on biomarkers of sensory and working memory in schizophrenia and their smaller effects in individuals with nonclinical schizotypy. Third, we note irregularities across research domains leading to the current situation in which there is a preponderance of data on auditory sensory memory and visual working memory, but markedly less in visual (iconic) memory and auditory working memory, particularly when focusing on schizotypy where data are either scarce or inconsistent. Together, this review highlights opportunities for researchers without access to clinical populations to address gaps in knowledge. We conclude by highlighting the theory that early sensory memory deficits contribute negatively to working memory and vice versa. This presents a mechanistic perspective where biomarkers may interact with one another and impact schizophrenia-related symptoms.

The effect of topic familiarity and volatility of auditory scene on selective auditory attention

Selective auditory attention has been shown to modulate the cortical representation of speech. This effect has been well documented in acoustically more challenging environments. However, the influence of top-down factors, in particular topic familiarity, on this process remains unclear, despite evidence that semantic information can promote speech-in-noise perception. Apart from individual features forming a static listening condition, dynamic and irregular changes of auditory scenes-volatile listening environments-have been less studied. To address these gaps, we explored the influence of topic familiarity and volatile listening on the selective auditory attention process during dichotic listening using electroencephalography. When stories with unfamiliar topics were presented, participants' comprehension was severely degraded. However, their cortical activity selectively tracked the speech of the target story well. This implies that topic familiarity hardly influences the speech tracking neural index, possibly when the bottom-up information is sufficient. However, when the listening environment was volatile and the listeners had to re-engage in new speech whenever auditory scenes altered, the neural correlates of the attended speech were degraded. In particular, the cortical response to the attended speech and the spatial asymmetry of the response to the left and right attention were significantly attenuated around 100-200 ms after the speech onset. These findings suggest that volatile listening environments could adversely affect the modulation effect of selective attention, possibly by hampering proper attention due to increased perceptual load.

Quantitative models of auditory cortical processing

To generate insight from experimental data, it is critical to understand the inter-relationships between individual data points and place them in context within a structured framework. Quantitative modeling can provide the scaffolding for such an endeavor. Our main objective in this review is to provide a primer on the range of quantitative tools available to experimental auditory neuroscientists. Quantitative modeling is advantageous because it can provide a compact summary of observed data, make underlying assumptions explicit, and generate predictions for future experiments. Quantitative models may be developed to characterize or fit observed data, to test theories of how a task may be solved by neural circuits, to determine how observed biophysical details might contribute to measured activity patterns, or to predict how an experimental manipulation would affect neural activity. In complexity, quantitative models can range from those that are highly biophysically realistic and that include detailed simulations at the level of individual synapses, to those that use abstract and simplified neuron models to simulate entire networks. Here, we survey the landscape of recently developed models of auditory cortical processing, highlighting a small selection of models to demonstrate how they help generate insight into the mechanisms of auditory processing. We discuss examples ranging from models that use details of synaptic properties to explain the temporal pattern of cortical responses to those that use modern deep neural networks to gain insight into human fMRI data. We conclude by discussing a biologically realistic and interpretable model that our laboratory has developed to explore aspects of vocalization categorization in the auditory pathway.

Deficiency in Re-Orienting of Attention in Adults with Attention-Deficit Hyperactivity Disorder

Objective: To characterize potential brain indexes of attention deficit hyperactivity disorder (ADHD) in adults. Methods: In an effort to develop objective, laboratory-based tests that can help to establish ADHD diagnosis, the brain indexes of distractibility was investigated in a group of adults. We used event-related brain potentials (ERPs) and performance measures in a forced-choice visual task. Results: Behaviorally aberrant distractibility in the ADHD group was significantly higher. Across three ERP components of distraction: N1 enhancement, P300 (P3a), and Reorienting Negativity (RON) the significant difference between ADHD and matched controls was found in the amplitude of the RON. We used non-parametric randomization tests, enabling us to statistically validated this difference between-group. Conclusions: Our main results of this feasibility study suggest that among other ERP components associated with auditory distraction, the RON response is promising index for a potential biomarker of deficient re-orienting of attention in adults s with ADHD.

Within- and between-subject consistency of perceptual segmentation in periodic noise: A combined behavioral tapping and EEG study

It is remarkable that human listeners can perceive periodicity in noise, as the isochronous repetition of a particular noise segment is not accompanied by salient physical cues in the acoustic signal. Previous research suggested that listeners rely on short temporally local and idiosyncratic features to perceptually segment periodic noise sequences. The present study sought to test this assumption by disentangling consistency of perceptual segmentation within and between listeners. Presented periodic noise sequences either consisted of seamless repetitions of a 500-ms segment or of repetitions of a 200-ms segment that were interleaved with 300-ms portions of random noise. Both within- and between-subject consistency was stronger for interleaved (compared with seamless) periodic sequences. The increased consistency likely resulted from reduced temporal jitter of potential features used for perceptual segmentation when the recurring segment was shorter and occurred interleaved with random noise. These results support the notion that perceptual segmentation of periodic noise relies on subtle temporally local features. However, the finding that some specific noise sequences were segmented more consistently across listeners than others challenges the assumption that the features are necessarily idiosyncratic. Instead, in some specific noise samples, a preference for certain spectral features is shared between individuals.

Auditory representations for long lasting sounds: Insights from event-related brain potentials and neural oscillations

The basic features of short sounds, such as frequency and intensity including their temporal dynamics, are integrated in a unitary representation. Knowledge on how our brain processes long lasting sounds is scarce. We review research utilizing the Mismatch Negativity event-related potential and neural oscillatory activity for studying representations for long lasting simple versus complex sounds such as sinusoidal tones versus speech. There is evidence for a temporal constraint in the formation of auditory representations: Auditory edges like sound onsets within long lasting sounds open a temporal window of about 350 ms in which the sounds' dynamics are integrated into a representation, while information beyond that window contributes less to that representation. This integration window segments the auditory input into short chunks. We argue that the representations established in adjacent integration windows can be concatenated into an auditory representation of a long sound, thus, overcoming the temporal constraint.

Sustained responses and neural synchronization to amplitude and frequency modulation in sound change with age

Perception of speech requires sensitivity to features, such as amplitude and frequency modulations, that are often temporally regular. Previous work suggests age-related changes in neural responses to temporally regular features, but little work has focused on age differences for different types of modulations. We recorded magnetoencephalography in younger (21-33 years) and older adults (53-73 years) to investigate age differences in neural responses to slow (2-6 Hz sinusoidal and non-sinusoidal) modulations in amplitude, frequency, or combined amplitude and frequency. Audiometric pure-tone average thresholds were elevated in older compared to younger adults, indicating subclinical hearing impairment in the recruited older-adult sample. Neural responses to sound onset (independent of temporal modulations) were increased in magnitude in older compared to younger adults, suggesting hyperresponsivity and a loss of inhibition in the aged auditory system. Analyses of neural activity to modulations revealed greater neural synchronization with amplitude, frequency, and combined amplitude-frequency modulations for older compared to younger adults. This potentiated response generalized across different degrees of temporal regularity (sinusoidal and non-sinusoidal), although neural synchronization was generally lower for non-sinusoidal modulation. Despite greater synchronization, sustained neural activity was reduced in older compared to younger adults for sounds modulated both sinusoidally and non-sinusoidally in frequency. Our results suggest age differences in the sensitivity of the auditory system to features present in speech and other natural sounds.

No Link Between Speech-in-Noise Perception and Auditory Sensory Memory - Evidence From a Large Cohort of Older and Younger Listeners

A growing literature is demonstrating a link between working memory (WM) and speech-in-noise (SiN) perception. However, the nature of this correlation and which components of WM might underlie it, are being debated. We investigated how SiN reception links with auditory sensory memory (aSM) - the low-level processes that support the short-term maintenance of temporally unfolding sounds. A large sample of old (N = 199, 60-79 yo) and young (N = 149, 20-35 yo) participants was recruited online and performed a coordinate response measure-based speech-in-babble task that taps listeners' ability to track a speech target in background noise. We used two tasks to investigate implicit and explicit aSM. Both were based on tone patterns overlapping in processing time scales with speech (presentation rate of tones 20 Hz; of patterns 2 Hz). We hypothesised that a link between SiN and aSM may be particularly apparent in older listeners due to age-related reduction in both SiN reception and aSM. We confirmed impaired SiN reception in the older cohort and demonstrated reduced aSM performance in those listeners. However, SiN and aSM did not share variability. Across the two age groups, SiN performance was predicted by a binaural processing test and age. The results suggest that previously observed links between WM and SiN may relate to the executive components and other cognitive demands of the used tasks. This finding helps to constrain the search for the perceptual and cognitive factors that explain individual variability in SiN performance.

Effects of iron supplementation on neural indices of habituation in Bangladeshi children

BACKGROUND

Iron deficiency and anemia have been associated with poor cognition in children, yet the effects of iron supplementation on neurocognition remain unclear.

OBJECTIVE

We aimed to examine the effects of supplementation with iron on neural indices of habituation using auditory event-related brain potentials (ERPs).

METHODS

This substudy was nested within a 3-arm, double-blind, double-dummy, individual randomized trial in Bangladesh, in which 3300 8-mo-old children were randomly selected to receive 3 mo of daily iron syrup (12.5 mg iron), multiple micronutrient powders (MNPs) (including 12.5 mg iron), or placebo. Children were assessed after 3 mo of intervention (mo 3) and 9 mo thereafter (mo 12). The neurocognitive substudy comprised a randomly selected subset of children from the main trial. Brain activity elicited during an auditory roving oddball task was recorded using electroencephalography to provide an index of habituation. The differential response to a novel (deviant) compared with a repeated (standard) sound was examined. The primary outcome was the amplitude of the mismatch response (deviant minusstandard tone waveforms) at mo 3. Secondary outcomes included the deviant and standard tone-evoked amplitudes, N2 amplitude differences, and differences in mean amplitudes evoked by deviant tones presented in the second compared with first half of the oddball sequence at mo 3 and 12.

RESULTS

Data were analyzed from 329 children at month 3 and 363 at mo 12. Analyses indicated no treatment effects of iron interventions compared with placebo on the amplitude of the mismatch response (iron syrup compared with placebo: mean difference (MD) = 0.07μV [95% CI: -1.22, 1.37]; MNPs compared with placebo: MD = 0.58μV [95% CI: -0.74, 1.90]) nor any secondary ERP outcomes at mo 3 or 12, despite improvements in hemoglobin and ferritin concentrations from iron syrup and MNPs in this nested substudy.

CONCLUSION

In Bangladeshi children with >40% anemia prevalence, iron or MNP interventions alone are insufficient to improve neural indices of habituation. This trial was registered at the Australian New Zealand Clinical Trials Registry as ACTRN12617000660381.

Processing of task-irrelevant sounds during typical everyday activities in children

Our ability to focus on a task and ignore task-irrelevant stimuli is critical for efficient cognitive functioning. Attention control is especially required in the auditory modality as sound has privileged access to perception and consciousness. Despite this important function, little is known about auditory attention during typical everyday activities in childhood. We investigated the impact of task-irrelevant sounds on attention during three everyday activities - playing a game, reading a book, watching a movie. During these activities, environmental novel sounds were presented within a sequence of standard sounds to 7-8-year-old children and adults. We measured ERPs reflecting early sound processing and attentional orienting and theta power evoked by standard and novel sounds during these activities. Playing a game versus reading or watching reduced early encoding of sounds in children and affected ongoing information processing and attention allocation in both groups. In adults, theta power was reduced during playing at mid-central brain areas. Results show a pattern of immature neuronal mechanisms underlying perception and attention of task-irrelevant sounds in 7-8-year-old children. While the type of activity affected the processing of irrelevant sounds in both groups, early stimulus encoding processes were more sensitive to the type of activities in children.

Intention-based predictive information modulates auditory deviance processing

The human brain is highly responsive to (deviant) sounds violating an auditory regularity. Respective brain responses are usually investigated in situations when the sounds were produced by the experimenter. Acknowledging that humans also actively produce sounds, the present event-related potential study tested for differences in the brain responses to deviants that were produced by the listeners by pressing one of two buttons. In one condition, deviants were unpredictable with respect to the button-sound association. In another condition, deviants were predictable with high validity yielding correctly predicted deviants and incorrectly predicted (mispredicted) deviants. Temporal principal component analysis revealed deviant-specific N1 enhancement, mismatch negativity (MMN) and P3a. N1 enhancements were highly similar for each deviant type, indicating that the underlying neural mechanism is not affected by intention-based expectation about the self-produced forthcoming sound. The MMN was abolished for predictable deviants, suggesting that the intention-based prediction for a deviant can overwrite the prediction derived from the auditory regularity (predicting a standard). The P3a was present for each deviant type but was largest for mispredicted deviants. It is argued that the processes underlying P3a not only evaluate the deviant with respect to the fact that it violates an auditory regularity but also with respect to the intended sensorial effect of an action. Overall, our results specify current theories of auditory predictive processing, as they reveal that intention-based predictions exert different effects on different deviance-specific brain responses.

Adding noise is a confounded nuisance

A wide variety of research and clinical assessments involve presenting speech stimuli in the presence of some kind of noise. Here, I selectively review two theoretical perspectives and discuss ways in which these perspectives may help researchers understand the consequences for listeners of adding noise to a speech signal. I argue that adding noise changes more about the listening task than merely making the signal more difficult to perceive. To fully understand the effects of an added noise on speech perception, we must consider not just how much the noise affects task difficulty, but also how it affects all of the systems involved in understanding speech: increasing message uncertainty, modifying attentional demand, altering affective response, and changing motivation to perform the task.

Reduced functional connectivity supports statistical learning of temporally distributed regularities

Statistical learning is a powerful ability that extracts regularities from our environment and makes predictions about future events. Using functional magnetic resonance imaging, we aimed to probe how a wide range of brain areas are intertwined to support statistical learning, characterising its architecture in the whole-brain functional connectivity (FC). Participants performed a statistical learning task of temporally distributed regularities. We used refined behavioural learning scores to associate individuals' learning performances with the FC changed by statistical learning. As a result, the learning performance was mediated by the activation strength in the lateral occipital cortex, angular gyrus, precuneus, anterior cingulate cortex, and superior frontal gyrus. Through a group independent component analysis, activations of the superior frontal network showed the largest correlation with the statistical learning performances. Seed-to-voxel whole-brain and seed-to-ROI FC analyses revealed that the FC between the superior frontal gyrus and the salience, language, and dorsal attention networks were reduced during statistical learning. We suggest that the weakened functional connections between the superior frontal gyrus and brain regions involved in top-down control processes serve a pivotal role in statistical learning, supporting better processing of novel information such as the extraction of new patterns from the environment.

Understanding Design Features of Music and Language: The Choric/Dialogic Distinction

Music and spoken language share certain characteristics: both consist of sequences of acoustic elements that are combinatorically combined, and these elements partition the same continuous acoustic dimensions (frequency, formant space and duration). However, the resulting categories differ sharply: scale tones and note durations of small integer ratios appear in music, while speech uses phonemes, lexical tone, and non-isochronous durations. Why did music and language diverge into the two systems we have today, differing in these specific features? We propose a framework based on information theory and a reverse-engineering perspective, suggesting that design features of music and language are a response to their differential deployment along three different continuous dimensions. These include the familiar propositional-aesthetic ('goal') and repetitive-novel ('novelty') dimensions, and a dialogic-choric ('interactivity') dimension that is our focus here. Specifically, we hypothesize that music exhibits specializations enhancing coherent production by several individuals concurrently-the 'choric' context. In contrast, language is specialized for exchange in tightly coordinated turn-taking-'dialogic' contexts. We examine the evidence for our framework, both from humans and non-human animals, and conclude that many proposed design features of music and language follow naturally from their use in distinct dialogic and choric communicative contexts. Furthermore, the hybrid nature of intermediate systems like poetry, chant, or solo lament follows from their deployment in the less typical interactive context.

Separate Functional Subnetworks of Excitatory Neurons Show Preference to Periodic and Random Sound Structures

Auditory cortex (ACX) neurons are sensitive to spectro-temporal sound patterns and violations in patterns induced by rare stimuli embedded within streams of sounds. We investigate the auditory cortical representation of repeated presentations of sequences of sounds with standard stimuli (common) with an embedded deviant (rare) stimulus in two conditions, Periodic (Fixed deviant position) or Random (Random deviant position). We used extracellular single-unit and two-photon Ca2+ imaging recordings in layer 2/3 neurons of the mouse (Mus musculus) ACX of either sex. Population single-unit average responses increased over repetitions in the Random condition and were suppressed or did not change in the Periodic condition, showing general irregularity preference. A subset of neurons showed the opposite behavior, indicating regularity preference. Furthermore, pairwise noise correlations were higher in the Random condition than in the Periodic condition, suggesting a role of recurrent connections in the observed differential adaptation. Functional two-photon Ca2+ imaging showed that excitatory (EX), and inhibitory (IN) neurons [parvalbumin-positive (PV) and somatostatin-positive (SOM)] also had different categories of long-term adaptation as observed with single-units. However, examination of functional connectivity between pairs of neurons of different categories showed that EX-PV connected pairs behaved opposite to the EX-EX and EX-SOM pairs, with more connections outside category in Random condition than Periodic condition. Finally, considering Regularity, Irregularity, and no preference of connected pairs of neurons showed that EX-EX and EX-SOM pairs were in largely separate functional subnetworks with different preferences, not EX-PV pairs. Thus, separate subnetworks underlie coding of periodic and random sound sequences.SIGNIFICANCE STATEMENT Studying how the auditory cortex (ACX) neurons respond to streams of sound sequences help us understand the importance of changes in dynamic acoustic noisy scenes around us. Humans and animals are sensitive to regularity and its violations in sound sequences. Psychophysical tasks in humans show that the auditory brain differentially responds to Periodic and Random structures, independent of the listener's attentional states. Here, we show that mouse ACX L2/3 neurons detect changes and respond differently to patterns over long-time scales. The differential functional connectivity profile obtained in response to two different sound contexts suggests the vital role of recurrent connections in the auditory cortical network. Furthermore, the excitatory-inhibitory neuronal interactions can contribute to detecting the changing sound patterns.

Involuntary oculomotor inhibition markers of saliency and deviance in response to auditory sequences

Our eyes move constantly but are often inhibited momentarily in response to external stimuli (oculomotor inhibition [OMI]), depending on the stimulus saliency, anticipation, and attention. Previous studies have shown prolonged OMI for auditory oddballs; however, they required counting the oddballs, possibly reflecting voluntary attention. Here, we investigated whether the “passive” OMI response to auditory deviants can provide a quantitative measure of deviance strength (pitch difference) and studied its dependence on the inter-trial interval (ITI). Participants fixated centrally and passively listened to repeated short sequences of pure tones that contained a deviant tone either regularly or with 20% probability (oddballs). In an “active” control experiment, participants counted the deviant or the standard. As in previous studies, the results showed prolonged microsaccade inhibition and increased pupil dilation following the rare deviant tone. Earlier inhibition onset was found in proportion to the pitch deviance (the saliency effect), and a later release was found for oddballs, but only for ITI <2.5 seconds. The active control experiment showed similar results when counting the deviant but longer OMI for the standard when counting it. Taken together, these results suggest that OMI provides involuntary markers of saliency and deviance, which can be obtained without the participant's response.

A Speech-Level–Based Segmented Model to Decode the Dynamic Auditory Attention States in the Competing Speaker Scenes

In the competing speaker environments, human listeners need to focus or switch their auditory attention according to dynamic intentions. The reliable cortical tracking ability to the speech envelope is an effective feature for decoding the target speech from the neural signals. Moreover, previous studies revealed that the root mean square (RMS)–level–based speech segmentation made a great contribution to the target speech perception with the modulation of sustained auditory attention. This study further investigated the effect of the RMS-level–based speech segmentation on the auditory attention decoding (AAD) performance with both sustained and switched attention in the competing speaker auditory scenes. Objective biomarkers derived from the cortical activities were also developed to index the dynamic auditory attention states. In the current study, subjects were asked to concentrate or switch their attention between two competing speaker streams. The neural responses to the higher- and lower-RMS-level speech segments were analyzed via the linear temporal response function (TRF) before and after the attention switching from one to the other speaker stream. Furthermore, the AAD performance decoded by the unified TRF decoding model was compared to that by the speech-RMS-level–based segmented decoding model with the dynamic change of the auditory attention states. The results showed that the weight of the typical TRF component approximately 100-ms time lag was sensitive to the switching of the auditory attention. Compared to the unified AAD model, the segmented AAD model improved attention decoding performance under both the sustained and switched auditory attention modulations in a wide range of signal-to-masker ratios (SMRs). In the competing speaker scenes, the TRF weight and AAD accuracy could be used as effective indicators to detect the changes of the auditory attention. In addition, with a wide range of SMRs (i.e., from 6 to –6 dB in this study), the segmented AAD model showed the robust decoding performance even with short decision window length, suggesting that this speech-RMS-level–based model has the potential to decode dynamic attention states in the realistic auditory scenarios.

Hearing in Complex Environments: Auditory Gain Control, Attention, and Hearing Loss

Listening in noisy or complex sound environments is difficult for individuals with normal hearing and can be a debilitating impairment for those with hearing loss. Extracting meaningful information from a complex acoustic environment requires the ability to accurately encode specific sound features under highly variable listening conditions and segregate distinct sound streams from multiple overlapping sources. The auditory system employs a variety of mechanisms to achieve this auditory scene analysis. First, neurons across levels of the auditory system exhibit compensatory adaptations to their gain and dynamic range in response to prevailing sound stimulus statistics in the environment. These adaptations allow for robust representations of sound features that are to a large degree invariant to the level of background noise. Second, listeners can selectively attend to a desired sound target in an environment with multiple sound sources. This selective auditory attention is another form of sensory gain control, enhancing the representation of an attended sound source while suppressing responses to unattended sounds. This review will examine both “bottom-up” gain alterations in response to changes in environmental sound statistics as well as “top-down” mechanisms that allow for selective extraction of specific sound features in a complex auditory scene. Finally, we will discuss how hearing loss interacts with these gain control mechanisms, and the adaptive and/or maladaptive perceptual consequences of this plasticity.

The effect of background speech on attentive sound processing: A pupil dilation study

Listening to task-irrelevant speech while performing a cognitive task can involuntarily deviate our attention and lead to decreases in performance. One explanation for the impairing effect of irrelevant speech is that semantic processing can consume attentional resources. In the present study, we tested this assumption by measuring performance in a non-linguistic attentional task while participants were exposed to meaningful (native) and non-meaningful (foreign) speech. Moreover, based on the tight relation between pupillometry and attentional processes, we also registered changes in pupil diameter size to quantify the effect of meaningfulness upon attentional allocation. To these aims, we recruited 41 native German speakers who had neither received formal instruction in French nor had extensive informal contact with this language. The focal task consisted of an auditory oddball task. Participants performed a duration discrimination task containing frequently repeated standard sounds and rarely presented deviant sounds while a story was read in German or (non-meaningful) French in the background. Our results revealed that, whereas effects of language meaningfulness on attention were not detectable at the behavioural level, participants' pupil dilated more in response to the sounds of the auditory task when background speech was played in non-meaningful French compared to German, independent of sound type. In line with the initial hypothesis, this suggested that semantic processing of the native language required attentional resources, which lead to fewer resources devoted to the processing of the sounds of the focal task. Our results highlight the potential of the pupil dilation response for the investigation of subtle cognitive processes that might not surface when only behaviour is measured.

Expectations of the timing and intensity of a stimulus propagate to the auditory periphery through the medial olivocochlear reflex

Expectations concerning the timing of a stimulus enhance attention at the time at which the event occurs, which confers significant sensory and behavioral benefits. Herein, we show that temporal expectations modulate even the sensory transduction in the auditory periphery via the descending pathway. We measured the medial olivocochlear reflex (MOCR), a sound-activated efferent feedback that controls outer hair cell motility and optimizes the dynamic range of the sensory system. MOCR was noninvasively assessed using otoacoustic emissions. We found that the MOCR was enhanced by a visual cue presented at a fixed interval before a sound but was unaffected if the interval was changing between trials. The MOCR was also observed to be stronger when the learned timing expectation matched with the timing of the sound but remained unvaried when these two factors did not match. This implies that the MOCR can be voluntarily controlled in a stimulus- and goal-directed manner. Moreover, we found that the MOCR was enhanced by the expectation of a strong but not a weak, sound intensity. This asymmetrical enhancement could facilitate antimasking and noise protective effects without disrupting the detection of faint signals. Therefore, the descending pathway conveys temporal and intensity expectations to modulate auditory processing.

Hyper-Sensitivity to Pitch and Poorer Prosody Processing in Adults With Autism: An ERP Study

Individuals with autism typically experience a range of symptoms, including abnormal sensory sensitivities. However, there are conflicting reports on the sensory profiles that characterize the sensory experience in autism that often depend on the type of stimulus. Here, we examine early auditory processing to simple changes in pitch and later auditory processing of more complex emotional utterances. We measured electroencephalography in 24 adults with autism and 28 controls. First, tones (1046.5Hz/C6, 1108.7Hz/C#6, or 1244.5Hz/D#6) were repeated three times or nine times before the pitch changed. Second, utterances of delight or frustration were repeated three or six times before the emotion changed. In response to the simple pitched tones, the autism group exhibited larger mismatch negativity (MMN) after nine standards compared to controls and produced greater trial-to-trial variability (TTV). In response to the prosodic utterances, the autism group showed smaller P3 responses when delight changed to frustration compared to controls. There was no significant correlation between ERPs to pitch and ERPs to prosody. Together, this suggests that early auditory processing is hyper-sensitive in autism whereas later processing of prosodic information is hypo-sensitive. The impact the different sensory profiles have on perceptual experience in autism may be key to identifying behavioral treatments to reduce symptoms.

Predictability-Based Source Segregation and Sensory Deviance Detection in Auditory Aging

When multiple sound sources are present at the same time, auditory perception is often challenged with disentangling the resulting mixture and focusing attention on the target source. It has been repeatedly demonstrated that background (distractor) sound sources are easier to ignore when their spectrotemporal signature is predictable. Prior evidence suggests that this ability to exploit predictability for foreground-background segregation degrades with age. On a theoretical level, this has been related with an impairment in elderly adults’ capabilities to detect certain types of sensory deviance in unattended sound sequences. Yet the link between those two capacities, deviance detection and predictability-based sound source segregation, has not been empirically demonstrated. Here we report on a combined behavioral-EEG study investigating the ability of elderly listeners (60–75 years of age) to use predictability as a cue for sound source segregation, as well as their sensory deviance detection capacities. Listeners performed a detection task on a target stream that can only be solved when a concurrent distractor stream is successfully ignored. We contrast two conditions whose distractor streams differ in their predictability. The ability to benefit from predictability was operationalized as performance difference between the two conditions. Results show that elderly listeners can use predictability for sound source segregation at group level, yet with a high degree of inter-individual variation in this ability. In a further, passive-listening control condition, we measured correlates of deviance detection in the event-related brain potential (ERP) elicited by occasional deviations from the same spectrotemporal pattern as used for the predictable distractor sequence during the behavioral task. ERP results confirmed neural signatures of deviance detection in terms of mismatch negativity (MMN) at group level. Correlation analyses at single-subject level provide no evidence for the hypothesis that deviance detection ability (measured by MMN amplitude) is related to the ability to benefit from predictability for sound source segregation. These results are discussed in the frameworks of sensory deviance detection and predictive coding.

Tablet PC use directly affects children's perception and attention

Children currently grow up with a marked increase in interactive digital mobile media. To what extent digital media directly modulate children’s perception and attention is largely unknown. We investigated the processing of task-irrelevant auditory information while 37 children aged 6;8–9;1-years played the identical card game on a tablet PC or with the experimenter in reality. The sound sequence included repeated standard sounds and occasionally novel sounds. Event-related potentials in the EEG, that reflect sound-related processes of perception and attention, were measured. Sounds evoked increased amplitudes of the ERP components P1, P2 and P3a during the interaction with the tablet PC compared to the human interaction. This indicates enhanced early processing of task-irrelevant information and increased allocation of attention to sounds throughout the interaction with a tablet PC compared to a human partner. Results suggest direct effects of typical situations, where children interact with a tablet PC, on neuronal mechanisms that drive perception and attention in the developing brain. More research into this phenomena is required to make specific suggestions for developing digital interactive learning programs.

An ecological approach to measuring synchronization abilities across the animal kingdom

In this perspective paper, we focus on the study of synchronization abilities across the animal kingdom. We propose an ecological approach to studying nonhuman animal synchronization that begins from observations about when, how and why an animal might synchronize spontaneously with natural environmental rhythms. We discuss what we consider to be the most important, but thus far largely understudied, temporal, physical, perceptual and motivational constraints that must be taken into account when designing experiments to test synchronization in nonhuman animals. First and foremost, different species are likely to be sensitive to and therefore capable of synchronizing at different timescales. We also argue that it is fruitful to consider the latent flexibility of animal synchronization. Finally, we discuss the importance of an animal's motivational state for showcasing synchronization abilities. We demonstrate that the likelihood that an animal can successfully synchronize with an environmental rhythm is context-dependent and suggest that the list of species capable of synchronization is likely to grow when tested with ecologically honest, species-tuned experiments.

This article is part of the theme issue ‘Synchrony and rhythm interaction: from the brain to behavioural ecology’.

Brain Structural and Functional Connectivity: A Review of Combined Works of Diffusion Magnetic Resonance Imaging and Electro-Encephalography

Implications of structural connections within and between brain regions for their functional counterpart are timely points of discussion. White matter microstructural organization and functional activity can be assessed in unison. At first glance, however, the corresponding findings appear variable, both in the healthy brain and in numerous neuro-pathologies. To identify consistent associations between structural and functional connectivity and possible impacts for the clinic, we reviewed the literature of combined recordings of electro-encephalography (EEG) and diffusion-based magnetic resonance imaging (MRI). It appears that the strength of event-related EEG activity increases with increased integrity of structural connectivity, while latency drops. This agrees with a simple mechanistic perspective: the nature of microstructural white matter influences the transfer of activity. The EEG, however, is often assessed for its spectral content. Spectral power shows associations with structural connectivity that can be negative or positive often dependent on the frequencies under study. Functional connectivity shows even more variations, which are difficult to rank. This might be caused by the diversity of paradigms being investigated, from sleep and resting state to cognitive and motor tasks, from healthy participants to patients. More challenging, though, is the potential dependency of findings on the kind of analysis applied. While this does not diminish the principal capacity of EEG and diffusion-based MRI co-registration, it highlights the urgency to standardize especially EEG analysis.

Intention-based and sensory-based predictions

We inhabit a continuously changing world, where the ability to anticipate future states of the environment is critical for adaptation. Anticipation can be achieved by learning about the causal or temporal relationship between sensory events, as well as by learning to act on the environment to produce an intended effect. Together, sensory-based and intention-based predictions provide the flexibility needed to successfully adapt. Yet it is currently unknown whether the two sources of information are processed independently to form separate predictions, or are combined into a common prediction. To investigate this, we ran an experiment in which the final tone of two possible four-tone sequences could be predicted from the preceding tones in the sequence and/or from the participants' intention to trigger that final tone. This tone could be congruent with both sensory-based and intention-based predictions, incongruent with both, or congruent with one while incongruent with the other. Trials where predictions were incongruent with each other yielded similar prediction error responses irrespectively of the violated prediction, indicating that both predictions were formulated and coexisted simultaneously. The violation of intention-based predictions yielded late additional error responses, suggesting that those violations underwent further differential processing which the violations of sensory-based predictions did not receive.

Distinct timescales for the neuronal encoding of vocal signals in a high-order auditory area

The ability of the auditory system to selectively recognize natural sound categories while maintaining a certain degree of tolerance towards variations within these categories, which may have functional roles, is thought to be crucial for vocal communication. To date, it is still largely unknown how the balance between tolerance and sensitivity to variations in acoustic signals is coded at a neuronal level. Here, we investigate whether neurons in a high-order auditory area in zebra finches, a songbird species, are sensitive to natural variations in vocal signals by recording their responses to repeated exposures to identical and variant sound sequences. We used the songs of male birds which tend to be highly repetitive with only subtle variations between renditions. When playing these songs to both anesthetized and awake birds, we found that variations between songs did not affect the neuron firing rate but the temporal reliability of responses. This suggests that auditory processing operates on a range of distinct timescales, namely a short one to detect variations in vocal signals, and longer ones that allow the birds to tolerate variations in vocal signal structure and to encode the global context.

Talker discontinuity disrupts attention to speech: Evidence from EEG and pupillometry

Speech is processed less efficiently from discontinuous, mixed talkers than one consistent talker, but little is known about the neural mechanisms for processing talker variability. Here, we measured psychophysiological responses to talker variability using electroencephalography (EEG) and pupillometry while listeners performed a delayed recall of digit span task. Listeners heard and recalled seven-digit sequences with both talker (single- vs. mixed-talker digits) and temporal (0- vs. 500-ms inter-digit intervals) discontinuities. Talker discontinuity reduced serial recall accuracy. Both talker and temporal discontinuities elicited P3a-like neural evoked response, while rapid processing of mixed-talkers' speech led to increased phasic pupil dilation. Furthermore, mixed-talkers' speech produced less alpha oscillatory power during working memory maintenance, but not during speech encoding. Overall, these results are consistent with an auditory attention and streaming framework in which talker discontinuity leads to involuntary, stimulus-driven attentional reorientation to novel speech sources, resulting in the processing interference classically associated with talker variability.

Pragmatic Prediction in the Processing of Referring Expressions Containing Scalar Quantifiers

Previous research in cognitive science and psycholinguistics has shown that language users are able to predict upcoming linguistic input probabilistically, pre-activating material on the basis of cues emerging from different levels of linguistic abstraction, from phonology to semantics. Current evidence suggests that linguistic prediction also operates at the level of pragmatics, where processing is strongly constrained by context. To test a specific theory of contextually-constrained processing, termed pragmatic surprisal theory here, we used a self-paced reading task where participants were asked to view visual scenes and then read descriptions of those same scenes. Crucially, we manipulated whether the visual context biased readers into specific pragmatic expectations about how the description might unfold word by word. Contrary to the predictions of pragmatic surprisal theory, we found that participants took longer reading the main critical term in scenarios where they were biased by context and pragmatic constraints to expect a given word, as opposed to scenarios where there was no pragmatic expectation for any particular referent.

A neural signature of regularity in sound is reduced in older adults

Sensitivity to repetitions in sound amplitude and frequency is crucial for sound perception. As with other aspects of sound processing, sensitivity to such patterns may change with age, and may help explain some age-related changes in hearing such as segregating speech from background sound. We recorded magnetoencephalography to characterize differences in the processing of sound patterns between younger and older adults. We presented tone sequences that either contained a pattern (made of a repeated set of tones) or did not contain a pattern. We show that auditory cortex in older, compared to younger, adults is hyperresponsive to sound onsets, but that sustained neural activity in auditory cortex, indexing the processing of a sound pattern, is reduced. Hence, the sensitivity of neural populations in auditory cortex fundamentally differs between younger and older individuals, overresponding to sound onsets, while underresponding to patterns in sounds. This may help to explain some age-related changes in hearing such as increased sensitivity to distracting sounds and difficulties tracking speech in the presence of other sound.

The Relationship Between Tinnitus Pitch, Audiogram Edge Frequency, and Auditory Stream Segregation Abilities in Individuals With Tinnitus

Purpose Around 80%-93% of the individuals with tinnitus have hearing loss. Researchers have found that tinnitus pitch was related to the frequencies of hearing loss, but unclear about the relationship between tinnitus pitch and audiometry edge frequency. The comorbidity of tinnitus and speech perception in noise problems had also been reported, but the relationship between tinnitus pitch and speech perception in noise had seldom been investigated. This study was designed to estimate the relationship between tinnitus pitch, audiogram edge frequency, and speech perception in noise. The speech perception in noise was measured using auditory stream segregation paradigm. Method Thirteen individuals with bilateral mild-to-severe tonal tinnitus and minimal-to-mild cochlear hearing loss were selected. Thirteen individuals with hearing loss without tinnitus were also selected. The audiogram of each participant with tinnitus was matched with that of the participant without tinnitus. Tinnitus pitch of the participants with tinnitus was measured and compared with audiogram edge frequency. The stream segregation thresholds were calculated at the participants' admitted tinnitus pitch and one octave below the tinnitus pitch. The stream segregation thresholds were estimated at fission and fusion boundary using pure-tone stimuli in ABA paradigm. Results High correlation between tinnitus pitch and audiogram edge frequency was noted. Overall stream segregation thresholds were higher for individuals with tinnitus. Higher thresholds indicated poorer stream segregation abilities. Within tinnitus participants, the thresholds were significantly lesser at frequency corresponding to admitted tinnitus pitch than at one octave below the tinnitus pitch. Conclusions The information from this study may be helpful in educating the patients about the relationship between hearing loss and tinnitus. The findings may also account for speech-perception-in-noise difficulties often reported by the individuals with tinnitus.