Prestimulus influences on auditory perception from sensory representations and decision processes

Beyond alpha band: prestimulus local oscillation and interregional synchrony of the beta band shape the temporal perception of the audiovisual beep-flash stimulus

Objective.Multisensory integration is more likely to occur if the multimodal inputs are within a narrow temporal window called temporal binding window (TBW). Prestimulus local neural oscillations and interregional synchrony within sensory areas can modulate cross-modal integration. Previous work has examined the role of ongoing neural oscillations in audiovisual temporal integration, but there is no unified conclusion. This study aimed to explore whether local ongoing neural oscillations and interregional audiovisual synchrony modulate audiovisual temporal integration.Approach.The human participants performed a simultaneity judgment (SJ) task with the beep-flash stimuli while recording electroencephalography. We focused on two stimulus onset asynchrony (SOA) conditions where subjects report ∼50% proportion of synchronous responses in auditory- and visual-leading SOA (A50V and V50A).Main results.We found that the alpha band power is larger in synchronous response in the central-right posterior and posterior sensors in A50V and V50A conditions, respectively. The results suggested that the alpha band power reflects neuronal excitability in the auditory or visual cortex, which can modulate audiovisual temporal perception depending on the leading sense. Additionally, the SJs were modulated by the opposite phases of alpha (5-10 Hz) and low beta (14-20 Hz) bands in the A50V condition while the low beta band (14-18 Hz) in the V50A condition. One cycle of alpha or two cycles of beta oscillations matched an auditory-leading TBW of ∼86 ms, while two cycles of beta oscillations matched a visual-leading TBW of ∼105 ms. This result indicated the opposite phases in the alpha and beta bands reflect opposite cortical excitability, which modulated the audiovisual SJs. Finally, we found stronger high beta (21-28 Hz) audiovisual phase synchronization for synchronous response in the A50V condition. The phase synchrony of the beta band might be related to maintaining information flow between visual and auditory regions in a top-down manner.Significance.These results clarified whether and how the prestimulus brain state, including local neural oscillations and functional connectivity between brain regions, affects audiovisual temporal integration.

Phase-dependent word perception emerges from region-specific sensitivity to the statistics of language

Neural oscillations reflect fluctuations in excitability, which biases the percept of ambiguous sensory input. Why this bias occurs is still not fully understood. We hypothesized that neural populations representing likely events are more sensitive, and thereby become active on earlier oscillatory phases, when the ensemble itself is less excitable. Perception of ambiguous input presented during less-excitable phases should therefore be biased toward frequent or predictable stimuli that have lower activation thresholds. Here, we show such a frequency bias in spoken word recognition using psychophysics, magnetoencephalography (MEG), and computational modelling. With MEG, we found a double dissociation, where the phase of oscillations in the superior temporal gyrus and medial temporal gyrus biased word-identification behavior based on phoneme and lexical frequencies, respectively. This finding was reproduced in a computational model. These results demonstrate that oscillations provide a temporal ordering of neural activity based on the sensitivity of separable neural populations.

Just a phase? Causal probing reveals spurious phasic dependence of sustained attention

For over a decade, electrophysiological studies have reported correlations between attention / perception and the phase of spontaneous brain oscillations. To date, these findings have been interpreted as evidence that the brain uses neural oscillations to sample and predict upcoming stimuli. Yet, evidence from simulations have shown that analysis artefacts could also lead to spurious pre-stimulus oscillations that appear to predict future brain responses. To address this discrepancy, we conducted an experiment in which visual stimuli were presented in time to specific phases of spontaneous alpha and theta oscillations. This allowed us to causally probe the role of ongoing neural activity in visual processing independent of the stimulus-evoked dynamics. Our findings did not support a causal link between spontaneous alpha / theta rhythms and behaviour. However, spurious correlations between theta phase and behaviour emerged offline using gold-standard time-frequency analyses. These findings are a reminder that care should be taken when inferring causal relationships between neural activity and behaviour using acausal analysis methods.

Interdependence of "What" and "When" in the Brain

From a brain's-eye-view, when a stimulus occurs and what it is are interrelated aspects of interpreting the perceptual world. Yet in practice, the putative perceptual inferences about sensory content and timing are often dichotomized and not investigated as an integrated process. We here argue that neural temporal dynamics can influence what is perceived, and in turn, stimulus content can influence the time at which perception is achieved. This computational principle results from the highly interdependent relationship of what and when in the environment. Both brain processes and perceptual events display strong temporal variability that is not always modeled; we argue that understanding-and, minimally, modeling-this temporal variability is key for theories of how the brain generates unified and consistent neural representations and that we ignore temporal variability in our analysis practice at the peril of both data interpretation and theory-building. Here, we review what and when interactions in the brain, demonstrate via simulations how temporal variability can result in misguided interpretations and conclusions, and outline how to integrate and synthesize what and when in theories and models of brain computation.

The Influence of Prestimulus 1/f-Like versus Alpha-Band Activity on Subjective Awareness of Auditory and Visual Stimuli

Alpha rhythmic activity is often suggested to exert an inhibitory influence on information processing. However, relatively little is known about how reported alpha-related effects are influenced by a potential confounding element of the neural signal, power-law scaling. In the current study, we systematically examine the effect of accounting for 1/f activity on the relation between prestimulus alpha power and human behavior during both auditory and visual detection (N = 27; 19 female, 6 male, 2 nonbinary). The results suggest that, at least in the scalp-recorded EEG signal, the difference in alpha power often reported before visual hits versus misses is probably best thought of as a combination of narrowband alpha and broadband shifts. That is, changes in broadband parameters (exponent and offset of 1/f-like activity) also appear to be strong predictors of the subsequent awareness of visual stimuli. Neither changes in posterior alpha power nor changes in 1/f-like activity reliably predicted detection of auditory stimuli. These results appear consistent with suggestions that broadband changes in the scalp-recorded EEG signal may account for a portion of prior results linking alpha band dynamics to visuospatial attention and behavior, and suggest that systematic re-examination of existing data may be warranted.Significance Statement Fluctuations in alpha band (∼8-12 Hz) activity systematically follow the allocation of attention across space and sensory modality. Increases in alpha amplitude, which often precede failures to report awareness of threshold visual stimuli, are suggested to exert an inhibitory influence on information processing. However, fluctuations in alpha activity are often confounded with changes in the broadband 1/f-like pattern of the neural signal. When both factors are considered, we find that changes in broadband activity are as effective as narrowband alpha activity as predictors of subsequent visual detection. These results are consistent with emerging understanding of the potential functional importance of broadband changes in the neural signal and may have significant consequences for our understanding of alpha rhythmic activity.

Pre-stimulus alpha activity modulates long-lasting unconscious feature integration

Pre-stimulus alpha (α) activity can influence perception of shortly presented, low-contrast stimuli. The underlying mechanisms are often thought to affect perception exactly at the time of presentation. In addition, it is suggested that α cycles determine temporal windows of integration. However, in everyday situations, stimuli are usually presented for periods longer than ∼100 ms and perception is often an integration of information across space and time. Moving objects are just one example. Hence, the question is whether α activity plays a role also in temporal integration, especially when stimuli are integrated over several α cycles. Using electroencephalography (EEG), we investigated the relationship between pre-stimulus brain activity and long-lasting integration in the sequential metacontrast paradigm (SQM), where two opposite vernier offsets, embedded in a stream of lines, are unconsciously integrated into a single percept. We show that increases in α power, even 300 ms before the stimulus, affected the probability of reporting the first offset, shown at the very beginning of the SQM. This effect was mediated by the systematic slowing of the α rhythm that followed the peak in α power. No phase effects were found. Together, our results demonstrate a cascade of neural changes, following spontaneous bursts of α activity and extending beyond a single moment, which influences the sensory representation of visual features for hundreds of milliseconds. Crucially, as feature integration in the SQM occurs before a conscious percept is elicited, this also provides evidence that α activity is linked to mechanisms regulating unconscious processing.

Prestimulus amygdala spectral activity is associated with visual face awareness

Alpha cortical oscillations have been proposed to suppress sensory processing in the visual, auditory, and tactile domains, influencing conscious stimulus perception. However, it is unknown whether oscillatory neural activity in the amygdala, a subcortical structure involved in salience detection, has a similar impact on stimulus awareness. Recording intracranial electroencephalography (EEG) from 9 human amygdalae during face detection in a continuous flash suppression task, we found increased spectral prestimulus power and phase coherence, with most consistent effects in the alpha band, when faces were undetected relative to detected, similarly as previously observed in cortex with this task using scalp-EEG. Moreover, selective decreases in the alpha and gamma bands preceded face detection, with individual prestimulus alpha power correlating negatively with detection rate in patients. These findings reveal for the first time that prestimulus subcortical oscillations localized in human amygdala may contribute to perceptual gating mechanisms governing subsequent face detection and offer promising insights on the role of this structure in visual awareness.

The influence of the respiratory cycle on reaction times in sensory-cognitive paradigms

Behavioural and electrophysiological studies point to an apparent influence of the state of respiration, i.e., whether we inhale or exhale, on brain activity and cognitive performance. Still, the prevalence and relevance of such respiratory-behavioural relations in typical sensory-cognitive tasks remain unclear. We here used a battery of six tasks probing sensory detection, discrimination and short-term memory to address the questions of whether and by how much behaviour covaries with the respiratory cycle. Our results show that participants tend to align their respiratory cycle to the experimental paradigm, in that they tend to inhale around stimulus presentation and exhale when submitting their responses. Furthermore, their reaction times, but not so much their response accuracy, consistently and significantly covary with the respiratory cycle, differing between inhalation and exhalation. This effect is strongest when analysed contingent on the respiratory state around participants' responses. The respective effect sizes of these respiration-behaviour relations are comparable to those seen in other typical experimental manipulations in sensory-cognitive tasks, highlighting the relevance of these effects. Overall, our results support a prominent relation between respiration and sensory-cognitive function and show that sensation is intricately linked to rhythmic bodily or interoceptive functions.

Cell type-specific excitability probed by optogenetic stimulation depends on the phase of the alpha oscillation

BACKGROUND

Alpha oscillations have been proposed to provide phasic inhibition in the brain. Yet, pinging alpha oscillations with transcranial magnetic stimulation (TMS) to examine phase-dependent network excitability has resulted in conflicting findings. At the cellular level, such gating by the alpha oscillation remains poorly understood.

OBJECTIVE

We examine how the excitability of pyramidal cells and presumed fast-spiking inhibitory interneurons depends on the phase of the alpha oscillation.

METHODS

Optogenetic stimulation pulses were administered at random phases of the alpha oscillation in the posterior parietal cortex (PPC) of two adult ferrets that expressed channelrhodopsin in pyramidal cells. Post-stimulation firing probability was calculated as a function of the stimulation phase of the alpha oscillation for both verum and sham stimulation.

RESULTS

The excitability of pyramidal cells depended on the alpha phase, in anticorrelation with their intrinsic phase preference; pyramidal cells were more responsive to optogenetic stimulation at the alpha phase with intrinsically low firing rates. In contrast, presumed fast-spiking inhibitory interneurons did not show such a phase dependency despite their stronger intrinsic phase preference.

CONCLUSIONS

Alpha oscillations gate input to PPC in a phase-dependent manner such that low intrinsic activity was associated with higher responsiveness to input. This finding supports a model of cortical oscillation, in which internal processing and communication are limited to the depolarized half-cycle, whereas the other half-cycle serves as a signal detector for unexpected input. The functional role of different parts of the alpha cycle may vary across the cortex depending on local neuronal firing properties.

Connectomics of human electrophysiology

We present both a scientific overview and conceptual positions concerning the challenges and assets of electrophysiological measurements in the search for the nature and functions of the human connectome. We discuss how the field has been inspired by findings and approaches from functional magnetic resonance imaging (fMRI) and informed by a small number of significant multimodal empirical studies, which show that the canonical networks that are commonplace in fMRI are in fact rooted in electrophysiological processes. This review is also an opportunity to produce a brief, up-to-date critical survey of current data modalities and analytical methods available for deriving both static and dynamic connectomes from electrophysiology. We review hurdles that challenge the significance and impact of current electrophysiology connectome research. We then encourage the field to take a leap of faith and embrace the wealth of electrophysiological signals, despite their apparent, disconcerting complexity. Our position is that electrophysiology connectomics is poised to inform testable mechanistic models of information integration in hierarchical brain networks, constructed from observable oscillatory and aperiodic signal components and their polyrhythmic interactions.

Ongoing neural oscillations influence behavior and sensory representations by suppressing neuronal excitability

The ability to process and respond to external input is critical for adaptive behavior. Why, then, do neural and behavioral responses vary across repeated presentations of the same sensory input? Ongoing fluctuations of neuronal excitability are currently hypothesized to underlie the trial-by-trial variability in sensory processing. To test this, we capitalized on intracranial electrophysiology in neurosurgical patients performing an auditory discrimination task with visual cues: specifically, we examined the interaction between prestimulus alpha oscillations, excitability, task performance, and decoded neural stimulus representations. We found that strong prestimulus oscillations in the alpha+ band (i.e., alpha and neighboring frequencies), rather than the aperiodic signal, correlated with a low excitability state, indexed by reduced broadband high-frequency activity. This state was related to slower reaction times and reduced neural stimulus encoding strength. We propose that the alpha+ rhythm modulates excitability, thereby resulting in variability in behavior and sensory representations despite identical input.

Preparatory delta phase response is correlated with naturalistic speech comprehension performance

While human speech comprehension is thought to be an active process that involves top-down predictions, it remains unclear how predictive information is used to prepare for the processing of upcoming speech information. We aimed to identify the neural signatures of the preparatory processing of upcoming speech. Participants selectively attended to one of two competing naturalistic, narrative speech streams, and a temporal response function (TRF) method was applied to derive event-related-like neural responses from electroencephalographic data. The phase responses to the attended speech at the delta band (1-4 Hz) were correlated with the comprehension performance of individual participants, with a latency of - 200-0 ms relative to the onset of speech amplitude envelope fluctuations over the fronto-central and left-lateralized parietal electrodes. The phase responses to the attended speech at the alpha band also correlated with comprehension performance but with a latency of 650-980 ms post-onset over the fronto-central electrodes. Distinct neural signatures were found for the attentional modulation, taking the form of TRF-based amplitude responses at a latency of 240-320 ms post-onset over the left-lateralized fronto-central and occipital electrodes. Our findings reveal how the brain gets prepared to process an upcoming speech in a continuous, naturalistic speech context.

An oscillating computational model can track pseudo-rhythmic speech by using linguistic predictions

Neuronal oscillations putatively track speech in order to optimize sensory processing. However, it is unclear how isochronous brain oscillations can track pseudo-rhythmic speech input. Here we propose that oscillations can track pseudo-rhythmic speech when considering that speech time is dependent on content-based predictions flowing from internal language models. We show that temporal dynamics of speech are dependent on the predictability of words in a sentence. A computational model including oscillations, feedback, and inhibition is able to track pseudo-rhythmic speech input. As the model processes, it generates temporal phase codes, which are a candidate mechanism for carrying information forward in time. The model is optimally sensitive to the natural temporal speech dynamics and can explain empirical data on temporal speech illusions. Our results suggest that speech tracking does not have to rely only on the acoustics but could also exploit ongoing interactions between oscillations and constraints flowing from internal language models.

Dynamic relationships between spontaneous and evoked electrophysiological activity

Spontaneous neural activity fluctuations have been shown to influence trial-by-trial variation in perceptual, cognitive, and behavioral outcomes. However, the complex electrophysiological mechanisms by which these fluctuations shape stimulus-evoked neural activity remain largely to be explored. Employing a large-scale magnetoencephalographic dataset and an electroencephalographic replication dataset, we investigate the relationship between spontaneous and evoked neural activity across a range of electrophysiological variables. We observe that for high-frequency activity, high pre-stimulus amplitudes lead to greater evoked desynchronization, while for low frequencies, high pre-stimulus amplitudes induce larger degrees of event-related synchronization. We further decompose electrophysiological power into oscillatory and scale-free components, demonstrating different patterns of spontaneous-evoked correlation for each component. Finally, we find correlations between spontaneous and evoked time-domain electrophysiological signals. Overall, we demonstrate that the dynamics of multiple electrophysiological variables exhibit distinct relationships between their spontaneous and evoked activity, a result which carries implications for experimental design and analysis in non-invasive electrophysiology.

Delta/theta band EEG differentially tracks low and high frequency speech-derived envelopes

The representation of speech in the brain is often examined by measuring the alignment of rhythmic brain activity to the speech envelope. To conveniently quantify this alignment (termed 'speech tracking') many studies consider the broadband speech envelope, which combines acoustic fluctuations across the spectral range. Using EEG recordings, we show that using this broadband envelope can provide a distorted picture on speech encoding. We systematically investigated the encoding of spectrally-limited speech-derived envelopes presented by individual and multiple noise carriers in the human brain. Tracking in the 1 to 6 Hz EEG bands differentially reflected low (0.2 - 0.83 kHz) and high (2.66 - 8 kHz) frequency speech-derived envelopes. This was independent of the specific carrier frequency but sensitive to attentional manipulations, and may reflect the context-dependent emphasis of information from distinct spectral ranges of the speech envelope in low frequency brain activity. As low and high frequency speech envelopes relate to distinct phonemic features, our results suggest that functionally distinct processes contribute to speech tracking in the same EEG bands, and are easily confounded when considering the broadband speech envelope.

Coupling between the phase of a neural oscillation or bodily rhythm with behavior: Evaluation of different statistical procedures

•

Circular tests are differentially sensitive to different coupling modes.

•

The Watson test is a good all-rounder method.

•

Phase Opposition Sum is robust to imbalances in relative trial number.

•

Modulation Index detects more complex phase-behavior relationships.

Growing experimental evidence points at relationships between the phase of a cortical or bodily oscillation and behavior, using various circular statistical tests. Here, we systematically compare the performance (sensitivity, False Positive rate) of four circular statistical tests (some commonly used, i.e. Phase Opposition Sum, Circular Logistic Regression, others less common, i.e., Watson test, Modulation Index). We created semi-artificial datasets mimicking real two-alternative forced choice experiments with 30 participants, where we imposed a link between a simulated binary behavioral outcome with the phase of a physiological oscillation. We systematically varied the strength of phase-outcome coupling, the coupling mode (1:1 to 4:1), the overall number of trials and the relative number of trials in the two outcome conditions. We evaluated different strategies to estimate phase-outcome coupling chance level, as well as significance at the individual or group level. The results show that the Watson test, although seldom used in the experimental literature, is an excellent first intention test, with a good sensitivity and low False Positive rate, some sensitivity to 2:1 coupling mode and low computational load. Modulation Index, initially designed for continuous variables but that we find useful to estimate coupling between phase and a binary outcome, should be preferred if coupling mode is higher than 2:1. Phase Opposition Sum, coupled with a resampling procedure, is the only test retaining a good sensitivity in the case of a large unbalance in the number of occurrences of the two behavioral outcomes.

Associations between pre-stimulus alpha power, hearing level and performance in a digits-in-noise task

OBJECTIVE

Baseline electroencephalography (EEG) alpha power, i.e. that measured prior to stimulus presentation, is a potential objective predictor of task performance. Here we assessed the predictive power of EEG alpha on performance accuracy in a digits-in-noise recognition task, factoring in hearing thresholds and age.

DESIGN

EEG alpha power, recorded while participants listened to target digits presented in a noise background, was analysed during two different baseline periods: i) a pre-stimulus baseline (pre-STIM) free from any acoustic stimulus, and ii) a pre-target baseline (pre-TARG) recorded in background noise only.

STUDY SAMPLE

Eighty-five participants with either normal hearing or aided hearing impairment (age range: 55-85 years old, 42 male).

RESULTS

Hierarchical multiple regression analyses indicated that i) lower hearing thresholds and, to a lesser extent, higher pre-STIM alpha power were associated with improved performance accuracy ii) alpha power in pre-STIM and pre-TARG were highly correlated across individuals but pre-TARG alpha power was not a significant predictor of performance accuracy.

CONCLUSION

Investigations of baseline EEG alpha power as a predictor of speech-in-noise performance accuracy should control for associations between hearing thresholds and measures of EEG baseline periods.

The Neurophysiological Basis of the Trial-Wise and Cumulative Ventriloquism Aftereffects

Our senses often receive conflicting multisensory information, which our brain reconciles by adaptive recalibration. A classic example is the ventriloquism aftereffect, which emerges following both cumulative (long-term) and trial-wise exposure to spatially discrepant multisensory stimuli. Despite the importance of such adaptive mechanisms for interacting with environments that change over multiple timescales, it remains debated whether the ventriloquism aftereffects observed following trial-wise and cumulative exposure arise from the same neurophysiological substrate. We address this question by probing electroencephalography recordings from healthy humans (both sexes) for processes predictive of the aftereffect biases following the exposure to spatially offset audiovisual stimuli. Our results support the hypothesis that discrepant multisensory evidence shapes aftereffects on distinct timescales via common neurophysiological processes reflecting sensory inference and memory in parietal-occipital regions, while the cumulative exposure to consistent discrepancies additionally recruits prefrontal processes. During the subsequent unisensory trial, both trial-wise and cumulative exposure bias the encoding of the acoustic information, but do so distinctly. Our results posit a central role of parietal regions in shaping multisensory spatial recalibration, suggest that frontal regions consolidate the behavioral bias for persistent multisensory discrepancies, but also show that the trial-wise and cumulative exposure bias sound position encoding via distinct neurophysiological processes.

SIGNIFICANCE STATEMENT Our brain easily reconciles conflicting multisensory information, such as seeing an actress on screen while hearing her voice over headphones. These adaptive mechanisms exert a persistent influence on the perception of subsequent unisensory stimuli, known as the ventriloquism aftereffect. While this aftereffect emerges following trial-wise or cumulative exposure to multisensory discrepancies, it remained unclear whether both arise from a common neural substrate. We here rephrase this hypothesis using human electroencephalography recordings. Our data suggest that parietal regions involved in multisensory and spatial memory mediate the aftereffect following both trial-wise and cumulative adaptation, but also show that additional and distinct processes are involved in consolidating and implementing the aftereffect following prolonged exposure.

Delta/Theta band EEG activity shapes the rhythmic perceptual sampling of auditory scenes

Many studies speak in favor of a rhythmic mode of listening, by which the encoding of acoustic information is structured by rhythmic neural processes at the time scale of about 1 to 4 Hz. Indeed, psychophysical data suggest that humans sample acoustic information in extended soundscapes not uniformly, but weigh the evidence at different moments for their perceptual decision at the time scale of about 2 Hz. We here test the critical prediction that such rhythmic perceptual sampling is directly related to the state of ongoing brain activity prior to the stimulus. Human participants judged the direction of frequency sweeps in 1.2 s long soundscapes while their EEG was recorded. We computed the perceptual weights attributed to different epochs within these soundscapes contingent on the phase or power of pre-stimulus EEG activity. This revealed a direct link between 4 Hz EEG phase and power prior to the stimulus and the phase of the rhythmic component of these perceptual weights. Hence, the temporal pattern by which the acoustic information is sampled over time for behavior is directly related to pre-stimulus brain activity in the delta/theta band. These results close a gap in the mechanistic picture linking ongoing delta band activity with their role in shaping the segmentation and perceptual influence of subsequent acoustic information.

Endogenous activity modulates stimulus and circuit-specific neural tuning and predicts perceptual behavior

Perception reflects not only sensory inputs, but also the endogenous state when these inputs enter the brain. Prior studies show that endogenous neural states influence stimulus processing through non-specific, global mechanisms, such as spontaneous fluctuations of arousal. It is unclear if endogenous activity influences circuit and stimulus-specific processing and behavior as well. Here we use intracranial recordings from 30 pre-surgical epilepsy patients to show that patterns of endogenous activity are related to the strength of trial-by-trial neural tuning in different visual category-selective neural circuits. The same aspects of the endogenous activity that relate to tuning in a particular neural circuit also correlate to behavioral reaction times only for stimuli from the category that circuit is selective for. These results suggest that endogenous activity can modulate neural tuning and influence behavior in a circuit- and stimulus-specific manner, reflecting a potential mechanism by which endogenous neural states facilitate and bias perception.

Phase-Coded Oscillatory Ordering Promotes the Separation of Closely Matched Representations to Optimize Perceptual Discrimination

Low-frequency oscillations are proposed to be involved in separating neuronal representations belonging to different items. Although item-specific neuronal activity was found to cluster on different oscillatory phases, the influence of this mechanism on perception is unknown. Here, we investigated the perceptual consequences of neuronal item separation through oscillatory clustering. In an electroencephalographic experiment, participants categorized sounds parametrically varying in pitch, relative to an arbitrary pitch boundary. Pre-stimulus theta and alpha phase biased near-boundary sound categorization to one category or the other. Phase also modulated whether evoked neuronal responses contributed stronger to the fit of the sound envelope of one or another category. Intriguingly, participants with stronger oscillatory clustering (phase strongly biasing sound categorization) in the theta, but not alpha, range had steeper perceptual psychometric slopes (sharper sound category discrimination). These results indicate that neuronal sorting by phase directly influences subsequent perception and has a positive impact on discrimination performance.

•

Pre-stimulus theta/alpha phase co-determines how we perceive ambiguous sounds

•

Phase influences to which sound envelope evoked potentials fit better

•

Neural separation through phase clustering promotes sound discrimination

Attention strengthens across-trial pre-stimulus phase coherence in visual cortex, enhancing stimulus processing

Attention selectively routes the most behaviorally relevant information from the stream of sensory inputs through the hierarchy of cortical areas. Previous studies have shown that visual attention depends on the phase of oscillatory brain activities. These studies mainly focused on the stimulus presentation period, rather than the pre-stimulus period. Here, we hypothesize that selective attention controls the phase of oscillatory neural activities to efficiently process relevant information. We document an attentional modulation of pre-stimulus inter-trial phase coherence (a measure of deviation between instantaneous phases of trials) of low frequency local field potentials (LFP) in visual area MT of macaque monkeys. Our data reveal that phase coherence increases following a spatial cue deploying attention towards the receptive field of the recorded neural population. We further show that the attentional enhancement of phase coherence is positively correlated with the modulation of the stimulus-induced firing rate, and importantly, a higher phase coherence is associated with a faster behavioral response. These results suggest a functional utilization of intrinsic neural oscillatory activities for an enhanced processing of upcoming stimuli.

Shared Physiological Correlates of Multisensory and Expectation-Based Facilitation

Perceptual performance in a visual task can be enhanced by simultaneous multisensory information, but can also be enhanced by a symbolic or amodal cue inducing a specific expectation. That similar benefits can arise from multisensory information and within-modality expectation raises the question of whether the underlying neurophysiological processes are the same or distinct. We investigated this by comparing the influence of the following three types of auxiliary probabilistic cues on visual motion discrimination in humans: (1) acoustic motion, (2) a premotion visual symbolic cue, and (3) a postmotion symbolic cue. Using multivariate analysis of the EEG data, we show that both the multisensory and preceding visual symbolic cue enhance the encoding of visual motion direction as reflected by cerebral activity arising from occipital regions ∼200–400 ms post-stimulus onset. This suggests a common or overlapping physiological correlate of cross-modal and intramodal auxiliary information, pointing to a neural mechanism susceptive to both multisensory and more abstract probabilistic cues. We also asked how prestimulus activity shapes the cue–stimulus combination and found a differential influence on the cross-modal and intramodal combination: while alpha power modulated the relative weight of visual motion and the acoustic cue, it did not modulate the behavioral influence of a visual symbolic cue, pointing to differences in how prestimulus activity shapes the combination of multisensory and abstract cues with task-relevant information.

Predictability modulates the anticipation and perception of pain in both self and others

Predictability has been suggested to modulate both the anticipation and perception of self-pain. Considering the overlapping neural circuits between self-pain and other-pain perceptions, the present study investigated how the predictability of forthcoming pain modulates the anticipation and perception of self-pain and other-pain. We used a balanced, within-participant experimental design in which a visual cue indicating the recipient, intensity and predictability of an upcoming painful electrical stimulation was presented before its delivery. Subjective ratings and electroencephalography activities to the anticipation and perception of self-pain and other-pain were recorded and compared between certain and uncertain conditions. Results showed that predictability affected the perception of self-pain and other-pain in a similar manner such that the differences in behavioral ratings and event-related potentials to high-intensity and low-intensity pain were significantly reduced when the intensity was uncertain. The strengths of predictability-induced modulation of self-pain and other-pain perceptions were positively correlated with each other. Furthermore, predictability also modulated the anticipation of both self-pain and other-pain such that pre-stimulus high-frequency α-oscillation power at sensorimotor electrodes contralateral to the stimulation side was maximally suppressed when anticipating certain high-intensity pain. These findings demonstrate that predictability-induced modulation on pain anticipation and perception was similarly applied to both self-pain and other-pain.

Local cortical desynchronization and pupil-linked arousal differentially shape brain states for optimal sensory performance

Instantaneous brain states have consequences for our sensation, perception, and behaviour. Fluctuations in arousal and neural desynchronization likely pose perceptually relevant states. However, their relationship and their relative impact on perception is unclear. We here show that, at the single-trial level in humans, local desynchronization in sensory cortex (expressed as time-series entropy) versus pupil-linked arousal differentially impact perceptual processing. While we recorded electroencephalography (EEG) and pupillometry data, stimuli of a demanding auditory discrimination task were presented into states of high or low desynchronization of auditory cortex via a real-time closed-loop setup. Desynchronization and arousal distinctly influenced stimulus-evoked activity and shaped behaviour displaying an inverted u-shaped relationship: States of intermediate desynchronization elicited minimal response bias and fastest responses, while states of intermediate arousal gave rise to highest response sensitivity. Our results speak to a model in which independent states of local desynchronization and global arousal jointly optimise sensory processing and performance.

How to test for phasic modulation of neural and behavioural responses

Research on whether perception or other processes depend on the phase of neural oscillations is rapidly gaining popularity. However, it is unknown which methods are optimally suited to evaluate the hypothesized phase effect. Using a simulation approach, we here test the ability of different methods to detect such an effect on dichotomous (e.g., "hit" vs "miss") and continuous (e.g., scalp potentials) response variables. We manipulated parameters that characterise the phase effect or define the experimental approach to test for this effect. For each parameter combination and response variable, we identified an optimal method. We found that methods regressing single-trial responses on circular (sine and cosine) predictors perform best for all of the simulated parameters, regardless of the nature of the response variable (dichotomous or continuous). In sum, our study lays a foundation for optimized experimental designs and analyses in future studies investigating the role of phase for neural and behavioural responses. We provide MATLAB code for the statistical methods tested.

Neural Entrainment and Attentional Selection in the Listening Brain

The streams of sounds we typically attend to abound in acoustic regularities. Neural entrainment is seen as an important mechanism that the listening brain exploits to attune to these regularities and to enhance the representation of attended sounds. We delineate the neurophysiology underlying this mechanism and review entrainment alongside its more pragmatic signature, often called 'speech tracking'. The latter has become a popular analytical approach to trace the reflection of acoustic and linguistic information at different levels of granularity, from neurophysiology to neuroimaging. As we discuss, the concept of entrainment offers both a putative neurophysiological mechanism for selective listening and a versatile window onto the neural basis of hearing and speech comprehension.

Evidence for the Rhythmic Perceptual Sampling of Auditory Scenes

Converging results suggest that perception is controlled by rhythmic processes in the brain. In the auditory domain, neuroimaging studies show that the perception of sounds is shaped by rhythmic activity prior to the stimulus, and electrophysiological recordings have linked delta and theta band activity to the functioning of individual neurons. These results have promoted theories of rhythmic modes of listening and generally suggest that the perceptually relevant encoding of acoustic information is structured by rhythmic processes along auditory pathways. A prediction from this perspective-which so far has not been tested-is that such rhythmic processes also shape how acoustic information is combined over time to judge extended soundscapes. The present study was designed to directly test this prediction. Human participants judged the overall change in perceived frequency content in temporally extended (1.2-1.8 s) soundscapes, while the perceptual use of the available sensory evidence was quantified using psychophysical reverse correlation. Model-based analysis of individual participant's perceptual weights revealed a rich temporal structure, including linear trends, a U-shaped profile tied to the overall stimulus duration, and importantly, rhythmic components at the time scale of 1-2 Hz. The collective evidence found here across four versions of the experiment supports the notion that rhythmic processes operating on the delta time scale structure how perception samples temporally extended acoustic scenes.

Neurobiological mechanisms of TENS-induced analgesia

Pain inhibition by additional somatosensory input is the rationale for the widespread use of Transcutaneous Electrical Nerve Stimulation (TENS) to relieve pain. Two main types of TENS produce analgesia in animal models: high-frequency (∼50-100 Hz) and low-intensity 'conventional' TENS, and low-frequency (∼2-4 Hz) and high-intensity 'acupuncture-like' TENS. However, TENS efficacy in human participants is debated, raising the question of whether the analgesic mechanisms identified in animal models are valid in humans. Here, we used a sham-controlled experimental design to clarify the efficacy and the neurobiological effects of 'conventional' and 'acupuncture-like' TENS in 80 human volunteers. To test the analgesic effect of TENS we recorded the perceptual and brain responses elicited by radiant heat laser pulses that activate selectively Aδ and C cutaneous nociceptors. To test whether TENS has a long-lasting effect on brain state we recorded spontaneous electrocortical oscillations. The analgesic effect of 'conventional' TENS was maximal when nociceptive stimuli were delivered homotopically, to the same hand that received the TENS. In contrast, 'acupuncture-like' TENS produced a spatially-diffuse analgesic effect, coupled with long-lasting changes both in the state of the primary sensorimotor cortex (S1/M1) and in the functional connectivity between S1/M1 and the medial prefrontal cortex, a core region in the descending pain inhibitory system. These results demonstrate that 'conventional' and 'acupuncture-like' TENS have different analgesic effects, which are mediated by different neurobiological mechanisms.

Others' Pain Appraisals Modulate the Anticipation and Experience of Subsequent Pain

The present study investigated how pain appraisals from other individuals modulated self-pain anticipation and perception. Appraisals of pain intensity from 10 other individuals were presented before the participants received identical electrical pain stimulation themselves. In reality, the presented other's pain appraisals, with either low or high in mean and variance, were generated by the experimenter, and were randomly paired with the subsequent electrical stimulation at either low or high intensity. Specifically, the mean and variance of others' pain appraisals were manipulated to induce participants' expectation and certainty to the upcoming pain. Subjective ratings of pain intensity and electroencephalographic (EEG) responses to the electrical stimulation, as well as anticipatory EEG activities measured prior to the onset of electrical stimulation, were compared. Results showed that the mean and variance of others' pain appraisal modulated the subjective pain ratings and the affective-motivational P2 responses elicited by the electrical stimulation, as well as anticipatory sensorimotor α-oscillation measured before the onset of pain stimulation. When the mean of others' pain appraisal was low, higher variance suppressed the sensorimotor α-oscillations and enhanced subsequent pain perception. In contrast, when the mean was high, the higher variance enhanced sensorimotor α-oscillations and suppressed subsequent pain perception. These results demonstrated that others' pain appraisals can modulate both of the anticipation and perception of first-hand pain. It also suggested that the top-down modulation of others' pain appraisals on pain perception could be partially driven by the different brain states during the anticipation stage, as captured by the prestimulus sensorimotor α-oscillations.

Shared neural underpinnings of multisensory integration and trial-by-trial perceptual recalibration in humans

Perception adapts to mismatching multisensory information, both when different cues appear simultaneously and when they appear sequentially. While both multisensory integration and adaptive trial-by-trial recalibration are central for behavior, it remains unknown whether they are mechanistically linked and arise from a common neural substrate. To relate the neural underpinnings of sensory integration and recalibration, we measured whole-brain magnetoencephalography while human participants performed an audio-visual ventriloquist task. Using single-trial multivariate analysis, we localized the perceptually-relevant encoding of multisensory information within and between trials. While we found neural signatures of multisensory integration within temporal and parietal regions, only medial superior parietal activity encoded past and current sensory information and mediated the perceptual recalibration within and between trials. These results highlight a common neural substrate of sensory integration and perceptual recalibration, and reveal a role of medial parietal regions in linking present and previous multisensory evidence to guide adaptive behavior.

A good ventriloquist will make their audience experience an illusion. The speech the spectators hear appears to come from the mouth of the puppet and not from the puppeteer. Moviegoers experience the same illusion: they perceive dialogue as coming from the mouths of the actors on screen, rather than from the loudspeakers mounted on the walls. Known as the ventriloquist effect, this ‘trick’ exists because the brain assumes that sights and sounds which occur at the same time have the same origin, and it therefore combines the two sets of sensory stimuli.

A version of the ventriloquist effect can be induced in the laboratory. Participants hear a sound while watching a simple visual stimulus (for instance, a circle) appear on a screen. When asked to pinpoint the origin of the noise, volunteers choose a location shifted towards the circle, even if this was not where the sound came from. In addition, this error persists when the visual stimulus is no longer present: if a standard trial is followed by a trial that features a sound but no circle, participants perceive the sound in the second test as ‘drawn’ towards the direction of the former shift. This is known as the ventriloquist aftereffect.

By scanning the brains of healthy volunteers performing this task, Park and Kayser show that a number of brain areas contribute to the ventriloquist effect. All of these regions help to combine what we see with what we hear, but only one maintains representations of the combined sensory inputs over time. Called the medial superior parietal cortex, this area is unique in contributing to both the ventriloquist effect and its aftereffect.

We must constantly use past and current sensory information to adapt our behavior to the environment. The results by Park and Kayser shed light on the brain structures that underpin our capacity to combine information from several senses, as well as our ability to encode memories. Such knowledge should be useful to explore how we can make flexible decisions.

Pre-stimulus brain state predicts auditory pattern identification accuracy

Recent studies show that pre-stimulus band-specific power and phase in the electroencephalogram (EEG) can predict accuracy on tasks involving the detection of near-threshold stimuli. However, results in the auditory modality have been mixed, and few works have examined pre-stimulus features when more complex decisions are made (e.g. identifying supra-threshold sounds). Further, most auditory studies have used background sounds known to induce oscillatory EEG states, leaving it unclear whether phase predicts accuracy without such background sounds. To address this gap in knowledge, the present study examined pre-stimulus EEG as it relates to accuracy in a tone pattern identification task. On each trial, participants heard a triad of 40-ms sinusoidal tones (separated by 40-ms intervals), one of which was at a different frequency than the other two. Participants' task was to indicate the tone pattern (low-low-high, low-high-low, etc.). No background sounds were employed. Using a phase opposition measure based on inter-trial phase consistencies, pre-stimulus 7-10 Hz phase was found to differ between correct and incorrect trials ∼200 to 100 ms prior to tone-pattern onset. After sorting trials into bins based on phase, accuracy was found to be lowest at around π-+ relative to individuals' most accurate phase bin. No significant effects were found for pre-stimulus power. In the context of the literature, findings suggest an important relationship between the complexity of task demands and pre-stimulus activity within the auditory domain. Results also raise interesting questions about the role of induced oscillatory states or rhythmic processing modes in obtaining pre-stimulus effects of phase in auditory tasks.

Consistent pre-stimulus influences on auditory perception across the lifespan

As we get older, perception in cluttered environments becomes increasingly difficult as a result of changes in peripheral and central neural processes. Given the aging society, it is important to understand the neural mechanisms constraining perception in the elderly. In young participants, the state of rhythmic brain activity prior to a stimulus has been shown to modulate the neural encoding and perceptual impact of this stimulus - yet it remains unclear whether, and if so, how, the perceptual relevance of pre-stimulus activity changes with age. Using the auditory system as a model, we recorded EEG activity during a frequency discrimination task from younger and older human listeners. By combining single-trial EEG decoding with linear modelling we demonstrate consistent statistical relations between pre-stimulus power and the encoding of sensory evidence in short-latency EEG components, and more variable relations between pre-stimulus phase and subjects' decisions in longer-latency components. At the same time, we observed a significant slowing of auditory evoked responses and a flattening of the overall EEG frequency spectrum in the older listeners. Our results point to mechanistically consistent relations between rhythmic brain activity and sensory encoding that emerge despite changes in neural response latencies and the relative amplitude of rhythmic brain activity with age.

Decoding cortical brain states from widefield calcium imaging data using visibility graph

Widefield optical imaging of neuronal populations over large portions of the cerebral cortex in awake behaving animals provides a unique opportunity for investigating the relationship between brain function and behavior. In this paper, we demonstrate that the temporal characteristics of calcium dynamics obtained through widefield imaging can be utilized to infer the corresponding behavior. Cortical activity in transgenic calcium reporter mice (n=6) expressing GCaMP6f in neocortical pyramidal neurons is recorded during active whisking (AW) and no whisking (NW). To extract features related to the temporal characteristics of calcium recordings, a method based on visibility graph (VG) is introduced. An extensive study considering different choices of features and classifiers is conducted to find the best model capable of predicting AW and NW from calcium recordings. Our experimental results show that temporal characteristics of calcium recordings identified by the proposed method carry discriminatory information that are powerful enough for decoding behavior.

Beta oscillatory power modulation reflects the predictability of pitch change

Humans process highly dynamic auditory information in real time, and regularities in stimuli such as speech and music can aid such processing by allowing sensory predictions for upcoming events. Auditory sequences contain information about both the identity of sounds (what) and their timing (when they occur). Temporal prediction in isochronous sequences is reflected in neural oscillatory power modulation in the beta band (∼20 Hz). Specifically, power decreases (desynchronization) after tone onset and then increases (resynchronization) to reach a maximum around the expected time of the next tone. The current study investigates whether the predictability of the pitch of a tone (what) is also reflected in beta power modulation. We presented two isochronous auditory oddball sequences, each with 20% of tones at a deviant pitch. In one sequence the deviant tones occurred regularly every fifth tone (predictably), but in the other sequence they occurred pseudorandomly (unpredictably). We recorded the electroencephalogram (EEG) while participants listened passively to these sequences. The results showed that auditory beta power desynchronization was larger prior to a predictable than an unpredictable pitch change. A single-trial correlation analysis using linear mixed-effect (LME) models further showed that the deeper the pre-deviant beta desynchronization depth, the smaller the event-related P3a amplitude following the deviant, and this effect only occurred when the pitch change was predictable. Given that P3a is associated with attentional response to prediction error, larger beta desynchronization depth indicates better prediction of an upcoming deviant pitch. Thus, these findings suggest that beta oscillations reflect predictions for what in additional to when during dynamic auditory information processing.

Visual perception affected by motivation and alertness controlled by a noninvasive brain-computer interface

The influence of motivation and alertness on brain activity associated with visual perception was studied experimentally using the Necker cube, which ambiguity was controlled by the contrast of its ribs. The wavelet analysis of recorded multichannel electroencephalograms (EEG) allowed us to distinguish two different scenarios while the brain processed the ambiguous stimulus. The first scenario is characterized by a particular destruction of alpha rhythm (8–12 Hz) with a simultaneous increase in beta-wave activity (20–30 Hz), whereas in the second scenario, the beta rhythm is not well pronounced while the alpha-wave energy remains unchanged. The experiments were carried out with a group of financially motivated subjects and another group of unpaid volunteers. It was found that the first scenario occurred mainly in the motivated group. This can be explained by the increased alertness of the motivated subjects. The prevalence of the first scenario was also observed in a group of subjects to whom images with higher ambiguity were presented. We believe that the revealed scenarios can occur not only during the perception of bistable images, but also in other perceptual tasks requiring decision making. The obtained results may have important applications for monitoring and controlling human alertness in situations which need substantial attention. On the base of the obtained results we built a brain-computer interface to estimate and control the degree of alertness in real time.

States and traits of neural irregularity in the age-varying human brain

Sensory representations, and thus human percepts, of the physical world are susceptible to fluctuations in brain state or “neural irregularity”. Furthermore, aging brains display altered levels of neural irregularity. We here show that a single, within-trial, information-theoretic measure (weighted permutation entropy) captures neural irregularity in the human electroencephalogram as a proxy for both, trait-like differences between individuals of varying age, and state-like fluctuations that bias perceptual decisions. First, the overall level of neural irregularity increased with participants’ age, paralleled by a decrease in variability over time, likely indexing age-related changes at structural and functional levels of brain activity. Second, states of higher neural irregularity were associated with optimized sensory encoding and a subsequently increased probability of choosing the first of two physically identical stimuli to be higher in pitch. In sum, neural irregularity not only characterizes behaviourally relevant brain states, but also can identify trait-like changes that come with age.

Neural correlates of multisensory reliability and perceptual weights emerge at early latencies during audio-visual integration

To make accurate perceptual estimates, observers must take the reliability of sensory information into account. Despite many behavioural studies showing that subjects weight individual sensory cues in proportion to their reliabilities, it is still unclear when during a trial neuronal responses are modulated by the reliability of sensory information or when they reflect the perceptual weights attributed to each sensory input. We investigated these questions using a combination of psychophysics, EEG‐based neuroimaging and single‐trial decoding. Our results show that the weighted integration of sensory information in the brain is a dynamic process; effects of sensory reliability on task‐relevant EEG components were evident 84 ms after stimulus onset, while neural correlates of perceptual weights emerged 120 ms after stimulus onset. These neural processes had different underlying sources, arising from sensory and parietal regions, respectively. Together these results reveal the temporal dynamics of perceptual and neural audio‐visual integration and support the notion of temporally early and functionally specific multisensory processes in the brain.

Laughter catches attention!

In social interactions, emotionally salient and sudden changes in vocal expressions attract attention. However, only a few studies examined how emotion and attention interact in voice processing. We investigated neutral, happy (laughs) and angry (growls) vocalizations in a modified oddball task. Participants silently counted the targets in each block and rated the valence and arousal of the vocalizations. A combined event-related potential and time-frequency analysis focused on the P3 and pre-stimulus alpha power to capture attention effects in response to unexpected events. Whereas an early differentiation between emotionally salient and neutral vocalizations was reflected in the P3a response, the P3b was selectively enhanced for happy voices. The P3b modulation was predicted by pre-stimulus frontal alpha desynchronization, and by the perceived pleasantness of the targets. These findings indicate that vocal emotions may be differently processed based on task relevance and valence. Increased anticipation and attention to positive vocal cues (laughter) may reflect their high social relevance.

Alpha Power Predicts Persistence of Bistable Perception

Perception is strongly affected by the intrinsic state of the brain, which controls the propensity to either maintain a particular perceptual interpretation or switch to another. To understand the mechanisms underlying the spontaneous drive of the brain to explore alternative interpretations of unchanging stimuli, we repeatedly recorded high-density EEG after normal sleep and after sleep deprivation while participants observed a Necker cube image and reported the durations of the alternating representations of their bistable perception. We found that local alpha power around the parieto-occipital sulcus within the first second after the emergence of a perceptual representation predicted the fate of its duration. An experimentally induced increase in alpha power by means of sleep deprivation increased the average duration of individual representations. Taken together, these findings show that high alpha power promotes the stability of a perceptual representation and suppresses switching to the alternative. The observations support the hypothesis that synchronization of alpha oscillations across a wide neuronal network promotes the maintenance and stabilization of its current perceptual representation. Elevated alpha power could also be key to the poorly understood cognitive deficits, that typically accompany sleep deprivation, such as the loss of mental flexibility and lapses of responsiveness.

Contributions of local speech encoding and functional connectivity to audio-visual speech perception

Seeing a speaker’s face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker’s face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.

DOI:http://dx.doi.org/10.7554/eLife.24763.001

When listening to someone in a noisy environment, such as a cocktail party, we can understand the speaker more easily if we can also see his or her face. Movements of the lips and tongue convey additional information that helps the listener’s brain separate out syllables, words and sentences. However, exactly where in the brain this effect occurs and how it works remain unclear.

To find out, Giordano et al. scanned the brains of healthy volunteers as they watched clips of people speaking. The clarity of the speech varied between clips. Furthermore, in some of the clips the lip movements of the speaker corresponded to the speech in question, whereas in others the lip movements were nonsense babble. As expected, the volunteers performed better on a word recognition task when the speech was clear and when the lips movements agreed with the spoken dialogue.

Watching the video clips stimulated rhythmic activity in multiple regions of the volunteers’ brains, including areas that process sound and areas that plan movements. Speech is itself rhythmic, and the volunteers’ brain activity synchronized with the rhythms of the speech they were listening to. Seeing the speaker’s face increased this degree of synchrony. However, it also made it easier for sound-processing regions within the listeners’ brains to transfer information to one other. Notably, only the latter effect predicted improved performance on the word recognition task. This suggests that seeing a person’s face makes it easier to understand his or her speech by boosting communication between brain regions, rather than through effects on individual areas.

Further work is required to determine where and how the brain encodes lip movements and speech sounds. The next challenge will be to identify where these two sets of information interact, and how the brain merges them together to generate the impression of specific words.

DOI:http://dx.doi.org/10.7554/eLife.24763.002

Large-scale network dynamics of beta-band oscillations underlie auditory perceptual decision-making

Perceptual decisions vary in the speed at which we make them. Evidence suggests that translating sensory information into perceptual decisions relies on distributed interacting neural populations, with decision speed hinging on power modulations of the neural oscillations. Yet the dependence of perceptual decisions on the large-scale network organization of coupled neural oscillations has remained elusive. We measured magnetoencephalographic signals in human listeners who judged acoustic stimuli composed of carefully titrated clouds of tone sweeps. These stimuli were used in two task contexts, in which the participants judged the overall pitch or direction of the tone sweeps. We traced the large-scale network dynamics of the source-projected neural oscillations on a trial-by-trial basis using power-envelope correlations and graph-theoretical network discovery. In both tasks, faster decisions were predicted by higher segregation and lower integration of coupled beta-band (∼16-28 Hz) oscillations. We also uncovered the brain network states that promoted faster decisions in either lower-order auditory or higher-order control brain areas. Specifically, decision speed in judging the tone sweep direction critically relied on the nodal network configurations of anterior temporal, cingulate, and middle frontal cortices. Our findings suggest that global network communication during perceptual decision-making is implemented in the human brain by large-scale couplings between beta-band neural oscillations.

Analgesia induced by self-initiated electrotactile sensation is mediated by top-down modulations

It is well known that sensory perception can be attenuated when sensory stimuli are controlled by self-initiated actions. This phenomenon is explained by the consistency between forward models of anticipated action effects and actual sensory feedback. Specifically, the brain state related to the binding between motor processing and sensory perception would have inhibitory function by gating sensory information via top-down control. Since the brain state could casually influence the perception of subsequent stimuli of different sensory modalities, we hypothesize that pain evoked by nociceptive stimuli following the self-initiated tactile stimulation would be attenuated as compared to that following externally determined tactile stimulation. Here, we compared psychophysical and neurophysiological responses to identical nociceptive-specific laser stimuli in two different conditions: self-initiated tactile sensation condition (STS) and nonself-initiated tactile sensation condition (N-STS). We observed that pain intensity and unpleasantness, as well as laser-evoked brain responses, were significantly reduced in the STS condition compared to the N-STS condition. In addition, magnitudes of alpha and beta oscillations prior to laser onset were significantly larger in the STS condition than in the N-STS condition. These results confirmed that pain perception and pain-related brain responses were attenuated when the tactile stimulation was initiated by subjects' voluntary actions, and exploited neural oscillations reflecting the binding between motor processing and sensory feedback. Thus, our study elaborated the understanding of underlying neural mechanisms related to top-down modulations of the analgesic effect induced by self-initiated tactile sensation, which provided theoretical basis to improve the analgesic effect in various clinical applications.

Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations

Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific processes, such as early sensory encoding, the transformation of sensory representations into a motor response, or to more unspecific processes such as attention. We combined an audio-visual motion discrimination task with the single-trial mapping of dynamic sensory representations in EEG activity to localize when and where multisensory congruency facilitates perceptual accuracy. Our results show that a congruent sound facilitates the encoding of motion direction in occipital sensory - as opposed to parieto-frontal - cortices, and facilitates later - as opposed to early (i.e. below 100 ms) - sensory activations. This multisensory enhancement was visible as an earlier rise of motion-sensitive activity in middle-occipital regions about 350 ms from stimulus onset, which reflected the better discriminability of motion direction from brain activity and correlated with the perceptual benefit provided by congruent multisensory information. This supports a hierarchical model of multisensory integration in which the enhancement of relevant sensory cortical representations is transformed into a more accurate choice.

•

Feature specific multisensory integration occurs in sensory not amodal cortex.

•

Feature specific integration occurs late, i.e. around 350 ms post stimulus onset.

•

Acoustic and visual representations interact in occipital motion regions.

Auditory cortical delta-entrainment interacts with oscillatory power in multiple fronto-parietal networks

The timing of slow auditory cortical activity aligns to the rhythmic fluctuations in speech. This entrainment is considered to be a marker of the prosodic and syllabic encoding of speech, and has been shown to correlate with intelligibility. Yet, whether and how auditory cortical entrainment is influenced by the activity in other speech–relevant areas remains unknown. Using source-localized MEG data, we quantified the dependency of auditory entrainment on the state of oscillatory activity in fronto-parietal regions. We found that delta band entrainment interacted with the oscillatory activity in three distinct networks. First, entrainment in the left anterior superior temporal gyrus (STG) was modulated by beta power in orbitofrontal areas, possibly reflecting predictive top-down modulations of auditory encoding. Second, entrainment in the left Heschl's Gyrus and anterior STG was dependent on alpha power in central areas, in line with the importance of motor structures for phonological analysis. And third, entrainment in the right posterior STG modulated theta power in parietal areas, consistent with the engagement of semantic memory. These results illustrate the topographical network interactions of auditory delta entrainment and reveal distinct cross-frequency mechanisms by which entrainment can interact with different cognitive processes underlying speech perception.

•

We study auditory cortical speech entrainment from a network perspective.

•

Found three distinct networks interacting with delta-entrainment in auditory cortex.

•

Entrainment is modulated by frontal beta power, possibly indexing predictions.

•

Central alpha power interacts with entrainment, suggesting motor involvement.

•

Parietal theta is modulated by entrainment, suggesting working memory compensation.