Are alpha oscillations instrumental in multisensory synchrony perception?

Prestimulus Alpha Phase Modulates Visual Temporal Integration

When presented shortly after another, discrete pictures are naturally perceived as continuous. The neuronal mechanism underlying such continuous or discrete perception is not well understood. While continuous alpha oscillations are a candidate for orchestrating such neuronal mechanisms, recent evidence is mixed. In this study, we investigated the influence of prestimulus alpha oscillation on visual temporal perception. Specifically, we were interested in whether prestimulus alpha phase modulates neuronal and perceptual processes underlying discrete or continuous perception. Participants had to report the location of a missing object in a visual temporal integration task, while simultaneously MEG data were recorded. Using source reconstruction, we evaluated local phase effects by contrasting phase angle values between correctly and incorrectly integrated trials. Our results show a phase opposition cluster between -0.8 and -0.5 s (relative to stimulus presentation) and between 6 and 20 Hz. These momentary phase angle values were correlated with behavioral performance and event-related potential amplitude. There was no evidence that frequency defined a window of temporal integration.

Beyond alpha band: prestimulus local oscillation and interregional synchrony of the beta band shape the temporal perception of the audiovisual beep-flash stimulus

Objective.Multisensory integration is more likely to occur if the multimodal inputs are within a narrow temporal window called temporal binding window (TBW). Prestimulus local neural oscillations and interregional synchrony within sensory areas can modulate cross-modal integration. Previous work has examined the role of ongoing neural oscillations in audiovisual temporal integration, but there is no unified conclusion. This study aimed to explore whether local ongoing neural oscillations and interregional audiovisual synchrony modulate audiovisual temporal integration.Approach.The human participants performed a simultaneity judgment (SJ) task with the beep-flash stimuli while recording electroencephalography. We focused on two stimulus onset asynchrony (SOA) conditions where subjects report ∼50% proportion of synchronous responses in auditory- and visual-leading SOA (A50V and V50A).Main results.We found that the alpha band power is larger in synchronous response in the central-right posterior and posterior sensors in A50V and V50A conditions, respectively. The results suggested that the alpha band power reflects neuronal excitability in the auditory or visual cortex, which can modulate audiovisual temporal perception depending on the leading sense. Additionally, the SJs were modulated by the opposite phases of alpha (5-10 Hz) and low beta (14-20 Hz) bands in the A50V condition while the low beta band (14-18 Hz) in the V50A condition. One cycle of alpha or two cycles of beta oscillations matched an auditory-leading TBW of ∼86 ms, while two cycles of beta oscillations matched a visual-leading TBW of ∼105 ms. This result indicated the opposite phases in the alpha and beta bands reflect opposite cortical excitability, which modulated the audiovisual SJs. Finally, we found stronger high beta (21-28 Hz) audiovisual phase synchronization for synchronous response in the A50V condition. The phase synchrony of the beta band might be related to maintaining information flow between visual and auditory regions in a top-down manner.Significance.These results clarified whether and how the prestimulus brain state, including local neural oscillations and functional connectivity between brain regions, affects audiovisual temporal integration.

Alpha-band sensory entrainment improves audiovisual temporal acuity

Visual and auditory stimuli are transmitted from the environment to sensory cortices with different timing, requiring the brain to encode when sensory inputs must be segregated or integrated into a single percept. The probability that different audiovisual (AV) stimuli are integrated into a single percept even when presented asynchronously is reflected in the construct of temporal binding window (TBW). There is a strong interest in testing whether it is possible to broaden or shrink TBW by using different neuromodulatory approaches that can speed up or slow down ongoing alpha oscillations, which have been repeatedly hypothesized to be an important determinant of the TBWs size. Here, we employed a web-based sensory entrainment protocol combined with a simultaneity judgment task using simple flash-beep stimuli. The aim was to test whether AV temporal acuity could be modulated trial by trial by synchronizing ongoing neural oscillations in the prestimulus period to a rhythmic sensory stream presented in the upper (∼12 Hz) or lower (∼8.5 Hz) alpha range. As a control, we implemented a nonrhythmic condition where only the first and the last entrainers were employed. Results show that upper alpha entrainment shrinks AV TBW and improves AV temporal acuity when compared with lower alpha and control conditions. Our findings represent a proof of concept of the efficacy of sensory entrainment to improve AV temporal acuity in a trial-by-trial manner, and they strengthen the idea that alpha oscillations may reflect the temporal unit of AV temporal binding.

Alpha Oscillations and Temporal Binding Windows in Perception-A Critical Review and Best Practice Guidelines

An intriguing question in cognitive neuroscience is whether alpha oscillations shape how the brain transforms the continuous sensory inputs into distinct percepts. According to the alpha temporal resolution hypothesis, sensory signals arriving within a single alpha cycle are integrated, whereas those in separate cycles are segregated. Consequently, shorter alpha cycles should be associated with smaller temporal binding windows and higher temporal resolution. However, the evidence supporting this hypothesis is contentious, and the neural mechanisms remain unclear. In this review, we first elucidate the alpha temporal resolution hypothesis and the neural circuitries that generate alpha oscillations. We then critically evaluate study designs, experimental paradigms, psychophysics, and neurophysiological analyses that have been employed to investigate the role of alpha frequency in temporal binding. Through the lens of this methodological framework, we then review evidence from between-subject, within-subject, and causal perturbation studies. Our review highlights the inherent interpretational ambiguities posed by previous study designs and experimental paradigms and the extensive variability in analysis choices across studies. We also suggest best practice recommendations that may help to guide future research. To establish a mechanistic role of alpha frequency in temporal parsing, future research is needed that demonstrates its causal effects on the temporal binding window with consistent, experimenter-independent methods.

Alpha-Band Frequency and Temporal Windows in Perception: A Review and Living Meta-analysis of 27 Experiments (and Counting)

Temporal windows in perception refer to windows of time within which distinct stimuli interact to influence perception. A simple example is two temporally proximal stimuli fusing into a single percept. It has long been hypothesized that the human alpha rhythm (an 8- to 13-Hz neural oscillation maximal over posterior cortex) is linked to temporal windows, with higher frequencies corresponding to shorter windows and finer-grained temporal resolution. This hypothesis has garnered support from studies demonstrating a correlation between individual differences in alpha-band frequency (IAF) and behavioral measures of temporal processing. However, nonsignificant effects have also been reported. Here, we review and meta-analyze 27 experiments correlating IAF with measures of visual and audiovisual temporal processing. Our results estimate the true correlation in the population to be between .39 and .53, a medium-to-large effect. The effect held when considering visual or audiovisual experiments separately, when examining different IAF estimation protocols (i.e., eyes open and eyes closed), and when using analysis choices that favor a null result. Our review shows that (1) effects have been internally and independently replicated, (2) several positive effects are based on larger sample sizes than the null effects, and (3) many reported null effects are actually in the direction predicted by the hypothesis. A free interactive web app was developed to allow users to replicate our meta-analysis and change or update the study selection at will, making this a "living" meta-analysis (randfxmeta.streamlit.app). We discuss possible factors underlying null reports, design recommendations, and open questions for future research.

Alterations of Audiovisual Integration in Alzheimer's Disease

Audiovisual integration is a vital information process involved in cognition and is closely correlated with aging and Alzheimer's disease (AD). In this review, we evaluated the altered audiovisual integrative behavioral symptoms in AD. We further analyzed the relationships between AD pathologies and audiovisual integration alterations bidirectionally and suggested the possible mechanisms of audiovisual integration alterations underlying AD, including the imbalance between energy demand and supply, activity-dependent degeneration, disrupted brain networks, and cognitive resource overloading. Then, based on the clinical characteristics including electrophysiological and imaging data related to audiovisual integration, we emphasized the value of audiovisual integration alterations as potential biomarkers for the early diagnosis and progression of AD. We also highlighted that treatments targeted audiovisual integration contributed to widespread pathological improvements in AD animal models and cognitive improvements in AD patients. Moreover, investigation into audiovisual integration alterations in AD also provided new insights and comprehension about sensory information processes.

Neural oscillations reflect the individual differences in the temporal perception of audiovisual speech

Multisensory integration occurs within a limited time interval between multimodal stimuli. Multisensory temporal perception varies widely among individuals and involves perceptual synchrony and temporal sensitivity processes. Previous studies explored the neural mechanisms of individual differences for beep-flash stimuli, whereas there was no study for speech. In this study, 28 subjects (16 male) performed an audiovisual speech/ba/simultaneity judgment task while recording their electroencephalography. We examined the relationship between prestimulus neural oscillations (i.e. the pre-pronunciation movement-related oscillations) and temporal perception. The perceptual synchrony was quantified using the Point of Subjective Simultaneity and temporal sensitivity using the Temporal Binding Window. Our results revealed dissociated neural mechanisms for individual differences in Temporal Binding Window and Point of Subjective Simultaneity. The frontocentral delta power, reflecting top-down attention control, is positively related to the magnitude of individual auditory leading Temporal Binding Windows (auditory Temporal Binding Windows; LTBWs), whereas the parieto-occipital theta power, indexing bottom-up visual temporal attention specific to speech, is negatively associated with the magnitude of individual visual leading Temporal Binding Windows (visual Temporal Binding Windows; RTBWs). In addition, increased left frontal and bilateral temporoparietal occipital alpha power, reflecting general attentional states, is associated with increased Points of Subjective Simultaneity. Strengthening attention abilities might improve the audiovisual temporal perception of speech and further impact speech integration.

Spontaneous alpha-band oscillations reflect individual differences in audiovisual temporal perception

Light, and sound are persistently out of sync for subjective temporal perception called point of subjective simultaneity (PSS). It is stable within individuals but variable among individuals. Previous studies found that spontaneous alpha power, functioning in attention-related brain states, predicts individual PSS in the temporal order judgment (TOJ) task. However, the neural mechanisms underlying individual differences in audiovisual PSS have not been elucidated in the simultaneity judgment (SJ) task. A hypothesis that the spontaneous alpha band power might reflect the individual subjective temporal bias was proposed. We designed an SJ task EEG experiment where subjects judged whether the beep-flash stimuli are synchronous to test the above hypothesis. We primarily explored the correlation between the alpha-band power differences (visual- and auditory-leading conditions) with individual PSS. We used the V50A (~50% proportion of synchronous responses) to represent visual-leading conditions while A50V represents auditory-leading ones. We found the higher alpha power difference (V50A - A50V) predicted larger individual PSS. This study extends previous results and found that individual difference effects in the alpha band power also exist in the SJ task. The results suggested that alpha power might be associated with a spontaneous attentional state and reflect individuals' subjective temporal bias.

Electrophysiological and Behavioral Effects of Alpha-Band Sensory Entrainment: Neural Mechanisms and Clinical Applications

Alpha-band (7-13 Hz) activity has been linked to visuo-attentional performance in healthy participants and to impaired functionality of the visual system in a variety of clinical populations including patients with acquired posterior brain lesion and neurodevelopmental and psychiatric disorders. Crucially, several studies suggested that short uni- and multi-sensory rhythmic stimulation (i.e., visual, auditory and audio-visual) administered in the alpha-band effectively induces transient changes in alpha oscillatory activity and improvements in visuo-attentional performance by synchronizing the intrinsic brain oscillations to the external stimulation (neural entrainment). The present review aims to address the current state of the art on the alpha-band sensory entrainment, outlining its potential functional effects and current limitations. Indeed, the results of the alpha-band entrainment studies are currently mixed, possibly due to the different stimulation modalities, task features and behavioral and physiological measures employed in the various paradigms. Furthermore, it is still unknown whether prolonged alpha-band sensory entrainment might lead to long-lasting effects at a neural and behavioral level. Overall, despite the limitations emerging from the current literature, alpha-band sensory entrainment may represent a promising and valuable tool, inducing functionally relevant changes in oscillatory activity, with potential rehabilitative applications in individuals characterized by impaired alpha activity.

The effect of prestimulus low-frequency neural oscillations on the temporal perception of audiovisual speech

Objective

Perceptual integration and segregation are modulated by the phase of ongoing neural oscillation whose frequency period is broader than the size of the temporal binding window (TBW). Studies have shown that the abstract beep-flash stimuli with about 100 ms TBW were modulated by the alpha band phase. Therefore, we hypothesize that the temporal perception of speech with about hundreds of milliseconds of TBW might be affected by the delta-theta phase.

Methods

Thus, we conducted a speech-stimuli-based audiovisual simultaneity judgment (SJ) experiment. Twenty human participants (12 females) attended this study, recording 62 channels of EEG.

Results

Behavioral results showed that the visual leading TBWs are broader than the auditory leading ones [273.37 ± 24.24 ms vs. 198.05 ± 19.28 ms, (mean ± sem)]. We used Phase Opposition Sum (POS) to quantify the differences in mean phase angles and phase concentrations between synchronous and asynchronous responses. The POS results indicated that the delta-theta phase was significantly different between synchronous and asynchronous responses in the A50V condition (50% synchronous responses in auditory leading SOA). However, in the V50A condition (50% synchronous responses in visual leading SOA), we only found the delta band effect. In the two conditions, we did not find a consistency of phases over subjects for both perceptual responses by the post hoc Rayleigh test (all ps > 0.05). The Rayleigh test results suggested that the phase might not reflect the neuronal excitability which assumed that the phases within a perceptual response across subjects concentrated on the same angle but were not uniformly distributed. But V-test showed the phase difference between synchronous and asynchronous responses across subjects had a significant phase opposition (all ps < 0.05) which is compatible with the POS result.

Conclusion

These results indicate that the speech temporal perception depends on the alignment of stimulus onset with an optimal phase of the neural oscillation whose frequency period might be broader than the size of TBW. The role of the oscillatory phase might be encoding the temporal information which varies across subjects rather than neuronal excitability. Given the enriched temporal structures of spoken language stimuli, the conclusion that phase encodes temporal information is plausible and valuable for future research.

Effects of Rhythmic Transcranial Magnetic Stimulation in the Alpha-Band on Visual Perception Depend on Deviation From Alpha-Peak Frequency: Faster Relative Transcranial Magnetic Stimulation Alpha-Pace Improves Performance

Alpha-band oscillatory activity over occipito-parietal areas is involved in shaping perceptual and cognitive processes, with a growing body of electroencephalographic (EEG) evidence indicating that pre-stimulus alpha-band amplitude relates to the subjective perceptual experience, but not to objective measures of visual task performance (discrimination accuracy). The primary aim of the present transcranial magnetic stimulation (TMS) study was to investigate whether causality can be established for this relationship, using rhythmic (alpha-band) TMS entrainment protocols. It was anticipated that pre-stimulus 10 Hz-TMS would induce changes in subjective awareness ratings but not accuracy, in the visual hemifield contralateral to TMS. To test this, we administered 10 Hz-TMS over the right intraparietal sulcus prior to visual stimulus presentation in 17 participants, while measuring their objective performance and subjective awareness in a visual discrimination task. Arrhythmic and 10 Hz sham-TMS served as control conditions (within-participant design). Resting EEG was used to record individual alpha frequency (IAF). A study conducted in parallel to ours with a similar design but reported after we completed data collection informed further, secondary analyses for a causal relationship between pre-stimulus alpha-frequency and discrimination accuracy. This was explored through a regression analysis between rhythmic-TMS alpha-pace relative to IAF and performance measures. Our results revealed that contrary to our primary expectation, pre-stimulus 10 Hz-TMS did not affect subjective measures of performance, nor accuracy, relative to control-TMS. This null result is in accord with a recent finding showing that for influencing subjective measures of performance, alpha-TMS needs to be applied post-stimulus. In addition, our secondary analysis showed that IAF was positively correlated with task accuracy across participants, and that 10 Hz-TMS effects on accuracy—but not awareness ratings—depended on IAF: The slower (or faster) the IAF, relative to the fixed 10 Hz TMS frequency, the stronger the TMS-induced performance improvement (or worsening), indicating that 10 Hz-TMS produced a gain (or a loss) in individual performance, directly depending on TMS-pace relative to IAF. In support of recent reports, this is evidence for alpha-frequency playing a causal role in perceptual sensitivity likely through regulating the speed of sensory sampling.

Intrinsic neural activity predisposes susceptibility to a body illusion

Susceptibility to the rubber hand illusion (RHI) varies. To date, however, there is no consensus explanation of this variability. Previous studies, focused on the role of multisensory integration, have searched for neural correlates of the illusion. But those studies have failed to identify a sufficient set of functionally specific neural correlates. Because some evidence suggests that frontal α power is one means of tracking neural instantiations of self, we hypothesized that the higher the frontal α power during the eyes-closed resting state, the more stable the self. As a corollary, we infer that the more stable the self, the less susceptible are participants to a blurring of boundaries—to feeling that the rubber hand belongs to them. Indeed, we found that frontal α amplitude oscillations negatively correlate with susceptibility. Moreover, since lower frequencies often modulate higher frequencies, we explored the possibility that this might be the case for the RHI. Indeed, some evidence suggests that high frontal α power observed in low-RHI participants is modulated by δ frequency oscillations. We conclude that while neural correlates of multisensory integration might be necessary for the RHI, sufficient explanation involves variable intrinsic neural activity that modulates how the brain responds to incompatible sensory stimuli.

Predictive waves in the autism-schizophrenia continuum: A novel biobehavioral model

The brain is a predictive machine. Converging data suggests a diametric predictive strategy from autism spectrum disorders (ASD) to schizophrenic spectrum disorders (SSD). Whereas perceptual inference in ASD is rigidly shaped by incoming sensory information, the SSD population is prone to overestimate the precision of their priors' models. Growing evidence considers brain oscillations pivotal biomarkers to understand how top-down predictions integrate bottom-up input. Starting from the conceptualization of ASD and SSD as oscillopathies, we introduce an integrated perspective that ascribes the maladjustments of the predictive mechanism to dysregulation of neural synchronization. According to this proposal, disturbances in the oscillatory profile do not allow the appropriate trade-off between descending predictive signal, overweighted in SSD, and ascending prediction errors, overweighted in ASD. These opposing imbalances both result in an ill-adapted reaction to external challenges. This approach offers a neuro-computational model capable of linking predictive coding theories with electrophysiological findings, aiming to increase knowledge on the neuronal foundations of the two spectra features and stimulate hypothesis-driven rehabilitation/research perspectives.

Application of Latent Growth Curve modeling to predict individual trajectories during neurofeedback treatment for tinnitus

Tinnitus is a heterogeneous phenomenon indexed by various EEG oscillatory profiles. Applying neurofeedback (NFB) with the aim of changing these oscillatory patterns not only provides help for those who suffer from the phantom percept, but a promising foundation from which to probe influential factors. The reliable attribution of influential factors that potentially predict oscillatory changes during the course of NFB training may lead to the identification of subgroups of individuals that are more or less responsive to NFB training. The present study investigated oscillatory trajectories of delta (3-4Hz) and individual alpha (8.5-12Hz) during 15 NFB training sessions, based on a Latent Growth Curve framework. First, we found the desired enhancement of alpha, while delta was stable throughout the NFB training. Individual differences in tinnitus-specific variables and general-, as well as health-related quality of life predictors were largely unrelated to oscillatory change prior to and across the training. Only the predictors age and sex at baseline were clearly related to slow-wave delta, particularly so for older female individuals who showed higher delta power values from the start. Second, we confirmed a hierarchical cross-frequency association between the two frequency bands; however, in opposing directions to those anticipated in tinnitus. The establishment of individually tailored NFB protocols would boost this therapy's effectiveness in the treatment of tinnitus. In our analysis, we propose a conceptual groundwork toward this goal of developing more targeted treatment.

Binding Mechanisms in Visual Perception and Their Link With Neural Oscillations: A Review of Evidence From tACS

Neurophysiological studies in humans employing magneto- (MEG) and electro- (EEG) encephalography increasingly suggest that oscillatory rhythmic activity of the brain may be a core mechanism for binding sensory information across space, time, and object features to generate a unified perceptual representation. To distinguish whether oscillatory activity is causally related to binding processes or whether, on the contrary, it is a mere epiphenomenon, one possibility is to employ neuromodulatory techniques such as transcranial alternating current stimulation (tACS). tACS has seen a rising interest due to its ability to modulate brain oscillations in a frequency-dependent manner. In the present review, we critically summarize current tACS evidence for a causal role of oscillatory activity in spatial, temporal, and feature binding in the context of visual perception. For temporal binding, the emerging picture supports a causal link with the power and the frequency of occipital alpha rhythms (8-12 Hz); however, there is no consistent evidence on the causal role of the phase of occipital tACS. For feature binding, the only study available showed a modulation by occipital alpha tACS. The majority of studies that successfully modulated oscillatory activity and behavioral performance in spatial binding targeted parietal areas, with the main rhythms causally linked being the theta (~7 Hz) and beta (~18 Hz) frequency bands. On the other hand, spatio-temporal binding has been directly modulated by parieto-occipital gamma (~40-60 Hz) and alpha (10 Hz) tACS, suggesting a potential role of cross-frequency coupling when binding across space and time. Nonetheless, negative or partial results have also been observed, suggesting methodological limitations that should be addressed in future research. Overall, the emerging picture seems to support a causal role of brain oscillations in binding processes and, consequently, a certain degree of plasticity for shaping binding mechanisms in visual perception, which, if proved to have long lasting effects, can find applications in different clinical populations.

Exposure to first-person shooter videogames is associated with multisensory temporal precision and migraine incidence

Adaptive interactions with the environment require optimal integration and segregation of sensory information. Yet, temporal misalignments in the presentation of visual and auditory stimuli may generate illusory phenomena such as the sound-induced flash illusion, in which a single flash paired with multiple auditory stimuli induces the perception of multiple illusory flashes. This phenomenon has been shown to be robust and resistant to feedback training. According to a Bayesian account, this is due to a statistically optimal combination of the signals operated by the nervous system. From this perspective, individual susceptibility to the illusion might be moulded through prolonged experience. For example, repeated exposure to the illusion and prolonged training sessions partially impact on the reported illusion. Therefore, extensive and immersive audio-visual experience, such as first-person shooter videogames, should sharpen individual capacity to correctly integrate multisensory information over time, leading to more veridical perception. We tested this hypothesis by comparing the temporal profile of the sound-induced illusion in a group of expert first-person shooter gamers and a non-players group. In line with the hypotheses, gamers experience significantly narrower windows of illusion (~87 ms) relative to non-players (~105 ms), leading to higher veridical reports in gamers (~68%) relative to non-players (~59%). Moreover, according to recent literature, we tested whether audio-visual intensive training in gamers could be related to the incidence of migraine, and found that its severity may be directly proportioned to the time spent on videogames. Overall, these results suggest that continued training within audio-visual environments such as first-person shooter videogames improves temporal discrimination and sensory integration. This finding may pave the way for future therapeutic strategies based on self-administered multisensory training. On the other hand, the impact of intensive training on visual-related stress disorders, such as migraine incidence, should be taken into account as a risk factor during therapeutic planning.