Individual differences in beta frequency correlate with the audio-visual fusion illusion

Theoretical and Technical Issues Concerning the Measurement of Alpha Frequency and the Application of Signal Detection Theory: Comment on Buergers and Noppeney (2022)

Classical and recent evidence has suggested that alpha oscillations play a critical role in temporally discriminating or binding successively presented items. Challenging this view, Buergers and Noppeney [Buergers, S., & Noppeney, U. The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022] found that by combining EEG, psychophysics, and signal detection theory, neither prestimulus nor resting-state alpha frequency influences perceptual sensitivity and bias in the temporal binding task. We propose the following four points that should be considered when interpreting the role of alpha oscillations, and especially their frequency, on perceptual temporal binding: (1) Multiple alpha components can be contaminated in conventional EEG analysis; (2) the effect of alpha frequency on perception will interact with alpha power; (3) prestimulus and resting-state alpha frequency can be different from poststimulus alpha frequency, which is the frequency during temporal binding and should be more directly related to temporal binding; and (4) when applying signal detection theory under the assumption of equal variance, the assumption is often incomplete and can be problematic (e.g., the magnitude relationships between individuals in parametric sensitivity may change when converted into nonparametric sensitivity). Future directions, including solutions to each of the issues, are discussed.

The Influence of Alpha Frequency on Temporal Binding across the Senses: Response to the Special Focus

The papers collected in this Special Focus, prompted by S. Buergers and U. Noppeney [The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022], have raised several interesting ideas, arguments, and empirical results relating to the alpha temporal resolution hypothesis. Here we briefly respond to these, and in the process emphasize four challenges for future research: defining the scope and limitation of the hypothesis; developing experimental paradigms and study designs that rigorously test its tenets; decomposing the scalp-level signal and isolating underlying neural circuits; and bringing uniformity to the current diversity of analysis and statistical methods. Addressing these challenges will facilitate the progression from merely correlating alpha frequency with various perceptual phenomena to establishing whether and (if so) how alpha frequency influences sensory integration and segregation.

Individual Alpha Frequency Contributes to the Precision of Human Visual Processing

Brain oscillatory activity within the alpha band has been associated with a wide range of processes encompassing perception, memory, decision-making, and overall cognitive functioning. Individual alpha frequency (IAF) is a specific parameter accounting for the mean velocity of the alpha cycling activity, conventionally ranging between ∼7 and ∼13 Hz. One influential hypothesis has proposed a fundamental role of this cycling activity in the segmentation of sensory input and in the regulation of the speed of sensory processing, with faster alpha oscillations resulting in greater temporal resolution and more refined perceptual experience. However, although several recent theoretical and empirical studies would support this account, contradictory evidence suggests caution and more systematic approaches in the assessment and interpretation of this hypothesis. For example, it remains to be explored to what degree IAF shapes perceptual outcomes. In the present study, we investigated whether inter-individual differences in bias-free visual contrast detection threshold in a large sample of individuals in the general population (n = 122) could be explained by inter-individual differences in alpha pace. Our results show that the contrast needed to correctly identify target stimuli (individual perceptual threshold) is associated with alpha peak frequency (not amplitude). Specifically, individuals who require reduced contrast show higher IAF than individuals requiring higher contrasts. This suggests that inter-individual differences in alpha frequency contribute to performance variability in low-level perceptual tasks, supporting the hypothesis that IAF underlies a fundamental temporal sampling mechanism that shapes visual objective performance, with higher frequencies promoting enhanced sensory evidence per time unit.

Audio-Visual Fission Illusion and Individual Alpha Frequency: Perspective on Buergers and Noppeney (2022)

Integrating visual and auditory information is an important ability in various cognitive processes, although its neural mechanisms remain unclear. Several studies indicated a close relationship between one's temporal binding window (TBW) for audio-visual interaction and their alpha rhythm in the brain (individual alpha frequency or IAF). A recent study by Buergers and Noppeney [Buergers, S., & Noppeney, U. The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022], however, challenged this view using a new approach to analyze behavioral data. Conforming to the same procedures by Buergers and Noppeney, here, I analyzed the data of my previous study and examined a relationship between TBW and IAF. In contrast to Buergers and Noppeney, a significant correlation was found between occipital IAF and a new behavioral measure of TBW. Some possibilities that caused these opposing results, such as a variability of "alpha band" across studies and a large inter-individual difference in magnitude of the fission illusion, are discussed.

Sensory Drive Modifies Brain Dynamics and the Temporal Integration Window

Perception is suggested to occur in discrete temporal windows, clocked by cycles of neural oscillations. An important testable prediction of this theory is that individuals' peak frequencies of oscillations should correlate with their ability to segregate the appearance of two successive stimuli. An influential study tested this prediction and showed that individual peak frequency of spontaneously occurring alpha (8-12 Hz) correlated with the temporal segregation threshold between two successive flashes of light [Samaha, J., & Postle, B. R. The speed of alpha-band oscillations predicts the temporal resolution of visual perception. Current Biology, 25, 2985-2990, 2015]. However, these findings were recently challenged [Buergers, S., & Noppeney, U. The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022]. To advance our understanding of the link between oscillations and temporal segregation, we devised a novel experimental approach. Rather than relying entirely on spontaneous brain dynamics, we presented a visual grating before the flash stimuli that is known to induce continuous oscillations in the gamma band (45-65 Hz). By manipulating the contrast of the grating, we found that high contrast induces a stronger gamma response and a shorter temporal segregation threshold, compared to low-contrast trials. In addition, we used a novel tool to characterize sustained oscillations and found that, for half of the participants, both the low- and high-contrast gratings were accompanied by a sustained and phase-locked alpha oscillation. These participants tended to have longer temporal segregation thresholds. Our results suggest that visual stimulus drive, reflected by oscillations in specific bands, is related to the temporal resolution of visual perception.

Alpha-band Brain Dynamics and Temporal Processing: An Introduction to the Special Focus

For decades, the intriguing connection between the human alpha rhythm (an 8- to 13-Hz oscillation maximal over posterior cortex) and temporal processes in perception has furnished a rich landscape of proposals. The past decade, however, has seen a surge in interest in the topic, bringing new theoretical, analytic, and methodological developments alongside fresh controversies. This Special Focus on alpha-band dynamics and temporal processing provides an up-to-date snapshot of the playing field, with contributions from leading researchers in the field spanning original perspectives, new evidence, comprehensive reviews and meta-analyses, as well as discussion of ongoing controversies and paths forward. We hope that the perspectives captured here will help catalyze future research and shape the pathways toward a theoretically grounded and mechanistic account of the link between alpha dynamics and temporal properties of perception.

Perceptual Training as Means to Assess the Effect of Alpha Frequency on Temporal Binding Window

For decades, it has been shown that alpha frequency is related to temporal binding window, and currently, such is the mainstream viewpoint [Noguchi, Y. Individual differences in beta frequency correlate with the audio-visual fusion illusion. Psychophysiology, 59, e14041, 2022; Gray, M. J., & Emmanouil, T. A. Individual alpha frequency increases during a task but is unchanged by alpha-band flicker. Psychophysiology, 57, e13480, 2020; Hirst, R. J., McGovern, D. P., Setti, A., Shams, L., & Newell, F. N. What you see is what you hear: Twenty years of research using the sound-induced flash illusion. Neuroscience & Biobehavioral Reviews, 118, 759-774, 2020; Keil, J. Double flash illusions: Current findings and future directions. Frontiers in Neuroscience, 14, 298, 2020; Migliorati, D., Zappasodi, F., Perrucci, M. G., Donno, B., Northoff, G., Romei, V., & Costantini, M. Individual alpha frequency predicts perceived visuotactile simultaneity. Journal of Cognitive Neuroscience, 32, 1-11, 2020; Keil, J., & Senkowski, D. Individual alpha frequency relates to the sound-induced flash illusion. Multisensory Research, 30, 565-578, 2017; Minami, S., & Amano, K. Illusory jitter perceived at the frequency of alpha oscillations. Current Biology, 27, 2344-2351, 2017; Cecere, R., Rees, G., & Romei, V. Individual differences in alpha frequency drive crossmodal illusory perception. Current Biology, 25, 231-235, 2015]. However, recently, this stance has been challenged [Buergers, S., & Noppeney, U. The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022]. Moreover, both stances appear to have their limitations regarding the reliability of results. Therefore, it is of paramount importance to develop new methodology to gain more reliable results. Perceptual training seems to be such a method that also offers significant practical implications.

Alpha Oscillations and Temporal Binding Windows in Perception-A Critical Review and Best Practice Guidelines

An intriguing question in cognitive neuroscience is whether alpha oscillations shape how the brain transforms the continuous sensory inputs into distinct percepts. According to the alpha temporal resolution hypothesis, sensory signals arriving within a single alpha cycle are integrated, whereas those in separate cycles are segregated. Consequently, shorter alpha cycles should be associated with smaller temporal binding windows and higher temporal resolution. However, the evidence supporting this hypothesis is contentious, and the neural mechanisms remain unclear. In this review, we first elucidate the alpha temporal resolution hypothesis and the neural circuitries that generate alpha oscillations. We then critically evaluate study designs, experimental paradigms, psychophysics, and neurophysiological analyses that have been employed to investigate the role of alpha frequency in temporal binding. Through the lens of this methodological framework, we then review evidence from between-subject, within-subject, and causal perturbation studies. Our review highlights the inherent interpretational ambiguities posed by previous study designs and experimental paradigms and the extensive variability in analysis choices across studies. We also suggest best practice recommendations that may help to guide future research. To establish a mechanistic role of alpha frequency in temporal parsing, future research is needed that demonstrates its causal effects on the temporal binding window with consistent, experimenter-independent methods.

Alpha-Band Frequency and Temporal Windows in Perception: A Review and Living Meta-analysis of 27 Experiments (and Counting)

Temporal windows in perception refer to windows of time within which distinct stimuli interact to influence perception. A simple example is two temporally proximal stimuli fusing into a single percept. It has long been hypothesized that the human alpha rhythm (an 8- to 13-Hz neural oscillation maximal over posterior cortex) is linked to temporal windows, with higher frequencies corresponding to shorter windows and finer-grained temporal resolution. This hypothesis has garnered support from studies demonstrating a correlation between individual differences in alpha-band frequency (IAF) and behavioral measures of temporal processing. However, nonsignificant effects have also been reported. Here, we review and meta-analyze 27 experiments correlating IAF with measures of visual and audiovisual temporal processing. Our results estimate the true correlation in the population to be between .39 and .53, a medium-to-large effect. The effect held when considering visual or audiovisual experiments separately, when examining different IAF estimation protocols (i.e., eyes open and eyes closed), and when using analysis choices that favor a null result. Our review shows that (1) effects have been internally and independently replicated, (2) several positive effects are based on larger sample sizes than the null effects, and (3) many reported null effects are actually in the direction predicted by the hypothesis. A free interactive web app was developed to allow users to replicate our meta-analysis and change or update the study selection at will, making this a "living" meta-analysis (randfxmeta.streamlit.app). We discuss possible factors underlying null reports, design recommendations, and open questions for future research.

Visual adaptation changes the susceptibility to the fission illusion

Sound-induced flash illusion (SiFI) is the illusion that participants perceive incorrectly that the number of visual flashes is equal to the number of auditory beeps when presented within 100 ms. Although previous studies found that repetition suppression can reduce an individual's perceptual sensitivity to the SiFI, there is not yet a consensus as to how visual adaptation affects the SiFI. In the present study, we added prolonged adapting visual stimuli prior to the presentation of audiovisual stimuli to investigate whether the bottom-up factor of adaptation affects the SiFI. The adapting visual stimuli consisted of one or two of the same visual stimuli that lasted for 2 minutes in succession, followed by the audiovisual stimuli. Both adaptation conditions showed SiFI effects. The accuracy of adapting double-flashes was significantly lower than that of in adapting a single flash for the fission illusion. Our analyses indicated that such a pattern could be attributed to a lower d' in adapting double-flashes than in adapting a single flash. However, the accuracy, discriminability and criterion were not significantly different between the two adaptation conditions because of the instability of the fusion illusion. Thus, the present study indicated that the reduced perceptual sensitivity based on visual adaptation could enhance the fission illusion in multisensory integration.

Rhythmic TMS as a Feasible Tool to Uncover the Oscillatory Signatures of Audiovisual Integration

Multisensory integration is quintessential to adaptive behavior, with clinical populations showing significant impairments in this domain, most notably hallucinatory reports. Interestingly, altered cross-modal interactions have also been reported in healthy individuals when engaged in tasks such as the Sound-Induced Flash-Illusion (SIFI). The temporal dynamics of the SIFI have been recently tied to the speed of occipital alpha rhythms (IAF), with faster oscillations entailing reduced temporal windows within which the illusion is experienced. In this regard, entrainment-based protocols have not yet implemented rhythmic transcranial magnetic stimulation (rhTMS) to causally test for this relationship. It thus remains to be evaluated whether rhTMS-induced acoustic and somatosensory sensations may not specifically interfere with the illusion. Here, we addressed this issue by asking 27 volunteers to perform a SIFI paradigm under different Sham and active rhTMS protocols, delivered over the occipital pole at the IAF. Although TMS has been proven to act upon brain tissues excitability, results show that the SIFI occurred for both Sham and active rhTMS, with the illusory rate not being significantly different between baseline and stimulation conditions. This aligns with the discrete sampling hypothesis, for which alpha amplitude modulation, known to reflect changes in cortical excitability, should not account for changes in the illusory rate. Moreover, these findings highlight the viability of rhTMS-based interventions as a means to probe the neuroelectric signatures of illusory and hallucinatory audiovisual experiences, in healthy and neuropsychiatric populations.

Long-term Tai Chi training reduces the fusion illusion in older adults

Sound-induced flash illusion (SiFI) is an auditory-dominated audiovisual integration phenomenon that can be used as a reliable indicator of audiovisual integration. Although previous studies have found that Tai Chi exercise has a promoting effect on cognitive processing, such as executive functions, the effect of Tai Chi exercise on early perceptual processing has yet to be investigated. This study used the classic SiFI paradigm to investigate the effects of long-term Tai Chi exercise on multisensory integration in older adults. We compared older adults with long-term Tai Chi exercise experience with those with long-term walking exercise. The results showed that the accuracy of the Tai Chi group was higher than that of the control group under the fusion illusion condition, mainly due to the increased perceptual sensitivity to flashes. However, there was no significant difference between the two groups in the fission illusion. These results indicated that the fission and fusion illusions were affected differently by Tai Chi exercise, and this was attributable to the association of the participants' flash discriminability with them. The present study provides preliminary evidence that long-term Tai Chi exercise improves older adults' multisensory integration, which occurs in early perceptual processing.

Differences in eccentricity for sound-induced flash illusion in four visual fields

A sound-induced flash illusion (SiFI) is a multisensory illusion dominated by auditory stimuli, in which the individual perceives that the number of visual flashes is equal to the number of auditory stimuli when visual flashes are presented along with an unequal number of auditory stimuli. Although the mechanisms underlying fission and fusion illusions have been documented, there is not yet a consensus on how they vary according to the different eccentricities. In the present study, by incorporating the classic SiFI paradigm into four different eccentricities, we aimed to investigate whether the SiFI varies under the different eccentricities. The results showed that the fission illusion varied significantly across the four eccentricities, with the perifovea (7°) and peripheral (11°) illusions being greater than the fovea and parafovea (3°) illusions. In contrast, the fusion illusion did not vary significantly across the four eccentricities. Our findings revealed that SiFI was affected by different visual fields and that there were differences between the fission and the fusion illusions. Furthermore, by examining the SiFI of eccentricity across visual fields, this study also suggests that bottom-up factors affect the SiFI.

Individual alpha frequency appears unrelated to the latency of early visual responses

A large body of work has linked neural oscillations in the alpha-band (8-13 Hz) to visual perceptual outcomes. In particular, studies have found that alpha phase prior to stimulus onset predicts stimulus detection, and sensory responses and that the frequency of alpha can predict temporal properties of perception. These findings have bolstered the idea that alpha-band oscillations reflect rhythmic sampling of visual information, however the mechanisms of this are unclear. Recently two contrasting hypotheses have been proposed. According to the rhythmic perception account, alpha oscillations impose phasic inhibition on perceptual processing and primarily modulate the amplitude or strength of visual responses and thus the likelihood of stimulus detection. On the other hand, the discrete perception account proposes that alpha activity discretizes perceptual inputs thereby reorganizing the timing (not only the strength) of perceptual and neural processes. In this paper, we sought neural evidence for the discrete perception account by assessing the correlation between individual alpha frequencies (IAF) and the latency of early visual evoked event-related potential (ERP) components. If alpha cycles were responsible for shifting neural events in time, then we may expect higher alpha frequencies to be associated with earlier afferent visual ERPs. Participants viewed large checkerboard stimuli presented to either the upper or lower visual field that were designed to elicit a large C1 ERP response (thought to index feedforward primary visual cortex activation). We found no reliable correlation between IAF and the C1 latency, or subsequent ERP component latencies, suggesting that the timing of these visual-evoked potentials was not modulated by alpha frequency. Our results thus fail to find evidence for discrete perception at the level of early visual responses but leave open the possibility of rhythmic perception.

Effects of Rhythmic Transcranial Magnetic Stimulation in the Alpha-Band on Visual Perception Depend on Deviation From Alpha-Peak Frequency: Faster Relative Transcranial Magnetic Stimulation Alpha-Pace Improves Performance

Alpha-band oscillatory activity over occipito-parietal areas is involved in shaping perceptual and cognitive processes, with a growing body of electroencephalographic (EEG) evidence indicating that pre-stimulus alpha-band amplitude relates to the subjective perceptual experience, but not to objective measures of visual task performance (discrimination accuracy). The primary aim of the present transcranial magnetic stimulation (TMS) study was to investigate whether causality can be established for this relationship, using rhythmic (alpha-band) TMS entrainment protocols. It was anticipated that pre-stimulus 10 Hz-TMS would induce changes in subjective awareness ratings but not accuracy, in the visual hemifield contralateral to TMS. To test this, we administered 10 Hz-TMS over the right intraparietal sulcus prior to visual stimulus presentation in 17 participants, while measuring their objective performance and subjective awareness in a visual discrimination task. Arrhythmic and 10 Hz sham-TMS served as control conditions (within-participant design). Resting EEG was used to record individual alpha frequency (IAF). A study conducted in parallel to ours with a similar design but reported after we completed data collection informed further, secondary analyses for a causal relationship between pre-stimulus alpha-frequency and discrimination accuracy. This was explored through a regression analysis between rhythmic-TMS alpha-pace relative to IAF and performance measures. Our results revealed that contrary to our primary expectation, pre-stimulus 10 Hz-TMS did not affect subjective measures of performance, nor accuracy, relative to control-TMS. This null result is in accord with a recent finding showing that for influencing subjective measures of performance, alpha-TMS needs to be applied post-stimulus. In addition, our secondary analysis showed that IAF was positively correlated with task accuracy across participants, and that 10 Hz-TMS effects on accuracy—but not awareness ratings—depended on IAF: The slower (or faster) the IAF, relative to the fixed 10 Hz TMS frequency, the stronger the TMS-induced performance improvement (or worsening), indicating that 10 Hz-TMS produced a gain (or a loss) in individual performance, directly depending on TMS-pace relative to IAF. In support of recent reports, this is evidence for alpha-frequency playing a causal role in perceptual sensitivity likely through regulating the speed of sensory sampling.