Auditory Sensitivity and Decision Criteria Oscillate at Different Frequencies Separately for the Two Ears

Walking modulates visual detection performance according to stride cycle phase

Walking is among our most frequent and natural of voluntary behaviours, yet the consequences of locomotion upon perceptual and cognitive function remain largely unknown. Recent work has highlighted that although walking feels smooth and continuous, critical phases exist within each step for the successful coordination of perceptual and motor function. Here, we test whether these phasic demands impact upon visual perception, by assessing performance in a visual detection task during natural unencumbered walking. We finely sample visual performance over the stride cycle as participants walk along a smooth linear path at a comfortable speed in a wireless virtual reality environment. At the group-level, accuracy, reaction times, and response likelihood show strong oscillations, modulating at approximately 2 cycles per stride (~2 Hz) with a marked phase of optimal performance aligned with the swing phase of each step. At the participant level, Bayesian inference of population prevalence reveals highly prevalent oscillations in visual detection performance that cluster in two idiosyncratic frequency ranges (2 or 4 cycles per stride), with a strong phase alignment across participants.

Neural tracking of continuous acoustics: properties, speech-specificity and open questions

Human speech is a particularly relevant acoustic stimulus for our species, due to its role of information transmission during communication. Speech is inherently a dynamic signal, and a recent line of research focused on neural activity following the temporal structure of speech. We review findings that characterise neural dynamics in the processing of continuous acoustics and that allow us to compare these dynamics with temporal aspects in human speech. We highlight properties and constraints that both neural and speech dynamics have, suggesting that auditory neural systems are optimised to process human speech. We then discuss the speech-specificity of neural dynamics and their potential mechanistic origins and summarise open questions in the field.

Rhythmic Entrainment Echoes in Auditory Perception

Rhythmic entrainment echoes-rhythmic brain responses that outlast rhythmic stimulation-can demonstrate endogenous neural oscillations entrained by the stimulus rhythm. Here, we tested for such echoes in auditory perception. Participants detected a pure tone target, presented at a variable delay after another pure tone that was rhythmically modulated in amplitude. In four experiments involving 154 human (female and male) participants, we tested (1) which stimulus rate produces the strongest entrainment echo and, inspired by the tonotopical organization of the auditory system and findings in nonhuman primates, (2) whether these are organized according to sound frequency. We found the strongest entrainment echoes after 6 and 8 Hz stimulation, respectively. The best moments for target detection (in phase or antiphase with the preceding rhythm) depended on whether sound frequencies of entraining and target stimuli matched, which is in line with a tonotopical organization. However, for the same experimental condition, best moments were not always consistent across experiments. We provide a speculative explanation for these differences that relies on the notion that neural entrainment and repetition-related adaptation might exercise competing opposite influences on perception. Together, we find rhythmic echoes in auditory perception that seem more complex than those predicted from initial theories of neural entrainment.SIGNIFICANCE STATEMENT Rhythmic entrainment echoes are rhythmic brain responses that are produced by a rhythmic stimulus and persist after its offset. These echoes play an important role for the identification of endogenous brain oscillations, entrained by rhythmic stimulation, and give us insights into whether and how participants predict the timing of events. In four independent experiments involving >150 participants, we examined entrainment echoes in auditory perception. We found that entrainment echoes have a preferred rate (between 6 and 8 Hz) and seem to follow the tonotopic organization of the auditory system. Although speculative, we also found evidence that several, potentially competing processes might interact to produce such echoes, a notion that might need to be considered for future experimental design.

Alerting attention is sufficient to induce a phase-dependent behavior that can be predicted by frontal EEG

Recent studies suggest that attention is rhythmic. Whether that rhythmicity can be explained by the phase of ongoing neural oscillations, however, is still debated. We contemplate that a step toward untangling the relationship between attention and phase stems from employing simple behavioral tasks that isolate attention from other cognitive functions (perception/decision-making) and by localized monitoring of neural activity with high spatiotemporal resolution over the brain regions associated with the attentional network. In this study, we investigated whether the phase of electroencephalography (EEG) oscillations predicts alerting attention. We isolated the alerting mechanism of attention using the Psychomotor Vigilance Task, which does not involve a perceptual component, and collected high resolution EEG using novel high-density dry EEG arrays at the frontal region of the scalp. We identified that alerting attention alone is sufficient to induce a phase-dependent modulation of behavior at EEG frequencies of 3, 6, and 8 Hz throughout the frontal region, and we quantified the phase that predicts the high and low attention states in our cohort. Our findings disambiguate the relationship between EEG phase and alerting attention.

Slow neural oscillations explain temporal fluctuations in distractibility

Human environments comprise various sources of distraction, which often occur unexpectedly in time. The proneness to distraction (i.e., distractibility) is posited to be independent of attentional sampling of targets, but its temporal dynamics and neurobiological basis are largely unknown. Brain oscillations in the theta band (3 - 8Hz) have been associated with fluctuating neural excitability, which is hypothesised here to explain rhythmic modulation of distractibility. In a pitch discrimination task (N = 30) with unexpected auditory distractors, we show that distractor-evoked neural responses in the electroencephalogram and perceptual susceptibility to distraction were co-modulated and cycled approximately 3 - 5 times per second. Pre-distractor neural phase in left inferior frontal and insular cortex regions explained fluctuating distractibility. Thus, human distractibility is not constant but fluctuates on a subsecond timescale. Furthermore, slow neural oscillations subserve the behavioural consequences of a hitherto largely unexplained but ever-increasing phenomenon in modern environments - distraction by unexpected sound.

Saccadic modulation of neural excitability in auditory areas of the neocortex

In natural "active" vision, humans and other primates use eye movements (saccades) to sample bits of information from visual scenes. In the visual cortex, non-retinal signals linked to saccades shift visual cortical neurons into a high excitability state as each saccade ends. The extent of this saccadic modulation outside of the visual system is unknown. Here, we show that during natural viewing, saccades modulate excitability in numerous auditory cortical areas with a temporal pattern complementary to that seen in visual areas. Control somatosensory cortical recordings indicate that the temporal pattern is unique to auditory areas. Bidirectional functional connectivity patterns suggest that these effects may arise from regions involved in saccade generation. We propose that by using saccadic signals to yoke excitability states in auditory areas to those in visual areas, the brain can improve information processing in complex natural settings.

Cochlear Theta Activity Oscillates in Phase Opposition during Interaural Attention

It is widely established that sensory perception is a rhythmic process as opposed to a continuous one. In the context of auditory perception, this effect is only established on a cortical and behavioral level. Yet, the unique architecture of the auditory sensory system allows its primary sensory cortex to modulate the processes of its sensory receptors at the cochlear level. Previously, we could demonstrate the existence of a genuine cochlear theta (∼6-Hz) rhythm that is modulated in amplitude by intermodal selective attention. As the study's paradigm was not suited to assess attentional effects on the oscillatory phase of cochlear activity, the question of whether attention can also affect the temporal organization of the cochlea's ongoing activity remained open. The present study utilizes an interaural attention paradigm to investigate ongoing otoacoustic activity during a stimulus-free cue-target interval and an omission period of the auditory target in humans. We were able to replicate the existence of the cochlear theta rhythm. Importantly, we found significant phase opposition between the two ears and attention conditions of anticipatory as well as cochlear oscillatory activity during target presentation. Yet, the amplitude was unaffected by interaural attention. These results are the first to demonstrate that intermodal and interaural attention deploy different aspects of excitation and inhibition at the first level of auditory processing. Whereas intermodal attention modulates the level of cochlear activity, interaural attention modulates the timing.

Motor-induced oscillations in choice response performance

Recently, numerous studies have revealed 4-12 Hz fluctuations of behavioral performance in a multitude of tasks. The majority has utilized stimuli near detection threshold and observed related fluctuations in hit-rates, attributing these to perceptual or attentional processes. As neural oscillations in the 8-20 Hz range also feature prominently in cortical motor areas, they might cause fluctuations in the ability to induce responses, independent of attentional capabilities. Additionally, different effectors (e.g., the left versus right hand) might be cyclically prioritized in an alternating fashion, similar to the attentional sampling of distinct locations, objects, or memory templates. Here, we investigated these questions via a behavioral dense-sampling approach. Twenty-six participants performed a simple visual discrimination task using highly salient stimuli. We varied the interval between each motor response and the subsequent target from 330 to 1040 ms, and analyzed performance as a function of this interval. Our data show significant fluctuations of both RTs and sensitivity between 12.5 and 25 Hz, but no evidence for an alternating prioritization of left- versus right-hand responses. While our results suggest an impact of motor-related signals on performance oscillations, they might additionally be influenced by perceptual processes earlier in the processing hierarchy. In summary, we demonstrate that behavioral oscillations generalize to situations involving highly salient stimuli, closer to everyday life. Moreover, our work adds to the literature by showing fluctuations at a high speed, which might be a consequence of both low task difficulty and the involvement of sensorimotor rhythms.

There Is More Evidence of Rhythmic Attention than Can Be Found in Behavioral Studies: Perspective on Brookshire, 2022

Recent research indicates periodicity in attention-related sampling and switching, with some of the initial findings coming from behavioral studies. Brookshire [Brookshire, G. Putative rhythms in attentional switching can be explained by aperiodic temporal structure. Nature Human Behaviour, 2022, https://doi.org/10.1038/s41562-022-01364-0], points out that widely used approaches to testing for rhythms in behavioral times series can misclassify consistent aperiodic patterns in temporal structure as periodic patterns. Evidence for rhythmic attention, however, is not limited to behavioral data. Here, I briefly discuss (i) issues with differentiating periodic and aperiodic structure in both behavioral and neural time series, (ii) findings from neural data that are consistent with rhythmic sampling and switching during attentional deployment, and (iii) whether alternative approaches to establishing periodicity in behavioral time series, recommended by Brookshire are appropriate for this particular research topic.

Visual priming and serial dependence are mediated by separate mechanisms

Perceptual history influences current perception, readily revealed by visual priming (the facilitation of responses on repeated presentations of similar stimuli) and by serial dependence (systematic biases toward the previous stimuli). We asked whether the two phenomena shared perceptual mechanisms. We modified the standard “priming of pop-out” paradigm to measure both priming and serial dependence concurrently. The stimulus comprised three grating patches, one or two red, and the other green. Participants identified the color singleton (either red or green), and reproduced its orientation. Trial sequences were designed to maximize serial dependence, and long runs of priming color and position. The results showed strong effects of priming, both on reaction times and accuracy, which accumulated steadily over time, as generally reported in the literature. The serial dependence effects were also strong, but did not depend on previous color, nor on the run length. Reaction times measured under various conditions of repetition or change of priming color or position were reliably correlated with imprecision in orientation reproduction, but reliably uncorrelated with magnitude of serial dependence. The results suggest that visual priming and serial dependence are mediated by different neural mechanisms. We propose that priming affects sensitivity, possibly via attention-like mechanisms, whereas serial dependence affects criteria, two orthogonal dimensions in the signal detection theory.

Quantifying rhythmicity in perceptual reports

Several recent studies investigated the rhythmic nature of cognitive processes that lead to perception and behavioral report. These studies used different methods, and there has not yet been an agreement on a general standard. Here, we present a way to test and quantitatively compare these methods. We simulated behavioral data from a typical experiment and analyzed these data with several methods. We applied the main methods found in the literature, namely sine-wave fitting, the discrete Fourier transform (DFT) and the least square spectrum (LSS). DFT and LSS can be applied both on the average accuracy time course and on single trials. LSS is mathematically equivalent to DFT in the case of regular, but not irregular sampling - which is more common. LSS additionally offers the possibility to take into account a weighting factor which affects the strength of the rhythm, such as arousal. Statistical inferences were done either on the investigated sample (fixed-effects) or on the population (random-effects) of simulated participants. Multiple comparisons across frequencies were corrected using False Discovery Rate, Bonferroni, or the Max-Based approach. To perform a quantitative comparison, we calculated sensitivity, specificity and D-prime of the investigated analysis methods and statistical approaches. Within the investigated parameter range, single-trial methods had higher sensitivity and D-prime than the methods based on the average accuracy time course. This effect was further increased for a simulated rhythm of higher frequency. If an additional (observable) factor influenced detection performance, adding this factor as weight in the LSS further improved sensitivity and D-prime. For multiple comparison correction, the Max-Based approach provided the highest specificity and D-prime, closely followed by the Bonferroni approach. Given a fixed total amount of trials, the random-effects approach had higher D-prime when trials were distributed over a larger number of participants, even though this gave less trials per participant. Finally, we present the idea of using a dampened sinusoidal oscillator instead of a simple sinusoidal function, to further improve the fit to behavioral rhythmicity observed after a reset event.

Cyclic reactivation of distinct feature dimensions in human visual working memory

Several recent behavioral studies have observed 4-10 Hz rhythmic fluctuations in attention-related performance over time. So far, this rhythmic attentional sampling has predominantly been demonstrated with regards to external visual attention, directed toward one single feature dimension. Whether and how attention might sample from concurrent internal representations of different feature dimensions held in working memory (WM) is currently largely unknown. To elucidate this issue, we conducted a human behavioral dense-sampling experiment, in which participants had to hold representations of two distinct feature dimensions (color and orientation) in WM. By querying the contents of WM at 72 time-points after encoding, we estimated the activity time course of the individual feature representations. Our results demonstrate an oscillatory component at 9.4 Hz in the joint time courses of both representations, presumably reflecting a common early perceptual sampling process in the alpha-frequency range. Furthermore, we observed an oscillatory component at 3.5 Hz in the time course difference between the two representations. This likely corresponds to a later attentional sampling process and indicates that internal representations of distinct features are activated in alteration. In summary, we demonstrate the cyclic reactivation of internal WM representations of distinct feature dimensions, as well as the co-occurrence of behavioral fluctuations at distinct frequencies, presumably associated to internal perceptual- and attentional rhythms. In addition, our findings also challenge a model of strict parallel processing in visual search, thus, providing novel input to the ongoing debate on whether search for more than one target feature constitutes a parallel- or a sequential mechanism.

Putative rhythms in attentional switching can be explained by aperiodic temporal structure

The neural and perceptual effects of attention were traditionally assumed to be sustained over time, but recent work suggests that covert attention rhythmically switches between objects at 3-8 Hz. Here I use simulations to demonstrate that the analysis approaches commonly used to test for rhythmic oscillations generate false positives in the presence of aperiodic temporal structure. I then propose two alternative analyses that are better able to discriminate between periodic and aperiodic structure in time series. Finally, I apply these alternative analyses to published datasets and find no evidence for behavioural rhythms in attentional switching after accounting for aperiodic temporal structure. The techniques presented here will help clarify the periodic and aperiodic dynamics of perception and of cognition more broadly.

Attentional sampling of visual and auditory objects is captured by theta-modulated neural activity

Recent evidence suggests that visual attention alternately samples two behaviourally relevant objects at approximately 4 Hz, rhythmically shifting between the objects. Whether similar attentional rhythms exist in other sensory modalities, however, is not yet clear. We therefore adapted and extended an established paradigm to investigate visual and potential auditory attentional rhythms, as well as possible interactions, on both a behavioural (detection performance, N = 33) and a neural level (EEG, N = 18). The results during unimodal attention demonstrate that both visual- and auditory-target detection fluctuate at frequencies of approximately 4-8 Hz, confirming that attentional rhythms are not specific to visual processing. The EEG recordings provided evidence of oscillatory activity that underlies these behavioural effects. At right and left occipital EEG electrodes, we detected counter-phasic theta-band activity (4-8 Hz), mirroring behavioural evidence of alternating sampling between the objects presented right and left of central fixation, respectively. Similarly, alpha-band activity as a signature of relatively suppressed sensory encoding showed a theta-rhythmic, counter-phasic change in power. Moreover, these theta-rhythmic changes in alpha power were predictive of behavioural performance in both sensory modalities. Overall, the present findings provide a new perspective on the multimodal rhythmicity of attention.

Theta-Rhythmic Oscillation of Working Memory Performance

Representations held in working memory are crucial in guiding human attention in a goal-directed fashion. Currently, it is debated whether only a single representation or several of these representations can be active and bias behavior at any given moment. In the present study, 25 university students performed a behavioral dense-sampling experiment to produce an estimate of the temporal-activation patterns of two simultaneously held visual templates. We report two key novel results. First, performance related to both representations was not continuous but fluctuated rhythmically at 6 Hz. This corresponds to neural oscillations in the theta band, the functional importance of which in working memory is well established. Second, our findings suggest that two concurrently held representations may be prioritized in alternation, not simultaneously. Our data extend recent research on rhythmic sampling of external information by demonstrating an analogous mechanism in the cyclic activation of internal working memory representations.

Alpha-Band Phase Modulates Bottom-up Feature Processing

Recent studies reveal that attention operates in a rhythmic manner, that is, sampling each location or feature alternatively over time. However, most evidence derives from top-down tasks, and it remains elusive whether bottom-up processing also entails dynamic coordination. Here, we developed a novel feature processing paradigm and combined time-resolved behavioral measurements and electroencephalogram (EEG) recordings to address the question. Specifically, a salient color in a multicolor display serves as a noninformative cue to capture attention and presumably reset the oscillations of feature processing. We then measured the behavioral performance of a probe stimulus associated with either high- or low-salient color at varied temporal lags after the cue. First, the behavioral results (i.e., reaction time) display an alpha-band (~8 Hz) profile with a consistent phase lag between high- and low-salient conditions. Second, simultaneous EEG recordings show that behavioral performance is modulated by the phase of alpha-band neural oscillation at the onset of the probes. Finally, high- and low-salient probes are associated with distinct preferred phases of alpha-band neural oscillations. Taken together, our behavioral and neural results convergingly support a central function of alpha-band rhythms in feature processing, that is, features with varied saliency levels are processed at different phases of alpha neural oscillations.

Rhythmic Modulation of Visual Perception by Continuous Rhythmic Auditory Stimulation

At any given moment our sensory systems receive multiple, often rhythmic, inputs from the environment. Processing of temporally structured events in one sensory modality can guide both behavioral and neural processing of events in other sensory modalities, but whether this occurs remains unclear. Here, we used human electroencephalography (EEG) to test the cross-modal influences of a continuous auditory frequency-modulated (FM) sound on visual perception and visual cortical activity. We report systematic fluctuations in perceptual discrimination of brief visual stimuli in line with the phase of the FM-sound. We further show that this rhythmic modulation in visual perception is related to an accompanying rhythmic modulation of neural activity recorded over visual areas. Importantly, in our task, perceptual and neural visual modulations occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. As such, the results provide a critical validation for the existence and functional role of cross-modal entrainment and demonstrates its utility for organizing the perception of multisensory stimulation in the natural environment.SIGNIFICANCE STATEMENT Our sensory environment is filled with rhythmic structures that are often multi-sensory in nature. Here, we show that the alignment of neural activity to the phase of an auditory frequency-modulated (FM) sound has cross-modal consequences for vision: yielding systematic fluctuations in perceptual discrimination of brief visual stimuli that are mediated by accompanying rhythmic modulation of neural activity recorded over visual areas. These cross-modal effects on visual neural activity and perception occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. The current work shows that continuous auditory fluctuations in the natural environment can provide a pacing signal for neural activity and perception across the senses.

Predictive visuo-motor communication through neural oscillations

The mechanisms coordinating action and perception over time are poorly understood. The sensory cortex needs to prepare for upcoming changes contingent on action, and this requires temporally precise communication that takes into account the variable delays between sensory and motor processing. Several theorists^1,2 have proposed synchronization of the endogenous oscillatory activity observed in most regions of the brain³ as the basis for an efficient and flexible communication protocol between distal brain areas,^2,4 a concept known as "communication through coherence." Synchronization of endogenous oscillations^5,6 occurs after a salient sensory stimulus, such as a flash or a sound,^7-11 and after a voluntary action,^12-18 and this directly impacts perception, causing performance to oscillate rhythmically over time. Here we introduce a novel fMRI paradigm to probe the neural sources of oscillations, based on the concept of perturbative signals, which overcomes the low temporal resolution of BOLD signals. The assumption is that a synchronized endogenous rhythm will modulate cortical excitability rhythmically, which should be reflected in the BOLD responses to brief stimuli presented at different phases of the oscillation cycle. We record rhythmic oscillations of V1 BOLD synchronized by a simple voluntary action, in phase with behaviorally measured oscillations in visual sensitivity in the theta range. The functional connectivity between V1 and M1 also oscillates at the same rhythm. By demonstrating oscillatory temporal coupling between primary motor and sensory cortices, our results strongly implicate communication through coherence to achieve precise coordination and to encode sensory-motor timing.

Shared resources between visual attention and visual working memory are allocated through rhythmic sampling

Attention and visual working memory (VWM) are among the most theoretically detailed and empirically tested constructs in human cognition. Nevertheless, the nature of the interrelation between selective attention and VWM still presents a fundamental controversy: Do they rely on the same cognitive resources or not? The present study aims at disentangling this issue by capitalizing on recent evidence showing that attention is a rhythmic phenomenon, oscillating over short time windows. Using a dual-task approach, we combined a classic VWM task with a visual detection task in which we densely sampled detection performance during the time between the memory and the test array. Our results show that an increment in VWM load was related to reduced detection of near-threshold visual stimuli. Importantly, we observed an oscillatory pattern in detection at ~7.5 Hz in the low VWM load conditions, which decreased towards ~5 Hz in the high VWM load condition. These findings suggest that the frequency of this sampling rhythm changes according to the allocation of attentional resources to either the VWM or the detection task. This pattern of results is consistent with a central sampling attentional rhythm which allocates shared attentional resources both to the flow of external visual stimulation and to the internal maintenance of visual information.

Cochlear activity in silent cue-target intervals shows a theta-rhythmic pattern and is correlated to attentional alpha and theta modulations

BACKGROUND

A long-standing debate concerns where in the processing hierarchy of the central nervous system (CNS) selective attention takes effect. In the auditory system, cochlear processes can be influenced via direct and mediated (by the inferior colliculus) projections from the auditory cortex to the superior olivary complex (SOC). Studies illustrating attentional modulations of cochlear responses have so far been limited to sound-evoked responses. The aim of the present study is to investigate intermodal (audiovisual) selective attention in humans simultaneously at the cortical and cochlear level during a stimulus-free cue-target interval.

RESULTS

We found that cochlear activity in the silent cue-target intervals was modulated by a theta-rhythmic pattern (~ 6 Hz). While this pattern was present independently of attentional focus, cochlear theta activity was clearly enhanced when attending to the upcoming auditory input. On a cortical level, classical posterior alpha and beta power enhancements were found during auditory selective attention. Interestingly, participants with a stronger release of inhibition in auditory brain regions show a stronger attentional modulation of cochlear theta activity.

CONCLUSIONS

These results hint at a putative theta-rhythmic sampling of auditory input at the cochlear level. Furthermore, our results point to an interindividual variable engagement of efferent pathways in an attentional context that are linked to processes within and beyond processes in auditory cortical regions.

Propagation and update of auditory perceptual priors through alpha and theta rhythms

To maintain a continuous and coherent percept over time, the brain makes use of past sensory information to anticipate forthcoming stimuli. We recently showed that auditory experience of the immediate past is propagated through ear-specific reverberations, manifested as rhythmic fluctuations of decision bias at alpha frequencies. Here, we apply the same time-resolved behavioural method to investigate how perceptual performance changes over time under conditions of stimulus expectation and to examine the effect of unexpected events on behaviour. As in our previous study, participants were required to discriminate the ear-of-origin of a brief monaural pure tone embedded in uncorrelated dichotic white noise. We manipulated stimulus expectation by increasing the target probability in one ear to 80%. Consistent with our earlier findings, performance did not remain constant across trials, but varied rhythmically with delay from noise onset. Specifically, decision bias showed a similar oscillation at ~9 Hz, which depended on ear congruency between successive targets. This suggests rhythmic communication of auditory perceptual history occurs early and is not readily influenced by top-down expectations. In addition, we report a novel observation specific to infrequent, unexpected stimuli that gave rise to oscillations in accuracy at ~7.6 Hz one trial after the target occurred in the non-anticipated ear. This new behavioural oscillation may reflect a mechanism for updating the sensory representation once a prediction error has been detected.

Cortical Distance but Not Physical Distance Modulates Attentional Rhythms

It has been well documented that the spotlight of attention is intrinsically rhythmic and oscillates by discretely sampling either single or multiple objects. However, the neural site of attentional rhythms remains poorly understood. Considering the topography of visual cortical areas, we modulated the cortical distances of two gratings while fixing the corresponding retinal distance by setting the gratings on different sides (cortically far, Experiment 1) or on the same side (cortically near, Experiment 2) of the vertical median, to investigate the interhemispheric divide effect in attentional rhythms. The cue-target stimulus onset asynchrony (SOA) varied from 0.1 s to 1.08 s in 20-ms increments, allowing fluctuations below 50 Hz to be examined. The results showed that when the two stimuli were on opposite sides of the vertical meridian, attentional rhythms were observed at theta and alpha frequencies, consistent with the results reported in previous studies. However, when the two stimuli were located on the same side of the vertical meridian, attentional rhythms were not observed. This study indicates that attentional rhythms are modulated by cortical distance but not by physical distance.

Theta band behavioral fluctuations synchronized interpersonally during cooperation

Human behavior fluctuates. A growing body of evidence has demonstrated that behavioral performance in perception fluctuates rhythmically, with dynamics closely resembling spectral features of neural oscillations. However, it is unclear whether the behavioral fluctuations in a complex cooperation context can also express similar rhythmic features, and, more importantly, whether these behavioral rhythms are synchronized among co-actors in a neurophysiologically relevant manner. To answer these questions, we applied a time-resolved approach, previously used for probing individual-level behavioral oscillations in perception, in a complex social interaction context, and further probed dyad-level behavioral synchrony. Twenty pairs of male participants completed, in dyad, joint-action tasks with cooperation or competition demand. We extracted behavioral rhythms from ongoing cooperative performance and measured behavioral synchrony by computing the phase coherence of these behavioral rhythms between dyad members. Despite the absence of significant behavioral oscillations in individuals' amplitude spectrum, we observed enhanced theta-band phase coherence between co-actors' behavioral rhythms during cooperation compared to competition conditions. These results indicate that cooperative behaviors of co-actors fluctuated synchronously within the theta band, providing a behavioral counterpart of theta-band interbrain synchrony in cooperation reported in previous hyperscanning studies. Furthermore, the observed behavioral synchrony could be used as a sensitive predictor of cooperation pattern, as evidenced by its significant correlation with leader-follower relationship during cooperation.

Perceptual Oscillations in Gender Classification of Faces, Contingent on Stimulus History

Perception is a proactive ‘‘predictive’’ process, in which the brain takes advantage of past experience to make informed guesses about the world to test against sensory data. Here we demonstrate that in the judgment of the gender of faces, beta rhythms play an important role in communicating perceptual experience. Observers classified in forced choice as male or female, a sequence of face stimuli, which were physically constructed to be male or female or androgynous (equal morph). Classification of the androgynous stimuli oscillated rhythmically between male and female, following a complex waveform comprising 13.5 and 17 Hz. Parsing the trials based on the preceding stimulus showed that responses to androgynous stimuli preceded by male stimuli oscillated reliably at 17 Hz, whereas those preceded by female stimuli oscillated at 13.5 Hz. These results suggest that perceptual priors for face perception from recent perceptual memory are communicated through frequency-coded beta rhythms.

•

Perception is strongly influenced by prior expectations and perceptual experience

•

We show perceptual priors for face perception are communicated through beta rhythms

•

Priors for male and female are communicated via distinct beta frequencies

The rhythm of attention: Perceptual modulation via rhythmic entrainment is lowpass and attention mediated

Modulation patterns are known to carry critical predictive cues to signal detection in complex acoustic environments. The current study investigated the persistence of masker modulation effects on postmodulation detection of probe signals. Hickok, Farahbod, and Saberi (Psychological Science, 26, 1006-1013, 2015) demonstrated that thresholds for a tone pulse in stationary noise follow a predictable periodic pattern when preceded by a 3-Hz amplitude modulated masker. They found entrainment of detection patterns to the modulation envelope lasting for approximately two cycles after termination of modulation. The current study extends these results to a wide range of modulation rates by mapping the temporal modulation transfer function for persistent modulatory effects. We found significant entrainment to modulation rates of 2 and 3 Hz, a weaker effect at 5 Hz, and no entrainment at higher rates (8 to 32 Hz). The effect seems critically dependent on attentional mechanisms, requiring temporal and level uncertainty of the probe signal. Our findings suggest that the persistence of modulatory effects on signal detection is lowpass in nature and attention based.

Synchronisation of Neural Oscillations and Cross-modal Influences

At any given moment, we receive multiple signals from our different senses. Prior research has shown that signals in one sensory modality can influence neural activity and behavioural performance associated with another sensory modality. Recent human and nonhuman primate studies suggest that such cross-modal influences in sensory cortices are mediated by the synchronisation of ongoing neural oscillations. In this review, we consider two mechanisms proposed to facilitate cross-modal influences on sensory processing, namely cross-modal phase resetting and neural entrainment. We consider how top-down processes may further influence cross-modal processing in a flexible manner, and we highlight fruitful directions for further research.

Auditory Perception: A Rhythm Reflecting the Past

Previous research has demonstrated that auditory perception fluctuates rhythmically after a cue. New research shows that these 'behavioural oscillations' critically depend on expectations from preceding stimulation.

Auditory Perceptual History Is Propagated through Alpha Oscillations

Perception is a proactive, “predictive” process, in which the brain relies, at least in part, on accumulated experience to make best guesses about the world to test against sensory data, updating the guesses as new experience is acquired. Using novel behavioral methods, the present study demonstrates the role of alpha rhythms in communicating past perceptual experience. Participants were required to discriminate the ear of origin of brief sinusoidal tones that were presented monaurally at random times within a burst of uncorrelated dichotic white noise masks. Performance was not constant but varied with delay after noise onset in an oscillatory manner at about 9 Hz (alpha rhythm). Importantly, oscillations occurred only for trials preceded by a target tone to the same ear, either on the previous trial or two trials back. These results suggest that communication of perceptual history generates neural oscillations within specific perceptual circuits, strongly implicating behavioral oscillations in predictive perception and with formation of working memory.

•

We demonstrate the role of alpha rhythms in the propagation of perceptual history

•

Auditory decisions were rhythmically biased by stimuli presented 1 or 2 trials back

•

Bias oscillated at ∼9 Hz only when successive stimuli occurred in the same ear

•

Alpha is strongly implicated in predictive perception and working memory formation

Evidence for the Rhythmic Perceptual Sampling of Auditory Scenes

Converging results suggest that perception is controlled by rhythmic processes in the brain. In the auditory domain, neuroimaging studies show that the perception of sounds is shaped by rhythmic activity prior to the stimulus, and electrophysiological recordings have linked delta and theta band activity to the functioning of individual neurons. These results have promoted theories of rhythmic modes of listening and generally suggest that the perceptually relevant encoding of acoustic information is structured by rhythmic processes along auditory pathways. A prediction from this perspective-which so far has not been tested-is that such rhythmic processes also shape how acoustic information is combined over time to judge extended soundscapes. The present study was designed to directly test this prediction. Human participants judged the overall change in perceived frequency content in temporally extended (1.2-1.8 s) soundscapes, while the perceptual use of the available sensory evidence was quantified using psychophysical reverse correlation. Model-based analysis of individual participant's perceptual weights revealed a rich temporal structure, including linear trends, a U-shaped profile tied to the overall stimulus duration, and importantly, rhythmic components at the time scale of 1-2 Hz. The collective evidence found here across four versions of the experiment supports the notion that rhythmic processes operating on the delta time scale structure how perception samples temporally extended acoustic scenes.

The tempos of performance

Human performance fluctuates over time. Rather than random, the complex time course of variation reflects, among other factors, influences from regular periodic processes operating at multiple time scales. In this review, we consider evidence for how our performance ebbs and flows over fractions of seconds as we engage with sensory objects, over minutes as we perform tasks, and over hours according to homeostatic factors. We propose that rhythms of performance at these multiple tempos arise from the interplay among three sources of influence: intrinsic fluctuations in brain activity, periodicity of external stimulation, and the anticipation of the temporal structure of external stimulation by the brain.

The Common Rhythm of Action and Perception

Research in the last decade has undermined the idea of perception as a continuous process, providing strong empirical support for its rhythmic modulation. More recently, it has been revealed that the ongoing motor processes influence the rhythmic sampling of sensory information. In this review, we will focus on a growing body of evidence suggesting that oscillation-based mechanisms may structure the dynamic interplay between the motor and sensory system and provide a unified temporal frame for their effective coordination. We will describe neurophysiological data, primarily collected in animals, showing phase-locking of neuronal oscillations to the onset of (eye) movements. These data are complemented by novel evidence in humans, which demonstrate the behavioral relevance of these oscillatory modulations and their domain-general nature. Finally, we will discuss the possible implications of these modulations for action-perception coupling mechanisms.

Reaction Time Improvements by Neural Bistability

The often reported reduction of Reaction Time (RT) by Vision Training) is successfully replicated by 81 athletes across sports. This enabled us to achieve a mean reduction of RTs for athletes eye-hand coordination of more than 10%, with high statistical significance. We explain how such an observed effect of Sensorimotor systems' plasticity causing reduced RT can last in practice for multiple days and even weeks in subjects, via a proof of principle. Its mathematical neural model can be forced outside a previous stable (but long) RT into a state leading to reduced eye-hand coordination RT, which is, again, in a stable neural state.

Behavioural oscillations in visual orientation discrimination reveal distinct modulation rates for both sensitivity and response bias

Perception is modulated by ongoing brain oscillations. Psychophysical studies show a voluntary action can synchronize oscillations, producing rhythmical fluctuations of visual contrast sensitivity. We used signal detection to examine whether voluntary action could also synchronize oscillations in decision criterion, and whether that was due to the oscillations of perceptual bias or of motor bias. Trials started with a voluntary button-press. After variable time lags, a grating at threshold contrast was presented briefly and participants discriminated its orientation (45° or −45°) with a mouse-click. Two groups of participants completed the experiment with opposite mappings between grating orientations and response buttons. We calculated sensitivity and criterion in the 800 ms period following the button press. To test for oscillations, we fitted first-order Fourier series to these time series. Alpha oscillations occurred in both sensitivity and criterion at different frequencies: ~8 Hz (sensitivity) and ~10 Hz (criterion). Sensitivity oscillations had the same phase for both stimulus-response mappings. Criterion oscillations, however, showed a strong anti-phase relationship when the two groups were compared, suggesting a motor bias rather than perceptual bias. Our findings suggest two roles for alpha oscillations: in sensitivity, reflecting rhythmic attentional inhibition, and in criterion, indicating dynamic motor-related anticipation or preparation.

Saliency-based Rhythmic Coordination of Perceptual Predictions

Objects, shown explicitly or held in mind internally, compete for limited processing resources. Recent studies have demonstrated that attention samples locations and objects rhythmically. Interestingly, periodic sampling not only operates over objects in the same scene but also occurs for multiple perceptual predictions that are held in attention for incoming inputs. However, how the brain coordinates perceptual predictions that are endowed with different levels of bottom-up saliency information remains unclear. To address the issue, we used a fine-grained behavioral measurement to investigate the temporal dynamics of processing of high- and low-salient visual stimuli, which have equal possibility to occur within experimental blocks. We demonstrate that perceptual predictions associated with different levels of saliency are organized via a theta-band rhythmic course and are optimally processed in different phases within each theta-band cycle. Meanwhile, when the high- and low-salient stimuli are presented in separate blocks and thus not competing with each other, the periodic behavioral profile is no longer present. In summary, our findings suggest that attention samples and coordinates multiple perceptual predictions through a theta-band rhythm according to their relative saliency. Our results, in combination with previous studies, advocate the rhythmic nature of attentional process.

Attention periodically samples competing stimuli during binocular rivalry

The attentional sampling hypothesis suggests that attention rhythmically enhances sensory processing when attending to a single (~8 Hz), or multiple (~4 Hz) objects. Here, we investigated whether attention samples sensory representations that are not part of the conscious percept during binocular rivalry. When crossmodally cued toward a conscious image, subsequent changes in consciousness occurred at ~8 Hz, consistent with the rates of undivided attentional sampling. However, when attention was cued toward the suppressed image, changes in consciousness slowed to ~3.5 Hz, indicating the division of attention away from the conscious visual image. In the electroencephalogram, we found that at attentional sampling frequencies, the strength of inter-trial phase-coherence over fronto-temporal and parieto-occipital regions correlated with changes in perception. When cues were not task-relevant, these effects disappeared, confirming that perceptual changes were dependent upon the allocation of attention, and that attention can flexibly sample away from a conscious image in a task-dependent manner.

Perceptual Oscillation of Audiovisual Time Simultaneity

Action and perception are tightly coupled systems requiring coordination and synchronization over time. How the brain achieves synchronization is still a matter of debate, but recent experiments suggest that brain oscillations may play an important role in this process. Brain oscillations have been also proposed to be fundamental in determining time perception. Here, we had subjects perform an audiovisual temporal order judgment task to investigate the fine dynamics of temporal bias and sensitivity before and after the execution of voluntary hand movement (button-press). The reported order of the audiovisual sequence was rhythmically biased as a function of delay from hand action execution. Importantly, we found that it oscillated at a theta range frequency, starting ∼500 ms before and persisting ∼250 ms after the button-press, with consistent phase-locking across participants. Our results show that the perception of cross-sensory simultaneity oscillates rhythmically in synchrony with the programming phase of a voluntary action, demonstrating a link between action preparation and bias in temporal perceptual judgments.