The Common Rhythm of Action and Perception

A domain-general process for theta-rhythmic sampling of either environmental information or internally stored information

Many everyday tasks, such as shopping for groceries, require the sampling of both environmental information and internally stored information. Selective attention involves the preferential processing and sampling of behaviorally important information from the external environment, while working memory involves the preferential processing and sampling of behaviorally important, internally stored information. These essential cognitive processes share neural resources within a large-scale network that includes frontal, parietal, and sensory cortices, and these shared neural resources can lead to between-domain interactions. Previous research has linked external sampling during selective attention and internal sampling during working memory to theta-rhythmic (3-8 Hz) neural activity in higher-order (e.g., frontal cortices) and sensory regions (e.g., visual cortices). Such theta-rhythmic neural activity might help to resolve the competition for shared neural resources by isolating neural activity associated with different functions over time. Here, we used EEG and a dual-task design (i.e., a task that required both external and internal sampling) to directly compare (i) theta-dependent fluctuations in behavioral performance during external sampling with (ii) theta-dependent fluctuations in behavioral performance during internal sampling. Our findings are consistent with a domain-general, theta-rhythmic process for sampling either external information or internal information. We further demonstrate that interactions between external and internal information-specifically, when to-be-detected information matches to-be-remembered information-are not dependent on theta-band activity (i.e., theta phase). Given that these theta-independent 'match effects' occur during early processing stages (peaking at 75 ms), we propose that theta-rhythmic sampling modulates external and internal information during later processing stages.

Aperiodic activity differences in individuals with high and low temporal processing efficiency

It is known that Temporal Information Processing (TIP) underpins our cognitive functioning. Previous research has focused on the relationship between TIP efficiency and oscillatory brain activity, especially the gamma rhythm; however, non-oscillatory (aperiodic or 1/f) brain activity has often been missed. Recent studies have identified the 1/f component as being important for the functioning of the brain. Therefore, the current study aimed to verify whether TIP efficiency is associated with specific EEG resting state cortical activity patterns, including oscillatory and non-oscillatory (aperiodic) brain activities. To measure individual TIP efficiency, we used two behavioral tasks in which the participant judges the order of two sounds separated by millisecond intervals. Based on the above procedure, participants were classified into two groups with high and low TIP efficiency. Using cluster-based permutation analyses, we examined between-group differences in oscillatory and non-oscillatory (aperiodic) components across the 1-90 Hz range. The results revealed that the groups differed in the aperiodic component across the 30-80 Hz range in fronto-central topography. In other words, participants with low TIP efficiency exhibited higher levels of aperiodic activity, and thus a flatter frequency spectrum compared to those with high TIP efficiency. We conclude that participants with low TIP efficiency display higher levels of 'neural noise', which is associated with poorer quality and speed of neural processing.

Consequences of eye movements for spatial selectivity

What determines spatial tuning in the visual system? Standard views rely on the assumption that spatial information is directly inherited from the relative position of photoreceptors and shaped by neuronal connectivity.1,2 However, human eyes are always in motion during fixation,3,4,5,6 so retinal neurons receive temporal modulations that depend on the interaction of the spatial structure of the stimulus with eye movements. It has long been hypothesized that these modulations might contribute to spatial encoding,7,8,9,10,11,12 a proposal supported by several recent observations.13,14,15,16 A fundamental, yet untested, consequence of this encoding strategy is that spatial tuning is not hard-wired in the visual system but critically depends on how the fixational motion of the eye shapes the temporal structure of the signals impinging onto the retina. Here we used high-resolution techniques for eye-tracking17 and gaze-contingent display control18 to quantitatively test this distinctive prediction. We examined how contrast sensitivity, a hallmark of spatial vision, is influenced by fixational motion, both during normal active fixation and when the spatiotemporal stimulus on the retina is altered to mimic changes in fixational control. We showed that visual sensitivity closely follows the strength of the luminance modulations delivered within a narrow temporal bandwidth, so changes in fixational motion have opposite visual effects at low and high spatial frequencies. By identifying a key role for oculomotor activity in spatial selectivity, these findings have important implications for the perceptual consequences of abnormal eye movements, the sources of perceptual variability, and the function of oculomotor control.

Sensorimotor Oscillations in Human Infants during an Innate Rhythmic Movement

The relationship between cerebral rhythms and early sensorimotor development is not clear. In recent decades, evidence revealed a rhythmic modulation involving sensorimotor processing. A widely corroborated functional role of oscillatory activity is to coordinate the information flow across sensorimotor networks. Their activity is coordinated by event-related synchronisation and desynchronisation in different sensorimotor rhythms, which indicate parallel processes may be occurring in the neuronal network during movement. To date, the dynamics of these brain oscillations and early sensorimotor development are unexplored. Our study investigates the relationship between the cerebral rhythms using EEG and a typical rhythmic movement of infants, the non-nutritive sucking (NNS) behaviour. NNS is an endogenous behaviour that originates from the suck central pattern generator in the brainstem. We find, in 17 infants, that sucking frequency correlates with beta synchronisation within the sensorimotor area in two phases: one strongly anticipating (~3 s) and the other encompassing the start of the motion. These findings suggest that a beta synchronisation of the sensorimotor cortex may influence the sensorimotor dynamics of NNS activity. Our results reveal the importance of rapid brain oscillations in infants and the role of beta synchronisation and their possible role in the communication between cortical and deep generators.

Theoretical and Technical Issues Concerning the Measurement of Alpha Frequency and the Application of Signal Detection Theory: Comment on Buergers and Noppeney (2022)

Classical and recent evidence has suggested that alpha oscillations play a critical role in temporally discriminating or binding successively presented items. Challenging this view, Buergers and Noppeney [Buergers, S., & Noppeney, U. The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022] found that by combining EEG, psychophysics, and signal detection theory, neither prestimulus nor resting-state alpha frequency influences perceptual sensitivity and bias in the temporal binding task. We propose the following four points that should be considered when interpreting the role of alpha oscillations, and especially their frequency, on perceptual temporal binding: (1) Multiple alpha components can be contaminated in conventional EEG analysis; (2) the effect of alpha frequency on perception will interact with alpha power; (3) prestimulus and resting-state alpha frequency can be different from poststimulus alpha frequency, which is the frequency during temporal binding and should be more directly related to temporal binding; and (4) when applying signal detection theory under the assumption of equal variance, the assumption is often incomplete and can be problematic (e.g., the magnitude relationships between individuals in parametric sensitivity may change when converted into nonparametric sensitivity). Future directions, including solutions to each of the issues, are discussed.

Walking modulates visual detection performance according to stride cycle phase

Walking is among our most frequent and natural of voluntary behaviours, yet the consequences of locomotion upon perceptual and cognitive function remain largely unknown. Recent work has highlighted that although walking feels smooth and continuous, critical phases exist within each step for the successful coordination of perceptual and motor function. Here, we test whether these phasic demands impact upon visual perception, by assessing performance in a visual detection task during natural unencumbered walking. We finely sample visual performance over the stride cycle as participants walk along a smooth linear path at a comfortable speed in a wireless virtual reality environment. At the group-level, accuracy, reaction times, and response likelihood show strong oscillations, modulating at approximately 2 cycles per stride (~2 Hz) with a marked phase of optimal performance aligned with the swing phase of each step. At the participant level, Bayesian inference of population prevalence reveals highly prevalent oscillations in visual detection performance that cluster in two idiosyncratic frequency ranges (2 or 4 cycles per stride), with a strong phase alignment across participants.

Scale-invariant changes in corticospinal excitability reflect multiplexed oscillations in the motor output

In the absence of disease, humans produce smooth and accurate movement trajectories. Despite such 'macroscopic' aspect, the 'microscopic' structure of movements reveals recurrent (quasi-rhythmic) discontinuities. To date, it is unclear how the sensorimotor system contributes to the macroscopic and microscopic architecture of movement. Here, we investigated how corticospinal excitability changes in relation to microscopic fluctuations that are naturally embedded within larger macroscopic variations in motor output. Participants performed a visuomotor tracking task. In addition to the 0.25 Hz modulation that is required for task fulfilment (macroscopic scale), the motor output shows tiny but systematic fluctuations at ∼2 and 8 Hz (microscopic scales). We show that motor-evoked potentials (MEPs) elicited by transcranial magnetic stimulation (TMS) during task performance are consistently modulated at all (time) scales. Surprisingly, MEP modulation covers a similar range at both micro- and macroscopic scales, even though the motor output differs by several orders of magnitude. Thus, corticospinal excitability finely maps the multiscale temporal patterning of the motor output, but it does so according to a principle of scale invariance. These results suggest that corticospinal excitability indexes a relatively abstract level of movement encoding that may reflect the hierarchical organisation of sensorimotor processes. KEY POINTS: Motor behaviour is organised on multiple (time)scales. Small but systematic ('microscopic') fluctuations are engrained in larger and slower ('macroscopic') variations in motor output, which are instrumental in deploying the desired motor plan. Corticospinal excitability is modulated in relation to motor fluctuations on both macroscopic and microscopic (time)scales. Corticospinal excitability obeys a principle of scale invariance, that is, it is modulated similarly at all (time)scales, possibly reflecting hierarchical mechanisms that optimise motor encoding.

From neural noise to co-adaptability: Rethinking the multifaceted architecture of motor variability

In the last decade, the source and the functional meaning of motor variability have attracted considerable attention in behavioral and brain sciences. This construct classically combined different levels of description, variable internal robustness or coherence, and multifaceted operational meanings. We provide here a comprehensive review of the literature with the primary aim of building a precise lexicon that goes beyond the generic and monolithic use of motor variability. In the pars destruens of the work, we model three domains of motor variability related to peculiar computational elements that influence fluctuations in motor outputs. Each domain is in turn characterized by multiple sub-domains. We begin with the domains of noise and differentiation. However, the main contribution of our model concerns the domain of adaptability, which refers to variation within the same exact motor representation. In particular, we use the terms learning and (social)fitting to specify the portions of motor variability that depend on our propensity to learn and on our largely constitutive propensity to be influenced by external factors. A particular focus is on motor variability in the context of the sub-domain named co-adaptability. Further groundbreaking challenges arise in the modeling of motor variability. Therefore, in a separate pars construens, we attempt to characterize these challenges, addressing both theoretical and experimental aspects as well as potential clinical implications for neurorehabilitation. All in all, our work suggests that motor variability is neither simply detrimental nor beneficial, and that studying its fluctuations can provide meaningful insights for future research.

The microstructure of intra- and interpersonal coordination

Movements are naturally composed of submovements, i.e. recurrent speed pulses (2-3 Hz), possibly reflecting intermittent feedback-based motor adjustments. In visuomotor (unimanual) synchronization tasks, partners alternate submovements over time, indicating mutual coregulation. However, it is unclear whether submovement coordination is organized differently between and within individuals. Indeed, different types of information may be variably exploited for intrapersonal and interpersonal coordination. Participants performed a series of bimanual tasks alone or in pairs, with or without visual feedback (solo task only). We analysed the relative timing of submovements between their own hands or between their own hands and those of their partner. Distinct coordinative structures emerged at the submovement level depending on the relevance of visual feedback. Specifically, the relative timing of submovements (between partners/effectors) shifts from alternation to simultaneity and a mixture of both when coordination is achieved using vision (interpersonal), proprioception/efference-copy only (intrapersonal, without vision) or all information sources (intrapersonal, with vision), respectively. These results suggest that submovement coordination represents a behavioural proxy for the adaptive weighting of different sources of information within action-perception loops. In sum, the microstructure of movement reveals common principles governing the dynamics of sensorimotor control to achieve both intra- and interpersonal coordination.

The role of neural oscillations in visuo-motor communication at the time of saccades

Saccadic eye-movements are fundamental for active vision, allowing observers to purposefully scan the environment with the high-resolution fovea. In this brief perspective we outline a series of experiments from our laboratories investigating the role of eye-movements and their consequences to active perception. We show that saccades lead to suppression of visual sensitivity at saccadic onset, and that this suppression is accompanied by endogenous neural oscillations in the delta range. Similar oscillations are initiated by purposeful hand movements, which lead to measurable changes in responsivity in area V1, and in the connectivity with motor area M1. Saccades also lead to clear distortions in apparent position, but only for verbal reports, not when participants respond with rapid pointing, consistent with the action of two separate visual systems in neurotypical adults. At the time of saccades, serial dependence, the positive influence on perception of previous stimulus attributes (such as orientation) is particularly strong. Again, these processes are accompanied by neural oscillations, in the alpha and low beta range. In general, oscillations seem to be tightly linked to serial dependence in perception, both in auditory judgments (around 10 Hz), and for visual judgements of face gender (14 Hz for female, 17 Hz for male). Taken together, the studies show that neural oscillations play a fundamental role in dynamic, active vision.

Rhythmic temporal coordination of neural activity prevents representational conflict during working memory

Selective attention¹ is characterized by alternating states associated with either attentional sampling or attentional shifting, helping to prevent functional conflicts by isolating function-specific neural activity in time.^2,3,4,5 We hypothesized that such rhythmic temporal coordination might also help to prevent representational conflicts during working memory.⁶ Multiple items can be simultaneously held in working memory, and these items can be represented by overlapping neural populations.^7,8,9 Traditional theories propose that the short-term storage of to-be-remembered items occurs through persistent neural activity,^10,11,12 but when neurons are simultaneously representing multiple items, persistent activity creates a potential for representational conflicts. In comparison, more recent, "activity-silent" theories of working memory propose that synaptic changes also contribute to short-term storage of to-be-remembered items.^13,14,15,16 Transient bursts in neural activity,¹⁷ rather than persistent activity, could serve to occasionally refresh these synaptic changes. Here, we used EEG and response times to test whether rhythmic temporal coordination helps to isolate neural activity associated with different to-be-remembered items, thereby helping to prevent representational conflicts. Consistent with this hypothesis, we report that the relative strength of different item representations alternates over time as a function of the frequency-specific phase. Although RTs were linked to theta (∼6 Hz) and beta (∼25 Hz) phases during a memory delay, the relative strength of item representations only alternated as a function of the beta phase. The present findings (1) are consistent with rhythmic temporal coordination being a general mechanism for preventing functional or representational conflicts during cognitive processes and (2) inform models describing the role of oscillatory dynamics in organizing working memory.^{13,18,19,20,21}.

Motor-induced oscillations in choice response performance

Recently, numerous studies have revealed 4-12 Hz fluctuations of behavioral performance in a multitude of tasks. The majority has utilized stimuli near detection threshold and observed related fluctuations in hit-rates, attributing these to perceptual or attentional processes. As neural oscillations in the 8-20 Hz range also feature prominently in cortical motor areas, they might cause fluctuations in the ability to induce responses, independent of attentional capabilities. Additionally, different effectors (e.g., the left versus right hand) might be cyclically prioritized in an alternating fashion, similar to the attentional sampling of distinct locations, objects, or memory templates. Here, we investigated these questions via a behavioral dense-sampling approach. Twenty-six participants performed a simple visual discrimination task using highly salient stimuli. We varied the interval between each motor response and the subsequent target from 330 to 1040 ms, and analyzed performance as a function of this interval. Our data show significant fluctuations of both RTs and sensitivity between 12.5 and 25 Hz, but no evidence for an alternating prioritization of left- versus right-hand responses. While our results suggest an impact of motor-related signals on performance oscillations, they might additionally be influenced by perceptual processes earlier in the processing hierarchy. In summary, we demonstrate that behavioral oscillations generalize to situations involving highly salient stimuli, closer to everyday life. Moreover, our work adds to the literature by showing fluctuations at a high speed, which might be a consequence of both low task difficulty and the involvement of sensorimotor rhythms.

Interacting rhythms enhance sensitivity of target detection in a fronto-parietal computational model of visual attention

Even during sustained attention, enhanced processing of attended stimuli waxes and wanes rhythmically, with periods of enhanced and relatively diminished visual processing (and subsequent target detection) alternating at 4 or 8 Hz in a sustained visual attention task. These alternating attentional states occur alongside alternating dynamical states, in which lateral intraparietal cortex (LIP), the frontal eye field (FEF), and the mediodorsal pulvinar (mdPul) exhibit different activity and functional connectivity at α, β, and γ frequencies-rhythms associated with visual processing, working memory, and motor suppression. To assess whether and how these multiple interacting rhythms contribute to periodicity in attention, we propose a detailed computational model of FEF and LIP. When driven by θ-rhythmic inputs simulating experimentally-observed mdPul activity, this model reproduced the rhythmic dynamics and behavioral consequences of observed attentional states, revealing that the frequencies and mechanisms of the observed rhythms allow for peak sensitivity in visual target detection while maintaining functional flexibility.

The influence of action on perception spans different effectors

Perception and action are fundamental processes that characterize our life and our possibility to modify the world around us. Several pieces of evidence have shown an intimate and reciprocal interaction between perception and action, leading us to believe that these processes rely on a common set of representations. The present review focuses on one particular aspect of this interaction: the influence of action on perception from a motor effector perspective during two phases, action planning and the phase following execution of the action. The movements performed by eyes, hands, and legs have a different impact on object and space perception; studies that use different approaches and paradigms have formed an interesting general picture that demonstrates the existence of an action effect on perception, before as well as after its execution. Although the mechanisms of this effect are still being debated, different studies have demonstrated that most of the time this effect pragmatically shapes and primes perception of relevant features of the object or environment which calls for action; at other times it improves our perception through motor experience and learning. Finally, a future perspective is provided, in which we suggest that these mechanisms can be exploited to increase trust in artificial intelligence systems that are able to interact with humans.

Saccades are locked to the phase of alpha oscillations during natural reading

We saccade 3 to 5 times per second when reading. However, little is known about the neuronal mechanisms coordinating the oculomotor and visual systems during such rapid processing. Here, we ask if brain oscillations play a role in the temporal coordination of the visuomotor integration. We simultaneously acquired MEG and eye-tracking data while participants read sentences silently. Every sentence was embedded with a target word of either high or low lexical frequency. Our key finding demonstrated that saccade onsets were locked to the phase of alpha oscillations (8 to 13 Hz), and in particular, for saccades towards low frequency words. Source modelling demonstrated that the alpha oscillations to which the saccades were locked, were generated in the right-visual motor cortex (BA 7). Our findings suggest that the alpha oscillations serve to time the processing between the oculomotor and visual systems during natural reading, and that this coordination becomes more pronounced for demanding words.

There Is More Evidence of Rhythmic Attention than Can Be Found in Behavioral Studies: Perspective on Brookshire, 2022

Recent research indicates periodicity in attention-related sampling and switching, with some of the initial findings coming from behavioral studies. Brookshire [Brookshire, G. Putative rhythms in attentional switching can be explained by aperiodic temporal structure. Nature Human Behaviour, 2022, https://doi.org/10.1038/s41562-022-01364-0], points out that widely used approaches to testing for rhythms in behavioral times series can misclassify consistent aperiodic patterns in temporal structure as periodic patterns. Evidence for rhythmic attention, however, is not limited to behavioral data. Here, I briefly discuss (i) issues with differentiating periodic and aperiodic structure in both behavioral and neural time series, (ii) findings from neural data that are consistent with rhythmic sampling and switching during attentional deployment, and (iii) whether alternative approaches to establishing periodicity in behavioral time series, recommended by Brookshire are appropriate for this particular research topic.

Advances in human intracranial electroencephalography research, guidelines and good practices

Since the second-half of the twentieth century, intracranial electroencephalography (iEEG), including both electrocorticography (ECoG) and stereo-electroencephalography (sEEG), has provided an intimate view into the human brain. At the interface between fundamental research and the clinic, iEEG provides both high temporal resolution and high spatial specificity but comes with constraints, such as the individual's tailored sparsity of electrode sampling. Over the years, researchers in neuroscience developed their practices to make the most of the iEEG approach. Here we offer a critical review of iEEG research practices in a didactic framework for newcomers, as well addressing issues encountered by proficient researchers. The scope is threefold: (i) review common practices in iEEG research, (ii) suggest potential guidelines for working with iEEG data and answer frequently asked questions based on the most widespread practices, and (iii) based on current neurophysiological knowledge and methodologies, pave the way to good practice standards in iEEG research. The organization of this paper follows the steps of iEEG data processing. The first section contextualizes iEEG data collection. The second section focuses on localization of intracranial electrodes. The third section highlights the main pre-processing steps. The fourth section presents iEEG signal analysis methods. The fifth section discusses statistical approaches. The sixth section draws some unique perspectives on iEEG research. Finally, to ensure a consistent nomenclature throughout the manuscript and to align with other guidelines, e.g., Brain Imaging Data Structure (BIDS) and the OHBM Committee on Best Practices in Data Analysis and Sharing (COBIDAS), we provide a glossary to disambiguate terms related to iEEG research.

Interpersonal sensorimotor communication shapes intrapersonal coordination in a musical ensemble

Social behaviors rely on the coordination of multiple effectors within one's own body as well as between the interacting bodies. However, little is known about how coupling at the interpersonal level impacts coordination among body parts at the intrapersonal level, especially in ecological, complex, situations. Here, we perturbed interpersonal sensorimotor communication in violin players of an orchestra and investigated how this impacted musicians' intrapersonal movements coordination. More precisely, first section violinists were asked to turn their back to the conductor and to face the second section of violinists, who still faced the conductor. Motion capture of head and bow kinematics showed that altering the usual interpersonal coupling scheme increased intrapersonal coordination. Our perturbation also induced smaller yet more complex head movements, which spanned multiple, faster timescales that closely matched the metrical levels of the musical score. Importantly, perturbation differentially increased intrapersonal coordination across these timescales. We interpret this behavioral shift as a sensorimotor strategy that exploits periodical movements to effectively tune sensory processing in time and allows coping with the disruption in the interpersonal coupling scheme. As such, head movements, which are usually deemed to fulfill communicative functions, may possibly be adapted to help regulate own performance in time.

Reclaiming saliency: Rhythmic precision-modulated action and perception

Computational models of visual attention in artificial intelligence and robotics have been inspired by the concept of a saliency map. These models account for the mutual information between the (current) visual information and its estimated causes. However, they fail to consider the circular causality between perception and action. In other words, they do not consider where to sample next, given current beliefs. Here, we reclaim salience as an active inference process that relies on two basic principles: uncertainty minimization and rhythmic scheduling. For this, we make a distinction between attention and salience. Briefly, we associate attention with precision control, i.e., the confidence with which beliefs can be updated given sampled sensory data, and salience with uncertainty minimization that underwrites the selection of future sensory data. Using this, we propose a new account of attention based on rhythmic precision-modulation and discuss its potential in robotics, providing numerical experiments that showcase its advantages for state and noise estimation, system identification and action selection for informative path planning.

Vision: Optimizing each glimpse

A new study uses a rigorous approach to isolate the consequences of eye movements on cortical visual processing, showing that our visual system does not shut down during saccades but specifically modulates sensitivity to selected stimuli.

Interpersonal synchronization of movement intermittency

Most animal species group together and coordinate their behavior in quite sophisticated manners for mating, hunting, or defense purposes. In humans, coordination at a macroscopic level (the pacing of movements) is evident both in daily life (e.g., walking) and skilled (e.g., music and dance) behaviors. By examining the fine structure of movement, we here show that interpersonal coordination is established also at a microscopic – submovement – level. Natural movements appear as marked by recurrent (2–3 Hz) speed breaks, i.e., submovements, that are traditionally considered the result of intermittency in (visuo)motor feedback-based control. In a series of interpersonal coordination tasks, we show that submovements produced by interacting partners are not independent but alternate tightly over time, reflecting online mutual adaptation. These findings unveil a potential core mechanism for behavioral coordination that is based on between-persons synchronization of the intrinsic dynamics of action-perception cycles.

•

Movements show intermittent speed pulses occurring at 2–3 Hz, called submovements

•

Submovements are actively coordinated in counter-phase by interacting partners

•

Submovements coordination depends on spatial alignment but not movement congruency

•

Behavioral coordination occurs both at macro- and microscopic movement scales

Disrupting Short-Term Memory Maintenance in Premotor Cortex Affects Serial Dependence in Visuomotor Integration

Human behavior is biased by past experience. For example, when intercepting a moving target, the speed of previous targets will bias responses in future trials. Neural mechanisms underlying this so-called serial dependence are still under debate. Here, we tested the hypothesis that the previous trial leaves a neural trace in brain regions associated with encoding task-relevant information in visual and/or motor regions. We reasoned that injecting noise by means of transcranial magnetic stimulation (TMS) over premotor and visual areas would degrade such memory traces and hence reduce serial dependence. To test this hypothesis, we applied bursts of TMS pulses to right visual motion processing region hV5/MT+ and to left dorsal premotor cortex (PMd) during intertrial intervals of a coincident timing task performed by twenty healthy human participants (15 female). Without TMS, participants presented a bias toward the speed of the previous trial when intercepting moving targets. TMS over PMd decreased serial dependence in comparison to the control Vertex stimulation, whereas TMS applied over hV5/MT+ did not. In addition, TMS seems to have specifically affected the memory trace that leads to serial dependence, as we found no evidence that participants' behavior worsened after applying TMS. These results provide causal evidence that an implicit short-term memory mechanism in premotor cortex keeps information from one trial to the next, and that this information is blended with current trial information so that it biases behavior in a visuomotor integration task with moving objects.SIGNIFICANCE STATEMENT Human perception and action are biased by the recent past. The origin of such serial bias is still not fully understood, but a few components seem to be fundamental for its emergence: the brain needs to keep previous trial information in short-term memory and blend it with incoming information. Here, we present evidence that a premotor area has a potential role in storing previous trial information in short-term memory in a visuomotor task and that this information is responsible for biasing ongoing behavior. These results corroborate the perspective that areas associated with processing information of a stimulus or task also participate in maintaining that information in short-term memory even when this information is no longer relevant for current behavior.

Attentional sampling of visual and auditory objects is captured by theta-modulated neural activity

Recent evidence suggests that visual attention alternately samples two behaviourally relevant objects at approximately 4 Hz, rhythmically shifting between the objects. Whether similar attentional rhythms exist in other sensory modalities, however, is not yet clear. We therefore adapted and extended an established paradigm to investigate visual and potential auditory attentional rhythms, as well as possible interactions, on both a behavioural (detection performance, N = 33) and a neural level (EEG, N = 18). The results during unimodal attention demonstrate that both visual- and auditory-target detection fluctuate at frequencies of approximately 4-8 Hz, confirming that attentional rhythms are not specific to visual processing. The EEG recordings provided evidence of oscillatory activity that underlies these behavioural effects. At right and left occipital EEG electrodes, we detected counter-phasic theta-band activity (4-8 Hz), mirroring behavioural evidence of alternating sampling between the objects presented right and left of central fixation, respectively. Similarly, alpha-band activity as a signature of relatively suppressed sensory encoding showed a theta-rhythmic, counter-phasic change in power. Moreover, these theta-rhythmic changes in alpha power were predictive of behavioural performance in both sensory modalities. Overall, the present findings provide a new perspective on the multimodal rhythmicity of attention.

Rhythmic sampling revisited: Experimental paradigms and neural mechanisms

Sampling of information is thought to be an important aspect of explorative behaviour. Evidence for it has been gained in behavioural assessments of a variety of overt and covert cognitive domains, including sensation, attention, memory, eye movements and dexterity. A common aspect across many findings is that sampling tends to exhibit a rhythmicity at low frequencies (theta, 4-8 Hz; alpha, 9-12 Hz). Neurophysiological investigations in a wide range of species, including rodents, non-human primates and humans have demonstrated the presence of sampling related neural oscillations in a number of brain areas ranging from early sensory cortex, hippocampus to high-level cognitive areas. However, to assess whether rhythmic sampling represents a general aspect of exploratory behaviour one must critically evaluate the task parameters, and their potential link with neural oscillations. Here we focus on sampling during attentive vision to present an overview on the experimental conditions that are used to investigate rhythmic sampling and associated oscillatory brain activity in this domain. This review aims to (1) provide guidelines to efficiently quantify behavioural rhythms, (2) compare results from human and non-human primate studies and (3) argue that the underlying neural mechanisms of sampling can co-occur in both sensory and high-level areas.

Predictive visuo-motor communication through neural oscillations

The mechanisms coordinating action and perception over time are poorly understood. The sensory cortex needs to prepare for upcoming changes contingent on action, and this requires temporally precise communication that takes into account the variable delays between sensory and motor processing. Several theorists^1,2 have proposed synchronization of the endogenous oscillatory activity observed in most regions of the brain³ as the basis for an efficient and flexible communication protocol between distal brain areas,^2,4 a concept known as "communication through coherence." Synchronization of endogenous oscillations^5,6 occurs after a salient sensory stimulus, such as a flash or a sound,^7-11 and after a voluntary action,^12-18 and this directly impacts perception, causing performance to oscillate rhythmically over time. Here we introduce a novel fMRI paradigm to probe the neural sources of oscillations, based on the concept of perturbative signals, which overcomes the low temporal resolution of BOLD signals. The assumption is that a synchronized endogenous rhythm will modulate cortical excitability rhythmically, which should be reflected in the BOLD responses to brief stimuli presented at different phases of the oscillation cycle. We record rhythmic oscillations of V1 BOLD synchronized by a simple voluntary action, in phase with behaviorally measured oscillations in visual sensitivity in the theta range. The functional connectivity between V1 and M1 also oscillates at the same rhythm. By demonstrating oscillatory temporal coupling between primary motor and sensory cortices, our results strongly implicate communication through coherence to achieve precise coordination and to encode sensory-motor timing.

Tapping Force Encodes Metrical Aspects of Rhythm

Humans possess the ability to extract highly organized perceptual structures from sequences of temporal stimuli. For instance, we can organize specific rhythmical patterns into hierarchical, or metrical, systems. Despite the evidence of a fundamental influence of the motor system in achieving this skill, few studies have attempted to investigate the organization of our motor representation of rhythm. To this aim, we studied-in musicians and non-musicians-the ability to perceive and reproduce different rhythms. In a first experiment participants performed a temporal order-judgment task, for rhythmical sequences presented via auditory or tactile modality. In a second experiment, they were asked to reproduce the same rhythmic sequences, while their tapping force and timing were recorded. We demonstrate that tapping force encodes the metrical aspect of the rhythm, and the strength of the coding correlates with the individual's perceptual accuracy. We suggest that the similarity between perception and tapping-force organization indicates a common representation of rhythm, shared between the perceptual and motor systems.

Differential attention-dependent adjustment of frequency, power and phase in primary sensory and frontoparietal areas

Continuously prioritizing behaviourally relevant information from the environment for improved stimulus processing is a crucial function of attention. In the current MEG study, we investigated how ongoing oscillatory activity of both sensory and non-sensory brain regions are differentially impacted by attentional focus. Low-frequency phase alignment of neural activity in primary sensory areas, with respect to attended/ignored features has been suggested to support top-down prioritization. However, phase adjustment in frontoparietal regions has not been widely studied, despite general implication of these in top-down selection of information. To investigate this, we let participants perform an established intermodal selective attention task, where low-frequency auditory (1.6 Hz) and visual (1.8 Hz) stimuli were presented simultaneously. We instructed them to either attend to the auditory or to the visual stimuli and to detect targets while ignoring the other stimulus stream. As expected, the strongest phase adjustment was observed in primary sensory regions for auditory and for visual stimulation, independent of attentional focus. We found greater differences in phase locking between attended and ignored stimulation for the visual modality. Interestingly, auditory temporal regions show small but significant attention-dependent neural entrainment even for visual stimulation. Extending findings from invasive recordings in non-human primates, we demonstrate an effect of attentional focus on the phase of the entrained oscillations in auditory and visual cortex which may be driven by phase locked increases of induced power. While sensory areas adjusted the phase of the respective stimulation frequencies, attentional focus adjusted the peak frequencies in nonsensory areas. Spatially these areas show a striking overlap with core regions of the dorsal attention network and the frontoparietal network. This suggests that these areas prioritize the attended modality by optimally exploiting the temporal structure of stimulation. Overall, our study complements and extends previous work by showing a differential effect of attentional focus on entrained oscillations (or phase adjustment) in primary sensory areas and frontoparietal areas.

Perceptual Oscillations in Gender Classification of Faces, Contingent on Stimulus History

Perception is a proactive ‘‘predictive’’ process, in which the brain takes advantage of past experience to make informed guesses about the world to test against sensory data. Here we demonstrate that in the judgment of the gender of faces, beta rhythms play an important role in communicating perceptual experience. Observers classified in forced choice as male or female, a sequence of face stimuli, which were physically constructed to be male or female or androgynous (equal morph). Classification of the androgynous stimuli oscillated rhythmically between male and female, following a complex waveform comprising 13.5 and 17 Hz. Parsing the trials based on the preceding stimulus showed that responses to androgynous stimuli preceded by male stimuli oscillated reliably at 17 Hz, whereas those preceded by female stimuli oscillated at 13.5 Hz. These results suggest that perceptual priors for face perception from recent perceptual memory are communicated through frequency-coded beta rhythms.

•

Perception is strongly influenced by prior expectations and perceptual experience

•

We show perceptual priors for face perception are communicated through beta rhythms

•

Priors for male and female are communicated via distinct beta frequencies

Visual detection is locked to the internal dynamics of cortico-motor control

Movements overtly sample sensory information, making sensory analysis an active-sensing process. In this study, we show that visual information sampling is not just locked to the (overt) movement dynamics but to the internal (covert) dynamics of cortico-motor control. We asked human participants to perform continuous isometric contraction while detecting unrelated and unpredictable near-threshold visual stimuli. The motor output (force) shows zero-lag coherence with brain activity (recorded via electroencephalography) in the beta-band, as previously reported. In contrast, cortical rhythms in the alpha-band systematically forerun the motor output by 200 milliseconds. Importantly, visual detection is facilitated when cortico-motor alpha (not beta) synchronization is enhanced immediately before stimulus onset, namely, at the optimal phase relationship for sensorimotor communication. These findings demonstrate an ongoing coupling between visual sampling and motor control, suggesting the operation of an internal and alpha-cycling visuomotor loop.

The Role of Motor and Environmental Visual Rhythms in Structuring Auditory Cortical Excitability

Previous studies indicate that motor sampling patterns modulate neuronal excitability in sensory brain regions by entraining brain rhythms, a process termed motor-initiated entrainment. In addition, rhythms of the external environment are also capable of entraining brain rhythms. Our first goal was to investigate the properties of motor-initiated entrainment in the auditory system using a prominent visual motor sampling pattern in primates, saccades. Second, we wanted to determine whether/how motor-initiated entrainment interacts with visual environmental entrainment. We examined laminar profiles of neuronal ensemble activity in primary auditory cortex and found that whereas motor-initiated entrainment has a suppressive effect, visual environmental entrainment has an enhancive effect. We also found that these processes are temporally coupled, and their temporal relationship ensures that their effect on excitability is complementary rather than interfering. Altogether, our results demonstrate that motor and sensory systems continuously interact in orchestrating the brain's context for the optimal sampling of our multisensory environment.

Synchronisation of Neural Oscillations and Cross-modal Influences

At any given moment, we receive multiple signals from our different senses. Prior research has shown that signals in one sensory modality can influence neural activity and behavioural performance associated with another sensory modality. Recent human and nonhuman primate studies suggest that such cross-modal influences in sensory cortices are mediated by the synchronisation of ongoing neural oscillations. In this review, we consider two mechanisms proposed to facilitate cross-modal influences on sensory processing, namely cross-modal phase resetting and neural entrainment. We consider how top-down processes may further influence cross-modal processing in a flexible manner, and we highlight fruitful directions for further research.