Temporal alignment of anticipatory motor cortical beta lateralisation in hidden visual-motor sequences

Goal-Dependent Use of Temporal Regularities to Orient Attention under Spatial and Action Uncertainty

The temporal regularities in our environments support the proactive dynamic anticipation of relevant events. In visual attention, one important outstanding question is whether temporal predictions must be linked to predictions about spatial locations or motor plans to facilitate behaviour. To test this, we developed a task for manipulating temporal expectations and task relevance of visual stimuli appearing within rapidly presented streams, while stimulus location and responding hand remained uncertain. Differently coloured stimuli appeared in one of two concurrent (left and right) streams with distinct temporal probability structures. Targets were defined by colour on a trial-by-trial basis and appeared equiprobably in either stream, requiring a localisation response. Across two experiments, participants were faster and more accurate at detecting temporally predictable targets compared to temporally unpredictable targets. We conclude that temporal expectations learned incidentally from temporal regularities can be called upon flexibly in a goal-driven manner to guide behaviour. Moreover, we show that visual temporal attention can facilitate performance in the absence of concomitant spatial or motor expectations in dynamically unfolding contexts.

Attention in flux

Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.

Attentional modulation of beta-power aligns with the timing of behaviorally relevant rhythmic sounds

It is largely unknown how attention adapts to the timing of acoustic stimuli. To address this, we investigated how hemispheric lateralization of alpha (7-13 Hz) and beta (14-24 Hz) oscillations, reflecting voluntary allocation of auditory spatial attention, is influenced by tempo and predictability of sounds. We recorded electroencephalography while healthy adults listened to rhythmic sound streams with different tempos that were presented dichotically to separate ears, thus permitting manipulation of spatial-temporal attention. Participants responded to stimulus-onset-asynchrony (SOA) deviants (-90 ms) for given tones in the attended rhythm. Rhythm predictability was controlled via the probability of SOA deviants per block. First, the results revealed hemispheric lateralization of beta-power according to attention direction, reflected as ipsilateral enhancement and contralateral suppression, which was amplified in high- relative to low-predictability conditions. Second, fluctuations in the time-resolved beta-lateralization aligned more strongly with the attended than the unattended tempo. Finally, a trend-level association was found between the degree of beta-lateralization and improved ability to distinguish between SOA-deviants in the attended versus unattended ear. Differently from previous studies, we presented continuous rhythms in which task-relevant and irrelevant stimuli had different tempo, thereby demonstrating that temporal alignment of beta-lateralization with attended sounds reflects top-down attention to sound timing.

Neural basis of implicit motor sequence learning: Modulation of cortical power

Implicit sequence learning describes the acquisition of serially ordered movements and sequentially structured cognitive information, that occurs without awareness. Theta, alpha and beta cortical oscillations are present during implicit motor sequence learning, but their role in this process is unclear. The current study addressed this gap in the literature. A total of 50 healthy adults aged between 19 and 37 years participated in the study. Implicit motor sequence learning was examined using the Serial Reaction Time task where participants unknowingly repeat a sequence of finger movements in response to a visual stimulus. Sequence learning was examined by comparing reaction times and oscillatory power between sequence trials and a set of control trials comprising random stimulus presentations. Electroencephalography was recorded as participants completed the task. Analyses of the behavioral data revealed participants learnt the sequence. Analyses of oscillatory activity, using permutation testing, revealed sequence learning was associated with a decrease in theta band (4-7 Hz) power recorded over frontal and central electrode sites. Sequence learning effects were not observed in the alpha (7-12 Hz) or beta bands (12-20 Hz). Even though alpha and beta power modulations have long been associated with executing a motor response, it seems theta power is a correlate of sequence learning in the manual domain. Theta power modulations on the serial reaction time task may reflect disengagement of attentional resources, either promoting or occurring as a consequence of implicit motor sequence learning.

Implicit spatial sequential learning facilitates attentional selection in covert visual search. An event-related potentials study

Introduction

While most studies on implicit sequential learning focus on object learning, the hidden structure of target location and onset time can also be a subject of implicitly gathered knowledge. In our study, we wanted to investigate the effect of implicitly learned spatial and temporal sequential predictability on performance in a localization task in a paradigm in which covert selective attention is engaged. We were also interested in the neural mechanism of the facilitating effect of the predictable spatio-temporal context on visual search processes. Specifically, with the use of an event-related potential technique, we wanted to verify whether perceptual, attentional, and motor processes can be enhanced by the predictive spatio-temporal context of visual stimuli.

Methods

We analyzed data from 15 young, healthy adults who took part in an experimental electroencephalographic (EEG) study and performed a visual search localization task. Predictable sequences of four target locations and/or target onset times were presented in separate blocks of trials that formed the Space, Space- Time, and Time conditions. One block of trials with randomly presented stimuli served as a control condition.

Results

The behavioral results revealed that participants successfully learned only the spatial dimension of target predictability. Although spatial predictability was a response-relevant dimension, we found that attentional selection–instead of motor preparation–was the facilitation mechanism in this type of visual search task. This was manifested by a shorter latency and more negative amplitude of the N2pc component and the lack of an effect on the sLRP component. We observed no effect of predictability on perceptual processing (P1 component).

Discussion

We discuss these results with reference to the current knowledge on sequential learning. Our findings also contribute to the current debate on the predictive coding theory.

Speed and accuracy instructions affect two aspects of skill learning differently

Procedural learning is key to optimal skill learning and is essential for functioning in everyday life. The findings of previous studies are contradictory regarding whether procedural learning can be modified by prioritizing speed or accuracy during learning. The conflicting results may be due to the fact that procedural learning is a multifaceted cognitive function. The purpose of our study is to determine whether and how speed and accuracy instructions affect two aspects of procedural learning: the learning of probability-based and serial-order-based regularities. Two groups of healthy individuals were instructed to practice on a cued probabilistic sequence learning task: one group focused on being fast and the other on being accurate during the learning phase. The speed instruction resulted in enhanced expression of probability-based but not serial-order-based knowledge. After a retention period, we instructed the participants to focus on speed and accuracy equally, and we tested their acquired knowledge. The acquired knowledge was comparable between groups in both types of learning. These findings suggest that different aspects of procedural learning can be affected differently by instructions. However, only momentary performance might be boosted by speed instruction; the acquired knowledge remains intact. In addition, as the accuracy instruction resulted in accuracy near ceiling level, the results illustrate that response errors are not needed for humans to learn in the procedural domain and draw attention to the fact that different instructions can separate competence from performance.

Context-specific control over the neural dynamics of temporal attention by the human cerebellum

Physiological methods have identified a number of signatures of temporal prediction, a core component of attention. While the underlying neural dynamics have been linked to activity within cortico-striatal networks, recent work has shown that the behavioral benefits of temporal prediction rely on the cerebellum. Here, we examine the involvement of the human cerebellum in the generation and/or temporal adjustment of anticipatory neural dynamics, measuring scalp electroencephalography in individuals with cerebellar degeneration. When the temporal prediction relied on an interval representation, duration-dependent adjustments were impaired in the cerebellar group compared to matched controls. This impairment was evident in ramping activity, beta-band power, and phase locking of delta-band activity. These same neural adjustments were preserved when the prediction relied on a rhythmic stream. Thus, the cerebellum has a context-specific causal role in the adjustment of anticipatory neural dynamics of temporal prediction, providing the requisite modulation to optimize behavior.

Don't stop me now: Hampered retrieval of action plans following interruptions

How can we retrieve action plans in working memory (WM) after being distracted or interrupted? The present EEG study investigated this question using a WM task in which a random sequence of single numbers (1-4 and 6-9) was presented. In a given trial, participants had to decide whether the number presented in the preceding trial was odd or even. Additionally, interfering stimuli were randomly presented in 25% of all trials, requiring the participants to either ignore a colored number (distraction) or respond to it (interruption) while maintaining the previously formed action plan in WM. Our results revealed a detrimental impact of interruptions on WM performance in trials after interrupting stimuli compared to trials without a preceding interference. This was reflected in decreased task accuracy and reduced stimulus- and response-locked P3b amplitudes potentially indicating a hampered reactivation of stimulus-response links. Moreover, decreased contralateral mu suppression prior to a given response highlighted an impaired response preparation following interruptions. Distractions, on the other hand, did not negatively affect task performance but were followed by faster responses in subsequent trials compared to trials without prior interference. This result pattern was supported by stronger contralateral mu suppression indicating a facilitated response preparation. Overall, these results suggest that action representations in WM are resistant to distractions but do suffer from interruptions that disrupt or interfere with their implementation. We thus propose that the possibility of adequately preparing for an upcoming response is essential for behavioral guidance in the presence of external interference.

Temporal Expectations Prepare Visual Working Memory for Behavior

Working memory enables us to retain past sensations in service of anticipated task demands. How we prepare for anticipated task demands during working memory retention remains poorly understood. Here, we focused on the role of time—asking how temporal expectations help prepare for ensuing memory-guided behavior. We manipulated the expected probe time in a delayed change-detection task and report that temporal expectation can have a profound influence on memory-guided behavioral performance. EEG measurements corroborated the utilization of temporal expectations: demonstrating the involvement of a classic EEG signature of temporal expectation—the contingent negative variation—in the context of working memory. We also report the influence of temporal expectations on 2 EEG signatures associated with visual working memory—the lateralization of 8- to 12-Hz alpha activity, and the contralateral delay activity. We observed a dissociation between these signatures, whereby alpha lateralization (but not the contralateral delay activity) adapted to the time of expected memory utilization. These data show how temporal expectations prepare visual working memory for behavior and shed new light on the electrophysiological markers of both temporal expectation and working memory.

Purpose-Dependent Consequences of Temporal Expectations Serving Perception and Action

Temporal expectations enable anticipatory brain states that prepare us for upcoming perception and action. We investigated the purpose-dependent nature and consequences of cued temporal expectations on brain and behavior in male and female human volunteers, using two matched visual-motor tasks that stressed either response speed or visual accuracy. We show that the consequences of temporal expectations are fundamentally purpose dependent. Temporal expectations predominantly affected response times when visual demands were low and speed was more important, but perceptual accuracy when visual demands were more challenging. Using magnetoencephalography, we further show how temporal expectations latch onto anticipatory neural states associated with concurrent spatial expectations—modulating task-specific anticipatory neural lateralization of oscillatory brain activity in a modality- and frequency-specific manner. By relating these brain states to behavior, we finally reveal how the behavioral relevance of such anticipatory brain states is similarly purpose dependent.

SIGNIFICANCE STATEMENT Knowing when events may occur helps to prepare neural activity for upcoming perception and action. It is becoming increasingly clear that distinct sources of temporal expectations may facilitate performance via distinct mechanisms. Another relevant dimension to consider regards the distinct purposes that temporal expectations may serve. Here, we demonstrate that the consequences of temporal expectations on neurophysiological brain activity and behavior are fundamentally purpose dependent, and show how temporal expectations interact with task-relevant neural states in a modality- and frequency-specific manner. This brings the important insight that the ways in which temporal expectations influence brain and behavior, and how brain activity is related to behavior, are not fixed properties but rather depend on the task at hand.

Speed or Accuracy Instructions During Skill Learning do not Affect the Acquired Knowledge

A crucial question in skill learning research is how instruction affects the performance or the underlying representations. Little is known about the effects of instructions on one critical aspect of skill learning, namely, picking-up statistical regularities. More specifically, the present study tests how prelearning speed or accuracy instructions affect the acquisition of non-adjacent second-order dependencies. We trained 2 groups of participants on an implicit probabilistic sequence learning task: one group focused on being fast and the other on being accurate. As expected, we detected a strong instruction effect: accuracy instruction resulted in a nearly errorless performance, and speed instruction caused short reaction times (RTs). Despite the differences in the average RTs and accuracy scores, we found a similar level of statistical learning performance in the training phase. After the training phase, we tested the 2 groups under the same instruction (focusing on both speed and accuracy), and they showed comparable performance, suggesting a similar level of underlying statistical representations. Our findings support that skill learning can result in robust representations, and they highlight that this form of knowledge may appear with almost errorless performance. Moreover, multiple sessions with different instructions enabled the separation of competence from performance.

Encoding, storage, and response preparation-Distinct EEG correlates of stimulus and action representations in working memory

Working memory (WM) allows for the active storage of stimulus- and higher level representations, such as action plans. This electroencephalography (EEG) study investigated the specific electrophysiological correlates dissociating action-related from stimulus-related representations in WM using three different experimental conditions based on the same stimulus material. In the experiment, a random sequence of single numbers (from 1 to 6) was presented and participants had to indicate whether the current number (N0 condition), the preceding number (N-1 condition), or the sum of the current and the preceding number (S-1 condition) was odd or even. Accordingly, participants had to store a stimulus representation in S-1 and an action representation in N-1 until the onset of the next stimulus. In the EEG, the storage of stimulus representations (S-1) was reflected by a fronto-central slow wave indicating the rehearsal of information that was required for the response in the following trial. In contrast, the storage of action representations (N-1) went along with a posterior positive slow wave, suggesting that the action plan was actively stored in WM until the presentation of the next stimulus. Crucially, preparing for the next response in N-1 was associated with increased contralateral mu/beta suppression, predicting the response time in the given trial. Our findings, thus, show that the WM processes for stimulus- and action representations can be clearly dissociated from each other with a distinct sequence of EEG correlates for encoding, storage, and response preparation.

Multi-session Transcranial Direct Current Stimulation Over Primary Motor Cortex Facilitates Sequence Learning, Chunking, and One Year Retention

Transcranial direct current stimulation (tDCS) over the primary motor cortex (M1) can facilitate motor learning, but it has not been established how stimulation to other brain regions impacts online and offline motor sequence learning, as well as long-term retention. Here, we completed three experiments comparing the effects of tDCS and sham stimulation to the prefrontal cortex (PFC), M1, and the supplementary motor area complex to understand the contributions of these brain regions to motor sequence learning. In Experiment 1, we found that both left and right PFC tDCS groups displayed a slowing in learning in both reaction time and number of chunks, whereas stimulation over M1 improved both metrics over the course of three sessions. To better understand the sequence learning impairment of left PFC anodal stimulation, we tested a left PFC cathodal tDCS group in Experiment 2. The cathodal group demonstrated learning impairments similar to the left PFC anodal stimulation group. In Experiment 3, a subset of participants from the left PFC, M1, and sham tDCS groups of Experiment 1 returned to complete a single session without tDCS on the same sequences assigned to them 1 year previously. We found that the M1 tDCS group reduced reaction time at a faster rate relative to the sham and left PFC groups, demonstrating faster relearning after a one-year delay. Thus, our findings suggest that, regardless of the polarity of stimulation, tDCS to PFC impairs sequence learning, whereas stimulation to M1 facilitates learning and relearning, especially in terms of chunk formation.

Premembering Experience: A Hierarchy of Time-Scales for Proactive Attention

Memories are about the past, but they serve the future. Memory research often emphasizes the former aspect: focusing on the functions that re-constitute (re-member) experience and elucidating the various types of memories and their interrelations, timescales, and neural bases. Here we highlight the prospective nature of memory in guiding selective attention, focusing on functions that use previous experience to anticipate the relevant events about to unfold-to "premember" experience. Memories of various types and timescales play a fundamental role in guiding perception and performance adaptively, proactively, and dynamically. Consonant with this perspective, memories are often recorded according to expected future demands. Using working memory as an example, we consider how mnemonic content is selected and represented for future use. This perspective moves away from the traditional representational account of memory toward a functional account in which forward-looking memory traces are informationally and computationally tuned for interacting with incoming sensory signals to guide adaptive behavior.

The tempos of performance

Human performance fluctuates over time. Rather than random, the complex time course of variation reflects, among other factors, influences from regular periodic processes operating at multiple time scales. In this review, we consider evidence for how our performance ebbs and flows over fractions of seconds as we engage with sensory objects, over minutes as we perform tasks, and over hours according to homeostatic factors. We propose that rhythms of performance at these multiple tempos arise from the interplay among three sources of influence: intrinsic fluctuations in brain activity, periodicity of external stimulation, and the anticipation of the temporal structure of external stimulation by the brain.

Anticipatory neural dynamics of spatial-temporal orienting of attention in younger and older adults

Spatial and temporal expectations act synergistically to facilitate visual perception. In the current study, we sought to investigate the anticipatory oscillatory markers of combined spatial-temporal orienting and to test whether these decline with ageing. We examined anticipatory neural dynamics associated with joint spatial-temporal orienting of attention using magnetoencephalography (MEG) in both younger and older adults. Participants performed a cued covert spatial-temporal orienting task requiring the discrimination of a visual target. Cues indicated both where and when targets would appear. In both age groups, valid spatial-temporal cues significantly enhanced perceptual sensitivity and reduced reaction times. In the MEG data, the main effect of spatial orienting was the lateralised anticipatory modulation of posterior alpha and beta oscillations. In contrast to previous reports, this modulation was not attenuated in older adults; instead it was even more pronounced. The main effect of temporal orienting was a bilateral suppression of posterior alpha and beta oscillations. This effect was restricted to younger adults. Our results also revealed a striking interaction between anticipatory spatial and temporal orienting in the gamma-band (60-75 Hz). When considering both age groups separately, this effect was only clearly evident and only survived statistical evaluation in the older adults. Together, these observations provide several new insights into the neural dynamics supporting separate as well as combined effects of spatial and temporal orienting of attention, and suggest that different neural dynamics associated with attentional orienting appear differentially sensitive to ageing.