Sequential effects within a short foreperiod context: evidence for the conditioning account of temporal preparation

Does temporal preparation facilitate visual processing in a selective manner? Evidence from attentional capture

The present study addressed the question of whether temporal preparation influences perceptual stimulus processing in a selective manner. In three visual search experiments, we examined whether temporal preparation aids spatial selection and thus reduces distraction caused by the onset of a task-irrelevant item. In each trial, participants had to detect a target amongst five non-targets and report a basic feature of the target. In some trials, an additional task-irrelevant singleton item (abrupt onset) appeared on the screen which distracted attention away from the target. To manipulate the degree of distraction, we varied the spatial distance and the stimulus-onset asynchrony between target and singleton. Temporal preparation for the target varied by means of constant foreperiods of different lengths. Though we observed overall faster responding in the case of high temporal preparation in all three experiments, temporal preparation did not reduce spatial distraction by the abrupt onset, even when the spatial position of the target was predictable. In sum, this pattern of results does not provide support for an influence of temporal preparation on spatial selection. Instead, it indicates that temporal preparation affects early visual processing in a non-selective manner.

Time-based event expectations employ relative, not absolute, representations of time

When the timing of an event is predictable, humans automatically form implicit time-based event expectations. We investigated whether these expectations rely on absolute (e.g., 800 ms) or relative (e.g., a shorter duration) representations of time. In a choice-response task with two different pre-target intervals, participants implicitly learned that targets were predictable by interval durations. In a test phase, the two intervals were either considerably shortened or lengthened. In both cases, behavioral tendencies transferred from practice to test according to relative, not absolute, interval duration. We conclude that humans employ relative representations of time periods when forming time-based event expectations. These results suggest that learned time-based event expectations (e.g., in communication and human-machine interaction) should transfer to faster or slower environments if the relative temporal distribution of events is preserved.

Implicit and explicit timing in oculomotor control

The passage of time can be estimated either explicitly, e.g. before leaving home in the morning, or implicitly, e.g. when catching a flying ball. In the present study, the latency of saccadic eye movements was used to evaluate differences between implicit and explicit timing. Humans were required to make a saccade between a central and a peripheral position on a computer screen. The delay between the extinction of a central target and the appearance of an eccentric target was the independent variable that could take one out of four different values (400, 900, 1400 or 1900 ms). In target trials, the delay period lasted for one of the four durations randomly. At the end of the delay, a saccade was initiated by the appearance of an eccentric target. Cue&target trials were similar to target trials but the duration of the delay was visually cued. In probe trials, the duration of the upcoming delay was cued, but there was no eccentric target and subjects had to internally generate a saccade at the estimated end of the delay. In target and cue&target trials, the mean and variance of latency distributions decreased as delay duration increased. In cue&target trials latencies were shorter. In probe trials, the variance increased with increasing delay duration and scalar variability was observed. The major differences in saccadic latency distributions were observed between visually-guided (target and cue&target trials) and internally-generated saccades (probe trials). In target and cue&target trials the timing of the response was implicit. In probe trials, the timing of the response was internally-generated and explicitly based on the duration of the visual cue. Scalar timing was observed only during probe trials. This study supports the hypothesis that there is no ubiquitous timing system in the brain but independent timing processes active depending on task demands.

The role of response inhibition in temporal preparation: evidence from a go/no-go task

During the foreperiod (FP) of a warned reaction task, participants engage in a process of temporal preparation to speed response to the impending target stimulus. Previous neurophysiological studies have shown that inhibition is applied during FP to prevent premature response. Previous behavioral studies have shown that the duration of FP on both the current and the preceding trial codetermine response time to the target. Integrating these findings, the present study tested the hypothesis that the behavioral effects find their origin in response inhibition on the preceding trial. In two experiments the variable-FP paradigm was combined with a go/no-go task, in which no-go stimuli required explicit response inhibition. The resulting data pattern revealed sequential effects of both FP (long or short) and response requirement (go or no-go), which could be jointly understood as expressions of response inhibition, consistent with the hypothesis.

Gating of attentional effort through the central thalamus

The central thalamus plays an important role in the regulation of arousal and allocation of attentional resources in the performance of even simple tasks. To assess the contribution of central thalamic neurons to short-term adjustments of attentional effort, we analyzed 166 microelectrode recordings obtained from two rhesus monkeys performing a visuomotor simple reaction time task with a variable foreperiod. Multiunit responses showed maintained firing rate elevations during the variable delay period of the task in ∼24% of recording sites. Simultaneously recorded local field potentials demonstrated significant decreases in power at ∼10-20 Hz and increases in power at 30-100 Hz during the delay period when compared against precue baselines. Comparison of the spectral power of local field potentials during the delay period of correct and incorrect trials showed that, during incorrect trials, similar, but reduced, shifts of spectral power occurred within the same frequency bands. Sustained performance of even simple tasks requires regulation of arousal and attention that combine in the concept of "attentional effort". Our findings suggest that central thalamic neurons regulate task performance through brief changes in firing rates and spectral power changes during task-relevant short-term shifts of attentional effort. Increases in attentional effort may be reflected in changes within the central thalamic local populations, where correct task performance associates with more robust maintenance of firing rates during the delay period. Such ongoing fluctuations of central thalamic activity likely reflect a mix of influences, including variations in moment-to-moment levels of motivation, arousal, and availability of cognitive resources.

Arousal modulates temporal preparation under increased time uncertainty: Evidence from higher-order sequential foreperiod effects

When the foreperiod (FP) is unpredictably varied in reaction-time tasks, responses are slow at short but fast at long FPs (variable-FP effect), and further vary asymmetrically as a function of FP sequence (sequential FP effect). A trace-conditioning model attributes these phenomena to time-related associative learning, while a dual-process model views them as resulting from combined effects of strategic preparation and trial-to-trial changes in arousal. Sometimes, responses are slower in long-long than in short-long FP sequences. This pattern is not predicted from the trace-conditioning account, since FP repetitions should speed up, rather than slow down, responses (due to reinforcement). The effect, however, might indicate the contribution of arousal, which according to the dual-process model, is heightened after a short FP(n-1) but decreased after a long FP(n-1). In five experiments, we examined higher-order sequential FP effects on performance, with a particular emphasis on analyzing performance in long-FP(n) trials as a function of FP length in the two preceding trials, varying temporal FP context (i.e. average FP length) and reaction mode (simple vs. choice reaction). Slower responses in long-long-long (compared with short-short-long) FP sequences were not found within a short-FP context (Exps. 1 & 2) but clearly emerged within a long-FP context (Exps. 3-5). This pattern supports the notion that transient arousal changes contribute to sequential performance effects in variable-FP tasks, in line with the dual-process account of temporal preparation.

Dissociative patterns of foreperiod effects in temporal discrimination and reaction time tasks

This study examined whether the process of temporal preparation for a target stimulus is the same regardless of the task required by the target stimulus. To this end, the same variable-foreperiod design was used in a temporal discrimination task (Experiment 1) and a reaction time task (Experiment 2). In Experiment 1, both temporal sensitivity and perceived duration increased as a function of foreperiod, whereas in Experiment 2, foreperiod did not influence reaction time. Furthermore, both temporal sensitivity and perceived duration revealed an asymmetric sequential effect of foreperiod, but the pattern of this effect was opposite to the pattern observed in the reaction time task. Together these dissociative patterns of foreperiod effects suggest that the mechanism of temporal preparation depends on the task required by the target stimulus.

Does temporal preparation increase the rate of sensory information accumulation?

Recent studies showed that temporal preparation, i.e., the ability to prepare for an upcoming stimulus, improves perceptual processing. The mechanisms underlying this benefit are still controversial. Based upon the theoretical framework of accumulation models, it has been proposed that the accumulation of sensory stimulus information begins earlier when participants are temporally prepared than when they are unprepared. Alternatively, however, temporal preparation might also affect the accumulation rate of sensory information. In the present study, we examined these possibilities. Specifically, in three experiments, we manipulated participants' decision criterion. This manipulation should interact with any experimental manipulation affecting the rate of information processing, but produce additive effects with any manipulation affecting the onset of information accumulation rather than its rate. We obtained additive effects on RT, irrespective of whether the decision criterion was manipulated by increasing catch trial proportion or nogo trial proportion. These results suggest that temporal preparation improves perceptual processing by operating on the onset of sensory information accumulation rather than the rate of sensory information accumulation.

Staying responsive to the world: modality-specific and -nonspecific contributions to speeded auditory, tactile, and visual stimulus detection

Sustained responsiveness to external stimulation is fundamental to many time-critical interactions with the outside world. We used functional magnetic resonance imaging during speeded stimulus detection to identify convergent and divergent neural correlates of maintaining the readiness to respond to auditory, tactile, and visual stimuli. In addition, using a multimodal condition, we investigated the effect of making stimulus modality unpredictable. Relative to sensorimotor control tasks, all three unimodal detection tasks elicited stronger activity in the right temporo-parietal junction, inferior frontal cortex, anterior insula, dorsal premotor cortex, and anterior cingulate cortex as well as bilateral mid-cingulum, midbrain, brainstem, and medial cerebellum. The multimodal detection condition additionally activated left dorsal premotor cortex and bilateral precuneus. Modality-specific modulations were confined to respective sensory areas: we found activity increases in relevant, and decreases in irrelevant sensory cortices. Our findings corroborate the modality independence of a predominantly right-lateralized core network for maintaining an alert (i.e., highly responsive) state and extend previous results to the somatosensory modality. Monitoring multiple sensory channels appears to induce additional processing, possibly related to stimulus-driven shifts of intermodal attention. The results further suggest that directing attention to a given sensory modality selectively enhances and suppresses sensory processing-even in simple detection tasks, which do not require inter- or intra-modal selection.

Distraction by irrelevant sound during foreperiods selectively impairs temporal preparation

When the interval between a warning signal (WS) and an imperative signal (IS), termed the foreperiod (FP), is variable across trials, reaction time (RT) to the IS typically decreases with increasing FP length. Here we examined the auditory filled-FP effect, which refers to a performance decrement after FPs filled with irrelevant auditory stimulation compared to FPs without additional stimulation. According to one account, irrelevant stimulation distracts individuals from processing time and probability information during the FP (distraction-during-FP hypothesis). This should predominantly affect long-FP trials. Alternatively, the filled-FP effect may arise from a failure to shift attention from FP modality to IS modality (attention-to-modality hypothesis). The first hypothesis focuses on preparatory processing, predicting a selective RT increase on long-FP trials, whereas the second hypothesis focuses on target processing, only predicting a global RT increase irrespective of FP length. Across four experiments, a filled-FP (compared to a blank-FP) condition consistently yielded a selective RT increase on long-FP trials, irrespective of FP-IS modality pairing. This pattern of results contradicts the attention-to-modality hypothesis but corroborates the distraction-during-FP hypothesis. More generally, these data have theoretical implications by supporting a multi-process view of temporal preparation under time uncertainty.

The effect of a cross-trial shift of auditory warning signals on the sequential foreperiod effect

When a warning signal (WS) precedes an imperative signal (IS) by a certain amount of time (the foreperiod, FP), responses are speeded. Moreover, this effect is modulated by the FP length in the previous trial. This sequential FP effect has lately been attributed to a trace-conditioning mechanism according to which individuals learn (and re-learn) temporal relationships between the WS and the IS. Recent evidence suggests that sensory WS attributes are critical to trigger time-related response activation. Specifically, when WS modality is shifted in subsequent trials (e.g., from auditory to visual modality), the sequential FP effect becomes attenuated. This study examined whether the sequential FP effect is reduced only by between-modality shifts or whether this attenuation generalizes to cross-trial shifts of WS attributes within modalities. We compared dimensional (low vs. high tone frequency) and qualitative shifts (pure tone vs. noise) of equal-intense auditory WS events. The results of four experiments revealed that shifts of tone frequency did not, whereas shifts of qualitative tone characteristics did attenuate the sequential FP effect. These results support the view that the WS acts as a trigger cue that unintentionally activates responses at previously reinforced critical moments.

Differential effects of prolonged work on performance measures in self-paced speed tests

Time-related changes in the speeded performance of complex cognitive tasks are considered to arise from the combined effects of practice and mental fatigue. Here we explored the differential contributions of practice and fatigue to performance changes in a self-paced speeded mental addition and comparison task of about 50 min duration, administered twice within one week’s time. Performance measures included average response speed, accuracy, and response speed variability. The results revealed differential effects of prolonged work on different performance indices: Practice effects, being more pronounced in the first session, were reflected in an improvement of average response speed, whereas mental fatigue, occurring in both sessions, was reflected in an increase of response speed variability. This demonstrates that effects of mental fatigue on average speed of performance may be masked by practice effects but still be detectable in the variability of performance. Therefore, besides experimental factors such as the length and complexity of tasks, indices of response speed variability should be taken into consideration when interpreting different aspects of performance in self-paced speed tests.

Temporal orienting deficit after prefrontal damage

The aim of this study was to explore, for the first time in patients, the neural bases of temporal orienting of attention as well as the interrelations with two other effects of temporal preparation: the foreperiod effect and sequential effects. We administered an experimental task to a group of 14 patients with prefrontal lesion, a group of 15 control subjects and a group of 7 patients with a basal ganglia lesion. In the task, a cue was presented (a short versus long line) to inform participants about the time of appearance (early versus late) of a target stimulus, and the duration of the cue-target time intervals (400 versus 1400 ms) was manipulated. In contrast to the control group, patients with right prefrontal lesion showed a clear deficit in the temporal orienting effect. The foreperiod effect was also affected in the group of patients with prefrontal lesion (without lateralization of the deficit), whereas sequential effects were preserved. The group of basal ganglia patients did not show deficits in any of the effects. These findings support the voluntary and strategic nature of the temporal orienting and foreperiod effects, which depend on the prefrontal cortex, as well as the more automatic nature of sequential effects, which do not depend on either prefrontal cortex or frontobasal circuits.

Mental fatigue and temporal preparation in simple reaction-time performance

Performance decrements attributed to mental fatigue have been found to be especially pronounced in tasks that involve the voluntary control of attention. Here we explored whether mental fatigue from prolonged time on task (TOT) also impairs temporal preparation for speeded action in a simple reaction-time task. Temporal preparation is enabled by a warning signal presented before the imperative stimulus and usually results in shorter reaction time (RT). When the delay between warning and imperative stimuli - the foreperiod (FP) - varies between trials, responses are faster with longer FPs. This pattern has been proposed to arise from either voluntary attentional processes (temporal orienting) or automatic trial-to-trial learning (trace conditioning). The former account suggests a selective RT increase on long-FP trials with fatigue; the latter account suggests no such change. Over a work period of 51 min, we found the typical increase in overall RT but no selective RT increase after long FPs. This additivity indicates that TOT-induced mental fatigue generally reduces cognitive efficiency but leaves temporal preparation under time uncertainty unaffected. We consider this result more consistent with the trace-conditioning account of temporal preparation.

Neuroticism and Speed-Accuracy Tradeoff in Self-Paced Speeded Mental Addition and Comparison

Previous research suggests a relationship between neuroticism (N) and the speed-accuracy tradeoff in speeded performance: High-N individuals were observed performing less efficiently than low-N individuals and compensatorily overemphasizing response speed at the expense of accuracy. This study examined N-related performance differences in the serial mental addition and comparison task (SMACT) in 99 individuals, comparing several performance measures (i.e., response speed, accuracy, and variability), retest reliability, and practice effects. N was negatively correlated with mean reaction time but positively correlated with error percentage, indicating that high-N individuals tended to be faster but less accurate in their performance than low-N individuals. The strengthening of the relationship after practice demonstrated the reliability of the findings. There was, however, no relationship between N and distractibility (assessed via measures of reaction time variability). Our main findings are in line with the processing efficiency theory, extending the relationship between N and working style to sustained self-paced speeded mental addition.

Dynamic adjustment of temporal preparation: shifting warning signal modality attenuates the sequential foreperiod effect

We examined sequential effects in the variable foreperiod (FP) paradigm, which refer to the finding that responses to an imperative signal (IS) are fast when a short FP trial is repeated but slow when it is preceded by a long FP trial. The effect has been attributed to a trace-conditioning mechanism in which individuals learn the temporal relationship between a warning signal (WS) and the IS in a trial-by-trial manner. An important assumption is that the WS in a current trial (i.e., trial FP(n)) acts as a conditioned stimulus, such that it automatically triggers the conditioned response at the exact critical moment that was imperative in the previous trial (i.e., trial FP(n-1)). According to this assumption, a shift from one WS modality in trial FP(n-1) to another modality in trial FP(n) is expected to eliminate or at least reduce the sequential FP effect. This prediction was tested in three experiments that included a random variation of WS modality and FP length within blocks of trials. In agreement with the prediction, a shift in WS modality attenuated the asymmetry of the sequential FP effect.

Interacting outcome retrieval, anticipation, and feedback processes in the human brain

Cognitive control is an inherently multivariate phenomenon, and its neural basis is currently unclear. Here we examined using functional magnetic resonance imaging how participants retrieve prelearnt information from memory, use this information to guide responses for an impending decision, and adjust their responses based on outcome feedback. We developed a behavioral task designed to manipulate memory outcome-retrieval load, outcome-anticipation interval, and outcome-feedback processes. This allowed us to understand the neural basis of these cognitive processes in isolation and how they interact. Extending previous work, we found a retrieval-load by outcome-feedback interaction in the left globus pallidus; an outcome-feedback by anticipation-interval interaction in the inferior prefrontal cortex; a retrieval-load by anticipation-interval interaction in the midcingulate gyrus and a load by interval by outcome interaction in the right frontal pole. These results further advance our knowledge of how fundamental cognitive processes interact physiologically to give rise to higher-level behavioral control.