Temporal preparation influences the dynamics of information processing: Evidence for early onset of information accumulation

Variable, sometimes absent, but never negative: Applying multilevel models of variability to the backward crosstalk effect to find theoretical constraints

When performing two tasks at the same time, the congruency of the second task's features influences performance in the first task. This is called the backward crosstalk effect (BCE), a phenomenon that influences both theories of binding and of dual-task capacity limitations. The question of whether the BCE is found in all participants at all times is relevant for understanding the basis of the effect. For example, if the BCE is based on strategic choices, it can be variable, but if it is automatic and involuntary, it should never vary in whether it is present or not. Variability in observed BCE sizes was already documented and discussed when the group average effect was first reported (Hommel, 1998). Yet the theories discussed at the time did not motivate a more direct analysis of this variability, nor did the readily available statistical tools permit it. Some statistical approaches recently applied in cognitive psychology allow such a variability-focused analysis and some more recent theoretical debates would benefit from this as well. We assessed the variability of the BCE as well as a BCE-like free-choice congruency effect by applying a Bayesian multilevel modeling approach to the data from a dual-tasking experiment. Trials consisted of a two- and a four-response task. We manipulated which task was presented first and whether the response to the four-choice task was free or forced choice. RT data were best predicted by a model in which the BCE is zero in part of the population and drawn from a normal distribution truncated at zero (and thus always positive) in the rest of the population. Choice congruency bias data were best predicted by a model assuming this effect to be drawn from a normal distribution truncated at zero (but, in contrast to the RT data, without the subset of the population where it is zero). The BCE is not an inflexible and universal phenomenon that is directly linked to an inherent structural trait of human cognition. We discuss theoretical constraints implied by these results with a focus on what we can infer about the traits of the factors that influence BCE size. We suggest that future research might add further major constraints by using multi-session experiments to distinguish between-person and within-person variability. Our results show that the BCE is variable. The next step is understanding along which axes it is variable and why it varies.

Temporal unpredictability increases error monitoring as revealed by EEG-EMG investigation

Reacting in an unpredictable context increases error monitoring as evidenced by greater error-related negativity (ERN), an electrophysiological marker linked to an evaluation of response outcomes. We investigated whether ERN also increased when participants evaluated their responses to events that appeared in unpredictable versus predictable moments in time. We complemented electroencephalographic (EEG) analysis of cortical activity by measuring performance monitoring processes at the peripheral level using electromyography (EMG). Specifically, we used EMG data to quantify how temporal unpredictability would affect motor time (MT), the interval between the onset of muscle activity, and the mechanical response. MT increases following errors, indexing online error detection, and an attempt to stop incorrect actions. In our temporally cued version of the stop-signal task, symbolic cues predicted (temporally predictable condition) or not (temporally unpredictable condition) the onset of a target. In 25% of trials, an auditory signal occurred shortly after the target presentation, informing participants that they should inhibit their response completely. Response times were slower, and fewer inhibitory errors were made during temporally unpredictable than predictable trials, indicating enhanced control of unwanted actions when target onset time was unknown. Importantly, the ERN to inhibitory errors was greater in temporally unpredictable relative to temporally predictable conditions. Similarly, EMG data revealed prolonged MT when reactions to temporally unpredictable targets had not been stopped. Taken together, our results show that a temporally unpredictable environment increases the control of unwanted actions, both at cortical and peripheral levels, suggesting a higher subjective cost of maladaptive responses to temporally uncertain events.

Exogenous temporal attention varies with temporal uncertainty

Temporal attention is the selection and prioritization of information at a specific moment. Exogenous temporal attention is the automatic, stimulus driven deployment of attention. The benefits and costs of exogenous temporal attention on performance have not been isolated. Previous experimental designs have precluded distinguishing the effects of attention and expectation about stimulus timing. Here, we manipulated exogenous temporal attention and the uncertainty of stimulus timing independently and investigated visual performance at the attended and unattended moments with different levels of temporal uncertainty. In each trial, two Gabor patches were presented consecutively with a variable stimulus onset. To drive exogenous attention and test performance at attended and unattended moments, a task-irrelevant, brief cue was presented 100 ms before target onset, and an independent response cue was presented at the end of the trial. Exogenous temporal attention slightly improved accuracy, and the effects varied with temporal uncertainty, suggesting a possible interaction of temporal attention and expectations in time.

Temporal preparation accelerates spatial selection by facilitating bottom-up processing

Temporal preparation facilitates spatial selection in visual search. This selection benefit has not only been observed for targets, but also for task-irrelevant, salient distractors. This result suggests that temporal preparation influences bottom-up salience in spatial selection. To test this assumption, we conducted an event-related-potential (ERP) study in which we measured the joint effect of temporal preparation and target salience on the N2pc as an index of spatial selection and the N1 as an index of perceptual discrimination. To manipulate target salience, we employed two different setsizes (i.e., a small or large number of homogeneous distractors). To manipulate temporal preparation, we presented a warning signal before the search display and we varied the length of the interval (foreperiod) between warning signal and search display in different blocks of trials (constant foreperiod paradigm). Replicating previous results, we observed that the N1 and the N2pc arose earlier in case of good temporal preparation. Importantly, the beneficial effect on the N2pc onset latency was stronger when the target salience was initially low (i.e., small setsize). This result provides evidence that temporal preparation influences bottom-up processing and, thereby, facilitates spatial selection.

Rhythmic and non-rhythmic auditory precues: Multiple mechanisms mediating movement performance

Rhythmic auditory stimuli presented before a goal-directed movement have been found to improve temporal and spatial movement outcomes. However, little is known about the mechanisms mediating these benefits. The present experiment used three types of auditory stimuli to probe how improved scaling of movement parameters, temporal preparation and an external focus of attention may contribute to changes in movement performance. Three types of auditory stimuli were presented for 1200 ms before movement initiation; three metronome beats (RAS), a tone that stayed the same (tone-same), a tone that increased in pitch (tone-change) and a no sound control, were presented with and without visual feedback for a total of eight experimental conditions. The sound was presented before a visual go-signal, and participants were instructed to reach quickly and accurately to one of two targets randomly identified in left and right hemispace. Twenty-two young adults completed 24 trials per blocked condition in a counterbalanced order. Movements were captured with an Optotrak 3D Investigator, and a 4(sound) by 2(vision) repeated measures ANOVA was used to analyze dependant variables. All auditory conditions had shorter reaction times than no sound. Tone-same and tone-change conditions had shorter movement times and higher peak velocities, with no change in trajectory variability or endpoint error. Therefore, rhythmic and non-rhythmic auditory stimuli impacted movement performance differently. Based on the pattern of results we propose multiple mechanisms impact movement planning processes when rhythmic auditory stimuli are present.

Temporal Expectation Hastens Decision Onset But Does Not Affect Evidence Quality

The ability to predict the timing of forthcoming events, known as temporal expectation, has a strong impact on human information processing. Although there is growing consensus that temporal expectations enhance the speed and accuracy of perceptual decisions, it remains unclear whether they affect the decision process itself, or non-decisional (sensory/motor) processes. Here, healthy human participants (N = 21; 18 female) used predictive auditory cues to anticipate the timing of low-contrast visual stimuli they were required to detect. Modeling of the behavioral data using a prominent sequential sampling model indicated that temporal expectations speeded up non-decisional processes but had no effect on decision formation. Electrophysiological recordings confirmed and extended this result: temporal expectations hastened the onset of a neural signature of decision formation but had no effect on its build-up rate. Anticipatory α band power was modulated by temporal expectation and co-varied with intrinsic trial-by-trial variability in behavioral and neural signatures of the onset latency of the decision process. These findings highlight how temporal predictions optimize our interaction with unfolding sensory events.SIGNIFICANCE STATEMENT Temporal expectation enhances performance, but the locus of this effect remains debated. Here, we contrasted the two dominant accounts: enhancement through (1) expedited decision onset, or (2) an increase in the quality of sensory evidence. We manipulated expectations about the onset of a dim visual target using a temporal cueing paradigm, and probed the locus of the expectation effect with two complementary approaches: drift diffusion modeling (DDM) of behavior, and estimation of the onset and progression of the decision process from a supramodal accumulation-to-bound signal in simultaneously measured EEG signals. Behavioral modeling and neural data provided strong, converging evidence for an account in which temporal expectations enhance perception by speeding up decision onset, without affecting evidence quality.

The time-course of endogenous temporal attention - Super fast voluntary allocation of attention

It is widely accepted that voluntary spatial attention is slow - it can only affect performance with medium and long cue-target intervals. Here, we examined whether this also holds for voluntary temporal attention. We performed a rigorous examination of the time-course of attention allocation to a point in time using two common paradigms for studying endogenous temporal attention: 'constant foreperiod' and 'temporal orienting'. With both paradigms, the task required non-speeded identification of a letter, whose presentation was preceded by a warning cue. This cue was either auditory or visual, and it was either informative or uninformative. Critically, to avoid exogenous attention, the cues did not involve an intensity change. We found significantly higher identification accuracy when the cue was informative than uninformative, suggesting that temporal attention improved perceptual processing. Importantly, reliable effects of temporal attention on perceptual processing were found with as little as 150 ms from cue onset and up to 2400 ms. Hence, measuring endogenous attention in the temporal domain revealed a twofold faster mechanism than what was believed based on measurements in the spatial domain. These findings challenge the common assumption that voluntary processes are inherently slow. Instead, they portray voluntary mechanisms as considerably more flexible and dynamic, and they further underscore the importance of incorporating the temporal domain into the study of human perception.

The role of premature evidence accumulation in making difficult perceptual decisions under temporal uncertainty

The computations and neural processes underpinning decision making have primarily been investigated using highly simplified tasks in which stimulus onsets cue observers to start accumulating choice-relevant information. Yet, in daily life we are rarely afforded the luxury of knowing precisely when choice-relevant information will appear. Here, we examined neural indices of decision formation while subjects discriminated subtle stimulus feature changes whose timing relative to stimulus onset ('foreperiod') was uncertain. Joint analysis of behavioural error patterns and neural decision signal dynamics indicated that subjects systematically began the accumulation process before any informative evidence was presented, and further, that accumulation onset timing varied systematically as a function of the foreperiod of the preceding trial. These results suggest that the brain can adjust to temporal uncertainty by strategically modulating accumulation onset timing according to statistical regularities in the temporal structure of the sensory environment with particular emphasis on recent experience.

The costs and benefits of temporal predictability: impaired inhibition of prepotent responses accompanies increased activation of task-relevant responses

While the benefit of temporal predictability on sensorimotor processing is well established, it is still unknown whether this is due to efficient execution of an appropriate response and/or inhibition of an inappropriate one. To answer this question, we examined the effects of temporal predictability in tasks that required selective (Simon task) or global (Stop-signal task) inhibitory control of prepotent responses. We manipulated temporal expectation by presenting cues that either predicted (temporal cues) or not (neutral cues) when the target would appear. In the Simon task, performance was better when target location (left/right) was compatible with the hand of response and performance was improved further still if targets were temporally cued. However, Conditional Accuracy Functions revealed that temporal predictability selectively increased the number of fast, impulsive errors. Temporal cueing had no effect on selective response inhibition, as measured by the dynamics of the interference effect (delta plots) in the Simon task. By contrast, in the Stop-signal task, Stop-signal reaction time, a covert measure of a more global form of response inhibition, was significantly longer in temporally predictive trials. Therefore, when the time of target onset could be predicted in advance, it was harder to stop the impulse to respond to the target. Collectively, our results indicate that temporal cueing compounded the interfering effects of a prepotent response on task performance. We suggest that although temporal predictability enhances activation of task-relevant responses, it impairs inhibition of prepotent responses.

Influence of Temporal Expectations on Response Priming by Subliminal Faces

Unconscious processes are often assumed immune from attention influence. Recent behavioral studies suggest however that the processing of subliminal information can be influenced by temporal attention. To examine the neural mechanisms underlying these effects, we used a stringent masking paradigm together with fMRI to investigate how temporal attention modulates the processing of unseen (masked) faces. Participants performed a gender decision task on a visible neutral target face, preceded by a masked prime face that could vary in gender (same or different than target) and emotion expression (neutral or fearful). We manipulated temporal attention by instructing participants to expect targets to appear either early or late during the stimulus sequence. Orienting temporal attention to subliminal primes influenced response priming by masked faces, even when gender was incongruent. In addition, gender-congruent primes facilitated responses regardless of attention while gender-incongruent primes reduced accuracy when attended. Emotion produced no differential effects. At the neural level, incongruent and temporally unexpected primes increased brain response in regions of the fronto-parietal attention network, reflecting greater recruitment of executive control and reorienting processes. Congruent and expected primes produced higher activations in fusiform cortex, presumably reflecting facilitation of perceptual processing. These results indicate that temporal attention can influence subliminal processing of face features, and thus facilitate information integration according to task-relevance regardless of conscious awareness. They also suggest that task-congruent information between prime and target may facilitate response priming even when temporal attention is not selectively oriented to the prime onset time.

Time-Based Expectancy for Task Relevant Stimulus Features

When a particular target stimulus appears more frequently after a certain interval than after another one, participants adapt to such regularity, as evidenced by faster responses to frequent interval-target combinations than to infrequent ones. This phenomenon is known as time-based expectancy. Previous research has suggested that time-based expectancy is primarily motor-based, in the sense that participants learn to prepare a particular response after a specific interval. Perceptual time-based expectancy — in the sense of learning to perceive a certain stimulus after specific interval — has previously not been observed. We conducted a Two-Alternative-Forced-Choice experiment with four stimuli differing in shape and orientation. A subset of the stimuli was frequently paired with a certain interval, while the other subset was uncorrelated with interval. We varied the response relevance of the interval-correlated stimuli, and investigated under which conditions time-based expectancy transfers from trials with interval-correlated stimuli to trials with interval-uncorrelated stimuli. Transfer was observed only where transfer of perceptual expectancy and transfer of response expectancy predicted the same behavioral pattern, not when they predicted opposite patterns. The results indicate that participants formed time-based expectancy for stimuli as well as for responses. However, alternative interpretations are also discussed.

Multimodal Integration of Time

Recent studies suggest that the accuracy of duration discrimination for visually presented intervals is strongly impaired by concurrently presented auditory intervals of different duration, but not vice versa. Because these studies rely mostly on accuracy measures, it remains unclear whether this impairment results from changes in perceived duration or rather from a decrease in perceptual sensitivity. We therefore assessed complete psychometric functions in a duration discrimination task to disentangle effects on perceived duration and sensitivity. Specifically, participants compared two empty intervals marked by either visual or auditory pulses. These pulses were either presented unimodally, or accompanied by task-irrelevant pulses in the respective other modality, which defined conflicting intervals of identical, shorter, or longer duration. Participants were instructed to base their temporal judgments solely on the task-relevant modality. Despite this instruction, perceived duration was clearly biased toward the duration of the intervals marked in the task-irrelevant modality. This was not only found for the discrimination of visual intervals, but also, to a lesser extent, for the discrimination of auditory intervals. Discrimination sensitivity, however, was similar between all multimodal conditions, and only improved compared to the presentation of unimodal visual intervals. In a second experiment, evidence for multisensory integration was even found when the task-irrelevant modality did not contain any duration information, thus excluding noncompliant attention allocation as a basis of our results. Our results thus suggest that audiovisual integration of temporally discrepant signals does not impair discrimination sensitivity but rather alters perceived duration, presumably by means of a temporal ventriloquism effect.

Does temporal preparation facilitate visual processing in a selective manner? Evidence from attentional capture

The present study addressed the question of whether temporal preparation influences perceptual stimulus processing in a selective manner. In three visual search experiments, we examined whether temporal preparation aids spatial selection and thus reduces distraction caused by the onset of a task-irrelevant item. In each trial, participants had to detect a target amongst five non-targets and report a basic feature of the target. In some trials, an additional task-irrelevant singleton item (abrupt onset) appeared on the screen which distracted attention away from the target. To manipulate the degree of distraction, we varied the spatial distance and the stimulus-onset asynchrony between target and singleton. Temporal preparation for the target varied by means of constant foreperiods of different lengths. Though we observed overall faster responding in the case of high temporal preparation in all three experiments, temporal preparation did not reduce spatial distraction by the abrupt onset, even when the spatial position of the target was predictable. In sum, this pattern of results does not provide support for an influence of temporal preparation on spatial selection. Instead, it indicates that temporal preparation affects early visual processing in a non-selective manner.

Stochastic accumulation of feature information in perception and memory

It is now well established that the time course of perceptual processing influences the first second or so of performance in a wide variety of cognitive tasks. Over the last 20 years, there has been a shift from modeling the speed at which a display is processed, to modeling the speed at which different features of the display are perceived and formalizing how this perceptual information is used in decision making. The first of these models (Lamberts, 1995) was implemented to fit the time course of performance in a speeded perceptual categorization task and assumed a simple stochastic accumulation of feature information. Subsequently, similar approaches have been used to model performance in a range of cognitive tasks including identification, absolute identification, perceptual matching, recognition, visual search, and word processing, again assuming a simple stochastic accumulation of feature information from both the stimulus and representations held in memory. These models are typically fit to data from signal-to-respond experiments whereby the effects of stimulus exposure duration on performance are examined, but response times (RTs) and RT distributions have also been modeled. In this article, we review this approach and explore the insights it has provided about the interplay between perceptual processing, memory retrieval, and decision making in a variety of tasks. In so doing, we highlight how such approaches can continue to usefully contribute to our understanding of cognition.

Time pressure affects the efficiency of perceptual processing in decisions under conflict

The negative correlation between speed and accuracy in perceptual decision making is often explained as a tradeoff, where lowered decision boundaries under time pressure result in faster but more error-prone responses. Corresponding implementations in sequential sampling models confirmed the success of this account, which has led to the prevalent assumption that a second component of decision making, the efficiency of perceptual processing, is largely independent from temporal demands. To test the generality of this claim, we examined time pressure effects on decisions under conflict. Data from a flanker task were fit with a sequential sampling model that incorporates two successive phases of response selection, driven by the output of an early and late stage of stimulus selection, respectively. The fits revealed the canonical decrease of response boundaries with increasing time pressure. In addition, time pressure reduced the duration of non-decisional processes and impaired the early stage of stimulus selection, together with the subsequent first phase of response selection. The results show that the relation between speed and accuracy not only relies on the strategic adjustment of response boundaries but involves variations of processing efficiency. The findings support recent evidence of drift rate modulations in response to time pressure in simple perceptual decisions and confirm their validity in the context of more complex tasks.

The effects of alerting signals in masked priming

Alerting signals often serve to reduce temporal uncertainty by predicting the time of stimulus onset. The resulting response time benefits have often been explained by facilitated translation of stimulus codes into response codes on the basis of established stimulus-response (S-R) links. In paradigms of masked S-R priming alerting signals also modulate response activation processes triggered by subliminally presented prime stimuli. In the present study we tested whether facilitation of visuo-motor translation processes due to alerting signals critically depends on established S-R links. Alerting signals resulted in significantly enhanced masked priming effects for masked prime stimuli that included and that did not include established S-R links (i.e., target vs. novel primes). Yet, the alerting-priming interaction was more pronounced for target than for novel primes. These results suggest that effects of alerting signals on masked priming are especially evident when S-R links between prime and target exist. At the same time, an alerting-priming interaction also for novel primes suggests that alerting signals also facilitate stimulus-response translation processes when masked prime stimuli provide action-trigger conditions in terms of programmed S-R links.

The specificity of temporal expectancy: Evidence from a variable foreperiod paradigm

In speeded choice tasks with variable foreperiods (FPs), individuals behaviourally adapt to various frequency manipulations. Adaptations have been shown to frequencies of different stimulus–response events, to frequencies of different foreperiods, and to frequencies of different event–foreperiod combinations. We have investigated how participants adapt to a situation where all three frequency manipulations are done simultaneously. Three variable foreperiod experiments are reported. In Experiment 1, one target (the peak distributed target) appeared particularly frequently after one particular FP (the peak foreperiod), while another target was less frequent and equally distributed over all foreperiods. In Experiment 2, the equally distributed target was overall more frequent than the peak distributed one. In both experiments, performance advantages for the peak distributed target were specific to the peak foreperiod, and performance advantages at the peak foreperiod were specific to the peak distributed targets. A third experiment showed that, when two differently frequent target are both equally distributed over FPs, the performance distribution over FPs is not significantly different between both targets. Together, the results suggest that participants were able to simultaneously and specifically adapt to frequency manipulations in events, foreperiods, and event–foreperiod combinations.

How does temporal preparation speed up response implementation in choice tasks? Evidence for an early cortical activation

We investigated the influence of temporal preparation on information processing. Single-pulse transcranial magnetic stimulation (TMS) of the primary motor cortex was delivered during a between-hand choice task. The time interval between the warning and the imperative stimulus varied across blocks of trials was either optimal (500 ms) or nonoptimal (2500 ms) for participants' performance. Silent period duration was shorter prior to the first evidence of response selection for the optimal condition. Amplitude of the motor evoked potential specific to the responding hand increased earlier for the optimal condition. These results revealed an early release of cortical inhibition and a faster integration of the response selection-related inputs to the corticospinal pathway when temporal preparation is better. Temporal preparation may induce cortical activation prior to response selection that speeds up the implementation of the selected response.

Does temporal preparation increase the rate of sensory information accumulation?

Recent studies showed that temporal preparation, i.e., the ability to prepare for an upcoming stimulus, improves perceptual processing. The mechanisms underlying this benefit are still controversial. Based upon the theoretical framework of accumulation models, it has been proposed that the accumulation of sensory stimulus information begins earlier when participants are temporally prepared than when they are unprepared. Alternatively, however, temporal preparation might also affect the accumulation rate of sensory information. In the present study, we examined these possibilities. Specifically, in three experiments, we manipulated participants' decision criterion. This manipulation should interact with any experimental manipulation affecting the rate of information processing, but produce additive effects with any manipulation affecting the onset of information accumulation rather than its rate. We obtained additive effects on RT, irrespective of whether the decision criterion was manipulated by increasing catch trial proportion or nogo trial proportion. These results suggest that temporal preparation improves perceptual processing by operating on the onset of sensory information accumulation rather than the rate of sensory information accumulation.

Implicit, predictive timing draws upon the same scalar representation of time as explicit timing

It is not yet known whether the scalar properties of explicit timing are also displayed by more implicit, predictive forms of timing. We investigated whether performance in both explicit and predictive timing tasks conformed to the two psychophysical properties of scalar timing: the Psychophysical law and Weber's law. Our explicit temporal generalization task required overt estimation of the duration of an empty interval bounded by visual markers, whereas our temporal expectancy task presented visual stimuli at temporally predictable intervals, which facilitated motor preparation thus speeding target detection. The Psychophysical Law and Weber's Law were modeled, respectively, by (1) the functional dependence between mean subjective time and real time (2) the linearity of the relationship between timing variability and duration. Results showed that performance for predictive, as well as explicit, timing conformed to both psychophysical properties of interval timing. Both tasks showed the same linear relationship between subjective and real time, demonstrating that the same representational mechanism is engaged whether it is transferred into an overt estimate of duration or used to optimise sensorimotor behavior. Moreover, variability increased with increasing duration during both tasks, consistent with a scalar representation of time in both predictive and explicit timing. However, timing variability was greater during predictive timing, at least for durations greater than 200 msec, and ascribable to temporal, rather than non-temporal, mechanisms engaged by the task. These results suggest that although the same internal representation of time was used in both tasks, its external manifestation varied as a function of temporal task goals.