Control by action representation and input selection (CARIS): a theoretical framework for task switching

Exploring "phasic" vs. "tonic" accounts of the effect of switch probability on the auditory attention switch cost

Task-switching experiments have shown that the "switch cost" (poorer performance for task switches than for repetitions) is smaller when the probability of a switch is high (e.g., 0.75) than when it is low (e.g., 0.25). Some theoretical accounts explain this effect in terms of top-down control deployed in advance of the task cue ("pre-cue reconfiguration"). We tested such accounts by manipulating the time available before the onset of the cue (the response-cue interval, RCI), reasoning that top-down pre-cue reconfiguration requires time and therefore its effect should increase with RCI. Participants heard a man and a woman simultaneously speaking number words and categorised the number (< 5 vs. > 5) spoken by the voice specified by a pictorial gender-related cue presented at an RCI of 100 ms or 2,200 ms. The target voice switched with a probability of 0.25 or 0.75 (in separate sessions). In Experiment 1, RTs revealed a large effect of switch probability on the switch cost in the short RCI, which did not increase in the long RCI. Errors hinted at such an increase, but it did not receive clear statistical support and was disconfirmed by a direct and better powered replication in Experiment 2, which fully confirmed the RT pattern from Experiment 1. Thus, the effect of switch probability on the switch cost required little/no time following the response to emerge-it was already at full magnitude at a short RCI-challenging accounts that assume "phasic" deployment of top-down task-set control in advance of the cue.

Inhibition during task switching is affected by the number of competing tasks

Inhibition during task switching is assumed to be indexed by n - 2 repetition costs-that is, performance costs when the task in the current trial equals the task in trial n - 2 (sequences of type ABA) compared with two consecutive switches to another task each (sequences CBA). The present study examined effects of a short-term reduction of the number of candidate tasks on these costs. For this purpose, a variant of the task switching paradigm was used in which in half of the trials, a precue that preceded the task cue allowed for a short-term reduction of the number of candidate tasks. In Experiment 1, one out of three tasks could be excluded. In Experiment 2, one or two out of four tasks could be excluded. Experiment 3 served as control condition using the standard cueing paradigm. Significant n - 2 repetition costs were present with three candidate tasks. In contrast, no costs were visible when the number of candidate tasks was reduced to two. This result is interpreted in terms of a task selection mechanism based on antagonistic constraints among task representations, which operates on a rather superficial level when switching among only two tasks, thereby reducing the need for inhibition.

To switch or to repeat? Commonalities and differences in the electrophysiological correlates of preparation for voluntary and forced task choices

When switching tasks in the laboratory, either the experimenter or the participant can decide which task comes next. So far, this kind of forced and voluntary task switching is usually investigated in isolation. However, in our everyday life, switching between different tasks and goals often depends both on current situational demands and on our intentions. While research has mainly focused on differences between forced and voluntary switching, it is still unclear whether, and if so, which neural processes are shared between both switch types. To identify these, we compared electrophysiological preparatory activity in blocks of randomly intermixed voluntary and forced task-switching trials. We further manipulated the forced switch rate (20% vs. 80%) between blocks to de-confound voluntariness with switch frequency and to investigate how switch frequency effects influence preparatory potentials. ERP analysis revealed an enhanced early parietal activity pattern in the P3b time window on voluntary trials, possibly reflecting early traces of a decision process. A later pre-target negativity was enhanced on forced as compared to voluntary trials. Multivariate pattern analyses revealed that a common preparatory activity on both forced and voluntary switch trials can be found in the switch positivity time window, which we interpreted as an index of a common endogenous task preparation process.

Combined influences of strategy and selection history on attentional control

Visual attention is guided by top-down mechanisms and pre-stimulus task preparation, but also by selection history (i.e., the bias to prioritize previously attended items). Here we examine how these influences combine. Two groups of participants completed two intermingled tasks. One task involved categorization of a unique target; one group categorized the target based on color, and the other based on shape. The other task involved searching for a target defined by unique shape while ignoring a distractor defined by unique color. Our expectation was that the search task would be difficult for the color-categorization group because their categorization task required attentional resolution of color, but the search task required that they ignore color. In some experimental blocks, trials from the two tasks appeared predictably, giving the color-categorization group an opportunity to strategically prepare by switching between color-prioritizing and shape-prioritizing attentional templates. We looked to pre-stimulus oscillatory activity as a direct index of this preparation, and to reaction times and post-stimulus ERPs for markers of resultant change in attentional deployment. Results showed that preparation in the color-categorization group optimized attentional templates, such that these participants became less sensitive to the color distractor in the search task. But preparation was not sufficient to entirely negate the influence of selection history, and participants in the color-categorization group continued to show a propensity to attend to the color distractor. These results indicate that preparatory effort can be scaled to the anticipated attentional requirements, but attention is nevertheless considerably biased by selection history.

Serial or parallel proactive control of components of task-set? A task-switching investigation with concurrent EEG and eye-tracking

Among the issues examined by studies of cognitive control in multitasking is whether processes underlying performance in the different tasks occur serially or in parallel. Here we ask a similar question about processes that pro-actively control task-set. In task-switching experiments, several indices of task-set preparation have been extensively documented, including anticipatory orientation of gaze to the task-relevant location (an unambiguous marker of reorientation of attention), and a positive polarity brain potential over the posterior cortex (whose functional significance is less well understood). We examine whether these markers of preparation occur in parallel or serially, and in what order. On each trial a cue required participants to make a semantic classification of one of three digits presented simultaneously, with the location of each digit consistently associated with one of three classification tasks (e.g., if the task was odd/even, the digit at the top of the display was relevant). The EEG positivity emerged following, and appeared time-locked to, the anticipatory fixation on the task-relevant location, which might suggest serial organisation. However, the fixation-locked positivity was not better defined than the cue-locked positivity; in fact, for the trials with the earliest fixations the positivity was better time-locked to the cue onset. This is more consistent with (re)orientation of spatial attention occurring in parallel with, but slightly before, the reconfiguration of other task-set components indexed by the EEG positivity.

The role of working memory for task-order coordination in dual-task situations

Dual-task (DT) situations require task-order coordination processes that schedule the processing of two temporally overlapping tasks. Theories on task-order coordination suggest that these processes rely on order representations that are actively maintained and processed in working memory (WM). Preliminary evidence for this assumption stems from DT situations with variable task order, where repeating task order relative to the preceding trials results in improved performance compared to changing task order, indicating the processing of task-order information in WM between two succeeding trials. We directly tested this assumption by varying WM load during a DT with variable task order. In Experiment 1, WM load was manipulated by varying the number of stimulus–response mappings of the component tasks. In Experiment 2A, WM load was increased by embedding an additional WM updating task in the applied DT. In both experiments, the performance benefit for trials with repeated relative to trials with changed task order was reduced under high compared to low WM load. These results confirm our assumption that the processing of the task-order information relies on WM resources. In Experiment 2B, we tested whether the results of Experiment 2A can be attributed to introducing an additional task per se rather than to increased WM load by introducing an additional task with a low WM load. Importantly, in this experiment, the processing of order information was not affected. In sum, the results of the three experiments indicate that task-order coordination relies on order information which is maintained in an accessible state in WM during DT processing.

Task Switching and the Role of Motor Reprogramming in Parietal Structures

Human behaviour amazes with extraordinary flexibility and the underlying neural mechanisms have often been studied using task switching. Despite extensive research, the relative importance of "cognitive" and "motor" aspects during switching is unclear. In the current study we examine this question combining EEG analysis techniques and source localization to examine whether the selection of the response, or processes during the execution of the response, contribute most to switching effects. A clear dissociation was observed in the signal decomposition, since codes relating to motor aspects play a significant role in task switching and the scope of the switching costs. This was not the case for signals that denote reaction selection or decision processes that respond to selection or basic stimulus processing codes. On a functional neuroanatomical level, these modulations in motor processes showed a clear temporal sequence in that motor codes are processed primarily in superior parietal regions (Brodman area 7) and only then in premotor regions (Brodman area 6). The observed modulations may reflect motor reprogramming processes. The study shows how EEG signal analysis in combination with brain mapping methods can inform debates on theories of human cognitive flexibility.

Examining the Trainability and Transferability of Working-Memory Gating Policies

Internal working memory (WM) gating control policies have been suggested to constitute a critical component of task-sets that can be learned and transferred to very similar task contexts (Bhandari and Badre (Cognition, 172, 33–43, 2018). Here, we attempt to expand these findings, examining whether such control policies can be also trained and transferred to other untrained cognitive control tasks, namely to task switching and AX-CPT. To this end, a context-processing WM task was used for training, allowing to manipulate either input (i.e., top-down selective entry of information into WM) or output (i.e., bottom-up selective retrieval of WM) gating control policies by employing either a context-first (CF) or context-last (CL) task structure, respectively. In this task, two contextual cues were each associated with two different stimuli. In CF condition, each trial began with a contextual cue, determining which of the two subsequent stimuli is target relevant. In contrast, in the CL condition the contextual cue appeared last, preceded by a target and non-target stimulus successively. Participants completed a task switching baseline assessment, followed by one practice and six training blocks with the WM context-processing training task. After completing training, task-switching and AX-CPT transfer blocks were administrated, respectively. As hypothesized, compared to CL training condition, CF training led to improved task-switching performance. However, contrary to our predictions, training type did not influence AX-CPT performance. Taken together, the current results provide further evidence that internal control policies are (1) inherent element of task-sets, also in task switching and (2) independent of S-R mappings. However, these results need to be cautiously interpreted due to baseline differences in task-switching performance between the conditions (overall slower RTs in the CF condition). Importantly though, our results open a new venue for the realm of cognitive enhancement, pointing here for the first time to the potential of control policies training in promoting wider transfer effects.

Erasing the Homunculus as an Ongoing Mission: A Reply to the Commentaries

In our recent article (Schmidt, Liefooghe, & De Houwer, 2020, this volume), we presented an adaptation of the Parallel Episodic Processing (PEP) model for simulating instruction following and task-switching behaviour. In this paper, we respond to five commentaries on our article: Monsell & McLaren (2020), Koch & Lavric (2020), Meiran (2020), Longman (2020), and Pfeuffer (2020). The commentaries discuss potential future modelling goals, deeper reflections on cognitive control, and some potential challenges for our theoretical perspective and associated model. We focus primarily on the latter. In particular, we clarify that we (a) acknowledge the role of cognitive control in task switching, and (b) are arguing that certain task-switching effects do not serve as a good measure of said cognitive control. We also discuss some ambiguities in terminological uses (e.g., the meaning of "task-set reconfiguration"), along with some future experimental and modelling research directions.

An Episodic Model of Task Switching Effects: Erasing the Homunculus from Memory

The Parallel Episodic Processing (PEP) model is a neural network for simulating human performance in speeded response time tasks. It learns with an exemplar-based memory store and it is capable of modelling findings from various subdomains of cognition. In this paper, we show how the PEP model can be designed to follow instructions (e.g., task rules and goals). The extended PEP model is then used to simulate a number of key findings from the task switching domain. These include the switch cost, task-rule congruency effects, response repetition asymmetries, cue repetition benefits, and the full pattern of means from a recent feature integration decomposition of cued task switching (Schmidt & Liefooghe, 2016). We demonstrate that the PEP model fits the participant data well, that the model does not possess the flexibility to match any pattern of results, and that a number of competing task switching models fail to account for key observations that the PEP model produces naturally. Given the parsimony and unique explanatory power of the episodic account presented here, our results suggest that feature-integration biases have a far greater power in explaining task-switching performance than previously assumed.

New insights into the neural basis of cognitive control: An event-related fMRI study of task selection processes

To investigate cognitive control, researchers have repeatedly employed task switching paradigms. The comparison of switch relative to repeat trials reveals longer response times and higher error rates, a pattern that has been interpreted as switching costs. Functional magnetic resonance imaging (fMRI) studies have shown the involvement of different brain modules in switching conditions, including prefrontal and parietal regions together with other sub-cortical structures. In this study, the aim was to shed light on the brain basis of cognitive control using an approach that proved useful in previous studies investigating language control in bilinguals. We examined adult participants in one simple color naming context and two task selection mixed contexts. In the first mixed selection context, participants named the color or the shape of the stimulus based on a cue word. In the second, they named the color or the size of the stimulus. It was assumed that the comparison of brain responses to the same color naming in mixed selection contexts vs. in non-selection context will reveal the of engagement of cognitive control/task selection processes. Whole brain analysis of color naming in the different contexts showed a significant main effect of context. The comparison of brain responses in several frontal, parietal and sub-cortical regions, of which some are supposedly involved in cognitive control, demonstrated an increased activation during color naming in mixed relative the simple non-mixed context. The different cognitive control modules described in this study fit with recent bilingual language control and domain general cognitive models.

Modality compatibility biases voluntary choice of response modality in task switching

The term modality compatibility refers to the similarity between stimulus modality and the modality of response-related sensory consequences (e.g., vocal responses produce auditory effects). The previous results showed smaller task-switching costs when participants switched between modality compatible tasks (auditory-vocal and visual-manual) compared to switching between modality incompatible tasks (auditory-manual and visual-vocal). In the present study using a voluntary task-switching paradigm (VTS), participants chose the response modality (vocal or manual) to indicate the location of either a visual or an auditory stimulus. We examined whether free task choices were biased by modality compatibility, so that modality compatible tasks are preferred in VTS. The choice probability analysis indicated that participants tended to choose the response modality that is compatible to the stimulus modality. However, participants did not show a preference to repeat a stimulus-response (S-R) modality mapping, but to switch between modality compatibility (i.e., from S-R modality compatible mapping to S-R modality incompatible mapping and vice versa). More interestingly, even though participants freely chose the response modality, modality compatibility still influenced task-switching costs, showing larger costs with modality incompatible mappings. The finding that modality compatibility influenced choice behaviour suggests components of both top-down control and bottom-up effects of selecting a response modality for different stimulus modalities.

Selective impairment of attentional set shifting in adults with ADHD

Background

Task switch protocols are frequently used in the assessment of cognitive control, both in clinical and non-clinical populations. These protocols frequently confound task switch and attentional set shift. The current study investigated the ability of adult ADHD patients to shift attentional set in the context of switching tasks.

Method

We tested 38 adults with ADHD and 39 control adults with an extensive diagnostic battery and a task switch protocol without proactive interference. The experiment combined orthogonally task-switch vs. repetition, and attentional set shift vs. no shift. Each experimental stimulus had global and local features (Hierarchical/“Navon” stimuli), associated with corresponding attentional sets.

Results

ADHD patients were slower than controls in task switch trials with a simultaneous shift of attention between global/local attentional sets. This also correlated significantly with diagnostic scales for ADHD symptoms. The patients had more variable reaction times, but when the attentional set was kept constant neither were they significantly slower nor showed higher task switch costs.

Conclusion

ADHD is associated with a deficit in flexible deployment of attention to varying sources of stimulus information.

Stimulus- and response-based interference contributes to the costs of switching between cognitive tasks

Little is known about how stimulus- and response-based interference might interact to contribute to the costs of switching between cognitive tasks. We analyzed switch costs in a novel cued task-switching/card-matching paradigm in a large study (N = 95). We reasoned that interference from previously active task sets may be contingent upon the retrieval of these task sets via stimulus processing, or alternatively, via response processing. We examined the efficacy of these two factors through eligibility manipulations. That is, stimulus/response features that were capable of retrieving task sets from the previous trial remained eligible (or not) on the current trial. We report three main findings: first, no switch costs were found when neither stimulus features, nor response features, were adequate for the retrieval of the previously executed task sets. Second, we found substantial switch costs when, on switch trials, stimulus features kept the previously executed task eligible, and we found roughly equivalent switch costs when the previously executed response remained eligible. Third, evidence for stimulus-induced switch costs was exclusively observed when previously executed responses remained ineligible. These data indicate that stimulus-based interference, and of importance, response-based interference, contribute comparably to switch costs. Possible interpretations of non-additive switch costs are discussed.

On the role of the prefrontal cortex in fatigue effects on cognitive flexibility - a system neurophysiological approach

Demanding tasks like cognitive flexibility show time-related deterioration of performance (i.e. fatigability effects). Fatigability has been associated with structural and functional properties of the prefrontal cortex. However, the electrophysiological underpinnings of these processes are not well understood. We examined n = 34 healthy participants with a task switching paradigm in which switches were either signaled by cues or needed to be maintained by working memory processes. We analyzed event-related potentials (ERPs) and performed residue iteration decomposition (RIDE) to account for effects of fatigue on intra-individual variability of neurophysiological data. This was combined with source localization methods. We show that task switching is affected by time on task (TOT) effects mostly when working memory processes are needed. On a neurophysiological level, this effect could not be observed in standard ERPs, but only after accounting for intra-individual variability using RIDE. The RIDE data suggests that during task switching, fatigability specifically affects response recoding processes that are associated with functions of the middle frontal gyrus (MFG; BA10). The results underline propositions of the ‘opportunity cost model’, which states that fatigability effects of executive functions depend on the degree to which tasks engage similar prefrontal regions - in this case working memory and task switching mechanisms.

The interplay of crossmodal attentional preparation and modality compatibility in cued task switching

Two experiments examined the influence of preparation on modality compatibility effects in task switching. The term modality compatibility refers to the similarity between the stimulus modality and the modality of response-related sensory consequences. Previous research showed evidence for modality compatibility benefits in task switching when participants switched either between two modality compatible tasks (auditory-vocal and visual-manual) or between two modality incompatible tasks (auditory-manual and visual-vocal). In this study, we investigated the influence of active preparation on modality compatibility effects in task switching. To this end, in Experiment 1, we introduced unimodal modality cues, whereas in Experiment 2, bimodal abstract cues were used. In both experiments, the cue-stimulus interval (CSI) was manipulated while holding the response-stimulus interval (RSI) constant. In both experiments, we found not only decreased switch costs with long CSI but also the elimination of the residual switch costs. More importantly, this preparation effect did not modulate the modality compatibility effect in task switching. To account for this data pattern, we assume that cue-based preparation of switches by modality mappings was highly effective and produced no residual reaction time (RT) costs with long CSI.

Shifting the set of stimulus selection when switching between tasks

Switching between tasks associated with different requirements of stimulus selection may suffer interference from persisting attentional settings or processes of reconfiguration, possibly constituting a source of task switch costs (i.e., impaired performance in task switch trials compared to task repetition trials). To explore the processes involved in task switching with and without a switch in stimulus selection requirements, we administered a task-switching paradigm that involved task-unique sets of hierarchical (Navon) stimuli, preventing stimulus-related proactive interference (i.e., impaired responding to a stimulus that was previously processed in the context of a different task), and varied, between groups of participants, whether the target stimulus level (i.e., global vs. local) was held constant or varied between the tasks. Mixing target levels impaired performance overall and increased the task switch costs. Moreover, (within-task) global-local congruency effects were larger when target levels were mixed, particularly in task switch trials, suggesting relatively stronger stimulus processing according to the attentional set of the other task. In a second phase of the experimental session, the target level was changed persistently for either one or for both tasks, presumably evoking stimulus-related proactive interference. This change yielded large task switch costs and global-local congruency effects when it resulted in mixed target levels, but not when it resulted in a constant target level. These results are consistent with the notion that stimulus-related proactive interference is reduced by constant withdrawal of attention from the perceptual dimension of the interference-eliciting stimuli.

Distinct brain responses to different inhibitions: Evidence from a modified Flanker Task

Whether inhibition is a unitary or multifaceted construct is still an open question. To clarify the electrophysiological distinction among the different types of inhibition, we used a modified flanker paradigm, in which interference inhibition, rule inhibition, and response inhibition were compared to non-inhibition condition. The results indicated that, compared to the non-inhibition condition (1) the interference inhibition condition induced larger negativities during N2 epoch at the frontal region, (2) the rule inhibition condition elicited a larger N1 at the posterior region, followed by a larger P3a at the frontal region, reflecting the function of proactive cognitive control in the new stimulus-reaction (S-R) association, and (3) the response inhibition condition evoked a larger P3b at the posterior region, reflecting the process of suppressing the old response and reprogramming the new action. These findings provide new evidence that distinct neural mechanisms underlie different types of inhibition.

Emerging features of modality mappings in task switching: modality compatibility requires variability at the level of both stimulus and response modality

The term modality compatibility refers to the similarity between the stimulus modality and the modality of response-related sensory consequences. Previous research showed evidence for modality compatibility benefits in task switching, when participants switch either between two modality compatible tasks (auditory-vocal and visual-manual) or between two modality incompatible tasks (auditory-manual and visual-vocal). However, it remained unclear whether there is also a modality compatibility benefit when participants switch between a modality compatible and an incompatible task. To this end, in Experiment 1, we kept the same design as in earlier studies, so participants had to switch either between modality compatible or modality incompatible spatial discrimination tasks, but in Experiment 2A, participants switched at the response level (manual/vocal) while we kept the stimulus modality constant across tasks, and in Experiment 2B, they switched at the stimulus level (visual/auditory) while we kept the response modality constant across tasks. We found increased switch costs in modality incompatible tasks in Experiment 1, but no such a difference between modality compatible and incompatible tasks in Experiment 2A and 2B, supporting the idea that modality incompatible tasks increase crosstalk, due to the response-based priming of the competing task, but this crosstalk is reduced if the competing task involves either the same stimulus modality or the same response modality. We conclude that a significant impact of modality compatibility in task switching requires variability at the level of both stimulus and response modality.

Adoption of Task-Specific Sets of Visual Attention

Evidence from behavioral and physiological studies suggests attentional weighting of stimulus information from different sources, according to task demands. We investigated the adoption of task-specific attentional sets by administering a flanker task, which required responding to a centrally presented letter while ignoring two adjacent letters, and a same-different judgment task, which required a homogenous/heterogeneous classification concerning the complete three-letter string. To assess the distribution of attentional weights across the letter locations we intermixed trials of a visual search task, in which a target stimulus occurred randomly in any of these locations. Search task reaction times displayed a stronger center-to periphery gradient, indicating focusing of visual attention on the central location, when the search task was intermixed into blocks of trials of the flanker task than into blocks of trials of the same-different task (Experiment 1) and when a cue indicated the likely occurrence of the flanker task as compared to the likely occurrence the same-different task (Experiment 2). These findings demonstrate flexible adoption of task-specific sets of visual attention that can be implemented during preparation. In addition, responses in the intermixed search task trials were faster and (marginally significantly) more error-prone after preparation for a (letter) task repetition than for a task switch, suggesting that response caution is reduced during preparation for a task repetition.

More than Attentional Tuning - Investigating the Mechanisms Underlying Practice Gains and Preparation in Task Switching

In task switching, participants perform trials of task repetitions (i.e., the same task is executed in consecutive trials) and task switches (i.e., different tasks are executed in consecutive trials) and the longer reaction times in switch trials in comparison to these times in repetition trials are referred to as switch costs. These costs are reduced by lengthening of an interval following a cue that indicates the upcoming task; this effect demonstrated effective task preparation. To investigate the role of task switching practice for these preparation effects and task switch costs, we applied a task switching paradigm, involving two digit classification tasks, in six successive practice sessions and varied the length of the preparation interval. To further examine practice-related processing alterations on preparation, particularly concerning the focusing of visual attention and control of response competition, we added an Eriksen flanker task in the initial and the final session. Unlike the two digit tasks, which were always validly cued, the Eriksen flanker task occurred randomly after a cue that indicated one of the other two tasks (i.e., invalid task cuing). The results showed that, in the initial session, task switch costs for the digit tasks were reduced after a long preparation interval but this reduction disappeared after practice. This finding is consistent with the assumption of practice-related enhancement of preparation efficiency concerning non-perceptual task processes. Flanker interference was larger after preparation for a task repetition than for a task switch and (regarding error rates) larger in the final than in the initial session. Possible mechanisms underlying these attentional modulations evoked by task-sequence-dependent preparation and by task switching practice are discussed.

Evidence for instructions-based updating of task-set representations: the informed fadeout effect

The cognitive system can be updated rapidly and efficiently to maximize performance in cognitive tasks. This paper used a task-switching task to explore updating at the level of the plausible task-sets held for future performance. Previous research suggested a "fadeout effect", performance improvement when moving from task-switching context to single-task context, yet this effect could reflect passive learning rather than intentional control. In a novel "informed fadeout paradigm", one of two tasks was canceled for a certain number of trials and participants were informed or uninformed regarding task cancelation. The "informed fadeout effect" indicates better performance in the informed than uninformed fadeout after one informed trial had been executed. However, the results regarding the first trial were inconclusive. Possible underlying mechanisms are discussed.

The coupling between spatial attention and other components of task-set: A task-switching investigation

Is spatial attention reconfigured independently of, or in tandem with, other task-set components when the task changes? We tracked the eyes of participants cued to perform one of three digit-classification tasks, each consistently associated with a distinct location. Previously we observed, on task switch trials, a substantial delay in orientation to the task-relevant location and tendency to fixate the location of the previously relevant task—“attentional inertia”. In the present experiments the cues specified (and instructions emphasized) the relevant location rather than the current task. In Experiment 1, with explicit spatial cues (arrows or spatial adverbs), the previously documented attentional handicaps all but disappeared, whilst the performance “switch cost” increased. Hence, attention can become decoupled from other aspects of task-set, but at a cost to the efficacy of task-set preparation. Experiment 2 used arbitrary single-letter cues with instructions and a training regime that encouraged participants to interpret the cue as indicating the relevant location rather than task. As in our previous experiments, and unlike in Experiment 1, we now observed clear switch-induced attentional delay and inertia, suggesting that the natural tendency is for spatial attention and task-set to be coupled and that only quasi-exogenous location cues decouple their reconfiguration.

Proactive inhibitory control: A general biasing account

Flexible behavior requires a control system that can inhibit actions in response to changes in the environment. Recent studies suggest that people proactively adjust response parameters in anticipation of a stop signal. In three experiments, we tested the hypothesis that proactive inhibitory control involves adjusting both attentional and response settings, and we explored the relationship with other forms of proactive and anticipatory control. Subjects responded to the color of a stimulus. On some trials, an extra signal occurred. The response to this signal depended on the task context subjects were in: in the 'ignore' context, they ignored it; in the 'stop' context, they had to withhold their response; and in the 'double-response' context, they had to execute a secondary response. An analysis of event-related brain potentials for no-signal trials in the stop context revealed that proactive inhibitory control works by biasing the settings of lower-level systems that are involved in stimulus detection, action selection, and action execution. Furthermore, subjects made similar adjustments in the double-response and stop-signal contexts, indicating an overlap between various forms of proactive action control. The results of Experiment 1 also suggest an overlap between proactive inhibitory control and preparatory control in task-switching studies: both require reconfiguration of task-set parameters to bias or alter subordinate processes. We conclude that much of the top-down control in response inhibition tasks takes place before the inhibition signal is presented.

Feature Integration and Task Switching: Diminished Switch Costs after Controlling for Stimulus, Response, and Cue Repetitions

This report presents data from two versions of the task switching procedure in which the separate influence of stimulus repetitions, response key repetitions, conceptual response repetitions, cue repetitions, task repetitions, and congruency are considered. Experiment 1 used a simple alternating runs procedure with parity judgments of digits and consonant/vowel decisions of letters as the two tasks. Results revealed sizable effects of stimulus and response repetitions, and controlling for these effects reduced the switch cost. Experiment 2 was a cued version of the task switch paradigm with parity and magnitude judgments of digits as the two tasks. Results again revealed large effects of stimulus and response repetitions, in addition to cue repetition effects. Controlling for these effects again reduced the switch cost. Congruency did not interact with our novel “unbiased” measure of switch costs. We discuss how the task switch paradigm might be thought of as a more complex version of the feature integration paradigm and propose an episodic learning account of the effect. We further consider to what extent appeals to higher-order control processes might be unnecessary and propose that controls for feature integration biases should be standard practice in task switching experiments.

Cue response dissociates inhibitory processes: task identity information is related to backward inhibition but not to competitor rule suppression

In task switching, a conflict between competing task-sets is resolved by inhibiting the interfering task-set. Recent models have proposed a framework of the task-set as composed of two hierarchical components: abstract task identity (e.g., respond to quantity) and more concrete task rules (e.g., category-response rules mapping the categories "one" and "three" to the left and right keys, respectively). The present study explored whether task-set inhibition is the outcome of a general control process or whether it reflects multiple inhibitory processes, each targeting a different component of the competing task-set. To this end, two effects of task-set inhibition were examined: backward inhibition (BI), reflecting the suppression of a just-performed task-set that is no longer relevant; and, competitor rule suppression (CRS), reflecting the suppression of an irrelevant task-set that generates a response conflict. In two task switching experiments, each involving three tasks, we asked participants to make two responses: a cue response, indicating the identity of the relevant task (e.g., "Color"), and a target response requiring the implementation of the task rule (e.g., "Red"). The results demonstrate that BI, but not CRS, appears in cue responses, and thus, suggests that BI reflects inhibition that influences representations related to abstract task identity, rather than (just) competing responses or response rules. These results support a dissociation between inhibitory processes in task switching. The current findings also provide further evidence for a multi-component conceptualization of task-set and task-set inhibition.

Cognitive caching promotes flexibility in task switching: evidence from event-related potentials

Time-consuming processes of task-set reconfiguration have been shown to contribute to the costs of switching between cognitive tasks. We describe and probe a novel mechanism serving to reduce the costs of task-set reconfiguration. We propose that when individuals are uncertain about the currently valid task, one task set is activated for execution while other task sets are maintained at a pre-active state in cognitive cache. We tested this idea by assessing an event-related potential (ERP) index of task-set reconfiguration in a three-rule task-switching paradigm involving varying degrees of task uncertainty. In high-uncertainty conditions, two viable tasks were equally likely to be correct whereas in low-uncertainty conditions, one task was more likely than the other. ERP and performance measures indicated substantial costs of task-set reconfiguration when participants were required to switch away from a task that had been likely to be correct. In contrast, task-set-reconfiguration costs were markedly reduced when the previous task set was chosen under high task uncertainty. These results suggest that cognitive caching of alternative task sets adds to human cognitive flexibility under high task uncertainty.

Distractor onset but not preparation time affects the frequency of task confusions in task switching

When participants rapidly switch between tasks that share the same stimuli and responses, task confusions (i.e., the accidental application of the wrong task) can occur. The present study investigated whether these task confusions result from failures of endogenous control (i.e., from ineffective task preparation) or from failures of exogenous control (i.e., from stimulus-induced task conflicts). The frequency of task confusions was estimated by considering the relative proportion of distractor errors, that is, errors that result when participants erroneously respond to the distractor associated with the alternative task. In Experiment 1, the efficiency of exogenous control was manipulated by varying the temporal order of target and distractor presentation. In Experiment 2, the efficiency of endogenous control was manipulated by varying the time available for preparing the task in advance. It turned out that only the efficiency of exogenous control but not the efficiency of endogenous control influenced the proportion of distractor errors. Accordingly, task confusions are more related to failures in exogenous control.

Proactive control of irrelevant task rules during cued task switching

In task-switching paradigms, participants are often slower on incongruent than congruent trials, a pattern known as the task-rule congruency effect. This effect suggests that irrelevant task rules or associated responses may be retrieved automatically in spite of task cues. The purpose of the present study was to examine whether the task-rule congruency effect may be modulated via manipulations intended to induce variation in proactive control. Manipulating the proportion of congruent to incongruent trials strongly influenced the magnitude of the task-rule congruency effect. The effect was significantly reduced in a mostly incongruent list relative to a mostly congruent list, a pattern that was observed for not only biased but also 50 % congruent items. This finding implicates a role for global attentional control processes in the task-rule congruency effect. In contrast, enhancing the preparation of relevant (cued) task rules by the provision of a monetary incentive substantially reduced mixing costs but did not affect the task-rule congruency effect. These patterns support the view that there may be multiple routes by which proactive control can influence task-switching performance; however, only select routes appear to influence the automatic retrieval of irrelevant task rules.

Longitudinal alterations to brain function, structure, and cognitive performance in healthy older adults: A fMRI-DTI study

Cross-sectional research has shown that older adults tend to have different frontal cortex activation patterns, poorer brain structure, and lower task performance than younger adults. However, relationships between longitudinal changes in brain function, brain structure, and cognitive performance in older adults are less well understood. Here we present the results of a longitudinal, combined fMRI-DTI study in cognitive normal (CN) older adults. A two time-point study was conducted in which participants completed a task switching paradigm while fMRI data was collected and underwent the identical scanning protocol an average of 3.3 years later (SD=2 months). We observed longitudinal fMRI activation increases in bilateral regions of lateral frontal cortex at time point 2. These fMRI activation increases were associated with longitudinal declines in WM microstructure in a portion of the corpus callosum connecting the increasingly recruited frontal regions. In addition, the fMRI activation increase in the left VLPFC was associated with longitudinal increases in response latencies. Taken together, our results suggest that local frontal activation increases in CN older adults may in part reflect a response to reduced inter-hemispheric signaling mechanisms.

The role of crossmodal competition and dimensional overlap in crossmodal attention switching

Crossmodal selective attention was investigated in a cued task switching paradigm using bimodal visual and auditory stimulation. A cue indicated the imperative modality. Three levels of spatial S-R associations were established following perceptual (location), structural (numerical), and conceptual (verbal) set-level compatibility. In Experiment 1, participants switched attention between the auditory and visual modality either with a spatial-location or spatial-numerical stimulus set. In the spatial-location set, participants performed a localization judgment on left vs. right presented stimuli, whereas the spatial-numerical set required a magnitude judgment about a visually or auditorily presented number word. Single-modality blocks with unimodal stimuli were included as a control condition. In Experiment 2, the spatial-numerical stimulus set was replaced by a spatial-verbal stimulus set using direction words (e.g., "left"). RT data showed modality switch costs, which were asymmetric across modalities in the spatial-numerical and spatial-verbal stimulus set (i.e., larger for auditory than for visual stimuli), and congruency effects, which were asymmetric primarily in the spatial-location stimulus set (i.e., larger for auditory than for visual stimuli). This pattern of effects suggests task-dependent visual dominance.

Anticipating action effects with different attention foci is reflected in brain activation

Anticipation is informed by experience. Having focused on action effects in the past will lead to differences when the focus is now on the effector. Boules-type throwing movements were presented as point-light displays of shoulder and arm-markers. Activation in motor-related areas measured with functional magnetic resonance imaging was compared between two tasks: Task A anticipating action effects and Task B judging the velocity of the hand marker. One group of participants performed a session of Task A followed by a session of Task B; the other group started with Task B followed by Task A. The group starting with Task A exhibited higher brain activation during Task A bilaterally in intraparietal areas and in right hemispheric frontal and premotor areas. These areas are known to be involved in effect estimation and action simulation. The second group showed higher activation during Task B in premotor cortex and human intraparietal area 3 of the right hemisphere. The results suggest that the instruction to focus on anticipating action effects facilitates the recruitment of core components of the simulation network during anticipation and when effect anticipation is not the primary intention.

Crossmodal attention switching: auditory dominance in temporal discrimination tasks

Visual stimuli are often processed more efficiently than accompanying stimuli in another modality. In line with this "visual dominance", earlier studies on attentional switching showed a clear benefit for visual stimuli in a bimodal visual-auditory modality-switch paradigm that required spatial stimulus localization in the relevant modality. The present study aimed to examine the generality of this visual dominance effect. The modality appropriateness hypothesis proposes that stimuli in different modalities are differentially effectively processed depending on the task dimension, so that processing of visual stimuli is favored in the dimension of space, whereas processing auditory stimuli is favored in the dimension of time. In the present study, we examined this proposition by using a temporal duration judgment in a bimodal visual-auditory switching paradigm. Two experiments demonstrated that crossmodal interference (i.e., temporal stimulus congruence) was larger for visual stimuli than for auditory stimuli, suggesting auditory dominance when performing temporal judgment tasks. However, attention switch costs were larger for the auditory modality than for visual modality, indicating a dissociation of the mechanisms underlying crossmodal competition in stimulus processing and modality-specific biasing of attentional set.

A neural network model of individual differences in task switching abilities

We use a biologically grounded neural network model to investigate the brain mechanisms underlying individual differences specific to the selection and instantiation of representations that exert cognitive control in task switching. Existing computational models of task switching do not focus on individual differences and so cannot explain why task switching abilities are separable from other executive function (EF) abilities (such as response inhibition). We explore hypotheses regarding neural mechanisms underlying the "Shifting-Specific" and "Common EF" components of EF proposed in the Unity/Diversity model (Miyake & Friedman, 2012) and similar components in related theoretical frameworks. We do so by adapting a well-developed neural network model of working memory (Prefrontal cortex, Basal ganglia Working Memory or PBWM; Hazy, Frank, & O'Reilly, 2007) to task switching and the Stroop task, and comparing its behavior on those tasks under a variety of individual difference manipulations. Results are consistent with the hypotheses that variation specific to task switching (i.e., Shifting-Specific) may be related to uncontrolled, automatic persistence of goal representations, whereas variation general to multiple EFs (i.e., Common EF) may be related to the strength of PFC representations and their effect on processing in the remainder of the cognitive system. Moreover, increasing signal to noise ratio in PFC, theoretically tied to levels of tonic dopamine and a genetic polymorphism in the COMT gene, reduced Stroop interference but increased switch costs. This stability-flexibility tradeoff provides an explanation for why these two EF components sometimes show opposing correlations with other variables such as attention problems and self-restraint.

Age-related increases in right frontal activation during task switching are mediated by reaction time and white matter microstructure

Age-related increases in right frontal cortex activation are a common finding in the neuroimaging literature. However, neurocognitive factors contributing to right frontal over-recruitment remain poorly understood. Here we investigated the influence of age-related reaction time (RT) slowing and white matter (WM) microstructure reductions as potential explanatory factors for age-related increases in right frontal activation during task switching. Groups of younger (N=32) and older (N=33) participants completed a task switching paradigm while functional magnetic resonance imaging (fMRI) was performed, and rested while diffusion tensor imaging (DTI) was performed. Two right frontal regions of interest (ROIs), the dorsolateral prefrontal cortex (DLPFC) and insula, were selected for further analyses from a common network of regions recruited by both age groups during task switching. Results demonstrated age-related activation increases in both ROIs. In addition, the older adult group showed longer RT and decreased fractional anisotropy in regions of the corpus callosum with direct connections to the fMRI ROIs. Subsequent mediation analyses indicated that age-related increases in right insula activation were mediated by RT slowing and age-related increases in right DLPFC activation were mediated by WM microstructure. Our results suggest that age-related RT slowing and WM microstructure declines contribute to age-related increases in right frontal activation during cognitive task performance.

Breaking a habit: a further role of the phonological loop in action control

Recent research has suggested that keeping track of a task goal in rapid task switching may depend on the phonological loop component of working memory. In this study, we investigated whether the phonological loop plays a similar role when a single switch extending over several trials is required after many trials on which one has performed a competing task. Participants were shown pairs of digits varying in numerical and physical size, and they were required to decide which digit was numerically or physically larger. An experimental cycle consisted of four blocks of 24 trials. In Experiment 1, participants in the task change groups performed the numerical-size judgment task during the first three blocks, and then changed to the physical-size judgment task in the fourth. Participants in the continuation groups performed only the physical-size judgment task throughout all four blocks. We found negative effects of articulatory suppression on the fourth block, but only in the task change groups. Experiment 2 was a replication, with the modification that both groups received identical instructions and practice. Experiment 3 was a further replication using numerical-size judgment as the target task. The results showed a pattern similar to that from Experiment 1, with negative effects of articulatory suppression found only in the task change group. The congruity of numerical and physical size had a reliable effect on performance in all three experiments, but unlike the task change, it did not reliably interact with articulatory suppression. The results suggest that in addition to its well-established role in rapid task switching, the phonological loop also contributes to active goal maintenance in longer-term action control.

Cue type affects preparatory influences on task inhibition

The present study investigates the influence of preparation on inhibitory effects in cued task switching. In three experiments, we assessed n - 2 repetition costs as marker of inhibition of the just executed and now irrelevant task by comparing performance in task sequences such as ABA (i.e., n - 2 repetitions, with A, B and C standing for different tasks) to task sequences such as CBA (i.e., n - 2 switches). Specifically, we varied the cue-target interval (CTI) to examine cue-based preparation effects. In addition, we manipulated cue type (i.e., abstract, verbal, and direct cues) across the three experiments. We obtained significant reductions of n - 2 repetition costs with prolonged CTI when using abstract cues (i.e., coloured frames) and task names (i.e., digit), but not when using the task-specific stimulus-response mapping as cue for the upcoming task. These data suggest that cue-based preparation is not a uniform process but depends on the information provided by the cue.

Differential contribution of task conflicts to task switch cost and task mixing cost in alternating runs and cued task-switching: evidence from ex-Gaussian modeling of reaction time distributions

Task switching involves switch cost (poorer performance switch trials than in task-repetition trials) and mixing cost (poorer performance in task-repetition trials than in trials from blocks without task switching). These are mainly studied with the alternating runs task-switching (ARTS) paradigm (in which the task changes every constant number of trials) or the cued task-switching (CTS) paradigm, in which the tasks change randomly. The authors tested the hypothesis that dealing with actual or potential conflicts regarding which task is currently required contribute to mixing cost in CTS more than in ARTS and contribute to switch costs more in ARTS than in CTS. This hypothesis was tested using ex-Gaussian modeling of reaction time (RT) distributions, in which the heaviness of the right tail marks task conflicts (Steinhauser and Hübner in J Exp Psychol Human Percept Perform 35:1398-1412 2009). As predicted, a heavier RT-distribution tail marked switch cost more strongly in ARTS than in CTS and marked mixing costs more strongly in CTS than in ARTS. These results indicate that switch cost and mixing cost reflect different processes in different task-switching paradigms.

Support for a history-dependent predictive model of dACC activity in producing the bivalency effect: an event-related potential study

In the present study, we examine electrophysiological correlates of factors influencing an adjustment in cognitive control known as the bivalency effect. During task-switching, the occasional presence of bivalent stimuli in a block of univalent trials is enough to elicit a response slowing on all subsequent univalent trials. Bivalent stimuli can be congruent or incongruent with respect to the response afforded by the irrelevant stimulus feature. Here we show that the incongruent bivalency effect, the congruent bivalency effect, and an effect of a simple violation of expectancy are captured at a frontal ERP component (between 300 and 550ms) associated with ACC activity, and that the unexpectedness effect is distinguished from both congruent and incongruent bivalency effects at an earlier component (100-120ms) associated with the temporal parietal junction. We suggest that the frontal component reflects the dACC's role in predicting future cognitive load based on recent history. In contrast, the posterior component may index early visual feature extraction in response to bivalent stimuli that cue currently ongoing tasks; dACC activity may trigger the temporal parietal activity only when specific task cueing is involved and not for simple violations of expectancy.

Task switching among two or four tasks: effects of a short-term variation of the number of candidate tasks

In two experiments, using a modified task-cueing paradigm, participants switched among a set of four tasks that was on some trials reduced to two by a pre-cue preceding the task cue. A pre-cue temporarily restricting the options to two candidate tasks facilitated performance on switch trials to a much larger extent than on repeat trials. This observation is interpreted as an indication of a short-term restructuring of a global task representation by implementing antagonistic constraints among the representations of the two remaining candidate tasks.

An orienting response is not enough: Bivalency not infrequency causes the bivalency effect

When switching tasks, occasionally responding to bivalent stimuli (i.e., stimuli with relevant features for two different tasks) slows performance on subsequent univalent stimuli, even when they do not share relevant features with bivalent stimuli. This performance slowing is labelled the bivalency effect. Here, we investigated whether the bivalency effect results from an orienting response to the infrequent stimuli (i.e., the bivalent stimuli). To this end, we compared the impact of responding to infrequent univalent stimuli to the impact of responding to infrequent bivalent stimuli. For the latter, the results showed a performance slowing for all trials following bivalent stimuli. This indicates a long-lasting bivalency effect, replicating previous findings. For infrequent univalent stimuli, however, the results showed a smaller and shorter-lived performance slowing. These results demonstrate that the bivalency effect does not simply reflect an orienting response to infrequent stimuli. Rather it results from the conflict induced by bivalent stimuli, probably by episodic binding with the more demanding context created by them.

A role for recency of response conflict in producing the bivalency effect

The bivalency effect is a block-wise response slowing that is observed during task-switching when rare stimuli that cue two tasks (bivalent stimuli) are encountered. This adjustment in response style affects all trials that follow bivalent stimuli, including those trials that do not share any features with bivalent stimuli. However, the specific stimulus and response properties that trigger the bivalency effect are not well understood. In typical bivalency effect experiments, bivalent stimuli can be congruent or incongruent with respect to the response afforded by the irrelevant stimulus feature, and this distinction has never been examined. In the present study, we show that cognitive load defined by the response incongruence on bivalent trials plays a critical role in producing the subsequent response slowing observed in the bivalency effect, as well as maintaining the magnitude of the bivalency effect across practice. We propose that the bivalency effect reflects a process involved in predicting future cognitive load based on recent cognitive load experience. This is in line with a recent proposal for a role of the ACC in monitoring ongoing changes in the environment to optimize future performance (Sheth et al., in Nature 488:218-221, 2012).

What are task-sets: a single, integrated representation or a collection of multiple control representations?

Performing two randomly alternating tasks typically results in higher reaction times (RTs) following a task switch, relative to a task repetition. These task switch costs (TSC) reflect processes of switching between control settings for different tasks. The present study investigated whether task sets operate as a single, integrated representation or as an agglomeration of relatively independent components. In a cued task switch paradigm, target detection (present/absent) and discrimination (blue/green/right-/left-tilted) tasks alternated randomly across trials. The target was either a color or an orientation singleton among homogeneous distractors. Across two trials, the task and target-defining dimension repeated or changed randomly. For task switch trials, agglomerated task sets predict a difference between dimension changes and repetitions: joint task and dimension switches require full task set reconfiguration, while dimension repetitions permit re-using some control settings from the previous trial. By contrast, integrated task sets always require full switches, predicting dimension repetition effects (DREs) to be absent across task switches. RT analyses showed significant DREs across task switches as well as repetitions supporting the notion of agglomerated task sets. Additionally, two event-related potentials (ERP) were analyzed: the Posterior-Contralateral-Negativity (PCN) indexing spatial selection dynamics, and the Sustained-Posterior-Contralateral-Negativity (SPCN) indexing post-selective perceptual/semantic analysis. Significant DREs across task switches were observed for both the PCN and SPCN components. Together, DREs across task switches for RTs and two functionally distinct ERP components suggest that re-using control settings across different tasks is possible. The results thus support the “agglomerated-task-set” hypothesis, and are inconsistent with “integrated task sets.”