Parsing a cognitive task: a characterization of the mind's bottleneck

C-SMB 2.0: Integrating over 25 years of motor sequencing research with the Discrete Sequence Production task

An exhaustive review is reported of over 25 years of research with the Discrete Sequence Production (DSP) task as reported in well over 100 articles. In line with the increasing call for theory development, this culminates into proposing the second version of the Cognitive framework of Sequential Motor Behavior (C-SMB 2.0), which brings together known models from cognitive psychology, cognitive neuroscience, and motor learning. This processing framework accounts for the many different behavioral results obtained with the DSP task and unveils important properties of the cognitive system. C-SMB 2.0 assumes that a versatile central processor (CP) develops multimodal, central-symbolic representations of short motor segments by repeatedly storing the elements of these segments in short-term memory (STM). Independently, the repeated processing by modality-specific perceptual and motor processors (PPs and MPs) and by the CP when executing sequences gradually associates successively used representations at each processing level. The high dependency of these representations on active context information allows for the rapid serial activation of the sequence elements as well as for the executive control of tasks as a whole. Speculations are eventually offered as to how the various cognitive processes could plausibly find their neural underpinnings within the intricate networks of the brain.

A global neuronal workspace model of functional neurological disorders

We introduce here a general model of Functional Neurological Disorders based on the following hypothesis: a Functional Neurological Disorder could correspond to a consciously initiated voluntary top-down process causing involuntary lasting consequences that are consciously experienced and subjectively interpreted by the patient as involuntary. We develop this central hypothesis according to Global Neuronal Workspace theory of consciousness, that is particularly suited to describe interactions between conscious and non-conscious cognitive processes. We then present a list of predictions defining a research program aimed at empirically testing their validity. Finally, this general model leads us to reinterpret the long-debated links between hypnotic suggestion and functional neurological disorders. Driven by both scientific and therapeutic goals, this theoretical paper aims at bringing closer the psychiatric and neurological worlds of functional neurological disorders with the latest developments of cognitive neuroscience of consciousness.

Serial attention to serial memory: The psychological refractory period in forward and backward cued recall

Guided by the conjecture that memory retrieval is attention turned inward, we examined serial attention in serial memory, combining the psychological refractory period (PRP) procedure from attention research with cued recall of two items from brief six-item lists. We report six experiments showing robust PRP effects in cued recall from memory (1-4) and cued report from perceptual displays (5-6), which suggest that memory retrieval requires the same attentional bottleneck as "retrieval" from perception. There were strong direction effects in each memory experiment. Response time (RT) was shorter and accuracy was higher when the cues occurred in the forward direction (left-to-right, top-to-bottom, first-to-last), replicating differences between forward and backward serial recall. Cue positions had strong effects on RT and accuracy in the memory experiments (1-4). The pattern suggested that subjects find cued items in memory by stepping through the list from the beginning or the end, with a preference for starting at the beginning. The perceptual experiments (5-6) showed weak effects of position that were more consistent with direct access. In all experiments, the distance between the cues in the list (lag) had weak effects, suggesting that subjects searched for each cue from the beginning or end of the list more often than they moved through the list from the first cue to the second. Direction, distance, and lag effects on RT and inter-response interval changed with SOA in a manner that suggested they affect bottleneck or pre-bottleneck processes that create and execute a plan for successive retrievals. We conclude that sequential retrieval from memory and sequential attention to perception engage the same computations and we show how computational models of memory can be interpreted as models of attention focused on memory.

Fate of the second task in dual-task interference is associated with sensory system interactions with default-mode network

Psychological refractory period (PRP) effect refers to the delay in responding to the second of two tasks occurring in rapid succession. While all the major models of PRP highlight the importance of the frontoparietal control network (FPCN) in prioritizing the neural processing of the first task, the fate of the second task remains poorly understood. Here, we provide novel neural evidence on how the functional connectivity between sensory systems and the default-mode network (DMN) suspends the neural processing of the second task to ensure the efficient completion of the first task in dual-task situation. In a cross-modal PRP paradigm, a visual task could either precede or follow an auditory task. The DMN was generally deactivated during task performance and selectively coupled with the sensory system underlying the second task subjected to the PRP effect. Specifically, the DMN showed neural coupling with the auditory system when the auditory task came after the visual task, and with the visual system vice versa. More critically, the strength of the DMN-Sensory coupling correlated negatively with the size of the PRP effect: the stronger the coupling, the shorter the PRP. Therefore, rather than being detrimental to the dual-task performance, temporary suspension of the second task, via the DMN-Sensory coupling, surprisingly guaranteed the efficient completion of the first task by reducing the interference from the second task. Accordingly, the entry and processing of the second stimuli in the central executive system were speeded up as well.

Stop-signal delay reflects response selection duration in stop-signal task

The stop-signal task (SST) is widely used for studying the speed of the latent process of response inhibition. The SST patterns are typically explained by a horse-race model (HRM) with supposed Go and Stop processes. However, HRM does not agree with the sequential-stage model of response control. As a result, the exact relationship between the response selection, the response execution stages, and the Stop process remains unclear. We propose that response selection occurs within the stop-signal delay (SSD) period, and that the competition between the Go and Stop processes occurs within the response execution period. To confirm this, we conducted two experiments. In Experiment 1, participants carried out a modified SST task with an additional stimulus category - Cued-Go. In the Cued-Go trials, cues were followed by imperative Go signals. The Cue-Go period duration was dynamically adjusted by an adaptive algorithm based on the response times reflecting the individual response selection duration. In Experiment 2, Cued-Go stimuli were followed by Stop Signals in half of the trials and response inhibition efficiency was calculated. The results of Experiment 1 indicate that SSD reflects the duration of the response selection process. The results of Experiment 2 show that this process has an independent and small effect on the effectiveness of controlled inhibition of the target response. Based on our findings, we propose a two-stage model of response inhibition in SST, with the first stage including response selection process and the second stage response inhibition following the SS presentation.

A reservoir of foraging decision variables in the mouse brain

In any given situation, the environment can be parsed in different ways to yield decision variables (DVs) defining strategies useful for different tasks. It is generally presumed that the brain only computes a single DV defining the current behavioral strategy. Here to test this assumption, we recorded neural ensembles in the frontal cortex of mice performing a foraging task admitting multiple DVs. Methods developed to uncover the currently employed DV revealed the use of multiple strategies and occasional switches in strategy within sessions. Optogenetic manipulations showed that the secondary motor cortex (M2) is needed for mice to use the different DVs in the task. Surprisingly, we found that regardless of which DV best explained the current behavior, M2 activity concurrently encoded a full basis set of computations defining a reservoir of DVs appropriate for alternative tasks. This form of neural multiplexing may confer considerable advantages for learning and adaptive behavior.

Solving the binding problem: Assemblies form when neurons enhance their firing rate-they don't need to oscillate or synchronize

When we look at an image, its features are represented in our visual system in a highly distributed manner, calling for a mechanism that binds them into coherent object representations. There have been different proposals for the neuronal mechanisms that can mediate binding. One hypothesis is that binding is achieved by oscillations that synchronize neurons representing features of the same perceptual object. This view allows separate communication channels between different brain areas. Another hypothesis is that binding of features that are represented in different brain regions occurs when the neurons in these areas that respond to the same object simultaneously enhance their firing rate, which would correspond to directing object-based attention to these features. This review summarizes evidence in favor of and against these two hypotheses, examining the neuronal correlates of binding and assessing the time course of perceptual grouping. I conclude that enhanced neuronal firing rates bind features into coherent object representations, whereas oscillations and synchrony are unrelated to binding.

Knowledge generalization and the costs of multitasking

Humans are able to rapidly perform novel tasks, but show pervasive performance costs when attempting to do two things at once. Traditionally, empirical and theoretical investigations into the sources of such multitasking interference have largely focused on multitasking in isolation to other cognitive functions, characterizing the conditions that give rise to performance decrements. Here we instead ask whether multitasking costs are linked to the system's capacity for knowledge generalization, as is required to perform novel tasks. We show how interrogation of the neurophysiological circuitry underlying these two facets of cognition yields further insights for both. Specifically, we demonstrate how a system that rapidly generalizes knowledge may induce multitasking costs owing to sharing of task contingencies between contexts in neural representations encoded in frontoparietal and striatal brain regions. We discuss neurophysiological insights suggesting that prolonged learning segregates such representations by refining the brain's model of task-relevant contingencies, thereby reducing information sharing between contexts and improving multitasking performance while reducing flexibility and generalization. These proposed neural mechanisms explain why the brain shows rapid task understanding, multitasking limitations and practice effects. In short, multitasking limits are the price we pay for behavioural flexibility.

The Construct Validity of Intellect and Openness as Distinct Aspects of Personality through Differential Associations with Reaction Time

The construct validity of group factor models of personality, which are typically derived from factor analysis of questionnaire items, relies on the ability of each factor to predict meaningful and differentiated real-world outcomes. In a sample of 481 participants, we used the Big Five Aspect Scales (BFAS) personality questionnaire, two laboratory-measured reaction time (RT) tasks, and a short-form test of cognitive ability (ICAR-16) to test the hypothesis that the Intellect and Openness aspects of Big Five Openness to Experience differentially correlate with reaction time moments. We found that higher scores on the Intellect aspect significantly correlate with faster and less variable response times, while no such association is observed for the Openness aspect. Further, we found that this advantage lies solely in the decisional, but not perceptual, stage of information processing; no other Big Five aspect showed a similar pattern of results. In sum, these findings represent the largest and most comprehensive study to date on personality factors and reaction time, and the first to demonstrate a mechanistic validation of BFAS Intellect through a differential pattern of associations with RT and Big Five personality aspects.

An adaptive paradigm for detecting the individual duration of the preparatory period in the choice reaction time task

According to the sequential stage model, the selection and the execution of a motor response are two distinct independent processes. Here, we propose a new adaptive paradigm for identifying the individual duration of the response preparatory period based on the motor reaction time (RT) data. The results are compared using the paradigm with constant values of the preparatory period. Two groups of participants performed on either an easy (Group 1) or a hard (Group 2) response selection task with two types of stimuli based on the preparatory period parameters: (1) stimuli with a constant preparatory period duration of 0 or 1200 ms and (2) stimuli with adaptive preparatory period durations. Our analysis showed an increase in the duration of the response selection process as a function of increasing task complexity when using both paradigms with constant and adaptive values of the preparatory period duration. We conclude that the adaptive paradigm proposed in the current paper has several important advantages over the constant paradigm in terms of measuring the response accuracy while being equally efficiently in capturing other critical response parameters.

Inter-Individual Differences in Executive Functions Predict Multitasking Performance - Implications for the Central Attentional Bottleneck

Human multitasking suffers from a central attentional bottleneck preventing parallel performance of central mental operations, leading to profound deferments in task performance. While previous research assumed that the deferment is caused by a mere waiting time (refractory period), we show that the bottleneck requires executive functions (EF; active scheduling account) accounting for a profound part of the deferment. Three participant groups with EF impairments (dyslexics, highly neurotics, deprived smokers) showed worse multitasking performance than respective control groups. Three further groups with EF improvements (video-gamers, bilinguals, coffee consumers) showed improved multitasking. Finally, three groups performed a dual-task and different measures of EF (reading span, rotation span, symmetry span) and showed significant correlations between multitasking performance and working memory capacity. Demands on EF during multitasking may cause more errors, mental fatigue and stress, with parts of the population being considerably more prone to this.

A Process-Oriented View of Procedural Memory Can Help Better Understand Tourette's Syndrome

Tourette's syndrome (TS) is a neurodevelopmental disorder characterized by repetitive movements and vocalizations, also known as tics. The phenomenology of tics and the underlying neurobiology of the disorder have suggested that the altered functioning of the procedural memory system might contribute to its etiology. However, contrary to the robust findings of impaired procedural memory in neurodevelopmental disorders of language, results from TS have been somewhat mixed. We review the previous studies in the field and note that they have reported normal, impaired, and even enhanced procedural performance. These mixed findings may be at least partially be explained by the diversity of the samples in both age and tic severity, the vast array of tasks used, the low sample sizes, and the possible confounding effects of other cognitive functions, such as executive functions, working memory or attention. However, we propose that another often overlooked factor could also contribute to the mixed findings, namely the multiprocess nature of the procedural system itself. We propose that a process-oriented view of procedural memory functions could serve as a theoretical framework to help integrate these varied findings. We discuss evidence suggesting heterogeneity in the neural regions and their functional contributions to procedural memory. Our process-oriented framework can help to deepen our understanding of the complex profile of procedural functioning in TS and atypical development in general.

The working memory costs of a central attentional bottleneck in multitasking

When two (or more) tasks, each requiring a rapid response, are performed at the same time then serial processing may occur at certain processing stages, such as the response selection. There is accumulating evidence that such serial processing involves additional control processes, such as inhibition, switching, and scheduling (termed the active scheduling account). The present study tested whether the existence of serial processing in multitasking leads to a requirement for processes that coordinate processing in this way (active scheduling account) and, furthermore, whether such control processes are linked to the executive functions (EF) of working memory (WM). To test this question, we merged the psychological refractory period (PRP) paradigm with a WM task, creating a complex WM span task. Participants were presented with a sequence of letters to remember, followed by a processing block in which they had to perform either a single task or a dual task, and finally were asked to recall the letters. Results showed that WM performance, i.e. the amount of letters recalled in the correct order, decreased when performing a dual task as compared to performing a single task during the retention interval. Two further experiments supported this finding using manipulations of the dual task difficulty. We conclude that the existence of serial processing in multitasking demands additional control processes (active scheduling) and that these processes are strongly linked to the executive functions of working memory.

Reaction Time Decomposition as a Tool to Study Subcortical Ischemic Vascular Cognitive Impairment

Background:

The study of reaction time (RT) and its intraindividual variability (IIV) in aging, cognitive impairment, and dementia typically fails to investigate the processing stages that contribute to an overall response. Applying “mental chronometry” techniques makes it possible to separately assess the role of processing components during environmental interaction.

Objective:

To determine whether RT and IIV-decomposition techniques can shed light on the nature of underlying deficits in subcortical ischemic vascular cognitive impairment (VCI). Using a novel iPad task, we examined whether VCI deficits occur during both initiation and movement phases of a response, and whether they are equally reflected in both RT and IIV.

Methods:

Touch cancellation RT and its IIV were measured in a group of younger adults (n = 22), cognitively healthy older adults (n = 21), and patients with VCI (n = 21) using an iPad task.

Results:

Whereas cognitively healthy aging affected the speed (RT) of response initiation and movement but not its variability (IIV), VCI resulted in both slowed RT and increased IIV for both response phases. Furthermore, there were group differences with respect to response phase.

Conclusion:

These results indicate that IIV can be more sensitive than absolute RT in separating VCI from normal aging. Furthermore, compared to cognitively healthy aging, VCI was characterized by significant deficits in planning/initiating action as well as performing movements. Such deficits have important implications for real life actions such as driving safety, employment, and falls risk.

Neural mechanisms underlying the temporal control of sequential saccade planning in the frontal eye field

Sequences of saccadic eye movements are instrumental in navigating our visual environment. While neural activity has been shown to ramp up to a threshold before single saccades, the neural underpinnings of multiple saccades is unknown. To understand the neural control of saccade sequences, we recorded from the frontal eye field (FEF) of macaque monkeys while they performed a sequential saccade task. We show that the concurrent planning of two saccade plans brings forth processing bottlenecks, specifically by decreasing the growth rate and increasing the threshold of saccade-related ramping activity. The rate disruption affected both saccade plans, and a computational model, wherein activity related to the two saccade plans mutually and asymmetrically inhibited each other, predicted the behavioral and neural results observed experimentally. Borrowing from models in psychology, our results demonstrate a capacity-sharing mechanism of processing bottlenecks, wherein multiple saccade plans in a sequence compete for the processing capacity by the perturbation of the saccade-related ramping activity. Finally, we show that, in contrast to movement-related neurons, visual activity in FEF neurons is not affected by the presence of multiple saccade targets, indicating that, for perceptually simple tasks, inhibition within movement-related neurons mainly instantiates capacity sharing. Taken together, we show how psychology-inspired models of capacity sharing can be mapped onto neural responses to understand the control of rapid saccade sequences.

Deployment dynamics of hypnotic anger modulation

To understand the role that attention plays in the deployment timeline of hypnotic anger modulation, we composed an Attentional Blink paradigm where the first and second targets were faces, expressing neutral or angry emotions. We then suppressed the salience of angry faces through a "hypnotic numbing" suggestion. We found that hypnotic suggestion only attenuated the emotional salience of the second target (T2). By implementing drift-diffusion decision modelling, we also found that hypnotic suggestion mainly affected decision thresholds. These findings suggest that hypnotic numbing resulted from belated changes in response strategy. Interestingly, a contrast against non-hypnotized participants revealed that the numbing suggestion had the instruction-like feature of incorporating emotional valence into the attentional task-set. Together, our results portray hypnotic anger modulation as a two-tiered process: first, hypnotic suggestion alters the attentional task-set; second, provided processing and response preparation are not interrupted, a hypnotizability-dependent response based on said altered task-set is produced through late cognitive control strategies.

The distance effect on discrimination ability and response bias during magnitude comparison in a go/no-go task

The distance effect is the change in the performance during numerical magnitude comparison, depending on the numerical distance between the compared numbers (Moyer & Landauer, Nature, 215[5109], 1519-1520, 1967). This effect is generally accepted as evidence for the mental number line (MNL) hypothesis, which proposes that the mental representation of the numbers align in an increasing linear (or monotone) order. The majority of studies investigating the distance effect are focused on the reaction time (RT) findings, which show slower responses for closer numbers. In the present study, we examined the distance effect by applying signal detection theory (SDT) to a magnitude comparison task. We aimed to reveal whether discrimination ability and the response bias measures were affected by the location of numbers on the MNL. To accomplish this, we developed a magnitude comparison task using a go/no-go procedure in which participants performed a magnitude comparison based on a reference number (i.e., 5). Results revealed a substantial distance effect in both sensitivity and response bias measures-a better discrimination performance for far numbers, and a larger response bias for close numbers. In addition, an RT distribution analysis revealed that the distance effect seems to originate mainly from slower responses. Based on the current data, we suggest that sensitivity and response bias measures could offer comprehensive information in the understanding of number-based decisions.

Multiple decisions about one object involve parallel sensory acquisition but time-multiplexed evidence incorporation

The brain is capable of processing several streams of information that bear on different aspects of the same problem. Here, we address the problem of making two decisions about one object, by studying difficult perceptual decisions about the color and motion of a dynamic random dot display. We find that the accuracy of one decision is unaffected by the difficulty of the other decision. However, the response times reveal that the two decisions do not form simultaneously. We show that both stimulus dimensions are acquired in parallel for the initial ∼0.1 s but are then incorporated serially in time-multiplexed bouts. Thus, there is a bottleneck that precludes updating more than one decision at a time, and a buffer that stores samples of evidence while access to the decision is blocked. We suggest that this bottleneck is responsible for the long timescales of many cognitive operations framed as decisions.

Dual-Task Interference in a Simulated Driving Environment: Serial or Parallel Processing?

When humans are required to perform two or more tasks concurrently, their performance declines as the tasks get closer together in time. Here, we investigated the mechanisms of this cognitive performance decline using a dual-task paradigm in a simulated driving environment, and using drift-diffusion modeling, examined if the two tasks are processed in a serial or a parallel manner. Participants performed a lane change task, along with an image discrimination task. We systematically varied the time difference between the onset of the two tasks (Stimulus Onset Asynchrony, SOA) and measured its effect on the amount of dual-task interference. Results showed that the reaction times (RTs) of the two tasks in the dual-task condition were higher than those in the single-task condition. SOA influenced the RTs of both tasks when they were presented second and the RTs of the image discrimination task when it was presented first. Results of drift-diffusion modeling indicated that dual-task performance affects both the rate of evidence accumulation and the delays outside the evidence accumulation period. These results suggest that a hybrid model containing features of both parallel and serial processing best accounts for the results. Next, manipulating the predictability of the order of the two tasks, we showed that in unpredictable conditions, the order of the response to the two tasks changes, causing attenuation in the effect of SOA. Together, our findings suggest higher-level executive functions are involved in managing the resources and controlling the processing of the tasks during dual-task performance in naturalistic settings.

Effects of task probability on prioritized processing: Modulating the efficiency of parallel response selection

Four experiments investigated the extent to which a limited pool of resources can be shared between different tasks performed simultaneously when it is efficient to do so. The experiments used a prioritized processing paradigm, in which stimuli for both a primary task and a background task were presented in each trial. If the primary-task stimulus required a response in a trial, participants made only that response. If the primary-task stimulus did not require a response, participants responded to the background task. The main manipulation was the relative probability that a response would be required to the primary versus background task. In some blocks, the majority of trials required responses to the primary task (Experiments 1 and 2: 80%; Experiments 3 and 4: 60%), whereas in other blocks the majority required responses to the background task. Background-task responses were substantially faster in blocks where they were more likely to be required, consistent with the idea that more capacity was allocated to them in these blocks. Backward compatibility effects on primary-task responses and stimulus-onset asynchrony effects on background-task responses provided further evidence of greater capacity allocation to the background task when there was a higher probability of responding to it. The results support the view that two tasks can be processed in parallel, with resources divided between them, when it is efficient to do so.

Identifying Feigned Cognitive Impairment: Investigating the Utility of Diffusion Model Analyses

Forced-choice performance validity tests are routinely used for the detection of feigned cognitive impairment. The drift diffusion model deconstructs performance into distinct cognitive processes using accuracy and response time measures. It thereby offers a unique approach for gaining insight into examinees' speed-accuracy trade-offs and the cognitive processes that underlie their performance. The current study is the first to perform such analyses using a well-established forced-choice performance validity test. To achieve this aim, archival data of healthy participants, either simulating cognitive impairment in the Word Memory Test or performing it to the best of their ability, were analyzed using the EZ-diffusion model (N = 198). The groups differed in the three model parameters, with drift rate emerging as the best predictor of group membership. These findings provide initial evidence for the usefulness of the drift diffusion model in clarifying the cognitive processes underlying feigned cognitive impairment and encourage further research.

The Transition from Evaluation to Selection Involves Neural Subspace Reorganization in Core Reward Regions

Economic choice proceeds from evaluation, in which we contemplate options, to selection, in which we weigh options and choose one. These stages must be differentiated so that decision makers do not proceed to selection before evaluation is complete. We examined responses of neurons in two core reward regions, orbitofrontal (OFC) and ventromedial prefrontal cortex (vmPFC), during two-option choice with asynchronous offer presentation. Our data suggest that neurons selective during the first (presumed evaluation) and second (presumed comparison and selection) offer epochs come from a single pool. Stage transition is accompanied by a shift toward orthogonality in the low-dimensional population response manifold. Nonetheless, the relative position of each option in driving responses in the population subspace is preserved. The orthogonalization we observe supports the hypothesis that the transition from evaluation to selection leads to reorganization of response subspace and suggests a mechanism by which value-related signals are prevented from prematurely driving choice.

Fictional narrative as a variational Bayesian method for estimating social dispositions in large groups

Modelling intentions in large groups is cognitively costly. Not alone must first order beliefs be tracked ('what does A think about X?'), but also beliefs about beliefs ('what does A think about B's belief concerning X?'). Thus linear increases in group size impose non-linear increases in cognitive processing resources. At the same time, however, large groups offer coordination advantages relative to smaller groups due to specialisation and increased productive capacity. How might these competing demands be reconciled? We propose that fictional narrative can be understood as a cultural tool for dealing with large groups. Specifically, we argue that prototypical action roles that are removed from real-world interactions function as interpretive priors in a form of variational Bayesian inference, such that they allow estimations can be made of unknown social motives. We offer support for this claim in two ways. Firstly, by evaluating the existing literature on narrative cognition and showing where it anticipates a variational model; and secondly, by simulation, where we show that an agent-based model naturally converges on a set of social categories that resemble narrative across a wide range of starting points.

Parallel programming of saccades in the macaque frontal eye field: are sequential motor plans coactivated?

We use sequences of saccadic eye movements to continually explore our visual environments. Previous behavioral studies have established that saccades in a sequence may be programmed in parallel by the oculomotor system. In this study, we tested the neural correlates of parallel programming of saccade sequences in the frontal eye field (FEF), using single-unit electrophysiological recordings from macaques performing a sequential saccade task. It is known that FEF visual neurons instantiate target selection whereas FEF movement neurons undertake saccade preparation, where the activity corresponding to a saccade vector gradually ramps up. The question of whether FEF movement neurons are involved in concurrent processing of saccade plans is as yet unresolved. In the present study, we show that, when a peripheral target is foveated after a sequence of two saccades, presaccadic activity of FEF movement neurons for the second saccade can be activated while the first is still underway. Moreover, the onset of movement activity varied parametrically with the behaviorally measured time available for parallel programming. Although at central fixation coactivated FEF movement activity may vectorially encode the retinotopic location of the second target with respect to the fixation point or the remapped location of the second target, with respect to the first our evidence suggests the possibility of early encoding of the remapped second saccade vector. Taken together, the results indicate that movement neurons, although located terminally in the FEF visual-motor spectrum, can accomplish concurrent processing of multiple saccade plans, leading to rapid execution of saccade sequences.NEW & NOTEWORTHY The execution of purposeful sequences underlies much of goal-directed behavior. How different brain areas accomplish sequencing is poorly understood. Using a modified double-step task to generate a rapid sequence of two saccades, we demonstrate that downstream movement neurons in the frontal eye field (FEF), a prefrontal oculomotor area, allow for coactivation of the first and second movement plans that constitute the sequence. These results provide fundamental insights into the neural control of action sequencing.

The offline stream of conscious representations

When do we become conscious of a stimulus after its presentation? We would all agree that this necessarily takes time and that it is not instantaneous. Here, I would like to propose not only that conscious access is delayed relative to the external stimulation, but also that it can flexibly desynchronize from external stimulation; it can process some information 'offline', if and when it becomes relevant. Thus, in contrast with initial sensory processing, conscious experience might not strictly follow the sequence of events in the environment. In this article, I will review gathering evidence in favour of this proposition. I will argue that it offers a coherent framework for explaining a great variety of observations in the domain of perception, sensory memory and working memory: the psychological refractory period, the attentional blink, post-dictive phenomena, iconic memory, latent working memory and the newly described retro-perception phenomenon. I will integrate this proposition to the global neuronal workspace model and consider possible underlying brain mechanisms. Finally, I will argue that this capacity to process information 'offline' might have made conscious processing evolutionarily advantageous in spite of its sluggishness and capacity limitations.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

Interference in speaking while hearing and vice versa

Even when speakers are not actively doing another task, they can be interfered in their speech planning by concurrent auditory stimuli. In this study, we used picture naming with passive hearing, or active listening, combined to high-density electroencephalographic (EEG) recordings to investigate the locus and origin of interference on speech production. Participants named pictures while ignoring (or paying attention to) auditory syllables presented at different intervals (+150 ms, +300 ms or +450 ms). Interference of passive hearing was observed at all positive stimulus onset asynchronies (SOA) including when distractors appeared 450 ms after picture onset. Analyses of ERPs and microstates revealed modulations appearing in a time-window close to verbal response onset likely relating to post-lexical planning processes. A shift of latency of the N1 auditory component for syllables displayed 450 ms after picture onset relative to hearing in isolation was also observed. Data from picture naming with active listening to auditory syllables also pointed to post-lexical interference. The present study suggests that, beyond the lexical stage, post-lexical processes can be interfered and that the reciprocal interference between utterance planning and hearing relies on attentional demand and possibly competing neural substrates.

Categorizing digits and the mental number line

Following the classical work of Moyer and Landauer (1967), experimental studies investigating the way in which humans process and compare symbolic numerical information regularly used one of two experimental designs. In selection tasks, two numbers are presented, and the task of the participant is to select (for example) the larger one. In classification tasks, a single number is presented, and the participant decides if it is smaller or larger than a predefined standard. Many findings obtained with these paradigms fit in well with the notion of a mental analog representation, or an Approximate Number System (ANS; e.g., Piazza 2010). The ANS is often conceptualized metaphorically as a mental number line, and data from both paradigms are well accounted for by diffusion models based on the stochastic accumulation of noisy partial numerical information over time. The present study investigated a categorization paradigm in which participants decided if a number presented falls into a numerically defined central category. We show that number categorization yields a highly regular, yet considerably more complex pattern of decision times and error rates as compared to the simple monotone relations obtained in traditional selection and classification tasks. We also show that (and how) standard diffusion models of number comparison can be adapted so as to account for mean and standard deviations of all RTs and for error rates in considerable quantitative detail. We conclude that just as traditional number comparison, the more complex process of categorizing numbers conforms well with basic notions of the ANS.

Visual Dominance Effect upon Passing the Central Bottleneck of Information Processing

BACKGROUND

In the classical psychological refractory period (PRP) paradigm, two stimuli are presented in brief succession, and participants are asked to make separate speeded responses to both stimuli. Due to a central cognitive bottleneck, responses to the second stimulus are delayed, especially at short stimulus-onset asynchrony (SOA) between the two stimuli. Although the mechanisms of dual-task interference in the classical PRP paradigm have been extensively investigated, specific mechanisms underlying the cross-modal PRP paradigm are not well understood. In particular, it remains unknown whether the dominance of vision over audition manifests in the cross-modal PRP tasks. The present study aimed to investigate whether the visual dominance effect manifests in the cross-modal PRP paradigm.

METHODS

We adapted the classical PRP paradigm by manipulating the order of a visual and an auditory task: the visual task could either precede the auditory task or vice versa, at either short or long SOAs. Twenty-five healthy participants took part in Experiment 1, and thirty-three new participants took part in Experiment 2. Reaction time and accuracy data were calculated and further analyzed by repeated-measures analysis of variance.

RESULTS

The results showed that visual precedence in the Visual-Auditory condition caused larger impairments to the subsequent auditory processing than vice versa in the Auditory-Visual condition: a larger delay of second response was revealed in the Visual-Auditory condition (135 ± 10 ms) than the Auditory-Visual condition (88 ± 9 ms). This effect was found only at the short SOAs under the existence of the central bottleneck, but not at the long SOAs. Moreover, this effect occurred both when the single visual and the single auditory task were of equal difficulty in Experiment 1 and when the single auditory task was more difficult than the single visual task in Experiment 2.

CONCLUSION

Results of the two experiments suggested that the visual dominance effect occurred under the central bottleneck of cognitive processing.

Neural correlates of motor-cognitive dual-tasking in young and old adults

When two tasks are performed simultaneously, performance often declines in one or both tasks. These so-called dual-task costs are more pronounced in old than in young adults. One proposed neurological mechanism of the dual-task costs is that old compared with young adults tend to execute single-tasks with higher brain activation. In the brain regions that are needed for both tasks, the reduced residual capacity may interfere with performance of the dual-task. This competition for shared brain regions has been called structural interference. The purpose of the study was to determine whether structural interference indeed plays a role in the age-related decrease in dual-task performance. Functional magnetic resonance imaging (fMRI) was used to investigate 23 young adults (20–29 years) and 32 old adults (66–89 years) performing a calculation (serial subtraction by seven) and balance-simulation (plantar flexion force control) task separately or simultaneously. Behavioral performance decreased during the dual-task compared with the single-tasks in both age groups, with greater dual-task costs in old compared with young adults. Brain activation was significantly higher in old than young adults during all conditions. Region of interest analyses were performed on brain regions that were active in both tasks. Structural interference was apparent in the right insula, as quantified by an age-related reduction in upregulation of brain activity from single- to dual-task. However, the magnitude of upregulation did not correlate with dual-task costs. Therefore, we conclude that the greater dual-task costs in old adults were probably not due to increased structural interference.

On the time-course of automatic response activation in the Simon task

The Simon effect (prolonged RT when the task-irrelevant stimulus location is incongruent with the response side) has been reported to decrease at longer RTs, which is reflected in negative-going delta functions. This finding has been attributed to gradual dissipation of the response automatically activated by the task-irrelevant location information. The Diffusion Model for Conflict Tasks (DMC, Ulrich, Schröter, Leuthold, & Birngruber, Cognitive Psychology 78:148-174, 2015) formally specifies the time-course of this automatic activation process as a pulse-like function. In contrast to alternative views, DMC is consistent with the notion that this time-course is unaffected by the presentation duration of the target stimulus. Therefore, we expected that delta functions are invariant against changes of stimulus duration. This prediction was verified in two Simon task experiments. Consistent with this general result, DMC's parameter τ which defines the time-course of the automatic response activation was estimated to not meaningfully differ between short and long durations. We argue that our results are coherent with processing architectures that assume a transient automatic process that is virtually unaffected by stimulus duration.

Exploring the origin of the number-size congruency effect: Sensitivity or response bias?

Physical size modulates the efficiency of digit comparison, depending on whether the relation of numerical magnitude and physical size is congruent or incongruent (Besner & Coltheart, Neuropsychologia, 17, 467-472, 1979), the number-size congruency effect (NSCE). In addition, Henik and Tzelgov (Memory & Cognition, 10, 389-395, 1982) first reported an NSCE for the reverse task of comparing the physical size of digits such that the numerical magnitude of digits modulated the time required to compare their physical sizes. Does the NSCE in physical comparisons simply reflect a number-mediated bias mechanism related to making decisions and selecting responses about the digit's sizes? Alternatively, or in addition, the NSCE might indicate a true increase in the ability to discriminate small and large font sizes when these sizes are congruent with the digit's symbolic numerical meaning, over and above response bias effects. We present a new research design that permits us to apply signal detection theory to a task that required observers to judge the physical size of digits. Our results clearly demonstrate that the NSCE cannot be reduced to mere response bias effects, and that genuine sensitivity gains for congruent number-size pairings contribute to the NSCE.

Multisensory Decisions: the Test of a Race Model, Its Logic, and Power

The use of separate multisensory signals is often beneficial. A prominent example is the speed-up of responses to two redundant signals relative to the components, which is known as the redundant signals effect (RSE). A convenient explanation for the effect is statistical facilitation, which is inherent in the basic architecture of race models (Raab, 1962,Trans. N. Y. Acad. Sci.24, 574–590). However, this class of models has been largely rejected in multisensory research, which we think results from an ambiguity in definitions and misinterpretations of the influential race model test (Miller, 1982,Cogn. Psychol.14, 247–279). To resolve these issues, we here discuss four main items. First, we clarify definitions and ask how successful models of perceptual decision making can be extended from uni- to multisensory decisions. Second, we review the race model test and emphasize elements leading to confusion with its interpretation. Third, we introduce a new approach to study the RSE. As a major change of direction, our working hypothesis is that the basic race model architecture is correct even if the race model test seems to suggest otherwise. Based on this approach, we argue that understanding the variability of responses is the key to understand the RSE. Finally, we highlight the critical role of model testability to advance research on multisensory decisions. Despite being largely rejected, it should be recognized that race models, as part of a broader class of parallel decision models, demonstrate, in fact, a convincing explanatory power in a range of experimental paradigms. To improve research consistency in the future, we conclude with a short checklist for RSE studies.

How numbers mean: Comparing random walk models of numerical cognition varying both encoding processes and underlying quantity representations

How do people derive meaning from numbers? Here, we instantiate the primary theories of numerical representation in computational models and compare simulated performance to human data. Specifically, we fit simulated data to the distributions for correct and incorrect responses, as well as the pattern of errors made, in a traditional "relative quantity" task. The results reveal that no current theory of numerical representation can adequately account for the data without additional assumptions. However, when we introduce repeated, error-prone sampling of the stimulus (e.g., Cohen, 2009) superior fits are achieved when the underlying representation of integers reflects linear spacing with constant variance. These results provide new insights into (i) the detailed nature of mental numerical representation, and, (ii) general perceptual processes implemented by the human visual system.

Neural underpinnings of the evidence accumulator

Gradual accumulation of evidence favoring one or another choice is considered a core component of many different types of decisions, and has been the subject of many neurophysiological studies in non-human primates. But its neural circuit mechanisms remain mysterious. Investigating it in rodents has recently become possible, facilitating perturbation experiments to delineate the relevant causal circuit, as well as the application of other tools more readily available in rodents. In addition, advances in stimulus design and analysis have aided studying the relevant neural encoding. In complement to ongoing non-human primate studies, these newly available model systems and tools place the field at an exciting time that suggests that the dynamical circuit mechanisms underlying accumulation of evidence could soon be revealed.

Do Arabic numerals activate magnitude automatically? Evidence from the psychological refractory period paradigm

A single experiment (N = 30) tested the claim that Arabic numerals automatically activate their magnitude representations by assessing whether central attention is required in order to activate magnitude within the psychological refractory period (PRP) paradigm. Subjects performed a color discrimination task as Task 1 and a parity judgment task as Task 2. Task overlap was controlled by varying stimulus onset asynchrony (SOA). A spatial-numerical association of response codes (SNARC) effect arose in Task 2 and yielded under-additive effects with decreasing SOA. This result suggests that magnitude is activated prior to central attention, and is therefore consistent with the claim that numerals activate magnitude automatically.

Central as well as Peripheral Attentional Bottlenecks in Dual-Task Performance Activate Lateral Prefrontal Cortices

Human information processing suffers from severe limitations in parallel processing. In particular, when required to respond to two stimuli in rapid succession, processing bottlenecks may appear at central and peripheral stages of task processing. Importantly, it has been suggested that executive functions are needed to resolve the interference arising at such bottlenecks. The aims of the present study were to test whether central attentional limitations (i.e., bottleneck at the decisional response selection stage) as well as peripheral limitations (i.e., bottleneck at response initiation) both demand executive functions located in the lateral prefrontal cortex. For this, we re-analyzed two previous studies, in which a total of 33 participants performed a dual-task according to the paradigm of the psychological refractory period (PRP) during functional magnetic resonance imaging (fMRI). In one study (N = 17), the PRP task consisted of two two-choice response tasks known to suffer from a central bottleneck (CB group). In the other study (N = 16), the PRP task consisted of two simple-response tasks known to suffer from a peripheral bottleneck (PB group). Both groups showed considerable dual-task costs in form of slowing of the second response in the dual-task (PRP effect). Imaging results are based on the subtraction of both single-tasks from the dual-task within each group. In the CB group, the bilateral middle frontal gyri and inferior frontal gyri were activated. Higher activation in these areas was associated with lower dual-task costs. In the PB group, the right middle frontal and inferior frontal gyrus (IFG) were activated. Here, higher activation was associated with higher dual-task costs. In conclusion we suggest that central and peripheral bottlenecks both demand executive functions located in lateral prefrontal cortices (LPFC). Differences between the CB and PB groups with respect to the exact prefrontal areas activated and the correlational patterns suggest that the executive functions resolving interference at least partially differ between the groups.

Turn-taking in Human Communication--Origins and Implications for Language Processing

Most language usage is interactive, involving rapid turn-taking. The turn-taking system has a number of striking properties: turns are short and responses are remarkably rapid, but turns are of varying length and often of very complex construction such that the underlying cognitive processing is highly compressed. Although neglected in cognitive science, the system has deep implications for language processing and acquisition that are only now becoming clear. Appearing earlier in ontogeny than linguistic competence, it is also found across all the major primate clades. This suggests a possible phylogenetic continuity, which may provide key insights into language evolution.

Time-Resolved Decoding of Two Processing Chains during Dual-Task Interference

The human brain exhibits fundamental limitations in multitasking. When subjects engage in a primary task, their ability to respond to a second stimulus is degraded. Two competing models of multitasking have been proposed: either cognitive resources are shared between tasks, or they are allocated to each task serially. Using a novel combination of magneto-encephalography and multivariate pattern analyses, we obtained a precise spatio-temporal decomposition of the brain processes at work during multitasking. We discovered that each task relies on a sequence of brain processes. These sequences can operate in parallel for several hundred milliseconds but beyond ∼ 500 ms, they repel each other: processes evoked by the first task are shortened, while processes of the second task are either lengthened or postponed. These results contradict the resource-sharing model and further demonstrate that the serial model is incomplete. We therefore propose a new theoretical framework for the computational architecture underlying multitasking.

Speed-accuracy tradeoff by a control signal with balanced excitation and inhibition

A hallmark of flexible behavior is the brain's ability to dynamically adjust speed and accuracy in decision-making. Recent studies suggested that such adjustments modulate not only the decision threshold, but also the rate of evidence accumulation. However, the underlying neuronal-level mechanism of the rate change remains unclear. In this work, using a spiking neural network model of perceptual decision, we demonstrate that speed and accuracy of a decision process can be effectively adjusted by manipulating a top-down control signal with balanced excitation and inhibition [balanced synaptic input (BSI)]. Our model predicts that emphasizing accuracy over speed leads to reduced rate of ramping activity and reduced baseline activity of decision neurons, which have been observed recently at the level of single neurons recorded from behaving monkeys in speed-accuracy tradeoff tasks. Moreover, we found that an increased inhibitory component of BSI skews the decision time distribution and produces a pronounced exponential tail, which is commonly observed in human studies. Our findings suggest that BSI can serve as a top-down control mechanism to rapidly and parametrically trade between speed and accuracy, and such a cognitive control signal presents both when the subjects emphasize accuracy or speed in perceptual decisions.

Distinct effects of prefrontal and parietal cortex inactivations on an accumulation of evidence task in the rat

Numerous brain regions have been shown to have neural correlates of gradually accumulating evidence for decision-making, but the causal roles of these regions in decisions driven by accumulation of evidence have yet to be determined. Here, in rats performing an auditory evidence accumulation task, we inactivated the frontal orienting fields (FOF) and posterior parietal cortex (PPC), two rat cortical regions that have neural correlates of accumulating evidence and that have been proposed as central to decision-making. We used a detailed model of the decision process to analyze the effect of inactivations. Inactivation of the FOF induced substantial performance impairments that were quantitatively best described as an impairment in the output pathway of an evidence accumulator with a long integration time constant (>240 ms). In contrast, we found a minimal role for PPC in decisions guided by accumulating auditory evidence, even while finding a strong role for PPC in internally-guided decisions.