Theories of the psychological refractory period

Working memory involvement in action planning does not include timing initiation structure

A fundamental limitation in the type of information that can be retained in working memory is identified in this theoretical / review article. The analysis is based on studies of skilled motor performance that were not initially conceived in terms of working memory. Findings from a long history of experimentation involving reaction time (RT) prior to making a brief motor response indicate that although the parameters representing the goal to be achieved by the response can be retained in working memory, the control code that implements timing of action components cannot. This lack of working memory requires that the "timing code" must be compiled immediately prior to the moment that it is to be utilized; it is not possible to be fully ready to respond earlier. This compiling process increases RT and may also underlie both the psychological refractory period effect and the difficulty of generating concurrent motor actions with independent timing. These conclusions extend, but do not conflict with, other models of working memory.

The benefit of making voluntary choices generalizes across multiple effectors

It has been shown that cognitive performance could be improved by expressing volition (e.g., making voluntary choices), which necessarily involves the execution of action through a certain effector. However, it is unclear if the benefit of expressing volition can generalize across different effectors. In the present study, participants made a choice between two pictures either voluntarily or forcibly, and subsequently completed a visual search task with the chosen picture as a task-irrelevant background. The effector for choosing a picture could be the hand (pressing a key), foot (pedaling), mouth (commanding), or eye (gazing), whereas the effector for responding to the search target was always the hand. Results showed that participants responded faster and had a more liberal response criterion in the search task after a voluntary choice (vs. a forced choice). Importantly, the improved performance was observed regardless of which effector was used in making the choice, and regardless of whether the effector for making choices was the same as or different from the effector for responding to the search target. Eye-movement data for oculomotor choice showed that the main contributor to the facilitatory effect of voluntary choice was the post-search time in the visual search task (i.e., the time spent on processes after the target was found, such as response selection and execution). These results suggest that the expression of volition may involve the motor control system in which the effector-general, high-level processing of the goal of the voluntary action plays a key role.

The working memory costs of a central attentional bottleneck in multitasking

When two (or more) tasks, each requiring a rapid response, are performed at the same time then serial processing may occur at certain processing stages, such as the response selection. There is accumulating evidence that such serial processing involves additional control processes, such as inhibition, switching, and scheduling (termed the active scheduling account). The present study tested whether the existence of serial processing in multitasking leads to a requirement for processes that coordinate processing in this way (active scheduling account) and, furthermore, whether such control processes are linked to the executive functions (EF) of working memory (WM). To test this question, we merged the psychological refractory period (PRP) paradigm with a WM task, creating a complex WM span task. Participants were presented with a sequence of letters to remember, followed by a processing block in which they had to perform either a single task or a dual task, and finally were asked to recall the letters. Results showed that WM performance, i.e. the amount of letters recalled in the correct order, decreased when performing a dual task as compared to performing a single task during the retention interval. Two further experiments supported this finding using manipulations of the dual task difficulty. We conclude that the existence of serial processing in multitasking demands additional control processes (active scheduling) and that these processes are strongly linked to the executive functions of working memory.

Rationalizing constraints on the capacity for cognitive control

Humans are remarkably limited in: (i) how many control-dependent tasks they can execute simultaneously, and (ii) how intensely they can focus on a single task. These limitations are universal assumptions of most theories of cognition. Yet, a rationale for why humans are subject to these constraints remains elusive. This feature review draws on recent insights from psychology, neuroscience, and machine learning, to suggest that constraints on cognitive control may result from a rational adaptation to fundamental, computational dilemmas in neural architectures. The reviewed literature implies that limitations in multitasking may result from a trade-off between learning efficacy and processing efficiency and that limitations in the intensity of commitment to a single task may reflect a trade-off between cognitive stability and flexibility.

The Planning Horizon for Movement Sequences

When performing a long chain of actions in rapid sequence, future movements need to be planned concurrently with ongoing action. However, how far ahead we plan, and whether this ability improves with practice, is currently unknown. Here, we designed an experiment in which healthy volunteers produced sequences of 14 finger presses quickly and accurately on a keyboard in response to numerical stimuli. On every trial, participants were only shown a fixed number of stimuli ahead of the current keypress. The size of this viewing window varied between 1 (next digit revealed with the pressing of the current key) and 14 (full view of the sequence). Participants practiced the task for 5 days, and their performance was continuously assessed on random sequences. Our results indicate that participants used the available visual information to plan multiple actions into the future, but that the planning horizon was limited: receiving information about more than three movements ahead did not result in faster sequence production. Over the course of practice, we found larger performance improvements for larger viewing windows and an expansion of the planning horizon. These findings suggest that the ability to plan future responses during ongoing movement constitutes an important aspect of skillful movement. Based on the results, we propose a framework to investigate the neuronal processes underlying simultaneous planning and execution.

Global-local processing and dispositional bias interact with emotion processing in the psychological refractory period paradigm

The reciprocal link between scope of attention and emotional processing is an important aspect of the relationship between emotion and attention. Larger scope of attention or global processing has been linked to positive emotions and narrow scope of attention or local processing has been linked to negative emotions. The nature of this relationship in the context of central capacity limitations and individual differences in attentional processing has not been studied in detail so far. To investigate such a relationship, here we used the psychological refractory period (PRP) paradigm, in which we manipulated the stimulus onset asynchrony (SOA: 150 ms, 300 ms, 900 ms) of stimuli corresponding to two tasks in a sequence. The first task was identifying a number at the global or local level; the second task was recognizing the emotional expression (happy or angry). Additionally, predisposition towards local or global perceptual dimension was measured with the global-local task. Results indicated that global precedence modulated PRP effect and that response accuracy was impaired by the combination of local-angry task modalities. Interestingly, interference between simultaneous tasks was modulated by the predisposition to different perceptual levels resulting in different cognitive strategies for performing simultaneous tasks: locally biased subjects tended more towards serial processing, meanwhile globally biased ones were performing tasks in a parallel manner. This result suggest that individual differences may play a role in the choice of dual-task performing strategies.

Spatiotemporal characteristics of an attacker's strategy to pass a defender effectively in a computer-based one-on-one task

For modern humans, chase-and-escape behaviors are fundamental skills in many sports. A critical factor related to the success or failure of chase-and-escape is the visuomotor delay. Recent studies on sensorimotor decision making have shown that humans can incorporate their own visuomotor delay into their decisions. However, the relationship between the decision of an attacker and the visuomotor delay of a defender is still unknown. Here, we conducted a one-on-one chase-and-escape task for humans and investigated the characteristics of the direction changes of the attacker and the responses of the defender. Our results showed that the direction change of the attacker has two characteristics: uniformity of spatial distribution and bimodality of temporal distribution. In addition, we showed that the response of the defender did not depend on the position but it was delayed to the direction change of the attacker with a short interval. These results suggest that the characteristics of direction change of an attacker increased unpredictability, and it could be useful for preventing the predictive response of the defender and to receive the benefit of an extra response delay of tens of milliseconds, respectively.

The offline stream of conscious representations

When do we become conscious of a stimulus after its presentation? We would all agree that this necessarily takes time and that it is not instantaneous. Here, I would like to propose not only that conscious access is delayed relative to the external stimulation, but also that it can flexibly desynchronize from external stimulation; it can process some information 'offline', if and when it becomes relevant. Thus, in contrast with initial sensory processing, conscious experience might not strictly follow the sequence of events in the environment. In this article, I will review gathering evidence in favour of this proposition. I will argue that it offers a coherent framework for explaining a great variety of observations in the domain of perception, sensory memory and working memory: the psychological refractory period, the attentional blink, post-dictive phenomena, iconic memory, latent working memory and the newly described retro-perception phenomenon. I will integrate this proposition to the global neuronal workspace model and consider possible underlying brain mechanisms. Finally, I will argue that this capacity to process information 'offline' might have made conscious processing evolutionarily advantageous in spite of its sluggishness and capacity limitations.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

Intertrial Effects of Same-Different Judgements

Specific intertrial effects (repetition effects) and general intertrial effects (refractoriness or persisting attention to the preceding trial) were studied with the same-different judgment task, which dissociates the effects of response repetition and stimulus repetition. Response repetition alone did not facilitate performance. Stimulus repetition did aid performance, but mainly when accompanied by response repetition. Subjects tended to avoid the normal comparison process by using the (invalid!) “bypass rule” (Fletcher and Rabbitt, 1978): repeat the response if the stimulus or some aspect thereof (letter contents, size, position) is repeated from the preceding trial, otherwise change the response. As to general effects, partial refractoriness was evident at response execution, but not at earlier processing stages. Mean RT increased, but errors decreased, as the response-stimulus interval (RSI) between trials decreased. Presenting a new letter pair immediately after the preceding response produced a delay, but subjects used the waiting time, while the response system recovered or was redirected to the present trial, to improve the accuracy of their decision.

Chronometric Evidence for Central Postponement in Temporally Overlapping Tasks

When the stimuli from two tasks arrive in rapid succession (the overlapping tasks paradigm), response delays are typically observed. Two general types of models have been proposed to account for these delays. Postponement models suppose that processing stages in the second task are delayed due to a single-channel bottleneck. Capacity-sharing models suppose that processing on both tasks occurs at reduced rates because of sharing of common resources. Postponement models make strong and distinctive predictions for the behaviour of variables slowing particular second-task stages, when assessed in single- and dual-task conditions. In Experiment 1, subjects were required to make manual classification responses to a tone (S1) and a letter (S2), presented at stimulus onset asynchronies of 50, 100, and 400 msec, making R1 responses to S1 as promptly as possible. The second response, R2, but not R1, was delayed in the dual task condition, and the effects of two S2 variables (degradation and repetition) on R2 response times in dual- and single-task conditions closely matched the predictions of a postponement model with a processing bottleneck at the decision/response-selection stage. In Experiment 2, subjects were encouraged to emit both responses close together in time. Use of this response grouping procedure had little effect on the magnitude of R2 response times, or on the pattern of stimulus factor effects on R2, supporting the hypothesis that the same underlying postponement process was operating. R1 response times were, however, dramatically delayed, and were now affected by S2 difficulty variables. The results provide strong support for postponement models of dual-task interference in the overlapping tasks paradigm, even when response times are delayed on both tasks.

Moving slowly is hard for humans: limitations of dynamic primitives

Mounting evidence suggests that human motor control uses dynamic primitives, attractors of dynamic neuromechanical systems that require minimal central supervision. However, advantages for control may be offset by compromised versatility. Extending recent results showing that humans could not sustain discrete movements as duration decreased, this study tested whether smoothly rhythmic movements could be maintained as duration increased. Participants performed horizontal movements between two targets, paced by sounds with intervals that increased from 1 to 6 s by 200 ms per cycle and then decreased again. The instruction emphasized smooth rhythmic movements without interspersed dwell times. We hypothesized that 1) when oscillatory motions slow down, smoothness decreases; 2) slower oscillatory motions are executed as submovements or even discrete movements; and 3) the transition between smooth oscillations and submovements shows hysteresis. An alternative hypothesis was that 4) removing visual feedback restores smoothness, indicative of visually evoked corrections causing the irregularity. Results showed that humans could not perform slow and smooth oscillatory movements. Harmonicity decreased with longer intervals, and dwell times between cycles appeared and became prominent at slower speeds. Velocity profiles showed an increase with cycle duration of the number of overlapping submovements. There was weak evidence of hysteresis in the transition between these two types of movement. Eliminating vision had no effect, suggesting that intermittent visually evoked corrections did not underlie this phenomenon. These results show that it is hard for humans to execute smooth rhythmic motions very slowly. Instead, they "default" to another dynamic primitive and compose motion as a sequence of overlapping submovements.NEW & NOTEWORTHY Complementing a large body of prior work showing advantages of composing primitives to manage the complexity of motor control, this paper uncovers a limitation due to composition of behavior from dynamic primitives: while slower execution frequently makes a task easier, there is a limit and it is hard for humans to move very slowly. We suggest that this remarkable limitation is not due to inadequacies of muscle, nor to slow neural communication, but is a consequence of how the control of movement is organized.

The Microstructure of Dual-Task Interaction. 1. The Patterning of Main-Task Responses within Secondary-Task Intervals

The patterning or microstructure of a situation where subjects were presented with two sets of information from two independent ‘high decision’ information processing tasks, was investigated. Thirty-two subjects worked at the five-choice serial-response task (designated by instructions to be the main task), whilst being presented with a transformation task which required that seven had to be added to a presented auditory digit (designated by instructions to be the secondary task). Results suggested that subjects were not able to process two streams of information in parallel, and that the way in which the attention process was ordered was partly a function of task instructions and partly a function of the random occurrence of each digit in relation to the on-going serial task. Results also gave support to the view that the locus of disruption was the production of the response to the secondary task. Explanations of this effect are considered.

Chronometric Evidence for two Types of Attention

Parallel processing in the human brain is subject to severe attentional limits, but it is unclear whether such limits arise from a single attentional process or multiple distinct attentional processes We provide new evidence that two candidates, input attention and central attention, operate at different temporal stages of processing This conclusion is supported by chronometric analyses showing that the same reference stage (letter identification) operates after the stage at which input attention operates, but prior to the stage at which central attention operates The finding that attention operates at different temporal loci provides new support for the existence of distinct attentional processes

Multisensory Competition Is Modulated by Sensory Pathway Interactions with Fronto-Sensorimotor and Default-Mode Network Regions

Multisensory information competes for preferential access to consciousness. It remains unknown what neural processes cause one particular modality to win multisensory competition and eventually dominate behavior. Thus, in a paradigm in which human participants sought to make simultaneous auditory and visual detection responses, we sought to identify prestimulus and poststimulus neural signals that were associated with auditory and visual dominance on each trial. Behaviorally, visual detection responses preceded auditory responses more frequently than vice versa. Even when visual responses were preceded by auditory responses, they recovered more quickly from previous responses, indicating the dominance of vision over audition. Neurally, visual precedence was associated with increased prestimulus activity in the prefrontal cortex and reduced prestimulus activity in the default-mode network, and increased poststimulus connectivity between the prefrontal cortex and the visual system. Moreover, the dorsal visual stream showed not only increased activity in post-perceptual phases but also enhanced connectivity with the sensorimotor cortex, indicating the functional role of the dorsal visual stream in prioritizing the flow of visual information into the motor system. In contrast, auditory precedence was associated with increased prestimulus activity in the auditory cortex and increased poststimulus neural coupling between the auditory and the sensorimotor cortex. Finally, whenever one modality lost multisensory competition, the corresponding sensory cortex showed enhanced connectivity with the default-mode network. Overall, the outcome of audiovisual competition depended on dynamic interactions between sensory systems and both the fronto-sensorimotor and the default-mode network. Together, these results revealed both the neural causes and the neural consequences of visual and auditory dominance during multisensory competition.

Measuring individual corrective reaction time using the intermittent illumination model

The corrective reaction time (tcr) is an essential motor property when modelling hand control movements. Many studies designed experiments to estimate tcr, but reported only group means with inconsistent definitions. This study proposes an alternative methodology using Drury's (1994) intermittent illumination model. A total of 24 participants performed circular tracking movements under five levels of visual information delay using a modified monitor in a darkened room. Measured movement speeds and the manipulated delays were used with the model to estimate tcr of individuals and test effects of gender and path width. The results showed excellent model fits and demonstrated individual differences of tcr, which was 273 ms on average and ranged from 87 to 441 ms. The wide range of tcr values was due to significant effects of gender and path width. Male participants required shorter tcr compared to female participants, especially for narrow path widths.

PRACTITIONER SUMMARY

This study reports the corrective reaction time (tcr) of individuals using a novel methodology. The estimated tcr ranged from 87 to 441 ms, helping model hand control movements, such as aiming and tracking. The methodology can be continuously applied to study tcr under conditions with various performers and movements.

Human stick balancing: an intermittent control explanation

There are two issues in balancing a stick pivoting on a finger tip (or mechanically on a moving cart): maintaining the stick angle near to vertical and maintaining the horizontal position within the bounds of reach or cart track. The (linearised) dynamics of the angle are second order (although driven by pivot acceleration), and so, as in human standing, control of the angle is not, by itself very difficult. However, once the angle is under control, the position dynamics are, in general, fourth order. This makes control quite difficult for humans (and even an engineering control system requires careful design). Recently, three of the authors have experimentally demonstrated that humans control the stick angle in a special way: the closed-loop inverted pendulum behaves as a non-inverted pendulum with a virtual pivot somewhere between the stick centre and tip and with increased gravity. Moreover, they suggest that the virtual pivot lies at the radius of gyration (about the mass centre) above the mass centre. This paper gives a continuous-time control-theoretical interpretation of the virtual-pendulum approach. In particular, by using a novel cascade control structure, it is shown that the horizontal control of the virtual pivot becomes a second-order problem which is much easier to solve than the generic fourth-order problem. Hence, the use of the virtual pivot approach allows the control problem to be perceived by the subject as two separate second-order problems rather than a single fourth-order problem, and the control problem is therefore simplified. The theoretical predictions are verified using the data previously presented by three of the authors and analysed using a standard parameter estimation method. The experimental data indicate that although all subjects adopt the virtual pivot approach, the less expert subjects exhibit larger amplitude angular motion and poorly controlled translational motion. It is known that human control systems are delayed and intermittent, and therefore, the continuous-time strategy cannot be correct. However, the model of intermittent control used in this paper is based on the virtual pivot continuous-time control scheme, handles time delays and moreover masquerades as the underlying continuous-time controller. In addition, the event-driven properties of intermittent control can explain experimentally observed variability.

Interfacing sensory input with motor output: does the control architecture converge to a serial process along a single channel?

Modular organization in control architecture may underlie the versatility of human motor control; but the nature of the interface relating sensory input through task-selection in the space of performance variables to control actions in the space of the elemental variables is currently unknown. Our central question is whether the control architecture converges to a serial process along a single channel? In discrete reaction time experiments, psychologists have firmly associated a serial single channel hypothesis with refractoriness and response selection [psychological refractory period (PRP)]. Recently, we developed a methodology and evidence identifying refractoriness in sustained control of an external single degree-of-freedom system. We hypothesize that multi-segmental whole-body control also shows refractoriness. Eight participants controlled their whole body to ensure a head marker tracked a target as fast and accurately as possible. Analysis showed enhanced delays in response to stimuli with close temporal proximity to the preceding stimulus. Consistent with our preceding work, this evidence is incompatible with control as a linear time invariant process. This evidence is consistent with a single-channel serial ballistic process within the intermittent control paradigm with an intermittent interval of around 0.5 s. A control architecture reproducing intentional human movement control must reproduce refractoriness. Intermittent control is designed to provide computational time for an online optimization process and is appropriate for flexible adaptive control. For human motor control we suggest that parallel sensory input converges to a serial, single channel process involving planning, selection, and temporal inhibition of alternative responses prior to low dimensional motor output. Such design could aid robots to reproduce the flexibility of human control.

Refractoriness in sustained visuo-manual control: is the refractory duration intrinsic or does it depend on external system properties?

Researchers have previously adopted the double stimulus paradigm to study refractoriness in human neuromotor control. Currently, refractoriness, such as the Psychological Refractory Period (PRP) has only been quantified in discrete movement conditions. Whether refractoriness and the associated serial ballistic hypothesis generalises to sustained control tasks has remained open for more than sixty years. Recently, a method of analysis has been presented that quantifies refractoriness in sustained control tasks and discriminates intermittent (serial ballistic) from continuous control. Following our recent demonstration that continuous control of an unstable second order system (i.e. balancing a 'virtual' inverted pendulum through a joystick interface) is unnecessary, we ask whether refractoriness of substantial duration (~200 ms) is evident in sustained visual-manual control of external systems. We ask whether the refractory duration (i) is physiologically intrinsic, (ii) depends upon system properties like the order (0, 1(st), and 2(nd)) or stability, (iii) depends upon target jump direction (reversal, same direction). Thirteen participants used discrete movements (zero order system) as well as more sustained control activity (1(st) and 2(nd) order systems) to track unpredictable step-sequence targets. Results show a substantial refractory duration that depends upon system order (250, 350 and 550 ms for 0, 1(st) and 2(nd) order respectively, n=13, p<0.05), but not stability. In sustained control refractoriness was only found when the target reverses direction. In the presence of time varying actuators, systems and constraints, we propose that central refractoriness is an appropriate control mechanism for accommodating online optimization delays within the neural circuitry including the more variable processing times of higher order (complex) input-output relations.

Mitigating the effects of in-vehicle distractions through use of the Psychological Refractory Period paradigm

Modern driving involves frequent and potentially detrimental interactions with distracting in-vehicle tasks. Distraction has been shown to slow brake reaction time and decrease lateral and longitudinal vehicle control. It is likely that these negative effects will become more prevalent in the future as advances are made in the functionality, availability, and number of in-vehicle systems. This paper addresses this problem by considering ways to manage in-vehicle task presentation to mitigate their distracting effects. A driving simulator experiment using 48 participants was performed to investigate the existence of the Psychological Refractory Period in the driving context and its effect on braking performance. Drivers were exposed to lead vehicle braking events in isolation (single-task) and with a preceding surrogate in-vehicle task (dual-task). In dual-task scenarios, the time interval between the in-vehicle and braking tasks was manipulated. Brake reaction time increased when drivers were distracted. The in-vehicle task interfered with the performance of the braking task in a manner that was dependent on the interval between the two tasks, with slower reactions following a shorter inter-task interval. This is the Psychological Refractory Period effect. These results have implications for driver safety during in-vehicle distraction. The findings are used to develop recommendations regarding the timing of in-vehicle task presentation so as to reduce their potentially damaging effects on braking performance. In future, these guidelines could be incorporated into a driver workload management system to minimise the opportunity for a driver to be distracted from the ongoing driving task.

Activation of dorsolateral prefrontal cortex in a dual neuropsychological screening test: an fMRI approach

Background

The Kana Pick-out Test (KPT), which uses Kana or Japanese symbols that represent syllables, requires parallel processing of discrete (pick-out) and continuous (reading) dual tasks. As a dual task, the KPT is thought to test working memory and executive function, particularly in the prefrontal cortex (PFC), and is widely used in Japan as a clinical screen for dementia. Nevertheless, there has been little neurological investigation into PFC activity during this test.

Methods

We used functional magnetic resonance imaging (fMRI) to evaluate changes in the blood oxygenation level-dependent (BOLD) signal in young healthy adults during performance of a computerized KPT dual task (comprised of reading comprehension and picking out vowels) and compared it to its single task components (reading or vowel pick-out alone).

Results

Behavioral performance of the KPT degraded compared to its single task components. Performance of the KPT markedly increased BOLD signal intensity in the PFC, and also activated sensorimotor, parietal association, and visual cortex areas. In conjunction analyses, bilateral BOLD signal in the dorsolateral PFC (Brodmann's areas 45, 46) was present only in the KPT.

Conclusions

Our results support the central bottleneck theory and suggest that the dorsolateral PFC is an important mediator of neural activity for both short-term storage and executive processes. Quantitative evaluation of the KPT with fMRI in healthy adults is the first step towards understanding the effects of aging or cognitive impairment on KPT performance.

A Unified attentional bottleneck in the human brain

Human information processing is characterized by bottlenecks that constrain throughput. These bottlenecks limit both what we can perceive and what we can act on in multitask settings. Although perceptual and response limitations are often attributed to independent information processing bottlenecks, it has recently been suggested that a common attentional limitation may be responsible for both. To date, however, evidence supporting the existence of such a "unified" bottleneck has been mixed. Here, we tested the unified bottleneck hypothesis using time-resolved fMRI. Experiment 1 isolated brain regions involved in the response selection bottleneck that limits speeded dual-task performance. These same brain regions were not only engaged by a perceptual encoding task in Experiment 2, their activity also tracked delays to a speeded decision-making task caused by concurrent perceptual encoding (Experiment 3). We conclude that a unified attentional bottleneck, including the inferior frontal junction, superior medial frontal cortex, and bilateral insula, temporally limits operations as diverse as perceptual encoding and decision-making.

Intermittent control: a computational theory of human control

The paradigm of continuous control using internal models has advanced understanding of human motor control. However, this paradigm ignores some aspects of human control, including intermittent feedback, serial ballistic control, triggered responses and refractory periods. It is shown that event-driven intermittent control provides a framework to explain the behaviour of the human operator under a wider range of conditions than continuous control. Continuous control is included as a special case, but sampling, system matched hold, an intermittent predictor and an event trigger allow serial open-loop trajectories using intermittent feedback. The implementation here may be described as "continuous observation, intermittent action". Beyond explaining unimodal regulation distributions in common with continuous control, these features naturally explain refractoriness and bimodal stabilisation distributions observed in double stimulus tracking experiments and quiet standing, respectively. Moreover, given that human control systems contain significant time delays, a biological-cybernetic rationale favours intermittent over continuous control: intermittent predictive control is computationally less demanding than continuous predictive control. A standard continuous-time predictive control model of the human operator is used as the underlying design method for an event-driven intermittent controller. It is shown that when event thresholds are small and sampling is regular, the intermittent controller can masquerade as the underlying continuous-time controller and thus, under these conditions, the continuous-time and intermittent controller cannot be distinguished. This explains why the intermittent control hypothesis is consistent with the continuous control hypothesis for certain experimental conditions.

[Toward a taxonomy of unconscious perceptual visual processes: from the patient to the healthy subject]

Our conscious perception is not exhaustive of all the processes at work when we face a visual scene. In the light of a recent theoretical model, - the conscious global workspace model -, which states the necessary and sufficient conditions for a perceptual representation to reach conscious content, we propose here a taxonomy, which distinguishes between four types of unconscious visual processes. For each of them, we will draw close links between several neurological syndromes and experimental visual paradigms, which can be used in the laboratory with normal subjects.

The brain's router: a cortical network model of serial processing in the primate brain

The human brain efficiently solves certain operations such as object recognition and categorization through a massively parallel network of dedicated processors. However, human cognition also relies on the ability to perform an arbitrarily large set of tasks by flexibly recombining different processors into a novel chain. This flexibility comes at the cost of a severe slowing down and a seriality of operations (100-500 ms per step). A limit on parallel processing is demonstrated in experimental setups such as the psychological refractory period (PRP) and the attentional blink (AB) in which the processing of an element either significantly delays (PRP) or impedes conscious access (AB) of a second, rapidly presented element. Here we present a spiking-neuron implementation of a cognitive architecture where a large number of local parallel processors assemble together to produce goal-driven behavior. The precise mapping of incoming sensory stimuli onto motor representations relies on a "router" network capable of flexibly interconnecting processors and rapidly changing its configuration from one task to another. Simulations show that, when presented with dual-task stimuli, the network exhibits parallel processing at peripheral sensory levels, a memory buffer capable of keeping the result of sensory processing on hold, and a slow serial performance at the router stage, resulting in a performance bottleneck. The network captures the detailed dynamics of human behavior during dual-task-performance, including both mean RTs and RT distributions, and establishes concrete predictions on neuronal dynamics during dual-task experiments in humans and non-human primates.

Neurophysiological bases of exponential sensory decay and top-down memory retrieval: a model

Behavioral observations suggest that multiple sensory elements can be maintained for a short time, forming a perceptual buffer which fades after a few hundred milliseconds. Only a subset of this perceptual buffer can be accessed under top-down control and broadcasted to working memory and consciousness. In turn, single-cell studies in awake-behaving monkeys have identified two distinct waves of response to a sensory stimulus: a first transient response largely determined by stimulus properties and a second wave dependent on behavioral relevance, context and learning. Here we propose a simple biophysical scheme which bridges these observations and establishes concrete predictions for neurophsyiological experiments in which the temporal interval between stimulus presentation and top-down allocation is controlled experimentally. Inspired in single-cell observations, the model involves a first transient response and a second stage of amplification and retrieval, which are implemented biophysically by distinct operational modes of the same circuit, regulated by external currents. We explicitly investigated the neuronal dynamics, the memory trace of a presented stimulus and the probability of correct retrieval, when these two stages were bracketed by a temporal gap. The model predicts correctly the dependence of performance with response times in interference experiments suggesting that sensory buffering does not require a specific dedicated mechanism and establishing a direct link between biophysical manipulations and behavioral observations leading to concrete predictions.

Limits on Introspection

Which cognitive processes are accessible to conscious report? To study the limits of conscious reportability, we designed a novel method of quantified introspection, in which subjects were asked, after each trial of a standard cognitive task, to estimate the time spent completing the task. We then applied classical mental-chronometry techniques, such as the additive-factors method, to analyze these introspective estimates of response time. We demonstrate that introspective response time can be a sensitive measure, tightly correlated with objective response time in a single-task context. In a psychological-refractory-period task, however, the objective processing delay resulting from interference by a second concurrent task is totally absent from introspective estimates. These results suggest that introspective estimates of time spent on a task tightly correlate with the period of availability of central processing resources.

Delays without mistakes: response time and error distributions in dual-task

Background

When two tasks are presented within a short interval, a delay in the execution of the second task has been systematically observed. Psychological theorizing has argued that while sensory and motor operations can proceed in parallel, the coordination between these modules establishes a processing bottleneck. This model predicts that the timing but not the characteristics (duration, precision, variability…) of each processing stage are affected by interference. Thus, a critical test to this hypothesis is to explore whether the qualitiy of the decision is unaffected by a concurrent task.

Methodology/Principal Findings

In number comparison–as in most decision comparison tasks with a scalar measure of the evidence–the extent to which two stimuli can be discriminated is determined by their ratio, referred as the Weber fraction. We investigated performance in a rapid succession of two non-symbolic comparison tasks (number comparison and tone discrimination) in which error rates in both tasks could be manipulated parametrically from chance to almost perfect. We observed that dual-task interference has a massive effect on RT but does not affect the error rates, or the distribution of errors as a function of the evidence.

Conclusions/Significance

Our results imply that while the decision process itself is delayed during multiple task execution, its workings are unaffected by task interference, providing strong evidence in favor of a sequential model of task execution.

Postural prioritization defines the interaction between a reaction time task and postural perturbations

Concurrent demands for postural and cognitive control processes are now known to induce interference, e.g., information processing speed may decrease during postural adjustment. It is less clear whether postural control may, at least in many situations, take precedence over cognitive control ("postural prioritization"). The purpose of this study was to determine if postural dual-task effects are the result of a postural prioritization effect. Twelve young subjects (6 female; 24.1 +/- 4.1) performed a discrete choice reaction time (RT) task in combination with a platform perturbation. To assess the effect of postural prioritization on RT and center of pressure (COP) parameters, destabilizing perturbations were randomly interspersed with non-destabilizing perturbations. Furthermore, stimulus order and the time interval of the RT stimulus relative to the platform perturbation were manipulated. COP and RT data obtained in these manipulations were compared to single-task baseline data. The results suggested that, irrespective of the degree of threat to postural stability, postural task processes are prioritized. Furthermore, anticipation of a postural stimulus negatively affects RT. However, once a perturbation commences subsequent RTs are speeded. Postural reactions were unaffected by a concurrent RT task, however. The RT stimulus acted as a cue to initiate biomechanical adaptations for an upcoming perturbation.

Brain activity associated with dual-task management differs depending on the combinations of response modalities

Several functional imaging studies have demonstrated the importance of fronto-parietal network in dual-task management. However, neural correlates underlying the difference in intensity of dual-task interference between the same and different response modalities remain unknown. Therefore, we investigated the relationship between brain activity associated with dual-task management and the combinations of response modalities. We used the dual-task requiring bilateral finger responses (DT-same condition) and that requiring finger and oral responses (DT-different condition) to visual and auditory stimuli. The right premotor cortex, precuneus and right posterior parietal cortex were significantly activated in the DT-same condition. The neural activities in the right premotor cortex significantly correlated to the delayed responses in the DT-same condition relative to the single-task conditions, indicating that the right premotor cortex is partly associated with dual-task management (i.e., the regulation of information flow). In addition, neural activity in this brain region was significantly higher in the DT-same condition than in the DT-different condition, suggesting that the difference in intensity between the same and different response modalities is partly associated with difference in the load on the premotor cortex between the DT-same and DT-different conditions. The significant activation of the parietal cortex also differed between the DT-same and DT-different conditions. These results demonstrate that brain activity associated with dual-task management differs depending on the combination of response modalities and that such a difference in brain activity, particularly in the right premotor cortex, might be partly associated with the difference in intensity of dual-task interference between the DT-same and DT-different conditions.

Dynamics of the central bottleneck: dual-task and task uncertainty

Why is the human brain fundamentally limited when attempting to execute two tasks at the same time or in close succession? Two classical paradigms, psychological refractory period (PRP) and task switching, have independently approached this issue, making significant advances in our understanding of the architecture of cognition. Yet, there is an apparent contradiction between the conclusions derived from these two paradigms. The PRP paradigm, on the one hand, suggests that the simultaneous execution of two tasks is limited solely by a passive structural bottleneck in which the tasks are executed on a first-come, first-served basis. The task-switching paradigm, on the other hand, argues that switching back and forth between task configurations must be actively controlled by a central executive system (the system controlling voluntary, planned, and flexible action). Here we have explicitly designed an experiment mixing the essential ingredients of both paradigms: task uncertainty and task simultaneity. In addition to a central bottleneck, we obtain evidence for active processes of task setting (planning of the appropriate sequence of actions) and task disengaging (suppression of the plan set for the first task in order to proceed with the next one). Our results clarify the chronometric relations between these central components of dual-task processing, and in particular whether they operate serially or in parallel. On this basis, we propose a hierarchical model of cognitive architecture that provides a synthesis of task-switching and PRP paradigms.

Testing the predictions of the central capacity sharing model

The divergent predictions of 2 models of dual-task performance are investigated. The central bottleneck and central capacity sharing models argue that a central stage of information processing is capacity limited, whereas stages before and after are capacity free. The models disagree about the nature of this central capacity limitation. The central bottleneck model claims that central processing acts on only 1 task at a time and, therefore, constitutes a bottleneck that processes tasks serially. The central capacity sharing model postulates that the central stage is a limited-capacity parallel processor that divides resources among to-be-performed tasks. As a result of this difference, in the psychological refractory period paradigm, the central capacity sharing model predicts that lengthening Task 2 precentral processing will improve Task 1 performance at short stimulus onset asynchronies, whereas the central bottleneck model does not. Results of 2 experiments confirm the prediction of the central capacity sharing model.

Degrees of freedom and motor planning in purposive movement

This paper presents empirical evidence suggesting that healthy humans can perform a two degree of freedom visuo-motor pursuit tracking task with the same response time delay as a one degree of freedom task. In contrast, the time delay of the response is influenced markedly by the nature of the motor synergy required to produce it. We suggest a conceptual account of this evidence based on adaptive model theory, which combines theories of intermittency from psychology and adaptive optimal control from engineering. The intermittent response planning stage has a fixed period. It possesses multiple optimal trajectory generators such that multiple degrees of freedom can be planned concurrently, without requiring an increase in the planning period. In tasks which require unfamiliar motor synergies, or are deemed to be incompatible, internal adaptive models representing movement dynamics are inaccurate. This means that the actual response which is produced will deviate from the one which is planned. For a given target-response discrepancy, corrective response trajectories of longer duration are planned, consistent with the principle of speed-accuracy trade-off. Compared to familiar or compatible tasks, this results in a longer response time delay and reduced accuracy. From the standpoint of the intermittency approach, the findings of this study help make possible a more integral and predictive account of purposive action.

Parsing a cognitive task: a characterization of the mind's bottleneck

Parsing a mental operation into components, characterizing the parallel or serial nature of this flow, and understanding what each process ultimately contributes to response time are fundamental questions in cognitive neuroscience. Here we show how a simple theoretical model leads to an extended set of predictions concerning the distribution of response time and its alteration by simultaneous performance of another task. The model provides a synthesis of psychological refractory period and random-walk models of response time. It merely assumes that a task consists of three consecutive stages-perception, decision based on noisy integration of evidence, and response-and that the perceptual and motor stages can operate simultaneously with stages of another task, while the central decision process constitutes a bottleneck. We designed a number-comparison task that provided a thorough test of the model by allowing independent variations in number notation, numerical distance, response complexity, and temporal asynchrony relative to an interfering probe task of tone discrimination. The results revealed a parsing of the comparison task in which each variable affects only one stage. Numerical distance affects the integration process, which is the only step that cannot proceed in parallel and has a major contribution to response time variability. The other stages, mapping the numeral to an internal quantity and executing the motor response, can be carried out in parallel with another task. Changing the duration of these processes has no significant effect on the variance.

Effect of Preparation on Dual-Task Performance in Postural Control

The authors applied an overlapping-task design to study the interaction between postural control and cognitive task processes in young (n = 10) and older (n = 10) adults. A rapid destabilizing floor translation was followed at specific time intervals by a simple auditory reaction time (RT) task. The translations were preceded by either an informational cue or no cue. Interference between postural task demands and the RT task was found only in the first 50 ms. Cueing also had an effect on both the onset of the postural recovery response and RT performance. The results suggest (a) only a brief interference between postural and cognitive processing demands in relatively easy tasks, (b) competition for a common central mechanism, possibly a response-selection mechanism, and (c) no differential impact of aging on that interaction.

Evidence for an error deadzone in compensatory tracking

Humans and monkeys show intermittent arm movements while tracking moving targets. This intermittency has been explained by postulating either a psychological refractory period after each movement and/or an error deadzone, an area surrounding the target within which movements are not initiated. We present a technique to detect and quantify the size of this deadzone, using a compensatory tracking paradigm that distinguishes it from a psychological refractory period. An artificial deadzone of variable size was added around a visual target displayed on a computer screen. While the subject was within this area, he received visual feedback that showed him to be directly on target. The presence of this artificial deadzone could affect tracking performance only if it exceeded the size of his intrinsic deadzone. Therefore, the size of artificial deadzone at which performance began to be affected revealed the size of the intrinsic deadzone. Measured at the subjects' eye, the deadzone was found to vary between 0.06 and 0.38 degrees, depending on the tracking task and viewing conditions; on the screen, this range was 1.3 mm to 3.3 mm. It increased with increasing speed of the target, with increasing viewing distance, and when the amplitude of the movement required was reduced. However, the deadzone size was not significantly correlated with the subjects' level of performance. We conclude that an intrinsic deadzone exists during compensatory tracking, and we suggest that its size is set by a cognitive process not simply related to the difficulty of the tracking task.

Visual and cognitive control of attention in smooth pursuit

In this chapter, we describe the role of attention in the control of smooth pursuit eye movements. As a voluntary and continuous eye movement, smooth pursuit is driven by both visual and cognitive signals. Here we show that whereas the entire process of smooth pursuit requires visual attention, the post-onset phase of the initiation and the maintenance smooth pursuit are under an additional sustained non-visual cognitive attention control. The temporal dynamics of these complementary controls of visual and non-visual cognitive attention support the continuous generation of smooth pursuit so that eye tracking of a moving target can be prompt and accurate.