Success versus failure in cognitive control: meta-analytic evidence from neuroimaging studies on error processing

Brain mechanisms of error processing have often been investigated using response interference tasks and focusing on the posterior medial frontal cortex, which is also implicated in resolving response conflict in general. Thereby, the role other brain regions may play has remained undervalued. Here, activation likelihood estimation meta-analyses were used to synthesize the neuroimaging literature on brain activity related to committing errors versus responding successfully in interference tasks and to test for commonalities and differences. The salience network and the temporoparietal junction were commonly recruited irrespective of whether responses were correct or incorrect, pointing towards a general involvement in coping with situations that call for increased cognitive control. The dorsal posterior cingulate cortex, posterior thalamus, and left superior frontal gyrus showed error-specific convergence, which underscores their consistent involvement when performance goals are not met. In contrast, successful responding revealed stronger convergence in the dorsal attention network and lateral prefrontal regions. Underrecruiting these regions in error trials may reflect failures in activating the task-appropriate stimulus-response contingencies necessary for successful response execution.

Effectiveness of Lateral Auditory Collision Warnings: Should Warnings Be Toward Danger or Toward Safety?

OBJECTIVE

The present study investigated the design of spatially oriented auditory collision-warning signals to facilitate drivers' responses to potential collisions.

BACKGROUND

Prior studies on collision warnings have mostly focused on manual driving. It is necessary to examine the design of collision warnings for safe takeover actions in semi-autonomous driving.

METHOD

In a video-based semi-autonomous driving scenario, participants responded to pedestrians walking across the road, with a warning tone presented in either the avoidance direction or the collision direction. The time interval between the warning tone and the potential collision was also manipulated. In Experiment 1, pedestrians always started walking from one side of the road to the other side. In Experiment 2, pedestrians appeared in the middle of the road and walked toward either side of the road.

RESULTS

In Experiment 1, drivers reacted to the pedestrian faster with collision-direction warnings than with avoidance-direction warnings. In Experiment 2, the difference between the two warning directions became nonsignificant. In both experiments, shorter time intervals to potential collisions resulted in faster reactions but did not influence the effect of warning direction.

CONCLUSION

The collision-direction warnings were advantageous over the avoidance-direction warnings only when they occurred at the same lateral location as the pedestrian, indicating that this advantage was due to the capture of attention by the auditory warning signals.

APPLICATION

The present results indicate that drivers would benefit most when warnings occur at the side of potential collision objects rather than the direction of a desirable action during semi-autonomous driving.

Human Cognition in Interaction With Robots: Taking the Robot's Perspective Into Account

OBJECTIVE

The present study investigated whether and how different human-robot interactions in a physically shared workspace influenced human stimulus-response (SR) relationships.

BACKGROUND

Human work is increasingly performed in interaction with advanced robots. Since human-robot interaction often takes place in physical proximity, it is crucial to investigate the effects of the robot on human cognition.

METHOD

In two experiments, we compared conditions in which humans interacted with a robot that they either remotely controlled or monitored under otherwise comparable conditions in the same shared workspace. The cognitive extent to which the participants took the robot's perspective served as a dependent variable and was evaluated with a SR compatibility task.

RESULTS

The results showed pronounced compatibility effects from the robot's perspective when participants had to take the perspective of the robot during the task, but significantly reduced compatibility effects when human and robot did not interact. In both experiments, compatibility effects from the robot's perspective resulted in statistically significant differences in response times and in error rates between compatible and incompatible conditions.

CONCLUSION

We concluded that SR relationships from the perspective of the robot need to be considered when designing shared workspaces that require users to take the perspective of the robot.

APPLICATION

The results indicate changed compatibility relationships when users share their workplace with an interacting robot and therefore have to take its perspective from time to time. The perspective-dependent processing times are expected to be accompanied by corresponding error rates, which might affect-for instance-safety and efficiency in a production process.

Effects of a neutral warning signal on spatial two-choice reactions

Posner et al. reported that, at short fixed foreperiods, a neutral warning tone reduced reaction times (RTs) in a visual two-choice task while increasing error rates for both spatially compatible and incompatible stimulus-response mappings. Consequently, they concluded that alertness induced by the warning does not affect the efficiency of information processing but the setting of a response criterion. We conducted two experiments to determine the conditions under which the trade-off occurs. In Experiment 1, participants performed the same two-choice task as in Posner et al.'s study without RT feedback. Results showed that the warning tone speeded responses with no evidence of speed/accuracy trade-off. In Experiment 2, RT feedback was provided after each response, and a speed/accuracy trade-off was found for the 50-ms foreperiod. However, better information-processing efficiency was evident for the 200-ms foreperiod. We conclude that the foreperiod effect of a 50-ms foreperiod is a result of response criterion adjustment and that providing trial-level RT feedback is critical for replicating this pattern. However, fixed foreperiods of 200 ms or longer benefit both speed and accuracy, implying a more controlled preparation component that improves response efficiency.

Drivers' Spatio-Temporal Attentional Distributions Are Influenced by Vehicle Dynamics and Displayed Point of View

OBJECTIVE

The aim of this study is to measure drivers' attention to preview and their velocity and acceleration tracking error to evaluate two- and three-dimensional displays for following a winding roadway.

BACKGROUND

Display perturbation techniques and Fourier analysis of steering movements can be used to infer drivers' spatio-temporal distribution of attention to preview. Fourier analysis of tracking error time histories provides measures of position, velocity, and acceleration error.

METHOD

Participants tracked a winding roadway with 1 s of preview in low-fidelity driving simulations. Position and rate-aided vehicle dynamics were paired with top-down and windshield displays of the roadway.

RESULTS

For both vehicle dynamics, tracking was smoother with the windshield display. This display emphasizes nearer preview positions and has a closer correspondence to the control-theoretic optimal attentional distributions for these tasks than the top-down display. This correspondence is interpreted as a form of stimulus-response compatibility. The position error and attentional signal-to-noise ratios did not differ between the two displays with position control, but with more complex rate-aided control much higher position error and much lower attentional signal-to-noise ratios occurred with the top-down display.

CONCLUSION

Display-driven influences on the distribution of attention may facilitate tracking with preview when they are similar to optimal attentional distributions derived from control theory.

APPLICATION

Display perturbation techniques can be used to assess spatially distributed attention to evaluate displays and secondary tasks in the context of driving. This methodology can supplement eye movement measurements to determine what information is guiding drivers' actions.

The Effects of Computer-Based and Motor-Imagery Training on Scoring Ability in Lacrosse

Previous studies have confirmed that the temporal attentional control created by the repetition of stimulus–response compatibility (SRC) tasks was transferred to shooting skills in lacrosse players. In the current study, we investigated whether combining motor imagery training with SRC tasks could enhance the scoring ability of lacrosse players. We grouped 33 male lacrosse players into three groups: an SRC task and motor imagery group (referred as to SRC + Image), an SRC task group, and a control group. Players in the first two groups underwent five sessions of 200 SRC task trials. In addition, the SRC + Image group completed five sessions of motor-imagery training. The control group underwent no training interventions. All three groups performed a lacrosse shooting test and a Simon task before and after training sessions to assess the magnitude of the interference effects of the various types of training they underwent. The results of the Simon task showed that repetition of 1,000 trials was enough to create a short-term representation with the incompatible special mapping being transferred to a dynamic activity like lacrosse shooting. Moreover, a combination of a computer-based Type 2 task and motor-imagery training could effectively increase players’ scoring abilities in a field of large spatial conflict.

Modulation of Spatial Attentional Allocation by Computer-Based Cognitive Training during Lacrosse Shooting Performance

It has been reported that repetitive execution of a stimulus–response compatibility (SRC) task attenuates the interference effect of a choice reaction time task, known as a Simon task. We investigated whether attentional control, enhanced by repetitive execution of an SRC task, would reduce the interference effect of a Simon task and could be transferred to lacrosse shooting skills, increasing the likelihood that players would shoot in the direction opposite to the goalie’s initial movement. Female lacrosse players who were matched in terms of age, handedness score, competitive lacrosse playing experience, and playing position, were allocated to the SRC task group (n = 15) or the 2-back training group (n = 14). Participants underwent 10 sessions of 180 trials of a computer-based version of either a Type 2 SRC task or the 2-back task, within four consecutive weeks. Eight practice trials were completed prior to the execution of each task in every training session, during which feedback was provided to confirm accurate mapping between the stimulus and response. Before and after the training phase, both the magnitude of the Simon effect and the lacrosse shooting performance were assessed. After participating in computer-based cognitive training, players did indeed increase the number of shots toward the direction opposite to that of the movement of the goalie. In conclusion, these findings indicate that computer-based cognitive training is beneficial for improving the shooting ability of lacrosse players.

Behavioral and TMS Markers of Action Observation Might Reflect Distinct Neuronal Processes

Transcranial magnetic stimulation (TMS) studies have shown that observing an action induces muscle-specific changes in corticospinal excitability. From a signal detection theory standpoint, this pattern can be related to sensitivity, which here would measure the capacity to distinguish between two action observation conditions. In parallel to these TMS studies, action observation has also been linked to behavioral effects such as motor priming and interference. It has been hypothesized that behavioral markers of action observation could be related to TMS markers and thus represent a potentially cost-effective mean of assessing the functioning of the action-perception system. However, very few studies have looked at possible relationships between these two measures. The aim of this study was to investigate if individual differences in sensitivity to action observation could be related to the behavioral motor priming and interference effects produced by action observation. To this end, 14 healthy participants observed index and little finger movements during a TMS task and a stimulus-response compatibility task. Index muscle displayed sensitivity to action observation, and action observation resulted in significant motor priming+interference, while no significant effect was observed for the little finger in both task. Nevertheless, our results indicate that the sensitivity measured in TMS was not related to the behavioral changes measured in the stimulus-response compatibility task. Contrary to a widespread assumption, the current results indicate that individual differences in physiological and behavioral markers of action observation may be unrelated. This could have important impacts on the potential use of behavioral markers in place of more costly physiological markers of action observation in clinical settings.

Behavioral Advantages of the First-Person Perspective Model for Imitation

Visuomotor information may be better conveyed through a first-person perspective than through a third-person perspective. However, few reports have shown a clear behavioral advantage of the first-person perspective because of the confounding factor of spatial stimulus-response compatibility. Most imitation studies have utilized visuospatial imitation tasks in which participants use the same body part as that used by the model, identified by its spatial position (i.e., the response action is predefined). In such studies, visuomotor information conveyed by the model does not appear to facilitate imitative behavior. We hypothesized that the use of the first-person perspective would facilitate more efficient imitative behavior than a third-person perspective when participants are asked to choose and reproduce an action identical to that of the model rather than to select the same body part; this task requires the analysis of both visual and motor information from the model rather than a simple assessment of spatial information. To test this hypothesis, we asked 15 participants to observe a model from two perspectives (first-person and third-person) with left or right hand laterality and to lift their index finger with an identical movement type (extension or flexion) as quickly as possible. Response latencies were shorter and fewer errors were made in trials using the first-person perspective than in those using the third-person perspective, regardless of whether the model used the right or left hand. These findings suggest that visuomotor information from the first-person perspective, without confounding effects of spatial information, facilitates efficient imitative behavior.

Independent effects of 2-D and 3-D locations of stimuli in a 3-D display on response speed in a Simon task

The Simon Effect is a phenomenon in which reaction times are usually faster when the stimulus location and the response correspond, even if the stimulus location is irrelevant to the task. Recent studies have demonstrated the Simon effect in a three-dimensional (3-D) display. The present study examined whether two-dimensional (2-D) and 3-D locations simultaneously affected the Simon effect for stimuli in which a target and fixation were located on the same plane (ground or ceiling) at different 3-D depths, and the perspective effect produced a difference in the 2-D vertical location of the target stimulus relative to the fixation. The presence of the ground and ceiling plane was controlled to examine the contextual effects of background. The results showed that the 2-D vertical location and 3-D depth simultaneously affected the speed of responses, and they did not interact. The presence of the background did not affect the magnitude of either the 2-D or the 3-D Simon effect. These results suggest that 2-D vertical location and 3-D depth are coded simultaneously and independently, and both affect response selection in which 2-D and 3-D representations overlap.

Interacting hands: the role of attention for the joint Simon effect

Recent research in monkeys and humans has shown that the presence of the hands near an object enhances spatial processing for objects presented near the hand. This study aimed to test the effect of hand position on the joint Simon effect. In Experiment 1, two human co-actors shared a Simon task while placing their response hands either near the objects appearing on the monitor or away from the monitor. Experiment 2 varied each co-actor’s hand position independently. Experiment 3 tested whether enhanced spatial processing for objects presented near the hand is obtained when replacing one of the two co-actors by a non-human event-producing rubber hand. Experiment 1 provided evidence for a Simon effect. Hand position significantly modulated the size of the Simon effect in the joint Simon task showing an increased Simon effect when the hands of both actors were located near the objects on the monitor, than when they were located away from the monitor. Experiment 2 replicated this finding showing an increased Simon effect when the actor’s hand was located near the objects on the monitor, but only when the co-actor also produced action events in spatial reference. A similar hand position effect was observed in Experiment 3 when a non-human rubber hand replaced the human co-actor. These findings suggest that external action events that are produced in spatial reference bias the distribution of attention to the area near the hand. This strengthens the weight of the spatial response codes (referential coding) and hence increases the joint Simon effect.

Neural systems for preparatory control of imitation

Humans have an automatic tendency to imitate others. Previous studies on how we control these tendencies have focused on reactive mechanisms, where inhibition of imitation is implemented after seeing an action. This work suggests that reactive control of imitation draws on at least partially specialized mechanisms. Here, we examine preparatory imitation control, where advance information allows control processes to be employed before an action is observed. Drawing on dual route models from the spatial compatibility literature, we compare control processes using biological and non-biological stimuli to determine whether preparatory imitation control recruits specialized neural systems that are similar to those observed in reactive imitation control. Results indicate that preparatory control involves anterior prefrontal, dorsolateral prefrontal, posterior parietal and early visual cortices regardless of whether automatic responses are evoked by biological (imitative) or non-biological stimuli. These results indicate both that preparatory control of imitation uses general mechanisms, and that preparatory control of imitation draws on different neural systems from reactive imitation control. Based on the regions involved, we hypothesize that preparatory control is implemented through top-down attentional biasing of visual processing.

Gesturing Meaning: Non-action Words Activate the Motor System

Across cultures, speakers produce iconic gestures, which add – through the movement of the speakers’ hands – a pictorial dimension to the speakers’ message. These gestures capture not only the motor content but also the visuospatial content of the message. Here, we provide first evidence for a direct link between the representation of perceptual information and the motor system that can account for these observations. Across four experiments, participants’ hand movements captured both shapes that were directly perceived, and shapes that were only implicitly activated by unrelated semantic judgments of object words. These results were obtained even though the objects were not associated with any motor behaviors that would match the gestures the participants had to produce. Moreover, implied shape affected not only gesture selection processes but also their actual execution – as measured by the shape of hand motion through space – revealing intimate links between implied shape representation and motor output. The results are discussed in terms of ideomotor theories of action and perception, and provide one avenue for explaining the ubiquitous phenomenon of iconic gestures.

Electrophysiological manifestations of stimulus evaluation, response inhibition and motor processing in Tourette syndrome patients

Gilles de la Tourette syndrome (GTS) is a neuropsychiatric disorder with childhood onset presenting with multiple fluctuating motor tics and one or more phonic tics. A significant proportion of people suffering from GTS are still symptomatic in adulthood and present other emotional and cognitive difficulties, along with motor problems that often accompany these comorbid conditions. The nature of these difficulties is still poorly understood and multiple comorbidities are often inadequately controlled. The current study investigates both stimulus evaluation and motor processing in GTS while controlling for comorbidity. Fifteen adults with GTS and 20 control participants were matched on gender, laterality and intelligence. The P300 component, the no-go anteriorization (NGA) as well as the stimulus and response-locked lateralized-readiness potentials (S-LRP, R-LRP) were elicited during a stimulus-response compatibility (SRC) paradigm. The standard version of the Stroop Color-Word Test (SCWT) was also administered. Reaction times showed that participants with GTS processed both the SRC and the SCWT more rapidly than the control group, while producing a delayed P300 peak latency. The GTS group also showed faster S-LRP onset in response to the incompatible and faster processing of interference in the SCWT. There was also a tendency toward a greater frontal shift of the NGA in the GTS group. The P300 latency showed that with GTS patients, stimulus evaluation occurs later whereas the overlapping pre-motor response selection processes occur faster. Our findings are congruent with a probable cortical motor over-activation hypothesis of GTS involving faster motor program selection in processing conflicting SR configuration.