Intentional control of attention: action planning primes action-related stimulus dimensions

Action Planning Mediates Guidance of Visual Attention from Working Memory

Visual search is impaired when a salient task-irrelevant stimulus is presented together with the target. Recent research has shown that this attentional capture effect is enhanced when the salient stimulus matches working memory (WM) content, arguing in favor of attention guidance from WM. Visual attention was also shown to be closely coupled with action planning. Preparing a movement renders action-relevant perceptual dimensions more salient and thus increases search efficiency for stimuli sharing that dimension. The present study aimed at revealing common underlying mechanisms for selective attention, WM, and action planning. Participants both prepared a specific movement (grasping or pointing) and memorized a color hue. Before the movement was executed towards an object of the memorized color, a visual search task (additional singleton) was performed. Results showed that distraction from target was more pronounced when the additional singleton had a memorized color. This WM-guided attention deployment was more pronounced when participants prepared a grasping movement. We argue that preparing a grasping movement mediates attention guidance from WM content by enhancing representations of memory content that matches the distractor shape (i.e., circles), thus encouraging attentional capture by circle distractors of the memorized color. We conclude that templates for visual search, action planning, and WM compete for resources and thus cause interferences.

Linking perception and action by structure or process? Toward an integrative perspective

Over the past decades cognitive neuroscience's renewed interest in action has intensified the search of principles explaining how the cognitive system links perception to action and vice versa. To date, at least two seemingly alternative approaches can be distinguished. Perception and action might be linked either by common representational structures, as assumed by the ideomotor approach, or by common attentional processes, as assumed by the attention approach. This article first reviews the evidence from different paradigms supporting each approach. It becomes clear that most studies selectively focus either on actions directed at goals outside the actors' perceptual range (supporting the ideomotor approach) or on actions directed at targets within the actors' perceptual range (supporting the attention approach). In a second step, I will try to reconcile both approaches by reviewing recent eye movement studies that abolish the classical combination of approach and goals under study. Demonstrating that both approaches cover target- as well as goal-directed actions, it is proposed that operations addressed in both conceptual frameworks interact with each other.

The Influences of Goal and Laterality of a Prepared Hand Response on a Co-Occurring Visual Search

Computer use generally requires manual interaction with human-computer interfaces. In this experiment, we studied the influence of manual response preparation on co-occurring shifts of attention to information on a computer screen. The participants were to carry out a visual search task on a computer screen while simultaneously preparing to reach for either a proximal or distal switch on a horizontal device, with either their right or left hand. The response properties were not predictive of the target’s spatial position. The results mainly showed that the preparation of a manual response influenced visual search: (1) The visual target whose location was congruent with the goal of the prepared response was found faster; (2) the visual target whose location was congruent with the laterality of the response hand was found faster; (3) these effects have a cumulative influence on visual search performance; (4) the magnitude of the influence of the response goal on visual search is marginally negatively correlated with the rapidity of response execution. These results are discussed in the general framework of structural coupling between perception and motor planning.

How do you hold your mouse? Tracking the compatibility effect between hand posture and stimulus size

In keeping with the idea that observing objects activates possible motor responses, several experiments revealed compatibility effects between the hand postures used to report a choice and some characteristics of the stimuli. The real-time dynamics of such compatibility effects are currently unknown. We tracked the time course of a categorization experiment requiring subjects to categorize as natural or artifact figures of big and small objects. Participants reported their choice using either a big mouse (requiring a power grip: a hand posture compatible with the grasping of big objects) or a small mouse (requiring a precision grip: a hand posture compatible with the grasping of small objects). We found a compatibility effect between the grip required by the mouse and the grip elicited by objects, even if it was irrelevant to the task. In a following experiment with the same paradigm, lexical stimuli failed to reproduce the same effect. Nevertheless, a compatibility effect mediated by the target-word category (artificial vs. natural) was observed. We discuss the results in the context of affordance effects literature and grounded theories of cognition.

Moving time: the influence of action on duration perception

Perceiving the sensory consequences of action accurately is essential for appropriate interaction with our physical and social environments. Prediction mechanisms are considered necessary for fine-tuned sensory control of action, yet paradoxically may distort perception. Here, we examine this paradox by addressing how movement influences the perceived duration of sensory outcomes congruent with action. Experiment 1 required participants to make judgments about the duration of vibrations applied to a moving or stationary finger. In Experiments 2 and 3, participants judged observed finger movements that were congruent or incongruent with their own actions. In all experiments, target events were perceived to be longer when congruent with movement. Interestingly, this temporal dilation did not differ as a function of stimulus perspective (1st or 3rd person) or spatial location. We propose that this bias may reflect the operation of an adaptive mechanism for sensorimotor selection and control that preactivates anticipated outcomes of action. The bias itself may have surprising implications for both action control and perception of others: we may be in contact with grasped objects for less time than we realize, and others' reactions to us may be briefer than we believe.

How active perception and attractor dynamics shape perceptual categorization: a computational model

We propose a computational model of perceptual categorization that fuses elements of grounded and sensorimotor theories of cognition with dynamic models of decision-making. We assume that category information consists in anticipated patterns of agent-environment interactions that can be elicited through overt or covert (simulated) eye movements, object manipulation, etc. This information is firstly encoded when category information is acquired, and then re-enacted during perceptual categorization. The perceptual categorization consists in a dynamic competition between attractors that encode the sensorimotor patterns typical of each category; action prediction success counts as "evidence" for a given category and contributes to falling into the corresponding attractor. The evidence accumulation process is guided by an active perception loop, and the active exploration of objects (e.g., visual exploration) aims at eliciting expected sensorimotor patterns that count as evidence for the object category. We present a computational model incorporating these elements and describing action prediction, active perception, and attractor dynamics as key elements of perceptual categorizations. We test the model in three simulated perceptual categorization tasks, and we discuss its relevance for grounded and sensorimotor theories of cognition.

Action imitation changes perceptual alternations in binocular rivalry

Binocular rivalry is a visual phenomenon in which perception alternates between two different monocular images presented to each of the two eyes. Here, we propose using this phenomenon as a method to study the relation between action execution and action perception. In our experiment, a simple background (a checkerboard) was contrasted with a video representing a hand continuously grasping and releasing a ball. In Experiment 1, our subjects were asked to reproduce the perceived movement with their right hand whenever they became aware of it and to stop doing this when the checkerboard dominated. Our results revealed that motor imitation of the perceived action significantly increased the time spent perceiving the hand. Three control experiments showed that these effects were not due to a generic involvement of focused attention (Experiment 2 and 3), to a verbal description of the performed action (Experiment 3) or to the execution of an unrelated movement of the hand (Experiment 4). Although an intrinsic connection between action execution and attention cannot be excluded with certainty, and the boundary between action imitation and unrelated action execution may vary along various degrees of similarity, on the whole, the present results seem to suggest, at least on a preliminary basis, that action imitation do play a relevant role in the perception of action. We discuss these findings in the frame of current theories concerning the relation between perception and action.

Everyday robotic action: lessons from human action control

Robots are increasingly capable of performing everyday human activities such as cooking, cleaning, and doing the laundry. This requires the real-time planning and execution of complex, temporally extended sequential actions under high degrees of uncertainty, which provides many challenges to traditional approaches to robot action control. We argue that important lessons in this respect can be learned from research on human action control. We provide a brief overview of available psychological insights into this issue and focus on four principles that we think could be particularly beneficial for robot control: the integration of symbolic and subsymbolic planning of action sequences, the integration of feedforward and feedback control, the clustering of complex actions into subcomponents, and the contextualization of action-control structures through goal representations.

Motor resonance facilitates movement execution: an ERP and kinematic study

Action observation, simulation and execution share neural mechanisms that allow for a common motor representation. It is known that when these overlapping mechanisms are simultaneously activated by action observation and execution, motor performance is influenced by observation and vice versa. To understand the neural dynamics underlying this influence and to measure how variations in brain activity impact the precise kinematics of motor behavior, we coupled kinematics and electrophysiological recordings of participants while they performed and observed congruent or non-congruent actions or during action execution alone. We found that movement velocities and the trajectory deviations of the executed actions increased during the observation of congruent actions compared to the observation of non-congruent actions or action execution alone. This facilitation was also discernible in the motor-related potentials of the participants; the motor-related potentials were transiently more negative in the congruent condition around the onset of the executed movement, which occurred 300 ms after the onset of the observed movement. This facilitation seemed to depend not only on spatial congruency but also on the optimal temporal relationship of the observation and execution events.

Attentional resource allocation during a cued saccade task

Attentional selection of sensory information and motor output is critical for successful interaction with one's surroundings. However, organization of attentional processes involved in selection of salient visual information, decision making, and movement planning has not yet been fully elucidated. We hypothesized that attentional processes involved in these tasks can function independently and draw from separate resources. If true, challenging the capacity limit of one attentional process would not affect performance of others. Healthy participants performed a cued saccade task in which target cues were embedded in a central stream of letters in a Rapid Serial Visual Presentation (RSVP). Participants performed saccades as quickly and as accurately as possible to a peripheral target location based on cue presentation within the central letter stream. To challenge visual attention, we parametrically varied the duration at which each letter of the RSVP was presented (50-200ms). In a separate experiment we challenged motor attention by increasing the number of possible saccade trajectories (1-6 peripheral targets). As expected, increasing attentional load in one domain of the task negatively affected performance in that domain, while performance in other domains was unaffected. We interpret our results as support for the independent allocation of attentional resources, at least in the early stages of processing, required across components of a cued saccade task. Deciphering the contributions of attention during visuomotor tasks is a critical step to understanding how humans process information necessary to successfully interact with the environment.

TMS of the anterior intraparietal area selectively modulates orientation change detection during action preparation

Perception of relevant visual object features can be modulated by the preparation of an action toward it (“action-modulated perception”). For instance, the perception of the orientation of a book can be enhanced when preparing to grasp it (but not when pointing to it). However, the underlying neuronal mechanisms are poorly understood. We argue that brain areas controlling arm movements are involved in establishing this effect through top-down feedback to early visual areas, similar to the neuronal mechanisms linking visual attention and eye movements. To investigate this involvement, we applied transcranial magnetic stimulation to a grasping motor area, the left anterior intraparietal sulcus (aIPS), during grasping or pointing preparation. Concurrently, an orientation change detection task was performed. As a control area, the vertex was stimulated. We found that stimulation of aIPS selectively modulates orientation sensitivity during action preparation compared with control stimulation (vertex), negating the increased orientation sensitivity with grasping preparation over pointing preparation. We argue that aIPS is a critical part of the mechanism underlying perceptual modulations during action preparation. The present results and recent literature suggest that this action-modulated perception for hand movements is implemented through a cortical feedback connection between aIPS and early visual areas.

How Task Goals Mediate the Interplay between Perception and Action

Theories of embodied cognition suppose that perception, action, and cognition are tightly intertwined and share common representations and processes. Indeed, numerous empirical studies demonstrate interaction between stimulus perception, response planning, and response execution. In this paper, we present an experiment and a connectionist model that show how the Simon effect, a canonical example of perception–action congruency, can be moderated by the (cognitive representation of the) task instruction. To date, no representational account of this influence exists. In the experiment, a two-dimensional Simon task was used, with critical stimuli being colored arrows pointing in one of four directions (backward, forward, left, or right). Participants stood on a Wii balance board, oriented diagonally toward the screen displaying the stimuli. They were either instructed to imagine standing on a snowboard or on a pair of skis and to respond to the stimulus color by leaning toward either the left or right foot. We expected that participants in the snowboard condition would encode these movements as forward or backward, resulting in a Simon effect on this dimension. This was confirmed by the results. The left–right congruency effect was larger in the ski condition, whereas the forward–backward congruency effect appeared only in the snowboard condition. The results can be readily accounted for by HiTEC, a connectionist model that aims at capturing the interaction between perception and action at the level of representations, and the way this interaction is mediated by cognitive control. Together, the empirical work and the connectionist model contribute to a better understanding of the complex interaction between perception, cognition, and action.

Intentional weighting: a basic principle in cognitive control

Human perception and action are tailored to the situation at hand, and thus reflect the current intentions of the perceiver/actor. We suggest that this is achieved by an "intentional-weighting" mechanism. It operates on the cognitive representations of the features of perceived events and produced event--perceptions and actions that is. Intention- or goal-related feature dimensions are weighted more strongly, so that feature values defined on the respective dimension have a stronger impact on information processing, and stimulus and response selection in particular. This article discusses what intentional weighting is, how such a mechanism may work, and how it relates to available research on attention, action planning, and executive control.

Where's the action? The pragmatic turn in cognitive science

In cognitive science, we are currently witnessing a 'pragmatic turn', away from the traditional representation-centered framework towards a paradigm that focuses on understanding cognition as 'enactive', as skillful activity that involves ongoing interaction with the external world. The key premise of this view is that cognition should not be understood as providing models of the world, but as subserving action and being grounded in sensorimotor coupling. Accordingly, cognitive processes and their underlying neural activity patterns should be studied primarily with respect to their role in action generation. We suggest that such an action-oriented paradigm is not only conceptually viable, but already supported by much experimental evidence. Numerous findings either overtly demonstrate the action-relatedness of cognition or can be re-interpreted in this new framework. We argue that new vistas on the functional relevance and the presumed 'representational' nature of neural processes are likely to emerge from this paradigm.

Motivation modulates visual attention: evidence from pupillometry

Increasing evidence suggests that action planning does not only affect the preparation and execution of overt actions but also "works back" to tune the perceptual system toward action-relevant information. We investigated whether the amount of this impact of action planning on perceptual selection varies as a function of motivation for action, which was assessed online by means of pupillometry (Experiment 1) and visual analog scales (VAS, Experiment 2). Findings replicate the earlier observation that searching for size-defined targets is more efficient in the context of grasping than in the context of pointing movements (Wykowska et al., 2009). As expected, changes in tonic pupil size (reflecting changes in effort and motivation) across the sessions, as well as changes in motivation-related scores on the VAS were found to correlate with changes in the size of the action-perception congruency effect. We conclude that motivation and effort might play a crucial role in how much participants prepare for an action and activate action codes. The degree of activation of action codes in turn influences the observed action-related biases on perception.

Investigating ideomotor cognition with motorvisual priming paradigms: key findings, methodological challenges, and future directions

Ideomotor theory claims that perceptual representations of action-effects are functionally involved in the planning of actions. Strong evidence for this claim comes from a phenomenon called motorvisual priming. Motorvisual priming refers to the finding that action planning directly affects perception, and that the effects are selective for stimuli that share features with the planned action. Motorvisual priming studies have provided detailed insights into the processing of perceptual representations in action planning. One important finding is that such representations in action planning have a categorical format, whereas metric representations are not anticipated in planning. Further essential findings regard the processing mechanisms and the time course of ideomotor cognition. Perceptual representations of action-effects are first activated by action planning and then bound into a compound representation of the action plan. This compound representation is stabilized throughout the course of the action by the shielding of all involved representations from other cognitive processes. Despite a rapid growth in the number of motorvisual priming studies in the current literature, there are still many aspects of ideomotor cognition which have not yet been investigated. These aspects include the scope of ideomotor processing with regard to action types and stimulus types, as well as the exact nature of the binding and shielding mechanisms involved.

Too Good to be True? Ideomotor Theory from a Computational Perspective

In recent years, Ideomotor Theory has regained widespread attention and sparked the development of a number of theories on goal-directed behavior and learning. However, there are two issues with previous studies' use of Ideomotor Theory. Although Ideomotor Theory is seen as very general, it is often studied in settings that are considerably more simplistic than most natural situations. Moreover, Ideomotor Theory's claim that effect anticipations directly trigger actions and that action-effect learning is based on the formation of direct action-effect associations is hard to address empirically. We address these points from a computational perspective. A simple computational model of Ideomotor Theory was tested in tasks with different degrees of complexity. The model evaluation showed that Ideomotor Theory is a computationally feasible approach for understanding efficient action-effect learning for goal-directed behavior if the following preconditions are met: (1) The range of potential actions and effects has to be restricted. (2) Effects have to follow actions within a short time window. (3) Actions have to be simple and may not require sequencing. The first two preconditions also limit human performance and thus support Ideomotor Theory. The last precondition can be circumvented by extending the model with more complex, indirect action generation processes. In conclusion, we suggest that Ideomotor Theory offers a comprehensive framework to understand action-effect learning. However, we also suggest that additional processes may mediate the conversion of effect anticipations into actions in many situations.

Stimulus-response correspondence across peripersonal space is unaffected by chronic unilateral limb loss

Previous findings show an advantage in response speed when stimulus and response correspond spatially (i.e., the Simon effect). Chronic unilateral amputees show altered spatial perception near their affected hand, providing an opportunity to investigate whether experience also affects the visuomotor stimulus-response (S-R) mapping that underlies the Simon effect. We used a two-alternative, forced-choice paradigm to probe the spatial correspondence between visual cues and responses, in 14 unilateral upper limb amputees and 14 matched controls. We presented visual stimuli in 5 different locations within peripersonal space, including the midline, and found a smooth gradient of S-R correspondence effects. This is consistent with the hypothesis that S-R correspondence is represented along a spatial gradient. Unilateral amputees performed indistinguishably from matched controls, regardless of whether stimuli appeared in the hemispace ipsi- or contralateral to their missing limbs. This is inconsistent with the hypothesis that experience-dependent visual distortions entail changes in the S-R mapping; alternatively, it could reflect a complete experience independence of the Simon effect. We propose that the affordance competition hypothesis (Cisek in Philos Trans R Soc B Biol Sci 362:1585-1599, 2007) explains the Simon effect and the underlying gradient of S-R correspondence.

Imaging when acting: picture but not word cues induce action-related biases of visual attention

In line with the Theory of Event Coding (Hommel et al., 2001a), action planning has been shown to affect perceptual processing – an effect that has been attributed to a so-called intentional weighting mechanism (Wykowska et al., 2009; Memelink and Hommel, 2012), whose functional role is to provide information for open parameters of online action adjustment (Hommel, 2010). The aim of this study was to test whether different types of action representations induce intentional weighting to various degrees. To meet this aim, we introduced a paradigm in which participants performed a visual search task while preparing to grasp or to point. The to-be performed movement was signaled either by a picture of a required action or a word cue. We reasoned that picture cues might trigger a more concrete action representation that would be more likely to activate the intentional weighting of perceptual dimensions that provide information for online action control. In contrast, word cues were expected to trigger a more abstract action representation that would be less likely to induce intentional weighting. In two experiments, preparing for an action facilitated the processing of targets in an unrelated search task if they differed from distractors on a dimension that provided information for online action control. As predicted, however, this effect was observed only if action preparation was signaled by picture cues but not if it was signaled by word cues. We conclude that picture cues are more efficient than word cues in activating the intentional weighting of perceptual dimensions, presumably by specifying not only invariant characteristics of the planned action but also the dimensions of action-specific parameters.

Beyond feature binding: interference from episodic context binding creates the bivalency effect in task-switching

When switching between different tasks and bivalent stimuli occur only occasionally on one of them, performance is slowed on subsequent univalent trials even if they have no overlapping features with the bivalent stimulus. This phenomenon has been labeled the "bivalency effect." Recent evidence has revealed that this effect is robust, general, and enduring. Moreover, it challenges current theories of task-switching and cognitive control. Here, we review these theories and propose a new, episodic context binding account. According to this account, binding does not only occur between stimuli, responses, and tasks, but also for the more general context in which the stimuli occur. The result of this binding process is a complex representation that includes each of these components. When bivalent stimuli occur, the resulting conflict is associated with the general context, creating a new conflict-loaded representation. The reactivation of this representation causes interference on subsequent trials, that is, the bivalency effect. We evaluate this account in light of the empirical evidence.

Action intentions modulate allocation of visual attention: electrophysiological evidence

In line with the Theory of Event Coding (Hommel et al., 2001), action planning has been shown to affect perceptual processing – an effect that has been attributed to a so-called intentional weighting mechanism (Wykowska et al., 2009; Hommel, 2010). This paper investigates the electrophysiological correlates of action-related modulations of selection mechanisms in visual perception. A paradigm combining a visual search task for size and luminance targets with a movement task (grasping or pointing) was introduced, and the EEG was recorded while participants were performing the tasks. The results showed that the behavioral congruency effects, i.e., better performance in congruent (relative to incongruent) action-perception trials have been reflected by a modulation of the P1 component as well as the N2pc (an ERP marker of spatial attention). These results support the argumentation that action planning modulates already early perceptual processing and attention mechanisms.

Sensory-based mechanism for delayed motor intention

Prospective motor learning (PML) can be defined as learning an action to be performed in the future. The privileged retrieval mechanism behind this delayed motor performance remains unknown. From a motor control and learning perspective, we may conceive of two forms of retrieval: a stimulus- and an intention-based control. Retrieval from intention-based control is based on the anticipation of intended sensory effects related to an action in order to select and control the appropriate motor procedure (i.e., the ideomotor mechanism). In contrast, in a stimulus-based control a connection between stimuli-features and their related action-features is stored in the memory and serves as the retrieval mechanism. In this view, action retrieval from external stimuli is based on the detection of events in the environment to perform the intended behaviour (i.e., the sensorimotor mechanism). In this study, we report an advantage in the action retrieval for participants who use an intention-based mode of control in comparison to a stimulus-based control. Furthermore, a control task reveals that the intention-based advantage is specific to PML. Our findings show that PML is benefited by mental anticipation of a sensory effect that is efficiently processed through an ideomotor mechanism to fulfil delayed motor intentions.

When planning results in loss of control: intention-based reflexivity and working-memory

In this review, the authors discuss the seemingly paradoxical loss of control associated with states of high readiness to execute a plan, termed "intention-based reflexivity." The review suggests that the neuro-cognitive systems involved in the preparation of novel plans are different than those involved in preparation of practiced plans (i.e., those that have been executed beforehand). When the plans are practiced, intention-based reflexivity depends on the prior availability of response codes in long-term memory (LTM). When the plans are novel, reflexivity is observed when the plan is pending and the goal has not yet been achieved. Intention-based reflexivity also depends on the availability of working-memory (WM) limited resources and the motivation to prepare. Reflexivity is probably related to the fact that, unlike reactive control (once a plan is prepared), proactive control tends to be relatively rigid.

The role of cue-response mapping in motorvisual impairment and facilitation: evidence for different roles of action planning and action control in motorvisual dual-task priming

Previous research has shown that actions impair the visual perception of categorically action-consistent stimuli. On the other hand, actions can also facilitate the perception of spatially action-consistent stimuli. We suggest that motorvisual impairment is due to action planning processes, while motorvisual facilitation is due to action control mechanisms. This implies that because action planning is sensitive to modulations by cue-response mapping so should motorvisual impairment, while motorvisual facilitation should be insensitive to manipulations of cue-response mapping as is action control. We tested this prediction in three dual-task experiments. The impact of performing left and right key presses on the perception of unrelated, categorically or spatially consistent, stimuli was studied. As expected, we found motorvisual impairment for categorically consistent stimuli and motorvisual facilitation for spatially consistent stimuli. In all experiments, we compared congruent with incongruent cue-key mappings. Mapping manipulations affected motorvisual impairment, but not motorvisual facilitation. The results support our suggestion that motorvisual impairment is due to action planning, and motorvisual facilitation to action control.

The planning and control model (PCM) of motorvisual priming: reconciling motorvisual impairment and facilitation effects

Previous research on dual-tasks has shown that, under some circumstances, actions impair the perception of action-consistent stimuli, whereas, under other conditions, actions facilitate the perception of action-consistent stimuli. We propose a new model to reconcile these contrasting findings. The planning and control model (PCM) of motorvisual priming proposes that action planning binds categorical representations of action features so that their availability for perceptual processing is inhibited. Thus, the perception of categorically action-consistent stimuli is impaired during action planning. Movement control processes, on the other hand, integrate multi-sensory spatial information about the movement and, therefore, facilitate perceptual processing of spatially movement-consistent stimuli. We show that the PCM is consistent with a wider range of empirical data than previous models on motorvisual priming. Furthermore, the model yields previously untested empirical predictions. We also discuss how the PCM relates to motorvisual research paradigms other than dual-tasks.

Acting alters visual processing: flexible recruitment of visual areas by one's own actions

Using functional magnetic resonance imaging, we investigated the effect of motor preparation/execution on the activation of visual cortical areas by action observation. We presented videos of human actors performing several fine manipulative actions (e.g., grasping) with the hand or foot, together with appropriate control stimuli. Subjects either responded in a central fixation task with the hand (A) or foot (B) or viewed the stimuli passively (C). Experimental conditions were arranged according to a 2 × 2 × 3 factorial design with action, effector, and response as factors. Bilateral posterior parietal cortex was more strongly activated for action videos compared with controls during active runs (A or B) contrasted with passive runs (C). Two neighboring regions in the right fusiform gyrus (FG) were activated when the effector employed to respond in the task matched that displayed in the videos (A or B), independently of whether the stimulus was an action or a control. Neighboring regions in the right posterior middle temporal gyrus (MTG) were also activated when the effector observed and that used to respond matched (A or B), but only for action videos, not controls. Our results indicate flexible modulation of visual areas during concurrent action observation and action execution/preparation, which was effector specific in the FG and MTG.

Network asymmetry of motor areas revealed by resting-state functional magnetic resonance imaging

There are ample functional magnetic resonance imaging (fMRI) studies on functional brain asymmetries, and the asymmetry of cerebral network in the resting state may be crucial to brain function organization. In this paper, a unified schema of voxel-wise functional connectivity and asymmetry analysis was presented and the network asymmetry of motor areas was studied. Twelve healthy male subjects with mean age 29.8 ± 6.4 were studied. Functional network in the resting state was described by using functional connectivity magnetic resonance imaging (fcMRI) analysis. Motor areas were selected as regions of interest (ROIs). Network asymmetry, including intra- and inter-network asymmetries, was formulated and analyzed. The intra-network asymmetry was defined as the difference between the left and right part of a particular functional network. The inter-network asymmetry was defined as the difference between the networks for a specific ROI in the left hemisphere and its homotopic ROI in the right hemisphere. Primary motor area (M1), primary sensory area (S1) and premotor area (PMA) exhibited higher functional correlation with the right parietal-temporal-occipital circuit and the middle frontal gyrus than they did with the left hemisphere. Right S1 and right PMA exhibited higher functional correlation with the ipsilateral precentral and supramarginal areas. There exist the large-scale hierarchical network asymmetries of the motor areas in the resting state. These asymmetries imply the right hemisphere dominance for predictive motor coding based on spatial attention and higher sensory processing load for the motor performance of non-dominant hemisphere.

Active inference, attention, and motor preparation

Perception is the foundation of cognition and is fundamental to our beliefs and consequent action planning. The Editorial (this issue) asks: "what mechanisms, if any, mediate between perceptual and cognitive processes?" It has recently been argued that attention might furnish such a mechanism. In this paper, we pursue the idea that action planning (motor preparation) is an attentional phenomenon directed toward kinesthetic signals. This rests on a view of motor control as active inference, where predictions of proprioceptive signals are fulfilled by peripheral motor reflexes. If valid, active inference suggests that attention should not be limited to the optimal biasing of perceptual signals in the exteroceptive (e.g., visual) domain but should also bias proprioceptive signals during movement. Here, we investigate this idea using a classical attention (Posner) paradigm cast in a motor setting. Specially, we looked for decreases in reaction times when movements were preceded by valid relative to invalid cues. Furthermore, we addressed the hierarchical level at which putative attentional effects were expressed by independently cueing the nature of the movement and the hand used to execute it. We found a significant interaction between the validity of movement and effector cues on reaction times. This suggests that attentional bias might be mediated at a low level in the motor hierarchy, in an intrinsic frame of reference. This finding is consistent with attentional enabling of top-down predictions of proprioceptive input and may rely upon the same synaptic mechanisms that mediate directed spatial attention in the visual system.

Action-induced effects on perception depend neither on element-level nor on set-level similarity between stimulus and response sets

As was shown by Wykowska, Schubö, and Hommel (Journal of Experimental Psychology, Human Perception and Performance, 35, 1755-1769, 2009), action control can affect rather early perceptual processes in visual search: Although size pop-outs are detected faster when having prepared for a manual grasping action, luminance pop-outs benefit from preparing for a pointing action. In the present study, we demonstrate that this effect of action-target congruency does not rely on, or vary with, set-level similarity or element-level similarity between perception and action-two factors that play crucial roles in standard stimulus-response interactions and in models accounting for these interactions. This result suggests that action control biases perceptual processes in specific ways that go beyond standard stimulus-response compatibility effects and supports the idea that action-target congruency taps into a fundamental characteristic of human action control.

The relationship between attentional capture and deviations in movement trajectories in a selective reaching task

According to action-centered models of attention, attention and action systems are tightly linked such that the capture of attention by an object automatically initiates response-producing processes. In support of this link, studies have shown that movements deviate towards or away from non-target stimuli. These deviations are thought to emerge because attentional capture by non-target stimuli generates responses that summate with target responses to develop a combined movement vector. The present study tested attention-action coupling by examining movement trajectories in the presence of non-target stimuli that do or do not capture attention. Previous research has revealed that non-target cue stimuli only capture attention when they share critical features with the target. Cues that do not share this feature do not capture attention. Following these studies and their findings, participants in the present study aimed to the location of a single white square (onset singleton target) or a single red square presented with two white squares (color singleton target). In separate blocks, targets were preceded by non-predictive cues that did or did not share the target feature (color or onset singleton cues). The critical finding of the present study was that trajectory effects mirrored the temporal interference effects in that deviations were only observed when cue and target properties matched. Deviations were not observed when the cue and target properties did not match. These data provide clear support for the link between attentional capture and the activation of response-producing processes.

A computational model of perception and action for cognitive robotics

Robots are increasingly expected to perform tasks in complex environments. To this end, engineers provide them with processing architectures that are based on models of human information processing. In contrast to traditional models, where information processing is typically set up in stages (i.e., from perception to cognition to action), it is increasingly acknowledged by psychologists and robot engineers that perception and action are parts of an interactive and integrated process. In this paper, we present HiTEC, a novel computational (cognitive) model that allows for direct interaction between perception and action as well as for cognitive control, demonstrated by task-related attentional influences. Simulation results show that key behavioral studies can be readily replicated. Three processing aspects of HiTEC are stressed for their importance for cognitive robotics: (1) ideomotor learning of action control, (2) the influence of task context and attention on perception, action planning, and learning, and (3) the interaction between perception and action planning. Implications for the design of cognitive robotics are discussed.

Grasping preparation enhances orientation change detection

Preparing a goal directed movement often requires detailed analysis of our environment. When picking up an object, its orientation, size and relative distance are relevant parameters when preparing a successful grasp. It would therefore be beneficial if the motor system is able to influence early perception such that information processing needs for action control are met at the earliest possible stage. However, only a few studies reported (indirect) evidence for action-induced visual perception improvements. We therefore aimed to provide direct evidence for a feature-specific perceptual modulation during the planning phase of a grasping action. Human subjects were instructed to either grasp or point to a bar while simultaneously performing an orientation discrimination task. The bar could slightly change its orientation during grasping preparation. By analyzing discrimination response probabilities, we found increased perceptual sensitivity to orientation changes when subjects were instructed to grasp the bar, rather than point to it. As a control experiment, the same experiment was repeated using bar luminance changes, a feature that is not relevant for either grasping or pointing. Here, no differences in visual sensitivity between grasping and pointing were found. The present results constitute first direct evidence for increased perceptual sensitivity to a visual feature that is relevant for a certain skeletomotor act during the movement preparation phase. We speculate that such action-induced perception improvements are controlled by neuronal feedback mechanisms from cortical motor planning areas to early visual cortex, similar to what was recently established for spatial perception improvements shortly before eye movements.

The bivalency effect: adjustment of cognitive control without response set priming

The occasional occurrence of bivalent stimuli, that is, stimuli with features relevant to two tasks, slows performance on subsequent tasks with univalent stimuli, including those which have no common features with bivalent stimuli (i.e., the "bivalency effect"). We have suggested that the bivalency effect might stem from an episodic context binding arising from the occasional occurrence of bivalent stimuli. However, as the same response set is used usually for univalent and bivalent stimuli, bivalent stimulus features may be negatively primed via response features. We investigated this possibility in two experiments, in which one group of participants used the same response keys for all tasks and another group used separate response keys. The results showed a comparable bivalency effect in both groups. Thus, it rather results from episodic context binding than from response set priming.

Integration of visual and auditory information for hand actions: preliminary evidence for the contribution of natural sounds to grasping

When we reach out to grasp objects, vision plays a major role in the control of our movements. Nevertheless, other sensory modalities contribute to the fine-tuning of our actions. Even olfaction has been shown to play a role in the scaling of movements directed at objects. Much less is known about how auditory information might be used to program grasping movements. The aim of our study was to investigate how the sound of a target object affects the planning of grasping movements in normal right-handed subjects. We performed an experiment in which auditory information could be used to infer size of targets when the availability of visual information was varied from trial to trial. Classical kinematic parameters (such as grip aperture) were measured to evaluate the influence of auditory information. In addition, an optimal inference modeling was applied to the data. The scaling of grip aperture indicated that the introduction of sound allowed subjects to infer the size of the object when vision was not available. Moreover, auditory information affected grip aperture even when vision was available. Our findings suggest that the differences in the natural impact sounds of objects of different sizes being placed on a surface can be used to plan grasping movements.

The Simon effect as tool and heuristic

On its 43rd anniversary the Simon effect can look back at a long and varied history. First treated as a curious observation with implications for human factors research, it slowly evolved not only into a valuable target of psychological theorizing itself but also into a handy means to investigate attentional operations, the representation of space and of one's body, the cognitive representation of intentional action, and executive control. This article discusses the major characteristics of the Simon effect and the Simon task that laid the ground for this success and reviews the major lines of research, theoretical developments, and ongoing controversies on and around the Simon Effect and the cognitive processes it reflects.