Grasping objects by their handles: a necessary interaction between cognition and action

Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions

Everyday interactions with common manipulable objects require the integration of conceptual knowledge about objects and actions with real-time sensory information about the position, orientation and volumetric structure of the grasp target. The ability to successfully interact with everyday objects involves analysis of visual form and shape, surface texture, material properties, conceptual attributes such as identity, function and typical context, and visuomotor processing supporting hand transport, grasp form, and object manipulation. Functionally separable brain regions across the dorsal and ventral visual pathways support the processing of these different object properties and, in cohort, are necessary for functional object use. Object-directed grasps display end-state-comfort: they anticipate in form and force the shape and material properties of the grasp target, and how the object will be manipulated after it is grasped. End-state-comfort is the default for everyday interactions with manipulable objects and implies integration of information across the ventral and dorsal visual pathways. We propose a model of how visuomotor and action representations in parietal cortex interact with object representations in ventral and lateral occipito-temporal cortex. One pathway, from the supramarginal gyrus to the middle and inferior temporal gyrus, supports the integration of action-related information, including hand and limb position (supramarginal gyrus) with conceptual attributes and an appreciation of the action goal (middle temporal gyrus). A second pathway, from posterior IPS to the fusiform gyrus and collateral sulcus supports the integration of grasp parameters (IPS) with the surface texture and material properties (e.g., weight distribution) of the grasp target. Reciprocal interactions among these regions are part of a broader network of regions that support everyday functional object interactions.

Incompatibility Influences Cursor Placement When Pointing to Images of Cups

OBJECTIVE

As images are used within graphical user interfaces to signify menu selection, it is important to understand how image properties can influence cursor placement online.

BACKGROUND

Objects have multiple dimensions that create potential ambiguity and Stroop-like confusions for the operator if a previously habitual response conflicts with the required response.

METHODS

To examine the impact of compatibility and other contextual factors, 41 participants used a computer Mouse or touch screen to place the cursor upon images of full or empty cups that varied in size, and direction of handle.

RESULTS

Cursor placements took longer using the Mouse than touch screen. Although participants were placing the cursor on images, the size of the cup, whether it was empty or full, and the handle orientation interacted in their effects upon response duration and cursor placement. The effects of cup size reversed for empty cups or those with incompatible handles.

CONCLUSION

Context can influence cursor placement. Perceived spillability influenced precision requirements, and the cup handle can serve as target or a flanking distractor.

APPLICATION

Image content can influence screen hotspots. As performance can change with cup spillability, this bodes well for attempts to detect intent from cursor trajectories.

Grip selection without tool knowledge: end-state comfort effect in familiar and novel tool use

A well-known phenomenon for the study of movement planning is the end-state comfort (ESC) effect: When they reach and grasp tools, individuals tend to adopt uncomfortable initial hand postures if that allows a subsequent comfortable final posture. In the context of tool use, this effect is modulated by tool orientation, task goal, and cooperation. However, the cognitive bases of the ESC effect remain unclear. The goal of this study was to determine the contribution of semantic tool knowledge and technical reasoning to movement planning, by testing whether the ESC effect typically observed with familiar tools would also be observed with novel tools. Twenty-six participants were asked to reach and grasp familiar and novel tools under varying conditions (i.e., tool's handle downward vs. upward; tool transport vs. use; solo vs. cooperation). In our findings, the effects of tool orientation, task goal and cooperation were replicated with novel tools. It follows that semantic tool knowledge is not critical for the ESC effect to occur. In fact, we found an "habitual" effect: Participant adopted uncomfortable grips with familiar tools even when it was not necessary (i.e., to transport them), probably because of the interference of habitual movement programming with actual movement programming. A cognitive view of movement planning is proposed, according to which goal comprehension (1) may rely on semantic tool knowledge, technical reasoning, and/or social skills, (2) defines end-state configuration, which in turn (3) calibrates beginning-state comfort and hence the occurrence of the ESC effect.

Right Fusiform Gray Matter Volume in Children with Long-Term Abacus Training Positively Correlates with Arithmetic Ability

Abacus-based mental calculation (AMC) training has a positive effect on number-related cognitive abilities. While visuospatial strategy may distinguish AMC from conventional calculation method, the underlying neural mechanism is still elusive. The current study aimed to address this question by examining the plasticity of fusiform induced by AMC training and whether this training affects the association between the volume of fusiform and behavioral performance in numerical cognitive tasks using voxel-based morphometry analysis. The results showed that gray matter volumes of bilateral fusiform were significantly smaller in the AMC group relative to the control group. In addition, the volume of right fusiform was positively correlated with digit memory span and negatively correlated with reaction time of an arithmetic operation task only within the AMC group. These results indicate that bilateral fusiform may be the essential neural substrate for AMC experts to recognize and reconstruct abacus-based representations for numbers. These results may advance our understanding of the neural mechanisms of AMC and shield some lights to potential interactions between brain development and cognitive training in children.

Selective effects of psychosocial stress on plan based movement selection

Efficient movement selection is crucial in everyday activities. Whether this function is governed by our stress system is so far unknown. In the current study, data from thirty-six young male adults were analyzed. They performed rule- and plan-based movement selection tasks before (session 1) and after (session 2) a psychosocial stressor, or after a control condition without additional social stressor. Results showed that the rule-based efficiency advantage which was observed prior to the psychosocial stressor was significantly reduced afterwards in the whole sample, as well as in the stress group. Regression analyses revealed that this effect was due to a modulation of the plan-based approach. Especially variations-both increase and decrease-in the parasympathetic activity (reflected by the heart rate variability measure RMSSD) appeared to be disadvantageous for plan-based movement selection improvement. In contrast, performance in the rule-based movement selection tasks appeared to be rather invariant to external influences. The current results suggest that autonomic nervous system activity might modulate motor-cognitive performance. This modulatory capability might be selective for plan-based approaches, hence the applied strategy to movement selection could be decisive when it comes to the vulnerability of motor-cognitive processes towards psychosocial stress.

Perceived depth modulates perceptual resolution

Humans constantly use depth information to support perceptual decisions about object size and location in space, as well as planning and executing actions. It was recently reported that perceived depth modulates perceptual performance even when depth information is not relevant to the task, with faster shape discrimination for objects perceived as being close to the observer. However, it is yet to be determined if the observed "close advantage" reflects differences in psychophysical sensitivity or response bias. Moreover, it is unclear whether this advantage is generalizable to other viewing situations and tasks. To address these outstanding issues, we evaluated whether visual resolution is modulated by perceived depth defined by 2D pictorial cues. In a series of experiments, we used the method of constant stimuli to measure the precision of perceptual judgements for stimuli positioned at close, far, and flat perceived distances. In Experiment 1, we found that size discrimination was more precise when the object was perceived to be closer to the observers. Experiments 2a and 2b extended this finding to a visual property orthogonal to depth information, by showing superior orientation discrimination for "close" objects. Finally, Experiment 3 demonstrated that the close advantage also occurs when performing high-level perceptual tasks such as face perception. Taken together, our results provide novel evidence that the perceived depth of an object, as defined by pictorial cues, modulates the precision of visual processing for close objects.

The relevance of signal timing in human-robot collaborative manipulation

To achieve a seamless human-robot collaboration, it is crucial that robots express their intentions without perturbating or interrupting the task that a human partner is performing at that moment. Although it has not received much attention so far, this issue is important when robots assist humans in physical and manipulation tasks. The main question addressed here is whether there is a more appropriate time to inform a human partner that a robot is requesting to pass them an object. This question is posed in a reference scenario where human individuals are involved in a continuous pick-and-place task that cannot be interrupted. Our findings showed that providing a cue at the beginning of a reach-to-grasp movement could severely interfere with the ongoing human action, increasing the number of errors made by humans, slowing down and degrading the smoothness of their arm movement, and deflecting their gaze. These disruptive interferences strongly decreased, until they disappeared, when the robot provided the cue to the human partners shortly after the participants picked up an object, identifying this as the best signaling timing. The results of this work showed how the signaling timing may have a decisive influence on the performances of the human-robot teamwork and contribute to understanding the mechanisms underpinning the phenomenon of cognitive-motor interference in humans.

Effects of visual blur and contrast on spatial and temporal precision in manual interception

The visual system is said to be especially sensitive towards spatial but lesser so towards temporal information. To test this, in two experiments, we systematically reduced the acuity and contrast of a visual stimulus and examined the impact on spatial and temporal precision (and accuracy) in a manual interception task. In Experiment 1, we blurred a virtual, to-be-intercepted moving circle (ball). Participants were asked to indicate (i.e., finger tap) on a touchscreen where and when the virtual ball crossed a ground line. As a measure of spatial and temporal accuracy and precision, we analyzed the constant and variable errors, respectively. With increasing blur, the spatial and temporal variable error, as well as the spatial constant error increased, while the temporal constant error decreased. Because in the first experiment, blur was potentially confounded with contrast, in Experiment 2, we re-ran the experiment with one difference: instead of blur, we included five levels of contrast matched to the blur levels. We found no systematic effects of contrast. Our findings confirm that blurring vision decreases spatial precision and accuracy and that the effects were not mediated by concomitant changes in contrast. However, blurring vision also affected temporal precision and accuracy, thereby questioning the generalizability of the theoretical predictions to the applied interception task.

Review: Sport Performance and the Two-visual-system Hypothesis of Vision: Two Pathways but Still Many Questions

SIGNIFICANCE

The two-visual-system hypothesis (TVSH) provides a framework for understanding the nature of the visual information athletes are likely to rely on during competition. If valid, the framework provides a valuable means of evaluating the likely efficacy of different vision training tools that claim to improve the sport performance of athletes.The TVSH has been used to explain that many of the existing methods of testing and training vision may be ineffective to improve on-field sport performance. The TVSH suggests that the visual pathway used to control actions on-field may be different-and rely on different visual information-to the pathway often tested and trained off-field. However, the central claims of the TVSH are increasingly questioned, and this has implications for our understanding of vision and sport performance. The aim of this article is to outline the implications of the TVSH for the visual control of actions in sport. We first provide a summary of the TVSH and outline how the visual information used to control actions might differ from that usually tested. Second, we look at the evidence from studies of sports that are (and are not) consistent with the TVSH and the implications they have for training vision. Finally, we take a wider look at the impact of the TVSH on the sport sciences and other complementary theories that hold implications for training vision to improve sport performance.

The Role of Haptic Expectations in Reaching to Grasp: From Pantomime to Natural Grasps and Back Again

When we reach to pick up an object, our actions are effortlessly informed by the object's spatial information, the position of our limbs, stored knowledge of the object's material properties, and what we want to do with the object. A substantial body of evidence suggests that grasps are under the control of "automatic, unconscious" sensorimotor modules housed in the "dorsal stream" of the posterior parietal cortex. Visual online feedback has a strong effect on the hand's in-flight grasp aperture. Previous work of ours exploited this effect to show that grasps are refractory to cued expectations for visual feedback. Nonetheless, when we reach out to pretend to grasp an object (pantomime grasp), our actions are performed with greater cognitive effort and they engage structures outside of the dorsal stream, including the ventral stream. Here we ask whether our previous finding would extend to cued expectations for haptic feedback. Our method involved a mirror apparatus that allowed participants to see a "virtual" target cylinder as a reflection in the mirror at the start of all trials. On "haptic feedback" trials, participants reached behind the mirror to grasp a size-matched cylinder, spatially coincident with the virtual one. On "no-haptic feedback" trials, participants reached behind the mirror and grasped into "thin air" because no cylinder was present. To manipulate haptic expectation, we organized the haptic conditions into blocked, alternating, and randomized schedules with and without verbal cues about the availability of haptic feedback. Replicating earlier work, we found the strongest haptic effects with the blocked schedules and the weakest effects in the randomized uncued schedule. Crucially, the haptic effects in the cued randomized schedule was intermediate. An analysis of the influence of the upcoming and immediately preceding haptic feedback condition in the cued and uncued random schedules showed that cuing the upcoming haptic condition shifted the haptic influence on grip aperture from the immediately preceding trial to the upcoming trial. These findings indicate that, unlike cues to the availability of visual feedback, participants take advantage of cues to the availability of haptic feedback, flexibly engaging pantomime, and natural modes of grasping to optimize the movement.

Haptic and Auditory-Haptic Attentional Blink in Spatial and Object-Based Tasks

Dual-task performance depends on both modalities (e.g., vision, audition, haptics) and task types (spatial or object-based), and the order by which different task types are organized. Previous studies on haptic and especially auditory-haptic attentional blink (AB) are scarce, and the effect of task types and their order have not been fully explored. In this study, 96 participants, divided into four groups of task type combinations, identified auditory or haptic Target 1 (T1) and haptic Target 2 (T2) in rapid series of sounds and forces. We observed a haptic AB (i.e., the accuracy of identifying T2 increased with increasing stimulus onset asynchrony between T1 and T2) in spatial, object-based, and object-spatial tasks, but not in spatial-object task. Changing the modality of an object-based T1 from haptics to audition eliminated the AB, but similar haptic-to-auditory change of the modality of a spatial T1 had no effect on the AB (if it exists). Our findings fill a gap in the literature regarding the auditory-haptic AB, and substantiate the importance of modalities, task types and their order, and the interaction between them. These findings were explained by how the cerebral cortex is organized for processing spatial and object-based information in different modalities.

Executive functions in motor imagery: support for the motor-cognitive model over the functional equivalence model

The motor-cognitive model holds that motor imagery relies on executive resources to a much greater extent than do overt actions. According to this view, engaging executive resources with an interference task during motor imagery or overt actions will lead to a greater lengthening of the time required to imagine a movement than to execute it physically. This model is in contrast to a currently popular view, the functional equivalence model, which holds that motor imagery and overt action use identical mental processes, and thus should be equally affected by task manipulations. The two competing frameworks were tested in three experiments that varied the amount and type of executive resources needed to perform an interference task concurrent with either an overt or imagined version of a grasping and placing action. In Experiment 1, performing a concurrent calculation task led to a greater lengthening of the time required to execute motor imagery than overt action relative to a control condition involving no interference task. Further, an increase in the number of responses used to index performance affected the timing of motor imagery but not overt actions. In Experiment 2, a low-load repetition task interfered with the timing of motor imagery, but less so than a high load calculation task; both tasks had much smaller effects on overt actions. In Experiment 3, a word generation task also interfered with motor imagery much more than with overt actions. The results of these experiments provide broad support for the motor-cognitive model over the functional equivalence model in showing that interfering with executive functions had a much greater impact on the timing of motor imagery than on overt actions. The possible roles of different executive processes in motor imagery are discussed.

Factors Influencing Manipulation of a Familiar Object in Patients With Limb Apraxia After Stroke

Previous studies have shown that hand actions to visual objects are affected both by perceptual factors and by action goals. Our aim was to study how these processes affected hand actions in chronic stroke patients, based on whether they had limb apraxia. Twenty-two left hemisphere, chronic stroke patients were measured on neuropsychological tasks of limb apraxia, which was identified in a subgroup of 10 patients. All patients underwent testing on a separate task of making simple reach and grasp actions to a cup. Their performance was compared to a group of 18 healthy age-matched volunteers. Participants were instructed to grasp the top or bottom of a cup to either lift or turn it over so as to end with a hand position that was either comfortable or uncomfortable. This task tested the influence of the compatibility of hand–cup orientation, as well as goals driven by the end-state comfort of the hand, on action selection for object manipulation. Participants’ performance was measured in terms of error rates, and speed of initiation and reaching (movement time) to the object. The patients’ performance was significantly delayed, and error rates increased when reaching to grasp a cup under conditions of poor compatibility and end-state comfort. The subgroup of patients with apraxia showed a decreased influence of compatibility of hand interaction with the cup, with increased error rates and delayed response times, compared to patients with no apraxia and healthy volunteers. This is despite the fact they did not display significant deficits on neuropsychological tasks of real object use. The study shows that patients with apraxia have difficulties in selecting elements of object-directed actions, pertaining to both habitual and goal-directed factors.

A Role for the Action Observation Network in Apraxia After Stroke

Limb apraxia is a syndrome often observed after stroke that affects the ability to perform skilled actions despite intact elementary motor and sensory systems. In a large cohort of unselected stroke patients with lesions to the left, right, and bilateral hemispheres, we used voxel-based lesion-symptom mapping (VLSM) on clinical CT head images to identify the neuroanatomical correlates of the impairment of performance in three tasks investigating praxis skills in patient populations. These included a meaningless gesture imitation task, a gesture production task involving pantomiming transitive and intransitive gestures, and a gesture recognition task involving recognition of these same categories of gestures. Neocortical lesions associated with poor performance in these tasks were all in the left hemisphere. They involved the pre-striate and medial temporal cortices, the superior temporal sulcus, inferior parietal area PGi, the superior longitudinal fasciculus underlying the primary motor cortex, and the uncinate fasciculus, subserving connections between temporal and frontal regions. No significant lesions were identified when language deficits, as indicated via a picture naming task, were controlled for. The implication of the superior temporal sulcus and the anatomically connected prestriate and inferior parietal regions challenges traditional models of the disorder. The network identified has been implicated in studies of action observation, which might share cognitive functions sub-serving praxis and language skills.

Growing up with Bilateral parieto-occipital injury: over ten years of clinical observation and neuropsychological follow-up

This paper presents a follow-up of a child with Balint's syndrome over more than a decade. The patient experienced traumatic brain injury before age 12, resulting in bilateral occipito-parietal infarctions and a clinical presentation of Balint's syndrome. Neuropsychological assessments at three time points showed average verbal abilities alongside persistent difficulties in visual orientation, mirrored in the patient's daily life. Her outstanding compensatory abilities in the face of these impairments are discussed with respect to the recruitment of the ventral visual stream and the role of top-down processing. This profile may help to determine interventions for younger patients with similar lesions.

Hemispheric lateralization does not affect the cognitive and mechanical cost of a sequential motor task

In sequential, repetitive tasks, we often partially reuse former motor plans. This causes a persistence of an earlier adopted posture (termed motor hysteresis). The cost-optimization hypothesis states that a partial reuse reduces the cognitive cost of a movement, while the persistence in a former posture increases its mechanical cost. An optimal fraction of reuse, which depends on the relative cognitive and mechanical cost, minimizes the total movement cost. Several studies postulate differences in mechanical or cognitive cost as a result of hemispheric lateralization. In the current study, we asked whether these differences would result in different fractions of motor plan reuse. To this end, left- and right-handed dominant participants executed a sequential motor task (opening a column of drawers) with their dominant and non-dominant hand. The size of the motor hysteresis effect was measured as a proxy for the fraction of plan reuse. Participants used similar postures and exhibited a similar hysteresis effect, irrespective of hand and handedness. This finding indicates that either the cognitive and mechanical costs of a motor task are unaffected by hemispheric differences or that their effect on motor planning is negligible.

Domain-Specific Diaschisis: Lesions to Parietal Action Areas Modulate Neural Responses to Tools in the Ventral Stream

Neural responses to small manipulable objects ("tools") in high-level visual areas in ventral temporal cortex (VTC) provide an opportunity to test how anatomically remote regions modulate ventral stream processing in a domain-specific manner. Prior patient studies indicate that grasp-relevant information can be computed about objects by dorsal stream structures independently of processing in VTC. Prior functional neuroimaging studies indicate privileged functional connectivity between regions of VTC exhibiting tool preferences and regions of parietal cortex supporting object-directed action. Here we test whether lesions to parietal cortex modulate tool preferences within ventral and lateral temporal cortex. We found that lesions to the left anterior intraparietal sulcus, a region that supports hand-shaping during object grasping and manipulation, modulate tool preferences in left VTC and in the left posterior middle temporal gyrus. Control analyses demonstrated that neural responses to "place" stimuli in left VTC were unaffected by lesions to parietal cortex, indicating domain-specific consequences for ventral stream neural responses in the setting of parietal lesions. These findings provide causal evidence that neural specificity for "tools" in ventral and lateral temporal lobe areas may arise, in part, from online inputs to VTC from parietal areas that receive inputs via the dorsal visual pathway.

The effect of grasp compatibility in go/no-go and two-choice tasks

The grasp compatibility effect has been put forward as evidence for the automatic involvement of the motor system during mental object representation. In three experiments, participants responded to object pictures or names by grasping cylinders using a precision or power grasp. In a two-choice task in which both grasps were used, we obtained grasp compatibility effects, but in a go/no-go task, in which only one grasp was used, there was no effect. These results indicate that the effect depends on the availability of response choice, in the present case, different size grasps. This suggests that grasp compatibility effects are better explained by coding of the stimulus and response on the same dimension, size, rather than automatic activation of a motor action towards the object.

Correspondence effect driven by salient visual asymmetries in integral object stimuli

The handle-to-hand correspondence effect consists of faster and more accurate responses when the responding hand is aligned with the handle side of an object tool, compared to when they lay on opposite sides. This effect has been attributed to the activation of affordances. Recent studies, however, claimed that it may depend on the spatial coding of the object on the basis of its visual asymmetry (location-coding account). Affordances are namely direct and meaningful relations between recognized objects and the observers' action system. Therefore, any manipulation that disrupts the body structure of object tools could potentially affect their identification and prevent the activation of affordances. The present study investigated the nature of the handle-to-hand correspondence effects by manipulating structural asymmetry and visual salience of object tools, while preserving their integrity that is, leaving unaltered the original possibilities to activate grasping affordances. Three experiments were run. Results were consistent with the location-coding account and claim for accurate control of visual asymmetries in object stimuli during investigation of affordance effects.

Efficiency in Rule- vs. Plan-Based Movements Is Modulated by Action-Mode

The rule/plan motor cognition (RPMC) paradigm elicits visually indistinguishable motor outputs, resulting from either plan- or rule-based action-selection, using a combination of essentially interchangeable stimuli. Previous implementations of the RPMC paradigm have used pantomimed movements to compare plan- vs. rule-based action-selection. In the present work we attempt to determine the generalizability of previous RPMC findings to real object interaction by use of a grasp-to-rotate task. In the plan task, participants had to use prospective planning to achieve a comfortable post-handle rotation hand posture. The rule task used implementation intentions (if-then rules) leading to the same comfortable end-state. In Experiment A, we compare RPMC performance of 16 healthy participants in pantomime and real object conditions of the experiment, within-subjects. Higher processing efficiency of rule- vs. plan-based action-selection was supported by diffusion model analysis. Results show a significant response-time increase in the pantomime condition compared to the real object condition and a greater response-time advantage of rule-based vs. plan-based actions in the pantomime compared to the real object condition. In Experiment B, 24 healthy participants performed the real object RPMC task in a task switching vs. a blocked condition. Results indicate that plan-based action-selection leads to longer response-times and less efficient information processing than rule-based action-selection in line with previous RPMC findings derived from the pantomime action-mode. Particularly in the task switching mode, responses were faster in the rule compared to the plan task suggesting a modulating influence of cognitive load. Overall, results suggest an advantage of rule-based action-selection over plan-based action-selection; whereby differential mechanisms appear to be involved depending on the action-mode. We propose that cognitive load is a factor that modulates the advantageous effect of implementation intentions in motor cognition on different levels as illustrated by the varying speed advantages and the variation in diffusion parameters per action-mode or condition, respectively.

Three-Dimensional Representations of Objects in Dorsal Cortex are Dissociable from Those in Ventral Cortex

An established conceptualization of visual cortical function is one in which ventral regions mediate object perception while dorsal regions support spatial information processing and visually guided action. This division has been contested by evidence showing that dorsal regions are also engaged in the representation of object shape, even when actions are not required. The critical question is whether these dorsal, object-based representations are dissociable from ventral representations, and whether they play a functional role in object recognition. We examined the neural and behavioral profile of patients with impairments in object recognition following ventral cortex damage. In a functional magnetic resonanace imaging experiment, the blood oxygen level-dependent response in the ventral, but not dorsal, cortex of the patients evinced less sensitivity to object 3D structure compared with that of healthy controls. Consistently, in psychophysics experiments, the patients exhibited significant impairments in object perception, but still revealed residual sensitivity to object-based structural information. Together, these findings suggest that, although in the intact system there is considerable crosstalk between dorsal and ventral cortices, object representations in dorsal cortex can be computed independently from those in ventral cortex. While dorsal representations alone are unable to support normal object perception, they can, nevertheless, support a coarse description of object structural information.

Effects of Cognitive Load on Driving Performance: The Cognitive Control Hypothesis

OBJECTIVE

The objective of this paper was to outline an explanatory framework for understanding effects of cognitive load on driving performance and to review the existing experimental literature in the light of this framework.

BACKGROUND

Although there is general consensus that taking the eyes off the forward roadway significantly impairs most aspects of driving, the effects of primarily cognitively loading tasks on driving performance are not well understood.

METHOD

Based on existing models of driver attention, an explanatory framework was outlined. This framework can be summarized in terms of the cognitive control hypothesis: Cognitive load selectively impairs driving subtasks that rely on cognitive control but leaves automatic performance unaffected. An extensive literature review was conducted wherein existing results were reinterpreted based on the proposed framework.

RESULTS

It was demonstrated that the general pattern of experimental results reported in the literature aligns well with the cognitive control hypothesis and that several apparent discrepancies between studies can be reconciled based on the proposed framework. More specifically, performance on nonpracticed or inherently variable tasks, relying on cognitive control, is consistently impaired by cognitive load, whereas the performance on automatized (well-practiced and consistently mapped) tasks is unaffected and sometimes even improved.

CONCLUSION

Effects of cognitive load on driving are strongly selective and task dependent.

APPLICATION

The present results have important implications for the generalization of results obtained from experimental studies to real-world driving. The proposed framework can also serve to guide future research on the potential causal role of cognitive load in real-world crashes.

Movement Interferes with Visuospatial Working Memory during the Encoding: An ERP Study

The present study focuses on the functional interactions of cognition and manual action control. Particularly, we investigated the neurophysiological correlates of the dual-task costs of a manual-motor task (requiring grasping an object, holding it, and subsequently placing it on a target) for working memory (WM) domains (verbal and visuospatial) and processes (encoding and retrieval). Thirty participants were tested in a cognitive-motor dual-task paradigm, in which a single block (a verbal or visuospatial WM task) was compared with a dual block (concurrent performance of a WM task and a motor task). Event-related potentials (ERPs) were analyzed separately for the encoding and retrieval processes of verbal and visuospatial WM domains both in single and dual blocks. The behavioral analyses show that the motor task interfered with WM and decreased the memory performance. The performance decrease was larger for the visuospatial task compared with the verbal task, i.e., domain-specific memory costs were obtained. The ERP analyses show the domain-specific interference also at the neurophysiological level, which is further process-specific to encoding. That is, comparing the patterns of WM-related ERPs in the single block and dual block, we showed that visuospatial ERPs changed only for the encoding process when a motor task was performed at the same time. Generally, the present study provides evidence for domain- and process-specific interactions of a prepared manual-motor movement with WM (visuospatial domain during the encoding process). This study, therefore, provides an initial neurophysiological characterization of functional interactions of WM and manual actions in a cognitive-motor dual-task setting, and contributes to a better understanding of the neuro-cognitive mechanisms of motor action control.

Object Recognition in Mental Representations: Directions for Exploring Diagnostic Features through Visual Mental Imagery

One of the fundamental goals of object recognition research is to understand how a cognitive representation produced from the output of filtered and transformed sensory information facilitates efficient viewer behavior. Given that mental imagery strongly resembles perceptual processes in both cortical regions and subjective visual qualities, it is reasonable to question whether mental imagery facilitates cognition in a manner similar to that of perceptual viewing: via the detection and recognition of distinguishing features. Categorizing the feature content of mental imagery holds potential as a reverse pathway by which to identify the components of a visual stimulus which are most critical for the creation and retrieval of a visual representation. This review will examine the likelihood that the information represented in visual mental imagery reflects distinctive object features thought to facilitate efficient object categorization and recognition during perceptual viewing. If it is the case that these representational features resemble their sensory counterparts in both spatial and semantic qualities, they may well be accessible through mental imagery as evaluated through current investigative techniques. In this review, methods applied to mental imagery research and their findings are reviewed and evaluated for their efficiency in accessing internal representations, and implications for identifying diagnostic features are discussed. An argument is made for the benefits of combining mental imagery assessment methods with diagnostic feature research to advance the understanding of visual perceptive processes, with suggestions for avenues of future investigation.

How do the two visual streams interact with each other?

The current consensus divides primate cortical visual processing into two broad networks or "streams" composed of highly interconnected areas (Milner and Goodale 2006, 2008; Goodale 2014). The ventral stream, passing from primary visual cortex (V1) through to inferior parts of the temporal lobe, is considered to mediate the transformation of the contents of the visual signal into the mental furniture that guides memory, recognition and conscious perception. In contrast the dorsal stream, passing from V1 through to various areas in the posterior parietal lobe, is generally considered to mediate the visual guidance of action, primarily in real time. The brain, however, does not work through mutually insulated subsystems, and indeed there are well-documented interconnections between the two streams. Evidence for contributions from ventral stream systems to the dorsal stream comes from human neuropsychological and neuroimaging research, and indicates a crucial role in mediating complex and flexible visuomotor skills. Complementary evidence points to a role for posterior dorsal-stream visual analysis in certain aspects of 3-D perceptual function in the ventral stream. A series of studies of a patient with visual form agnosia has been instrumental in shaping our knowledge of what each stream can achieve in isolation; but it has also helped us to tease apart the relative dependence of parietal visuomotor systems on direct bottom-up visual inputs versus inputs redirected via perceptual systems within the ventral stream.

Factors influencing planning of a familiar grasp to an object: what it is to pick a cup

We assessed the factors influencing the planning of actions required to manipulate one of two everyday objects with matching dimensions but openings at opposite ends: a cup and a vase. We found that, for cups, measures of movement preparation to reach and grasp the object were influenced by whether the grasp was made to the functional part of the object (wide opening) and whether the action would end in a supinated as opposed to a pronated grasp. These factors interacted such that effects of hand posture were found only when a less familiar grasp was made to the non-functional part of the cup (the base). These effects were not found with the vase, which has a less familiar location for grasping. We interpret the results in terms of a parallel model of action selection, modulated by both the familiarity of the grasp to a part of the object, likely to reflect object 'affordances' and the end state comfort of the action.

Is there any Influence of Variations in Context on Object-Affordance Effects in Schizophrenia? Perception of Property and Goals of Action

The simple perception of an object can potentiate an associated action. This affordance effect depends heavily on the action context in which the object is presented. In recent years, psychologists, psychiatrists, and phenomenologists have agreed that subjects with schizophrenia may not perceive the affordances of people or objects that could lead to a loss of ease in their actions. We examined whether the addition of contextually congruent elements, during the perception of everyday objects, could promote the emergence of object-affordance effects in subjects with schizophrenia and controls. Participants performed two Stimulus–Response-Compatibility tasks in which they were presented with semantic primes related to sense of property (Experiment 1) or goal of action (Experiment 2) prior to viewing each graspable object. Controls responded faster when their response hand and the graspable part of the object were compatibly oriented, but only when the context was congruent with the individual’s needs and goals. When the context operated as a constraint, the affordance-effect was disrupted. These results support the understanding that object-affordance is flexible and not just intrinsic to an object. However, the absence of this object-affordance effect in subjects with schizophrenia suggests the possible impairment of their ability to experience the internal simulation of motor action potentialities. In such case, all activities of daily life would require the involvement of higher cognitive processes rather than lower level sensorimotor processes. The study of schizophrenia requires the consideration of concepts and methods that arise from the theories of embodied and situated cognition.

Attention is required for the perceptual integration of action object pairs

Previous studies have demonstrated that functionally related objects are perceptually grouped during visual identification if they are depicted as if interacting with each other (Green and Hummel in J Exp Psychol Hum Percept Perform 32(5):1107-1119, 2006). However, it is unclear whether this integration requires attention or occurs pre-attentively. Here, we used a divided-attention task with variable attentional load to address this question. Participants matched a word label to a target object that was immediately preceded by a briefly presented, task-irrelevant tool that was either functionally related or unrelated to the word label (e.g., axe | "log" or hammer | "log"). The tool was either positioned to interact with the target object or faced away from it. The amount of attention available to process the tool was manipulated by asking participants to make a concurrent perceptual discrimination of varying difficulty on a surrounding frame stimulus. The previously demonstrated advantage for the related-and-interacting condition was replicated under conditions of no or low attentional load. This benefit disappeared under high competing attentional load, indicating that attention is required to integrate functionally related objects together into a single perceptual unit.

Perception and action

The phrase perception and action is used widely but in diverse ways in the context of the relationship between perceptual and motor processes. This review describes and integrates five perspectives on perception and action which rely on both neurophysiological and behavioral levels of analysis. The two visual systems view proposes dissociable but interactive systems for conscious processing of objects/space and the visual control of action. The integrative view proposes tightly calibrated but flexible systems for perception and motor control in spatial representation. The embodied view posits that action underlies perception, involving common coding or motor simulation systems, and examines the relationship between action observation, imitation, and the understanding of intention. The ecological view emphasizes environmental information and affordances in perception. The functional view defines the relationship between perception, action planning, and semantics in goal-directed actions. Although some of these views/approaches differ in significant ways, their shared emphasis on the importance of action in perception serves as a useful unifying framework. WIREs Cogn Sci 2010 1 800-810 For further resources related to this article, please visit the WIREs website.

Stable and variable affordances are both automatic and flexible

The mere observation of pictures or words referring to manipulable objects is sufficient to evoke their affordances since objects and their nouns elicit components of appropriate motor programs associated with object interaction. While nobody doubts that objects actually evoke motor information, the degree of automaticity of this activation has been recently disputed. Recent evidence has indeed revealed that affordances activation is flexibly modulated by the task and by the physical and social context. It is therefore crucial to understand whether these results challenge previous evidence showing that motor information is activated independently from the task. The context and the task can indeed act as an early or late filter. We will review recent data consistent with the notion that objects automatically elicit multiple affordances and that top-down processes select among them probably inhibiting motor information that is not consistent with behavior goals. We will therefore argue that automaticity and flexibility of affordances are not in conflict. We will also discuss how language can incorporate affordances showing similarities, but also differences, between the motor information elicited by vision and language. Finally we will show how the distinction between stable and variable affordances can accommodate all these effects.

How do you hold your mouse? Tracking the compatibility effect between hand posture and stimulus size

In keeping with the idea that observing objects activates possible motor responses, several experiments revealed compatibility effects between the hand postures used to report a choice and some characteristics of the stimuli. The real-time dynamics of such compatibility effects are currently unknown. We tracked the time course of a categorization experiment requiring subjects to categorize as natural or artifact figures of big and small objects. Participants reported their choice using either a big mouse (requiring a power grip: a hand posture compatible with the grasping of big objects) or a small mouse (requiring a precision grip: a hand posture compatible with the grasping of small objects). We found a compatibility effect between the grip required by the mouse and the grip elicited by objects, even if it was irrelevant to the task. In a following experiment with the same paradigm, lexical stimuli failed to reproduce the same effect. Nevertheless, a compatibility effect mediated by the target-word category (artificial vs. natural) was observed. We discuss the results in the context of affordance effects literature and grounded theories of cognition.

Cognitive-motor interference while grasping, lifting and holding objects

In daily life, object manipulation is usually performed concurrently to the execution of cognitive tasks. The aim of the present study was to determine which aspects of precision grip require cognitive resources using a motor-cognitive dual-task paradigm. Eighteen healthy participants took part in the experiment, which comprised two conditions. In the first condition, participants performed a motor task without any concomitant cognitive task. They were instructed to grip, lift and hold an apparatus incorporating strain gauges allowing a continuous measurement of the force perpendicular to each contact surface (grip force, GF) as well as the total tangential force applied on the object (load force, LF). In the second condition, participants performed the same motor task while concurrently performing a cognitive task consisting in a complex visual search combined with counting. In the dual-task condition, we found a significant increase in the duration of the preload phase (time between initial contact of the fingers with the apparatus and onset of the load force), as well as a significant increase of the grip force during the holding phase, indicating that the cognitive task interfered with the initial force scaling performed during the preload phase and the fine-tuning of grip force during the hold phase. These findings indicate that these aspects of precision grip require cognitive resources. In contrast, other aspects of the precision grip, such as the temporal coupling between grip and load forces, were not affected by the cognitive task, suggesting that they reflect more automatic processes. Taken together, our results suggest that assessing the dynamic and temporal parameters of precision grip in the context of a concurrent cognitive task may constitute a more ecological and better-suited tool to characterize motor dysfunction in patients.

Binocular vision enhances a rapidly evolving affordance priming effect: behavioural and TMS evidence

Extensive research has suggested that simply viewing an object can automatically prime compatible actions for object manipulation, known as affordances. Here we explored the generation of covert motor plans afforded by real objects with precision ('pinchable') or whole-hand/power ('graspable') grip significance under different types of vision. In Experiment 1, participants viewed real object primes either monocularly or binocularly and responded to orthogonal auditory stimuli by making precision or power grips. Pinchable primes facilitated congruent precision grip responses relative to incongruent power grips, and vice versa for graspable primes, but only in the binocular vision condition. To examine the temporal evolution of the binocular affordance effect, participants in Experiment 2 always viewed the objects binocularly but made no responses, instead receiving a transcranial magnetic stimulation pulse over their primary motor cortex at three different times (150, 300, 450ms) after prime onset. Motor evoked potentials (MEPs) recorded from a pinching muscle were selectively increased when subjects were primed with a pinchable object, whereas MEPs from a muscle associated with power grips were increased when viewing graspable stimuli. This interaction was obtained both 300 and 450ms (but not 150ms) after the visual onset of the prime, characterising for the first time the rapid development of binocular grip-specific affordances predicted by functional accounts of the affordance effect.

Are stripes beneficial? Dazzle camouflage influences perceived speed and hit rates

In the animal kingdom, camouflage refers to patterns that help potential prey avoid detection. Mostly camouflage is thought of as helping prey blend in with their background. In contrast, disruptive or dazzle patterns protect moving targets and have been suggested as an evolutionary force in shaping the dorsal patterns of animals. Dazzle patterns, such as stripes and zigzags, are thought to reduce the probability with which moving prey will be captured by impairing predators' perception of speed. We investigated how different patterns of stripes (longitudinal-i.e., parallel to movement direction-and vertical-i.e., perpendicular to movement direction) affect the probability with which humans can hit moving objects and if differences in hitting probability are caused by a misperception of speed. A first experiment showed that longitudinally striped objects were hit more often than unicolored objects. However, vertically striped objects did not differ from unicolored objects. A second study examining the link between perceived speed and hitting probability showed that longitudinally and vertically striped objects were both perceived as moving faster and were hit more often than unicolored objects. In sum, our results provide evidence that striped patterns disrupt the perception of speed, which in turn influences how often objects are hit. However, the magnitude and the direction of the effects depend on additional factors such as speed and the task setup.