A direct effect of perception on action when grasping a cup

Syntax matters in shaping sensorimotor activation driven by nouns

Existing evidence has shown that adjectives modulate the grasp-compatibility effect elicited by object nouns. The aim of the present study was to investigate the role of syntax on the sensorimotor activation elicited by nouns in a grasp-compatibility task. We assessed two languages with different syntactic rules, Italian in Experiment 1 and English in Experiment 2. In both experiments, an adjective-noun pair was shown on the screen. The adjective was always in a pre-nominal position and denoted either a disadvantageous quality of the object graspability (e.g., sharp) or the object colour (e.g., reddish). Participants had to categorize the object nouns as natural or artifact, performing a precision or a power reach-to-grasp movement. On different trials, the grasp response was compatible or incompatible with the grip typically used to manipulate the object indicated by the noun. In Experiment 1 (Italian language) the adjective-noun order violated the syntactic order and no difference emerged between reaction times on compatible and incompatible trials (no grasp compatibility effect). In Experiment 2 (English language), the adjective-noun order followed the syntactic rule. Results showed a grasp-compatibility effect when a colour adjective was presented before a natural object noun. When a disadvantageous adjective preceded an artifact or a natural object noun, an inverted grasp-compatibility effect emerged with slower responses on compatible than incompatible trials. Taken together, these findings suggest that adjectives can shape the sensorimotor activation elicited by nouns of graspable objects only when the syntax is correct. Results are discussed with respect to embodied cognition theories.

Limb Apraxias: The Influence of Higher Order Perceptual and Semantic Deficits in Motor Recovery After Stroke

Stroke is a leading cause of disability worldwide. Limb apraxia is a group of higher order motor disorders associated with greater disability and dependence after stroke. Original neuropsychology studies distinguished separate brain pathways involved in perception and action, known as the dual stream hypothesis. This framework has allowed a better understanding of the deficits identified in Limb Apraxia. In this review, we propose a hierarchical organization of this disorder, in which a distinction can be made between several visuomotor pathways that lead to purposeful actions. Based on this, executive apraxias (such as limb kinetic apraxia) cause deficits in executing fine motor hand skills, and intermediate apraxias (such as optic ataxia and tactile apraxia) cause deficits in reaching to grasp and manipulating objects in space. These disorders usually affect the contralesional limb. A further set of disorders collectively known as limb apraxias include deficits in gesture imitation, pantomime, gesture recognition, and object use. These deficits are due to deficits in integrating perceptual and semantic information to generate complex movements. Limb apraxias are usually caused by left-hemisphere lesions in right-handed stroke patients, affecting both limbs. The anterior- to posterior-axis of brain areas are disrupted depending on the increasing involvement of perceptual and semantic processes with each condition. Lower-level executive apraxias are linked to lesions in the frontal lobe and the basal ganglia, while intermediate apraxias are linked to lesions in dorso-dorsal subdivisions of the dorsal fronto-parietal networks. Limb apraxias can be caused by lesions in both dorsal and ventral subdivisions including the ventro-dorsal stream and a third visuomotor pathway, involved in body schema and social cognition. Rehabilitation of these disorders with behavioral therapies has aimed to either restore perceptuo-semantic deficits or compensate to overcome these deficits. Further studies are required to better stratify patients, using modern neurophysiology and neuroimaging techniques, to provide targeted and personalized therapies for these disorders in the future.

Influence of colour on object motor representation

Colour conveys specific information about the status/quality of an object; whereas its role in object recognition has been widely studied, little is known about its role in sensorimotor processes. We performed three experiments to assess whether colour influences the motor representation of graspable objects. In Experiment 1, we used a grasp compatibility task, in which participants categorized each object as natural or artifact, by performing reach-to-grasp movements. Response grasps could be compatible or incompatible with the ones normally used to manipulate the objects. Results showed faster reaction times for natural objects displayed in the correct colour compared with both opposite colour and correct colour artifact objects. In Experiment 2, to directly assess the effect of colour on object motor representation, we used an interference task in which an irrelevant object was shown while performing a pre-specified reach-to-grasp movement (i.e., verbal cues: small vs. large). Results highlighted a reversed compatibility effect when objects were shown in their correct colour, but only at the beginning of the movement (10 ms SOA). Finally, we run a third experiment using the same task as in Experiment 2. In this experiment, we compared the grasp compatibility effect driven by natural objects with the grasp compatibility effect driven by dangerous natural objects (e.g., cactus), which are objects that should not elicit a grasping program. The results of Experiment 3 confirm those of Experiment 2, highlighting also specific processes related to dangerous objects. Taken together, these results revealed that colour can be significant for the motor system, highlighting the close link between colour and shape, and also specific processes related to dangerous objects.

Neural Correlates of Hand-Object Congruency Effects during Action Planning

Selecting hand actions to manipulate an object is affected both by perceptual factors and by action goals. Affordances may contribute to "stimulus-response" congruency effects driven by habitual actions to an object. In previous studies, we have demonstrated an influence of the congruency between hand and object orientations on response times when reaching to turn an object, such as a cup. In this study, we investigated how the representation of hand postures triggered by planning to turn a cup was influenced by this congruency effect, in an fMRI scanning environment. Healthy participants were asked to reach and turn a real cup that was placed in front of them either in an upright orientation or upside-down. They were instructed to use a hand orientation that was either congruent or incongruent with the cup orientation. As expected, the motor responses were faster when the hand and cup orientations were congruent. There was increased activity in a network of brain regions involving object-directed actions during action planning, which included bilateral primary and extrastriate visual, medial, and superior temporal areas, as well as superior parietal, primary motor, and premotor areas in the left hemisphere. Specific activation of the dorsal premotor cortex was associated with hand-object orientation congruency during planning and prior to any action taking place. Activity in that area and its connectivity with the lateral occipito-temporal cortex increased when planning incongruent (goal-directed) actions. The increased activity in premotor areas in trials where the orientation of the hand was incongruent to that of the object suggests a role in eliciting competing representations specified by hand postures in lateral occipito-temporal cortex.

Handle-Hand Compatibility Effects for the Right and Left Hand Using Reach-to-Touch Movements

In stimulus-response compatibility tasks, performance is better when the handle of an object is oriented on the same side of the response than when the handle is oriented on the opposite side. Two major alternative accounts, the motor affordance and spatial accounts, have been proposed to explain this handle-hand compatibility effect. In two experiments, we tested between these two accounts by administering a go/no-go task to right-handed participants. Handled objects presented on a touchscreen were used as stimuli. Half of the participants had to reach-to-touch the stimuli by using their dominant hand, the other half by using their nondominant hand. Liftoff times (LTs), movement times (MTs) and spatial coordinates of the movement endpoints were recorded. Results from the LTs and MTs analyses showed no evidence of handle-hand compatibility effects. In contrast, the analyses of the spatial coordinates revealed that participants' touches were shifted more laterally towards the handle when the handles were oriented on the same side of the responding hand (Experiments 1 and 2). Furthermore, the right-hand touches landed higher (towards the handle) than the left-hand touches, especially when the vertical object dimension was particularly salient (Experiment 1). Overall, these results are in line with the activation of hand motor programs to reach and grasp the object as predicted by the motor account, at least for the right/dominant hand.

On the Evolution of a Radical Concept: Affordances According to Gibson and Their Subsequent Use and Development

James J. Gibson, the founder of ecological psychology, introduced a radical empiricist approach to perception and action centered on direct perception in naturalistic environments that was counter to popular representational views of his time. This direct perception approach and the associated introduction of the affordance concept have been extremely influential in several fields of study. However, since its inception, the affordance concept has evolved in a manner such that it now deviates significantly from Gibson's original intention. This review follows use of the affordance concept by four sets of influential experimental psychologists: Gibson, Donald Norman, Mike Tucker and Rob Ellis, and Daniel Bub and Michael Masson. Particular attention is paid to the manner in which they applied the concept and the contributions provided by each set of researchers. The primary goal of this review is to determine what cognitive psychologists can take away from developments within the field and what considerations should be taken into account when using the term affordance. Having a more thorough understanding of the factors that led to the concept of affordance and its recent reformulations will better equip cognitive psychologists and, by extension, human factors researchers to further advance the study of perception-action relations.