Response interference between functional and structural actions linked to the same familiar object

Syntax matters in shaping sensorimotor activation driven by nouns

Existing evidence has shown that adjectives modulate the grasp-compatibility effect elicited by object nouns. The aim of the present study was to investigate the role of syntax on the sensorimotor activation elicited by nouns in a grasp-compatibility task. We assessed two languages with different syntactic rules, Italian in Experiment 1 and English in Experiment 2. In both experiments, an adjective-noun pair was shown on the screen. The adjective was always in a pre-nominal position and denoted either a disadvantageous quality of the object graspability (e.g., sharp) or the object colour (e.g., reddish). Participants had to categorize the object nouns as natural or artifact, performing a precision or a power reach-to-grasp movement. On different trials, the grasp response was compatible or incompatible with the grip typically used to manipulate the object indicated by the noun. In Experiment 1 (Italian language) the adjective-noun order violated the syntactic order and no difference emerged between reaction times on compatible and incompatible trials (no grasp compatibility effect). In Experiment 2 (English language), the adjective-noun order followed the syntactic rule. Results showed a grasp-compatibility effect when a colour adjective was presented before a natural object noun. When a disadvantageous adjective preceded an artifact or a natural object noun, an inverted grasp-compatibility effect emerged with slower responses on compatible than incompatible trials. Taken together, these findings suggest that adjectives can shape the sensorimotor activation elicited by nouns of graspable objects only when the syntax is correct. Results are discussed with respect to embodied cognition theories.

Stimulus-response compatibility effects during object semantic categorisation: Evocation of grasp affordances or abstract coding of object size?

When the size of visual objects matches the size of the response required to perform the task, a potentiation effect has been reported, with faster responses in compatible than incompatible situations. Size compatibility effects have been taken as evidence of close perception-action interrelations. However, it is still unclear whether the effect arises from abstract coding of the size of stimulus and response or from the evocation of grasp affordances from visual objects. We aimed to disentangle the two interpretations. Two groups of 40 young adults categorised small and large objects presented in standardised size as natural or artefact objects. One group categorised manipulable objects that may be associated with small or large size properties and evoke power or precision grasp affordances. The other group categorised non-manipulable objects that may only be associated with small or large size properties. Categorisation responses were made by reaching and grasping a monotonic cylindric device with a power or precision grip in a grasping condition and with large or small touch responses in a control condition. Compatibility effects were found in both grasping and control conditions, independently of the manipulability or category of objects. Participants were faster when the size of the expected response matched the size of the object than when they mismatched, especially for power grasps or whole-hand touch responses. Overall findings support the abstract coding hypothesis and suggest that compatibility between the conceptual size of the object and the size of the hand response is sufficient to facilitate semantic categorisation judgements.

A fist bump in a political meeting? The influence of social context on affordance selection

Historically, understanding human cognition such as action processing has been a challenging issue in cognitive neuropsychology and the more we know about cognition, the more we shape it as a complex, multi-determined phenomenon that is embedded in a social context. The present study aimed at understanding how the social context could influence affordance selection. We hypothesized that affordance selection would be modulated by social context and that a given hand configuration would be considered appropriate or not, as a function of the presence or absence of social context. Twenty-six healthy participants were asked to judge the appropriateness of three variants of 10 hand-object interactions based on photographs presented with or without a visual, social context. In our results, hand configurations were intrinsically acceptable or not, but this effect was modulated by the social context. A three-step model of the influence of social context on affordance selection was proposed, according to which selection depends on social norms, in the form of social knowledge and social context analysis.

Mechanisms and neuroanatomy of response selection in tool and non-tool action tasks: Evidence from left-hemisphere stroke

The ability to select between potential actions is central to the complex process of tool use. After left hemisphere stroke, individuals with limb apraxia make more hand action errors when gesturing the use of tools with conflicting hand actions for grasping-to-move and use (e.g., screwdriver) relative to tools that are grasped-to-move and used with the same hand action (e.g., hammer). Prior research indicates that this grasp-use interference effect is driven by abnormalities in the competitive action selection process. The goal of this project was to determine whether common mechanisms and neural substrates support the competitive selection of task-appropriate responses in both tool and non-tool domains. If so, the grasp-use interference effect in a tool use gesturing task should be correlated with response interference effects in the classic Eriksen flanker and Simon tasks, and at least partly overlapping neural regions should subserve the 3 tasks. Sixty-four left hemisphere stroke survivors (33 with apraxia) participated in the tool- and non-tool interference tasks and underwent T1 anatomical MRI. There were robust grasp-use interference effects (grasp-use conflict test) and response interference effects (Eriksen flanker and Simon tasks), but these effects were not correlated. Lesion-symptom mapping analyses showed that lesions to the left inferior parietal lobule, ventral premotor cortex, and insula were associated with grasp-use interference. Lesions to the left inferior parietal lobule, postcentral gyrus, insula, caudate, and putamen were associated with response interference in the Eriksen flanker task. Lesions to the left caudate and putamen were also associated with response interference in the Simon task. Our results suggest that the selection of hand posture for tool use is mediated by distinct cognitive mechanisms and partly distinct neuroanatomic substrates from those mapping a stimulus to an appropriate motor response in non-tool domains.

An active inference model of hierarchical action understanding, learning and imitation

We advance a novel active inference model of the cognitive processing that underlies the acquisition of a hierarchical action repertoire and its use for observation, understanding and imitation. We illustrate the model in four simulations of a tennis learner who observes a teacher performing tennis shots, forms hierarchical representations of the observed actions, and imitates them. Our simulations show that the agent's oculomotor activity implements an active information sampling strategy that permits inferring the kinematic aspects of the observed movement, which lie at the lowest level of the action hierarchy. In turn, this low-level kinematic inference supports higher-level inferences about deeper aspects of the observed actions: proximal goals and intentions. Finally, the inferred action representations can steer imitative responses, but interfere with the execution of different actions. Our simulations show that hierarchical active inference provides a unified account of action observation, understanding, learning and imitation and helps explain the neurobiological underpinnings of visuomotor cognition, including the multiple routes for action understanding in the dorsal and ventral streams and mirror mechanisms.

Too much to handle? Interference from distractors with similar affordances on target selection for handled objects

The existence of handle affordances has been classically demonstrated using the Stimulus-Response Compatibility paradigm, with shorter response times when the orientation of the object handle and the response hand are compatible in comparison to incompatible. Yet the activation of handle affordances from visual objects has been investigated in very simple situations involving single stimulus and motor response. As natural perceptual scenes are usually composed of multiple objects that could activate multiple affordances, the consequence of multiple affordance activation on the perception and processing of a given object of the scene requires more investigation. The aim of this study was to determine the impact of distractor affordances on the processing of a target object in situations involving several familiar graspable objects. In two online experiments, 229 participants had to select a target object (the kitchen utensil or the tool) in a visual scene displaying a pair of objects. They performed left key presses when the target was on the left and right key presses when the target was on the right. Target handle orientation and response side could be compatible or incompatible. Critically, target and distractor objects had similar or dissimilar handle affordances, with handles oriented for left- or right-hand grasps. Results from the two experiments showed slower response times when target and distractor objects had similar handle affordances in comparison to dissimilar affordances, when participants performed right hand responses and when target orientation and response were compatible. Thus, affordance similarity between objects may interfere rather than facilitate object processing and slow down target selection. These findings are in line with models of affordance and object selection assuming automatic inhibition of distractors' affordances for appropriate object interaction.

Visual Form and Event Semantics Predict Transitivity in Silent Gestures: Evidence for Compositionality

Silent gesture is not considered to be linguistic, on par with spoken and sign languages. It is claimed that silent gestures, unlike language, represent events holistically, without compositional structure. However, recent research has demonstrated that gesturers use consistent strategies when representing objects and events, and that there are behavioral and clinically relevant limits on what form a gesture may take to effect a particular meaning. This systematicity challenges a holistic interpretation of silent gesture, which predicts that there should be no stable form-meaning correspondence across event representations. Here, we demonstrate to the contrary that untrained gesturers systematically manipulate the form of their gestures when representing events with and without a theme (e.g., Someone popped the balloon vs. Someone walked), that is, transitive and intransitive events. We elicited silent gestures and annotated them for manual features active in coding transitivity distinctions in sign languages. We trained linear support vector machines to make item-by-item transitivity predictions based on these features. Prediction accuracy was good across the entire dataset, thus demonstrating that systematicity in silent gesture can be explained with recourse to subunits. We argue that handshape features are constructs co-opted from cognitive systems subserving manual action production and comprehension for communicative purposes, which may integrate into the linguistic system of emerging sign languages. We further suggest that nonsigners tend to map event participants to each hand, a strategy found across genetically and geographically distinct sign languages, suggesting the strategy's cognitive foundation.

Tool use acquisition induces a multifunctional interference effect during object processing: evidence from the sensorimotor mu rhythm

A fundamental characteristic of human development is acquiring and accumulating tool use knowledge through observation and sensorimotor experience. Recent studies showed that, in children and adults, different action possibilities to grasp-to-move and grasp-to-use objects generate a conflict that extinguishes neural motor resonance phenomena during visual object processing. In this study, a training protocol coupled with EEG recordings was administered in virtual reality to healthy adults to evaluate whether a similar conflict occurs between novel tool use knowledge. Participants perceived and manipulated two novel 3D tools trained beforehand with either single or double-usage. A weaker reduction of mu-band (10-13 Hz) power, accompanied by a reduced inter-trial phase coherence, was recorded during the perception of the tool associated with the double-usage. These effects started within the first 200 ms of visual object processing and were predominantly recorded over the left motor system. Furthermore, interacting with the double usage tool delayed grasp-to-reach movements. The results highlight a multifunctional interference effect, such as tool use acquisition reduces the neural motor resonance phenomenon and inhibits the activation of the motor system during subsequent object recognition. These results imply that learned tool use information guides sensorimotor processes of objects.

Congruent action context releases Mu rhythm desynchronization when visual objects activate competing action representations

Recent findings demonstrated that object perception is affected by the competition between action representations. Simultaneous activation of distinct structural ("grasp-to-move") and functional ("grasp-to-use") action representations slows down perceptual judgements on objects. At the brain level, competition reduces motor resonance effects during manipulable object perception, reflected by an extinction of μ rhythm desynchronization. However, how this competition is solved in the absence of object-directed action remains unclear. The present study investigates the role of context in the resolution of the competition between conflicting action representations during mere object perception. To this aim, thirty-eight volunteers were instructed to perform a reachability judgment task on 3D objects presented at different distances in a virtual environment. Objects were conflictual objects associated with distinct structural and functional action representations. Verbs were used to provide a neutral or congruent action context prior or after object presentation. Neurophysiological correlates of the competition between action representation were recorded using EEG. The main result showed a release of μ rhythm desynchronization when reachable conflictual objects were presented with a congruent action context. Context influenced μ rhythm desynchronization when the action context was provided prior or after object presentation in a time-window compatible with object-context integration (around 1000 ms after the presentation of the first stimulus). These findings revealed that action context biases competition between co-activated action representations during mere object perception and demonstrated that μ rhythm desynchronization may be an index of activation but also competition between action representations in perception.

The role of the anterior temporal cortex in action: evidence from fMRI multivariate searchlight analysis during real object grasping

Intelligent manipulation of handheld tools marks a major discontinuity between humans and our closest ancestors. Here we identified neural representations about how tools are typically manipulated within left anterior temporal cortex, by shifting a searchlight classifier through whole-brain real action fMRI data when participants grasped 3D-printed tools in ways considered typical for use (i.e., by their handle). These neural representations were automatically evocated as task performance did not require semantic processing. In fact, findings from a behavioural motion-capture experiment confirmed that actions with tools (relative to non-tool) incurred additional processing costs, as would be suspected if semantic areas are being automatically engaged. These results substantiate theories of semantic cognition that claim the anterior temporal cortex combines sensorimotor and semantic content for advanced behaviours like tool manipulation.

What matters is the underlying experience: Similar motor responses during processing observed hand actions and hand-related verbs

It is well-accepted that processing observed actions involves at some extent the same neural mechanisms responsible for action execution. More recently, it has been forwarded that also the processing of verbs expressing a specific motor content is subserved by the neural mechanisms allowing individuals to perform the content expressed by that linguistic material. This view is also known as embodiment and contrasts with a more classical approach to language processing that considers it as amodal. In the present study, we used a go/no-go paradigm, in which participants were requested to respond to real words and pictures and refrain from responding when presented stimuli were pseudowords and scrambled images. Real stimuli included pictures depicting hand- and foot-related actions and verbs expressing hand- and foot-related actions. We, therefore, directly compared the modulation of hand motor responses during the observation of actions and the presentation of verbs, expressing actions in the same category. The results have shown that participants gave slower hand motor responses during the observation of hand actions and the processing of hand-related verbs as than observed foot actions and related verbs. These findings support embodiment showing that whatever the modality of presentation (observed action or verb), the modulation of hand motor responses was similar, thus suggesting that processing seen actions and related verbs shares common mechanisms most likely involving the motor system and the underlying motor experience.

A novel coding scheme for assessing responses in divergent thinking: An embodied approach

In the present study we devised a novel coding scheme for responses generated in a divergent thinking task. Based on considerations from behavioural and neurocognitive research from an embodied perspective, our scheme aims to capture dimensions of simulations of action or the body. In an exploratory investigation, we applied our novel coding scheme to analyze responses from a previously published dataset of divergent thinking responses. We show that a) these dimensions are reliably coded by naïve raters, and that b) individual differences in creativity influences the way in which different dimensions are used over time. Overall, our results provide new hypotheses about the generation of creative response in the divergent thinking task and should serve to characterize the cognitive strategies used in creative endeavors.

Tool use and function knowledge shape visual object processing

Perceiving the environment automatically informs how we can interact with it through affordance mechanisms. However, it remains unknown how our knowledge about the environment shapes how it is perceived. In this training study, we evaluated whether motor and function knowledge about novel objects affects visual object processing. Forty-three participants associated a usage or function to a novel object in interactive virtual reality while their EEG was recorded. Both usage and function influenced the mu-band (8-12 Hz) rhythms, suggesting that motor and function object information influence motor processing during object recognition. Learning the usage also prevented the reduction of the theta-band (4-8 Hz) rhythms recorded over the posterior cortical areas, suggesting a predominant top-down influence of tool use information on visuo-motor pathways. The modulation being specifically induced by learning an object usage, the results support further the embodied cognition approach rather than the reasoning-based approach of object processing.

Exploring the Role of Action Consequences in the Handle-Response Compatibility Effect

Previous research investigating handle-response compatibility effects with graspable objects used different categories of objects as stimuli, regardless of their specific, intrinsic characteristics. The current study explores whether different types of objects' characteristics may elicit different types of spatial compatibility, that is, handle-response and response-effect compatibility as well as their potential interaction. In Experiment 1, objects having a graspable handle opposite to either a visible functional component (i.e., handle-function objects: a teapot) or a latent functional component (handle-only objects: a pitcher lacking the spout) were presented separately in different blocks. Both the handle and the goal-directed functional components of these objects were located on the horizontal axis. In Experiment 2, handle-only objects had a handle located on the horizontal axis and a latent functional component located on the vertical axis (e.g., a cup). In both experiments, participants were required to judge the material (plastic and metal) the object was made of. Results showed that the handle-response compatibility effect was sensitive to whether the actions consequences of object manipulation took place on the horizontal rather than on the vertical axis.

Precrastination and individual differences in working memory capacity

When ordering tasks, people tend to first perform the task that can be started or completed sooner (precrastination) even if it requires more physical effort. Evidence from transport tasks suggests that precrastination can reduce cognitive effort and will likely not occur if it increases cognitive effort. However, some individuals precrastinate even when it increases cognitive effort. We examined whether individual differences in working memory capacity (WMC) influence this suboptimal choice. Participants retrieved two cups of water along a corridor, in the order of their choosing. We measured the frequency of choosing the close cup first (precrastination) while varying water levels in each cup (attention demand) located at different distances. Results showed that the tendency to select the far cup first (avoid precrastination) increases when the close cup is full (high attention demand) vs. not full (low attention demand). Post-hoc results showed high (vs. low) WMC individuals more frequently bypass decisions with relatively higher costs of cognitive effort, avoiding precrastination when the attentional demand of carrying the close (vs. far) cup is relatively high (close-cup full and far-cup half full), but not when it is relatively low (far-cup full). However, there was no evidence that WMC could explain why some individuals always precrastinated, at costs of cognitive effort. Instead, individuals who always precrastinated reported automatic behavior, and those who avoided precrastinating reported decisions of efficiency. Learning, the relationship between precrastination and tendencies to enjoy/engage in thinking or procrastinate, and evidence that precrastination required more cognitive effort in our task, are discussed.

Language can shape the perception of oriented objects

Seeing an object is a natural source for learning about the object's configuration. We show that language can also shape our knowledge about visual objects. We investigated sign language that enables deaf individuals to communicate through hand movements with as much expressive power as any other natural language. A few signs represent objects in a specific orientation. Sign-language users (signers) recognized visual objects faster when oriented as in the sign, and this match in orientation elicited specific brain responses in signers, as measured by event-related potentials (ERPs). Further analyses suggested that signers' responsiveness to object orientation derived from changes in the visual object representations induced by the signs. Our results also show that language facilitates discrimination between objects of the same kind (e.g., different cars), an effect never reported before with spoken languages. By focusing on sign language we could better characterize the impact of language (a uniquely human ability) on object visual processing.

On the Evolution of a Radical Concept: Affordances According to Gibson and Their Subsequent Use and Development

James J. Gibson, the founder of ecological psychology, introduced a radical empiricist approach to perception and action centered on direct perception in naturalistic environments that was counter to popular representational views of his time. This direct perception approach and the associated introduction of the affordance concept have been extremely influential in several fields of study. However, since its inception, the affordance concept has evolved in a manner such that it now deviates significantly from Gibson's original intention. This review follows use of the affordance concept by four sets of influential experimental psychologists: Gibson, Donald Norman, Mike Tucker and Rob Ellis, and Daniel Bub and Michael Masson. Particular attention is paid to the manner in which they applied the concept and the contributions provided by each set of researchers. The primary goal of this review is to determine what cognitive psychologists can take away from developments within the field and what considerations should be taken into account when using the term affordance. Having a more thorough understanding of the factors that led to the concept of affordance and its recent reformulations will better equip cognitive psychologists and, by extension, human factors researchers to further advance the study of perception-action relations.

Reduced competition between tool action neighbors in left hemisphere stroke

When pantomiming the use of tools, patients with limb apraxia after left hemisphere stroke (LCVA) produce more spatiotemporal hand action errors with tools associated with conflicting actions for use versus grasp-to-pick-up (e.g., corkscrew) than tools having a single action for both use and grasp (e.g., hammer). There are two possible accounts for this pattern of results. Reduced performance with 'conflict' tools may simply reflect weakened automaticity of use action activation, which is evident only when the use and grasp actions are not redundant. Alternatively, poor use performance may reflect a reduced ability of appropriate tool use actions to compete with task-inappropriate action representations. To address this issue, we developed a Stroop-like experiment in which 21 LCVA and 8 neurotypical participants performed pantomime actions in blocks containing two tools that were similar ("neighbors") in terms of hand action or function, or were unrelated on either dimension. In a congruent condition, they pantomimed the use action associated with the visually presented tool, whereas in an incongruent condition, they pantomimed the use action for the other tool in the block. Relative to controls and other task conditions, LCVA participants showed reductions in hand action errors in incongruent relative to congruent action trials; furthermore, the degree of reduction in this incongruence effect was related to the participants' susceptibility to grasp-on-use conflict in a separate test of pantomime to the sight of tools. Support vector regression lesion-symptom mapping analyses identified the left inferior frontal gyrus, supramarginal gyrus, and superior longitudinal fasciculus as core neuroanatomical sites associated with abnormal performance. Collectively, the results indicate that weakened activation of tool use actions in limb apraxia gives rise to reduced ability of these actions to compete for task-appropriate selection when competition arises within single tools (grasp-on-use conflict) as well as between two tools (reduced neighborhood effects).

A pantomiming priming study on the grasp and functional use actions of tools

It has previously been demonstrated that tool recognition is facilitated by the repeated visual presentation of object features affording actions, such as those related to grasping and their functional use. It is unclear, however, if this can also facilitate pantomiming. Participants were presented with an image of a prime followed by a target tool and were required to pantomime the appropriate action for each one. The grasp and functional use attributes of the target tool were either the same or different to the prime. Contrary to expectations, participants were slower at pantomiming the target tool relative to the prime regardless of whether the grasp and function of the tool were the same or different-except when the prime and target tools consisted of identical images of the same exemplar. We also found a decrease in accuracy of performing functional use actions for the target tool relative to the prime when the two differed in functional use but not grasp. We reconcile differences between our findings and those that have performed priming studies on tool recognition with differences in task demands and known differences in how the brain recognises tools and performs actions to make use of them.

Which task will we choose first? Precrastination and cognitive load in task ordering

Precrastination, as opposed to procrastination, is the tendency to embark on tasks as soon as possible, even at the expense of extra physical effort. We examined the generality of this recently discovered phenomenon by extending the methods used to study it, mainly to test the hypothesis that precrastination is motivated by cognitive load reduction. Our participants picked up two objects and brought them back together. Participants in Experiment 1 demonstrated precrastination by picking up the near object first, carrying it back to the farther object, and then returning with both. Also, participants given an additional cognitive task (memory load) had a higher probability of precrastinating than those not given the added cognitive task. The objects in Experiment 1 were buckets with balls that had a very low chance of spillage; carrying them required low demands on attention. The near-object-first preference was eliminated in Experiment 2, where the near and far objects were cups with water that had a high chance of spillage; carrying them required higher demands on attention. Had precrastination occurred in this case, it would have greatly increased cognitive effort. The results establish the generality of precrastination and suggest that it is sensitive to cognitive load. Our results complement others showing that people tend to structure their behavior to minimize cognitive effort. The main new discovery is that people expend more physical effort to do so. We discuss the applied implications of our findings, as well as the possibility that precrastination may be a default, automatic behavior.

The dominant role of functional action representation in object recognition

Action representation of manipulable objects has been found to be involved in object recognition. Recently, studies have indicated the existence of two distinct action systems: functional action specifying how to use an object and structural action concerning how to grasp an object. Despite evidence revealing the systems' anatomical and functional differences, few preceding studies have dissociated their respective roles in object recognition. The present study aimed to tease apart their roles in the recognition of manipulable objects with a priming paradigm. Specifically, we used static stimuli (photos, Experiments 1 and 2) and dynamic stimuli (video clips, Experiments 3 and 4) depicting functional and structural action hand gestures as primes and measured the magnitude of functional and structural action priming effect in object recognition. We found that static and dynamic priming stimuli induced a robust action priming effect only for functional action prime-target pairs. Naming latencies of the target objects were shorter when functional action representations of the prime and target were congruent than when they were incongruent. Moreover, as compared to static priming photos, dynamic priming stimuli induced a larger functional action priming effect. By contrast, neither static nor dynamic priming stimuli elicited a structural action priming effect. Behavioral data from our four experiments provide consistent evidence of the dominant role of functional action representation in the recognition of manipulable objects, suggesting that action knowledge regarding how to use rather than grasp an object is more likely an intrinsic component of objects' conceptual representation.

Bilateral functional connectivity at rest predicts apraxic symptoms after left hemisphere stroke

Increasing evidence indicates that focal lesions following stroke cause alterations in connectivity among functional brain networks. Functional connectivity between hemispheres has been shown to be particularly critical for predicting stroke-related behavioral deficits and recovery of motor function and attention. Much less is known, however, about the relevance of interhemispheric functional connectivity for cognitive abilities like praxis that rely on strongly lateralized brain networks. In the current study, we examine correlations between symptoms of apraxia-a disorder of skilled action that cannot be attributed to lower-level sensory or motor impairments-and spontaneous, resting brain activity in functional MRI in chronic left hemisphere stroke patients and neurologically-intact control participants. Using a data-driven approach, we identified 32 regions-of-interest in which pairwise functional connectivity correlated with two distinct measures of apraxia, even when controlling for age, head motion, lesion volume, and other artifacts: overall ability to pantomime the typical use of a tool, and disproportionate difficulty pantomiming the use of tools associated with different, competing use and grasp-to-move actions (e.g., setting a kitchen timer versus picking it up). Better performance on both measures correlated with stronger interhemispheric functional connectivity. Relevant regions in the right hemisphere were often homologous to left hemisphere areas associated with tool use and action. Additionally, relative to overall pantomime accuracy, disproportionate difficulty pantomiming the use of tools associated with competing use and grasp actions was associated with weakened functional connectivity among a more strongly left-lateralized and peri-Sylvian set of brain regions. Finally, patient performance on both measures of apraxia was best predicted by a model that incorporated information about lesion location and functional connectivity, and functional connectivity continued to explain unique variance in behavior even after accounting for lesion loci. These results indicate that interhemispheric functional connectivity is relevant even for a strongly lateralized cognitive ability like praxis and emphasize the importance of the right hemisphere in skilled action.

Concurrent Cortical Representations of Function- and Size-Related Object Affordances: An fMRI Study

Previous work has shown that the perception of a graspable object may automatically potentiate actions that are tailored to specific action-related features of the object (e.g., its size) and may be related to its immediate grasping as well as to its long-term, functional use. We investigated the neural correlates of function- and size-related object affordances that may be concurrently potentiated by a graspable object. Participants were lying in a MR scanner holding a large switch in one hand and a small switch in the other hand. They passively attended a large or a small object with clearly separated functional and graspable end that was displayed centrally at an average angle of 45 degrees. Participants responded to the direction of an arrow that was overlaid on the object after a mean period of 1,000 ms after object onset and was pointing to the left or to the right with equal probability. Response times were shorter when the arrow pointed to the functional end of the object and when the responses were made with the switch that was congruent to the size of the perceived object. A clear distinction was found in the representation of function- and size-related affordances; the former was represented in the posterior parietal cortex and the latter in prefrontal, premotor, and primary sensorimotor cortices. We conclude that different aspects of object-directed actions may be automatically potentiated by individual object features and are represented in distinct brain areas.

Thai Norms for Name, Image, and Category Agreement, Object Familiarity, Visual Complexity, Manipulability, and Age of Acquisition for 480 Color Photographic Objects

Normative databases containing psycholinguistic variables are commonly used to aid stimulus selection for investigations into language and other cognitive processes. Norms exist for many languages, but not for Thai. The aim of the present research, therefore, was to obtain Thai normative data for the BOSS, a set of 480 high resolution color photographic images of real objects (Brodeur et al. in PLoS ONE 5(5), 2010.  https://doi.org/10.1371/journal.pone.0010773 ). Norms were provided by 584 Thai university students on eight dimensions: name agreement, object familiarity, visual complexity, category agreement, image agreement, two types of manipulability (graspability and mimeability), and age of acquisition. The results revealed comparatively similar levels of name agreement to Brodeur et al. especially when unfamiliar items were factored out. The pattern of intercorrelations among the Thai psycholinguistic norms was comparable to previous studies and our cross-linguistic correlations were robust for the same set of pictures in English and French. Conjointly, the findings extend the relevancy of the BOSS to Thailand, supporting this photographic resource for investigations of language and other cognitive processes in monolingual, multilingual, and brain-impaired populations.

Switching between lift and use grasp actions

Switching between competing grasp postures incurs costs on speeded performance. We examined switch costs between lift versus use actions under task conditions that required subjects to identify familiar objects. There were no asymmetrical interference effects, though reliable costs occurred when the same object required a different action on consecutive trials. In addition, lift actions were faster to objects targeted for a prospective use action than objects irrelevant to this intended goal. The benefit of a lift-then-use action sequence was not merely due to the production of two different actions in short order on the same object; use actions to an object marked for the distal goal of a lift action were not faster than use actions applied to another object. We propose that the intention to use an object facilitates the prior action of lifting it because the motor sequence lift-then-use is habitually conscripted to enact the proper function of an object.

Effects of grasp compatibility on long-term memory for objects

Previous studies have shown action potentiation during conceptual processing of manipulable objects. In four experiments, we investigated whether these motor actions also play a role in long-term memory. Participants categorized objects that afforded either a power grasp or a precision grasp as natural or artifact by grasping cylinders with either a power grasp or a precision grasp. In all experiments, responses were faster when the affordance of the object was compatible with the type of grasp response. However, subsequent free recall and recognition memory tasks revealed no better memory for object pictures and object names for which the grasp affordance was compatible with the grasp response. The present results therefore do not support the hypothesis that motor actions play a role in long-term memory.

Limb apraxia and the left parietal lobe

Limb apraxia is a heterogeneous disorder of skilled action and tool use that has long perplexed clinicians and researchers. It occurs after damage to various loci in a densely interconnected network of regions in the left temporal, parietal, and frontal lobes. Historically, a highly classificatory approach to the study of apraxia documented numerous patterns of performance related to two major apraxia subtypes: ideational and ideomotor apraxia. More recently, there have been advances in our understanding of the functional neuroanatomy and connectivity of the left-hemisphere "tool use network," and the patterns of performance that emerge from lesions to different loci within this network. This chapter focuses on the left inferior parietal lobe, and its role in tool and body representation, action prediction, and action selection, and how these functions relate to the deficits seen in patients with apraxia subsequent to parietal lesions. Finally, suggestions are offered for several future directions that will benefit the study of apraxia, including increased attention to research on rehabilitation of this disabling disorder.

Graspable Objects Grab Attention More Than Images Do

The opportunity an object presents for action is known as an affordance. A basic assumption in previous research was that images of objects, which do not afford physical action, elicit effects on attention and behavior comparable with those of real-world tangible objects. Using a flanker task, we compared interference effects between real graspable objects and matched 2-D or 3-D images of the items. Compared with both 2-D and 3-D images, real objects yielded slower response times overall and elicited greater flanker interference effects. When the real objects were positioned out of reach or behind a transparent barrier, the pattern of response times and interference effects was comparable with that for 2-D images. Graspable objects exert a more powerful influence on attention and manual responses than images because of the affordances they offer for manual interaction. These results raise questions about whether images are suitable proxies for real objects in psychological research.

Sensory and semantic activations evoked by action attributes of manipulable objects: Evidence from ERPs

"Two route" theories of object-related action processing posit different temporal activation profiles of grasp-to-move actions (rapidly evoked based on object structure) versus skilled use actions (more slowly activated based on semantic knowledge). We capitalized on the exquisite temporal resolution and multidimensionality of Event-Related Potentials (ERPs) to directly test this hypothesis. Participants viewed manipulable objects (e.g., calculator) preceded by objects sharing either "grasp", "use", or no action attributes (e.g., bar of soap, keyboard, earring, respectively), as well as by action-unrelated but taxonomically-related objects (e.g., abacus); participants judged whether the two objects were related. The results showed more positive responses to "grasp-to-move" primed objects than "skilled use" primed objects or unprimed objects starting in the P1 (0-150 ms) time window and continuing onto the subsequent N1 and P2 components (150-300 ms), suggesting that only "grasp-to-move", but not "skilled use", actions may facilitate visual attention to object attributes. Furthermore, reliably reduced N400s (300-500 ms), an index of semantic processing, were observed to taxonomically primed and "skilled use" primed objects relative to unprimed objects, suggesting that "skilled use" action attributes are a component of distributed, multimodal semantic representations of objects. Together, our findings provide evidence supporting two-route theories by demonstrating that "grasp-to-move" and "skilled use" actions impact different aspects of object processing and highlight the relationship of "skilled use" information to other aspects of semantic memory.

Learning, remembering, and predicting how to use tools: Distributed neurocognitive mechanisms: Comment on Osiurak and Badets (2016)

The reasoning-based approach championed by Francois Osiurak and Arnaud Badets (Osiurak & Badets, 2016) denies the existence of sensory-motor memories of tool use except in limited circumstances, and suggests instead that most tool use is subserved solely by online technical reasoning about tool properties. In this commentary, I highlight the strengths and limitations of the reasoning-based approach and review a number of lines of evidence that manipulation knowledge is in fact used in tool action tasks. In addition, I present a "two route" neurocognitive model of tool use called the "Two Action Systems Plus (2AS+)" framework that posits a complementary role for online and stored information and specifies the neurocognitive substrates of task-relevant action selection. This framework, unlike the reasoning based approach, has the potential to integrate the existing psychological and functional neuroanatomic data in the tool use domain. (PsycINFO Database Record

Is there a Competition between Functional and Situational Affordances during Action Initiation with Everyday Tools?

Most studies of human-tool interactions focus on the typical use of a tool (e.g., cutting in the case of a knife). However, little is known about situations requiring atypical tool use (e.g., using a knife to tighten a screw). The present study focused on a selection of atypical uses of everyday tools which might be in conflict with their typical use. Our objective was to study how tool function influences the selection of the relevant action. In Experiment 1, which involved visuomotor priming, two everyday tools (a knife and a screwdriver) and two neutral tools (two bars, with no strong functional affordance) were used as primes and targets. Participants had to use the target with the appropriate box (indicated by the color) that allowed to make an action. Longer initiation times were observed when the prime was an everyday tool, irrespective of the nature of the target. We therefore observed a conflict between functional and situational affordances. To investigate whether the priming effect is caused by the task-irrelevance of the prime, we asked the participants in Experiment 2 to perform an action associated with the prime. The results showed longer initiation times only when the prime and target were everyday tools, irrespective of their precise nature. This suggests that activation of the typical use of a tool might not be fully automatic but flexible depending on the situation.

Chained Activation of the Motor System during Language Understanding

Two experiments were carried out to investigate whether and how one important characteristic of the motor system, that is its goal-directed organization in motor chains, is reflected in language processing. This possibility stems from the embodied theory of language, according to which the linguistic system re-uses the structures of the motor system. The participants were presented with nouns of common tools preceded by a pair of verbs expressing grasping or observational motor chains (i.e., grasp-to-move, grasp-to-use, look-at-to-grasp, and look-at-to-stare). They decided whether the tool mentioned in the sentence was the same as that displayed in a picture presented shortly after. A primacy of the grasp-to-use motor chain over the other motor chains in priming the participants' performance was observed in both the experiments. More interestingly, we found that the motor information evoked by the noun was modulated by the specific motor-chain expressed by the preceding verbs. Specifically, with the grasping chain aimed at using the tool, the functional motor information prevailed over the volumetric information, and vice versa with the grasping chain aimed at moving the tool (Experiment 2). Instead, the functional and volumetric information were balanced for those motor chains that comprise at least an observational act (Experiment 1). Overall our results are in keeping with the embodied theory of language and suggest that understanding sentences expressing an action directed toward a tool drives a chained activation of the motor system.

Through the forest of motor representations

Following neuroscience, and using different labels, several philosophers have addressed the idea of the presence of a single representational mechanism lying in between (visual) perceptual processes and motor processes involved in different functions and useful for shaping suitable action performances: a motor representation (MR). MRs are the naturalized mental antecedents of action. This paper presents a new, non-monolithic view of MRs, according to which, contrarily to the received view, when looking at in between (visual) perceptual processes and motor processes, we find not only a single representational mechanism with different functions, but an ensemble of different sub-representational phenomena, each of which with a different function. This new view is able to avoid several issues emerging from the literature and to address something the literature is silent about, which however turns out to be crucial for a theory of MRs.

Manipulability agreement as a predictor of action initiation latency

In the domain of cognition, an increasing number of researchers are interested in the role of objects' motor affordances in cognitive processing. However, outside of the existing norms on the objects' levels of manipulability (e.g., Magnié, Besson, Poncet, & Dolisi, Journal of Clinical and Experimental Neuropsychology, 25:521-560,2003), relatively few norms exist that would allow researchers to have good control over objects' motor dimensions. In the present study, we have provided norms on the extent to which participants agreed about the movements typically performed for using specific objects--what we will call manipulability agreement. We showed that manipulability agreement was a good predictor of the times needed to initiate the action associated with the object. This study provides ratings on a new dimension of objects' motor affordances that could be useful to researchers in the domain of visual cognition.

Visual objects speak louder than words: motor planning and weight in tool use and object transport

For theories of embodied cognition, reading a word activates sensorimotor representations in a similar manner to seeing the physical object the word represents. Thus, reading words representing objects of different sizes interfere with motor planning, inducing changes in grip aperture. An outstanding issue is whether word reading can also evoke sensorimotor information about the weight of objects. This issue was addressed in two experiments wherein participants have first to read the name of an object (Experiment 1)/observe the object (Experiment 2) and then to transport versus use bottles of water. The objects presented as primes were either lighter or heavier than the bottles to be grasped. Results indicated that the main parameters of motor planning recorded (initiation times and finger contact points) were not affected by the presentation of words as primes (Experiment 1). By contrast, the presentation of visual objects as primes induced significant changes in these parameters (Experiment 2). Participants changed their way of grasping the bottles, particularly in the use condition. Taken together, these results suggest that the activation of concepts does not automatically evoke sensorimotor representations about the weight of objects, but visual objects do.

Manipulation gesture effect in visual and auditory presentations: the link between tools in perceptual and motor tasks

There is much behavioral and neurophysiological evidence in support of the idea that seeing a tool activates motor components of action related to the perceived object (e.g., grasping, use manipulation). However, the question remains as to whether the processing of the motor components associated with the tool is automatic or depends on the situation, including the task and the modality of tool presentation. The present study investigated whether the activation of motor components involved in tool use in response to the simple perception of a tool is influenced by the link between prime and target tools, as well as by the modality of presentation, in perceptual or motor tasks. To explore this issue, we manipulated the similarity of gesture involved in the use of the prime and target (identical, similar, different) with two tool presentation modalities of the presentation tool (visual or auditory) in perceptual and motor tasks. Across the experiments, we also manipulated the relevance of the prime (i.e., associated or not with the current task). The participants saw a first tool (or heard the sound it makes), which was immediately followed by a second tool on which they had to perform a perceptual task (i.e., indicate whether the second tool was identical to or different from the first tool) or a motor task (i.e., manipulate the second tool as if it were the first tool). In both tasks, the similarity between the gestures employed for the first and the second tool was manipulated (Identical, Similar or Different gestures). The results showed that responses were faster when the manipulation gestures for the two tools were identical or similar, but only in the motor task. This effect was observed irrespective of the modality of presentation of the first tool, i.e., visual or auditory. We suggest that the influence of manipulation gesture on response time depends on the relevance of the first tool in motor tasks. We discuss these motor activation results in terms of the relevance and demands of the tasks.

Grasping an object comfortably: orientation information is held in memory

It has been shown that memorized information can influence real-time visuomotor control. For instance, a previously seen object (prime) influences grasping movements toward a target object. In this study, we examined how general the priming effect is: does it depend on the orientation of the target object and the similarity between the prime and the target? To do so, we examined whether priming effects occured for different orientations of the prime and the target objects and for primes that were either identical to the target object or only half of the target object. We found that for orientations of the target object that did not require an awkward grasp, the orientation of the prime could influence the initiation time and the final grip orientation. The priming effects on initiation time were only found when the whole target object was presented as prime, but not when only half of the target object was presented. The results suggest that a memory effect on real-time control is constrained by end-state comfort and by the relevance of the prime for the grasping movement, which might mean that the interactions between the ventral and dorsal pathways are task specific.