Is that graspable? Let your right hand be the judge

Reliable affordances: A generative modeling approach for test-retest reliability of the affordances task

The affordances task serves as an important tool for the assessment of cognition and visuomotor functioning, and yet its test-retest reliability has not been established. In the affordances task, participants attend to a goal-directed task (e.g., classifying manipulable objects such as cups and pots) while suppressing their stimulus-driven, irrelevant reactions afforded by these objects (e.g., grasping their handles). This results in cognitive conflicts manifesting at the task level and the response level. In the current study, we assessed the reliability of the affordances task for the first time. While doing so, we referred to the "reliability paradox," according to which behavioral tasks that produce highly replicable group-level effects often yield low test-retest reliability due to the inadequacy of traditional correlation methods in capturing individual differences between participants. Alongside the simple test-retest correlations, we employed a Bayesian generative model that was recently demonstrated to result in a more precise estimation of test-retest reliability. Two hundred and ninety-five participants completed an online version of the affordances task twice, with a one-week gap. Performance on the online version replicated results obtained under in-lab administrations of the task. While the simple correlation method resulted in weak test-retest measures of the different effects, the generative model yielded a good reliability assessment. The current results support the utility of the affordances task as a reliable behavioral tool for the assessment of group-level and individual differences in cognitive and visuomotor functioning. The results further support the employment of generative modeling in the study of individual differences.

Too much to handle? Interference from distractors with similar affordances on target selection for handled objects

The existence of handle affordances has been classically demonstrated using the Stimulus-Response Compatibility paradigm, with shorter response times when the orientation of the object handle and the response hand are compatible in comparison to incompatible. Yet the activation of handle affordances from visual objects has been investigated in very simple situations involving single stimulus and motor response. As natural perceptual scenes are usually composed of multiple objects that could activate multiple affordances, the consequence of multiple affordance activation on the perception and processing of a given object of the scene requires more investigation. The aim of this study was to determine the impact of distractor affordances on the processing of a target object in situations involving several familiar graspable objects. In two online experiments, 229 participants had to select a target object (the kitchen utensil or the tool) in a visual scene displaying a pair of objects. They performed left key presses when the target was on the left and right key presses when the target was on the right. Target handle orientation and response side could be compatible or incompatible. Critically, target and distractor objects had similar or dissimilar handle affordances, with handles oriented for left- or right-hand grasps. Results from the two experiments showed slower response times when target and distractor objects had similar handle affordances in comparison to dissimilar affordances, when participants performed right hand responses and when target orientation and response were compatible. Thus, affordance similarity between objects may interfere rather than facilitate object processing and slow down target selection. These findings are in line with models of affordance and object selection assuming automatic inhibition of distractors' affordances for appropriate object interaction.

The Inhibition Effect of Affordances in Action Picture Naming: An ERP Study

How quickly are different kinds of conceptual knowledge activated in action picture naming? Using a masked priming paradigm, we manipulated the prime category type (artificial vs. natural), prime action type (precision, power, vs. neutral grip), and target action type (precision vs. power grip) in action picture naming, while electrophysiological signals were measured concurrently. Naming latencies showed an inhibition effect in the congruent action type condition compared with the neutral condition. ERP results showed that artificial and natural category primes induced smaller waveforms in precision or power action primes than neutral primes in the time window of 100-200 msec. Time-frequency results consistently presented a power desynchronization of the mu rhythm in the time window of 0-210 msec with precision action type artificial objects compared with neutral primes, which localized at the supplementary motor, precentral and postcentral areas in the left hemisphere. These findings suggest an inhibitory effect of affordances arising at conceptual preparation in action picture naming and provide evidence for embodied cognition.

Neutral affordances: Task conflict in the affordances task

Task conflict emerges when a stimulus triggers two or more competing tasks. To date, task conflict has been studied mainly using the color-word Stroop task. We hypothesized that task conflict also emerges in the affordances task between the goal-directed relevant task (e.g., classifying manipulable objects such as cups and pots), and the automatic, stimulus-driven, irrelevant task afforded by these objects (e.g., grasping their handles). Thus, we expected task conflict to manifest in both congruent and incongruent trials, separately from the well-known affordances response conflict that manifests in incongruent trials between responding with the right vs. the left hand. To this end, we aimed to identify a neutral condition for the affordances task. In Experiment 1, participants performed an affordances task that included images of manipulable objects and houses. While manipulable objects evoke automatic grasping tendencies, house images were hypothesized to serve as neutral, conflict-free stimuli. House images yielded shorter reaction time (RT) than incongruent trials, indicating that they may serve as neutral stimuli for the task. House images also yielded shorter RT than congruent trials, suggesting that task conflict manifests in congruent (as well as in incongruent) affordances trials. In Experiment 2 we manipulated cognitive control in the affordance task by creating low-control and high-control blocks. While both congruent and incongruent trials were impacted by this manipulation of cognitive control, neutral trials remained unaffected. These findings indicate that the affordances task involves conflicts at both the task level and the level of response, and can be used as a supplementary, non-linguistic measure of task conflict and the activation of task control.

No fruits without color: Cross-modal priming and EEG reveal different roles for different features across semantic categories

Category-specific impairments witnessed in patients with semantic deficits have broadly dissociated into natural and artificial kinds. However, how the category of food (more specifically, fruits and vegetables) fits into this distinction has been difficult to interpret, given a pattern of deficit that has inconsistently mapped onto either kind, despite its intuitive membership to the natural domain. The present study explores the effects of a manipulation of a visual sensory (i.e., color) or functional (i.e., orientation) feature on the consequential semantic processing of fruits and vegetables (and tools, by comparison), first at the behavioral and then at the neural level. The categorization of natural (i.e., fruits/vegetables) and artificial (i.e., utensils) entities was investigated via cross-modal priming. Reaction time analysis indicated a reduction in priming for color-modified natural entities and orientation-modified artificial entities. Standard event-related potentials (ERP) analysis was performed, in addition to linear classification. For natural entities, a N400 effect at central channel sites was observed for the color-modified condition compared relative to normal and orientation conditions, with this difference confirmed by classification analysis. Conversely, there was no significant difference between conditions for the artificial category in either analysis. These findings provide strong evidence that color is an integral property to the categorization of fruits/vegetables, thus substantiating the claim that feature-based processing guides as a function of semantic category.

Does a smartphone on the desk drain our brain? No evidence of cognitive costs due to smartphone presence in a short-term and prospective memory task

It has recently been shown that the mere presence of one's own smartphone on the desk impairs working memory performance. The aim of this study was to follow up on this important finding by assessing the effect of smartphone presence (present on the desk vs. absent from the desk) on different memory functions (short-term memory and prospective memory), and by further examining the moderating role of individual differences in smartphone dependency and impulsiveness. We found no overall effect of smartphone presence on short-term and prospective memory performance. There was a moderating effect for prospective memory: Performance was better when the smartphone was absent versus present for participants with low smartphone dependency. In light of the absence of an overall effect of smartphone presence on memory functions, our results show that previous findings of impairments in working memory due to smartphone presence do not generalize to other domains of memory capacity.

Control over task conflict in the stroop and affordances tasks: an individual differences study

Task conflict is a type of conflict that emerges when a stimulus triggers two or more competing tasks. In the Stroop task, task conflict occurs between the relevant color-naming task and irrelevant word reading task and can be observed mainly on congruent trials, which only involve task conflict and are devoid of additional conflict types. We hypothesized that task conflict also manifests in the affordances task between the relevant task (e.g., classifying manipulatable objects), and the automatic task afforded by the object (e.g., grasping the object), and is mostly evident on congruent trials. Using an individual differences design we assessed the relationship between control mechanisms operating on Stroop congruent and affordances congruent trials under conditions of high and low cognitive control requirements. We hypothesized that task control is employed in both tasks. One-hundred and twenty-three participants performed an affordances task and two blocks of a Stroop task, each requiring a different level of task control (high vs. low). In a hierarchical regression model, we found a significant and specific correlation between affordances congruent and Stroop congruent conditions only in the high-control block, designed to greatly engage participants' task control, thus linking the task control mechanism in both tasks. These results indicate that task control underlies diverse modalities of response (visuomotor and linguistic), independently of other conflict types. We suggest that the affordances task may serve as a supplementary tool for the assessment of task control in the lab.

Infants plan prehension while pivoting

Skilled object retrieval requires coordination of the perceptual and motor systems. Coordination is especially challenging when body position is changing and visual search is required to locate the target. In three experiments, we used a "pivot paradigm" to induce changes in body position: Participants were passively pivoted 180° toward a target placed at varied locations to the left and right of the center of a reaching board. Experiment 1 showed that 6- to 15-month-old infants (n = 41) plan prehension so quickly that they retrieve targets mid-turn and scale their reaches to target location relative to turn direction. Experiment 2 characterized planning mid-turn reaching in 6- to 8-month-olds (n = 5) wearing a head-mounted eye tracker. Reach planning depended on when the target appeared in the field of view-not on target fixation. Experiment 3 used head-mounted eye tracking and motion tracking to assess perceptual-motor coordination in adults (n = 13). Adults displayed more mid-turn reaching than infants. But like infants, adults scaled reaching to target location relative to turn direction, and contact time depended on when the target came into view-not on target fixation. Findings show that fast, efficient perceptual-motor coordination supports flexibility in infant prehension, and constraints on coordination are similar across the lifespan.

Sensorimotor lateralization scaffolds cognitive specialization

In this chapter, we review hemispheric differences for sensorimotor function and cognitive abilities. Specifically, we examine the left-hemisphere specialization for visuomotor control and its interplay with language, executive function, and musical training. Similarly, we discuss right-hemisphere lateralization for haptic processing and its relationship to spatial and numerical processing. We propose that cerebral lateralization for sensorimotor functions served as a foundation for the development of higher cognitive abilities and their hemispheric functional specialization. We further suggest that sensorimotor and cognitive functions are inextricably linked. Based on the studies discussed in this chapter our view is that sensorimotor control serves as a loom upon which the fibers of language, executive function, spatial, and numerical processing are woven together to create the fabric of cognition.

Wait wait, don't tell me: Handedness questionnaires do not predict hand preference for grasping

Handedness questionnaires are a common screening tool in psychology and neuroscience, used whenever a participant's performance on a given task may conceivably be affected by their laterality. Two widely-used examples of such questionnaires are the Edinburgh Handedness Inventory and the Waterloo Handedness Questionnaire. Both instruments ask respondents to report their hand preference for performing a variety of common tasks (e.g., throwing a ball, or opening a drawer). Here we combined questions from the two instruments (E-WHQ; 22 questions total) and asked participants to report their preferred hand for each via a five-point scale. The purpose of this study was to determine whether responses on the E-WHQ are accurate, reliable, and/or predictive of hand-preference for a simple grasp-to-construct task. Regarding accuracy, handedness scores were 5% lower when participants used a scrambled response key versus a consistent one. Test-retest reliability of the questionnaire was weak, with any given inventory item eliciting a different response from 34% of respondents upon retesting. Neither was the E-WHQ predictively useful-although both left- and right-handers preferred their dominant hands, E-WHQ score did not correlate with overall percentage of dominant-hand grasps in either group. We conclude that the E-WHQ is unsuited for predicting hand preference for grasping.

Action properties of object images facilitate visual search

There is mounting evidence that constraints from action can influence the early stages of object selection, even in the absence of any explicit preparation for action. Here, we examined whether action properties of images can influence visual search, and whether such effects were modulated by hand preference. Observers searched for an oddball target among 3 distractors. The search arrays consisted either of images of graspable "handles" ("action-related" stimuli), or images that were otherwise identical to the handles but in which the semicircular fulcrum element was reoriented so that the stimuli no longer looked like graspable objects ("non-action-related" stimuli). In Experiment 1, right-handed observers, who have been shown previously to prefer to use the right hand over the left for manual tasks, were faster to detect targets in action-related versus non-action-related arrays, and showed a response time (reaction time [RT]) advantage for rightward- versus leftward-oriented action-related handles. In Experiment 2, left-handed observers, who have been shown to use the left and right hands relatively equally in manual tasks, were also faster to detect targets in the action-related versus non-action-related arrays, but RTs were equally fast for rightward- and leftward-oriented handle targets. Together, or results suggest that action properties in images, and constraints for action imposed by preferences for manual interaction with objects, can influence attentional selection in the context of visual search. (PsycINFO Database Record

The contributions of vision and haptics to reaching and grasping

This review aims to provide a comprehensive outlook on the sensory (visual and haptic) contributions to reaching and grasping. The focus is on studies in developing children, normal, and neuropsychological populations, and in sensory-deprived individuals. Studies have suggested a right-hand/left-hemisphere specialization for visually guided grasping and a left-hand/right-hemisphere specialization for haptically guided object recognition. This poses the interesting possibility that when vision is not available and grasping relies heavily on the haptic system, there is an advantage to use the left hand. We review the evidence for this possibility and dissect the unique contributions of the visual and haptic systems to grasping. We ultimately discuss how the integration of these two sensory modalities shape hand preference.

Manual preferences for visually- and haptically-guided grasping

Studies have shown that individuals exhibit a right-hand preference for grasping during visually-guided tasks. Recently, we have found that when vision is occluded right-hand preference decreases dramatically. It remains unknown however, if this decrease is a result of visual occlusion or the effects of relying only on haptic feedback. Therefore, in the present study, we sought to explore the contributions of vision and haptics (separately and in conjunction) to hand preference for grasping. Right- and left-handed individuals were tested on a block building task under four different visual and haptic conditions: 1) vision/normal haptic feedback (V/H), 2) no vision/normal haptic feedback (NV/H), 3) vision/constrained haptic feedback (V/Constrained-H), and 4) no vision/constrained haptic feedback (NV/Constrained-H). Vision was occluded using a blindfold and haptic feedback was constrained by asking participants to wear textured gloves. Right-handed individuals displayed a right-hand preference when vision was available (V/H and V/Constrained-H groups), but this preference was much greater when haptic feedback was constrained (V/Constrained-H group). When vision was occluded and haptic feedback was used to complete the task (NV/H) no hand preference was found. Finally hand preference was similar between the V/H and the NV/Constrained-H groups. For left-handed individuals, no differences in hand use were found between the different sensory groups, but the NV/H group showed a clear left-hand preference for haptically-guided grasping. The results suggest that haptics plays an important role in hand preference for grasping. Furthermore, they support a left-hand/right-hemisphere specialization for haptically-guided grasping (regardless of handedness) and a right-hand/left-hemisphere specialization for visually-guided grasping (at least in right-handed individuals).