Sensory and semantic activations evoked by action attributes of manipulable objects: Evidence from ERPs

No need to integrate action information during coarse semantic processing of man-made tools

Action representation of man-made tools consists of two subtypes: structural action representation concerning how to grasp an object, and functional action representation concerning the skilled use of an object. Compared to structural action representation, functional action representation plays the dominant role in fine-grained (i.e., basic level) object recognition. However, it remains unclear whether the two types of action representation are involved differently in the coarse semantic processing in which the object is recognized at a superordinate level (i.e., living/non-living). Here we conducted three experiments using the priming paradigm, in which video clips displaying structural and functional action hand gestures were used as prime stimuli and grayscale photos of man-made tools were used as target stimuli. Participants recognized the target objects at the basic level in Experiment 1 (i.e., naming task) and at the superordinate level in Experiments 2 and 3 (i.e., categorization task). We observed a significant priming effect for functional action prime-target pairs only in the naming task. In contrast, no priming effect was found in either the naming or the categorization task for the structural action prime-target pairs (Experiment 2), even when the categorization task was preceded by a preliminary action imitation of the prime gestures (Experiment 3). Our results suggest that only functional action information is retrieved during fine-grained object processing. In contrast, coarse semantic processing does not require the integration of either structural or functional action information.

Early neural markers for individual difference in mathematical achievement determined from rational number processing

The neural markers for individual differences in mathematical achievement have been studied extensively using magnetic resonance imaging; however, high temporal resolution electrophysiological evidence for individual differences in mathematical achievement require further elucidation. This study evaluated the event-related potential (ERP) when 48 college students with high or low mathematical achievement (HA vs. LA) matched non-symbolic and symbolic rational numbers. Behavioral results indicated that HA students had better performance in the discretized non-symbolic matching, although the two groups showed similar performances in the continuous matching. ERP data revealed that even before non-symbolic stimulus presentation, HA students had greater Bereitschaftspotential (BP) amplitudes over posterior central electrodes. After the presentation of non-symbolic numbers, HA students had larger N1 amplitudes at 160 ms post-stimulus, over left-lateralized parieto-occipital electrodes. After the presentation of symbolic numbers, HA students displayed more profound P1 amplitudes at 100 ms post-stimulus, over left parietal electrodes. Furthermore, larger BP and N1 amplitudes were associated with the shorter reaction times, and larger P1 amplitudes corresponded to lower error rates. The BP effect could indicate preparation processing, and early left-lateralized N1 and P1 effects could reflect the non-symbolic and symbolic number processing along the dorsal neural pathways. These results suggest that the left-lateralized P1 and N1 components elicited by matching non-symbolic and symbolic rational numbers can be considered as neurocognitive markers for individual differences in mathematical achievement.

Lateralization as a symphony: Joint influence of interhemispheric inhibition and transmission on brain asymmetry and syntactic processing

This study investigated the roles of cross-hemispheric communications in promoting left-lateralized syntactic processing in the brain. Fifty-six young right-handers without familial sinistrality background underwent a divided visual field ERP grammaticality judgment experiment to assess syntactic processing in each hemisphere. Two behavioral tasks -the bilateral flanker task and bilateral word matching task, were used to assess cross-hemispheric inhibition and transmission. Grand average ERP data showed a significant P600 grammaticality effect in the left hemisphere (LH) only; however, individual variations in the P600 responses were observed in both hemispheres. Results of correlational analyses showed that larger LH P600 effects were associated with slower inter-hemispheric transmissions; smaller right hemisphere (RH) P600 effects were associated with more effective RH inhibition. These results yielded support for both the callosal distance hypothesis and the inhibition hypothesis for language lateralization and demonstrated that different aspects of cross-hemispheric communications jointly influence the degree of syntactic lateralization.

Hand-related action words impair action anticipation in expert table tennis players: Behavioral and neural evidence

Athletes extract kinematic information to anticipate action outcomes. Here, we examined the influence of linguistic information (experiment 1, 2) and its underlying neural correlates (experiment 2) on anticipatory judgment. Table tennis experts and novices remembered a hand- or leg-related verb or a spatial location while predicting the trajectory of a ball in a video occluded at the moment of the serve. Experiment 1 showed that predictions by experts were more accurate than novices, but experts' accuracy significantly decreased when hand-related words versus spatial locations were memorized. For nonoccluded videos with ball trajectories congruent or incongruent with server actions in experiment 2, remembering hand-related verbs shared cognitive resources with action anticipation only in experts, with heightened processing load (increased P3 amplitude) and more efficient conflict monitoring (decreased N2 amplitude) versus leg-related verbs. Thus, action anticipation required updating of motor representations facilitated by motor expertize but was also affected by effector-specific semantic representations of actions, suggesting a link from language to motor systems.

Reduced right-hemisphere ERP P600 grammaticality effect is associated with greater right-hemisphere inhibition: Evidence from right-handers with familial sinistrality

The present study examined the hypothesis that left hemisphere (LH) equivalent language capabilities in the right hemisphere (RH) are inhibited in neurologically intact individuals by testing healthy young right-handers with a history of familial sinistrality (FS+, i.e. with at least one left handed biological relative), a population documented to show greater variability for RH language processing. Event-Related Potential (ERP) and split visual field presentation techniques were combined to assess LH- and RH- biased responses to syntactic category violations. In addition, a bilateral flanker task was used to measure inter-hemispheric inhibition ability in the same set of participants. Replicating prior findings, in addition to the LH-biased P600 grammaticality effect previously seen for right-handers in general, a fair amount, though not all, of FS + right-handers showed RH-biased P600 responses, leading to a reliable RH P600 grammaticality effect at the group level. Capitalizing on the variability of RH P600 responses, our results further revealed that reduced RH-biased P600 effects were reliably correlated with more effective RH inhibition (indexed by smaller reaction time differences between incongruent and neutral flankers presented to the RH via the left visual field). These results corroborated previous findings that the RH is capable of processing syntactic information in a manner qualitatively similar to that in the LH and further demonstrated that LH-equivalent processing in the RH as indexed by the P600 responses is modulated by RH inhibition, contributing to inter-individual variability in syntactic lateralization.

Predicting domain-specific actions in expert table tennis players activates the semantic brain network

Motor expertise acquired during long-term training in sports enables top athletes to predict the outcomes of domain-specific actions better than nonexperts do. However, whether expert players encode actions, in addition to the concrete sensorimotor level, also at a more abstract, conceptual level, remains unclear. The present study manipulated the congruence between body kinematics and the subsequent ball trajectory in videos of an expert player performing table tennis serves. By using functional magnetic resonance imaging, the brain activity was evaluated in expert and nonexpert table tennis players during their predictions on the fate of the ball trajectory in congruent versus incongruent videos. Compared with novices, expert players showed greater activation in the sensorimotor areas (right precentral and postcentral gyri) in the comparison between incongruent vs. congruent videos. They also showed greater activation in areas related to semantic processing: the posterior inferior parietal lobe (angular gyrus), middle temporal gyrus, and ventromedial prefrontal cortex. These findings indicate that action anticipation in expert table tennis players engages both semantic and sensorimotor regions and suggests that skilled action observation in sports utilizes predictions both at motor-kinematic and conceptual levels.

The dominant role of functional action representation in object recognition

Action representation of manipulable objects has been found to be involved in object recognition. Recently, studies have indicated the existence of two distinct action systems: functional action specifying how to use an object and structural action concerning how to grasp an object. Despite evidence revealing the systems' anatomical and functional differences, few preceding studies have dissociated their respective roles in object recognition. The present study aimed to tease apart their roles in the recognition of manipulable objects with a priming paradigm. Specifically, we used static stimuli (photos, Experiments 1 and 2) and dynamic stimuli (video clips, Experiments 3 and 4) depicting functional and structural action hand gestures as primes and measured the magnitude of functional and structural action priming effect in object recognition. We found that static and dynamic priming stimuli induced a robust action priming effect only for functional action prime-target pairs. Naming latencies of the target objects were shorter when functional action representations of the prime and target were congruent than when they were incongruent. Moreover, as compared to static priming photos, dynamic priming stimuli induced a larger functional action priming effect. By contrast, neither static nor dynamic priming stimuli elicited a structural action priming effect. Behavioral data from our four experiments provide consistent evidence of the dominant role of functional action representation in the recognition of manipulable objects, suggesting that action knowledge regarding how to use rather than grasp an object is more likely an intrinsic component of objects' conceptual representation.

The Role of Attention and Saccades on Parietofrontal Encoding of Contextual and Grasp-specific Affordances of Tools: An ERP Study

The ability to recognize a tool's affordances (how a spoon should be appropriately grasped and used), is vital for daily life. Prior research has identified parietofrontal circuits, including mirror neurons, to be critical in understanding affordances. However, parietofrontal action-encoding regions receive extensive visual input and are adjacent to parietofrontal attention control networks. It is unclear how eye movements and attention modulate parietofrontal encoding of affordances. To address this issue, scenes depicting tools in different use-contexts and grasp-postures were presented to healthy subjects across two experiments, with stimuli durations of 100 ms or 500 ms. The 100-ms experiment automatically restricted saccades and required covert attention, while the 500-ms experiment allowed overt attention. The two experiments elicited similar behavioral decisions on tool-use correctness and isolated the influence of attention on parietofrontal activity. Parietofrontal ERPs (P600) distinguishing tool-use contexts (e.g., spoon-yogurt vs. spoon-ball) were similar in both experiments. Conversely, parietofrontal ERPs distinguishing tool-grasps were characterized by posterior to frontal N130-N200 ERPs in the 100-ms experiment and by saccade-perturbed N130-N200 ERPs, frontal N400 and parietal P500 in the 500-ms experiment. Particularly, only overt gaze toward the hand-tool interaction engaged mirror neurons (frontal N400) when discerning grasps that manipulate but not functionally use a tool - (grasp bowl rather than stem of spoon). Results here detail the first human electrophysiological evidence on how attention selectively modulates multiple parietofrontal grasp-perception circuits, especially the mirror neuron system, while unaffecting parietofrontal encoding of tool-use contexts. These results are pertinent to neurophysiological models of affordances that typically neglect the role of attention in action perception.