Bimanual gestures: Expressions of spatial representations that accompany speech processes

Production of co-speech gestures in the right hemisphere: Evidence from individuals with complete or anterior callosotomy

INTRODUCTION

A right-hand preference for co-speech gestures in right-handed neurotypical individuals as well as the co-occurrence of speech and gesture has induced neuropsychological research to primarily target the left hemisphere when investigating co-speech gesture production. However, the substantial number of spontaneous left-hand gestures in right-handed individuals has, thus far, been unexplained. Recent studies in individuals with complete callosotomy and exclusive left hemisphere speech production show a reliable left-hand preference for co-speech gestures, indicating a right hemispheric generation. However, the findings raise the issue if the separate right hemisphere is able to also generate representational gestures. The present study challenges the proposition of a specific right hemispheric contribution to gesture production by differentiating gesture types including representational ones in individuals with complete callosotomy and by including individuals with anterior callosotomy in whom neural reorganization is less extensive.

METHODS

Three right-handed individuals with complete commissurotomy (A.A., N.G., G.C.) and three right-handed individuals with anterior callosotomy (C.E., S.R., L. D), all with left hemisphere language dominance, and a matched right-handed neurotypical control group (n = 10) were examined in an experimental setting, including re-narration of a nonverbal animated cartoon and responding to intelligence questions. The participants' video-taped hand movement behavior was analyzed by two independent certified raters with the NEUROGES-ELAN system for nonverbal behavior and gesture. Unimanual right-hand and left-hand gestures were classified into eight gesture types.

RESULTS

The individuals with complete and anterior callosotomy performed unimanual co-speech gestures with the left as well as the right hand, with no significant preference of one hand for gestures overall. Concerning the specific gesture types, the group with complete callosotomy showed a significant right-hand preference for pantomime gestures, which also applied to the callosotomy total group. The group with anterior callosotomy displayed a significant left-hand preference for form presentation gestures. As a trend, the callosotomy total group differed from the neurotypical group as they performed more left-hand egocentric deictic and left-hand form presentation gestures.

DISCUSSION

The present study replicates the finding of a substantial left-hand use for unimanual co-speech gestures in individuals with complete callosotomy. The proposition of a right hemispheric contribution to gesture production independent from left hemispheric language production is corroborated by the finding that individuals with anterior callosotomy show a similar pattern of hand use for gestures. Representational gestures were displayed with either hand, suggesting that in particular right hemispheric spatial cognition can be directly expressed in gesture. The significant right-hand preference for pantomime gesture was outstanding and compatible with the established left hemispheric specialization for tool use praxis. The findings shed a new light on the left-hand gestures in neurotypical individuals, suggesting that these can be generated in the right hemisphere.

The Relation Between Cognitive Abilities and the Distribution of Semantic Features Across Speech and Gesture in 4-year-olds

When young children learn to use language, they start to use their hands in co-verbal gesturing. There are, however, considerable differences between children, and it is not completely understood what these individual differences are due to. We studied how children at 4 years of age employ speech and iconic gestures to convey meaning in different kinds of spatial event descriptions, and how this relates to their cognitive abilities. Focusing on spontaneous illustrations of actions, we applied a semantic feature (SF) analysis to characterize combinations of speech and gesture meaning and related them to the child's visual-spatial abilities or abstract/concrete reasoning abilities (measured using the standardized SON-R 2 1 2 - 7 test). Results show that children with higher cognitive abilities convey significantly more meaning via gesture and less solely via speech. These findings suggest that young children's use of cospeech representational gesturing is positively related to their mental representation and reasoning abilities.

Co-speech gesture in bimodal bilinguals

The effects of knowledge of sign language on co-speech gesture were investigated by comparing the spontaneous gestures of bimodal bilinguals (native users of American Sign Language and English; n = 13) and non-signing native English speakers (n = 12). Each participant viewed and re-told the Canary Row cartoon to a non-signer whom they did not know. Nine of the thirteen bimodal bilinguals produced at least one ASL sign, which we hypothesise resulted from a failure to inhibit ASL. Compared with non-signers, bimodal bilinguals produced more iconic gestures, fewer beat gestures, and more gestures from a character viewpoint. The gestures of bimodal bilinguals also exhibited a greater variety of handshape types and more frequent use of unmarked handshapes. We hypothesise that these semantic and form differences arise from an interaction between the ASL language production system and the co-speech gesture system.

Goal-related planning constraints in bimanual grasping and placing of objects

Our primary objective was to examine the possible interplay of the end-state comfort effect and bimanual temporal and spatial coupling constraints in a grasp-to-place task. Unimanual and bimanual grasping and placing tasks were employed with manipulations on initial comfort (by use of potentially interfering obstacles) and target goals (using various demands on end goal object orientations). Confirming previous temporal findings, incongruent bimanual tasks were considerably slower in initiation time and movement time than congruent ones, reflecting costs in conceptualizing, planning, and completion of the task. With respect to spatial constraints, when the same goal was present for both hands there was strong evidence of the influence of both end-state comfort and bimanual constraints. This was often not the case when the task demands differed for the two hands, although the primary task goals were still attained. We suggest that the implementation of constraints is not based on a strict hierarchy; rather, certain constraints become dominant depending on the task and situation.

Metaphor explanation attenuates the right-hand preference for depictive co-speech gestures that imitate actions

Differential activation levels of the two hemispheres due to hemispheric specialization for various linguistic processes might determine hand choice for co-speech gestures. To test this hypothesis, we compared hand choices for gesturing in 20 healthy right-handed participants during explanation of metaphorical vs. non-metaphorical meanings, on the assumption that metaphor explanation enhances the right hemisphere contribution to speech production. Hand choices were analyzed separately for: depictive gestures that imitate action ("character viewpoint gestures," [McNeill, D. (1992). Hand and mind. What gestures reveal about thought. Chicago: University of Chicago Press.]), depictive gestures that express motion, relative locations, and shape ("observer viewpoint gestures"), and "abstract deictic gestures." It was found that the right-hand over left-hand preference was significantly weaker in the metaphor condition than in the non-metaphor conditions for depictive gestures that imitated action. Findings suggest that the activation of the right hemisphere in the metaphor condition reduces the likelihood of left hemisphere generation of gestures that imitate action, thus attenuating the right-hand preference.