Making oneself predictable in linguistic interactions

Hand Gestures Have Predictive Potential During Conversation: An Investigation of the Timing of Gestures in Relation to Speech

During face-to-face conversation, transitions between speaker turns are incredibly fast. These fast turn exchanges seem to involve next speakers predicting upcoming semantic information, such that next turn planning can begin before a current turn is complete. Given that face-to-face conversation also involves the use of communicative bodily signals, an important question is how bodily signals such as co-speech hand gestures play into these processes of prediction and fast responding. In this corpus study, we found that hand gestures that depict or refer to semantic information started before the corresponding information in speech, which held both for the onset of the gesture as a whole, as well as the onset of the stroke (the most meaningful part of the gesture). This early timing potentially allows listeners to use the gestural information to predict the corresponding semantic information to be conveyed in speech. Moreover, we provided further evidence that questions with gestures got faster responses than questions without gestures. However, we found no evidence for the idea that how much a gesture precedes its lexical affiliate (i.e., its predictive potential) relates to how fast responses were given. The findings presented here highlight the importance of the temporal relation between speech and gesture and help to illuminate the potential mechanisms underpinning multimodal language processing during face-to-face conversation.

Communication and action predictability: two complementary strategies for successful cooperation

Making one's actions predictable and communicating what one intends to do are two strategies to achieve interpersonal coordination. It is less clear whether these two strategies are mutually exclusive or whether they can be used in parallel. Here, we asked how the availability of communication channels affects the use of strategy to make one's actions predictable. In three experiments, we investigated how people reach joint decisions if they are not allowed to communicate at all (Experiment 1), allowed minimal reciprocal communication (Experiment 2), or allowed to use the full range of conventional communication (Experiment 3). We found that when participants were not allowed to communicate, coordination was achieved by increasing action predictability. When conventional communication was allowed, there were no attempts to increase action predictability. In the minimal reciprocal communication condition, successful pairs both increased action predictability and established a communication system. Overall, this study demonstrates that people are able to flexibly adapt to coordination challenges during joint decision making and that communication reduces behavioural constraints on joint action coordination.

Understanding joint action: Current theoretical and empirical approaches

Joint actions are omnipresent, ranging from a handshake between two people to the coordination of groups of people playing in an orchestra. We are highly skilled at coordinating our actions with those of others to reach common goals and rely on this ability throughout our daily lives. What are the social, cognitive and neural processes underlying this ability? How do others around us influence our task representations? How does joint action influence interpersonal interactions? How do language and gesture support joint action? What differentiates joint action from individual action? This article forms an introductory editorial to the field of joint action. It accompanies contributions to the special issue entitled "Current Issues in Joint Action Research". The issue brings together conceptual and empirical approaches on different topics, ranging from lower-level issues such as the link between perception and joint action, to higher-level issues such as language as a form of joint action.