1
|
Ciaramidaro A, Toppi J, Vogel P, Freitag CM, Siniatchkin M, Astolfi L. Synergy of the mirror neuron system and the mentalizing system in a single brain and between brains during joint actions. Neuroimage 2024; 299:120783. [PMID: 39187218 DOI: 10.1016/j.neuroimage.2024.120783] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2024] [Revised: 08/04/2024] [Accepted: 08/12/2024] [Indexed: 08/28/2024] Open
Abstract
Cooperative action involves the simulation of actions and their co-representation by two or more people. This requires the involvement of two complex brain systems: the mirror neuron system (MNS) and the mentalizing system (MENT), both of critical importance for successful social interaction. However, their internal organization and the potential synergy of both systems during joint actions (JA) are yet to be determined. The aim of this study was to examine the role and interaction of these two fundamental systems-MENT and MNS-during continuous interaction. To this hand, we conducted a multiple-brain connectivity analysis in the source domain during a motor cooperation task using high-density EEG dual-recordings providing relevant insights into the roles of MNS and MENT at the intra- and interbrain levels. In particular, the intra-brain analysis demonstrated the essential function of both systems during JA, as well as the crucial role played by single brain regions of both neural mechanisms during cooperative activities. Specifically, our intra-brain analysis revealed that both neural mechanisms are essential during Joint Action (JA), showing a solid connection between MNS and MENT and a central role of the single brain regions of both mechanisms during cooperative actions. Additionally, our inter-brain study revealed increased inter-subject connections involving the motor system, MENT and MNS. Thus, our findings show a mutual influence between two interacting agents, based on synchronization of MNS and MENT systems. Our results actually encourage more research into the still-largely unknown realm of inter-brain dynamics and contribute to expand the body of knowledge in social neuroscience.
Collapse
Affiliation(s)
- Angela Ciaramidaro
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Viale Allegri 9, 42121 Reggio Emilia, Italy; Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital, Goethe-University, Deutschordenstraße 50, 60528 Frankfurt/Main, Germany.
| | - Jlenia Toppi
- Department of Computer, Control, and Management Engineering, Univ. of Rome "Sapienza", Via Ariosto 25, 00185 Rome, Italy; Neuroelectrical Imaging and Brain Computer Interface Laboratory, Fondazione Santa Lucia IRCCS, Via Ardeatina 306/354, 00179 Rome, Italy
| | - Pascal Vogel
- Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital, Goethe-University, Deutschordenstraße 50, 60528 Frankfurt/Main, Germany; Institute of Neurophysiology, Neuroscience Center, Goethe University, Heinrich-Hoffmann-Str. 7, 60528 Frankfurt/M, Germany
| | - Christine M Freitag
- Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital, Goethe-University, Deutschordenstraße 50, 60528 Frankfurt/Main, Germany
| | - Michael Siniatchkin
- Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, University Hospital, Goethe-University, Deutschordenstraße 50, 60528 Frankfurt/Main, Germany; Clinic of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital Aachen, RWTH Aachen University, Pauwelsstraße 30, 52074 Aachen, Germany
| | - Laura Astolfi
- Department of Computer, Control, and Management Engineering, Univ. of Rome "Sapienza", Via Ariosto 25, 00185 Rome, Italy; Neuroelectrical Imaging and Brain Computer Interface Laboratory, Fondazione Santa Lucia IRCCS, Via Ardeatina 306/354, 00179 Rome, Italy
| |
Collapse
|
2
|
Marschner M, Dignath D, Knoblich G. Me or we? Action-outcome learning in synchronous joint action. Cognition 2024; 247:105785. [PMID: 38583324 DOI: 10.1016/j.cognition.2024.105785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 02/26/2024] [Accepted: 03/26/2024] [Indexed: 04/09/2024]
Abstract
Goal-directed behaviour requires mental representations that encode instrumental relationships between actions and their outcomes. The present study investigated how people acquire representations of joint actions where co-actors perform synchronized action contributions to produce joint outcomes in the environment. Adapting an experimental procedure to assess individual action-outcome learning, we tested whether co-acting individuals link jointly produced action outcomes to individual-level features of their own action contributions or to group-level features of their joint action instead. In a learning phase, pairs of participants produced musical chords by synchronizing individual key press responses. In a subsequent test phase, the previously produced chords were presented as imperative stimuli requiring forced-choice responses by both pair members. Stimulus-response mappings were systematically manipulated to be either compatible or incompatible with the individual and joint action-outcome mappings of the preceding learning phase. Only joint but not individual compatibility was found to modulate participants' performance in the test phase. Yet, opposite to predictions of associative accounts of action-outcome learning, jointly incompatible mappings between learning and test phase resulted in better performance. We discuss a possible explanation of this finding, proposing that pairs' group-level learning experience modulated how participants encoded ambiguous task instructions in the test phase. Our findings inform current debates about mechanistic explanations of action-outcome learning effects and provide novel evidence that joint action is supported by dedicated mental representations encoding own and others' actions on a group level.
Collapse
Affiliation(s)
| | - David Dignath
- Department of Psychology, Eberhard Karls University of Tübingen, Tübingen, Germany.
| | - Günther Knoblich
- Department of Cognitive Science, Central European University, Vienna, Austria.
| |
Collapse
|
3
|
Zamm A, Loehr JD, Vesper C, Konvalinka I, Kappel SL, Heggli OA, Vuust P, Keller PE. A practical guide to EEG hyperscanning in joint action research: from motivation to implementation. Soc Cogn Affect Neurosci 2024; 19:nsae026. [PMID: 38584414 PMCID: PMC11086947 DOI: 10.1093/scan/nsae026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 12/31/2023] [Accepted: 03/15/2024] [Indexed: 04/09/2024] Open
Abstract
Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.
Collapse
Affiliation(s)
- Anna Zamm
- Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus 8000, Denmark
- Interacting Minds Center, Aarhus University, Aarhus 8000, Denmark
| | - Janeen D Loehr
- Department of Psychology and Health Studies, University of Saskatchewan, Saskatoon, SK S7N 5A5, Canada
| | - Cordula Vesper
- Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus 8000, Denmark
- Interacting Minds Center, Aarhus University, Aarhus 8000, Denmark
| | - Ivana Konvalinka
- Section for Cognitive Systems, DTU Compute, Technical University of Denmark, Kongens Lyngby DK-2800, Denmark
| | - Simon L Kappel
- Department of Electrical and Computer Engineering, Aarhus University, Aarhus N 8200, Denmark
| | - Ole A Heggli
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
| | - Peter E Keller
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, New South Wales 2751, Australia
| |
Collapse
|
4
|
Charbonneau M, Curioni A, McEllin L, Strachan JWA. Flexible Cultural Learning Through Action Coordination. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2024; 19:201-222. [PMID: 37458767 DOI: 10.1177/17456916231182923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2024]
Abstract
The cultural transmission of technical know-how has proven vital to the success of our species. The broad diversity of learning contexts and social configurations, as well as the various kinds of coordinated interactions they involve, speaks to our capacity to flexibly adapt to and succeed in transmitting vital knowledge in various learning contexts. Although often recognized by ethnographers, the flexibility of cultural learning has so far received little attention in terms of cognitive mechanisms. We argue that a key feature of the flexibility of cultural learning is that both the models and learners recruit cognitive mechanisms of action coordination to modulate their behavior contingently on the behavior of their partner, generating a process of mutual adaptation supporting the successful transmission of technical skills in diverse and fluctuating learning environments. We propose that the study of cultural learning would benefit from the experimental methods, results, and insights of joint-action research and, complementarily, that the field of joint-action research could expand its scope by integrating a learning and cultural dimension. Bringing these two fields of research together promises to enrich our understanding of cultural learning, its contextual flexibility, and joint action coordination.
Collapse
Affiliation(s)
- Mathieu Charbonneau
- Africa Institute for Research in Economics and Social Sciences, Université Mohammed VI Polytechnique
| | | | - Luke McEllin
- Department of Cognitive Science, Central European University
| | | |
Collapse
|
5
|
Sacheli LM, Diana L, Ravani A, Beretta S, Bolognini N, Paulesu E. Neuromodulation of the Left Inferior Frontal Cortex Affects Social Monitoring during Motor Interactions. J Cogn Neurosci 2023; 35:1788-1805. [PMID: 37677055 DOI: 10.1162/jocn_a_02046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
Motor interactions require observing and monitoring a partner's performance as the interaction unfolds. Studies in monkeys suggest that this form of social monitoring might be mediated by the activity of the ventral premotor cortex (vPMc), a critical brain region in action observation and motor planning. Our previous fMRI studies in humans showed that the left vPMc is indeed recruited during social monitoring, but its causal role is unexplored. In three experiments, we applied online anodal or cathodal transcranial direct current stimulation over the left lateral frontal cortex during a music-like interactive task to test the hypothesis that neuromodulation of the left vPMc affects participants' performance when a partner violates the agent's expectations. Participants played short musical sequences together with a virtual partner by playing one note each in turn-taking. In 50% of the trials, the partner violated the participant's expectations by generating the correct note through an unexpected movement. During sham stimulation, the partner's unexpected behavior led to a slowdown in the participant's performance (observation-induced posterror slowing). A significant interaction with the stimulation type showed that cathodal and anodal transcranial direct current stimulation induced modulation of the observation-induced posterror slowing in opposite directions by reducing or enhancing it, respectively. Cathodal stimulation significantly reduced the effect compared to sham stimulation. No effect of neuromodulation was found when the partner behaved as expected or when the observed violation occurred within a context that was perceptually matched but noninteractive in nature. These results provide evidence for the critical causal role that the left vPMc might play in social monitoring during motor interactions, possibly through the interplay with other brain regions in the posterior medial frontal cortex.
Collapse
Affiliation(s)
| | | | | | | | - Nadia Bolognini
- University of Milano-Bicocca
- IRCCS Istituto Auxologico Italiano
| | - Eraldo Paulesu
- University of Milano-Bicocca
- IRCCS Istituto Ortopedico Galeazzi, Italy
| |
Collapse
|
6
|
Gordon J, Knoblich G, Pezzulo G. Strategic Task Decomposition in Joint Action. Cogn Sci 2023; 47:e13316. [PMID: 37440442 DOI: 10.1111/cogs.13316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 06/15/2023] [Accepted: 06/23/2023] [Indexed: 07/15/2023]
Abstract
The core of human cooperation is people's ability to perform joint actions. Frequently, this requires effectively decomposing a joint task into individual subtasks, for example, when jointly shopping at the market to buy food. Surprisingly, little is known about how collaborators balance the costs of establishing a joint strategy for such decompositions and its expected benefits for a joint goal. We created a new online task that required pairs of randomly matched participants to jointly collect colored items. We then systematically varied the cognitive costs and benefits of applying a color-splitting strategy. The results showed that pairs adopted a color-splitting strategy more often when necessary to lower cognitive costs. However, once the strategy was jointly adopted, it continued to be used even when the cost-benefits changed. Our results provide first insights on how people decompose joint tasks into individual components and how decomposition strategies may evolve into conventions.
Collapse
Affiliation(s)
- Jeremy Gordon
- School of Information, University of California, Berkeley
| | - Guenther Knoblich
- Social Mind and Body Group, Department of Cognitive Science, Central European University
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council
| |
Collapse
|
7
|
Sacheli LM, Roberti E, Turati C. Encoding interactive scripts at 10 months of age. J Exp Child Psychol 2023; 227:105588. [PMID: 36512919 DOI: 10.1016/j.jecp.2022.105588] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 09/30/2022] [Accepted: 11/02/2022] [Indexed: 12/14/2022]
Abstract
Understanding action-reaction associations that give origin to interactive scripts (e.g., give-and-take interactions) is essential for appreciating social exchanges. However, studies on infants' action understanding have mainly investigated the case of actions performed by individual agents. Moreover, although extensive literature has explored infants' comprehension of action-effect relationships in object functioning, no study has addressed whether it also plays a role when observing social interactions, an issue we addressed here. In a first study, 10-month-old infants observed short videos of dyadic exchanges. We investigated whether they were able to link specific human gestures directed toward another person to specific vocal reactions in the receiver. We used a double-habituation paradigm in which infants were sequentially habituated to two specific action-reaction associations. In the test phase, infants watched one of the two habituated (Familiar) videos, a video with a reversed action-reaction association (Violation), and a Novel video. Results showed that the infants looked longer at both the Novel and Violation test trials than at the Familiar test trials. In a control study, we show that these results could not be accounted for by associative learning; indeed, learning of the action-reaction association did not occur when the vocalization was not produced by the receiver but only contingent on the agent's action. Thus, we show that 10-month-old infants can encode specific social action-effect relationships during the observation of dyadic interactions and that the interactivity of the social context may be critical to shaping young infants' understanding of others' behaviors.
Collapse
Affiliation(s)
- Lucia Maria Sacheli
- Department of Psychology and Milan Center for Neuroscience (NeuroMI), University of Milano-Bicocca, 20126 Milano, Italy.
| | - Elisa Roberti
- Department of Psychology and Milan Center for Neuroscience (NeuroMI), University of Milano-Bicocca, 20126 Milano, Italy
| | - Chiara Turati
- Department of Psychology and Milan Center for Neuroscience (NeuroMI), University of Milano-Bicocca, 20126 Milano, Italy.
| |
Collapse
|
8
|
Krol MA, Jellema T. Sensorimotor representation of observed dyadic actions with varying agent involvement: an EEG mu study. Cogn Neurosci 2023; 14:25-35. [PMID: 35699606 DOI: 10.1080/17588928.2022.2084605] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Observation of others' actions activates motor representations in sensorimotor cortex. Although action observation in the real-world often involves multiple agents displaying varying degrees of action involvement, most lab studies on action observation studied individual actions. We recorded EEG-mu suppression over sensorimotor cortex to investigate how the multi-agent nature of observed hand/arm actions is incorporated in sensorimotor action representations. Hereto we manipulated the extent of agent involvement in dyadic interactions presented in videos. In all clips two agents were present, of which agent-1 always performed the same action, while the involvement of agent-2 differed along three levels: (1) passive and uninvolved, (2) passively involved, (3) actively involved. Additionally, a no-action condition was presented. The occurrence of these four conditions was predictable thanks to cues at the start of each trial, which allowed to study possible mu anticipation effects. Dyadic interactions in which agent-2 was actively involved resulted in increased power suppression of the mu rhythm compared to dyadic interactions in which agent-2 was passively involved. The latter did not differ from actions in which agent-2 was present but not involved. No anticipation effects were found. The results suggest that the sensorimotor representation of a dyadic interaction takes into account the simultaneously performed bodily articulations of both agents, but no evidence was found for incorporation of their static articulated postures.
Collapse
Affiliation(s)
- Manon A Krol
- Donders Institute, Radboud University, Nijmegen, The Netherlands
| | | |
Collapse
|
9
|
Curioni A. What makes us act together? On the cognitive models supporting humans’ decisions for joint action. Front Integr Neurosci 2022; 16:900527. [PMID: 35990592 PMCID: PMC9381741 DOI: 10.3389/fnint.2022.900527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Accepted: 07/13/2022] [Indexed: 11/28/2022] Open
Abstract
We face tasks every day that we can solve alone but decide to solve together with others. When do we choose to act together vs. alone? How long do we persist in working together when doing so is difficult? Do we prefer to act together when times are uncertain? An open question in joint action research is under what conditions humans prefer to act together or alone to achieve a certain goal, and whether their preference is based on a utility calculus that takes into account the costs and benefits associated with individual and joint action alternatives. Research on cooperation reveals that frequent engagement in joint activities provides high survival benefits, as it allows individuals to achieve goals together that are otherwise unavailable. Yet, survival advantage does not wholly explain the reasons for human cooperative behavior. In fact, humans are motivated to cooperate even when it is not necessary to achieve an outcome. Research in cognitive science suggests that navigating the potential costs of joint actions is a challenge for humans, and that joint actions might provide individuals with rewards that go beyond the achievement of instrumental goals. We here address the influence of key factors on the decision to engage in joint action, such as the coordination costs arising when acting together compared to alone and the social and instrumental rewards expected when acting together compared to alone. Addressing these questions will provide critical insight for the design of cognitive models of human decisions for cooperation.
Collapse
|
10
|
Curioni A, Voinov P, Allritz M, Wolf T, Call J, Knoblich G. Human adults prefer to cooperate even when it is costly. Proc Biol Sci 2022; 289:20220128. [PMID: 35473383 PMCID: PMC9043698 DOI: 10.1098/rspb.2022.0128] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023] Open
Abstract
Joint actions are cooperative activities where humans coordinate their actions to achieve individual and shared goals. While the motivation to engage in joint action is clear when a goal cannot be achieved by individuals alone, we asked whether humans are motivated to act together even when acting together is not necessary and implies incurring additional costs compared to individual goal achievement. Using a utility-based empirical approach, we investigated the extent of humans' preference for joint action over individual action, when the instrumental costs of performing joint actions outweigh the benefits. The results of five experiments showed that human adults have a stable preference for joint action, even if individual action is more effective to achieve a certain goal. We propose that such preferences can be understood as ascribing additional reward value to performing actions together.
Collapse
Affiliation(s)
- Arianna Curioni
- Department of Cognitive Science, Central European University, 1100 Wien, Austria
| | - Pavel Voinov
- Department of Cognitive Science, Central European University, 1100 Wien, Austria.,Primate Research Institute, Kyoto University, Inuyama, Aichi 484-8506, Japan
| | - Mathias Allritz
- School of Psychology and Neuroscience, University of St Andrews, St Andrews, Fife KY16 9JU, UK
| | - Thomas Wolf
- Department of Cognitive Science, Central European University, 1100 Wien, Austria
| | - Josep Call
- School of Psychology and Neuroscience, University of St Andrews, St Andrews, Fife KY16 9JU, UK
| | - Günther Knoblich
- Department of Cognitive Science, Central European University, 1100 Wien, Austria
| |
Collapse
|
11
|
Sharing motor plans while acting jointly: a TMS study. Cortex 2022; 151:224-239. [DOI: 10.1016/j.cortex.2022.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 03/10/2022] [Accepted: 03/12/2022] [Indexed: 11/22/2022]
|
12
|
Olsen S, Alder G, Williams M, Chambers S, Jochumsen M, Signal N, Rashid U, Niazi IK, Taylor D. Electroencephalographic Recording of the Movement-Related Cortical Potential in Ecologically Valid Movements: A Scoping Review. Front Neurosci 2021; 15:721387. [PMID: 34650399 PMCID: PMC8505671 DOI: 10.3389/fnins.2021.721387] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 08/27/2021] [Indexed: 12/05/2022] Open
Abstract
The movement-related cortical potential (MRCP) is a brain signal that can be recorded using surface electroencephalography (EEG) and represents the cortical processes involved in movement preparation. The MRCP has been widely researched in simple, single-joint movements, however, these movements often lack ecological validity. Ecological validity refers to the generalizability of the findings to real-world situations, such as neurological rehabilitation. This scoping review aimed to synthesize the research evidence investigating the MRCP in ecologically valid movement tasks. A search of six electronic databases identified 102 studies that investigated the MRCP during multi-joint movements; 59 of these studies investigated ecologically valid movement tasks and were included in the review. The included studies investigated 15 different movement tasks that were applicable to everyday situations, but these were largely carried out in healthy populations. The synthesized findings suggest that the recording and analysis of MRCP signals is possible in ecologically valid movements, however the characteristics of the signal appear to vary across different movement tasks (i.e., those with greater complexity, increased cognitive load, or a secondary motor task) and different populations (i.e., expert performers, people with Parkinson’s Disease, and older adults). The scarcity of research in clinical populations highlights the need for further research in people with neurological and age-related conditions to progress our understanding of the MRCPs characteristics and to determine its potential as a measure of neurological recovery and intervention efficacy. MRCP-based neuromodulatory interventions applied during ecologically valid movements were only represented in one study in this review as these have been largely delivered during simple joint movements. No studies were identified that used ecologically valid movements to control BCI-driven external devices; this may reflect the technical challenges associated with accurately classifying functional movements from MRCPs. Future research investigating MRCP-based interventions should use movement tasks that are functionally relevant to everyday situations. This will facilitate the application of this knowledge into the rehabilitation setting.
Collapse
Affiliation(s)
- Sharon Olsen
- Rehabilitation Innovation Centre, Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand
| | - Gemma Alder
- Rehabilitation Innovation Centre, Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand
| | - Mitra Williams
- Rehabilitation Innovation Centre, Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand
| | - Seth Chambers
- Rehabilitation Innovation Centre, Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand
| | - Mads Jochumsen
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Nada Signal
- Rehabilitation Innovation Centre, Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand
| | - Usman Rashid
- Rehabilitation Innovation Centre, Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand.,Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland, New Zealand
| | - Imran Khan Niazi
- Rehabilitation Innovation Centre, Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand.,Department of Health Science and Technology, Aalborg University, Aalborg, Denmark.,Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland, New Zealand
| | - Denise Taylor
- Rehabilitation Innovation Centre, Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand
| |
Collapse
|
13
|
Effects of pointing movements on visuospatial working memory in a joint-action condition: Evidence from eye movements. Mem Cognit 2021; 50:261-277. [PMID: 34480326 PMCID: PMC8821511 DOI: 10.3758/s13421-021-01230-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/02/2021] [Indexed: 11/18/2022]
Abstract
Previous studies showed that (a) performing pointing movements towards to-be-remembered locations enhanced their later recognition, and (b) in a joint-action condition, experimenter-performed pointing movements benefited memory to the same extent as self-performed movements. The present study replicated these findings and additionally recorded participants’ fixations towards studied arrays. Each trial involved the presentation of two consecutive spatial arrays, where each item occupied a different spatial location. The item locations of one array were encoded by mere visual observation (the no-move array), whereas the locations of the other array were encoded by observation plus pointing movements (the move array). Critically, in Experiment 1, participants took turns with the experimenter in pointing towards the move arrays (joint-action condition), while in Experiment 2 pointing was performed only by the experimenter (passive condition). The results showed that the locations of move arrays were recognized better than the locations of no-move arrays in Experiment 1, but not in Experiment 2. The pattern of eye-fixations was in line with behavioral findings, indicating that in Experiment 1, fixations to the locations of move arrays were higher in number and longer in duration than fixations to the locations of no-move arrays, irrespective of the agent who performed the movements. In contrast, no differences emerged in Experiment 2. We propose that, in the joint-action condition, self- and other-performed pointing movements are coded at the same representational level and their functional equivalency is reflected in a similar pattern of eye-fixations.
Collapse
|
14
|
Meyer M, Chung H, Debnath R, Fox N, Woodward AL. Social context shapes neural processing of others' actions in 9-month-old infants. J Exp Child Psychol 2021; 213:105260. [PMID: 34390926 DOI: 10.1016/j.jecp.2021.105260] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 06/04/2021] [Accepted: 07/09/2021] [Indexed: 02/02/2023]
Abstract
From infancy, neural processes for perceiving others' actions and producing one's own actions overlap (neural mirroring). Adults and children show enhanced mirroring in social interactions. Yet, whether social context affects mirroring in infancy, a time when processing others' actions is crucial for action learning, remains unclear. We examined whether turn-taking, an early form of social interaction, enhanced 9-month-olds' neural mirroring. We recorded electroencephalography while 9-month-olds were grasping (execution) and observing live grasps (observation). In this design, half of the infants observed and acted in alternation (turn-taking condition), whereas the other half observed several times in a row before acting (blocked condition). Replicating previous findings, infants showed significant 6- to 9-Hz mu suppression (indicating motor activation) during execution and observation (n = 24). In addition, a condition (turn-taking or blocked) by time (action start or end) interaction indicated that infants engaged in turn-taking (n = 9), but not in the blocked context (n = 15), showed more mirroring when observing the action start compared with the action end. Exploratory analyses further suggest that (a) there is higher visual-motor functional connectivity in turn-taking toward the action's end, (b) mirroring relates to later visual-motor connectivity, and (c) visual attention as indexed by occipital alpha is enhanced in turn-taking compared with the blocked context. Together, this suggests that the neural processing of others' actions is modulated by the social context in infancy and that turn-taking may be particularly effective in engaging infants' action perception system.
Collapse
Affiliation(s)
- Marlene Meyer
- Department of Psychology, University of Chicago, Chicago, IL 60637, USA; Donders Institute, Radboud University, 6525 GD Nijmegen, the Netherlands.
| | - Haerin Chung
- Department of Psychology, University of Chicago, Chicago, IL 60637, USA
| | - Ranjan Debnath
- Leibniz Institute for Neurobiology, 39118 Magdeburg, Germany
| | - Nathan Fox
- Child Development Lab, Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD 20742, USA
| | - Amanda L Woodward
- Department of Psychology, University of Chicago, Chicago, IL 60637, USA
| |
Collapse
|
15
|
Zamm A, Debener S, Konvalinka I, Sebanz N, Knoblich G. The sound of silence: an EEG study of how musicians time pauses in individual and joint music performance. Soc Cogn Affect Neurosci 2021; 16:31-42. [PMID: 32734305 PMCID: PMC7812619 DOI: 10.1093/scan/nsaa096] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Revised: 06/16/2020] [Accepted: 07/11/2020] [Indexed: 11/13/2022] Open
Abstract
Pauses are an integral feature of social interaction. Conversation partners often pause between conversational turns, and musical co-performers often pause between musical phrases. How do humans coordinate the duration of pauses to ensure seamless interaction? A total of 40 trained pianists performed a simple melody containing fermatas (notated expressive pauses of unspecified duration) first alone (Solo) and then with a partner (Duet) while electroencephalography (EEG) was recorded. As predicted, Duet partners' tone onset synchrony was reduced for tones following pauses. Pauses were shorter in Duet relative to Solo performance, and synchrony of partners' Duet tone onsets was enhanced for tones following shorter pauses. EEG analysis revealed classic signatures of action preparation during pauses, namely decreases in the power of cortical beta oscillations (13-30 Hz, event-related desynchronization ERD). Beta ERD did not differ between pauses in Solo and Duet performance, but was enhanced for shorter relative to longer pauses, suggesting that reduced pause durations in Duet performance facilitated a neural state of enhanced action readiness. Together these findings provide novel insight into behavioural strategies by which musical partners resolve coordination challenges posed by expressive silence, and capture a clear neural signature of action planning during time-varying silences in natural music performance.
Collapse
Affiliation(s)
- Anna Zamm
- Department of Cognitive Science, Central European University, Budapest 1051, Hungar
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg 26129, Germany
| | - Ivana Konvalinka
- Section for Cognitive Systems, DTU Compute, Technical University of Denmark, Lyngby 2800, Denmark
| | - Natalie Sebanz
- Department of Cognitive Science, Central European University, Budapest 1051, Hungar
| | - Günther Knoblich
- Department of Cognitive Science, Central European University, Budapest 1051, Hungar
| |
Collapse
|
16
|
Schiavio A, Stupacher J, Xypolitaki E, Parncutt R, Timmers R. Musical novices perform with equal accuracy when learning to drum alone or with a peer. Sci Rep 2021; 11:12422. [PMID: 34127707 PMCID: PMC8203685 DOI: 10.1038/s41598-021-91820-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2021] [Accepted: 05/27/2021] [Indexed: 11/09/2022] Open
Abstract
The capacity of expert musicians to coordinate with each other when playing in ensembles or rehearsing has been widely investigated. However, little is known about the ability of novices to achieve satisfactory coordinated behaviour when making music together. We tested whether performance accuracy differs when novices play a newly learned drumming pattern with another musically untrained individual (duo group) or alone (solo group). A comparison between musical outcomes of the two groups revealed no significant differences concerning performative accuracy. An additional, exploratory examination of the degree of mutual influence between members of the duos suggested that they reciprocally affected each other when playing together. These findings indicate that a responsive auditory feedback involving surprises introduced by human errors could be part of pedagogical settings that employ repetition or imitation, thereby facilitating coordination among novices in a less prescribed fashion.
Collapse
Affiliation(s)
- Andrea Schiavio
- Centre for Systematic Musicology, University of Graz, Glacisstraße 27a, 8010, Graz, Austria.
| | - Jan Stupacher
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| | - Elli Xypolitaki
- Department of Music, The University of Sheffield, Sheffield, UK
| | - Richard Parncutt
- Centre for Systematic Musicology, University of Graz, Glacisstraße 27a, 8010, Graz, Austria
| | - Renee Timmers
- Department of Music, The University of Sheffield, Sheffield, UK
| |
Collapse
|
17
|
Hayashida K, Nishi Y, Osumi M, Nobusako S, Morioka S. Goal sharing with others modulates the sense of agency and motor accuracy in social contexts. PLoS One 2021; 16:e0246561. [PMID: 33539426 PMCID: PMC7861436 DOI: 10.1371/journal.pone.0246561] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2020] [Accepted: 01/21/2021] [Indexed: 11/18/2022] Open
Abstract
Sense of agency (SoA), the feeling of control over one’s own actions and their effects, is fundamental to goal-directed actions at the individual level and may constitute a cornerstone of everyday life, including cooperative behavior (i.e., goal sharing). Previous studies have demonstrated that goal sharing can activate the motor prediction of both agent’s action and partner’s action in joint-action tasks. Moreover, given that from an SoA perspective, predictive processes are an essential basis, there is a possibility that goal sharing may modulate SoA. However, the possibility for goal sharing to modulate SoA remains unclear. This study aimed to investigate whether goal sharing modulates the intentional binding (IB) effect (a method that can quantitatively measure SoA) of self-generated and observed partner’s actions and improves motor accuracy. Participants were required to stop a circular horizontal moving object by pressing a key when the object reaches the center of a target in a social situation. This task measured IB by having participants estimate the time interval between action and effect in several 100 milliseconds, with shorter time interval estimations indicating enhancement of SoA. Participants were randomly divided into 13 Cooperative groups (goal sharing) and 13 Independent groups (non-goal sharing). Cooperative groups were instructed to perform the task together, while Independent groups did so individually. Participants estimated the time interval between them by pressing the key and hearing the corresponding sound (Self-generated action) and the other person pressing the key and hearing the sound (Observed action). Our results indicated that goal sharing improved motor accuracy and enhanced both the IB of Self-generated and Observed actions compared to non-goal sharing. We suggest that SoA can be modulated by goal sharing in specific social contexts.
Collapse
Affiliation(s)
- Kazuki Hayashida
- Department of Neurorehabilitation, Graduate School of Health Sciences, Kio University, Umaminaka, Koryo, Kitakatsuragi-gun, Nara, Japan
- Department of Rehabilitation, Fujiikai Rehabilitation Hospital, Yayoi-cho, Higashiosaka-City, Osaka, Japan
- * E-mail:
| | - Yuki Nishi
- Department of Neurorehabilitation, Graduate School of Health Sciences, Kio University, Umaminaka, Koryo, Kitakatsuragi-gun, Nara, Japan
| | - Michihiro Osumi
- Department of Neurorehabilitation, Graduate School of Health Sciences, Kio University, Umaminaka, Koryo, Kitakatsuragi-gun, Nara, Japan
- Neurorehabilitation Research Center, Kio University, Umaminaka, Koryo, Kitakatsuragi-Gun, Nara, Japan
| | - Satoshi Nobusako
- Department of Neurorehabilitation, Graduate School of Health Sciences, Kio University, Umaminaka, Koryo, Kitakatsuragi-gun, Nara, Japan
- Neurorehabilitation Research Center, Kio University, Umaminaka, Koryo, Kitakatsuragi-Gun, Nara, Japan
| | - Shu Morioka
- Department of Neurorehabilitation, Graduate School of Health Sciences, Kio University, Umaminaka, Koryo, Kitakatsuragi-gun, Nara, Japan
- Neurorehabilitation Research Center, Kio University, Umaminaka, Koryo, Kitakatsuragi-Gun, Nara, Japan
| |
Collapse
|
18
|
Bolt NK, Loehr JD. The motor-related brain activity that supports joint action: A review. Acta Psychol (Amst) 2021; 212:103218. [PMID: 33307297 DOI: 10.1016/j.actpsy.2020.103218] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2020] [Revised: 08/28/2020] [Accepted: 11/16/2020] [Indexed: 01/17/2023] Open
Abstract
Recent years have seen a rapid increase in research investigating the motor-related brain activity that supports joint action. This research has employed a variety of joint action tasks and an array of neuroimaging techniques, including fMRI, fNIRS, EEG, and TMS. In this review, we provide an overview of this research to delineate what is known about the motor-related brain activity that contributes to joint action and to highlight key questions for future research. Taken together, the surveyed research supports three major conclusions. First, the mere presence of a joint action context is sufficient to modulate motor activity elicited by observing others' actions. Second, joint action is supported by dissociable motor activity associated with a person's own actions, their partner's actions, and the joint action, and by between-brain coupling of motor-related oscillatory activity. Third, the structure of a joint action modulates the motor activity involved: Unique motor activity is associated with performing joint actions comprised of complementary actions and with holding the roles of leader and follower within a joint action. We conclude the review by highlighting overarching themes and key questions for future research.
Collapse
|
19
|
Cracco E, Keysers C, Clauwaert A, Brass M. Representing Multiple Observed Actions in the Motor System. Cereb Cortex 2020; 29:3631-3641. [PMID: 30295709 DOI: 10.1093/cercor/bhy237] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2018] [Revised: 08/27/2018] [Accepted: 08/31/2018] [Indexed: 02/02/2023] Open
Abstract
There is now converging evidence that others' actions are represented in the motor system. However, social cognition requires us to represent not only the actions but also the interactions of others. To do so, it is imperative that the motor system can represent multiple observed actions. The current fMRI study investigated whether this is possible by measuring brain activity from 29 participants while they observed 2 right hands performing sign language gestures. Three key results were obtained. First, brain activity in the premotor and parietal motor cortex was stronger when 2 hands performed 2 different gestures than when 1 hand performed a single gesture. Second, both individual observed gestures could be decoded from brain activity in the same 2 regions. Third, observing 2 different gestures compared with 2 identical gestures activated brain areas related to motor conflict, and this activity was correlated with parietal motor activity. Together, these results show that the motor system is able to represent multiple observed actions, and as such reveal a potential mechanism by which third-party social encounters could be processed in the brain.
Collapse
Affiliation(s)
- Emiel Cracco
- Ghent University, Department of Experimental Psychology, Gent, Belgium
| | - Christian Keysers
- Royal Netherlands Academy of Art and Sciences (KNAW), Netherlands Institute for Neuroscience, BA Amsterdam, Netherlands
| | - Amanda Clauwaert
- Ghent University, Department of Experimental Psychology, Gent, Belgium
| | - Marcel Brass
- Ghent University, Department of Experimental Psychology, Gent, Belgium
| |
Collapse
|
20
|
Astolfi L, Toppi J, Ciaramidaro A, Vogel P, Freitag CM, Siniatchkin M. Raising the bar: Can dual scanning improve our understanding of joint action? Neuroimage 2020; 216:116813. [PMID: 32276053 DOI: 10.1016/j.neuroimage.2020.116813] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2019] [Revised: 03/31/2020] [Accepted: 04/01/2020] [Indexed: 02/07/2023] Open
Abstract
Two-person neuroscience (2 PN) is a recently introduced conceptual and methodological framework used to investigate the neural basis of human social interaction from simultaneous neuroimaging of two or more subjects (hyperscanning). In this study, we adopted a 2 PN approach and a multiple-brain connectivity model to investigate the neural basis of a form of cooperation called joint action. We hypothesized different intra-brain and inter-brain connectivity patterns when comparing the interpersonal properties of joint action with non-interpersonal conditions, with a focus on co-representation, a core ability at the basis of cooperation. 32 subjects were enrolled in dual-EEG recordings during a computerized joint action task including three conditions: one in which the dyad jointly acted to pursue a common goal (joint), one in which each subject interacted with the PC (PC), and one in which each subject performed the task individually (Solo). A combination of multiple-brain connectivity estimation and specific indices derived from graph theory allowed to compare interpersonal with non-interpersonal conditions in four different frequency bands. Our results indicate that all the indices were modulated by the interaction, and returned a significantly stronger integration of multiple-subject networks in the joint vs. PC and Solo conditions. A subsequent classification analysis showed that features based on multiple-brain indices led to a better discrimination between social and non-social conditions with respect to single-subject indices. Taken together, our results suggest that multiple-brain connectivity can provide a deeper insight into the understanding of the neural basis of cooperation in humans.
Collapse
Affiliation(s)
- Laura Astolfi
- Department of Computer, Control, and Management Engineering, Sapienza University of Rome, Rome, Italy; IRCCS, Fondazione Santa Lucia, Rome, Italy.
| | - Jlenia Toppi
- Department of Computer, Control, and Management Engineering, Sapienza University of Rome, Rome, Italy; IRCCS, Fondazione Santa Lucia, Rome, Italy
| | - Angela Ciaramidaro
- Department of Education and Human Sciences, University of Modena and Reggio Emilia, Reggio Emilia, Italy; Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Frankfurt University Hospital, Goethe University, Frankfurt/M, Germany
| | - Pascal Vogel
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Frankfurt University Hospital, Goethe University, Frankfurt/M, Germany; Institute of Neurophysiology, Neuroscience Center, Goethe University Frankfurt/M, Germany
| | - Christine M Freitag
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Frankfurt University Hospital, Goethe University, Frankfurt/M, Germany
| | - Michael Siniatchkin
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Frankfurt University Hospital, Goethe University, Frankfurt/M, Germany; Clinic of Child and Adolescent Psychiatry and Psychotherapy, Evangelical Hospital Bethel (EvKB), Bielefeld, Germany
| |
Collapse
|
21
|
Özkan DG, Pezzetta R, Moreau Q, Abreu AM, Aglioti SM. Predicting the fate of basketball throws: an EEG study on expert action prediction in wheelchair basketball players. Exp Brain Res 2019; 237:3363-3373. [DOI: 10.1007/s00221-019-05677-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2019] [Accepted: 11/07/2019] [Indexed: 12/22/2022]
|
22
|
Krol MA, Schutter DJLG, Jellema T. Sensorimotor cortex activation during anticipation of upcoming predictable but not unpredictable actions. Soc Neurosci 2019; 15:214-226. [PMID: 31587597 DOI: 10.1080/17470919.2019.1674688] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
The mirror neuron system (MNS) becomes active during action execution and action observation, which is presumably reflected by reductions in mu (8-13 Hz) activity in the electroencephalogram over the sensorimotor cortex. The function of the MNS is still fiercely debated. The current study aimed to investigate a role of the MNS in anticipating others' actions by examining whether the MNS was activated - indexed by mu power suppression - prior to the onset of observed actions when the onset and type of action could be predicted on the basis of environmental cues. Young adults performed and observed cued grasping and placing actions in a card game in a real-life setting, while the predictability of the observed actions was manipulated using rules. Significant mu suppression, relative to within-trial baseline activity, was found both prior to and during executed actions, but also during action observation, and, crucially, prior to observed actions provided they were predictable. No anticipatory mu reductions were found prior to unpredictable observed actions. These results suggest top-down modulation of MNS activity by conceptual knowledge. This is the first study to demonstrate mu suppression prior to action onset - possibly reflecting MNS anticipatory activity - by explicitly manipulating predictability.
Collapse
Affiliation(s)
- Manon A Krol
- Department of Psychology, University of Hull, Hull, UK.,Center for Autism Research Excellence, Boston University, Boston, MA, USA
| | | | | |
Collapse
|
23
|
Sacheli LM, Verga C, Arcangeli E, Banfi G, Tettamanti M, Paulesu E. How Task Interactivity Shapes Action Observation. Cereb Cortex 2019; 29:5302-5314. [DOI: 10.1093/cercor/bhz205] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2019] [Revised: 08/02/2019] [Accepted: 08/12/2019] [Indexed: 11/14/2022] Open
Abstract
Abstract
Action observation triggers imitation, a powerful mechanism permitting interpersonal coordination. Coordination, however, also occurs when the partners’ actions are nonimitative and physically incongruent. One influential theory postulates that this is achieved via top-down modulation of imitation exerted by prefrontal regions. Here, we rather argue that coordination depends on sharing a goal with the interacting partner: this shapes action observation, overriding involuntary imitation, through the predictive activity of the left ventral premotor cortex (lvPMc). During functional magnetic resonance imaging (fMRI), participants played music in turn with a virtual partner in interactive and noninteractive conditions requiring 50% of imitative/nonimitative responses. In a full-factorial design, both perceptual features and low-level motor requirements were kept constant throughout the experiment. Behaviorally, the interactive context minimized visuomotor interference due to the involuntary imitation of physically incongruent movements. This was paralleled by modulation of neural activity in the lvPMc, which was specifically recruited during the interactive task independently of the imitative/nonimitative nature of the social exchange. This lvPMc activity reflected the predictive decoding of the partner’s actions, as revealed by multivariate pattern analysis. This demonstrates that, during interactions, we process our partners’ behavior to prospectively infer their contribution to the shared goal achievement, generating motor predictions for cooperation beyond low-level imitation.
Collapse
Affiliation(s)
- L M Sacheli
- Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, Milan 20126, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan 20161, Italy
| | - C Verga
- Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, Milan 20126, Italy
| | - E Arcangeli
- Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, Milan 20126, Italy
| | - G Banfi
- IRCCS Istituto Ortopedico Galeazzi, Milan 20161, Italy
- Università Vita e Salute San Raffaele, Milan, 20132, Italy
| | - M Tettamanti
- Centro Interdipartimentale Mente/Cervello, Università degli Studi di Trento, Rovereto 38068, Italy
| | - E Paulesu
- Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, Milan 20126, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan 20161, Italy
| |
Collapse
|
24
|
Hidalgo C, Pesnot-Lerousseau J, Marquis P, Roman S, Schön D. Rhythmic Training Improves Temporal Anticipation and Adaptation Abilities in Children With Hearing Loss During Verbal Interaction. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2019; 62:3234-3247. [PMID: 31433722 DOI: 10.1044/2019_jslhr-s-18-0349] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Purpose In this study, we investigate temporal adaptation capacities of children with normal hearing and children with cochlear implants and/or hearing aids during verbal exchange. We also address the question of the efficiency of a rhythmic training on temporal adaptation during speech interaction in children with hearing loss. Method We recorded electroencephalogram data in children while they named pictures delivered on a screen, in alternation with a virtual partner. We manipulated the virtual partner's speech rate (fast vs. slow) and the regularity of alternation (regular vs. irregular). The group of children with normal hearing was tested once, and the group of children with hearing loss was tested twice: once after 30 min of auditory training and once after 30 min of rhythmic training. Results Both groups of children adjusted their speech rate to that of the virtual partner and were sensitive to the regularity of alternation with a less accurate performance following irregular turns. Moreover, irregular turns elicited a negative event-related potential in both groups, showing a detection of temporal deviancy. Notably, the amplitude of this negative component positively correlated with accuracy in the alternation task. In children with hearing loss, the effect was more pronounced and long-lasting following rhythmic training compared with auditory training. Conclusion These results are discussed in terms of temporal adaptation abilities in speech interaction and suggest the use of rhythmic training to improve these skills of children with hearing loss.
Collapse
Affiliation(s)
- Céline Hidalgo
- Laboratoire Parole et Langage, CNRS, Aix-Marseille University, Aix-en Provence, France
- Institut de Neurosciences des Systèmes, Inserm, Aix-Marseille University, Marseille, France
| | | | - Patrick Marquis
- Institut de Neurosciences des Systèmes, Inserm, Aix-Marseille University, Marseille, France
| | - Stéphane Roman
- Institut de Neurosciences des Systèmes, Inserm, Aix-Marseille University, Marseille, France
- Pediatric Otolaryngology Department, La Timone Children's Hospital (AP-HM), Marseille, France
| | - Daniele Schön
- Institut de Neurosciences des Systèmes, Inserm, Aix-Marseille University, Marseille, France
| |
Collapse
|
25
|
Baumgart KG, Byvshev P, Sliby AN, Strube A, König P, Wahn B. Neurophysiological correlates of collective perceptual decision-making. Eur J Neurosci 2019; 51:1676-1696. [PMID: 31418946 DOI: 10.1111/ejn.14545] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2019] [Revised: 07/05/2019] [Accepted: 08/05/2019] [Indexed: 11/27/2022]
Abstract
Humans frequently perform tasks collaboratively in daily life. Collaborating with others may or may not result in higher task performance than if one were to complete the task alone (i.e., a collective benefit). A recent study on collective benefits in perceptual decision-making showed that dyad members with similar individual performances attain collective benefit. However, little is known about the physiological basis of these results. Here, we replicate this earlier work and also investigate the neurophysiological correlates of decision-making using EEG. In a two-interval forced-choice task, co-actors individually indicated presence of a target stimulus with a higher contrast and then indicated their confidence on a rating scale. Viewing the individual ratings, dyads made a joint decision. Replicating earlier work, we found a positive correlation between the similarity of individual performances and collective benefit. We analyzed event-related potentials (ERPs) in three phases (i.e., stimulus onset, response and feedback) using explorative cluster mass permutation tests. At stimulus onset, ERPs were significantly linearly related to our manipulation of contrast differences, validating our manipulation of task difficulty. For individual and joint responses, we found a significant centro-parietal error-related positivity for correct versus incorrect responses, which suggests that accuracy is already evaluated at the response level. At feedback presentation, we found a significant late positive fronto-central potential elicited by incorrect joint responses. In sum, these results demonstrate that response- and feedback-related components elicited by an error-monitoring system differentially integrate conflicting information exchanged during the joint decision-making process.
Collapse
Affiliation(s)
- Kristina G Baumgart
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.,Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Petr Byvshev
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.,Department of Communications and Networking, Aalto University, Espoo, Finland
| | - Alexa-Nicole Sliby
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.,Institute for Molecular and Cellular Cognition, Center for Molecular Neurobiology ZMNH, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Andreas Strube
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.,Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Peter König
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.,Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Basil Wahn
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany.,Department of Psychology, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
26
|
Abstract
While the contribution of social processes to pain perception is well documented, surprisingly little is known about the influence of pain on social perception. In particular, an important question is how pain modulates the processing of other people's actions. To address this question, the current study tests, using automatic imitation, the hypothesis that pain interferes with motor simulation-that is, the processing of observed actions in the motor system. Participants in both experiments performed an automatic imitation task requiring them to abduct their index or little finger while they saw someone else performing either a congruent or incongruent action. Automatic imitation was measured in a pain-free context, a context where pain was coupled to the execution of a movement (experiment 1), and a context where pain occurred randomly (experiment 2). The results revealed that automatic imitation, indexed by slower responses on incongruent compared with congruent trials, was reduced when experiencing pain, both when pain was linked to movement execution and when it was not. Thus, the current study shows that pain leads to reduced motor processing of others' behavior and, as such, has important implications for understanding the social difficulties associated with pain.
Collapse
|
27
|
Bhatia D, Spataro P, Mishra RK, Cestari V, Doricchi F, Rossi-Arnaud C. Pointing movements and visuo-spatial working memory in a joint setting: the role of motor inhibition. PSYCHOLOGICAL RESEARCH 2019; 84:2065-2077. [PMID: 31183548 DOI: 10.1007/s00426-019-01209-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Accepted: 06/04/2019] [Indexed: 11/24/2022]
Abstract
Previous studies have shown that, under specific conditions, arrays that have been pointed at encoding are recognized better than passively viewed ones. According to one interpretation, the superior recognition of pointed-to arrays can be explained by the motor inhibition of passively viewed arrays. The present study sought to determine whether a similar motor inhibition can be induced also when the participants observed a co-actor perform the pointing movements. Participants were presented with two spatial arrays, one of which was encoded via observation only (the no-move array), while the other was encoded with pointing movements (the move array); movements were performed either by the participant or by the experimenter. Experiment 1 replicated the advantage of self-pointed arrays over passively viewed arrays. Experiment 2 showed that, when participants passively observed the pointing movements performed by the experimenter, move arrays were recognized no better than no-move arrays. Finally, Experiment 3 demonstrated that, in a joint-action condition in which participants alternated with the experimenter in making pointing movements, the advantage of experimenter-pointed arrays over passively viewed arrays was significant and similar in size to the advantage produced by self-performed movements. Importantly, a series of cross-experiment comparisons indicated that the higher recognition of both self- and experimenter-pointed arrays in Experiment 3 could be explained by the motor inhibition of no-move arrays. We propose that, in a joint condition, the pointing movements performed by the experimenter were represented in the same functional way as self-performed movements and that this produced the motor inhibition of passively viewed arrays.
Collapse
Affiliation(s)
- Divya Bhatia
- Department of Psychology, Sapienza University, Via dei Marsi 78, 00185, Rome, Italy
| | - Pietro Spataro
- Department of Economy, Universitas Mercatorum, Rome, Italy
| | - Ramesh Kumar Mishra
- Center for Neural and Cognitive Sciences, University of Hyderabad, Hyderabad, India
| | - Vincenzo Cestari
- Department of Psychology, Sapienza University, Via dei Marsi 78, 00185, Rome, Italy
| | - Fabrizio Doricchi
- Department of Psychology, Sapienza University, Via dei Marsi 78, 00185, Rome, Italy.,Fondazione Santa Lucia IRCCS, Rome, Italy
| | - Clelia Rossi-Arnaud
- Department of Psychology, Sapienza University, Via dei Marsi 78, 00185, Rome, Italy.
| |
Collapse
|
28
|
Evidence for we-representations during joint action planning. Neuropsychologia 2019; 131:73-83. [PMID: 31153967 PMCID: PMC6667733 DOI: 10.1016/j.neuropsychologia.2019.05.029] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2018] [Revised: 04/25/2019] [Accepted: 05/29/2019] [Indexed: 11/21/2022]
Abstract
Do people engaged in joint action form action plans that specify joint outcomes at the group level? EEG was recorded from pairs of participants who performed coordinated actions that could result in different postural configurations. To isolate individual and joint action planning processes, a pre-cue specified in advance the individual actions and/or the joint configuration. Participants had 1200 ms to prepare their actions. Then a Go cue specified all action parameters and participants performed a synchronized action as quickly as possible. Action onsets were shorter when the pre-cue specified the joint configuration, regardless of whether individual action was also specified. EEG analyses showed that specifying joint action parameters in advance reduced ambiguity in a structured joint action plan (reflected in the decrease of the amplitude of the P600) and helped with representing action goals and interpersonal coordination patterns in sensorimotor brain areas (reflected in increased alpha/mu suppression and CNV amplitudes). These results provide clear evidence that joint action is driven not only by action plans that specify individual contributions, but also by action plans that specify joint action outcomes at the group level. People form individual and group-level representations during joint action planning. Information about joint configuration benefits task performance. Information about joint configuration reduces ambiguity in joint task representation. Evidence for predictive “we-representations” in the sensorimotor system. “We-representations” may be formed independently of “I” and “You” representations.
Collapse
|
29
|
Two Brains in Action: Joint-Action Coding in the Primate Frontal Cortex. J Neurosci 2019; 39:3514-3528. [PMID: 30804088 DOI: 10.1523/jneurosci.1512-18.2019] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2018] [Revised: 01/12/2019] [Accepted: 01/18/2019] [Indexed: 11/21/2022] Open
Abstract
Daily life often requires the coordination of our actions with those of another partner. After 50 years (1968-2018) of behavioral neurophysiology of motor control, the neural mechanisms that allow such coordination in primates are unknown. We studied this issue by recording cell activity simultaneously from dorsal premotor cortex (PMd) of two male interacting monkeys trained to coordinate their hand forces to achieve a common goal. We found a population of "joint-action cells" that discharged preferentially when monkeys cooperated in the task. This modulation was predictive in nature, because in most cells neural activity led in time the changes of the "own" and of the "other" behavior. These neurons encoded the joint-performance more accurately than "canonical action-related cells", activated by the action per se, regardless of the individual versus interactive context. A decoding of joint-action was obtained by combining the two brains' activities, using cells with directional properties distinguished from those associated to the "solo" behaviors. Action observation-related activity studied when one monkey observed the consequences of the partner's behavior, i.e., the cursor's motion on the screen, did not sharpen the accuracy of joint-action cells' representation, suggesting that it plays no major role in encoding joint-action. When monkeys performed with a non-interactive partner, such as a computer, joint-action cells' representation of the other (non-cooperative) behavior was significantly degraded. These findings provide evidence of how premotor neurons integrate the time-varying representation of the self-action with that of a co-actor, thus offering a neural substrate for successful visuomotor coordination between individuals.SIGNIFICANCE STATEMENT The neural bases of intersubject motor coordination were studied by recording cell activity simultaneously from the frontal cortex of two interacting monkeys, trained to coordinate their hand forces to achieve a common goal. We found a new class of cells, preferentially active when the monkeys cooperated, rather than when the same action was performed individually. These "joint-action neurons" offered a neural representation of joint-behaviors by far more accurate than that provided by the "canonical action-related cells", modulated by the action per se regardless of the individual/interactive context. A neural representation of joint-performance was obtained by combining the activity recorded from the two brains. Our findings offer the first evidence concerning neural mechanisms subtending interactive visuomotor coordination between co-acting agents.
Collapse
|
30
|
Curioni A, Vesper C, Knoblich G, Sebanz N. Reciprocal information flow and role distribution support joint action coordination. Cognition 2019; 187:21-31. [PMID: 30797991 PMCID: PMC6446186 DOI: 10.1016/j.cognition.2019.02.006] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2018] [Revised: 02/05/2019] [Accepted: 02/06/2019] [Indexed: 12/03/2022]
Abstract
Many joint actions require task partners to temporally coordinate actions that follow different spatial patterns. This creates the need to find trade-offs between temporal coordination and spatial alignment. To study coordination under incongruent spatial and temporal demands, we devised a novel coordination task that required task partners to synchronize their actions while tracing different shapes that implied conflicting velocity profiles. In three experiments, we investigated whether coordination under incongruent demands is best achieved through mutually coupled predictions or through a clear role distribution with only one task partner adjusting to the other. Participants solved the task of trading off spatial and temporal coordination demands equally well when mutually perceiving each other’s actions without any role distribution, and when acting in a leader-follower configuration where the leader was unable to see the follower’s actions. Coordination was significantly worse when task partners who had been assigned roles could see each other’s actions. These findings make three contributions to our understanding of coordination mechanisms in joint action. First, they show that mutual prediction facilitates coordination under incongruent demands, demonstrating the importance of coupled predictive models in a wide range of coordination contexts. Second, they show that mutual alignment of velocity profiles in the absence of a leader-follower dynamic is more wide-spread than previously thought. Finally, they show that role distribution can result in equally effective coordination as mutual prediction without role assignment, provided that the role distribution is not arbitrarily imposed but determined by (lack of) perceptual access to a partner’s actions.
Collapse
Affiliation(s)
- Arianna Curioni
- Department of Cognitive Science, Central European University, Budapest, Hungary.
| | - Cordula Vesper
- School of Communication and Culture, Aarhus University, Aarhus, Denmark
| | - Günther Knoblich
- Department of Cognitive Science, Central European University, Budapest, Hungary
| | - Natalie Sebanz
- Department of Cognitive Science, Central European University, Budapest, Hungary
| |
Collapse
|
31
|
Rupp MA, McConnell DS, Smither JA. Examining associations between action game play and motor control. Acta Psychol (Amst) 2019; 193:55-65. [PMID: 30594040 DOI: 10.1016/j.actpsy.2018.12.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2017] [Revised: 11/04/2018] [Accepted: 12/06/2018] [Indexed: 01/02/2023] Open
Abstract
The effects of playing action video games have been investigated across a wide range of attentional and cognitive abilities. However, few studies have examined the association between motor control and action gaming experience. We report data from two discrete pointing tasks, manipulating the index of difficulty (ID) by movement distance and target size, respectively. Participants' gaming experience ranged from non-players to individuals who played several hours a night. Our results indicated greater experience playing action games, but not video games in general, was associated with shorter movement times (MT), higher velocities, and shallower ID-MT slopes when difficulty was manipulated across increasingly further distances and smaller target sizes. Additionally casual players, those who only play action games a couple times a week, were able to achieve a similar level of performance as more experienced players.
Collapse
Affiliation(s)
- Michael A Rupp
- Technology and Aging Laboratory, Department of Psychology, University of Central Florida, United States of America.
| | - Daniel S McConnell
- Technology and Aging Laboratory, Department of Psychology, University of Central Florida, United States of America
| | - Janan A Smither
- Technology and Aging Laboratory, Department of Psychology, University of Central Florida, United States of America
| |
Collapse
|
32
|
Dixon P, Glover S. Solo versus joint bimanual coordination. Exp Brain Res 2018; 237:273-287. [PMID: 30390100 DOI: 10.1007/s00221-018-5420-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2018] [Accepted: 10/27/2018] [Indexed: 11/29/2022]
Abstract
Understanding the differences between solo and joint action control is an important goal in psychology. The present study represented a novel approach in which participants performed a bimanual finger oscillation task, either alone or in pairs. It was hypothesized that performance of this task relies heavily on attention and utilizes two independent processes that differentially affect solo and joint performance. One process attempts to align the fingers correctly regardless of oscillation speed, and this is reflected in an alignment error evident even at slow oscillations. A second process attempts to minimize the time lag between the fingers as the oscillation speed increases, reflected in a temporal error indexed by the rate of error increase with increasing movement speed. In three experiments, alignment and temporal error in the finger oscillation task were compared in solo and joint actors. Overall, solo actors had much lower alignment error than joint actors. Solo actors also showed a reduction in temporal error when the fingers moved in a symmetrical rather than parallel fashion, consistent with previous research showing an increase in error with increasing movement speed. However, the effect of symmetry on temporal error did not occur with joint actors. Similar results were found with one hand inverted, suggesting that the pattern of results was not due to the use of homologous muscles. To test the role of visual feedback, we examined the effect of denying visual feedback to one of the actors in the joint condition. Paradoxically, under these conditions, there was lower temporal error in the symmetrical condition. These results are interpreted in terms of the organization of solo versus joint actions and the control of bimanual tasks in general.
Collapse
Affiliation(s)
- Peter Dixon
- Department of Psychology, University of Alberta, Edmonton, AB, T6G 2E9, Canada.
| | | |
Collapse
|
33
|
Abstract
Mutual adaptive timing (MAT), the capacity to adapt one's timing to the timing of a partner, is a form of interpersonal entrainment necessary to play music in ensemble. To this respect, two questions can be advanced. First, whether MAT can be seen also in non-musician populations. This might imply interesting theoretical consequences with respect to the hypothesis of an innate inter-subjective musicality. Second, whether subject's MAT can be influenced by the position of the partner's body. This might imply that MAT modulation is guided by changes in the feeling of body ownership and agency, which in turn would affect subject's cortico-spinal excitability patterns. In order to test these hypotheses, we employed an alternate joint finger tapping task (which can be easily carried out without being expert performers), while single-pulse TMS was delivered on M1. This experimental design allowed us to test MAT in non-musicians and to study cortico-spinal excitability patterns while manipulating partners' body position. Ownership and agency were tested by ad hoc questionnaires. We first found that MAT was present also in a non-musicians population and was not affected by the position of the partner, thus pointing to the universality of such a joint proto-musical competence. Moreover, cortico-spinal excitability was similar when the subject tapped alone ('solo condition') and when the subject tapped with the partner in a position congruent with the subject's body (the 'egocentric condition'). On the contrary, when the subject tapped with the partner placed in front of him (the 'allocentric' condition') cortico-spinal excitability was higher with respect to the solo and egocentric conditions. These results show that, despite the fact that the partner was present both in the egocentric and in the allocentric position, only the allocentric condition was treated as a social ensemble. Interestingly, in the egocentric condition the partner's body seemed to be treated as the subject's 'own' body. The subjective feeling of ownership and agency were coherent with the physiological data.
Collapse
|
34
|
Motor simulation of multiple observed actions. Cognition 2018; 180:200-205. [PMID: 30077822 DOI: 10.1016/j.cognition.2018.07.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2018] [Revised: 07/09/2018] [Accepted: 07/12/2018] [Indexed: 11/24/2022]
Abstract
Research has shown that observed actions are represented in the motor system, leading to automatic imitative responses. However, in social life, we often see multiple persons acting together. Here, we use an automatic imitation paradigm with four stimulus hands to investigate the hypothesis that multiple observed actions can be represented at the same time in the motor system. Experiments 1 and 2 revealed weaker automatic imitation when one hand performed a different action than the other three hands, compared with when three or four hands all performed the same action. Experiment 3 replicated this effect with mutually exclusive actions. These results show that multiple observed actions can be represented simultaneously in the motor system, even when they cannot be executed together. This has important implications for theories of interaction representation.
Collapse
|
35
|
Candidi M, Sacheli LM, Era V, Canzano L, Tieri G, Aglioti SM. Come together: human-avatar on-line interactions boost joint-action performance in apraxic patients. Soc Cogn Affect Neurosci 2018; 12:1793-1802. [PMID: 29140533 PMCID: PMC5714226 DOI: 10.1093/scan/nsx114] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2017] [Accepted: 10/01/2017] [Indexed: 01/24/2023] Open
Abstract
Limb apraxia (LA) is a high-order motor disorder linked to left-hemisphere damage. It is characterized by defective execution of purposeful actions upon delayed imitation, or verbal command when the actions are performed in isolated, non-naturalistic, conditions. Whether interpersonal interactions provide social affordances that activate neural resources different from those requested by individual action execution, which may improve LA performance, is unknown. To fill this gap, we measured interaction performance, behavioral and kinematic indexes of left-brain damaged patients with/without LA in a social reach-to-grasp task involving two different degrees of spatio-temporal interactivity with an avatar. We found that LA patients' impairment in coordinating with the virtual partner was abolished in highly interactive conditions (where patients selected their actions on-line based on the behavior of the virtual partner) with respect to low interactive conditions (where actions were selected beforehand based on abstract instructions). Voxel-based-Lesion-Symptom-Mapping indicated that impairments in low-interactive conditions were underpinned by lesions of premotor, motor and insular areas, and of the basal ganglia. Our approach expands current understanding of the behavioral and neural correlates of interactive motor performance by highlighting the important role of social affordances, and provides novel, potentially important, views on rehabilitation of higher-order motor cognition disorders.
Collapse
Affiliation(s)
- Matteo Candidi
- Department of Psychology, Sapienza University, 00185 Rome, Italy.,IRCCS Fondazione Santa Lucia, 00100 Rome, Italy
| | - Lucia M Sacheli
- Department of Psychology, Sapienza University, 00185 Rome, Italy.,IRCCS Fondazione Santa Lucia, 00100 Rome, Italy.,Department of Psychology and Milan Center for Neuroscience (NeuroMi), University of Milano-Bicocca, 20126 Milan, Italy
| | - Vanessa Era
- Department of Psychology, Sapienza University, 00185 Rome, Italy.,IRCCS Fondazione Santa Lucia, 00100 Rome, Italy
| | - Loredana Canzano
- Department of Psychology, Sapienza University, 00185 Rome, Italy.,IRCCS Fondazione Santa Lucia, 00100 Rome, Italy
| | - Gaetano Tieri
- IRCCS Fondazione Santa Lucia, 00100 Rome, Italy.,"Unitelme Sapienza", 00161 Rome, Italy
| | - Salvatore M Aglioti
- Department of Psychology, Sapienza University, 00185 Rome, Italy.,IRCCS Fondazione Santa Lucia, 00100 Rome, Italy
| |
Collapse
|
36
|
Kuhlen AK, Bogler C, Brennan SE, Haynes JD. Brains in dialogue: decoding neural preparation of speaking to a conversational partner. Soc Cogn Affect Neurosci 2018; 12:871-880. [PMID: 28338791 PMCID: PMC5472159 DOI: 10.1093/scan/nsx018] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2016] [Accepted: 02/07/2017] [Indexed: 11/14/2022] Open
Abstract
In dialogue, language processing is adapted to the conversational partner. We hypothesize that the brain facilitates partner-adapted language processing through preparatory neural configurations (task sets) that are tailored to the conversational partner. In this experiment, we measured neural activity with functional magnetic resonance imaging (fMRI) while healthy participants in the scanner (a) engaged in a verbal communication task with a conversational partner outside of the scanner, or (b) spoke outside of a conversational context (to test the microphone). Using multivariate searchlight analysis, we identify cortical regions that represent information on whether speakers plan to speak to a conversational partner or without having a partner. Most notably a region that has been associated with processing social-affective information and perspective taking, the ventromedial prefrontal cortex, as well as regions that have been associated with prospective task representation, the bilateral ventral prefrontal cortex, are involved in encoding the speaking condition. Our results suggest that speakers prepare, in advance of speaking, for the social context in which they will speak.
Collapse
Affiliation(s)
- Anna K Kuhlen
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health (BIH); Bernstein Center for Computational Neuroscience, Berlin Center for Advanced Neuroimaging, Department of Neurology, and Excellence Cluster NeuroCure, Berlin, Germany.,Humboldt-Universität zu Berlin, Berlin School of Mind and Brain and Institute of Psychology, Berlin, Germany
| | - Carsten Bogler
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health (BIH); Bernstein Center for Computational Neuroscience, Berlin Center for Advanced Neuroimaging, Department of Neurology, and Excellence Cluster NeuroCure, Berlin, Germany
| | - Susan E Brennan
- Department of Psychology, Stony Brook University, Stony Brook, NY, USA
| | - John-Dylan Haynes
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health (BIH); Bernstein Center for Computational Neuroscience, Berlin Center for Advanced Neuroimaging, Department of Neurology, and Excellence Cluster NeuroCure, Berlin, Germany.,Humboldt-Universität zu Berlin, Berlin School of Mind and Brain and Institute of Psychology, Berlin, Germany
| |
Collapse
|
37
|
Peterburs J, Liepelt R, Voegler R, Ocklenburg S, Straube T. It's not me, it's you - Differential neural processing of social and non-social nogo cues in joint action. Soc Neurosci 2017; 14:114-124. [PMID: 29115181 DOI: 10.1080/17470919.2017.1403374] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
This study used a joint flanker task to investigate differences in processing of social and non-social nogo cues, i.e., between cues indicating that a co-actor should respond and cues signaling that neither actor nor co-actor should respond, using event-related potentials (ERPs) and trial-to-trial response times (RTs). It was hypothesized that a social co-actor's response should be reflected in stronger modulation (slower RTs on subsequent trials; augmented neural responses) for social compared to non-social nogo. RTs and ERPs replicated flanker compatibility effects, with faster responses and increased P3a on compatible trials. In line with the hypotheses, ERPs revealed distinct coding of social and non-social nogo in the conflict-sensitive N2 which showed a compatibility effect only for social nogo, and in the attention/memory-related P3b which was larger for social relative to non-social nogo. The P3a did not distinguish between social and non-social nogo, but was larger for compatible and smaller for go trials. Contrary to our hypotheses, RTs were faster after social relative to non-social nogo. Hence, the representation of the co-actor's response in joint action modulates conflict processing reflected in the N2 and response discrimination and evaluation reflected in the P3b and may facilitate subsequent responses in the context of social versus non-social nogo.
Collapse
Affiliation(s)
- Jutta Peterburs
- a Institute of Medical Psychology and Systems Neuroscience , University of Münster , Münster , Germany
| | - Roman Liepelt
- b Institute of Psychology , German Sport University Cologne , Cologne , Germany.,c Department of Psychology , University of Münster , Münster , Germany
| | - Rolf Voegler
- a Institute of Medical Psychology and Systems Neuroscience , University of Münster , Münster , Germany
| | - Sebastian Ocklenburg
- d Department of Biological Psychology, Institute of Cognitive Neuroscience , Ruhr-University Bochum , Bochum , Germany
| | - Thomas Straube
- a Institute of Medical Psychology and Systems Neuroscience , University of Münster , Münster , Germany
| |
Collapse
|
38
|
Sciutti A, Sandini G. Interacting With Robots to Investigate the Bases of Social Interaction. IEEE Trans Neural Syst Rehabil Eng 2017; 25:2295-2304. [PMID: 29035218 DOI: 10.1109/tnsre.2017.2753879] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Humans show a great natural ability at interacting with each other. Such efficiency in joint actions depends on a synergy between planned collaboration and emergent coordination, a subconscious mechanism based on a tight link between action execution and perception. This link supports phenomena as mutual adaptation, synchronization, and anticipation, which cut drastically the delays in the interaction and the need of complex verbal instructions and result in the establishment of joint intentions, the backbone of social interaction. From a neurophysiological perspective, this is possible, because the same neural system supporting action execution is responsible of the understanding and the anticipation of the observed action of others. Defining which human motion features allow for such emergent coordination with another agent would be crucial to establish more natural and efficient interaction paradigms with artificial devices, ranging from assistive and rehabilitative technology to companion robots. However, investigating the behavioral and neural mechanisms supporting natural interaction poses substantial problems. In particular, the unconscious processes at the basis of emergent coordination (e.g., unintentional movements or gazing) are very difficult-if not impossible-to restrain or control in a quantitative way for a human agent. Moreover, during an interaction, participants influence each other continuously in a complex way, resulting in behaviors that go beyond experimental control. In this paper, we propose robotics technology as a potential solution to this methodological problem. Robots indeed can establish an interaction with a human partner, contingently reacting to his actions without losing the controllability of the experiment or the naturalness of the interactive scenario. A robot could represent an "interactive probe" to assess the sensory and motor mechanisms underlying human-human interaction. We discuss this proposal with examples from our research with the humanoid robot iCub, showing how an interactive humanoid robot could be a key tool to serve the investigation of the psychological and neuroscientific bases of social interaction.
Collapse
|
39
|
Della Gatta F, Garbarini F, Rabuffetti M, Viganò L, Butterfill SA, Sinigaglia C. Drawn together: When motor representations ground joint actions. Cognition 2017; 165:53-60. [PMID: 28501547 DOI: 10.1016/j.cognition.2017.04.008] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2016] [Revised: 04/14/2017] [Accepted: 04/24/2017] [Indexed: 11/17/2022]
Abstract
What enables individuals to act together? Recent discoveries suggest that a variety of mechanisms are involved. But something fundamental is yet to be investigated. In joint action, agents represent a collective goal, or so it is often assumed. But how, if at all, are collective goals represented in joint action and how do such representations impact performance? To investigate this question we adapted a bimanual paradigm, the circle-line drawing paradigm, to contrast two agents acting in parallel with two agents performing a joint action. Participants were required to draw lines or circles while observing circles or lines being drawn. The findings indicate that interpersonal motor coupling may occur in joint but not parallel action. This suggests that participants in joint actions can represent collective goals motorically.
Collapse
Affiliation(s)
- Francesco Della Gatta
- Department of Philosophy, University of Milan, via Festa del Perdono 7, I-20122 Milano, Italy
| | - Francesca Garbarini
- Department of Psychology, University of Turin, via Po 14, I-10123 Milano, Italy
| | - Marco Rabuffetti
- Department of Biomedical Technology, IRCCS Don Carlo Gnocchi Foundation Milan, Italy
| | - Luca Viganò
- Department of Philosophy, University of Milan, via Festa del Perdono 7, I-20122 Milano, Italy
| | | | - Corrado Sinigaglia
- Department of Philosophy, University of Milan, via Festa del Perdono 7, I-20122 Milano, Italy; Center for the Study of Social Action, University of Milan, Italy.
| |
Collapse
|
40
|
Endedijk HM, Meyer M, Bekkering H, Cillessen AHN, Hunnius S. Neural mirroring and social interaction: Motor system involvement during action observation relates to early peer cooperation. Dev Cogn Neurosci 2017; 24:33-41. [PMID: 28119184 PMCID: PMC6987761 DOI: 10.1016/j.dcn.2017.01.001] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2016] [Revised: 11/24/2016] [Accepted: 01/03/2017] [Indexed: 01/09/2023] Open
Abstract
Whether we hand over objects to someone, play a team sport, or make music together, social interaction often involves interpersonal action coordination, both during instances of cooperation and entrainment. Neural mirroring is thought to play a crucial role in processing other's actions and is therefore considered important for social interaction. Still, to date, it is unknown whether interindividual differences in neural mirroring play a role in interpersonal coordination during different instances of social interaction. A relation between neural mirroring and interpersonal coordination has particularly relevant implications for early childhood, since successful early interaction with peers is predictive of a more favorable social development. We examined the relation between neural mirroring and children's interpersonal coordination during peer interaction using EEG and longitudinal behavioral data. Results showed that 4-year-old children with higher levels of motor system involvement during action observation (as indicated by lower beta-power) were more successful in early peer cooperation. This is the first evidence for a relation between motor system involvement during action observation and interpersonal coordination during other instances of social interaction. The findings suggest that interindividual differences in neural mirroring are related to interpersonal coordination and thus successful social interaction.
Collapse
Affiliation(s)
- H M Endedijk
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands; Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands.
| | - M Meyer
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
| | - H Bekkering
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
| | - A H N Cillessen
- Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands.
| | - S Hunnius
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
| |
Collapse
|
41
|
The predictability of a partner’s actions modulates the sense of joint agency. Cognition 2017; 161:60-65. [DOI: 10.1016/j.cognition.2017.01.004] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2016] [Revised: 01/04/2017] [Accepted: 01/07/2017] [Indexed: 01/08/2023]
|
42
|
Wriessnegger S, Steyrl D, Koschutnig K, Müller-Putz G. Cooperation in mind: Motor imagery of joint and single actions is represented in different brain areas. Brain Cogn 2016; 109:19-25. [DOI: 10.1016/j.bandc.2016.08.008] [Citation(s) in RCA: 58] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2016] [Revised: 08/18/2016] [Accepted: 08/24/2016] [Indexed: 11/27/2022]
|
43
|
Buttelmann F, Buttelmann D. The influence of a bystander agent's beliefs on children's and adults' decision-making process. J Exp Child Psychol 2016; 153:126-139. [PMID: 27741442 DOI: 10.1016/j.jecp.2016.09.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2016] [Revised: 09/14/2016] [Accepted: 09/15/2016] [Indexed: 10/20/2022]
Abstract
The ability to attribute and represent others' mental states (e.g., beliefs; so-called "theory of mind") is essential for participation in human social interaction. Despite a considerable body of research using tasks in which protagonists in the participants' attentional focus held false or true beliefs, the question of automatic belief attribution to bystander agents has received little attention. In the current study, we presented adults and 6-year-olds (N=92) with an implicit computer-based avoidance false-belief task in which participants were asked to place an object into one of three boxes. While doing so, we manipulated the beliefs of an irrelevant human-like or non-human-like bystander agent who was visible on the screen. Importantly, the bystander agent's beliefs were irrelevant for solving the task. Still, children's decision making was significantly influenced by the bystander agent's beliefs even if this was a non-human-like self-propelled object. Such an influence did not become obvious in adults' deliberate decisions but occurred only in their reaction times, which suggests that they also processed the bystander agent's beliefs but were able to suppress the influence of such beliefs on their behavior regulation. The results of a control study (N=53) ruled out low-level explanations and confirmed that self-propelledness of agents is a necessary factor for belief attribution to occur. Thus, not only do humans spontaneously ascribe beliefs to self-propelled bystander agents, but those beliefs even influence meaningful decisions in children.
Collapse
|
44
|
Abstract
The human ability to perform joint actions is often attributed to high-level cognitive processes. For example, the finding that action leaders act faster when imitated by their partners has been interpreted as evidence for anticipation of the other's actions (Pfister, Dignath, Hommel, & Kunde, 2013). In two experiments, we showed that a low-level mechanism can account for this finding. Action leaders were faster when imitated than when counterimitated, but only if they could observe their partner's actions (Exp. 1). Crucially, when due to our manipulation the partner's imitative actions became slower than the counterimitative actions, leaders also became slower when they were imitated, and faster when counterimitated (Exp. 2). Our results suggest that spontaneous temporal adaptation is a key mechanism in joint action tasks. We argue for a reconsideration of other phenomena that have traditionally been attributed solely to high-level processes.
Collapse
|
45
|
Wahn B, Schwandt J, Krüger M, Crafa D, Nunnendorf V, König P. Multisensory teamwork: using a tactile or an auditory display to exchange gaze information improves performance in joint visual search. ERGONOMICS 2016; 59:781-795. [PMID: 26587687 DOI: 10.1080/00140139.2015.1099742] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2014] [Accepted: 09/15/2015] [Indexed: 06/05/2023]
Abstract
In joint tasks, adjusting to the actions of others is critical for success. For joint visual search tasks, research has shown that when search partners visually receive information about each other's gaze, they use this information to adjust to each other's actions, resulting in faster search performance. The present study used a visual, a tactile and an auditory display, respectively, to provide search partners with information about each other's gaze. Results showed that search partners performed faster when the gaze information was received via a tactile or auditory display in comparison to receiving it via a visual display or receiving no gaze information. Findings demonstrate the effectiveness of tactile and auditory displays for receiving task-relevant information in joint tasks and are applicable to circumstances in which little or no visual information is available or the visual modality is already taxed with a demanding task such as air-traffic control. Practitioner Summary: The present study demonstrates that tactile and auditory displays are effective for receiving information about actions of others in joint tasks. Findings are either applicable to circumstances in which little or no visual information is available or when the visual modality is already taxed with a demanding task.
Collapse
Affiliation(s)
- Basil Wahn
- a Institute of Cognitive Science , Universität Osnabrück , Osnabrück , Germany
| | - Jessika Schwandt
- a Institute of Cognitive Science , Universität Osnabrück , Osnabrück , Germany
| | - Matti Krüger
- a Institute of Cognitive Science , Universität Osnabrück , Osnabrück , Germany
| | - Daina Crafa
- a Institute of Cognitive Science , Universität Osnabrück , Osnabrück , Germany
- b Integrated Program in Neuroscience, Douglas Mental Health Institute , McGill University , Montreal , Canada
| | - Vanessa Nunnendorf
- a Institute of Cognitive Science , Universität Osnabrück , Osnabrück , Germany
| | - Peter König
- a Institute of Cognitive Science , Universität Osnabrück , Osnabrück , Germany
- c Institut für Neurophysiologie und Pathophysiologie , Universitätsklinikum Hamburg-Eppendorf , Hamburg , Germany
| |
Collapse
|
46
|
Faber TW, van Elk M, Jonas KJ. Complementary Hand Responses Occur in Both Peri- and Extrapersonal Space. PLoS One 2016; 11:e0154457. [PMID: 27120470 PMCID: PMC4847918 DOI: 10.1371/journal.pone.0154457] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2015] [Accepted: 04/12/2016] [Indexed: 11/18/2022] Open
Abstract
Human beings have a strong tendency to imitate. Evidence from motor priming paradigms suggests that people automatically tend to imitate observed actions such as hand gestures by performing mirror-congruent movements (e.g., lifting one’s right finger upon observing a left finger movement; from a mirror perspective). Many observed actions however, do not require mirror-congruent responses but afford complementary (fitting) responses instead (e.g., handing over a cup; shaking hands). Crucially, whereas mirror-congruent responses don't require physical interaction with another person, complementary actions often do. Given that most experiments studying motor priming have used stimuli devoid of contextual information, this space or interaction-dependency of complementary responses has not yet been assessed. To address this issue, we let participants perform a task in which they had to mirror or complement a hand gesture (fist or open hand) performed by an actor depicted either within or outside of reach. In three studies, we observed faster reaction times and less response errors for complementary relative to mirrored hand movements in response to open hand gestures (i.e., ‘hand-shaking’) irrespective of the perceived interpersonal distance of the actor. This complementary effect could not be accounted for by a low-level spatial cueing effect. These results demonstrate that humans have a strong and automatic tendency to respond by performing complementary actions. In addition, our findings underline the limitations of manipulations of space in modulating effects of motor priming and the perception of affordances.
Collapse
Affiliation(s)
- Tim W. Faber
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
- * E-mail:
| | - Michiel van Elk
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
| | - Kai J. Jonas
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|
47
|
Meyer M, Bekkering H, Haartsen R, Stapel J, Hunnius S. The role of action prediction and inhibitory control for joint action coordination in toddlers. J Exp Child Psychol 2015; 139:203-20. [DOI: 10.1016/j.jecp.2015.06.005] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2015] [Revised: 06/08/2015] [Accepted: 06/09/2015] [Indexed: 11/27/2022]
|
48
|
Loehr JD, Vesper C. The sound of you and me: Novices represent shared goals in joint action. Q J Exp Psychol (Hove) 2015; 69:535-47. [PMID: 26073040 DOI: 10.1080/17470218.2015.1061029] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
People performing joint actions coordinate their individual actions with each other to achieve a shared goal. The current study investigated the mental representations that are formed when people learn a new skill as part of a joint action. In a musical transfer-of-learning paradigm, piano novices first learned to perform simple melodies in the joint action context of coordinating with an accompanist to produce musical duets. Participants then performed their previously learned actions with two types of auditory feedback: while hearing either their individual action goal (the melody) or the shared action goal (the duet). As predicted, participants made more performance errors in the individual goal condition than in the shared goal condition. Further experimental manipulations indicated that this difference was not due to different coordination requirements in the two conditions or perceptual dissimilarities between learning and test. Together, these findings indicate that people form representations of shared goals in contexts that promote minimal representations, such as when learning a new action together with another person.
Collapse
Affiliation(s)
- Janeen D Loehr
- a Donders Institute for Brain, Cognition and Behaviour , Radboud University Nijmegen , Nijmegen , The Netherlands.,b Department of Psychology , University of Saskatchewan , Saskatoon , SK , Canada
| | - Cordula Vesper
- a Donders Institute for Brain, Cognition and Behaviour , Radboud University Nijmegen , Nijmegen , The Netherlands.,c Department of Cognitive Science , Central European University , Budapest , Hungary
| |
Collapse
|
49
|
Kourtis D, Knoblich G, Woźniak M, Sebanz N. Attention Allocation and Task Representation during Joint Action Planning. J Cogn Neurosci 2014; 26:2275-86. [DOI: 10.1162/jocn_a_00634] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
We investigated whether people take into account an interaction partner's attentional focus and whether they represent in advance their partner's part of the task when planning to engage in a synchronous joint action. The experiment involved two participants planning and performing joint actions (i.e., synchronously lifting and clinking glasses), unimanual individual actions (i.e., lifting and moving a glass as if clinking with another person), and bimanual individual actions. EEG was recorded from one of the participants. We employed a choice reaction paradigm where a visual cue indicated the type of action to be planned, followed 1.5 sec later by a visual go stimulus, prompting the participants to act. We studied attention allocation processes by examining two lateralized EEG components, namely the anterior directing attention negativity and the late directing attention positivity. Action planning processes were examined using the late contingent negative variation and the movement-related potential. The results show that early stages of joint action planning involve dividing attention between locations in space relevant for one's own part of the joint action and locations relevant for one's partner's part of the joint action. At later stages of joint action planning, participants represented in advance their partner's upcoming action in addition to their own action, although not at an effector-specific level. Our study provides electrophysiological evidence supporting the operation of attention sharing processes and predictive self/other action representation during the planning phase of a synchronous joint task.
Collapse
Affiliation(s)
- Dimitrios Kourtis
- 1Ghent University
- 2Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands
| | - Günther Knoblich
- 2Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands
- 3Central European University, Budapest, Hungary
| | | | - Natalie Sebanz
- 2Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands
- 3Central European University, Budapest, Hungary
| |
Collapse
|
50
|
Keitel A, Prinz W, Daum MM. Perception of individual and joint action in infants and adults. PLoS One 2014; 9:e107450. [PMID: 25202914 PMCID: PMC4174902 DOI: 10.1371/journal.pone.0107450] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2014] [Accepted: 08/13/2014] [Indexed: 11/19/2022] Open
Abstract
Infants and adults frequently observe actions performed jointly by more than one person. Research in action perception, however, has focused largely on actions performed by an individual person. Here, we explore how 9- and 12-month-old infants and adults perceive a block-stacking action performed by either one agent (individual condition) or two agents (joint condition). We used eye tracking to measure the latency of participants' gaze shifts towards action goals. Adults anticipated goals in both conditions significantly faster than infants, and their gaze latencies did not differ between conditions. By contrast, infants showed faster anticipation of goals in the individual condition than in the joint condition. This difference was more pronounced in 9-month-olds. Further analyses of fixations examined the role of visual attention in action perception. These findings are cautiously interpreted in terms of low-level processing in infants and higher-level processing in adults. More precisely, our results suggest that adults are able to infer the overarching joint goal of two agents, whereas infants are not yet able to do so and might rely primarily on visual cues to infer the respective sub-goals. In conclusion, our findings indicate that the perception of joint action in infants develops differentially from that of individual action.
Collapse
Affiliation(s)
- Anne Keitel
- Centre for Cognitive Neuroimaging, Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
- Research Group ‘Infant Cognition and Action’, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Wolfgang Prinz
- Department of Psychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Moritz M. Daum
- Research Group ‘Infant Cognition and Action’, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Developmental Psychology, Department of Psychology, University of Zurich, Zurich, Switzerland
| |
Collapse
|