1
|
Bolt NK, Loehr JD. Motor-related cortical oscillations distinguish one's own from a partner's contributions to a joint action. Biol Psychol 2024; 190:108804. [PMID: 38670429 DOI: 10.1016/j.biopsycho.2024.108804] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Revised: 04/13/2024] [Accepted: 04/19/2024] [Indexed: 04/28/2024]
Abstract
The ability to distinguish between one's own and others' actions is a requirement for successful joint action. Such a distinction might be supported by dissociable motor activity underlying each partner's individual contributions to the joint action. However, little research has directly compared motor activity associated with one's own vs. others' actions during joint action. The current study investigated whether motor-related cortical oscillations distinguish between self- and partner-produced actions when partners take turns producing taps to meet a joint timing goal. Across two experiments, the degree of beta suppression differentiated one's own from a partner's actions, with more suppression occurring during one's own actions than during a partner's actions. Self-partner differences in mu suppression were also evident, particularly when partners produced actions in succession. Increased beta suppression was also observed during partners' actions when they were followed by one's own actions, suggesting that the coordination demands imposed by the joint action could affect the pattern of beta reactivity during a turn-taking joint action. Together, these findings demonstrate that dynamic patterns of motor activity underpin successful joint action and that periods of distinct motor activity are associated with one's own contributions to a joint action.
Collapse
Affiliation(s)
- Nicole K Bolt
- Department of Psychology and Health Studies, University of Saskatchewan, Canada.
| | - Janeen D Loehr
- Department of Psychology and Health Studies, University of Saskatchewan, Canada
| |
Collapse
|
2
|
Marschner M, Dignath D, Knoblich G. Me or we? Action-outcome learning in synchronous joint action. Cognition 2024; 247:105785. [PMID: 38583324 DOI: 10.1016/j.cognition.2024.105785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 02/26/2024] [Accepted: 03/26/2024] [Indexed: 04/09/2024]
Abstract
Goal-directed behaviour requires mental representations that encode instrumental relationships between actions and their outcomes. The present study investigated how people acquire representations of joint actions where co-actors perform synchronized action contributions to produce joint outcomes in the environment. Adapting an experimental procedure to assess individual action-outcome learning, we tested whether co-acting individuals link jointly produced action outcomes to individual-level features of their own action contributions or to group-level features of their joint action instead. In a learning phase, pairs of participants produced musical chords by synchronizing individual key press responses. In a subsequent test phase, the previously produced chords were presented as imperative stimuli requiring forced-choice responses by both pair members. Stimulus-response mappings were systematically manipulated to be either compatible or incompatible with the individual and joint action-outcome mappings of the preceding learning phase. Only joint but not individual compatibility was found to modulate participants' performance in the test phase. Yet, opposite to predictions of associative accounts of action-outcome learning, jointly incompatible mappings between learning and test phase resulted in better performance. We discuss a possible explanation of this finding, proposing that pairs' group-level learning experience modulated how participants encoded ambiguous task instructions in the test phase. Our findings inform current debates about mechanistic explanations of action-outcome learning effects and provide novel evidence that joint action is supported by dedicated mental representations encoding own and others' actions on a group level.
Collapse
Affiliation(s)
| | - David Dignath
- Department of Psychology, Eberhard Karls University of Tübingen, Tübingen, Germany.
| | - Günther Knoblich
- Department of Cognitive Science, Central European University, Vienna, Austria.
| |
Collapse
|
3
|
Zamm A, Loehr JD, Vesper C, Konvalinka I, Kappel SL, Heggli OA, Vuust P, Keller PE. A practical guide to EEG hyperscanning in joint action research: from motivation to implementation. Soc Cogn Affect Neurosci 2024; 19:nsae026. [PMID: 38584414 PMCID: PMC11086947 DOI: 10.1093/scan/nsae026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 12/31/2023] [Accepted: 03/15/2024] [Indexed: 04/09/2024] Open
Abstract
Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.
Collapse
Affiliation(s)
- Anna Zamm
- Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus 8000, Denmark
- Interacting Minds Center, Aarhus University, Aarhus 8000, Denmark
| | - Janeen D Loehr
- Department of Psychology and Health Studies, University of Saskatchewan, Saskatoon, SK S7N 5A5, Canada
| | - Cordula Vesper
- Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus 8000, Denmark
- Interacting Minds Center, Aarhus University, Aarhus 8000, Denmark
| | - Ivana Konvalinka
- Section for Cognitive Systems, DTU Compute, Technical University of Denmark, Kongens Lyngby DK-2800, Denmark
| | - Simon L Kappel
- Department of Electrical and Computer Engineering, Aarhus University, Aarhus N 8200, Denmark
| | - Ole A Heggli
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
| | - Peter E Keller
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, New South Wales 2751, Australia
| |
Collapse
|
4
|
Constable MD, McEwen ES, Knoblich G, Gibson C, Addison A, Nestor S, Call J. Chimpanzees demonstrate a behavioural signature of human joint action. Cognition 2024; 246:105747. [PMID: 38412760 DOI: 10.1016/j.cognition.2024.105747] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Revised: 01/13/2024] [Accepted: 02/16/2024] [Indexed: 02/29/2024]
Abstract
The strength of human society can largely be attributed to the tendency to work together to achieve outcomes that are not possible alone. Effective social coordination benefits from mentally representing a partner's actions. Specifically, humans optimize social coordination by forming internal action models adapted to joint rather than individual task demands. To what extent do humans share the cognitive mechanisms that support optimal human coordination and collaboration with other species? An ecologically inspired joint handover-to-retrieve task was systematically manipulated across several experiments to assess whether joint action planning in chimpanzees reflects similar patterns to humans. Chimpanzees' chosen handover locations shifted towards the location of the experimenter's free or unobstructed hand, suggesting they represent the constraints of the joint task even though their individual half of the task was unobstructed. These findings indicate that chimpanzees and humans may share common cognitive mechanisms or predispositions that support joint action.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Josep Call
- University of St Andrews, St Andrews, United Kingdom
| |
Collapse
|
5
|
Martínez M, Babb MH, Range F, Brosnan SF. The Joint Simon task is not joint for capuchin monkeys. Sci Rep 2024; 14:5937. [PMID: 38467698 PMCID: PMC10928181 DOI: 10.1038/s41598-024-55885-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Accepted: 02/27/2024] [Indexed: 03/13/2024] Open
Abstract
Human cooperation can be facilitated by the ability to create a mental representation of one's own actions, as well as the actions of a partner, known as action co-representation. Even though other species also cooperate extensively, it is still unclear whether they have similar capacities. The Joint Simon task is a two-player task developed to investigate this action co-representation. We tested brown capuchin monkeys (Sapajus [Cebus] apella), a highly cooperative species, on a computerized Joint Simon task and found that, in line with previous research, the capuchins' performance was compatible with co-representation. However, a deeper exploration of the monkeys' responses showed that they, and potentially monkeys in previous studies, did not understand the control conditions, which precludes the interpretation of the results as a social phenomenon. Indeed, further testing to investigate alternative explanations demonstrated that our results were due to low-level cues, rather than action co-representation. This suggests that the Joint Simon task, at least in its current form, cannot determine whether non-human species co-represent their partner's role in joint tasks.
Collapse
Affiliation(s)
- Mayte Martínez
- Domestication Lab, Konrad Lorenz Institute of Ethology, University of Veterinary Medicine Vienna, Savoyenstraße 1a, 1160, Vienna, Austria.
- Language Research Center, Georgia State University, Atlanta, GA, 30034, USA.
| | - Matthew H Babb
- Language Research Center, Georgia State University, Atlanta, GA, 30034, USA
- Departments of Psychology and Philosophy, Neuroscience Institute, Georgia State University, Atlanta, GA, 30034, USA
| | - Friederike Range
- Domestication Lab, Konrad Lorenz Institute of Ethology, University of Veterinary Medicine Vienna, Savoyenstraße 1a, 1160, Vienna, Austria
| | - Sarah F Brosnan
- Language Research Center, Georgia State University, Atlanta, GA, 30034, USA
- Departments of Psychology and Philosophy, Neuroscience Institute, Georgia State University, Atlanta, GA, 30034, USA
| |
Collapse
|
6
|
Flösch KP, Flaisch T, Imhof MA, Schupp HT. Alpha/beta oscillations reveal cognitive and affective brain states associated with role taking in a dyadic cooperative game. Cereb Cortex 2024; 34:bhad487. [PMID: 38100327 DOI: 10.1093/cercor/bhad487] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 11/27/2023] [Accepted: 11/28/2023] [Indexed: 12/17/2023] Open
Abstract
Social cooperation often requires taking different roles in order to reach a shared goal. By defining individual tasks, these roles dictate processing demands of the collaborators. The main aim of the present study was to examine the hypothesis that induced alpha and lower beta oscillations provide insights into affective and cognitive brain states during social cooperation. Toward this end, an experimental game was used in which participants had to navigate a Pacman figure through a maze by sending and receiving information about the correct moving direction. Supporting our hypotheses, individual roles taken by the collaborators during gameplay were associated with significant changes in alpha and lower beta power. Furthermore, effects were similar when participants played the Pacman Game with human or computer partners. Findings are discussed from the perspective of the information-via-desynchronization hypothesis proposing that alpha and lower beta power decreases reflect states of enhanced cortical information representation. Overall, experimental games are a useful tool for extending basic research on brain oscillations to the domain of naturalistic social interaction as emphasized by the second-person neuroscience perspective.
Collapse
Affiliation(s)
- Karl-Philipp Flösch
- Department of Psychology, University of Konstanz, Universitätsstraße 10, Konstanz 78464, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Universitätsstraße 10, Konstanz 78464, Germany
| | - Tobias Flaisch
- Department of Psychology, University of Konstanz, Universitätsstraße 10, Konstanz 78464, Germany
| | - Martin A Imhof
- Department of Psychology, University of Konstanz, Universitätsstraße 10, Konstanz 78464, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Universitätsstraße 10, Konstanz 78464, Germany
| | - Harald T Schupp
- Department of Psychology, University of Konstanz, Universitätsstraße 10, Konstanz 78464, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Universitätsstraße 10, Konstanz 78464, Germany
| |
Collapse
|
7
|
Flösch KP, Flaisch T, Imhof MA, Schupp HT. Dyadic cooperation with human and artificial agents: Event-related potentials trace dynamic role taking during an interactive game. Psychophysiology 2024; 61:e14433. [PMID: 37681492 DOI: 10.1111/psyp.14433] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 07/04/2023] [Accepted: 08/10/2023] [Indexed: 09/09/2023]
Abstract
Humans are highly co-operative and thus cognitively, affectively, and motivationally tuned to pursue shared goals. Yet, cooperative tasks typically require people to constantly take and switch individual roles. Task relevance is dictated by these roles and thereby dynamically changing. Here, we designed a dyadic game to test whether the family of P3 components can trace this dynamic allocation of task relevance. We demonstrate that late positive event-related potential (ERP) modulations not only reflect predictable asymmetries between receiving and sending information but also differentiate whether the receiver's role is related to correct decision making or action monitoring. Furthermore, similar results were observed when playing the game with a computer, suggesting that experimental games may motivate humans to similarly cooperate with an artificial agent. Overall, late positive ERP waves provide a real-time measure of how role taking dynamically shapes the meaning and relevance of stimuli within collaborative contexts. Our results, therefore, shed light on how the processes of mutual coordination unfold during dyadic cooperation.
Collapse
Affiliation(s)
- Karl-Philipp Flösch
- Department of Psychology, University of Konstanz, Konstanz, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz, Germany
| | - Tobias Flaisch
- Department of Psychology, University of Konstanz, Konstanz, Germany
| | - Martin A Imhof
- Department of Psychology, University of Konstanz, Konstanz, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz, Germany
| | - Harald T Schupp
- Department of Psychology, University of Konstanz, Konstanz, Germany
- Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz, Germany
| |
Collapse
|
8
|
Tamburro G, Fiedler P, De Fano A, Raeisi K, Khazaei M, Vaquero L, Bruña R, Oppermann H, Bertollo M, Filho E, Zappasodi F, Comani S. An ecological study protocol for the multimodal investigation of the neurophysiological underpinnings of dyadic joint action. Front Hum Neurosci 2023; 17:1305331. [PMID: 38125713 PMCID: PMC10730734 DOI: 10.3389/fnhum.2023.1305331] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Accepted: 11/15/2023] [Indexed: 12/23/2023] Open
Abstract
A novel multimodal experimental setup and dyadic study protocol were designed to investigate the neurophysiological underpinnings of joint action through the synchronous acquisition of EEG, ECG, EMG, respiration and kinematic data from two individuals engaged in ecologic and naturalistic cooperative and competitive joint actions involving face-to-face real-time and real-space coordinated full body movements. Such studies are still missing because of difficulties encountered in recording reliable neurophysiological signals during gross body movements, in synchronizing multiple devices, and in defining suitable study protocols. The multimodal experimental setup includes the synchronous recording of EEG, ECG, EMG, respiration and kinematic signals of both individuals via two EEG amplifiers and a motion capture system that are synchronized via a single-board microcomputer and custom Python scripts. EEG is recorded using new dry sports electrode caps. The novel study protocol is designed to best exploit the multimodal data acquisitions. Table tennis is the dyadic motor task: it allows naturalistic and face-to-face interpersonal interactions, free in-time and in-space full body movement coordination, cooperative and competitive joint actions, and two task difficulty levels to mimic changing external conditions. Recording conditions-including minimum table tennis rally duration, sampling rate of kinematic data, total duration of neurophysiological recordings-were defined according to the requirements of a multilevel analytical approach including a neural level (hyperbrain functional connectivity, Graph Theoretical measures and Microstate analysis), a cognitive-behavioral level (integrated analysis of neural and kinematic data), and a social level (extending Network Physiology to neurophysiological data recorded from two interacting individuals). Four practical tests for table tennis skills were defined to select the study population, permitting to skill-match the dyad members and to form two groups of higher and lower skilled dyads to explore the influence of skill level on joint action performance. Psychometric instruments are included to assess personality traits and support interpretation of results. Studying joint action with our proposed protocol can advance the understanding of the neurophysiological mechanisms sustaining daily life joint actions and could help defining systems to predict cooperative or competitive behaviors before being overtly expressed, particularly useful in real-life contexts where social behavior is a main feature.
Collapse
Affiliation(s)
- Gabriella Tamburro
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Patrique Fiedler
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Ilmenau, Germany
| | - Antonio De Fano
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Khadijeh Raeisi
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Mohammad Khazaei
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Lucia Vaquero
- Center for Cognitive and Computational Neuroscience, Universidad Complutense de Madrid, Madrid, Spain
- Department of Experimental Pschology, Cognitive Processes and Speech Therapy, Universidad Complutense de Madrid, Madrid, Spain
| | - Ricardo Bruña
- Center for Cognitive and Computational Neuroscience, Universidad Complutense de Madrid, Madrid, Spain
- Department of Radiology, Universidad Complutense de Madrid, IdISSC, Madrid, Spain
| | - Hannes Oppermann
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Ilmenau, Germany
| | - Maurizio Bertollo
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Department of Medicine and Sciences of Aging, “University G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Edson Filho
- Wheelock College of Education and Human Development, Boston University, Boston, MA, United States
| | - Filippo Zappasodi
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| | - Silvia Comani
- Department of Neuroscience Imaging and Clinical Sciences, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
- Behavioral Imaging and Neural Dynamics Center, University “G. d’Annunzio” of Chieti–Pescara, Chieti, Italy
| |
Collapse
|
9
|
Sakata C, Ueda Y, Moriguchi Y. Visual memory of a co-actor's target during joint search. PSYCHOLOGICAL RESEARCH 2023; 87:2068-2085. [PMID: 36976364 PMCID: PMC10043510 DOI: 10.1007/s00426-023-01819-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Accepted: 03/17/2023] [Indexed: 03/29/2023]
Abstract
Studies on joint action show that when two actors turn-takingly attend to each other's target that appears one at a time, a partner's target is accumulated in memory. However, in the real world, actors may not be certain that they attend to the same object because multiple objects often appear simultaneously. In this study, we asked participant pairs to search for different targets in parallel from multiple objects and investigated the memory of a partner's target. We employed the contextual cueing paradigm, in which repetitive search forms associative memory between a target and a configuration of distractors that facilitates search. During the learning phase, exemplars of three target categories (i.e., bird, shoe, and tricycle) were presented among unique objects, and participant pairs searched for them. In Experiment 1, it was followed by a memory test about target exemplars. Consequently, the partner's target was better recognized than the target that nobody searched for. In Experiments 2a and 2b, the memory test was replaced with the transfer phase, where one individual from the pair searched for the category that nobody had searched for while the other individual searched for the category the partner had searched for in the learning phase. The transfer phase did not show search facilitation underpinned by associative memory between the partner's target and distractors. These results suggest that when participant pairs search for different targets in parallel, they accumulate the partner's target in memory but may not form its associative memory with the distractors that facilitates its search.
Collapse
Affiliation(s)
- Chifumi Sakata
- Graduate School of Letters, Kyoto University, Yoshida Hon-Machi, Sakyo-Ku, Kyoto, 606-8501, Japan.
| | - Yoshiyuki Ueda
- Institute for the Future of Human Society, Kyoto University, 46 Yoshida Shimoadachi-Cho, Sakyo-Ku, Kyoto, 606-8501, Japan
| | - Yusuke Moriguchi
- Graduate School of Letters, Kyoto University, Yoshida Hon-Machi, Sakyo-Ku, Kyoto, 606-8501, Japan
| |
Collapse
|
10
|
Zadina JN. The Synergy Zone: Connecting the Mind, Brain, and Heart for the Ideal Classroom Learning Environment. Brain Sci 2023; 13:1314. [PMID: 37759915 PMCID: PMC10526388 DOI: 10.3390/brainsci13091314] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 09/08/2023] [Accepted: 09/09/2023] [Indexed: 09/29/2023] Open
Abstract
This paper proposes a new perspective on implementing neuroeducation in the classroom. The pandemic exacerbated the mental health issues of faculty and students, creating a mental health crisis that impairs learning. It is important to get our students back in "the zone", both cognitively and emotionally, by creating an ideal learning environment for capturing our students and keeping them-the Synergy Zone. Research that examines the classroom environment often focuses on the foreground-instructors' organizational and instructional aspects and content. However, the emotional climate of the classroom affects student well-being. This emotional climate would ideally exhibit the brain states of engagement, attention, connection, and enjoyment by addressing the mind, brain, and heart. This ideal learning environment would be achieved by combining proposed practices derived from three areas of research: flow theory, brain synchronization, and positive emotion with heart engagement. Each of these enhances the desired brain states in a way that the whole is greater than the sum of the individual parts. I call this the Synergy Zone. A limitation of this proposed model is that implementation of some aspects may be challenging, and professional development resources might be needed. This essay presenting this perspective provides the relevant scientific research and the educational implications of implementation.
Collapse
Affiliation(s)
- Janet N Zadina
- Brain Research and Instruction, New Orleans, LA 70002, USA
| |
Collapse
|
11
|
Schmitz L, Wahn B, Krüger M. Attention allocation in complementary joint action: How joint goals affect spatial orienting. Atten Percept Psychophys 2023:10.3758/s13414-023-02779-1. [PMID: 37684501 DOI: 10.3758/s13414-023-02779-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/23/2023] [Indexed: 09/10/2023]
Abstract
When acting jointly, individuals often attend and respond to the same object or spatial location in complementary ways (e.g., when passing a mug, one person grasps its handle with a precision grip; the other receives it with a whole-hand grip). At the same time, the spatial relation between individuals' actions affects attentional orienting: one is slower to attend and respond to locations another person previously acted upon than to alternate locations ("social inhibition of return", social IOR). Achieving joint goals (e.g., passing a mug), however, often requires complementary return responses to a co-actor's previous location. This raises the question of whether attentional orienting, and hence the social IOR, is affected by the (joint) goal our actions are directed at. The present study addresses this question. Participants responded to cued locations on a computer screen, taking turns with a virtual co-actor. They pursued either an individual goal or performed complementary actions with the co-actor, in pursuit of a joint goal. Four experiments showed that the social IOR was significantly modulated when participant and co-actor pursued a joint goal. This suggests that attentional orienting is affected not only by the spatial but also by the social relation between two agents' actions. Our findings thus extend research on interpersonal perception-action effects, showing that the way another agent's perceived action shapes our own depends on whether we share a joint goal with that agent.
Collapse
Affiliation(s)
- Laura Schmitz
- Institute of Sports Science, Leibniz University Hannover, Hannover, Germany.
- Department of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| | - Basil Wahn
- Institute of Educational Research, Ruhr University Bochum, Bochum, Germany
| | - Melanie Krüger
- Institute of Sports Science, Leibniz University Hannover, Hannover, Germany
| |
Collapse
|
12
|
Llobera J, Charbonnier C. Physics-based character animation and human motor control. Phys Life Rev 2023; 46:190-219. [PMID: 37480729 DOI: 10.1016/j.plrev.2023.06.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 06/25/2023] [Indexed: 07/24/2023]
Abstract
Motor neuroscience and physics-based character animation (PBCA) approach human and humanoid control from different perspectives. The primary goal of PBCA is to control the movement of a ragdoll (humanoid or animal) applying forces and torques within a physical simulation. The primary goal of motor neuroscience is to understand the contribution of different parts of the nervous system to generate coordinated movements. We review the functional principles and the functional anatomy of human motor control and the main strategies used in PBCA. We then explore common research points by discussing the functional anatomy and ongoing debates in motor neuroscience from the perspective of PBCA. We also suggest there are several benefits to be found in studying sensorimotor integration and human-character coordination through closer collaboration between these two fields.
Collapse
Affiliation(s)
- Joan Llobera
- Artanim Foundation, 40, chemin du Grand-Puits, 1217 Meyrin - Geneva, Switzerland.
| | - Caecilia Charbonnier
- Artanim Foundation, 40, chemin du Grand-Puits, 1217 Meyrin - Geneva, Switzerland
| |
Collapse
|
13
|
Käppler M, Mamaev I, Alagi H, Stein T, Deml B. Optimizing human-robot handovers: the impact of adaptive transport methods. Front Robot AI 2023; 10:1155143. [PMID: 37520939 PMCID: PMC10373869 DOI: 10.3389/frobt.2023.1155143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 06/27/2023] [Indexed: 08/01/2023] Open
Abstract
Humans are increasingly coming into direct physical contact with robots in the context of object handovers. The technical development of robots is progressing so that handovers can be better adapted to humans. An important criterion for successful handovers between robots and humans is the predictability of the robot for the human. The better humans can anticipate the robot's actions, the better they can adapt to them and thus achieve smoother handovers. In the context of this work, it was investigated whether a highly adaptive transport method of the object, adapted to the human hand, leads to better handovers than a non-adaptive transport method with a predefined target position. To ensure robust handovers at high repetition rates, a Franka Panda robotic arm with a gripper equipped with an Intel RealSense camera and capacitive proximity sensors in the gripper was used. To investigate the handover behavior, a study was conducted with n = 40 subjects, each performing 40 handovers in four consecutive runs. The dependent variables examined are physical handover time, early handover intervention before the robot reaches its target position, and subjects' subjective ratings. The adaptive transport method does not result in significantly higher mean physical handover times than the non-adaptive transport method. The non-adaptive transport method does not lead to a significantly earlier handover intervention in the course of the runs than the adaptive transport method. Trust in the robot and the perception of safety are rated significantly lower for the adaptive transport method than for the non-adaptive transport method. The physical handover time decreases significantly for both transport methods within the first two runs. For both transport methods, the percentage of handovers with a physical handover time between 0.1 and 0.2 s increases sharply, while the percentage of handovers with a physical handover time of >0.5 s decreases sharply. The results can be explained by theories of motor learning. From the experience of this study, an increased understanding of motor learning and adaptation in the context of human-robot interaction can be of great benefit for further technical development in robotics and for the industrial use of robots.
Collapse
Affiliation(s)
- Marco Käppler
- Institute of Human and Industrial Engineering (ifab), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
| | - Ilshat Mamaev
- Intelligent Process Automation and Robotics Lab (IAR–IPR), Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
| | - Hosam Alagi
- Intelligent Process Automation and Robotics Lab (IAR–IPR), Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
| | - Thorsten Stein
- BioMotion Center, Institute of Sports and Sports Science (IfSS), Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Barbara Deml
- Institute of Human and Industrial Engineering (ifab), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
| |
Collapse
|
14
|
Dimov CM, Anderson JR, Betts SA, Bothell D. An Integrated Model of Collaborative Skill Acquisition: Anticipation, Control Tuning, and Role Adoption. Cogn Sci 2023; 47:e13303. [PMID: 37483081 DOI: 10.1111/cogs.13303] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 04/28/2023] [Accepted: 05/23/2023] [Indexed: 07/25/2023]
Abstract
We studied collaborative skill acquisition in a dynamic setting with the game Co-op Space Fortress. While gaining expertise, the majority of subjects became increasingly consistent in the role they adopted without being able to communicate. Moreover, they acted in anticipation of the future task state. We constructed a collaborative skill acquisition model in the cognitive architecture ACT-R that reproduced subject skill acquisition trajectory. It modeled role adoption through reinforcement learning and predictive processes through motion extrapolation and learned relevant control parameters using both a reinforcement learning procedure and a new to ACT-R supervised learning procedure. This is the first integrated cognitive model of collaborative skill acquisition and, as such, gives us valuable insights into the multiple cognitive processes that are involved in learning to collaborate.
Collapse
Affiliation(s)
- Cvetomir M Dimov
- Department of Psychology, Carnegie Mellon University
- Department of Psychology, University of Geneva
| | | | - Shawn A Betts
- Department of Psychology, Carnegie Mellon University
| | - Dan Bothell
- Department of Psychology, Carnegie Mellon University
| |
Collapse
|
15
|
Hüttner N, Müller F, Cañal-Bruland R. Motor performance in joint action tasks: The impact of dyadic motive fit. Hum Mov Sci 2023; 90:103100. [PMID: 37263040 DOI: 10.1016/j.humov.2023.103100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Revised: 05/09/2023] [Accepted: 05/18/2023] [Indexed: 06/03/2023]
Abstract
In many daily situations, two or more individuals need to coordinate their actions to achieve a common goal and perform successfully. Past research on joint action has predominantly focused on the question of how such interactions are accomplished. Here we focus on the impact of inter-individual, trait-like differences to predict joint action performance. More specifically, we examined whether performance in a joint action task is moderated by the (in)congruence of individuals' motive dispositions. To this end, 27 dyads performed a joint action task in which they had to navigate a ball through a maze with each partner using a joystick and each being responsible for either moving the ball along the x-axis or the y-axis. As dependent measures, we analyzed dyads' performance (times and errors). As trait-like predictors, we assessed implicit and explicit motives by means of the Picture Story Exercise and the Unified Motive Scale, respectively. Linear regression modeling revealed that congruent explicit affiliation motives predict faster best times and that higher congruent implicit achievement motives are associated with reduced errors. Exploratory Response Surface Analyses yielded identical results for the affiliation motive. These findings provide initial evidence to suggest that interindividual differences and in motives as well as their fit are related to joint action performance. Future directions of this new paradigm and novel ways to analyze dyadic motive fits and their relation to joint action performance are discussed.
Collapse
Affiliation(s)
- Norman Hüttner
- Department for the Psychology of Human Movement and Sport, Institute of Sport Science, Friedrich Schiller University Jena, Germany.
| | - Florian Müller
- Department for the Psychology of Human Movement and Sport, Institute of Sport Science, Friedrich Schiller University Jena, Germany
| | - Rouwen Cañal-Bruland
- Department for the Psychology of Human Movement and Sport, Institute of Sport Science, Friedrich Schiller University Jena, Germany
| |
Collapse
|
16
|
Zhou Z, Christensen J, Cummings JA, Loehr JD. Not just in sync: Relations between partners' actions influence the sense of joint agency during joint action. Conscious Cogn 2023; 111:103521. [PMID: 37084534 DOI: 10.1016/j.concog.2023.103521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 03/06/2023] [Accepted: 04/07/2023] [Indexed: 04/23/2023]
Abstract
When people perform joint actions together, they often experience a sense of joint agency ("we did that together"). The current study investigated whether relations between partners' actions within joint actions that require precise interpersonal synchrony influence joint agency, above and beyond the degree of synchrony partners achieve. We employed a mixed-methods approach that combined a quantitative experiment with a qualitative analysis of post-experiment interviews. Partners produced synchronized tone sequences that comprised either constant pitch sequences (simple temporal alignment between partners' actions) or musical duets (complex metrical and harmonic relations between partners' actions). Participants reported stronger joint agency for duets than constant pitches, when comparing trials with equally good synchronization. Post-experiment interviews revealed that joint agency was also influenced by participants' knowledge of the music and their perceptions of task performance, difficulty, and enjoyability. These findings further our understanding of joint agency for joint actions that require precise interpersonal synchrony.
Collapse
Affiliation(s)
- Zijun Zhou
- Department of Psychology and Health Studies, University of Saskatchewan, 9 Campus Drive, Saskatoon, Saskatchewan S7N 5A5, Canada.
| | - Justin Christensen
- Department of Psychology and Health Studies, University of Saskatchewan, 9 Campus Drive, Saskatoon, Saskatchewan S7N 5A5, Canada.
| | - Jorden A Cummings
- Department of Psychology and Health Studies, University of Saskatchewan, 9 Campus Drive, Saskatoon, Saskatchewan S7N 5A5, Canada.
| | - Janeen D Loehr
- Department of Psychology and Health Studies, University of Saskatchewan, 9 Campus Drive, Saskatoon, Saskatchewan S7N 5A5, Canada.
| |
Collapse
|
17
|
Kuhlen AK, Abdel Rahman R. Beyond speaking: neurocognitive perspectives on language production in social interaction. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210483. [PMID: 36871592 PMCID: PMC9985974 DOI: 10.1098/rstb.2021.0483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Accepted: 12/16/2022] [Indexed: 03/07/2023] Open
Abstract
The human faculty to speak has evolved, so has been argued, for communicating with others and for engaging in social interactions. Hence the human cognitive system should be equipped to address the demands that social interaction places on the language production system. These demands include the need to coordinate speaking with listening, the need to integrate own (verbal) actions with the interlocutor's actions, and the need to adapt language flexibly to the interlocutor and the social context. In order to meet these demands, core processes of language production are supported by cognitive processes that enable interpersonal coordination and social cognition. To fully understand the cognitive architecture and its neural implementation enabling humans to speak in social interaction, our understanding of how humans produce language needs to be connected to our understanding of how humans gain insights into other people's mental states and coordinate in social interaction. This article reviews theories and neurocognitive experiments that make this connection and can contribute to advancing our understanding of speaking in social interaction. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.
Collapse
Affiliation(s)
- Anna K. Kuhlen
- Department of Psychology, Humboldt-Universität zu Berlin, 12489 Berlin, Germany
| | - Rasha Abdel Rahman
- Department of Psychology, Humboldt-Universität zu Berlin, 12489 Berlin, Germany
| |
Collapse
|
18
|
Emergent and planned interpersonal synchronization are both sensitive to 'tempo aftereffect contagion'. Neuropsychologia 2023; 181:108492. [PMID: 36736856 DOI: 10.1016/j.neuropsychologia.2023.108492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Revised: 12/17/2022] [Accepted: 01/22/2023] [Indexed: 02/04/2023]
Abstract
Interpersonal synchronization is fundamental for motor coordination during social interactions. Discerning emergent (entrainment) from planned synchronization represents a non-trivial issue in visually bonded individuals acting together, as well as assessing whether inter-individual differences, e.g., in autistic traits, modulate both types of synchronization. In a visuomotor finger-tapping task, two participants replicated a target tempo either synchronizing ('joint' condition) or not ('non-interactive' condition, 'non-int') with each other. One participant was exposed ('induced') to tempo aftereffect (a medium tempo seems faster or slower after exposure to slower or faster inducing tempi), but not the other participant ('not induced'); thus they had different timing perceptions of the same target. We assessed to what degree emergent and/or planned synchronization affected dyads by analyzing inter-tap-intervals, synchronization indexes, and cross-correlation coefficients. Results revealed a 'tempo aftereffect contagion': inter-tap-intervals of both induced and not-induced participants showed aftereffect in both the joint and non-int conditions. Moreover, aftereffects did not correlate across conditions suggesting they might be due to (at least in part) different processes, but the propensity for tempo aftereffect contagion correlated with individuals' autistic traits only in the non-int condition. Finally, participants co-adjusted their tapping more in the joint condition than in the non-int one, as confirmed by higher synchronization indexes and the mutual adaptation pattern of cross-correlation coefficients. Altogether, these results show the subtle interplay between emergent and planned interpersonal synchronization mechanisms that act on a millisecond timescale independently from synching or not with the partner.
Collapse
|
19
|
Kohler N, Novembre G, Gugnowska K, Keller PE, Villringer A, Sammler D. Cortico-cerebellar audio-motor regions coordinate self and other in musical joint action. Cereb Cortex 2023; 33:2804-2822. [PMID: 35771593 PMCID: PMC10016054 DOI: 10.1093/cercor/bhac243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 05/19/2022] [Accepted: 05/20/2022] [Indexed: 11/14/2022] Open
Abstract
Joint music performance requires flexible sensorimotor coordination between self and other. Cognitive and sensory parameters of joint action-such as shared knowledge or temporal (a)synchrony-influence this coordination by shifting the balance between self-other segregation and integration. To investigate the neural bases of these parameters and their interaction during joint action, we asked pianists to play on an MR-compatible piano, in duet with a partner outside of the scanner room. Motor knowledge of the partner's musical part and the temporal compatibility of the partner's action feedback were manipulated. First, we found stronger activity and functional connectivity within cortico-cerebellar audio-motor networks when pianists had practiced their partner's part before. This indicates that they simulated and anticipated the auditory feedback of the partner by virtue of an internal model. Second, we observed stronger cerebellar activity and reduced behavioral adaptation when pianists encountered subtle asynchronies between these model-based anticipations and the perceived sensory outcome of (familiar) partner actions, indicating a shift towards self-other segregation. These combined findings demonstrate that cortico-cerebellar audio-motor networks link motor knowledge and other-produced sounds depending on cognitive and sensory factors of the joint performance, and play a crucial role in balancing self-other integration and segregation.
Collapse
Affiliation(s)
- Natalie Kohler
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103, Leipzig, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt am Main, Germany
| | - Giacomo Novembre
- Neuroscience of Perception and Action Laboratory, Italian Institute of Technology, Viale Regina Elena 291, 00161 Rome, Italy
| | - Katarzyna Gugnowska
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103, Leipzig, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt am Main, Germany
| | - Peter E Keller
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University, Universitetsbyen 3, 8000 Aarhus C, Denmark
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Locked Bag 1797, Penrith NSW 2751, Australia
| | - Arno Villringer
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103, Leipzig, Germany
| | - Daniela Sammler
- Corresponding author: Daniela Sammler, MPI for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt/M., Germany.
| |
Collapse
|
20
|
Olsen K, Tylén K. On the social nature of abstraction: cognitive implications of interaction and diversity. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210361. [PMID: 36571125 PMCID: PMC9791485 DOI: 10.1098/rstb.2021.0361] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 05/28/2022] [Indexed: 12/27/2022] Open
Abstract
The human capacity for abstraction is remarkable. We effortlessly form abstract representations from varied experiences, generalizing and flexibly transferring experiences and knowledge between contexts, which can facilitate reasoning, problem solving and learning across many domains. The cognitive process of abstraction, however, is often portrayed and investigated as an individual process. This paper addresses how cognitive processes of abstraction-together with other aspects of human reasoning and problem solving-are fundamentally shaped and modulated by online social interaction. Starting from a general distinction between convergent thinking, divergent thinking and processes of abstraction, we address how social interaction shapes information processing differently depending on cognitive demands, social coordination and task ecologies. In particular, we suggest that processes of abstraction are facilitated by the interactive sharing and integration of varied individual experiences. To this end, we also discuss how the dynamics of group interactions vary as a function of group composition; that is, in terms of the similarity and diversity between the group members. We conclude by outlining the role of cognitive diversity in interactive processes and consider the importance of group diversity in processes of abstraction. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.
Collapse
Affiliation(s)
- Karsten Olsen
- The Interacting Minds Centre, Aarhus University, 8000 Aarhus, Denmark
- Department for Linguistics, Cognitive Science, and Semiotics, Aarhus University, 8000 Aarhus, Denmark
| | - Kristian Tylén
- The Interacting Minds Centre, Aarhus University, 8000 Aarhus, Denmark
- Department for Linguistics, Cognitive Science, and Semiotics, Aarhus University, 8000 Aarhus, Denmark
| |
Collapse
|
21
|
Hudson D, Wiltshire TJ, Atzmueller M. multiSyncPy: A Python package for assessing multivariate coordination dynamics. Behav Res Methods 2023; 55:932-962. [PMID: 35513768 PMCID: PMC10027834 DOI: 10.3758/s13428-022-01855-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
In order to support the burgeoning field of research into intra- and interpersonal synchrony, we present an open-source software package: multiSyncPy. Multivariate synchrony goes beyond the bivariate case and can be useful for quantifying how groups, teams, and families coordinate their behaviors, or estimating the degree to which multiple modalities from an individual become synchronized. Our package includes state-of-the-art multivariate methods including symbolic entropy, multidimensional recurrence quantification analysis, coherence (with an additional sum-normalized modification), the cluster-phase 'Rho' metric, and a statistical test based on the Kuramoto order parameter. We also include functions for two surrogation techniques to compare the observed coordination dynamics with chance levels and a windowing function to examine time-varying coordination for most of the measures. Taken together, our collation and presentation of these methods make the study of interpersonal synchronization and coordination dynamics applicable to larger, more complex and often more ecologically valid study designs. In this work, we summarize the relevant theoretical background and present illustrative practical examples, lessons learned, as well as guidance for the usage of our package - using synthetic as well as empirical data. Furthermore, we provide a discussion of our work and software and outline interesting further directions and perspectives. multiSyncPy is freely available under the LGPL license at: https://github.com/cslab-hub/multiSyncPy , and also available at the Python package index.
Collapse
Affiliation(s)
- Dan Hudson
- Semantic Information Systems Group, Institute of Computer Science, Osnabrück University, P.O. Box 4469, 49069, Osnabrueck, Germany.
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, The Netherlands.
| | - Travis J Wiltshire
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, The Netherlands
| | - Martin Atzmueller
- Semantic Information Systems Group, Institute of Computer Science, Osnabrück University, P.O. Box 4469, 49069, Osnabrueck, Germany
| |
Collapse
|
22
|
Christensen J, Slavik L, Nicol JJ, Loehr JD. Alpha oscillations related to self-other integration and distinction during live orchestral performance: A naturalistic case study. PSYCHOLOGY OF MUSIC 2023; 51:295-315. [PMID: 36532616 PMCID: PMC9751440 DOI: 10.1177/03057356221091313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Ensemble music performance requires musicians to achieve precise interpersonal coordination while maintaining autonomous control over their own actions. To do so, musicians dynamically shift between integrating other performers' actions into their own action plans and maintaining a distinction between their own and others' actions. Research in laboratory settings has shown that this dynamic process of self-other integration and distinction is indexed by sensorimotor alpha oscillations. The purpose of the current descriptive case study was to examine oscillations related to self-other integration and distinction in a naturalistic performance context. We measured alpha activity from four violinists during a concert hall performance of a 60-musician orchestra. We selected a musical piece from the orchestra's repertoire and, before analyzing alpha activity, performed a score analysis to divide the piece into sections that were expected to strongly promote self-other integration and distinction. In line with previous laboratory findings, performers showed suppressed and enhanced alpha activity during musical sections that promoted self-other integration and distinction, respectively. The current study thus provides preliminary evidence that findings from carefully controlled laboratory experiments generalize to complex real-world performance. Its findings also suggest directions for future research and potential applications of interest to musicians, music educators, and music therapists.
Collapse
Affiliation(s)
| | - Lauren Slavik
- Department of Psychology, University of Saskatchewan, Saskatoon, Canada
| | - Jennifer J Nicol
- Department of Educational Psychology and Special Education, University of Saskatchewan, Saskatoon, Canada
| | - Janeen D Loehr
- Department of Psychology, University of Saskatchewan, Saskatoon, Canada
| |
Collapse
|
23
|
Playing the mirror game in virtual reality with an autonomous character. Sci Rep 2022; 12:21329. [PMID: 36494394 PMCID: PMC9734752 DOI: 10.1038/s41598-022-25197-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Accepted: 11/25/2022] [Indexed: 12/13/2022] Open
Abstract
Perceptual-motor synchronisation in human groups is crucial in many activities, from musical ensembles to sports teams. To this aim, the mirror game, where partners are asked to imitate each other's movements or gestures, is one of the best available experimental paradigms to study how humans engage in joint tasks and how they tend to synchronise their behaviour. However, to date, virtual reality characters do not engage in motor synchronisation with human users. In this work, we explored to what extent an autonomous virtual character and a human that play the mirror game in virtual reality can synchronise their behaviour. We created a full-body version of the mirror game with an autonomous virtual character, whose movements were driven by a model based on coupled oscillators. Participants engaged in a joint imitation task with a virtual player animated with one of three options: a model that included a small coupling, a model with no coupling, or another human. Behavioural measures and subjective reports suggest that participants were unable to distinguish the condition of small coupling from the engagement with an avatar driven by another human participant.
Collapse
|
24
|
Miss F, Adriaense J, Burkart J. Towards integrating joint action research: Developmental and evolutionary perspectives on co-representation. Neurosci Biobehav Rev 2022; 143:104924. [DOI: 10.1016/j.neubiorev.2022.104924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 10/11/2022] [Accepted: 10/20/2022] [Indexed: 11/23/2022]
|
25
|
Ichikawa J, Fujii K. Analysis of group behavior based on sharing heterogeneous roles in a triad using a coordinated drawing task. Front Psychol 2022; 13:890205. [DOI: 10.3389/fpsyg.2022.890205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2022] [Accepted: 09/27/2022] [Indexed: 11/17/2022] Open
Abstract
Humans often share roles and aim to achieve a group goal based on sociality, which is the tendency to spontaneously involve oneself with others. Cognitive science, psychology, and neuroscience studies suggest that in such planned coordination, adjusting one’s own actions based on other roles is crucial for high task performance. However, the mechanisms of complex and dynamically planned coordination, such as non-verbal group behavior with three or more members, remain to be fully investigated. This study introduced a coordinated drawing task in a triad, quantitatively analyzed non-verbal group behavior based on sharing heterogeneous roles, and investigated an important role. Participant triads engaged in the task repeatedly by operating reels to change thread tensions and moving a pen connected to the three threads to draw an equilateral triangle. Then, the three roles (pulling, relaxing, and adjusting) had to be shared. The pulling and relaxing roles served to move the pen as if an operator pulled it closer to the hand and to support the pen’s movement, respectively. However, these roles alone could not draw a side considering the task specification. The adjusting role needed to change the tension flexibly and maintain an overall balance. In the experiment, we measured the pen positions and tensions, and established statistical models to fit the analyzed data. The results estimated that the action in the adjusting role was related to the improved performance of faster drawing on a side. This role may moderately intervene in the actions by the other roles and fine-tune without disturbing the pen’s smooth movement while avoiding great pen deviation. Our findings may suggest the crucial role as a facilitator that handles resiliently in non-verbal coordinated behavior of a triad, and contribute to our understanding of social interactions.
Collapse
|
26
|
Klein L, Wood EA, Bosnyak D, Trainor LJ. Follow the sound of my violin: Granger causality reflects information flow in sound. Front Hum Neurosci 2022; 16:982177. [DOI: 10.3389/fnhum.2022.982177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 10/10/2022] [Indexed: 11/06/2022] Open
Abstract
Recent research into how musicians coordinate their expressive timing, phrasing, articulation, dynamics, and other stylistic characteristics during performances has highlighted the role of predictive processes, as musicians must anticipate how their partners will play in order to be together. Several studies have used information flow techniques such as Granger causality to show that upcoming movements of a musician can be predicted from immediate past movements of fellow musicians. Although musicians must move to play their instruments, a major goal of music making is to create a joint interpretation through the sounds they produce. Yet, information flow techniques have not been applied previously to examine the role that fellow musicians' sound output plays in these predictive processes and whether this changes as they learn to play together. In the present experiment, we asked professional violinists to play along with recordings of two folk pieces, each eight times in succession, and compared the amplitude envelopes of their performances with those of the recordings using Granger causality to measure information flow and cross-correlation to measure similarity and synchronization. In line with our hypotheses, our measure of information flow was higher from the recordings to the performances than vice versa, and decreased as the violinists became more familiar with the recordings over trials. This decline in information flow is consistent with a gradual shift from relying on auditory cues to predict the recording to relying on an internally-based (learned) model built through repetition. There was also evidence that violinists became more synchronized with the recordings over trials. These results shed light on the planning and learning processes involved in the aligning of expressive intentions in group music performance and lay the groundwork for the application of Granger causality to investigate information flow through sound in more complex musical interactions.
Collapse
|
27
|
Crombé K, Denys M, Maes PJ. The Role of a Mechanical Coupling in (Spontaneous) Interpersonal Synchronization: a Human Version of Huygens’ Clock Experiments. TIMING & TIME PERCEPTION 2022. [DOI: 10.1163/22134468-bja10054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Abstract
Interpersonal musical interaction typically relies on the mutual exchange of auditory and visual information. Inspired by the finding of Christiaan Huygens that two pendulum clocks spontaneously synchronize when hanging from a common, movable wooden beam, we explored the possible use of mechanical coupling as an alternative coupling modality between people to strengthen (spontaneous and instructed) joint (musical) synchronization. From a coupled oscillator viewpoint, we hypothesized that dyads standing on a common movable platform would cause bidirectional passive body motion (and corresponding proprioceptive, vestibular and somatosensory sensations), leading to enhanced interpersonal coordination and mutual entrainment. To test this hypothesis, we asked dyads to perform a musical synchronization–continuation task, while standing on a movable platform. Their rhythmic movements were compared under different conditions: mechanically coupled/decoupled platforms, and spontaneous/instructed synchronization. Additionally, we investigated the effects of performing an additional collaborative conversation task, and of initial tempo and phase differences in the instructed rhythms. The analysis was based on cross wavelet and synchrosqueezed transforms. The overall conclusion was that a mechanical coupling was effective in support of interpersonal synchronization, specifically when dyads were explicitly instructed to synchronize using the movable platform (instructed synchronization). On the other hand, results showed that mechanical coupling led only minimally to spontaneous interpersonal synchronization. The collaborative task and the initial phase and tempo have no strong effect. Although more research is required, possible applications can be found in the domains of music education, dance and music performance, sports, and well-being.
Collapse
Affiliation(s)
- Kristel Crombé
- Department of Art, Music and Theatre Sciences, Faculty of Arts and Philosophy, Ghent University, 9000 Gent, Belgium
| | - Marlies Denys
- Department of Art, Music and Theatre Sciences, Faculty of Arts and Philosophy, Ghent University, 9000 Gent, Belgium
| | - Pieter-Jan Maes
- Department of Art, Music and Theatre Sciences, Faculty of Arts and Philosophy, Ghent University, 9000 Gent, Belgium
| |
Collapse
|
28
|
Farrera A, Ramos-Fernández G. Collective Rhythm as an Emergent Property During Human Social Coordination. Front Psychol 2022; 12:772262. [PMID: 35222144 PMCID: PMC8868940 DOI: 10.3389/fpsyg.2021.772262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 11/30/2021] [Indexed: 11/23/2022] Open
Abstract
The literature on social interactions has shown that participants coordinate not only at the behavioral but also at the physiological and neural levels, and that this coordination gives a temporal structure to the individual and social dynamics. However, it has not been fully explored whether such temporal patterns emerge during interpersonal coordination beyond dyads, whether this phenomenon arises from complex cognitive mechanisms or from relatively simple rules of behavior, or which are the sociocultural processes that underlie this phenomenon. We review the evidence for the existence of group-level rhythmic patterns that result from social interactions and argue that the complexity of group dynamics can lead to temporal regularities that cannot be predicted from the individual periodicities: an emergent collective rhythm. Moreover, we use this interpretation of the literature to discuss how taking into account the sociocultural niche in which individuals develop can help explain the seemingly divergent results that have been reported on the social influences and consequences of interpersonal coordination. We make recommendations on further research to test these arguments and their relationship to the feeling of belonging and assimilation experienced during group dynamics.
Collapse
Affiliation(s)
- Arodi Farrera
- Mathematical Modeling of Social Systems Department, Institute for Research on Applied Mathematics and Systems, National Autonomous University of Mexico, Mexico City, Mexico
| | - Gabriel Ramos-Fernández
- Mathematical Modeling of Social Systems Department, Institute for Research on Applied Mathematics and Systems, National Autonomous University of Mexico, Mexico City, Mexico
| |
Collapse
|
29
|
Abstract
When people perform joint actions together, their individual actions (e.g., moving one end of a heavy couch) must be coordinated to achieve a collective goal (e.g., moving the couch across the room). Joint actions pose unique challenges for understanding people's sense of agency, because each person engaged in the joint action can have a sense of agency not only at the individual level (a sense that "I moved my end of the couch" or "My partner moved their end of the couch"), but also at the collective level (a sense that "We moved the couch together"). This review surveys research that has examined people's sense of agency in joint action, including explicit judgments of agency, implicit measures of agency, and first-hand accounts of agency in real-world settings. The review provides a comprehensive summary of the factors that influence individual- and collective-level agency in joint action; reveals the progress that has been made toward understanding different forms of collective-level agency in joint action, including the sense that agency is shared among co-actors and the sense that co-actors are acting as a single unit; and synthesizes evidence concerning the relationships between different measures of implicit agency and individual- versus collective-level agency in joint action. The review concludes by highlighting numerous outstanding questions and promising avenues for future research.
Collapse
|
30
|
Gambi C, Van de Cavey J, Pickering MJ. EXPRESS: Representation of others' synchronous and asynchronous sentences interferes with sentence production. Q J Exp Psychol (Hove) 2022; 76:180-195. [PMID: 35102784 DOI: 10.1177/17470218221080766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In dialogue, people represent each other's utterances in order to take turns and communicate successfully. In previous work [Gambi, C., Van de Cavey, J., & Pickering, M. J. (2015). Interference in joint picture naming. Journal of Experimental Psychology: Learning, Memory, and Cognition, 41(1), 1-21.], speakers who were naming single pictures or picture pairs represented whether another speaker was engaged in the same task (versus a different or no task) concurrently, but did not represent in detail the content of the other speaker's utterance. Here, we investigate co-representation of whole sentences. In three experiments, pairs of speakers imagined each other producing active or passive descriptions of transitive events. Speakers took longer to begin speaking when they believed their partner was also preparing to speak, compared to when they did not. Interference occurred when speakers believed their partners were preparing to speak at the same time as them (synchronous production and co-representation; Experiment 1), and also when speakers believed that their partner would speak only after them (asynchronous production and co-representation; Experiments 2a and 2b). However, interference was generally no greater when speakers believed their partner was preparing a different compared to a similar utterance, providing no consistent evidence that speakers represented what their partners were preparing to say. Taken together, these findings indicate that speakers can represent another's intention to speak even as they are themselves preparing to speak, but that such representation tends to lack detail.
Collapse
Affiliation(s)
- Chiara Gambi
- University of Edinburgh and Cardiff University 2112
| | | | | |
Collapse
|
31
|
Kathleen B, Víctor FC, Amandine M, Aurélie C, Elisabeth P, Michèle G, Rachid A, Hélène C. Addressing joint action challenges in HRI: Insights from psychology and philosophy. Acta Psychol (Amst) 2022; 222:103476. [PMID: 34974283 DOI: 10.1016/j.actpsy.2021.103476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Revised: 11/19/2021] [Accepted: 12/15/2021] [Indexed: 11/24/2022] Open
Abstract
The vast expansion of research in human-robot interactions (HRI) these last decades has been accompanied by the design of increasingly skilled robots for engaging in joint actions with humans. However, these advances have encountered significant challenges to ensure fluent interactions and sustain human motivation through the different steps of joint action. After exploring current literature on joint action in HRI, leading to a more precise definition of these challenges, the present article proposes some perspectives borrowed from psychology and philosophy showing the key role of communication in human interactions. From mutual recognition between individuals to the expression of commitment and social expectations, we argue that communicative cues can facilitate coordination, prediction, and motivation in the context of joint action. The description of several notions thus suggests that some communicative capacities can be implemented in the context of joint action for HRI, leading to an integrated perspective of robotic communication.
Collapse
Affiliation(s)
- Belhassein Kathleen
- CLLE, UMR5263, Toulouse University, CNRS, UT2J, France; LAAS-CNRS, UPR8001, Toulouse University, CNRS, France
| | | | | | | | | | | | - Alami Rachid
- LAAS-CNRS, UPR8001, Toulouse University, CNRS, France
| | - Cochet Hélène
- CLLE, UMR5263, Toulouse University, CNRS, UT2J, France
| |
Collapse
|
32
|
Saul MA, He X, Black S, Charles F. A Two-Person Neuroscience Approach for Social Anxiety: A Paradigm With Interbrain Synchrony and Neurofeedback. Front Psychol 2022; 12:568921. [PMID: 35095625 PMCID: PMC8796854 DOI: 10.3389/fpsyg.2021.568921] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Accepted: 12/06/2021] [Indexed: 12/11/2022] Open
Abstract
Social anxiety disorder has been widely recognised as one of the most commonly diagnosed mental disorders. Individuals with social anxiety disorder experience difficulties during social interactions that are essential in the regular functioning of daily routines; perpetually motivating research into the aetiology, maintenance and treatment methods. Traditionally, social and clinical neuroscience studies incorporated protocols testing one participant at a time. However, it has been recently suggested that such protocols are unable to directly assess social interaction performance, which can be revealed by testing multiple individuals simultaneously. The principle of two-person neuroscience highlights the interpersonal aspect of social interactions that observes behaviour and brain activity from both (or all) constituents of the interaction, rather than analysing on an individual level or an individual observation of a social situation. Therefore, two-person neuroscience could be a promising direction for assessment and intervention of the social anxiety disorder. In this paper, we propose a novel paradigm which integrates two-person neuroscience in a neurofeedback protocol. Neurofeedback and interbrain synchrony, a branch of two-person neuroscience, are discussed in their own capacities for their relationship with social anxiety disorder and relevance to the paradigm. The newly proposed paradigm sets out to assess the social interaction performance using interbrain synchrony between interacting individuals, and to employ a multi-user neurofeedback protocol for intervention of the social anxiety.
Collapse
Affiliation(s)
- Marcia A. Saul
- Faculty of Media and Communication, Centre for Digital Entertainment, Bournemouth University, Poole, United Kingdom
| | - Xun He
- Department of Psychology, Faculty of Science and Technology, Bournemouth University, Poole, United Kingdom
- *Correspondence: Xun He
| | - Stuart Black
- Applied Neuroscience Solutions Ltd., Frimley Green, United Kingdom
| | - Fred Charles
- Department of Creative Technology, Faculty of Science and Technology, Bournemouth University, Poole, United Kingdom
- Fred Charles
| |
Collapse
|
33
|
Zapparoli L, Paulesu E, Mariano M, Ravani A, Sacheli LM. The sense of agency in joint actions: a theory-driven meta-analysis. Cortex 2022; 148:99-120. [DOI: 10.1016/j.cortex.2022.01.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 11/15/2021] [Accepted: 01/05/2022] [Indexed: 01/09/2023]
|
34
|
Shimoda S, Jamone L, Ognibene D, Nagai T, Sciutti A, Costa-Garcia A, Oseki Y, Taniguchi T. What is the role of the next generation of cognitive robotics? Adv Robot 2021. [DOI: 10.1080/01691864.2021.2011780] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Shingo Shimoda
- RIKEN Center for Brain Science TOYOTA Collaboration Center, Nagoya, Japan
| | - Lorenzo Jamone
- School of Electronic Engineering and Computer Science, Queen Mary University of London, London, UK
| | - Dimitri Ognibene
- Computer Science and Artificial Intelligence, University of Milano Biccoca, Milano, Italy
| | - Takayuki Nagai
- Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Alessandra Sciutti
- Cognitive Architecture for Collaborative Technologies Unit, Italian Institute of Technology, Genova, Italy
| | | | - Yohei Oseki
- Department of Language and Information Sciences, University of Tokyo, Tokyo, Japan
| | - Tadahiro Taniguchi
- Department of Human and Computer Intelligence, Ritsumeikan University, Shiga, Japan
| |
Collapse
|
35
|
Thonhauser G, Weichold M. Approaching Collectivity Collectively: A Multi-Disciplinary Account of Collective Action. Front Psychol 2021; 12:740664. [PMID: 34925144 PMCID: PMC8674559 DOI: 10.3389/fpsyg.2021.740664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Accepted: 10/28/2021] [Indexed: 11/13/2022] Open
Abstract
There has been considerable progress in investigating collective actions in the last decades. However, the real progress is different from what many scholars take it to be. It lies in the fact that there is by now a wealth of different approaches from a variety of fields. Each approach has carved out fruitful mechanisms for explaining collective action, but is also faced with limitations. Given that situation, we submit that the next step in investigating collective action is to acknowledge the plurality of approaches and bring them into dialogue. With this aim in mind, the present article discusses the strengths and weaknesses of some of the to our mind most relevant approaches to collective action in current debates. We begin with the collective intentionality framework, the team reasoning approach, and social identity theory. Then, we move to ecological social psychology, participatory sense-making, and, through the lenses of those frameworks, dynamical systems theory. Finally, we discuss practice theory. Against this background, we provide a proposal for a synthesis of the successful explanatory mechanisms as they have been carved out by the different research programs. The suggestion is, roughly, to understand collective action as dynamical interaction of a self-organizing system with its environment, shaped by a process of collective sense-making.
Collapse
Affiliation(s)
- Gerhard Thonhauser
- Department of Philosophy, Technical University of Darmstadt, Darmstadt, Germany
| | - Martin Weichold
- Institute of Philosophy, University of Regensburg, Regensburg, Germany
| |
Collapse
|
36
|
Ortenzi V, Cosgun A, Pardi T, Chan WP, Croft E, Kulic D. Object Handovers: A Review for Robotics. IEEE T ROBOT 2021. [DOI: 10.1109/tro.2021.3075365] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
37
|
Resonating Minds—Emergent Collaboration Through Hierarchical Active Inference. Cognit Comput 2021. [DOI: 10.1007/s12559-021-09960-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
AbstractWorking together on complex collaborative tasks requires agents to coordinate their actions. Doing this explicitly or completely prior to the actual interaction is not always possible nor sufficient. Agents also need to continuously understand the current actions of others and quickly adapt their own behavior appropriately. Here we investigate how efficient, automatic coordination processes at the level of mental states (intentions, goals), which we call belief resonance, can lead to collaborative situated problem-solving. We present a model of hierarchical active inference for collaborative agents (HAICA). It combines efficient Bayesian Theory of Mind processes with a perception–action system based on predictive processing and active inference. Belief resonance is realized by letting the inferred mental states of one agent influence another agent’s predictive beliefs about its own goals and intentions. This way, the inferred mental states influence the agent’s own task behavior without explicit collaborative reasoning. We implement and evaluate this model in the Overcooked domain, in which two agents with varying degrees of belief resonance team up to fulfill meal orders. Our results demonstrate that agents based on HAICA achieve a team performance comparable to recent state-of-the-art approaches, while incurring much lower computational costs. We also show that belief resonance is especially beneficial in settings where the agents have asymmetric knowledge about the environment. The results indicate that belief resonance and active inference allow for quick and efficient agent coordination and thus can serve as a building block for collaborative cognitive agents.
Collapse
|
38
|
Scheidt CE, Pfänder S, Ballati A, Schmidt S, Lahmann C. Language and Movement Synchronization in Dyadic Psychotherapeutic Interaction - A Qualitative Review and a Proposal for a Classification. Front Psychol 2021; 12:696448. [PMID: 34744862 PMCID: PMC8569105 DOI: 10.3389/fpsyg.2021.696448] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Accepted: 08/31/2021] [Indexed: 11/30/2022] Open
Abstract
In individual psychotherapy verbal communication and movement synchronization are closely interrelated. The microanalysis of timing, rhythm and gestalt of movement has established dynamic movement coordination as a systemic property of the dyadic interaction. Movement synchronization supports and enhances the unfolding of linguistic meaning. In order to substantiate the importance of the concept of synchrony for adult psychotherapy we review evidence from developmental psychology and discuss approaches to measure synchrony with particular reference to the naturalistic setting of dyadic psychotherapy. As the concept of synchrony is still ambiguous, and the respective interactional phenomena are ephemeral and fluid, in the current paper we suggest a set of five criteria for the description of synchronization in general terms and eight additional criteria which specifically enable the description of phenomena of movement synchronization. The five general dimensions are: (1) context, (2) modality, (3) resources, (4) entrainment, and (5) time-lag. The eight categories for the description of movement synchrony are: (1) spatial direction, (2) amplitude, (3) sinuosity, (4) duration, (5) event structure, (6) phase, (7) frequency, and (8) content. To understand the process of participatory sense-making and the emergence of meaning in psychotherapy, synchrony research has to cope with the multimodality of the embodied interaction. This requires an integrated perspective of movement and language. A system for the classification of synchrony phenomena may contribute to the linking of variations and patterns of movement with language and linguistic utterances.
Collapse
Affiliation(s)
- Carl Eduard Scheidt
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center, Albert-Ludwigs-University Freiburg, Freiburg, Germany.,Freiburg Institute for Advanced Studies (FRIAS), Albert-Ludwigs-University Freiburg, Freiburg, Germany
| | - Stefan Pfänder
- Freiburg Institute for Advanced Studies (FRIAS), Albert-Ludwigs-University Freiburg, Freiburg, Germany.,Romanisches Seminar, Albert-Ludwigs-University Freiburg, Freiburg, Germany
| | - Arianna Ballati
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center, Albert-Ludwigs-University Freiburg, Freiburg, Germany
| | - Stefan Schmidt
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center, Albert-Ludwigs-University Freiburg, Freiburg, Germany
| | - Claas Lahmann
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center, Albert-Ludwigs-University Freiburg, Freiburg, Germany.,Freiburg Institute for Advanced Studies (FRIAS), Albert-Ludwigs-University Freiburg, Freiburg, Germany
| |
Collapse
|
39
|
Kiverstein J, Rietveld E. Skilled we-intentionality: Situating joint action in the living environment. OPEN RESEARCH EUROPE 2021; 1:54. [PMID: 37645108 PMCID: PMC10445857 DOI: 10.12688/openreseurope.13411.2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 09/10/2021] [Indexed: 08/31/2023]
Abstract
There is a difference between the activities of two or more individuals that are performed jointly such as playing music in a band or dancing as a couple, and performing these same activities alone. This difference is sometimes captured by appealing to shared or joint intentions that allow individuals to coordinate what they do over space and time. In what follows we will use the terminology of we-intentionality to refer to what individuals do when they engage in group ways of thinking, feeling and acting. Our aim in this paper is to argue that we-intentionality is best understood in relation to a shared living environment in which acting individuals are situated. By the "living environment" we mean to refer to places and everyday situations in which humans act. These places and situations are simultaneously social, cultural, material and natural. We will use the term "affordance" to refer to the possibilities for action the living environment furnishes. Affordances form and are maintained over time through the activities people repeatedly engage in the living environment. We will show how we-intentionality is best understood in relation to the affordances of the living environmentand by taking into account the skills people have to engage with these affordances. For this reason we coin the term 'skilled we-intentionality' to characterize the intentionality characteristic of group ways of acting, feeling and thinking.
Collapse
Affiliation(s)
- Julian Kiverstein
- Psychiatry, Academic Medical Center of the University of Amsterdam, Amsterdam, 1105AZ, The Netherlands
| | - Erik Rietveld
- Psychiatry, Academic Medical Center of the University of Amsterdam, Amsterdam, 1105AZ, The Netherlands
- Philosophy, University of Twente, Enschede, The Netherlands
- Institute of Logic, Language and Computation, Humanities, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
40
|
Abstract
Despite recent developments in integrating autonomous and human-like robots into many aspects of everyday life, social interactions with robots are still a challenge. Here, we focus on a central tool for social interaction: verbal communication. We assess the extent to which humans co-represent (simulate and predict) a robot's verbal actions. During a joint picture naming task, participants took turns in naming objects together with a social robot (Pepper, Softbank Robotics). Previous findings using this task with human partners revealed internal simulations on behalf of the partner down to the level of selecting words from the mental lexicon, reflected in partner-elicited inhibitory effects on subsequent naming. Here, with the robot, the partner-elicited inhibitory effects were not observed. Instead, naming was facilitated, as revealed by faster naming of word categories co-named with the robot. This facilitation suggests that robots, unlike humans, are not simulated down to the level of lexical selection. Instead, a robot's speaking appears to be simulated at the initial level of language production where the meaning of the verbal message is generated, resulting in facilitated language production due to conceptual priming. We conclude that robots facilitate core conceptualization processes when humans transform thoughts to language during speaking.
Collapse
|
41
|
Liebermann-Jordanidis H, Novembre G, Koch I, Keller PE. Simultaneous self-other integration and segregation support real-time interpersonal coordination in a musical joint action task. Acta Psychol (Amst) 2021; 218:103348. [PMID: 34058671 DOI: 10.1016/j.actpsy.2021.103348] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 04/21/2021] [Accepted: 05/24/2021] [Indexed: 12/27/2022] Open
Abstract
The ability to distinguish between an individual's own actions and those of another person is a requirement for successful joint action, particularly in domains such as group music making where precise interpersonal coordination ensures perceptual overlap in the effects of co-performers' actions. We tested the hypothesis that such coordination benefits from simultaneous integration and segregation of information about 'self' and 'other' in an experiment using a musical joint action paradigm. Sixteen pairs of individuals with little or no musical training performed a dyadic synchronization task on a pair of electronic music boxes. The relationship between pitches produced by paired participants (same vs. different) and the relationship between movement frequencies required to trigger synchronous tones (congruent vs. incongruent) were varied in a repeated measures design. The results indicate that interpersonal coordination was most accurate when sounds were different in pitch but movement frequency was congruent. Under other conditions, participants often drifted apart, resulting in poor coordination, especially with same sounds and incongruent movements across co-performers. These findings suggest that interpersonal coordination was facilitated when simultaneous self-other integration and segregation occurred across sensory modalities in an asymmetrical manner where pitch relations favoured segregation via auditory streaming while movement congruence favoured integration via visuo-motor coupling. Such self-other representational balance may enable co-performers to maintain autonomous control while attending, anticipating, and adapting to each other's timing when joint action requires precise temporal coordination.
Collapse
Affiliation(s)
- Hannah Liebermann-Jordanidis
- Department of Medical Psychology|Neuropsychology and Gender Studies & Center for Neuropsychological Diagnostics and Intervention (CeNDI), Faculty of Medicine and University Hospital Cologne, Germany
| | | | - Iring Koch
- Cognitive and Experimental Psychology, Rheinisch-Westfälische Technische Hochschule Aachen, Germany
| | - Peter E Keller
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Australia.
| |
Collapse
|
42
|
Laforest J, MacGillivray M, Lam MY. The influence of social context and social connection on visual perceptual processes. Acta Psychol (Amst) 2021; 215:103270. [PMID: 33639445 DOI: 10.1016/j.actpsy.2021.103270] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 02/03/2021] [Accepted: 02/10/2021] [Indexed: 10/22/2022] Open
Abstract
The aim of this study was twofold: (1) to re-test whether a minimal social context has an influence on gaze patterns, and (2) to determine if a social connection (i.e., friendship) has a modulatory effect on gaze patterns in a minimal social context. In Experiment 1, two unacquainted participants were paired and seated at separate testing stations in the same room. At the beginning of each trial, participants were informed whether they were looking at different image sets (solo trials), or the same image set (joint trials). Image sets consisted of a positive, a negative, and two neutral images. No explicit task instructions were provided and there was no interaction between participants during the task. Experiment 2 was identical to Experiment 1, except that participants were paired with a friend. The fixation-based metrics of interest were time to first fixation (TFF) and total fixation duration (TFD). The findings revealed that social context has a modulatory effect on attentional capture (i.e., TFF) irrespective of social connection. Unexpectedly, a negativity bias was found to hold attention (i.e., TFD) regardless of social context. However, having a social connection did increase the time spent looking at positive images on the joint trials. Having a social connection with another person seems to alter looking behaviour such that more time is spent looking at positive images on the joint trials compared to the solo trials. These findings highlight the importance of evaluating both TFD and TFF to develop a better understanding of the factors underlying joint perception.
Collapse
|
43
|
Harris I, Cross I. Investigating Everyday Musical Interaction During COVID-19: An Experimental Procedure for Exploring Collaborative Playlist Engagement. Front Psychol 2021; 12:647967. [PMID: 33868123 PMCID: PMC8049501 DOI: 10.3389/fpsyg.2021.647967] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2020] [Accepted: 03/08/2021] [Indexed: 11/13/2022] Open
Abstract
Musical Group Interaction (MGI) has been found to promote prosocial tendencies, including empathy, across various populations. However, experimental study is lacking in respect of effects of everyday forms of musical engagement on prosocial tendencies, as well as whether key aspects-such as physical co-presence of MGI participants-are necessary to enhance prosocial tendencies. We developed an experimental procedure in order to study online engagement with collaborative playlists and to investigate socio-cognitive components of prosocial tendencies expected to increase as a consequence of engagement. We aimed to determine whether mere perceived presence of a partner during playlist-making could elicit observable correlates of social processing implicated in both MGI and prosocial behaviors more generally and identify the potential roles of demographic, musical, and inter-individual differences. Preliminary results suggest that for younger individuals, some of the social processes involved in joint music-making and implicated in empathic processes are likely to be elicited even by an assumption of virtual co-presence. In addition, individual differences in styles of listening behavior may mediate the effects of mere perceived partner presence on recognition memory.
Collapse
Affiliation(s)
- Ilana Harris
- Department of Education and Psychology, Center for Cognitive Neuroscience Berlin, Free University Berlin, Berlin, Germany.,Faculty of Music, Centre for Music and Science, University of Cambridge, Cambridge, United Kingdom
| | - Ian Cross
- Faculty of Music, Centre for Music and Science, University of Cambridge, Cambridge, United Kingdom
| |
Collapse
|
44
|
Siekiera N, Białek A. Doing things together: Development of cooperation through cultural participation. JOURNAL FOR THE THEORY OF SOCIAL BEHAVIOUR 2021. [DOI: 10.1111/jtsb.12275] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
45
|
Cerullo S, Fulceri F, Muratori F, Contaldo A. Acting with shared intentions: A systematic review on joint action coordination in Autism Spectrum Disorder. Brain Cogn 2021; 149:105693. [PMID: 33556847 DOI: 10.1016/j.bandc.2021.105693] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2020] [Revised: 12/30/2020] [Accepted: 01/08/2021] [Indexed: 02/02/2023]
Abstract
BACKGROUND Joint actions, described as a form of social interaction in which individuals coordinate their actions in space and time to bring about a change in the environment, rely on sensory-motor processes that play a role in the development of social skills. Two brain networks, associated with "mirroring" and "mentalizing", are engaged during these actions: the mirror neuron and the theory of mind systems. People with autism spectrum disorder (ASD) showed impairment in interpersonal coordination during joint actions. Studying joint action coordination in ASD will contribute to clarify the interplay between sensory-motor and social processes throughout development and the interactions between the brain and the behavior. METHOD This review focused on empirical studies that reported behavioral and kinematic findings related to joint action coordination in people with ASD. RESULTS Literature on mechanisms involved in the joint action coordination impairment in ASD is still limited. Data are controversial. Different key-components of joint action coordination may be impaired, such as cooperative behavior, temporal coordination, and motor planning. CONCLUSIONS Interpersonal coordination during joint actions relies on early sensory-motor processes that have a key role in guiding social development. Early intervention targeting the sensory-motor processes involved in the development of joint action coordination could positively support social skills.
Collapse
Affiliation(s)
- Sonia Cerullo
- IRCCS Stella Maris Foundation, 331 Viale del Tirreno, 56018 Pisa, Italy
| | - Francesca Fulceri
- Research Coordination and Support Service, Istituto Superiore di Sanità, Viale Regina Elena 299, 00161 Rome, Italy
| | - Filippo Muratori
- IRCCS Stella Maris Foundation, 331 Viale del Tirreno, 56018 Pisa, Italy; Department of Clinical and Experimental Medicine, University of Pisa, Pisa, Italy
| | - Annarita Contaldo
- IRCCS Stella Maris Foundation, 331 Viale del Tirreno, 56018 Pisa, Italy.
| |
Collapse
|
46
|
Goupil L, Wolf T, Saint-Germier P, Aucouturier JJ, Canonne C. Emergent Shared Intentions Support Coordination During Collective Musical Improvisations. Cogn Sci 2021; 45:e12932. [PMID: 33438231 DOI: 10.1111/cogs.12932] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Revised: 11/26/2020] [Accepted: 12/09/2020] [Indexed: 11/28/2022]
Abstract
Human interactions are often improvised rather than scripted, which suggests that efficient coordination can emerge even when collective plans are largely underspecified. One possibility is that such forms of coordination primarily rely on mutual influences between interactive partners, and on perception-action couplings such as entrainment or mimicry. Yet some forms of improvised joint actions appear difficult to explain solely by appealing to these emergent mechanisms. Here, we focus on collective free improvisation, a form of highly unplanned creative practice where both agents' subjective reports and the complexity of their interactions suggest that shared intentions may sometimes emerge to support coordination during the course of the improvisation, even in the absence of verbal communication. In four experiments, we show that shared intentions spontaneously emerge during collective musical improvisations, and that they foster coordination on multiple levels, over and beyond the mere influence of shared information. We also show that musicians deploy communicative strategies to manifest and propagate their intentions within the group, and that this predicts better coordination. Overall, our results suggest that improvised and scripted joint actions are more continuous with one another than it first seems, and that they differ merely in the extent to which they rely on emergent or planned coordination mechanisms.
Collapse
Affiliation(s)
- Louise Goupil
- Science and Technology of Music and Sound (UMR 9912, IRCAM/CNRS/Sorbonne University).,School of Psychology, University of East London
| | - Thomas Wolf
- Department of Cognitive Science, Central European University
| | - Pierre Saint-Germier
- Science and Technology of Music and Sound (UMR 9912, IRCAM/CNRS/Sorbonne University)
| | | | - Clément Canonne
- Science and Technology of Music and Sound (UMR 9912, IRCAM/CNRS/Sorbonne University)
| |
Collapse
|
47
|
Bolt NK, Loehr JD. The motor-related brain activity that supports joint action: A review. Acta Psychol (Amst) 2021; 212:103218. [PMID: 33307297 DOI: 10.1016/j.actpsy.2020.103218] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2020] [Revised: 08/28/2020] [Accepted: 11/16/2020] [Indexed: 01/17/2023] Open
Abstract
Recent years have seen a rapid increase in research investigating the motor-related brain activity that supports joint action. This research has employed a variety of joint action tasks and an array of neuroimaging techniques, including fMRI, fNIRS, EEG, and TMS. In this review, we provide an overview of this research to delineate what is known about the motor-related brain activity that contributes to joint action and to highlight key questions for future research. Taken together, the surveyed research supports three major conclusions. First, the mere presence of a joint action context is sufficient to modulate motor activity elicited by observing others' actions. Second, joint action is supported by dissociable motor activity associated with a person's own actions, their partner's actions, and the joint action, and by between-brain coupling of motor-related oscillatory activity. Third, the structure of a joint action modulates the motor activity involved: Unique motor activity is associated with performing joint actions comprised of complementary actions and with holding the roles of leader and follower within a joint action. We conclude the review by highlighting overarching themes and key questions for future research.
Collapse
|
48
|
Schmitz L, Knoblich G, Deroy O, Vesper C. Crossmodal correspondences as common ground for joint action. Acta Psychol (Amst) 2021; 212:103222. [PMID: 33302228 PMCID: PMC7755874 DOI: 10.1016/j.actpsy.2020.103222] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2020] [Revised: 09/25/2020] [Accepted: 11/05/2020] [Indexed: 11/19/2022] Open
Abstract
When performing joint actions, people rely on common ground - shared information that provides the required basis for mutual understanding. Common ground can be based on people's interaction history or on knowledge and expectations people share, e.g., because they belong to the same culture or social class. Here, we suggest that people rely on yet another form of common ground, one that originates in their similarities in multisensory processing. Specifically, we focus on 'crossmodal correspondences' - nonarbitrary associations that people make between stimulus features in different sensory modalities, e.g., between stimuli in the auditory and the visual modality such as high-pitched sounds and small objects. Going beyond previous research that focused on investigating crossmodal correspondences in individuals, we propose that people can use these correspondences for communicating and coordinating with others. Initial support for our proposal comes from a communication game played in a public space (an art gallery) by pairs of visitors. We observed that pairs created nonverbal communication systems by spontaneously relying on 'crossmodal common ground'. Based on these results, we conclude that crossmodal correspondences not only occur within individuals but that they can also be actively used in joint action to facilitate the coordination between individuals.
Collapse
Affiliation(s)
- Laura Schmitz
- Department of Cognitive Science, Central European University, Budapest, Hungary; Institute for Sports Science, Leibniz Universität Hannover, Hannover, Germany
| | - Günther Knoblich
- Department of Cognitive Science, Central European University, Budapest, Hungary
| | - Ophelia Deroy
- Faculty of Philosophy, Ludwig-Maximilians-Universität, Munich, Germany; Munich Centre for Neuroscience, Ludwig-Maximilians-Universität, Munich, Germany; Institute of Philosophy, School of Advanced Study, University of London, London, UK
| | - Cordula Vesper
- Department of Cognitive Science, Central European University, Budapest, Hungary; Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus, Denmark; Interacting Minds Centre, Aarhus University, Aarhus, Denmark.
| |
Collapse
|
49
|
ERP markers of action planning and outcome monitoring in human - robot interaction. Acta Psychol (Amst) 2021; 212:103216. [PMID: 33285360 DOI: 10.1016/j.actpsy.2020.103216] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Revised: 11/12/2020] [Accepted: 11/16/2020] [Indexed: 01/06/2023] Open
Abstract
The present study aimed to examine event-related potentials (ERPs) of action planning and outcome monitoring in human-robot interaction. To this end, participants were instructed to perform costly actions (i.e. losing points) to stop a balloon from inflating and to prevent its explosion. They performed the task alone (individual condition) or with a robot (joint condition). Similar to findings from human-human interactions, results showed that action planning was affected by the presence of another agent, robot in this case. Specifically, the early readiness potential (eRP) amplitude was larger in the joint, than in the individual, condition. The presence of the robot affected also outcome perception and monitoring. Our results showed that the P1/N1 complex was suppressed in the joint, compared to the individual condition when the worst outcome was expected, suggesting that the presence of the robot affects attention allocation to negative outcomes of one's own actions. Similarly, results also showed that larger losses elicited smaller feedback-related negativity (FRN) in the joint than in the individual condition. Taken together, our results indicate that the social presence of a robot may influence the way we plan our actions and also the way we monitor their consequences. Implications of the study for the human-robot interaction field are discussed.
Collapse
|
50
|
Toro J, Martiny K. New perspectives on person-centered care: an affordance-based account. MEDICINE, HEALTH CARE, AND PHILOSOPHY 2020; 23:631-644. [PMID: 32886295 DOI: 10.1007/s11019-020-09977-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/27/2020] [Indexed: 06/11/2023]
Abstract
Despite the growing interest and supporting evidence for person-centered care (PCC), there is still a fundamental disagreement about what makes healthcare person-centered. In this article, we define PCC as operating with three fundamental conditions: personal, participatory and holistic. To further understand these concepts, we develop a framework based on the theory of affordances, which we apply to the healthcare case of rehabilitation and a concrete experiment on social interactions between persons with cerebral palsy and physio- and occupational therapists. Based on the application of the theory, we argue that in order for healthcare to be considered as PCC, professionals need to adopt a personalistic attitude in their care, defined (at the how-level) in terms of mutual affordances: how the professional and the person of care acknowledges each other as a person in an interaction. In opposition, we define (at the what level) the functionalistic attitude in terms of object affordances, those related to a concrete goal. We show that PCC requires a balance of personalistic and functionalistic attitudes, since this contributes to a participatory and holistic conception of, and interaction with, the person of care.
Collapse
Affiliation(s)
- Juan Toro
- Center for Subjectivity Research, University of Copenhagen, Copenhagen, Denmark.
- The Enactlab, Copenhagen, Denmark.
| | - Kristian Martiny
- Center for Subjectivity Research, University of Copenhagen, Copenhagen, Denmark
- The Enactlab, Copenhagen, Denmark
| |
Collapse
|