1
|
Lübbert A, Sengelmann M, Heimann K, Schneider TR, Engel AK, Göschl F. Predicting social experience from dyadic interaction dynamics: the BallGame, a novel paradigm to study social engagement. Sci Rep 2024; 14:19666. [PMID: 39181889 PMCID: PMC11344780 DOI: 10.1038/s41598-024-69678-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 08/07/2024] [Indexed: 08/27/2024] Open
Abstract
Theories of embodied cognition suggest that a shared environment and ongoing sensorimotor interaction are central for interpersonal learning and engagement. To investigate the embodied, distributed and hence dynamically unfolding nature of social cognitive capacities, we present a novel laboratory-based coordination task: the BallGame. Our paradigm requires continuous sensing and acting between two players who jointly steer a virtual ball around obstacles towards as many targets as possible. By analysing highly resolved measures of movement coordination and gaming behaviour, game-concurrent experience ratings, semi-structured interviews, and personality questionnaires, we reveal contributions from different levels of observation on social experience. In particular, successful coordination (number of targets collected) and intermittent periods of high versus low movement coordination (variability of relation) emerged as prominent predictors of social experience. Importantly, having the same (but incomplete) view on the game environment strengthened interpersonal coordination, whereas complementary views enhanced engagement and tended to generate more complex interactive behaviour. Overall, we find evidence for a critical balance between similarity and synchrony on the one hand, and variability and difference on the other, for successful engagement in social interactions. Finally, following participant reports, we highlight how interpersonal experience emerges from specific histories of coordination that are closely related to the interaction context in both space and time.
Collapse
Affiliation(s)
- Annika Lübbert
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany.
| | - Malte Sengelmann
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany
| | - Katrin Heimann
- Center for Educational Development, Aarhus University, Trøjborgvej 82-84, 8000, AarhusC, Denmark
- Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt Am Main, Germany
| | - Till R Schneider
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany
| | - Andreas K Engel
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany
| | - Florian Göschl
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany
| |
Collapse
|
2
|
Zamm A, Loehr JD, Vesper C, Konvalinka I, Kappel SL, Heggli OA, Vuust P, Keller PE. A practical guide to EEG hyperscanning in joint action research: from motivation to implementation. Soc Cogn Affect Neurosci 2024; 19:nsae026. [PMID: 38584414 PMCID: PMC11086947 DOI: 10.1093/scan/nsae026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 12/31/2023] [Accepted: 03/15/2024] [Indexed: 04/09/2024] Open
Abstract
Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.
Collapse
Affiliation(s)
- Anna Zamm
- Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus 8000, Denmark
- Interacting Minds Center, Aarhus University, Aarhus 8000, Denmark
| | - Janeen D Loehr
- Department of Psychology and Health Studies, University of Saskatchewan, Saskatoon, SK S7N 5A5, Canada
| | - Cordula Vesper
- Department of Linguistics, Cognitive Science and Semiotics, Aarhus University, Aarhus 8000, Denmark
- Interacting Minds Center, Aarhus University, Aarhus 8000, Denmark
| | - Ivana Konvalinka
- Section for Cognitive Systems, DTU Compute, Technical University of Denmark, Kongens Lyngby DK-2800, Denmark
| | - Simon L Kappel
- Department of Electrical and Computer Engineering, Aarhus University, Aarhus N 8200, Denmark
| | - Ole A Heggli
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
| | - Peter E Keller
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus 8000, Denmark
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, New South Wales 2751, Australia
| |
Collapse
|
3
|
Sabharwal SR, Breaden M, Volpe G, Camurri A, Keller PE. Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos. PLoS One 2024; 19:e0300663. [PMID: 38568939 PMCID: PMC10990194 DOI: 10.1371/journal.pone.0300663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 03/01/2024] [Indexed: 04/05/2024] Open
Abstract
Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.
Collapse
Affiliation(s)
| | - Matthew Breaden
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
| | | | | | - Peter E. Keller
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus, Aarhus, Aalborg, Denmark
| |
Collapse
|
4
|
Zheng Z, Wang J. Interpersonal prior information informs ensemble coding through the co-representation process. Psychon Bull Rev 2024; 31:886-896. [PMID: 37783900 DOI: 10.3758/s13423-023-02390-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/10/2023] [Indexed: 10/04/2023]
Abstract
Humans have the ability to rapidly extract summary statistics from object groupings through a specific capability known as ensemble coding. Previous literature has reported that this ability can become biased by prior perceptual experiences at the individual level. However, it remains unknown whether interpersonal prior information could also bias ensemble perception through a co-representation process. Experiment 1 found that participants' summary estimations were biased toward their co-actor's stimuli. Experiment 2 confirmed a causal relationship between the bias effect and the co-representation process by showing a reduction in biased estimation after pairing participants with an out-group partner. These findings extend the sources of prior information exploited by humans during perceptual average from individual-level information (i.e., self-tasks) to interpersonal-level information (i.e., co-actor's tasks). More specifically, interpersonal prior information is shown to act in a top-down and implicit manner, biasing ensemble perception.
Collapse
Affiliation(s)
- Zheng Zheng
- School of Psychology, Zhejiang Normal University, Jinhua City, 321004, People's Republic of China
- Zhejiang Philosophy and Social Science Laboratory for the Mental Health and Crisis Intervention of Children and Adolescents, Zhejiang Normal University, Jinhua, China
- Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, Zhejiang, 321004, China
| | - Jun Wang
- School of Psychology, Zhejiang Normal University, Jinhua City, 321004, People's Republic of China.
- Zhejiang Philosophy and Social Science Laboratory for the Mental Health and Crisis Intervention of Children and Adolescents, Zhejiang Normal University, Jinhua, China.
| |
Collapse
|
5
|
Rosso M, van Kerrebroeck B, Maes PJ, Leman M. Embodied perspective-taking enhances interpersonal synchronization: A body-swap study. iScience 2023; 26:108099. [PMID: 37920667 PMCID: PMC10618832 DOI: 10.1016/j.isci.2023.108099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 06/20/2023] [Accepted: 09/27/2023] [Indexed: 11/04/2023] Open
Abstract
Humans exhibit a strong tendency to synchronize movements with each other, with visual perspective potentially influencing interpersonal synchronization. By manipulating the visual scenes of participants engaged in a joint finger-tapping task, we examined the effects of 1st person and 2nd person visual perspectives on their coordination dynamics. We hypothesized that perceiving the partner's movements from their 1st person perspective would enhance spontaneous interpersonal synchronization, potentially mediated by the embodiment of the partner's hand. We observed significant differences in attractor dynamics across visual perspectives. Specifically, participants in 1st person coupling were unable to maintain de-coupled trajectories as effectively as in 2nd person coupling. Our findings suggest that visual perspective influences coordination dynamics in dyadic interactions, engaging error-correction mechanisms in individual brains as they integrate the partner's hand into their body representation. Our results have the potential to inform the development of applications for motor training and rehabilitation.
Collapse
Affiliation(s)
- Mattia Rosso
- IPEM - Institute for Systematic Musicology, Ghent University, 9000 Ghent, Flanders, Belgium
- PSITEC - Psychologie: Interactions, Temps, Emotions, Cognition - ULR 4072, University of Lille, 59650 Lille, Hauts-de-France, France
| | - Bavo van Kerrebroeck
- IPEM - Institute for Systematic Musicology, Ghent University, 9000 Ghent, Flanders, Belgium
- SPL - Sequence Production Lab, McGill University, Montreal, Quebec H3A 1B1, Canada
- IDMIL – Input Devices. And Music Interaction Laboratory, McGill University, Montréal, Québec H3A 1E3, Canada
| | - Pieter-Jan Maes
- IPEM - Institute for Systematic Musicology, Ghent University, 9000 Ghent, Flanders, Belgium
| | - Marc Leman
- IPEM - Institute for Systematic Musicology, Ghent University, 9000 Ghent, Flanders, Belgium
| |
Collapse
|
6
|
Lapenta OM, Keller PE, Nozaradan S, Varlet M. Spatial and temporal (non)binding of audiovisual rhythms in sensorimotor synchronisation. Exp Brain Res 2023; 241:875-887. [PMID: 36788141 PMCID: PMC9985575 DOI: 10.1007/s00221-023-06569-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 02/06/2023] [Indexed: 02/16/2023]
Abstract
Human movement synchronisation with moving objects strongly relies on visual input. However, auditory information also plays an important role, since real environments are intrinsically multimodal. We used electroencephalography (EEG) frequency tagging to investigate the selective neural processing and integration of visual and auditory information during motor tracking and tested the effects of spatial and temporal congruency between audiovisual modalities. EEG was recorded while participants tracked with their index finger a red flickering (rate fV = 15 Hz) dot oscillating horizontally on a screen. The simultaneous auditory stimulus was modulated in pitch (rate fA = 32 Hz) and lateralised between left and right audio channels to induce perception of a periodic displacement of the sound source. Audiovisual congruency was manipulated in terms of space in Experiment 1 (no motion, same direction or opposite direction), and timing in Experiment 2 (no delay, medium delay or large delay). For both experiments, significant EEG responses were elicited at fV and fA tagging frequencies. It was also hypothesised that intermodulation products corresponding to the nonlinear integration of visual and auditory stimuli at frequencies fV ± fA would be elicited, due to audiovisual integration, especially in Congruent conditions. However, these components were not observed. Moreover, synchronisation and EEG results were not influenced by congruency manipulations, which invites further exploration of the conditions which may modulate audiovisual processing and the motor tracking of moving objects.
Collapse
Affiliation(s)
- Olivia Morgan Lapenta
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.
- Psychological Neuroscience Lab, Center for Investigation in Psychology, University of Minho, Rua da Universidade, 4710-057, Braga, Portugal.
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Sylvie Nozaradan
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- Institute of Neuroscience, Université Catholique de Louvain, Woluwe-Saint-Lambert, Belgium
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- School of Psychology, Western Sydney University, Penrith, Australia
| |
Collapse
|
7
|
Varlet M, Nozaradan S, Schmidt RC, Keller PE. Neural tracking of visual periodic motion. Eur J Neurosci 2023; 57:1081-1097. [PMID: 36788113 DOI: 10.1111/ejn.15934] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 02/10/2023] [Accepted: 02/10/2023] [Indexed: 02/16/2023]
Abstract
Periodicity is a fundamental property of biological systems, including human movement systems. Periodic movements support displacements of the body in the environment as well as interactions and communication between individuals. Here, we use electroencephalography (EEG) to investigate the neural tracking of visual periodic motion, and more specifically, the relevance of spatiotemporal information contained at and between their turning points. We compared EEG responses to visual sinusoidal oscillations versus nonlinear Rayleigh oscillations, which are both typical of human movements. These oscillations contain the same spatiotemporal information at their turning points but differ between turning points, with Rayleigh oscillations having an earlier peak velocity, shown to increase an individual's capacity to produce accurately synchronized movements. EEG analyses highlighted the relevance of spatiotemporal information between the turning points by showing that the brain precisely tracks subtle differences in velocity profiles, as indicated by earlier EEG responses for Rayleigh oscillations. The results suggest that the brain is particularly responsive to velocity peaks in visual periodic motion, supporting their role in conveying behaviorally relevant timing information at a neurophysiological level. The results also suggest key functions of neural oscillations in the Alpha and Beta frequency bands, particularly in the right hemisphere. Together, these findings provide insights into the neural mechanisms underpinning the processing of visual periodic motion and the critical role of velocity peaks in enabling proficient visuomotor synchronization.
Collapse
Affiliation(s)
- Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.,School of Psychology, Western Sydney University, Penrith, Australia
| | - Sylvie Nozaradan
- Institute of Neuroscience (IONS), Université catholique de Louvain (UCL), Brussels, Belgium
| | - Richard C Schmidt
- Department of Psychology, College of the Holy Cross, Worcester, Massachusetts, USA
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.,Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| |
Collapse
|
8
|
Christensen J, Slavik L, Nicol JJ, Loehr JD. Alpha oscillations related to self-other integration and distinction during live orchestral performance: A naturalistic case study. PSYCHOLOGY OF MUSIC 2023; 51:295-315. [PMID: 36532616 PMCID: PMC9751440 DOI: 10.1177/03057356221091313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Ensemble music performance requires musicians to achieve precise interpersonal coordination while maintaining autonomous control over their own actions. To do so, musicians dynamically shift between integrating other performers' actions into their own action plans and maintaining a distinction between their own and others' actions. Research in laboratory settings has shown that this dynamic process of self-other integration and distinction is indexed by sensorimotor alpha oscillations. The purpose of the current descriptive case study was to examine oscillations related to self-other integration and distinction in a naturalistic performance context. We measured alpha activity from four violinists during a concert hall performance of a 60-musician orchestra. We selected a musical piece from the orchestra's repertoire and, before analyzing alpha activity, performed a score analysis to divide the piece into sections that were expected to strongly promote self-other integration and distinction. In line with previous laboratory findings, performers showed suppressed and enhanced alpha activity during musical sections that promoted self-other integration and distinction, respectively. The current study thus provides preliminary evidence that findings from carefully controlled laboratory experiments generalize to complex real-world performance. Its findings also suggest directions for future research and potential applications of interest to musicians, music educators, and music therapists.
Collapse
Affiliation(s)
| | - Lauren Slavik
- Department of Psychology, University of Saskatchewan, Saskatoon, Canada
| | - Jennifer J Nicol
- Department of Educational Psychology and Special Education, University of Saskatchewan, Saskatoon, Canada
| | - Janeen D Loehr
- Department of Psychology, University of Saskatchewan, Saskatoon, Canada
| |
Collapse
|
9
|
Chen WG, Iversen JR, Kao MH, Loui P, Patel AD, Zatorre RJ, Edwards E. Music and Brain Circuitry: Strategies for Strengthening Evidence-Based Research for Music-Based Interventions. J Neurosci 2022; 42:8498-8507. [PMID: 36351825 PMCID: PMC9665917 DOI: 10.1523/jneurosci.1135-22.2022] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Revised: 09/07/2022] [Accepted: 09/10/2022] [Indexed: 11/17/2022] Open
Abstract
The neuroscience of music and music-based interventions (MBIs) is a fascinating but challenging research field. While music is a ubiquitous component of every human society, MBIs may encompass listening to music, performing music, music-based movement, undergoing music education and training, or receiving treatment from music therapists. Unraveling the brain circuits activated and influenced by MBIs may help us gain better understanding of the therapeutic and educational values of MBIs by gathering strong research evidence. However, the complexity and variety of MBIs impose unique research challenges. This article reviews the recent endeavor led by the National Institutes of Health to support evidence-based research of MBIs and their impact on health and diseases. It also highlights fundamental challenges and strategies of MBI research with emphases on the utilization of animal models, human brain imaging and stimulation technologies, behavior and motion capturing tools, and computational approaches. It concludes with suggestions of basic requirements when studying MBIs and promising future directions to further strengthen evidence-based research on MBIs in connections with brain circuitry.SIGNIFICANCE STATEMENT Music and music-based interventions (MBI) engage a wide range of brain circuits and hold promising therapeutic potentials for a variety of health conditions. Comparative studies using animal models have helped in uncovering brain circuit activities involved in rhythm perception, while human imaging, brain stimulation, and motion capture technologies have enabled neural circuit analysis underlying the effects of MBIs on motor, affective/reward, and cognitive function. Combining computational analysis, such as prediction method, with mechanistic studies in animal models and humans may unravel the complexity of MBIs and their effects on health and disease.
Collapse
Affiliation(s)
- Wen Grace Chen
- Division of Extramural Research, National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, Maryland, 20892
| | | | - Mimi H Kao
- Tufts University, Medford, Massachusetts 02155
| | - Psyche Loui
- Northeastern University, Boston, Massachusetts 02115
| | | | - Robert J Zatorre
- Montreal Neurological Institute, McGill University, Montreal, Quebec H3A2B4, Canada
| | - Emmeline Edwards
- Division of Extramural Research, National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, Maryland, 20892
| |
Collapse
|
10
|
Ravreby I, Shilat Y, Yeshurun Y. Liking as a balance between synchronization, complexity and novelty. Sci Rep 2022; 12:3181. [PMID: 35210459 PMCID: PMC8873358 DOI: 10.1038/s41598-022-06610-z] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 02/01/2022] [Indexed: 02/06/2023] Open
Abstract
Synchronization has been identified as a key aspect in social bonding. While synchronization could be maximized by increasing the predictability of an interaction, such predictability is in tension with individuals' level of interest, which is tied to the interaction's complexity and novelty. In this study, we tested the interplay between synchronization and interest. We asked 104 female dyads to play the Mirror Game, in which they had to move their hands as coordinately as possible, and then report how much they liked each other. Utilizing information theory and video processing tools, we found that a combination of movement synchronization and complexity explained liking almost two times better than movement synchronization alone. Moreover, we found that people initiated novel and challenging interactions, even though they paid a price-being less synchronized. Examining the interactions' dynamics, we found that people who liked each other moved in a more synchronized, complex, and novel manner during most of the interaction. This suggests that in addition to synchronization, maintaining interest may be critical for positive social bonding. Thus, we propose a new framework in which balancing synchronization and interest, rather than merely maximizing synchronization, optimizes the interaction quality.
Collapse
Affiliation(s)
- Inbal Ravreby
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel.
- The Azrieli National Institute for Human Brain Imaging and Research, Rehovot, Israel.
| | - Yoel Shilat
- Department of Psychology, Ben-Gurion University of the Negev, Beer Sheva, Israel.
- Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer Sheva, Israel.
| | - Yaara Yeshurun
- School of Psychological Sciences, Tel-Aviv University, Tel-Aviv, Israel
- Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel
| |
Collapse
|
11
|
Heggli OA, Konvalinka I, Kringelbach ML, Vuust P. A metastable attractor model of self-other integration (MEAMSO) in rhythmic synchronization. Philos Trans R Soc Lond B Biol Sci 2021; 376:20200332. [PMID: 34420393 DOI: 10.1098/rstb.2020.0332] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
Human interaction is often accompanied by synchronized bodily rhythms. Such synchronization may emerge spontaneously as when a crowd's applause turns into a steady beat, be encouraged as in nursery rhymes, or be intentional as in the case of playing music together. The latter has been extensively studied using joint finger-tapping paradigms as a simplified version of rhythmic interpersonal synchronization. A key finding is that synchronization in such cases is multifaceted, with synchronized behaviour resting upon different synchronization strategies such as mutual adaptation, leading-following and leading-leading. However, there are multiple open questions regarding the mechanism behind these strategies and how they develop dynamically over time. Here, we propose a metastable attractor model of self-other integration (MEAMSO). This model conceptualizes dyadic rhythmic interpersonal synchronization as a process of integrating and segregating signals of self and other. Perceived sounds are continuously evaluated as either being attributed to self-produced or other-produced actions. The model entails a metastable system with two particular attractor states: one where an individual maintains two separate predictive models for self- and other-produced actions, and the other where these two predictive models integrate into one. The MEAMSO explains the three known synchronization strategies and makes testable predictions about the dynamics of interpersonal synchronization both in behaviour and the brain. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.
Collapse
Affiliation(s)
- Ole Adrian Heggli
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and the Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| | - Ivana Konvalinka
- SINe Lab, Section for Cognitive Systems, DTU Compute, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Morten L Kringelbach
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and the Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark.,Centre for Eudaimonia and Human Flourishing, Department of Psychiatry, University of Oxford, Oxford, UK
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and the Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| |
Collapse
|
12
|
Ayache J, Connor A, Marks S, Kuss DJ, Rhodes D, Sumich A, Heym N. Exploring the "Dark Matter" of Social Interaction: Systematic Review of a Decade of Research in Spontaneous Interpersonal Coordination. Front Psychol 2021; 12:718237. [PMID: 34707533 PMCID: PMC8542929 DOI: 10.3389/fpsyg.2021.718237] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 09/10/2021] [Indexed: 01/07/2023] Open
Abstract
Interpersonal coordination is a research topic that has attracted considerable attention this last decade both due to a theoretical shift from intra-individual to inter-individual processes and due to the development of new methods for recording and analyzing movements in ecological settings. Encompassing spatiotemporal behavioral matching, interpersonal coordination is considered as "social glue" due to its capacity to foster social bonding. However, the mechanisms underlying this effect are still unclear and recent findings suggest a complex picture. Goal-oriented joint action and spontaneous coordination are often conflated, making it difficult to disentangle the role of joint commitment from unconscious mutual attunement. Consequently, the goals of the present article are twofold: (1) to illustrate the rapid expansion of interpersonal coordination as a research topic and (2) to conduct a systematic review of spontaneous interpersonal coordination, summarizing its latest developments and current challenges this last decade. By applying Rapid Automatic Keyword Extraction and Latent Dirichlet Allocation algorithms, keywords were extracted from PubMed and Scopus databases revealing the large diversity of research topics associated with spontaneous interpersonal coordination. Using the same databases and the keywords "behavioral matching," "interactional synchrony," and "interpersonal coordination," 1,213 articles were identified, extracted, and screened following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses protocol. A total of 19 articles were selected using the following inclusion criteria: (1) dynamic and spontaneous interactions between two unacquainted individuals (2) kinematic analyses, and (3) non-clinical and non-expert adult populations. The results of this systematic review stress the proliferation of various definitions and experimental paradigms that study perceptual and/or social influences on the emergence of spontaneous interpersonal coordination. As methods and indices used to quantify interpersonal coordination differ from one study to another, it becomes difficult to establish a coherent picture. This review highlights the need to reconsider interpersonal coordination not as the pinnacle of social interactions but as a complex dynamical process that requires cautious interpretation. An interdisciplinary approach is necessary for building bridges across scattered research fields through opening a dialogue between different theoretical frameworks and consequently provides a more ecological and holistic understanding of human social cognition.
Collapse
Affiliation(s)
- Julia Ayache
- Department of Psychology, Nottingham Trent University, Nottingham, United Kingdom
| | - Andy Connor
- School of Future Environments, Auckland University of Technology, Auckland, New Zealand
| | - Stefan Marks
- School of Future Environments, Auckland University of Technology, Auckland, New Zealand
| | - Daria J. Kuss
- Department of Psychology, Nottingham Trent University, Nottingham, United Kingdom
| | - Darren Rhodes
- Department of Psychology, Nottingham Trent University, Nottingham, United Kingdom
| | - Alexander Sumich
- Department of Psychology, Nottingham Trent University, Nottingham, United Kingdom
- Department of Psychology, Auckland University of Technology, Auckland, New Zealand
| | - Nadja Heym
- Department of Psychology, Nottingham Trent University, Nottingham, United Kingdom
| |
Collapse
|
13
|
Rosso M, Maes PJ, Leman M. Modality-specific attractor dynamics in dyadic entrainment. Sci Rep 2021; 11:18355. [PMID: 34526522 PMCID: PMC8443558 DOI: 10.1038/s41598-021-96054-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2021] [Accepted: 08/03/2021] [Indexed: 11/08/2022] Open
Abstract
Rhythmic joint coordination is ubiquitous in daily-life human activities. In order to coordinate their actions towards shared goals, individuals need to co-regulate their timing and move together at the collective level of behavior. Remarkably, basic forms of coordinated behavior tend to emerge spontaneously as long as two individuals are exposed to each other's rhythmic movements. The present study investigated the dynamics of spontaneous dyadic entrainment, and more specifically how they depend on the sensory modalities mediating informational coupling. By means of a novel interactive paradigm, we showed that dyadic entrainment systematically takes place during a minimalistic rhythmic task despite explicit instructions to ignore the partner. Crucially, the interaction was organized by clear dynamics in a modality-dependent fashion. Our results showed highly consistent coordination patterns in visually-mediated entrainment, whereas we observed more chaotic and more variable profiles in the auditorily-mediated counterpart. The proposed experimental paradigm yields empirical evidence for the overwhelming tendency of dyads to behave as coupled rhythmic units. In the context of our experimental design, it showed that coordination dynamics differ according to availability and nature of perceptual information. Interventions aimed at rehabilitating, teaching or training sensorimotor functions can be ultimately informed and optimized by such fundamental knowledge.
Collapse
Affiliation(s)
- Mattia Rosso
- Department of Art, Music and Theatre Sciences, IPEM Institute for Psychoacoustics and Electronic Music, Ghent University, Ghent, Belgium.
| | - Pieter J Maes
- Department of Art, Music and Theatre Sciences, IPEM Institute for Psychoacoustics and Electronic Music, Ghent University, Ghent, Belgium
| | - Marc Leman
- Department of Art, Music and Theatre Sciences, IPEM Institute for Psychoacoustics and Electronic Music, Ghent University, Ghent, Belgium
| |
Collapse
|
14
|
Rosso M, Leman M, Moumdjian L. Neural Entrainment Meets Behavior: The Stability Index as a Neural Outcome Measure of Auditory-Motor Coupling. Front Hum Neurosci 2021; 15:668918. [PMID: 34177492 PMCID: PMC8219856 DOI: 10.3389/fnhum.2021.668918] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 04/29/2021] [Indexed: 01/23/2023] Open
Abstract
Understanding rhythmic behavior in the context of coupled auditory and motor systems has been of interest to neurological rehabilitation, in particular, to facilitate walking. Recent work based on behavioral measures revealed an entrainment effect of auditory rhythms on motor rhythms. In this study, we propose a method to compute the neural component of such a process from an electroencephalographic (EEG) signal. A simple auditory-motor synchronization paradigm was used, where 28 healthy participants were instructed to synchronize their finger-tapping with a metronome. The computation of the neural outcome measure was carried out in two blocks. In the first block, we used Generalized Eigendecomposition (GED) to reduce the data dimensionality to the component which maximally entrained to the metronome frequency. The scalp topography pointed at brain activity over contralateral sensorimotor regions. In the second block, we computed instantaneous frequency from the analytic signal of the extracted component. This returned a time-varying measure of frequency fluctuations, whose standard deviation provided our "stability index" as a neural outcome measure of auditory-motor coupling. Finally, the proposed neural measure was validated by conducting a correlation analysis with a set of behavioral outcomes from the synchronization task: resultant vector length, relative phase angle, mean asynchrony, and tempo matching. Significant moderate negative correlations were found with the first three measures, suggesting that the stability index provided a quantifiable neural outcome measure of entrainment, with selectivity towards phase-correction mechanisms. We address further adoption of the proposed approach, especially with populations where sensorimotor abilities are compromised by an underlying pathological condition. The impact of using stability index can potentially be used as an outcome measure to assess rehabilitation protocols, and possibly provide further insight into neuropathological models of auditory-motor coupling.
Collapse
Affiliation(s)
- Mattia Rosso
- Institute of Psychoacoustics and Electronic Music (IPEM), Faculty of Arts and Philosophy, Ghent University, Ghent, Belgium
| | - Marc Leman
- Institute of Psychoacoustics and Electronic Music (IPEM), Faculty of Arts and Philosophy, Ghent University, Ghent, Belgium
| | - Lousin Moumdjian
- Institute of Psychoacoustics and Electronic Music (IPEM), Faculty of Arts and Philosophy, Ghent University, Ghent, Belgium.,UMSC Hasselt-Pelt, Limburg, Belgium.,REVAL Rehabilitation Research Center, Faculty of Rehabilitation Sciences, Limburg, Belgium
| |
Collapse
|
15
|
Nijhuis P, Keller PE, Nozaradan S, Varlet M. Dynamic modulation of cortico-muscular coupling during real and imagined sensorimotor synchronisation. Neuroimage 2021; 238:118209. [PMID: 34051354 DOI: 10.1016/j.neuroimage.2021.118209] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2020] [Revised: 04/19/2021] [Accepted: 05/10/2021] [Indexed: 12/20/2022] Open
Abstract
People have a natural and intrinsic ability to coordinate body movements with rhythms surrounding them, known as sensorimotor synchronisation. This can be observed in daily environments, when dancing or singing along with music, or spontaneously walking, talking or applauding in synchrony with one another. However, the neurophysiological mechanisms underlying accurately synchronised movement with selected rhythms in the environment remain unclear. Here we studied real and imagined sensorimotor synchronisation with interleaved auditory and visual rhythms using cortico-muscular coherence (CMC) to better understand the processes underlying the preparation and execution of synchronised movement. Electroencephalography (EEG), electromyography (EMG) from the finger flexors, and continuous force signals were recorded in 20 participants during tapping and imagined tapping with discrete stimulus sequences consisting of alternating auditory beeps and visual flashes. The results show that the synchronisation between cortical and muscular activity in the beta (14-38 Hz) frequency band becomes time-locked to the taps executed in synchrony with the visual and auditory stimuli. Dynamic modulation in CMC also occurred when participants imagined tapping with the visual stimuli, but with lower amplitude and a different temporal profile compared to real tapping. These results suggest that CMC does not only reflect changes related to the production of the synchronised movement, but also to its preparation, which appears heightened under higher attentional demands imposed when synchronising with the visual stimuli. These findings highlight a critical role of beta band neural oscillations in the cortical-muscular coupling underlying sensorimotor synchronisation.
Collapse
Affiliation(s)
- Patti Nijhuis
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia.
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia
| | - Sylvie Nozaradan
- Institute of Neuroscience (Ions), Université catholique de Louvain (UCL), Belgium
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia; School of Psychology, Western Sydney University, Sydney, Australia
| |
Collapse
|
16
|
Tunçgenç B, Travers E, Fairhurst MT. Leadership and tempo perturbation affect coordination in medium-sized groups. Sci Rep 2021; 11:4940. [PMID: 33654114 PMCID: PMC7925598 DOI: 10.1038/s41598-021-81504-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2020] [Accepted: 12/07/2020] [Indexed: 11/08/2022] Open
Abstract
In marching bands, sports, dance and virtually all human group behaviour, we coordinate our actions with others. Coordinating actions in time and space can act as a social glue, facilitating bonding among people. However, much of our understanding about coordination dynamics is based on research into dyadic interactions. Little is known about the nature of the sensorimotor underpinnings and social bonding outcomes of coordination in medium-sized groups-the type of groups, in which most everyday teamwork takes place. In this study, we explored how the presence of a leader and an unexpected perturbation influence coordination and cohesion in a naturalistic setting. In groups of seven, participants were instructed to walk in time to an auditory pacing signal. We found that the presence of a reliable leader enhanced coordination with the target tempo, which was disrupted when the leader abruptly changed their movement tempo. This effect was not observed on coordination with the group members. Moreover, participants' perceptions of being a follower and group cooperativeness increased in the presence of a leader. This study extends our knowledge about coordination beyond previous work on dyads. We discuss our results in light of sensorimotor coupling and social cohesion theories of coordination in groups.
Collapse
Affiliation(s)
- Bahar Tunçgenç
- School of Psychology, University of Nottingham, Nottingham, UK
- Institute of Cognitive and Evolutionary Anthropology, University of Oxford, Oxford, UK
| | - Eoin Travers
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Merle T Fairhurst
- Faculty of Human Sciences, Institute of Psychology, Bundeswehr University, Munich, Germany.
- Faculty of Philosophy of Mind, Munich Centre for Neuroscience, LMU, Munich, Germany.
| |
Collapse
|
17
|
Bouvet CJ, Bardy BG, Keller PE, Dalla Bella S, Nozaradan S, Varlet M. Accent-induced Modulation of Neural and Movement Patterns during Spontaneous Synchronization to Auditory Rhythms. J Cogn Neurosci 2020; 32:2260-2271. [DOI: 10.1162/jocn_a_01605] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
Human rhythmic movements spontaneously synchronize with auditory rhythms at various frequency ratios. The emergence of more complex relationships—for instance, frequency ratios of 1:2 and 1:3—is enhanced by adding a congruent accentuation pattern (binary for 1:2 and ternary for 1:3), resulting in a 1:1 movement–accentuation relationship. However, this benefit of accentuation on movement synchronization appears to be stronger for the ternary pattern than for the binary pattern. Here, we investigated whether this difference in accent-induced movement synchronization may be related to a difference in the neural tracking of these accentuation profiles. Accented and control unaccented auditory sequences were presented to participants who concurrently produced finger taps at their preferred frequency, and spontaneous movement synchronization was measured. EEG was recorded during passive listening to each auditory sequence. The results revealed that enhanced movement synchronization with ternary accentuation was accompanied by enhanced neural tracking of this pattern. Larger EEG responses at the accentuation frequency were found for the ternary pattern compared with the binary pattern. Moreover, the amplitude of accent-induced EEG responses was positively correlated with the magnitude of accent-induced movement synchronization across participants. Altogether, these findings show that the dynamics of spontaneous auditory–motor synchronization is strongly driven by the multi-time-scale sensory processing of auditory rhythms, highlighting the importance of considering neural responses to rhythmic sequences for understanding and enhancing synchronization performance.
Collapse
Affiliation(s)
| | | | | | - Simone Dalla Bella
- Université Montpellier
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Canada
- University of Montreal
- University of Economics and Human Sciences in Warsaw
| | - Sylvie Nozaradan
- Western Sydney University
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Canada
- Université Catholique de Louvain
| | | |
Collapse
|