1
|
Plitchenko P, Bégel V, Palmer C. Effects of individual practice on joint musical synchronization. Front Hum Neurosci 2024; 18:1381232. [PMID: 38841125 PMCID: PMC11150700 DOI: 10.3389/fnhum.2024.1381232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2024] [Accepted: 04/30/2024] [Indexed: 06/07/2024] Open
Abstract
Successful music-making requires precise sensorimotor synchronization, both in individual (solo) and joint (ensemble) social settings. We investigated how individual practice synchronizing with a temporally regular melody (Solo conditions) influences subsequent synchronization between two partners (Joint conditions). Musically trained adults practiced producing a melody by tapping on a keypad; each tap generated the next tone in the melody. First, the pairs synchronized their melody productions with their partner in a baseline Joint synchronization task. Then each partner separately synchronized their melody with a computer-generated recording of the partner's melody in a Solo intervention condition that presented either Normal (temporally regular) auditory feedback or delayed feedback (by 30-70 ms) in occasional (25%) randomly placed tone positions. Then the pairs synchronized again with their partner in a Joint condition. Next, they performed the second Solo condition (normal or delayed auditory feedback) followed again by the Joint condition. Joint synchronization performance was modeled with a delay-coupled oscillator model to assess the coupling strength between partners. Absolute asynchronies in the Solo Intervention tasks were greater in the Delayed feedback condition than in the Normal feedback condition. Model estimates yielded larger coupling values between partners in Joint conditions that followed the Solo Normal feedback than the Solo Delayed feedback. Notably, the asynchronies were smaller in the Joint conditions than in the Solo conditions. These findings indicate that coupled interactions in settings of two or more performers can be improved by individual synchronization practice.
Collapse
Affiliation(s)
| | | | - Caroline Palmer
- Department of Psychology, McGill University, Montreal, QC, Canada
| |
Collapse
|
2
|
Sabharwal SR, Breaden M, Volpe G, Camurri A, Keller PE. Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos. PLoS One 2024; 19:e0300663. [PMID: 38568939 PMCID: PMC10990194 DOI: 10.1371/journal.pone.0300663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 03/01/2024] [Indexed: 04/05/2024] Open
Abstract
Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.
Collapse
Affiliation(s)
| | - Matthew Breaden
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
| | | | | | - Peter E. Keller
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus, Aarhus, Aalborg, Denmark
| |
Collapse
|
3
|
Fairhurst MT, Tajadura-Jiménez A, Keller PE, Deroy O. You, me, and us: Maintaining self-other distinction enhances coordination, agency, and affect. iScience 2023; 26:108253. [PMID: 38025777 PMCID: PMC10679890 DOI: 10.1016/j.isci.2023.108253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 08/08/2023] [Accepted: 10/16/2023] [Indexed: 12/01/2023] Open
Abstract
Coordinating our actions with others changes how we behave and feel. Here, we provide evidence that interacting with others rests on a balance between self-other integration and segregation. Using a group walking paradigm, participants were instructed to synchronize with a metronome while listening to the sounds of 8 virtual partners. By manipulating the similarity and synchronicity of the partners' steps to the participant's own, our novel auditory task disentangles the effects of synchrony and self-other similarity and examines their contribution to both collective and individual awareness. We measured temporal coordination (step timing regularity and synchrony with the metronome), gait patterns, and subjective reports about sense of self and group cohesion. The main findings show that coordination is best when participants hear distinct but synchronous virtual others, leading to greater subjective feelings of agency, strength, dominance, and happiness.
Collapse
Affiliation(s)
- Merle T. Fairhurst
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Faculty of Electrical and Computer Engineering, Technische Universität Dresden, Dresden, Germany
- Munich Centre for Neuroscience, Ludwig Maximilian University, Munich, Germany
| | - Ana Tajadura-Jiménez
- i_mBODY Lab, DEI Interactive Systems Group, Department of Computer Science and Engineering, Universidad Carlos III de Madrid, Spain
- UCL Interaction Centre (UCLIC), University College London, London, United Kingdom
| | - Peter E. Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| | - Ophelia Deroy
- Munich Centre for Neuroscience, Ludwig Maximilian University, Munich, Germany
- Faculty of Philosophy, Ludwig Maximilian University, Munich, Germany
- Institute of Philosophy, School of Advanced Study, University of London, London, United Kingdom
| |
Collapse
|
4
|
Gibbs HJ, Czepiel A, Egermann H. Physiological synchrony and shared flow state in Javanese gamelan: positively associated while improvising, but not for traditional performance. Front Psychol 2023; 14:1214505. [PMID: 37663327 PMCID: PMC10469686 DOI: 10.3389/fpsyg.2023.1214505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 08/02/2023] [Indexed: 09/05/2023] Open
Abstract
The experience of shared flow refers to the optimal balance between challenge and ability for a given task, resulting from interpersonal action in a group situation. The performance of Javanese gamelan is an ideal setting to investigate shared flow, due to the requirement that all performers on varying instrumental parts work harmoniously, allowing for shared flow and its native equivalent, ngeli. To minimise the disruption of flow, while still measuring it continuously, one way to assess a person's state is by measuring physiological responses of the sympathetic (i.e., fight-or-flight) system, namely heart rate and skin conductance. Flow has been related to physiological signatures, and shared actions in music-making have been related to synchronised physiology. However, to our knowledge, no study yet has directly investigated the links between shared physiology and shared flow. Therefore, this study aimed to assess the associations between flow states, physiological synchrony, and Javanese gamelan playing. Subsequently, we tested for differences between advanced and beginner groups playing traditional gamelan pieces and improvising. Firstly, a factor analysis revealed a two-factor solution of Awareness and Absorption for self-reported shared flow. Next, using inter-subject correlation to assess synchrony and circular shuffling to infer significance, we found a greater proportion of significance in traditional playing compared to improvised playing for the experienced group, and the opposite for the beginner group. Lastly, linear mixed models revealed largely positive associations between synchronised physiology and shared flow during improvised playing, and negative associations during traditional playing, regardless of experience levels. This study demonstrates methodological possibilities for the quantitative study of shared flow in music-making contexts, and potential differences in shared flow experience in improvised and traditional, or prescribed, playing.
Collapse
Affiliation(s)
- Hannah Jennet Gibbs
- York Music Psychology Group, Music, Science and Technology Research Cluster, School of Arts and Creative Technologies, University of York, York, United Kingdom
| | - Anna Czepiel
- Department of Music, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
| | - Hauke Egermann
- Institute for Music and Musicology, TU Dortmund University, Dortmund, Germany
| |
Collapse
|
5
|
Izen SC, Cassano-Coleman RY, Piazza EA. Music as a window into real-world communication. Front Psychol 2023; 14:1012839. [PMID: 37496799 PMCID: PMC10368476 DOI: 10.3389/fpsyg.2023.1012839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Accepted: 06/06/2023] [Indexed: 07/28/2023] Open
Abstract
Communication has been studied extensively in the context of speech and language. While speech is tremendously effective at transferring ideas between people, music is another communicative mode that has a unique power to bring people together and transmit a rich tapestry of emotions, through joint music-making and listening in a variety of everyday contexts. Research has begun to examine the behavioral and neural correlates of the joint action required for successful musical interactions, but it has yet to fully account for the rich, dynamic, multimodal nature of musical communication. We review the current literature in this area and propose that naturalistic musical paradigms will open up new ways to study communication more broadly.
Collapse
|
6
|
Bolt NK, Loehr JD. The auditory P2 differentiates self- from partner-produced sounds during joint action: Contributions of self-specific attenuation and temporal orienting of attention. Neuropsychologia 2023; 182:108526. [PMID: 36870472 DOI: 10.1016/j.neuropsychologia.2023.108526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Revised: 02/03/2023] [Accepted: 02/27/2023] [Indexed: 03/06/2023]
Abstract
Sensory attenuation of the auditory P2 event-related potential (ERP) has been shown to differentiate the sensory consequences of one's own from others' action in joint action contexts. However, recent evidence suggests that when people coordinate joint actions over time, temporal orienting of attention might simultaneously contribute to enhancing the auditory P2. The current study employed a joint tapping task in which partners produced tone sequences together to examine whether temporal orienting influences auditory ERP amplitudes during the time window of self-other differentiation. Our findings demonstrate that the combined requirements of coordinating with a partner toward a joint goal and immediately adjusting to the partner's tone timing enhance P2 amplitudes elicited by the partner's tone onsets. Furthermore, our findings replicate prior evidence for self-specific sensory attenuation of the auditory P2 in joint action, and additionally demonstrate that it occurs regardless of the coordination requirements between partners. Together, these findings provide evidence that temporal orienting and sensory attenuation both modulate the auditory P2 during joint action and suggest that both processes play a role in facilitating precise interpersonal coordination between partners.
Collapse
Affiliation(s)
- Nicole K Bolt
- Department of Psychology and Health Studies, University of Saskatchewan, 9 Campus Drive, Saskatoon, Saskatchewan, S7N 5A5, Canada.
| | - Janeen D Loehr
- Department of Psychology and Health Studies, University of Saskatchewan, 9 Campus Drive, Saskatoon, Saskatchewan, S7N 5A5, Canada.
| |
Collapse
|
7
|
Kohler N, Novembre G, Gugnowska K, Keller PE, Villringer A, Sammler D. Cortico-cerebellar audio-motor regions coordinate self and other in musical joint action. Cereb Cortex 2023; 33:2804-2822. [PMID: 35771593 PMCID: PMC10016054 DOI: 10.1093/cercor/bhac243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 05/19/2022] [Accepted: 05/20/2022] [Indexed: 11/14/2022] Open
Abstract
Joint music performance requires flexible sensorimotor coordination between self and other. Cognitive and sensory parameters of joint action-such as shared knowledge or temporal (a)synchrony-influence this coordination by shifting the balance between self-other segregation and integration. To investigate the neural bases of these parameters and their interaction during joint action, we asked pianists to play on an MR-compatible piano, in duet with a partner outside of the scanner room. Motor knowledge of the partner's musical part and the temporal compatibility of the partner's action feedback were manipulated. First, we found stronger activity and functional connectivity within cortico-cerebellar audio-motor networks when pianists had practiced their partner's part before. This indicates that they simulated and anticipated the auditory feedback of the partner by virtue of an internal model. Second, we observed stronger cerebellar activity and reduced behavioral adaptation when pianists encountered subtle asynchronies between these model-based anticipations and the perceived sensory outcome of (familiar) partner actions, indicating a shift towards self-other segregation. These combined findings demonstrate that cortico-cerebellar audio-motor networks link motor knowledge and other-produced sounds depending on cognitive and sensory factors of the joint performance, and play a crucial role in balancing self-other integration and segregation.
Collapse
Affiliation(s)
- Natalie Kohler
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103, Leipzig, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt am Main, Germany
| | - Giacomo Novembre
- Neuroscience of Perception and Action Laboratory, Italian Institute of Technology, Viale Regina Elena 291, 00161 Rome, Italy
| | - Katarzyna Gugnowska
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103, Leipzig, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt am Main, Germany
| | - Peter E Keller
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University, Universitetsbyen 3, 8000 Aarhus C, Denmark
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Locked Bag 1797, Penrith NSW 2751, Australia
| | - Arno Villringer
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103, Leipzig, Germany
| | - Daniela Sammler
- Corresponding author: Daniela Sammler, MPI for Empirical Aesthetics, Grüneburgweg 14, 60322 Frankfurt/M., Germany.
| |
Collapse
|
8
|
Harry BB, Margulies DS, Falkiewicz M, Keller PE. Brain networks for temporal adaptation, anticipation, and sensory-motor integration in rhythmic human behavior. Neuropsychologia 2023; 183:108524. [PMID: 36868500 DOI: 10.1016/j.neuropsychologia.2023.108524] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Revised: 01/21/2023] [Accepted: 02/22/2023] [Indexed: 03/05/2023]
Abstract
Human interaction often requires the precise yet flexible interpersonal coordination of rhythmic behavior, as in group music making. The present fMRI study investigates the functional brain networks that may facilitate such behavior by enabling temporal adaptation (error correction), prediction, and the monitoring and integration of information about 'self' and the external environment. Participants were required to synchronize finger taps with computer-controlled auditory sequences that were presented either at a globally steady tempo with local adaptations to the participants' tap timing (Virtual Partner task) or with gradual tempo accelerations and decelerations but without adaptation (Tempo Change task). Connectome-based predictive modelling was used to examine patterns of brain functional connectivity related to individual differences in behavioral performance and parameter estimates from the adaptation and anticipation model (ADAM) of sensorimotor synchronization for these two tasks under conditions of varying cognitive load. Results revealed distinct but overlapping brain networks associated with ADAM-derived estimates of temporal adaptation, anticipation, and the integration of self-controlled and externally controlled processes across task conditions. The partial overlap between ADAM networks suggests common hub regions that modulate functional connectivity within and between the brain's resting-state networks and additional sensory-motor regions and subcortical structures in a manner reflecting coordination skill. Such network reconfiguration might facilitate sensorimotor synchronization by enabling shifts in focus on internal and external information, and, in social contexts requiring interpersonal coordination, variations in the degree of simultaneous integration and segregation of these information sources in internal models that support self, other, and joint action planning and prediction.
Collapse
Affiliation(s)
- Bronson B Harry
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia.
| | - Daniel S Margulies
- Integrative Neuroscience and Cognition Center, Centre National de la Recherche Scientifique (CNRS) and Université de Paris, Paris, France; Max Planck Research Group for Neuroanatomy and Connectivity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Marcel Falkiewicz
- Max Planck Research Group for Neuroanatomy and Connectivity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia; Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark.
| |
Collapse
|
9
|
Miss F, Adriaense J, Burkart J. Towards integrating joint action research: Developmental and evolutionary perspectives on co-representation. Neurosci Biobehav Rev 2022; 143:104924. [DOI: 10.1016/j.neubiorev.2022.104924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 10/11/2022] [Accepted: 10/20/2022] [Indexed: 11/23/2022]
|