1
|
Abalde SF, Rigby A, Keller PE, Novembre G. A Framework for Joint Music Making: Behavioral Findings, Neural Processes, and Computational Models. Neurosci Biobehav Rev 2024:105816. [PMID: 39032841 DOI: 10.1016/j.neubiorev.2024.105816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Revised: 07/15/2024] [Accepted: 07/16/2024] [Indexed: 07/23/2024]
Abstract
Across different epochs and societies, humans occasionally gather to jointly make music. This universal form of collective behavior is as fascinating as it is fragmentedly understood. As the interest in joint music making (JMM) rapidly grows, we review the state-of-the-art of this emerging science, blending behavioral, neural, and computational contributions. We present a conceptual framework synthesizing research on JMM within four components. The framework is centered upon interpersonal coordination, a crucial requirement for JMM. The other components imply the influence of individuals' (past) experience, (current) social factors, and (future) goals on real-time coordination. Our aim is to promote the development of JMM research by organizing existing work, inspiring new questions, and fostering accessibility for researchers belonging to other research communities.
Collapse
Affiliation(s)
- Sara F Abalde
- Neuroscience of Perception and Action Lab, Italian Institute of Technology, Rome, Italy; The Open University Affiliated Research Centre at the Istituto Italiano di Tecnologia, Italy.
| | - Alison Rigby
- Neurosciences Graduate Program, University of California, San Diego, US
| | - Peter E Keller
- Center for Music in the Brain, Aarhus University, Denmark; Department of Clinical Medicine, Center for Music in the Brain, Department of Clinical Medicine, Aarhus University, Denmark; The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Australia
| | - Giacomo Novembre
- Neuroscience of Perception and Action Lab, Italian Institute of Technology, Rome, Italy
| |
Collapse
|
2
|
Kang K, Orlandi S, Lorenzen N, Chau T, Thaut MH. Does music induce interbrain synchronization between a non-speaking youth with cerebral palsy (CP), a parent, and a neurologic music therapist? A brief report. Dev Neurorehabil 2022; 25:426-432. [PMID: 35341463 DOI: 10.1080/17518423.2022.2051628] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Shared emotional experiences during musical activities among musicians can be coupled with brainwave synchronization. For non-speaking individuals with CP, verbal communication may be limited in expressing mutual empathy. Therefore, this case study explored interbrain synchronization among a non-speaking CP (female, 18 yrs), her parent, and a music therapist by measuring their brainwaves simultaneously during four music and four storytelling sessions. In only the youth-parent dyad, we observed a significantly higher level of interbrain synchronization during music rather than story-telling condition. However, in both the youth-parent and youth-therapist dyad, regardless of condition type, significant interbrain synchronization emerged in frontal and temporal lobes in the low-frequency bands, which are associated with socio-emotional responses. Although interbrain synchronization may have been induced by multiple factors (e.g., external stimuli, shared empathetic experiences, and internal physiological rhythms), the music activity setting deserves further study as a potential facilitator of neurophysiological synchrony between youth with CP and caregivers/healthcare providers.
Collapse
Affiliation(s)
- Kyurim Kang
- Music and Health Science Research Collaboratory (MaHRC), Faculty of Music, University of Toronto, Toronto, ON, Canada.,Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada.,Center for Music and Medicine, Department of Neurology, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Silvia Orlandi
- Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada.,Department of Electrical, Electronic, and Information Engineering "Guglielmo Marconi"- DEI, University of Bologna, Bologna, Italy
| | - Nicole Lorenzen
- School of Engineering, University of Guelph, Guelph, ON, Canada
| | - Tom Chau
- Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada.,Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| | - Michael H Thaut
- Music and Health Science Research Collaboratory (MaHRC), Faculty of Music, University of Toronto, Toronto, ON, Canada.,Faculty of Medicine, Institute of Medical Science and Rehabilitation Research Institute, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
3
|
Kurihara Y, Takahashi T, Osu R. The relationship between stability of interpersonal coordination and inter-brain EEG synchronization during anti-phase tapping. Sci Rep 2022; 12:6164. [PMID: 35418655 PMCID: PMC9008014 DOI: 10.1038/s41598-022-10049-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Accepted: 03/31/2022] [Indexed: 11/09/2022] Open
Abstract
Inter-brain synchronization is enhanced when individuals perform rhythmic interpersonal coordination tasks, such as playing instruments in music ensembles. Experimentally, synchronization has been shown to correlate with the performance of joint tapping tasks. However, it is unclear whether inter-brain synchronization is related to the stability of interpersonal coordination represented as the standard deviation of relative phase (SDRP). In this study, we simultaneously recorded electroencephalograms of two paired individuals during anti-phase tapping in three interactive tapping conditions: slow (reference inter-tap interval [ITI]: 0.5 s), fast (reference ITI: 0.25 s), and free (preferred ITI), and pseudo tapping where each participant tapped according to the metronome sounds without interaction. We calculated the inter-brain synchronization between pairs of six regions of interest (ROI): frontal, central, left/right temporal, parietal, and occipital regions. During the fast tapping, the inter-brain synchronization significantly increased in multiple ROI pairs including temporoparietal junction in comparison to pseudo tapping. Synchronization between the central and left-temporal regions was positively correlated with SDRP in the theta in the fast condition. These results demonstrate that inter-brain synchronization occurs when task requirements are high and increases with the instability of the coordination.
Collapse
Affiliation(s)
- Yuto Kurihara
- Graduate School of Human Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, Japan
| | - Toru Takahashi
- Faculty of Human Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, Japan
| | - Rieko Osu
- Faculty of Human Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama, Japan.
| |
Collapse
|
4
|
It Takes Two: Interpersonal Neural Synchrony Is Increased after Musical Interaction. Brain Sci 2022; 12:brainsci12030409. [PMID: 35326366 PMCID: PMC8946180 DOI: 10.3390/brainsci12030409] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 03/11/2022] [Accepted: 03/13/2022] [Indexed: 02/05/2023] Open
Abstract
Music’s deeply interpersonal nature suggests that music-derived neuroplasticity relates to interpersonal temporal dynamics, or synchrony. Interpersonal neural synchrony (INS) has been found to correlate with increased behavioral synchrony during social interactions and may represent mechanisms that support them. As social interactions often do not have clearly delineated boundaries, and many start and stop intermittently, we hypothesize that a neural signature of INS may be detectable following an interaction. The present study aimed to investigate this hypothesis using a pre-post paradigm, measuring interbrain phase coherence before and after a cooperative dyadic musical interaction. Ten dyads underwent synchronous electroencephalographic (EEG) recording during silent, non-interactive periods before and after a musical interaction in the form of a cooperative tapping game. Significant post-interaction increases in delta band INS were found in the post-condition and were positively correlated with the duration of the preceding interaction. These findings suggest a mechanism by which social interaction may be efficiently continued after interruption and hold the potential for measuring neuroplastic adaption in longitudinal studies. These findings also support the idea that INS during social interaction represents active mechanisms for maintaining synchrony rather than mere parallel processing of stimuli and motor activity.
Collapse
|
5
|
Washburn A, Wright MJ, Chafe C, Fujioka T. Temporal Coordination in Piano Duet Networked Music Performance (NMP): Interactions Between Acoustic Transmission Latency and Musical Role Asymmetries. Front Psychol 2021; 12:707090. [PMID: 34630213 PMCID: PMC8500175 DOI: 10.3389/fpsyg.2021.707090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2021] [Accepted: 08/16/2021] [Indexed: 11/26/2022] Open
Abstract
Today’s audio, visual, and internet technologies allow people to interact despite physical distances, for casual conversation, group workouts, or musical performance. Musical ensemble performance is unique because interaction integrity critically depends on the timing between each performer’s actions and when their acoustic outcomes arrive. Acoustic transmission latency (ATL) between players is substantially longer for networked music performance (NMP) compared to traditional in-person spaces where musicians can easily adapt. Previous work has shown that longer ATLs slow the average tempo in ensemble performance, and that asymmetric co-actor roles and empathy-related traits affect coordination patterns in joint action. Thus, we are interested in how musicians collectively adapt to a given latency and how such adaptation patterns vary with their task-related and person-related asymmetries. Here, we examined how two pianists performed duets while hearing each other’s auditory outcomes with an ATL of 10, 20, or 40 ms. To test the hypotheses regarding task-related asymmetries, we designed duets such that pianists had: (1) a starting or joining role and (2) a similar or dissimilar musical part compared to their co-performer, with respect to pitch range and melodic contour. Results replicated previous clapping-duet findings showing that longer ATLs are associated with greater temporal asynchrony between partners and increased average tempo slowing. While co-performer asynchronies were not affected by performer role or part similarity, at the longer ATLs starting performers displayed slower tempos and smaller tempo variability than joining performers. This asymmetry of stability vs. flexibility between starters and joiners may sustain coordination, consistent with recent joint action findings. Our data also suggest that relative independence in musical parts may mitigate ATL-related challenges. Additionally, there may be a relationship between co-performer differences in empathy-related personality traits such as locus of control and coordination during performance under the influence of ATL. Incorporating the emergent coordinative dynamics between performers could help further innovation of music technologies and composition techniques for NMP.
Collapse
Affiliation(s)
- Auriel Washburn
- Center for Computer Research in Music and Acoustics, Department of Music, Stanford University, Stanford, CA, United States
| | - Matthew J Wright
- Center for Computer Research in Music and Acoustics, Department of Music, Stanford University, Stanford, CA, United States
| | - Chris Chafe
- Center for Computer Research in Music and Acoustics, Department of Music, Stanford University, Stanford, CA, United States.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, Untied States
| | - Takako Fujioka
- Center for Computer Research in Music and Acoustics, Department of Music, Stanford University, Stanford, CA, United States.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, Untied States
| |
Collapse
|
6
|
Zamm A, Debener S, Konvalinka I, Sebanz N, Knoblich G. The sound of silence: an EEG study of how musicians time pauses in individual and joint music performance. Soc Cogn Affect Neurosci 2021; 16:31-42. [PMID: 32734305 PMCID: PMC7812619 DOI: 10.1093/scan/nsaa096] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Revised: 06/16/2020] [Accepted: 07/11/2020] [Indexed: 11/13/2022] Open
Abstract
Pauses are an integral feature of social interaction. Conversation partners often pause between conversational turns, and musical co-performers often pause between musical phrases. How do humans coordinate the duration of pauses to ensure seamless interaction? A total of 40 trained pianists performed a simple melody containing fermatas (notated expressive pauses of unspecified duration) first alone (Solo) and then with a partner (Duet) while electroencephalography (EEG) was recorded. As predicted, Duet partners' tone onset synchrony was reduced for tones following pauses. Pauses were shorter in Duet relative to Solo performance, and synchrony of partners' Duet tone onsets was enhanced for tones following shorter pauses. EEG analysis revealed classic signatures of action preparation during pauses, namely decreases in the power of cortical beta oscillations (13-30 Hz, event-related desynchronization ERD). Beta ERD did not differ between pauses in Solo and Duet performance, but was enhanced for shorter relative to longer pauses, suggesting that reduced pause durations in Duet performance facilitated a neural state of enhanced action readiness. Together these findings provide novel insight into behavioural strategies by which musical partners resolve coordination challenges posed by expressive silence, and capture a clear neural signature of action planning during time-varying silences in natural music performance.
Collapse
Affiliation(s)
- Anna Zamm
- Department of Cognitive Science, Central European University, Budapest 1051, Hungar
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg 26129, Germany
| | - Ivana Konvalinka
- Section for Cognitive Systems, DTU Compute, Technical University of Denmark, Lyngby 2800, Denmark
| | - Natalie Sebanz
- Department of Cognitive Science, Central European University, Budapest 1051, Hungar
| | - Günther Knoblich
- Department of Cognitive Science, Central European University, Budapest 1051, Hungar
| |
Collapse
|