1
|
Sabharwal SR, Breaden M, Volpe G, Camurri A, Keller PE. Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos. PLoS One 2024; 19:e0300663. [PMID: 38568939 PMCID: PMC10990194 DOI: 10.1371/journal.pone.0300663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 03/01/2024] [Indexed: 04/05/2024] Open
Abstract
Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.
Collapse
Affiliation(s)
| | - Matthew Breaden
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
| | | | | | - Peter E. Keller
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus, Aarhus, Aalborg, Denmark
| |
Collapse
|
2
|
Zhang K, Tong X, Yang S, Hu Y, Zhang Q, Bai X. Space-time mapping relationships in sensorimotor communication during asymmetric joint action. PeerJ 2024; 12:e16764. [PMID: 38225929 PMCID: PMC10789189 DOI: 10.7717/peerj.16764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 12/14/2023] [Indexed: 01/17/2024] Open
Abstract
Background Sensorimotor communication is frequently observed in complex joint actions and social interactions. However, it remains challenging to explore the cognitive foundations behind sensorimotor communication. Methods The present study extends previous research by introducing a single-person baseline condition and formulates two distinct categories of asymmetric joint action tasks: distance tasks and orientation tasks. This research investigates the action performance of 65 participants under various experimental conditions utilizing a 2 (cooperative intention: Coop, No-coop) × 2 (task characteristic: distance, orientation) × 4 (target: T1, T2, T3, T4) repeated-measures experimental design to investigate the cognitive mechanisms underlying sensorimotor communication between individuals. Results The results showed that (1) target key dwell time, motion time, total motion time, and maximum motion height in the Coop condition are more than in the No-coop condition. (2) In the distance task without cooperative intention, the dwell time of T4 is smaller than T1, T2, T3, and its variability of T1, T2, T3, and T4 were no different. In the distance task with cooperative intention, the dwell time and its variability of T1, T2, T3, and T4 displayed an increasing trend. (3) In the orientation task without cooperative intention, the dwell time of T1 is smaller than T2, T3, T4, and variability of the target keys T1, T2, T3, and T4 had no difference. In the orientation task with cooperative intention, the dwell time and variability of the target keys T1, T2, T3, and T4 had increasing trends. Conclusions Those findings underscore the importance of cooperative intention for sensorimotor communication. In the distance task with cooperative intention, message senders establish a mapping relationship characterized by "near-small, far-large" between the task distance and the individual's action characteristics through sensorimotor experience. In the orientation task with cooperative intention, message senders combined sensorimotor experience and verbal metaphors to establish a mapping relationship between task orientation and action characteristics, following the sequence of "left-up, right-up, left-down, right-down" to transmit the message to others.
Collapse
Affiliation(s)
- Ke Zhang
- Department of Psychology, Tianjin Normal University, Tianjin, China
| | - Xin Tong
- Department of Psychology, Tianjin Normal University, Tianjin, China
| | - Shaofeng Yang
- Department of Psychology, Tianjin Normal University, Tianjin, China
- Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, China
- School of Psychology, Inner Mongolia Normal University, Hohhot, China
| | - Ying Hu
- Department of Psychology, Tianjin Normal University, Tianjin, China
- Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, China
| | - Qihan Zhang
- Department of Psychology, Tianjin Normal University, Tianjin, China
- Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, China
| | - Xuejun Bai
- Department of Psychology, Tianjin Normal University, Tianjin, China
- Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, China
| |
Collapse
|
3
|
D'Amario S, Ternström S, Goebl W, Bishop L. Body motion of choral singers. Front Psychol 2023; 14:1220904. [PMID: 38187406 PMCID: PMC10771835 DOI: 10.3389/fpsyg.2023.1220904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Accepted: 11/24/2023] [Indexed: 01/09/2024] Open
Abstract
Recent investigations on music performances have shown the relevance of singers' body motion for pedagogical as well as performance purposes. However, little is known about how the perception of voice-matching or task complexity affects choristers' body motion during ensemble singing. This study focussed on the body motion of choral singers who perform in duo along with a pre-recorded tune presented over a loudspeaker. Specifically, we examined the effects of the perception of voice-matching, operationalized in terms of sound spectral envelope, and task complexity on choristers' body motion. Fifteen singers with advanced choral experience first manipulated the spectral components of a pre-recorded short tune composed for the study, by choosing the settings they felt most and least together with. Then, they performed the tune in unison (i.e., singing the same melody simultaneously) and in canon (i.e., singing the same melody but at a temporal delay) with the chosen filter settings. Motion data of the choristers' upper body and audio of the repeated performances were collected and analyzed. Results show that the settings perceived as least together relate to extreme differences between the spectral components of the sound. The singers' wrists and torso motion was more periodic, their upper body posture was more open, and their bodies were more distant from the music stand when singing in unison than in canon. These findings suggest that unison singing promotes an expressive-periodic motion of the upper body.
Collapse
Affiliation(s)
- Sara D'Amario
- Department of Music Acoustics, mdw – University of Music and Performing Arts Vienna, Vienna, Austria
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- Department of Musicology, University of Oslo, Oslo, Norway
| | - Sten Ternström
- Division of Speech, Music, and Hearing, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Werner Goebl
- Department of Music Acoustics, mdw – University of Music and Performing Arts Vienna, Vienna, Austria
| | - Laura Bishop
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- Department of Musicology, University of Oslo, Oslo, Norway
| |
Collapse
|
4
|
Nazzaro G, Emanuele M, Laroche J, Esposto C, Fadiga L, D'Ausilio A, Tomassini A. The microstructure of intra- and interpersonal coordination. Proc Biol Sci 2023; 290:20231576. [PMID: 37964525 PMCID: PMC10646454 DOI: 10.1098/rspb.2023.1576] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 10/23/2023] [Indexed: 11/16/2023] Open
Abstract
Movements are naturally composed of submovements, i.e. recurrent speed pulses (2-3 Hz), possibly reflecting intermittent feedback-based motor adjustments. In visuomotor (unimanual) synchronization tasks, partners alternate submovements over time, indicating mutual coregulation. However, it is unclear whether submovement coordination is organized differently between and within individuals. Indeed, different types of information may be variably exploited for intrapersonal and interpersonal coordination. Participants performed a series of bimanual tasks alone or in pairs, with or without visual feedback (solo task only). We analysed the relative timing of submovements between their own hands or between their own hands and those of their partner. Distinct coordinative structures emerged at the submovement level depending on the relevance of visual feedback. Specifically, the relative timing of submovements (between partners/effectors) shifts from alternation to simultaneity and a mixture of both when coordination is achieved using vision (interpersonal), proprioception/efference-copy only (intrapersonal, without vision) or all information sources (intrapersonal, with vision), respectively. These results suggest that submovement coordination represents a behavioural proxy for the adaptive weighting of different sources of information within action-perception loops. In sum, the microstructure of movement reveals common principles governing the dynamics of sensorimotor control to achieve both intra- and interpersonal coordination.
Collapse
Affiliation(s)
- Giovanni Nazzaro
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Marco Emanuele
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Julien Laroche
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Chiara Esposto
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Luciano Fadiga
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alessandro D'Ausilio
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alice Tomassini
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| |
Collapse
|
5
|
Tschacher W, Greenwood S, Ramakrishnan S, Tröndle M, Wald-Fuhrmann M, Seibert C, Weining C, Meier D. Audience synchronies in live concerts illustrate the embodiment of music experience. Sci Rep 2023; 13:14843. [PMID: 37798262 PMCID: PMC10556000 DOI: 10.1038/s41598-023-41960-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 09/04/2023] [Indexed: 10/07/2023] Open
Abstract
A study of 132 audience members of three classical public concerts (all three staged the same chamber music pieces by Ludwig van Beethoven, Brett Dean, and Johannes Brahms) had the goal of analyzing the physiological and motor responses of audiences. It was assumed that the music would induce synchronous physiology and movement in listeners (induction synchrony). In addition to hypothesizing that such synchronies would be present, we expected that they were linked to participants' aesthetic experiences, their affect and personality traits, which were assessed by questionnaires before and after the concerts. Clear evidence was found of physiological synchrony (heart rate, respiration rate, skin conductance response) as well as movement synchrony of the audiences, whereas breathing behavior was not synchronized. Thus the audiences of the three concerts resonated with the music, their music perception was embodied. There were links between the bodily synchrony and aesthetic experiences: synchrony, especially heart-rate synchrony, was higher when listeners felt moved emotionally and inspired by a piece, and were immersed in the music. Personality traits were also associated with the individual contributions to induction synchrony.
Collapse
Affiliation(s)
- Wolfgang Tschacher
- University Hospital of Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland.
| | | | | | | | | | | | | | - Deborah Meier
- University Hospital of Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland
| |
Collapse
|