1
|
Sabharwal SR, Breaden M, Volpe G, Camurri A, Keller PE. Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos. PLoS One 2024; 19:e0300663. [PMID: 38568939 PMCID: PMC10990194 DOI: 10.1371/journal.pone.0300663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 03/01/2024] [Indexed: 04/05/2024] Open
Abstract
Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.
Collapse
Affiliation(s)
| | - Matthew Breaden
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
| | | | | | - Peter E. Keller
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus, Aarhus, Aalborg, Denmark
| |
Collapse
|
2
|
Demos AP, Palmer C. Social and nonlinear dynamics unite: musical group synchrony. Trends Cogn Sci 2023; 27:1008-1018. [PMID: 37277276 DOI: 10.1016/j.tics.2023.05.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 05/07/2023] [Accepted: 05/09/2023] [Indexed: 06/07/2023]
Abstract
Synchronization, the human tendency to align behaviors in time with others, is necessary for many survival skills. The ability to synchronize actions with rhythmic (predictable) sound patterns is especially well developed in music making. Recent models of synchrony in musical ensembles rely on pairwise comparisons between group members. This pairwise approach to synchrony has hampered theory development, given current findings from social dynamics indicating shifts in members' influence within larger groups. We draw on social theory and nonlinear dynamics to argue that emergent properties and novel roles arise in musical group synchrony that differ from individual or pairwise behaviors. This transformational shift in defining synchrony sheds light on successful outcomes as well as on disruptions that cause negative behavioral outcomes.
Collapse
Affiliation(s)
- Alexander P Demos
- Department of Psychology, University of Illinois Chicago, 1007 W Harrison St., Chicago, IL 60607, USA.
| | - Caroline Palmer
- Department of Psychology, McGill University, 1205 Dr Penfield Ave., Montreal, QC H3A 1B1, Canada.
| |
Collapse
|
3
|
Wespi R, Birrenbach T, Schauber SK, Manser T, Sauter TC, Kämmer JE. Exploring objective measures for assessing team performance in healthcare: an interview study. Front Psychol 2023; 14:1232628. [PMID: 37941756 PMCID: PMC10628530 DOI: 10.3389/fpsyg.2023.1232628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 10/04/2023] [Indexed: 11/10/2023] Open
Abstract
Introduction Effective teamwork plays a critical role in achieving high-performance outcomes in healthcare. Consequently, conducting a comprehensive assessment of team performance is essential for providing meaningful feedback during team trainings and enabling comparisons in scientific studies. However, traditional methods like self-reports or behavior observations have limitations such as susceptibility to bias or being resource consuming. To overcome these limitations and gain a more comprehensive understanding of team processes and performance, the assessment of objective measures, such as physiological parameters, can be valuable. These objective measures can complement traditional methods and provide a more holistic view of team performance. The aim of this study was to explore the potential of the use of objective measures for evaluating team performance for research and training purposes. For this, experts in the field of research and medical simulation training were interviewed to gather their opinions, ideas, and concerns regarding this novel approach. Methods A total of 34 medical and research experts participated in this exploratory qualitative study, engaging in semi-structured interviews. During the interview, experts were asked for (a) their opinion on measuring team performance with objective measures, (b) their ideas concerning potential objective measures suitable for measuring team performance of healthcare teams, and (c) their concerns regarding the use of objective measures for evaluating team performance. During data analysis responses were categorized per question. Results The findings from the 34 interviews revealed a predominantly positive reception of the idea of utilizing objective measures for evaluating team performance. However, the experts reported limited experience in actively incorporating objective measures into their training and research. Nevertheless, they identified various potential objective measures, including acoustical, visual, physiological, and endocrinological measures and a time layer. Concerns were raised regarding feasibility, complexity, cost, and privacy issues associated with the use of objective measures. Discussion The study highlights the opportunities and challenges associated with employing objective measures to assess healthcare team performance. It particularly emphasizes the concerns expressed by medical simulation experts and team researchers, providing valuable insights for developers, trainers, researchers, and healthcare professionals involved in the design, planning or utilization of objective measures in team training or research.
Collapse
Affiliation(s)
- Rafael Wespi
- Department of Emergency Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
- Graduate School for Health Sciences, University of Bern, Bern, Switzerland
| | - Tanja Birrenbach
- Department of Emergency Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Stefan K. Schauber
- Center for Educational Measurement (CEMO) and Unit for Health Sciences Education, University of Oslo, Oslo, Norway
| | - Tanja Manser
- FHNW School of Applied Psychology, University of Applied Sciences and Arts, Northwestern Switzerland, Olten, Switzerland
- Division of Anesthesiology and Intensive Care, Department of Clinical Sciences, Intervention and Technology, Karolinska Institutet, Huddinge, Sweden
| | - Thomas C. Sauter
- Department of Emergency Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Juliane E. Kämmer
- Department of Emergency Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
- Department of Social and Communication Psychology, University of Göttingen, Göttingen, Germany
| |
Collapse
|
4
|
Yozevitch R, Dahan A, Seada T, Appel D, Gvirts H. Classifying interpersonal synchronization states using a data-driven approach: implications for social interaction understanding. Sci Rep 2023; 13:11150. [PMID: 37429957 DOI: 10.1038/s41598-023-37316-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Accepted: 06/20/2023] [Indexed: 07/12/2023] Open
Abstract
This study presents a data-driven approach to identifying interpersonal motor synchrony states by analyzing hand movements captured from a 3D depth camera. Utilizing a single frame from the experiment, an XGBoost machine learning model was employed to differentiate between spontaneous and intentional synchrony modes with nearly [Formula: see text] accuracy. Our findings demonstrate a consistent pattern across subjects, revealing that movement velocity tends to be slower in synchrony modes. These insights support the notion that the relationship between velocity and synchrony is influenced by the cognitive load required for the task, with slower movements leading to higher synchrony in tasks demanding higher cognitive load. This work not only contributes to the limited literature on algorithms for identifying interpersonal synchrony but also has potential implications for developing new metrics to assess real-time human social interactions, understanding social interaction, and diagnosing and developing treatment strategies for social deficits associated with conditions such as Autism Spectrum Disorder.
Collapse
Affiliation(s)
- Roi Yozevitch
- Department of Computer Science, Ariel University, Ariel, 40700, Israel.
| | - Anat Dahan
- Department of Software Engineering, Braude College of Engineering, Karmiel, 216100, Israel
| | - Talia Seada
- Department of Computer Science, Ariel University, Ariel, 40700, Israel
| | - Daniel Appel
- Department of Computer Science, Ariel University, Ariel, 40700, Israel
| | - Hila Gvirts
- Department of Behavioral Sciences, Ariel University, Ariel, 40700, Israel
| |
Collapse
|
5
|
Bieńkiewicz MMN, Janaqi S, Jean P, Bardy BG. Impact of emotion-laden acoustic stimuli on group synchronisation performance. Sci Rep 2023; 13:7094. [PMID: 37127737 PMCID: PMC10150690 DOI: 10.1038/s41598-023-34406-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 04/28/2023] [Indexed: 05/03/2023] Open
Abstract
The ability to synchronise with other people is a core socio-motor competence acquired during human development. In this study we aimed to understand the impact of individual emotional arousal on joint action performance. We asked 15 mixed-gender groups (of 4 individuals each) to participate in a digital, four-way movement synchronisation task. Participants shared the same physical space, but could not see each other during the task. In each trial run, every participant was induced with an emotion-laden acoustic stimulus (pre-selected from the second version of International Affective Digitized Sounds). Our data demonstrated that the human ability to synchronise is overall robust to fluctuations in individual emotional arousal, but performance varies in quality and movement speed as a result of valence of emotional induction (both on the individual and group level). We found that three negative inductions per group per trial led to a drop in overall group synchronisation performance (measured as the median and standard deviation of Kuramoto's order parameter-an index measuring the strength of synchrony between oscillators, in this study, players) in the 15 sec post-induction. We report that negatively-valenced inductions led to slower oscillations, whilst positive induction afforded faster oscillations. On the individual level of synchronisation performance we found an effect of empathetic disposition (higher competence linked to better performance during the negative induction condition) and of participant's sex (males displayed better synchronisation performance with others). We believe this work is a blueprint for exploring the frontiers of inextricably bound worlds of emotion and joint action, be it physical or digital.
Collapse
Affiliation(s)
- Marta M N Bieńkiewicz
- EuroMov Digital Health in Motion, Univ. Montpellier IMT Mines Ales, Hérault, Montpellier, 34090, France.
| | - Stefan Janaqi
- EuroMov Digital Health in Motion, Univ. Montpellier IMT Mines Ales, Hérault, Montpellier, 34090, France
| | - Pierre Jean
- EuroMov Digital Health in Motion, Univ. Montpellier IMT Mines Ales, Hérault, Montpellier, 34090, France
| | - Benoît G Bardy
- EuroMov Digital Health in Motion, Univ. Montpellier IMT Mines Ales, Hérault, Montpellier, 34090, France
| |
Collapse
|
6
|
Playing the mirror game in virtual reality with an autonomous character. Sci Rep 2022; 12:21329. [PMID: 36494394 PMCID: PMC9734752 DOI: 10.1038/s41598-022-25197-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Accepted: 11/25/2022] [Indexed: 12/13/2022] Open
Abstract
Perceptual-motor synchronisation in human groups is crucial in many activities, from musical ensembles to sports teams. To this aim, the mirror game, where partners are asked to imitate each other's movements or gestures, is one of the best available experimental paradigms to study how humans engage in joint tasks and how they tend to synchronise their behaviour. However, to date, virtual reality characters do not engage in motor synchronisation with human users. In this work, we explored to what extent an autonomous virtual character and a human that play the mirror game in virtual reality can synchronise their behaviour. We created a full-body version of the mirror game with an autonomous virtual character, whose movements were driven by a model based on coupled oscillators. Participants engaged in a joint imitation task with a virtual player animated with one of three options: a model that included a small coupling, a model with no coupling, or another human. Behavioural measures and subjective reports suggest that participants were unable to distinguish the condition of small coupling from the engagement with an avatar driven by another human participant.
Collapse
|
7
|
Tomassini A, Laroche J, Emanuele M, Nazzaro G, Petrone N, Fadiga L, D'Ausilio A. Interpersonal synchronization of movement intermittency. iScience 2022; 25:104096. [PMID: 35372806 PMCID: PMC8971945 DOI: 10.1016/j.isci.2022.104096] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Revised: 02/02/2022] [Accepted: 03/14/2022] [Indexed: 11/12/2022] Open
Abstract
Most animal species group together and coordinate their behavior in quite sophisticated manners for mating, hunting, or defense purposes. In humans, coordination at a macroscopic level (the pacing of movements) is evident both in daily life (e.g., walking) and skilled (e.g., music and dance) behaviors. By examining the fine structure of movement, we here show that interpersonal coordination is established also at a microscopic – submovement – level. Natural movements appear as marked by recurrent (2–3 Hz) speed breaks, i.e., submovements, that are traditionally considered the result of intermittency in (visuo)motor feedback-based control. In a series of interpersonal coordination tasks, we show that submovements produced by interacting partners are not independent but alternate tightly over time, reflecting online mutual adaptation. These findings unveil a potential core mechanism for behavioral coordination that is based on between-persons synchronization of the intrinsic dynamics of action-perception cycles. Movements show intermittent speed pulses occurring at 2–3 Hz, called submovements Submovements are actively coordinated in counter-phase by interacting partners Submovements coordination depends on spatial alignment but not movement congruency Behavioral coordination occurs both at macro- and microscopic movement scales
Collapse
Affiliation(s)
- Alice Tomassini
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Julien Laroche
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Marco Emanuele
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy.,Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Giovanni Nazzaro
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy.,Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Nicola Petrone
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Luciano Fadiga
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy.,Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alessandro D'Ausilio
- Center for Translational Neurophysiology of Speech and Communication (CTNSC), Italian Institute of Technology (IIT), Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy.,Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| |
Collapse
|
8
|
Calabrese C, Bardy BG, De Lellis P, di Bernardo M. Modeling Frequency Reduction in Human Groups Performing a Joint Oscillatory Task. Front Psychol 2022; 12:753758. [PMID: 35058838 PMCID: PMC8765722 DOI: 10.3389/fpsyg.2021.753758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Accepted: 12/07/2021] [Indexed: 11/13/2022] Open
Abstract
In human groups performing oscillatory tasks, it has been observed that the frequency of participants' oscillations reduces when compared to that acquired in solo. This experimental observation is not captured by the standard Kuramoto oscillators, often employed to model human synchronization. In this work, we aim at capturing this observed phenomenon by proposing three alternative modifications of the standard Kuramoto model that are based on three different biologically-relevant hypotheses underlying group synchronization. The three models are tuned, validated and compared against experiments on a group synchronization task, which is a multi-agent extension of the so-called mirror game.
Collapse
Affiliation(s)
- Carmela Calabrese
- Department of Electrical Engineering and Information Technology, University of Naples Federico II, Naples, Italy.,EuroMov Digital Health in Motion, University of Montpellier IMT Mines Ales, Montpellier, France
| | - Benoît G Bardy
- EuroMov Digital Health in Motion, University of Montpellier IMT Mines Ales, Montpellier, France
| | - Pietro De Lellis
- Department of Electrical Engineering and Information Technology, University of Naples Federico II, Naples, Italy
| | - Mario di Bernardo
- Department of Electrical Engineering and Information Technology, University of Naples Federico II, Naples, Italy
| |
Collapse
|