When they listen and when they watch: Pianists' use of nonverbal audio and visual cues during duet performance

Brain to brain musical interaction: A systematic review of neural synchrony in musical activities

The use of hyperscanning technology has revealed the neural mechanisms underlying multi-person interaction in musical activities. However, there is currently a lack of integration among various research findings. This systematic review aims to provide a comprehensive understanding of the social dynamics and brain synchronization in music activities through the analysis of 32 studies. The findings illustrate a strong correlation between inter-brain synchronization (IBS) and various musical activities, with the frontal, central, parietal, and temporal lobes as the primary regions involved. The application of hyperscanning not only advances theoretical research but also holds practical significance in enhancing the effectiveness of music-based interventions in therapy and education. The review also utilizes Predictive Coding Models (PCM) to provide a new perspective for interpreting neural synchronization in music activities. To address the limitations of current research, future studies could integrate multimodal data, adopt novel technologies, use non-invasive techniques, and explore additional research directions.

A framework for joint music making: Behavioral findings, neural processes, and computational models

Across different epochs and societies, humans occasionally gather to jointly make music. This universal form of collective behavior is as fascinating as it is fragmentedly understood. As the interest in joint music making (JMM) rapidly grows, we review the state-of-the-art of this emerging science, blending behavioral, neural, and computational contributions. We present a conceptual framework synthesizing research on JMM within four components. The framework is centered upon interpersonal coordination, a crucial requirement for JMM. The other components imply the influence of individuals' (past) experience, (current) social factors, and (future) goals on real-time coordination. Our aim is to promote the development of JMM research by organizing existing work, inspiring new questions, and fostering accessibility for researchers belonging to other research communities.

How and Why People Synchronize: An Integrated Perspective

Academic AbstractInterpersonal synchrony, the alignment of behavior and/or physiology during interactions, is a pervasive phenomenon observed in diverse social contexts. Here we synthesize across contexts and behaviors to classify the different forms and functions of synchrony. We provide a concise framework for classifying the manifold forms of synchrony along six dimensions: periodicity, discreteness, spatial similarity, directionality, leader-follower dynamics, and observability. We also distill the various proposed functions of interpersonal synchrony into four interconnected functions: reducing complexity and improving understanding, accomplishing joint tasks, strengthening social connection, and influencing partners' behavior. These functions derive from first principles, emerge from each other, and are accomplished by some forms of synchrony more than others. Effective synchrony flexibly adapts to social goals and more synchrony is not always better. Our synthesis offers a shared framework and language for the field, allowing for better cross-context and cross-behavior comparisons, generating new hypotheses, and highlighting future research directions.

Focus of attention in musical learning and music performance: a systematic review and discussion of focus instructions and outcome measures

The topic of attentional focus (focus of attention, FOA) in musical learning and performance has recently received increasing interest, as the growing number of empirical studies inspired by the established FOA paradigm in sports by Wulf and colleagues in 1998. The current systematical review aims at collecting, abstracting, and categorizing relevant data to show which kinds of FOA instructions were applied in experimental designs and what kinds of dependent variables were used to measure the effects of FOA instruction on musical performance. The three main inclusion criteria in the selection process were experimental design, detailed descriptions of FOA instructions, and outcome measures (OMs). A systematic search was conducted with a complex search term in four scientific databases in March 2023. For presenting and synthesizing results, we used data collection and an inductive-deductive data categorization. Fifteen studies with a total sample size of 401 participants were included out of 387 records initially identified. We collected 53 different FOA instruction citations from the 15 studies and classified them into 9 FOA subcategories, of which the most applied were bodily focus (21%), sound focus (15%), and visual focus (14%). Selected studies used 63 OMs that were abstracted to 10 different OM categories with expert ratings (27%) and acoustical analysis (22%) as the most applied dependent variables. Data categorization and abstraction of additional study information show multiple combinations of FOA instructions, OMs, participants' instruments and expertise, and musical tasks. Finally, studies show no consistent results of superiority of either external or internal or otherwise different FOA considering positive effects on musical performance. Limitations of the review lie in the small study sample, possible criticism of applied eligibility criteria, and subjectivity of data categorization. We propose a research agenda with a more exploratory approach that comprehensively and qualitatively examines the dimensions of musical goals to create a database that could provide a foundation for developing a music-specific FOA model.

Interperformer coordination in piano-singing duo performances: phrase structure and empathy impact

Musicians' body motion plays a fundamental role in ensemble playing, by supporting sound production, communication, and expressivity. This research investigates how Western classical musicians' head motion during ensemble performances relates to a piece's phrase structure and musicians' empathic perspective taking (EPT) profile. Twenty-four advanced piano and singing students took part in the study, and their EPT score was pre-assessed using the Interpersonal Reactivity Index. High and low EPT duos were formed, and musicians were paired with a co-performer from the same and the other EPT group. Musicians rehearsed Fauré's Automne and Schumann's Die Kartenlegerin, and performed the pieces one time before and three times after rehearsal. Motion capture data of the musicians' front head, audio, and MIDI recordings of the performances were collected and analysed. Similarity in musicians' head motion and tendency to lead/lag their co-performer were computed by extracting, respectively, power and phase difference of the cross-wavelet transforms of the velocity curves of each paired marker. Results demonstrate that the power of interperformer coordination corresponds to the piece's phrase levels and that singer's EPT can impact the leader-follower relationships between musicians, depending on piece and take number. In the Fauré piece, the higher the singer's EPT score, the higher the tendency for the singer to lead and pianist to follow in take 3, and the lower the tendency for the singer to lead and pianist to follow in take 2. These results contribute to a further understanding of the mechanisms underpinning social interactions, by revealing the complexity of the association between empathy and body motion in ensembles in promoting and diffusing leadership between musicians.

Follow the sound of my violin: Granger causality reflects information flow in sound

Recent research into how musicians coordinate their expressive timing, phrasing, articulation, dynamics, and other stylistic characteristics during performances has highlighted the role of predictive processes, as musicians must anticipate how their partners will play in order to be together. Several studies have used information flow techniques such as Granger causality to show that upcoming movements of a musician can be predicted from immediate past movements of fellow musicians. Although musicians must move to play their instruments, a major goal of music making is to create a joint interpretation through the sounds they produce. Yet, information flow techniques have not been applied previously to examine the role that fellow musicians' sound output plays in these predictive processes and whether this changes as they learn to play together. In the present experiment, we asked professional violinists to play along with recordings of two folk pieces, each eight times in succession, and compared the amplitude envelopes of their performances with those of the recordings using Granger causality to measure information flow and cross-correlation to measure similarity and synchronization. In line with our hypotheses, our measure of information flow was higher from the recordings to the performances than vice versa, and decreased as the violinists became more familiar with the recordings over trials. This decline in information flow is consistent with a gradual shift from relying on auditory cues to predict the recording to relying on an internally-based (learned) model built through repetition. There was also evidence that violinists became more synchronized with the recordings over trials. These results shed light on the planning and learning processes involved in the aligning of expressive intentions in group music performance and lay the groundwork for the application of Granger causality to investigate information flow through sound in more complex musical interactions.

Endogenous sources of interbrain synchrony in duetting pianists

When people interact with each other, their brains synchronize. However, it remains unclear whether interbrain synchrony (IBS) is functionally relevant for social interaction or stems from exposure of individual brains to identical sensorimotor information. To disentangle these views, the current dual-EEG study investigated amplitude-based IBS in pianists jointly performing duets containing a silent pause followed by a tempo change. First, we manipulated the similarity of the anticipated tempo change and measured IBS during the pause, hence, capturing the alignment of purely endogenous, temporal plans without sound or movement. Notably, right posterior gamma IBS was higher when partners planned similar tempi, it predicted whether partners' tempi matched after the pause, and it was modulated only in real, not in surrogate pairs. Second, we manipulated the familiarity with the partner's actions and measured IBS during joint performance with sound. Although sensorimotor information was similar across conditions, gamma IBS was higher when partners were unfamiliar with each other's part and had to attend more closely to the sound of the performance. These combined findings demonstrate that IBS is not merely an epiphenomenon of shared sensorimotor information but can also hinge on endogenous, cognitive processes crucial for behavioral synchrony and successful social interaction.

Rhythm in dyadic interactions

This review paper discusses rhythmic interactions and distinguishes them from non-rhythmic interactions. We report on communicative behaviours in social and sexual contexts, as found in dyads of humans, non-human primates, non-primate mammals, birds, anurans and insects. We discuss observed instances of rhythm in dyadic interactions, identify knowledge gaps and propose suggestions for future research. We find that most studies on rhythmicity in interactive signals mainly focus on one modality (acoustic or visual) and we suggest more work should be performed on multimodal signals. Although the social functions of interactive rhythms have been fairly well described, developmental research on rhythms used to regulate social interactions is still lacking. Future work should also focus on identifying the exact timing mechanisms involved. Rhythmic signalling behaviours are widespread and critical in regulating social interactions across taxa, but many questions remain unexplored. A multidisciplinary, comparative cross-species approach may help provide answers. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

The sound of silence: an EEG study of how musicians time pauses in individual and joint music performance

Pauses are an integral feature of social interaction. Conversation partners often pause between conversational turns, and musical co-performers often pause between musical phrases. How do humans coordinate the duration of pauses to ensure seamless interaction? A total of 40 trained pianists performed a simple melody containing fermatas (notated expressive pauses of unspecified duration) first alone (Solo) and then with a partner (Duet) while electroencephalography (EEG) was recorded. As predicted, Duet partners' tone onset synchrony was reduced for tones following pauses. Pauses were shorter in Duet relative to Solo performance, and synchrony of partners' Duet tone onsets was enhanced for tones following shorter pauses. EEG analysis revealed classic signatures of action preparation during pauses, namely decreases in the power of cortical beta oscillations (13-30 Hz, event-related desynchronization ERD). Beta ERD did not differ between pauses in Solo and Duet performance, but was enhanced for shorter relative to longer pauses, suggesting that reduced pause durations in Duet performance facilitated a neural state of enhanced action readiness. Together these findings provide novel insight into behavioural strategies by which musical partners resolve coordination challenges posed by expressive silence, and capture a clear neural signature of action planning during time-varying silences in natural music performance.

Simultaneous self-other integration and segregation support real-time interpersonal coordination in a musical joint action task

The ability to distinguish between an individual's own actions and those of another person is a requirement for successful joint action, particularly in domains such as group music making where precise interpersonal coordination ensures perceptual overlap in the effects of co-performers' actions. We tested the hypothesis that such coordination benefits from simultaneous integration and segregation of information about 'self' and 'other' in an experiment using a musical joint action paradigm. Sixteen pairs of individuals with little or no musical training performed a dyadic synchronization task on a pair of electronic music boxes. The relationship between pitches produced by paired participants (same vs. different) and the relationship between movement frequencies required to trigger synchronous tones (congruent vs. incongruent) were varied in a repeated measures design. The results indicate that interpersonal coordination was most accurate when sounds were different in pitch but movement frequency was congruent. Under other conditions, participants often drifted apart, resulting in poor coordination, especially with same sounds and incongruent movements across co-performers. These findings suggest that interpersonal coordination was facilitated when simultaneous self-other integration and segregation occurred across sensory modalities in an asymmetrical manner where pitch relations favoured segregation via auditory streaming while movement congruence favoured integration via visuo-motor coupling. Such self-other representational balance may enable co-performers to maintain autonomous control while attending, anticipating, and adapting to each other's timing when joint action requires precise temporal coordination.

Keeping in time with social and non-social stimuli: Synchronisation with auditory, visual, and audio-visual cues

Everyday social interactions require us to closely monitor, predict, and synchronise our movements with those of an interacting partner. Experimental studies of social synchrony typically examine the social-cognitive outcomes associated with synchrony, such as affiliation. On the other hand, research on the sensorimotor aspects of synchronisation generally uses non-social stimuli (e.g. a moving dot). To date, the differences in sensorimotor aspects of synchronisation to social compared to non-social stimuli remain largely unknown. The present study aims to address this gap using a verbal response paradigm where participants were asked to synchronise a 'ba' response in time with social and non-social stimuli, which were presented auditorily, visually, or audio-visually combined. For social stimuli a video/audio recording of an actor performing the same verbal 'ba' response was presented, whereas for non-social stimuli a moving dot, an auditory metronome or both combined were presented. The impact of autistic traits on participants' synchronisation performance was examined using the Autism Spectrum Quotient (AQ). Our results revealed more accurate synchronisation for social compared to non-social stimuli, suggesting that greater familiarity with and motivation in attending to social stimuli may enhance our ability to better predict and synchronise with them. Individuals with fewer autistic traits demonstrated greater social learning, as indexed through an improvement in synchronisation performance to social vs non-social stimuli across the experiment.

Interactional synchrony: signals, mechanisms and benefits

Many group-living animals, humans included, occasionally synchronize their behavior with that of conspecifics. Social psychology and neuroscience have attempted to explain this phenomenon. Here we sought to integrate results around three themes: the stimuli, the mechanisms and the benefits of interactional synchrony. As regards stimuli, we asked what characteristics, apart from temporal regularity, prompt synchronization and found that stimulus modality and complexity are important. The high temporal resolution of the auditory system and the relevance of socio-emotional information endow auditory, multimodal, emotional and somewhat variable and adaptive sequences with particular synchronizing power. Looking at the mechanisms revealed that traditional perspectives emphasizing beat-based representations of others' signals conflict with more recent work investigating the perception of temporal regularity. Timing processes supported by striato-cortical loops represent any kind of repetitive interval sequence fairly automatically. Additionally, socio-emotional processes supported by posterior superior temporal cortex help endow such sequences with value motivating the extent of synchronizing. Synchronizing benefits arise from an increased predictability of incoming signals and include many positive outcomes ranging from basic information processing at the individual level to the bonding of dyads and larger groups.

Dimensions of Musical Creativity

Current literature on creative cognition has developed rich conceptual landscapes dedicated to the analysis of both individual and collective forms of creativity. This work has favored the emergence of unifying theories on domain-general creative abilities in which the main experiential, behavioral, computational, and neural aspects involved in everyday creativity are examined and discussed. But while such accounts have gained important analytical leverage for describing the overall conditions and mechanisms through which creativity emerges and operates, they necessarily leave contextual forms of creativity less explored. Among the latter, musical practices have recently drawn the attention of scholars interested in its creative properties as well as in the creative potential of those who engage with them. In the present article, we compare previously posed theories of creativity in musical and non-musical domains to lay the basis of a conceptual framework that mitigates the tension between (i) individual and collective and (ii) domain-general and domain-specific perspectives on creativity. In doing so, we draw from a range of scholarship in music and enactive cognitive science, and propose that creative cognition may be best understood as a process of skillful organism-environment adaptation that one cultivates endlessly. With its focus on embodiment, plurality, and adaptiveness, our account points to a structured unity between living systems and their world, disclosing a variety of novel analytical resources for research and theory across different dimensions of (musical) creativity.

The influence of performing gesture type on interpersonal musical timing, and the role of visual contact and tempo

Bodily gestures play an important role in the communication of expressive intentions between humans. Music ensemble performance, as an outstanding example of nonverbal human communication, offers an exemplary context to study and understand the gestural control and communication of these expressive intentions. An important mechanism in music ensemble performance is the anticipation and control of interpersonal timing. When performing, musicians are involved in a complex system of mutual adaptation which is not completely understood so far. In this study, we investigated the role of performers' gestures in the mediation process of interpersonal timing in a dyad performance. Therefore, we designed an experiment in which we controlled for the use of hand and arm movements in a musical task, in which dyads were asked to synchronously tap out a melody. Next to their comfortable/natural way of tapping, we instructed participants to either perform pronounced expressive hand and arm gestures in between successive taps, or to restrict from any overt body movement. In addition, we looked at effects of visual contact (yes/no) and tempo (slow: 50 beats per minute; fast: 100 beats per minute). The results show that performers' gestures improve interpersonal musical timing, in terms of the consistency and accuracy of onset asynchronies, and of the variability of produced inter-onset intervals. Interestingly, we found that the use of expressive gestures, in regard to comfortable/natural movements, add to these positive timing effects, but only when there is visual contact and at the slow tempo. In addition, we found that the type of gestures employed by musicians may modulate leader-follower dynamics. Together, these findings are explained by human anticipation mechanisms facilitated by gesturing, shedding new light on the principles underlying human communication of expressive intentions, through music.

The influence of a conductor and co-performer on auditory-motor synchronisation, temporal prediction, and ancillary entrainment in a musical drumming task

Interpersonal coordination is exemplified in ensemble musicians, who coordinate their actions deliberately in order to achieve temporal synchronisation in their performances. However, musicians also move parts of their bodies unintentionally or spontaneously, sometimes in ways that do not directly produce sound from their instruments. Musicians' movements-intentional or otherwise-provide visual signals to co-performers, which might facilitate temporal synchronisation. In large ensembles, a conductor also provides a visual cue, which has been shown to enhance synchronisation. In the present study, we tested how visual cues from a co-performer and a conductor affect processes of temporal anticipation, synchronisation, and ancillary movements in a sample of primarily non-musicians. We used a dyadic synchronisation drumming task, in which paired participants drummed to the beat of tempo-changing music. We manipulated visual access between partners and a virtual conductor. Results showed that the conductor improved synchronisation with the music, but synchrony with the music did not improve when partners could see each other. Temporal prediction was improved when partners saw the conductor, but not each other. Ancillary movements of the head were more synchronised between partners when they could see each other, and greater ancillary synchrony at beat-related frequencies of movement was associated with greater drumming synchrony. These results suggest that compatible audio-visual cues can improve intentional synchronisation, that ancillary movements are affected by seeing a partner, and that attended vs. incidental visual cues thus have partially dissociable effects on temporal coordination during joint action.

The Power of Gaze in Music. Leonard Bernstein’s Conducting Eyes

The paper argues for the importance and richness of gaze communication during orchestra and choir conduction, and presents three studies on this issue. First, an interview with five choir and orchestra conductors reveals that they are not so deeply aware of the potentialities of gaze to convey indications in music performance. A conductor who was utterly conscious of the importance of gaze communication, however, is Leonard Bernstein, who conducted a performance of Haydn’s Symphony No. 88 using his face and gaze only. Therefore, a fragment of this performance is analyzed in an observational study, where a qualitative analysis singles out the items of gaze exploited by Bernstein and their corresponding meanings. Finally, a perception study is presented in which three of these items are submitted to expert, non-expert, and amateur participants. The results show that while the signal for “start” is fairly recognized, the other two, “pay attention” and “crescendo and accelerando” are more difficult to interpret. Furthermore, significant differences in gaze item recognition emerge among participants: experts not only recognize them more, but they also take advantage of viewing the items with audio-visual vs. video-only presentation, while non-experts do not take advantage of audio in their recognition.

Neural multimodal integration underlying synchronization with a co-performer in music: Influences of motor expertise and visual information

Sensorimotor synchronization is a general skill that musicians have developed to the highest levels of performance, including synchronization in timing and articulation. This study investigated neurocognitive processes that enable such high levels of performance, specifically testing the relevance of 1) motor resonance and sharing high levels of motor expertise with the co-performer, and 2) the role of visual information in addition to auditory information. Musicians with varying levels of piano expertise (including non-pianists) performed on a single piano key with their right hand along with recordings of a pianist who performed simple melodies with the left hand, synchronizing timing and articulation. The prerecorded performances were presented as audio-only, audio-video, or audio-animation stimuli. Double pulse Transcranial Magnetic Stimulation (dTMS) was applied to test the contribution of the right dorsal premotor cortex (dPMC), an area implicated in motor resonance with observed (left-hand) actions, and the contribution of the right intraparietal sulcus (IPS), an area known for multisensory binding. Results showed effects of dTMS in the conditions that included visual information. IPS stimulation improved synchronization, although this effect was found to reverse in the video condition with higher levels of piano expertise. dPMC stimulation improved or worsened synchronization ability. Level of piano expertise was found to influence this direction in the video condition. These results indicate that high levels of relevant motor expertise are required to beneficially employ visual and motor information of a co-performer for sensorimotor synchronization, which may qualify the effects of dPMC and IPS involvement.

Eye gaze as a means of giving and seeking information during musical interaction

During skilled music ensemble performance, a multi-layered network of interaction processes allows musicians to negotiate common interpretations of ambiguously-notated music in real-time. This study investigated the conditions that encourage visual interaction during duo performance. Duos recorded performances of a new piece before and after a period of rehearsal. Mobile eye tracking and motion capture were used in combination to map uni- and bidirectional eye gaze patterns. Musicians watched each other more during temporally-unstable passages than during regularly-timed passages. They also watched each other more after rehearsal than before. Duo musicians may seek visual interaction with each other primarily, but not exclusively, when coordination is threatened by temporal instability. Visual interaction increases as musicians become familiar with the piece, suggesting that they visually monitor each other once a shared interpretation of the piece is established. Visual monitoring of co-performers' movements and attention may facilitate feelings of engagement and high-level creative collaboration.

A Longitudinal Study Investigating Synchronization in a Singing Quintet

Research suggests that synchronization between musicians during ensemble performances can be affected by the rhythmic or tonal complexity of the piece being performed and by group roles such as leader-follower relationships. Since previous studies have mostly been conducted within single performance sessions, developmental aspects of interpersonal synchronization in ensembles remain underinvestigated. This longitudinal study followed a newly formed singing ensemble from initial rehearsals to the performance stage in order to investigate the evolution of synchronization between advanced singing students during a university term of study in relation to the musical content of the piece and leader-follower relationships. An advanced postgraduate singing quintet was recorded using head-worn microphones and laryngograph electrodes to allow fundamental frequency evaluation of the individual voices. The quintet, formed to complete a 1-year Master's programme in ensemble singing, rehearsed two pieces composed for the study, during five rehearsals over 3 months. Singers practised the same pieces in a randomized order across rehearsals and performed three repetitions of the same pieces before and after each rehearsal, resulting in six recordings per piece/rehearsal. Audio and laryngograph data of the repeated performances were collected, and synchronization was measured by extracting note times from the fundamental frequency values. The asynchronies of the two pieces before and after rehearsals were calculated and compared both within rehearsals (pre and post) and between rehearsals (rehearsals 1-5). Results demonstrate an increase in the precision of synchronization over the course of study, depending on the piece being rehearsed, and a more variable synchronization for the more rhythmically complex piece. Results also show changes in the distribution of the tendency to precede all co-performers across rehearsals, which became equally distributed among the musicians during the last rehearsal. The results reported here could have important implications for the tailoring of rehearsal strategies that could improve interpersonal synchronization between musicians during ensemble performances.

Synchronization in Singing Duo Performances: The Roles of Visual Contact and Leadership Instruction

Interpersonal synchronization between musicians during ensemble performances is characterized by continuous micro-timing adjustments due to intentional and unintentional factors supporting expressive interpretations, or caused by noise during the cognitive-motor process. Whether visual contact between musicians and the instruction to act as leader or follower affect synchronization in ensembles remains mostly unclear. This study investigates the role of visual cues and leader-follower relationships in singing performances. Twelve vocal duos took part in the study, singing a two-part piece, which was composed for the study and was mostly homophonic in structure. Four conditions were applied in a randomized order: with and without visual contact, and with a designated leader or follower. The piece was repeated four times in each condition, and the condition presented three times, for a total of 12 performances of the piece in each condition. Data were acquired using electrolaryngograph electrodes and head mounted microphones to track the fundamental frequency estimates of the individual singers. Results show that the presence and absence of visual contact had a significant effect on the precision and consistency of synchronization during singing duo performances. Precision and consistency were better in the presence of visual contact between singers than without, and these effects were associated with the beginning of phonation of the first note of the piece. The presence/absence of visual contact also had an effect on the tendency to lead or lag a co-performer associated with the onset of the first note; the extent of leading was greater when visual contact was absent. The instruction to act as leader or follower did not affect precision or consistency of synchronization, nor did it relate to the observed tendency to precede or lag a co-performer. The results contribute to the tailoring of rehearsal strategies, as singers and directors can be better informed of the factors influencing synchronization and focus on specific areas of difficulty in certain performance conditions, such as first note onsets when performers are not able to see each other.

Collaborative Musical Creativity: How Ensembles Coordinate Spontaneity

Music performance is inherently social. Most music is performed in groups, and even soloists are subject to influence from a (real or imagined) audience. It is also inherently creative. Performers are called upon to interpret notated music, improvise new musical material, adapt to unexpected playing conditions, and accommodate technical errors. The focus of this paper is how creativity is distributed across members of a music ensemble as they perform these tasks. Some aspects of ensemble performance have been investigated extensively in recent years as part of the broader literature on joint action (e.g., the processes underlying sensorimotor synchronization). Much of this research has been done under highly controlled conditions, using tasks that generate reliable results, but capture only a small part of ensemble performance as it occurs naturalistically. Still missing from this literature is an explanation of how ensemble musicians perform in conditions that require creative interpretation, improvisation, and/or adaptation: how do they coordinate the production of something new? Current theories of creativity endorse the idea that dynamic interaction between individuals, their actions, and their social and material environments underlies creative performance. This framework is much in line with the embodied music cognition paradigm and the dynamical systems perspective on ensemble coordination. This review begins by situating the concept of collaborative musical creativity in the context of embodiment. Progress that has been made toward identifying the mechanisms that underlie collaborative creativity in music performance is then assessed. The focus is on the possible role of musical imagination in facilitating performer flexibility, and on the forms of communication that are likely to support the coordination of creative musical output. Next, emergence and group flow–constructs that seem to characterize ensemble performance at its peak–are considered, and some of the conditions that may encourage periods of emergence or flow are identified. Finally, it is argued that further research is needed to (1) demystify the constructs of emergence and group flow, clarifying their effects on performer experience and listener response, (2) determine how constrained musical imagination is by perceptual experience and understand people's capacity to depart from familiar frameworks and imagine new sounds and sound structures, and (3) assess the technological developments that are supposed to facilitate or enhance musical creativity, and determine what effect they have on the processes underlying creative collaboration.

A new method of onset and offset detection in ensemble singing

This paper presents a novel method combining electrolaryngography and acoustic analysis to detect the onset and offset of phonation as well as the beginning and ending of notes within a sung legato phrase, through the application of a peak-picking algorithm, TIMEX. The evaluation of the method applied to a set of singing duo recordings shows an overall performance of 78% within a tolerance window of 50 ms compared with manual annotations performed by three experts. Results seem very promising in light of the state-of-the-art techniques presented at MIREX in 2016 yielding an overall performance of around 60%. The new method was applied to a pilot study with two duets to analyse synchronization between singers during ensemble performances. Results from this investigation demonstrate bidirectional temporal adaptations between performers, and suggest that the precision and consistency of synchronization, and the tendency to precede or lag a co-performer might be affected by visual contact between singers and leader-follower relationships. The outcomes of this paper promise to be beneficial for future investigations of synchronization in singing ensembles.

Beating time: How ensemble musicians' cueing gestures communicate beat position and tempo

Ensemble musicians typically exchange visual cues to coordinate piece entrances. "Cueing-in" gestures indicate when to begin playing and at what tempo. This study investigated how timing information is encoded in musicians' cueing-in gestures. Gesture acceleration patterns were expected to indicate beat position, while gesture periodicity, duration, and peak gesture velocity were expected to indicate tempo. Same-instrument ensembles (e.g., piano-piano) were expected to synchronize more successfully than mixed-instrument ensembles (e.g., piano-violin). Duos performed short passages as their head and (for violinists) bowing hand movements were tracked with accelerometers and Kinect sensors. Performers alternated between leader/follower roles; leaders heard a tempo via headphones and cued their partner in nonverbally. Violin duos synchronized more successfully than either piano duos or piano-violin duos, possibly because violinists were more experienced in ensemble playing than pianists. Peak acceleration indicated beat position in leaders' head-nodding gestures. Gesture duration and periodicity in leaders' head and bowing hand gestures indicated tempo. The results show that the spatio-temporal characteristics of cueing-in gestures guide beat perception, enabling synchronization with visual gestures that follow a range of spatial trajectories.

The Tight-interlocked Rhythm Section: Production and Perception of Synchronisation in Jazz Trio Performance

This study investigates the production and perception of timing, synchronisation and dynamics in jazz trio performances. In a production experiment, six trio combinations of one saxophonist, two bassists, and three drummers were recorded while they performed three popular jazz songs. Onset timing and dynamics of each performer were extracted and analysed. Results showed that the tempo was significantly influenced by the timing of the drummers and all performers showed higher temporal precision on the backbeats. The drummers demonstrated individual swing-ratios, accentuations of beats and intrapersonal asynchronies between simultaneous hi-hat and ride cymbal onsets, which resulted in a hi-hat played 2-26 ms ahead of the pulse of the music. In a subsequent perception test, participants ([Formula: see text]) rated 12 excerpts of the jazz recordings. They selected their preferred version from a pool of stimuli containing the original version, but also manipulations with artificially increased or reduced asynchronies. Stimuli with reduced asynchronies smaller than 19 ms were preferred by the listeners over the original or the fully quantised timing. This suggests that listeners endorse a 'tight-interlocked' jazz rhythm section, with asynchronies smaller than the perceptual threshold (temporal masking), but with natural timing variabilities that makes it distinguishable from a computer-generated playback.

Communication for coordination: gesture kinematics and conventionality affect synchronization success in piano duos

Ensemble musicians often exchange visual cues in the form of body gestures (e.g., rhythmic head nods) to help coordinate piece entrances. These cues must communicate beats clearly, especially if the piece requires interperformer synchronization of the first chord. This study aimed to (1) replicate prior findings suggesting that points of peak acceleration in head gestures communicate beat position and (2) identify the kinematic features of head gestures that encourage successful synchronization. It was expected that increased precision of the alignment between leaders' head gestures and first note onsets, increased gesture smoothness, magnitude, and prototypicality, and increased leader ensemble/conducting experience would improve gesture synchronizability. Audio/MIDI and motion capture recordings were made of piano duos performing short musical passages under assigned leader/follower conditions. The leader of each trial listened to a particular tempo over headphones, then cued their partner in at the given tempo, without speaking. A subset of motion capture recordings were then presented as point-light videos with corresponding audio to a sample of musicians who tapped in synchrony with the beat. Musicians were found to align their first taps with the period of deceleration following acceleration peaks in leaders' head gestures, suggesting that acceleration patterns communicate beat position. Musicians' synchronization with leaders' first onsets improved as cueing gesture smoothness and magnitude increased and prototypicality decreased. Synchronization was also more successful with more experienced leaders' gestures. These results might be applied to interactive systems using gesture recognition or reproduction for music-making tasks (e.g., intelligent accompaniment systems).

Listeners' and Performers' Shared Understanding of Jazz Improvisations

This study explores the extent to which a large set of musically experienced listeners share understanding with a performing saxophone-piano duo, and with each other, of what happened in three improvisations on a jazz standard. In an online survey, 239 participants listened to audio recordings of three improvisations and rated their agreement with 24 specific statements that the performers and a jazz-expert commenting listener had made about them. Listeners endorsed statements that the performers had agreed upon significantly more than they endorsed statements that the performers had disagreed upon, even though the statements gave no indication of performers' levels of agreement. The findings show some support for a more-experienced-listeners-understand-more-like-performers hypothesis: Listeners with more jazz experience and with experience playing the performers' instruments endorsed the performers' statements more than did listeners with less jazz experience and experience on different instruments. The findings also strongly support a listeners-as-outsiders hypothesis: Listeners' ratings of the 24 statements were far more likely to cluster with the commenting listener's ratings than with either performer's. But the pattern was not universal; particular listeners even with similar musical backgrounds could interpret the same improvisations radically differently. The evidence demonstrates that it is possible for performers' interpretations to be shared with very few listeners, and that listeners' interpretations about what happened in a musical performance can be far more different from performers' interpretations than performers or other listeners might assume.

Analysing change in music therapy interactions of children with communication difficulties

Music therapy has been found to improve communicative behaviours and joint attention in children with autism, but it is unclear what in the music therapy sessions drives those changes. We developed an annotation protocol and tools to accumulate large datasets of music therapy, for analysis of interaction dynamics. Analysis of video recordings of improvisational music therapy sessions focused on simple, unambiguous individual and shared behaviours: movement and facing behaviours, rhythmic activity and musical structures and the relationships between them. To test the feasibility of the protocol, early and late sessions of five client-therapist pairs were annotated and analysed to track changes in behaviours. To assess the reliability and validity of the protocol, inter-rater reliability of the annotation tiers was calculated, and the therapists provided feedback about the relevance of the analyses and results. This small-scale study suggests that there are both similarities and differences in the profiles of client-therapist sessions. For example, all therapists faced the clients most of the time, while the clients did not face back so often. Conversely, only two pairs had an increase in regular pulse from early to late sessions. More broadly, similarity across pairs at a general level is complemented by variation in the details. This perhaps goes some way to reconciling client- and context-specificity on one hand and generalizability on the other. Behavioural characteristics seem to influence each other. For instance, shared rhythmic pulse alternated with mutual facing and the occurrence of shared pulse was found to relate to the musical structure. These observations point towards a framework for looking at change in music therapy that focuses on networks of variables or broader categories. The results suggest that even when starting with simple behaviours, we can trace aspects of interaction and change in music therapy, which are seen as relevant by therapists.