Characterizing Movement Fluency in Musical Performance: Toward a Generic Measure for Technology Enhanced Learning

Expressivity attributed to music affects the smoothness of bowing movements in violinists

Playing music is a complex task that relies on the combination of musicians' technical and expressive skills. While the literature has investigated the effects of musical expressivity on the listeners, the way how technical difficulty and emotional expressivity affect musicians during playing has surprisingly received no attention. In an attempt to fill this gap in the literature, we collected behavioral and physiological data from twelve violinists playing 29 pieces that included both technical exercises and excerpts from classical repertoire for violin. After playing each stimulus, participants rated it for emotional expressivity and technical difficulty. During the entire session, cardiac parameters and electrodermal activity were collected, together with the kinematic parameters of the bowing gesture. A set of Linear Mixed-Effect (LME) models suggested that emotional expressivity attributed to music affected the fluidity of bowing (i.e., smoothness), with the excerpts rated as more expressive being performed in a less smooth way. In contrast, LME models revealed no effects of expressivity and technical difficulty on any of the physiological parameters of violinists. Our results offer novel insights into the psychophysiological dynamics that link motor parameters with musical expressivity. These findings could influence educational practices in music and deepen our understanding of aesthetic emotions.

Motion shapes for sound shaping

The focus of this perspective paper is on relationships between sound-producing body motion and corresponding perceived sound features, guided by the idea of shapes as the common denominator of these two domains. The term shape is used to denote graphical-pictorial renderings of phenomena that we perceive or imagine, and may have physical manifestations as tracings on paper or on screen, or as gesticulations, or just as imagined tracings in our minds. Shapes give us intermittent snapshots of unfolding motion and sound fragments, and the point of shapes is to make ephemeral sound and motion features tractable as more permanent objects. Shapes of perceived sound include dynamic, spectral, textural, pitch-related, harmonic, etc. features as shapes, whereas shapes of sound-producing motion include both motion trajectories and postures of sound-producing effectors, i.e., of fingers, hands, arms, etc., or mouth, lips, and tongue.

Efficacy of Therapeutic Exercise in Reducing Pain in Instrumental Musicians: Systematic Review and Meta-Analysis

Playing-related pain poses a significant health concern for musicians, often impacting their ability to perform. Therapeutic exercise emerges as a viable approach to alleviate these symptoms, offering a low-cost intervention with minimal side effects. This review seeks to examine and assess the efficacy of therapeutic exercise in reducing pain intensity among instrumental musicians. Three major databases (PubMed, Web of Science, and Scopus) were systematically searched from November 2023 to June 2024. The inclusion criteria required studies to be randomized clinical trials focusing on pain intensity in instrumental musicians, published in the last 10 years. Two independent researchers assessed the characteristics and methodological quality of the selected studies. Out of 305 identified studies, 15 underwent full-text reviews, with 5 ultimately included in the analysis. The total participant count was 273, with an average intervention duration of 32.5 min per session, twice weekly for eight weeks. Overall, therapeutic exercise interventions demonstrated favorable effects, with three studies exhibiting good methodological quality. The meta-analysis revealed significant positive results favoring exercise in reducing pain intensity, with positive responses observed across all clinical populations, so therapeutic exercise appears to be an effective approach for reducing pain intensity in musicians experiencing playing-related pain.

Please unmute your microphone: Comparing the effectiveness of remote versus in-person percussion training

Although remote music training has its limitations, the use of technology can lower barriers to its accessibility. This exploratory study compared the effects of remote and in-person percussion training on motor performance, performance quality, and students' enjoyment. The training involved the motor aspects of playing legato on percussion instruments. Twenty percussionists received the training either remotely from an instructor using videoconferencing technology or in person from the same instructor who was in the training room. Motor behavior, legato expressivity, performance quality, and participants' self-rated enjoyment were compared to determine potential advantages and disadvantages of training in the two formats. Furthermore, participants rated their interest in continuing to receive training in the same way they had experienced it, remote or in person. Regardless of whether the instructor was remote or in person, participants lifted their mallets to a greater height above the drums post-training, perhaps because there was more spatial and velocity variability in the movements of their elbows and wrists. Changes in their patterns of post-training movements were paralleled by higher ratings for expressivity of legato and performance quality. Critically, participants who received training from the remote instructor expressed greater interest in continuing training than those who received training from the instructor who was physically present, in both the short and long term. These findings may suggest that remote and in-person instruction yielded comparable changes on motor behavior, as demonstrated by the altered speed at which movements of the elbow and wrist were executed, which in turn may influence the perception of expressivity in legato playing. The results may support the use of remote training as an adjunct to physical practice to lower some barriers to music education.

The assessment of presence and performance in an AR environment for motor imitation learning: A case-study on violinists

The acquisition of advanced gestures is a challenge in various domains of proficient sensorimotor performance. For example, orchestral violinists must move in sync with the lead violinist's gestures. To help train these gestures, an educational music play-back system was developed using a HoloLens 2 simulated AR environment and an avatar representation of the lead violinist. This study aimed to investigate the impact of using a 2D or 3D representation of the lead violinist's avatar on students' learning experience in the AR environment. To assess the learning outcome, the study employed a longitudinal experiment design, in which eleven participants practiced two pieces of music in four trials, evenly spaced over a month. Participants were asked to mimic the avatar's gestures as closely as possible when it came to using the bow, including bowing, articulations, and dynamics. The study compared the similarities between the avatar's gestures and those of the participants at the biomechanical level, using motion capture measurements, as well as the smoothness of the participants' movements. Additionally, presence and perceived difficulty were assessed using questionnaires. The results suggest that using a 3D representation of the avatar leads to better gesture resemblance and a higher experience of presence compared to a 2D representation. The 2D representation, however, showed a learning effect, but this was not observed in the 3D condition. The findings suggest that the 3D condition benefits from stereoscopic information that enhances spatial cognition, making it more effective in relation to sensorimotor performance. Overall, the 3D condition had a greater impact on performance than on learning. This work concludes with recommendations for future efforts directed towards AR-based advanced gesture training to address the challenges related to measurement methodology and participants' feedback on the AR application.

The Impact of Limb Velocity Variability on Mallet Accuracy in Marimba Performance

The present study examined spatial accuracy of mallet endpoints in a marimba performance context. Trained percussionists performed two- (i.e., Experiment 1) and four-mallet (i.e., Experiment 2) excerpts in three tempo conditions including slow, intermediate, and fast. Motion capture was utilized to gather data of upper-limb and mallet movements, as well as to compute velocities of the upper-limb joints. Mallet spatial accuracy was assessed by comparing mallet endpoints to a visual target positioned on the marimba. It was hypothesized that mallet spatial accuracy would be reduced as tempo condition increased, with effects on joint kinematics potentially revealing sensorimotor mechanisms underlying optimal sound production in marimba. Across both experiments, mallet accuracy was reduced as tempo condition increased. Interestingly, velocity variability in the elbows, wrists, and hands increased as mallet accuracy decreased. Such a pattern of effects suggested that sound production in marimba is suboptimal at fast relative to slow tempi. In addition, the velocity variability effects highlight the impact of motor planning mechanisms on sound production. Overall, the results shed new light on sensorimotor control in percussion which can be leveraged to enhance the training of percussionists.

Understanding the Association between Musical Sophistication and Well-Being in Music Students

Quality of life and mental health are topics under discussion in the university environment that pose new educational challenges. Public policy in Chile establishes the need to track students who are starting university and who could find themselves at possible academic risk (Law 20. 903). These transition processes experienced by students therefore need to be guided to improve the students’ quality of life. Using a mixed design, the present study analyzes the association between musical sophistication (Ollen, 2006), students’ well-being, and the performance of first-year students training to be music teachers (n = 25). The Ollen Musical Sophistication questionnaire and the Spanish version of the PERMA-profiler, a questionnaire for assessing well-being, were applied. In order to obtain detailed information about learning processes and educational needs, seven interviews were conducted. Results indicate a negative correlation between musical sophistication on the one hand and negative emotions (anxiety and anger) and loneliness on the other. This is reflected in less consistent academic performance, difficulties in identity development, and reduced motivation to face new challenges besides musical learning. We concluded that knowledge and observation of students’ previous musical experience is crucial for understanding and supporting the educational transition process and well-being of student music teachers.

Temporospatial Alterations in Upper-Limb and Mallet Control Underlie Motor Learning in Marimba Performance

Sound-producing movements in percussion performance require a high degree of fine motor control. However, there remains a relatively limited empirical understanding of how performance level abilities develop in percussion performance in general, and marimba performance specifically. To address this issue, nine percussionists performed individualised excerpts on marimba within three testing sessions spaced 29 days apart to assess early, intermediate, and late stages of motor learning. Motor learning was quantified via analyses of both the temporal control of mallet movements, and the spatial variability of upper-limb movements. The results showed that temporal control of mallet movements was greater in the intermediate compared to the early learning session, with no significant additional improvements revealed in the late learning session. In addition, spatial variability in the left and right elbows decreased within the intermediate compared to the early learning session. The results suggest that temporal control of mallet movements may be driven by reductions in spatial variability of elbow movements specifically. As a result, this study provides novel evidence for kinematic mechanisms underlying motor learning in percussion which can be applied towards enhancing musical training.

Constraint-Based Sound-Motion Objects in Music Performance

The aim of this paper is to present principles of constraint-based sound-motion objects in music performance. Sound-motion objects are multimodal fragments of combined sound and sound-producing body motion, usually in the duration range of just a few seconds, and conceived, produced, and perceived as intrinsically coherent units. Sound-motion objects have a privileged role as building blocks in music because of their duration, coherence, and salient features and emerge from combined instrumental, biomechanical, and motor control constraints at work in performance. Exploring these constraints and the crucial role of the sound-motion objects can enhance our understanding of generative processes in music and have practical applications in performance, improvisation, and composition.

Computational Approaches to Music Motor Performance: Clustering of Percussion Kinematics Underlying Performance Style

The present study investigated motor kinematics underlying performance-related movements in marimba performance. Participants played a marimba while motion capture equipment tracked movements of the torso, shoulders, elbows, wrists, and hands. Principal components analysis was applied to assess the movements during the performance related to sound production and sound preparation. Subsequent cluster analyses sought to identify coupling of limb segment movements that may best characterize performance styles present in the performance. The analysis revealed four clusters that were thought to reflect performance styles of expressive performance, postural sway, energy efficiency, and a blend of the former styles. More specifically, the expressive cluster was best characterized by limb movements occurring along the vertical z-axis, whereas the postural sway cluster was characterized by forwards and backwards motions of the torso and upper limbs. The energy efficient cluster was characterized by movements of the body moving left to right along the marimba, whereas the blended style demonstrated limited delineation from the alternate styles. Such findings were interpreted as evidence that performance styles occur within a framework of biomechanical constraints and hierarchical stylistic factors. Overall, the results provided a more holistic understanding of motor execution in percussion performance.

Expertise- and Tempo-Related Performance Differences in Unimanual Drumming

BACKGROUND

High-speed drumming requires precise control over the timing, velocity, and magnitude of striking movements.

AIM

To examine effects of tempo and expertise on unaccented repetitive drumming performance using 3D motion capture.

METHODS

Expert and amateur drummers performed unimanual, unaccented, repetitive drum strikes, using their dominant right hand, at five different tempi. Performance was examined with regard to timing variability, striking velocity variability, the ability to match the prescribed tempo, and additional variables.

RESULTS

Permutated multivariate analysis of variance (PERMANOVA) revealed significant main effects of tempo (p < .001) and expertise (p <.001) on timing variability and striking velocity variability; low timing variability and low striking velocity variability were associated with low/medium tempo as well as with increased expertise. Individually, improved precision appeared across an optimum tempo range. Precision was poorest at maximum tempo (400 hits per minute) for precision variables.

CONCLUSIONS

Expert drummers demonstrated greater precision and consistency than amateurs. Findings indicate an optimum tempo range that extends with increased expertise.

Isoluminant stimuli in a familiar discrete keying sequence task can be ignored

Motor sequencing models suggest that when with extensive practice sequence representations have developed, stimuli indicating the individual sequence elements may no longer be used for sequence execution. However, it is not clear whether participants can at all refrain from processing these stimuli. Two experiments were performed in which participants practiced two 7-keypress sequences by responding to isoluminant key-specific stimuli. In the mixed condition of the ensuing test phase, the stimuli were displayed only occasionally, and the question was whether this would make participants stop processing these stimuli. In Experiment 1, the benefit of displaying stimuli was assessed after substantial practice, while Experiment 2 examined development of this benefit across practice. The results of Experiment 1 showed that participants rely a little less on these stimuli when they are displayed only occasionally, but Experiment 2 revealed that participants quickly developed high awareness, and that they ignored these stimuli already after limited practice. These findings confirm that participants can choose to ignore these isoluminant stimuli but tend to use them when they are displayed. These and other findings show in some detail how various cognitive systems interact to produce familiar keying sequences.

Method Development for Multimodal Data Corpus Analysis of Expressive Instrumental Music Performance

Musical performance is a multimodal experience, for performers and listeners alike. This paper reports on a pilot study which constitutes the first step toward a comprehensive approach to the experience of music as performed. We aim at bridging the gap between qualitative and quantitative approaches, by combining methods for data collection. The purpose is to build a data corpus containing multimodal measures linked to high-level subjective observations. This will allow for a systematic inclusion of the knowledge of music professionals in an analytic framework, which synthesizes methods across established research disciplines. We outline the methods we are currently developing for the creation of a multimodal data corpus dedicated to the analysis and exploration of instrumental music performance from the perspective of embodied music cognition. This will enable the study of the multiple facets of instrumental music performance in great detail, as well as lead to the development of music creation techniques that take advantage of the cross-modal relationships and higher-level qualities emerging from the analysis of this multi-layered, multimodal corpus. The results of the pilot project suggest that qualitative analysis through stimulated recall is an efficient method for generating higher-level understandings of musical performance. Furthermore, the results indicate several directions for further development, regarding observational movement analysis, and computational analysis of coarticulation, chunking, and movement qualities in musical performance. We argue that the development of methods for combining qualitative and quantitative data are required to fully understand expressive musical performance, especially in a broader scenario in which arts, humanities, and science are increasingly entangled. The future work in the project will therefore entail an increasingly multimodal analysis, aiming to become as holistic as is music in performance.

Expertise-Related Differences in Cyclic Motion Patterns in Drummers: A Kinematic Analysis

Background

At present only little information is available concerning the acquisition of skilled movements in musicians. Although optimally a longitudinal study of changing movement patterns during the process of increasing expertise is required, long-term follow up over several years is difficult to manage. Therefore, in the present cross-sectional study a comparative kinematic analysis of skilled movements in drummers with different levels of expertise was carried out.

Aims

The aim of the investigation was (1) to analyze the kinematic differences between beginners, students and expert drummers, and (2) to deduce from the results general rules related to the acquisition of drumming expertise and (3) to discuss the implications for drum teaching.

Method

Two highly skilled experts, eight professional drumming students and five beginners participated in the experiment. Fast repetitive drumming movements were assessed using an active infrared measurement setup (SELSPOT-System). Recording was obtained from LEDs positioned over the shoulder-, elbow-, wrist- and MCP-joints and close to the tip of the stick at a sampling rate of 300 Hz. Kinematic analysis included calculation of angles, velocities and accelerations and assessment of the relation between velocity and acceleration as phase diagrams.

Results

Temporal accuracy of the drumming movements was related to expertise. In contrast to beginners, experts and students revealed a high degree of self-similarity of movements and a predominant use of low-mass distal joints, resulting in a whiplash-like movement when hitting the pad.

Conclusion

Intense training in students and experts results in economic utilization of forces. Percussion teachers can take advantage of the kinematic analysis and improve their instructions according to the student’s observed motor pattern.