A developmental study of the affective value of tempo and mode in music

Distinct Inter-Joint Coordination during Fast Alternate Keystrokes in Pianists with Superior Skill

Musical performance requires motor skills to coordinate the movements of multiple joints in the hand and arm over a wide range of tempi. However, it is unclear whether the coordination of movement across joints would differ for musicians with different skill levels and how inter-joint coordination would vary in relation to music tempo. The present study addresses these issues by examining the kinematics and muscular activity of the hand and arm movements of professional and amateur pianists who strike two keys alternately with the thumb and little finger at various tempi. The professionals produced a smaller flexion velocity at the thumb and little finger and greater elbow pronation and supination velocity than did the amateurs. The experts also showed smaller extension angles at the metacarpo-phalangeal joint of the index and middle fingers, which were not being used to strike the keys. Furthermore, muscular activity in the extrinsic finger muscles was smaller for the experts than for the amateurs. These findings indicate that pianists with superior skill reduce the finger muscle load during keystrokes by taking advantage of differences in proximal joint motion and hand postural configuration. With an increase in tempo, the experts showed larger and smaller increases in elbow velocity and finger muscle co-activation, respectively, compared to the amateurs, highlighting skill level-dependent differences in movement strategies for tempo adjustment. Finally, when striking as fast as possible, individual differences in the striking tempo among players were explained by their elbow velocities but not by their digit velocities. These findings suggest that pianists who are capable of faster keystrokes benefit more from proximal joint motion than do pianists who are not capable of faster keystrokes. The distinct movement strategy for tempo adjustment in pianists with superior skill would therefore ensure a wider range of musical expression.

The development of aesthetic responses to music and their underlying neural and psychological mechanisms

In the field of psychology, the first studies in experimental aesthetics were conducted approximately 140 years ago. Since then, research has mainly concentrated on aesthetic responses to visual art. Both the aesthetic experience of music and, especially, its development have received rather limited attention. Moreover, until now, very little attention has been paid to the investigation of the aesthetic experience of music using neuroscientific methods. Aesthetic experiences are multidimensional and include inter alia sensory, perceptual, affective, and cognitive components. Aesthetic processes are usually experienced as pleasing and rewarding and are, thus, important and valuable experiences for many people. Because of their multidimensional nature, these processes employ several brain areas. In the present review, we examine important psychological and neural mechanisms that are believed to contribute to the development of aesthetic experiences of music. We also discuss relevant research findings. With the present review, we wish to provoke further discussion and possible future investigations as we consider the investigation of aesthetic experiences to be important both scientifically and with respect to potential clinical applications.

Manipulating Greek musical modes and tempo affects perceived musical emotion in musicians and nonmusicians

The combined influence of tempo and mode on emotional responses to music was studied by crossing 7 changes in mode with 3 changes in tempo. Twenty-four musicians aged 19 to 25 years (12 males and 12 females) and 24 nonmusicians aged 17 to 25 years (12 males and 12 females) were required to perform two tasks: 1) listening to different musical excerpts, and 2) associating an emotion to them such as happiness, serenity, fear, anger, or sadness. ANOVA showed that increasing the tempo strongly affected the arousal (F(2,116) = 268.62, mean square error (MSE) = 0.6676, P < 0.001) and, to a lesser extent, the valence of emotional responses (F(6,348) = 8.71, MSE = 0.6196, P < 0.001). Changes in modes modulated the affective valence of the perceived emotions (F(6,348) = 4.24, MSE = 0.6764, P < 0.001). Some interactive effects were found between tempo and mode (F (1,58) = 115.6, MSE = 0.6428, P < 0.001), but, in most cases, the two parameters had additive effects. This finding demonstrates that small changes in the pitch structures of modes modulate the emotions associated with the pieces, confirming the cognitive foundation of emotional responses to music.

Emotions and their cognitive control in children with cerebellar tumors

A constellation of deficits, termed the cerebellar cognitive affective syndrome (CCAS), has been reported following acquired cerebellar lesions. We studied emotion identification and the cognitive control of emotion in children treated for acquired tumors of the cerebellum. Participants were 37 children (7-16 years) treated for cerebellar tumors (19 benign astrocytomas (AST), 18 malignant medulloblastomas (MB), and 37 matched controls (CON). The Emotion Identification Task investigated recognition of happy and sad emotions in music. In two cognitive control tasks, we investigated whether children could identify emotion in situations in which the emotion in the music and the emotion in the lyrics was either congruent or incongruent. Children with cerebellar tumors identified emotion as accurately and quickly as controls (p > .05), although there was a significant interaction of emotions and group (p < .01), with the MB group performing less accurately identifying sad emotions, and both cerebellar tumor groups were impaired in the cognitive control of emotions (p < .01). The fact that childhood acquired cerebellar tumors disrupt cognitive control of emotion rather than emotion identification provides some support for a model of the CCAS as a disorder, not so much of emotion as of the regulation of emotion by cognition.

MMN evidence for asymmetry in detection of IOI shortening and lengthening at behavioral indifference tempo

Most behavioral investigations indicated an indifference interval of 500-700 ms, at which the detection of inter-onset interval (IOI) shortening and lengthening are equally difficult and no perceptual bias would be expected. However, some event-related potential (ERPs) studies showed that even at this behavioral indifference time, the detection of shortening and lengthening might rely on different aspects of information processing. This work was aimed to investigate whether the pre-attentive processing of local tempo perturbations, i.e., IOI shortening and lengthening, are different when the basic tempo is at the behavioral indifference area. Tempo perturbations were introduced by shortening or lengthening the third IOI by 10% of the base IOI of the 5-beat isochronous sequence. ERPs recorded in a passive experiment showed that both tempo perturbations elicited a distinct frontal mismatch negativity (MMN). The low resolution electromagnetic tomography (LORETA) source estimation indicated a left prefrontal predominance activity around the MMN peak, implicating an important role of the frontal lobe in the processing of local tempo perturbations. Statistical analysis revealed that the MMN to IOI shortening had an earlier and greater peak than that to IOI lengthening, implying that IOI shortening might be more easily to be detected than IOI lengthening even at indifference tempo. Our results suggested that local IOI perturbations at behavioral indifference area have an asymmetric effect on the pre-attentive processing of temporal variation detection.

Perception of emotion in musical performance in adolescents with autism spectrum disorders

Individuals with autism spectrum disorders (ASD) are impaired in understanding the emotional undertones of speech, many of which are communicated through prosody. Musical performance also employs a form of prosody to communicate emotion, and the goal of this study was to examine the ability of adolescents with ASD to understand musical emotion. We designed an experiment in which each musical stimulus served as its own control while we varied the emotional expressivity by manipulating timing and amplitude variation. We asked children and adolescents with ASD and matched controls as well as individuals with Williams syndrome (WS) to rate how emotional these excerpts sounded. Results show that children and adolescents with ASD are impaired relative to matched controls and individuals with WS at judging the difference in emotionality among the expressivity levels. Implications for theories of emotion in autism are discussed in light of these findings.

Tuning-in to the beat: Aesthetic appreciation of musical rhythms correlates with a premotor activity boost

Listening to music can induce us to tune in to its beat. Previous neuroimaging studies have shown that the motor system becomes involved in perceptual rhythm and timing tasks in general, as well as during preference-related responses to music. However, the role of preferred rhythm and, in particular, of preferred beat frequency (tempo) in driving activity in the motor system remains unknown. The goals of the present functional magnetic resonance imaging (fMRI) study were to determine whether the musical rhythms that are subjectively judged as beautiful boost activity in motor-related areas and if so, whether this effect is driven by preferred tempo, the underlying pulse people tune in to. On the basis of the subjects' judgments, individual preferences were determined for the different systematically varied constituents of the musical rhythms. Results demonstrate the involvement of premotor and cerebellar areas during preferred compared to not preferred musical rhythms and indicate that activity in the ventral premotor cortex (PMv) is enhanced by preferred tempo. Our findings support the assumption that the premotor activity increase during preferred tempo is the result of enhanced sensorimotor simulation of the beat frequency. This may serve as a mechanism that facilitates the tuning-in to the beat of appealing music.

Pleasurable emotional response to music: a case of neurodegenerative generalized auditory agnosia

Recent functional neuroimaging studies implicate the network of mesolimbic structures known to be active in reward processing as the neural substrate of pleasure associated with listening to music. Psychoacoustic and lesion studies suggest that there is a widely distributed cortical network involved in processing discreet musical variables. Here we present the case of a young man with auditory agnosia as the consequence of cortical neurodegeneration who continues to experience pleasure when exposed to music. In a series of musical tasks, the subject was unable to accurately identify any of the perceptual components of music beyond simple pitch discrimination, including musical variables known to impact the perception of affect. The subject subsequently misidentified the musical character of personally familiar tunes presented experimentally, but continued to report that the activity of 'listening' to specific musical genres was an emotionally rewarding experience. The implications of this case for the evolving understanding of music perception, music misperception, music memory, and music-associated emotion are discussed.

It's not what you play, it's how you play it: timbre affects perception of emotion in music

Salient sensory experiences often have a strong emotional tone, but the neuropsychological relations between perceptual characteristics of sensory objects and the affective information they convey remain poorly defined. Here we addressed the relationship between sound identity and emotional information using music. In two experiments, we investigated whether perception of emotions is influenced by altering the musical instrument on which the music is played, independently of other musical features. In the first experiment, 40 novel melodies each representing one of four emotions (happiness, sadness, fear, or anger) were each recorded on four different instruments (an electronic synthesizer, a piano, a violin, and a trumpet), controlling for melody, tempo, and loudness between instruments. Healthy participants (23 young adults aged 18–30 years, 24 older adults aged 58–75 years) were asked to select which emotion they thought each musical stimulus represented in a four-alternative forced-choice task. Using a generalized linear mixed model we found a significant interaction between instrument and emotion judgement with a similar pattern in young and older adults (p < .0001 for each age group). The effect was not attributable to musical expertise. In the second experiment using the same melodies and experimental design, the interaction between timbre and perceived emotion was replicated (p < .05) in another group of young adults for novel synthetic timbres designed to incorporate timbral cues to particular emotions. Our findings show that timbre (instrument identity) independently affects the perception of emotions in music after controlling for other acoustic, cognitive, and performance factors.

Role of tempo entrainment in psychophysiological differentiation of happy and sad music?

Respiration rate allows to differentiate between happy and sad excerpts which may be attributable to entrainment of respiration to the rhythm or the tempo rather than to emotions [Etzel, J.A., Johnsen, E.L., Dickerson, J., Tranel, D., Adolphs, R., 2006. Cardiovascular and respiratory responses during musical mood induction. Int. J. Psychophysiol. 61(1), 57-69]. In order to test for this hypothesis, this study intended to verify whether fast and slow rhythm, and/or tempo alone are sufficient to induce differential physiological effects. Psychophysiological responses (electrodermal responses, facial muscles activity, blood pressure, heart and respiration rate) were then measured in fifty young adults listening to fast/happy and slow/sad music, and to two control versions of these excerpts created by removing pitch variations (rhythmic version) and both pitch and temporal variations (beat-alone). The results indicate that happy and sad music are significantly differentiated (happy>sad) by diastolic blood pressure, electrodermal activity, and zygomatic activity, while the fast and slow rhythmic and tempo control versions did not elicit such differentiations. In contrast, respiration rate was faster with stimuli presented at fast tempi relative to slow stimuli in the beat-alone condition. It was thus demonstrated that the psychophysiological happy/sad distinction requires the tonal variations and cannot be explained solely by entrainment to tempo and rhythm. The tempo entrainment exists in the tempo alone condition but our results suggest this effect may disappear when embedded in music or with rhythm.

Musically induced arousal affects pain perception in females but not in males: A psychophysiological examination

The present study investigated affective and physiological responses to changes of tempo and mode in classical music and their effects on heat pain perception. Thirty-eight healthy non-musicians (17 female) listened to sequences of 24 music stimuli which were variations of 4 pieces of classical music. Tempo (46, 60, and 95 beats/min) and mode (major and minor) were manipulated digitally, all other musical elements were held constant. Participants rated valence, arousal, happiness and sadness of the musical stimuli as well as the intensity and the unpleasantness of heat pain stimuli which were applied during music listening. Heart rate, respiratory rate and end-tidal PCO(2) were recorded. Pain ratings were highest for the fastest tempo. Also, participants' arousal ratings, their respiratory rate and heart rate were accelerated by the fastest tempo. The modulation of pain perception by the tempo of music seems to be mediated by the listener's arousal.

Amygdala damage impairs emotion recognition from music

The role of the amygdala in recognition of danger is well established for visual stimuli such as faces. A similar role in another class of emotionally potent stimuli -- music -- has been recently suggested by the study of epileptic patients with unilateral resection of the anteromedian part of the temporal lobe [Gosselin, N., Peretz, I., Noulhiane, M., Hasboun, D., Beckett, C., & Baulac, M., et al. (2005). Impaired recognition of scary music following unilateral temporal lobe excision. Brain, 128(Pt 3), 628-640]. The goal of the present study was to assess the specific role of the amygdala in the recognition of fear from music. To this aim, we investigated a rare subject, S.M., who has complete bilateral damage relatively restricted to the amygdala and not encompassing other sectors of the temporal lobe. In Experiment 1, S.M. and four matched controls were asked to rate the intensity of fear, peacefulness, happiness, and sadness from computer-generated instrumental music purposely created to express those emotions. Subjects also rated the arousal and valence of each musical stimulus. An error detection task assessed basic auditory perceptual function. S.M. performed normally in this perceptual task, but was selectively impaired in the recognition of scary and sad music. In contrast, her recognition of happy music was normal. Furthermore, S.M. judged the scary music to be less arousing and the peaceful music less relaxing than did the controls. Overall, the pattern of impairment in S.M. is similar to that previously reported in patients with unilateral anteromedial temporal lobe damage. S.M.'s impaired emotional judgments occur in the face of otherwise intact processing of musical features that are emotionally determinant. The use of tempo and mode cues in distinguishing happy from sad music was also spared in S.M. Thus, the amygdala appears to be necessary for emotional processing of music rather than the perceptual processing itself.

Cardiovascular and respiratory responses during musical mood induction

Music is used to induce moods in experimental settings as well as for therapeutic purposes. Prior studies suggest that subjects listening to certain types of music experience strong moods and show physiological responses associated with the induced emotions. We hypothesized that cardiovascular and respiratory patterns could discriminate moods induced via music. 18 healthy subjects listened to 12 music clips, four each to induce happiness, sadness, and fear, while cardiovascular and respiratory responses were recorded using an electrocardiogram and chest strain-gauge belt. After each clip subjects completed a questionnaire. Subjects consistently reported experiencing the targeted mood, suggesting successful mood induction. Cardiovascular activity was measured by calculating time domain measures and heart rate changes during each clip. Respiratory activity was measured by total, inspiration, and expiration lengths as well as changes in mean respiration rate during each clip. Evaluation of individuals' patterns and mixed-model analyses were performed. Contrary to expectations, the time domain measures of subjects' cardiovascular responses did not vary significantly between the induced moods, although a heart rate deceleration was found during the sadness inductions and acceleration during the fear inductions. The time domain respiratory measures varied with clip type: the mean breath length was longest for the sad induction, intermediate during fear, and shortest during the happiness induction. However, analysis using normalized least mean squares adaptive filters to measure time correlation indicated that much of this difference may be attributable to entrainment of respiration to characteristics of the music which varied between the stimuli. Our findings point to the difficulty in detecting psychophysiological correlates of mood induction, and further suggest that part of this difficulty may arise from failure to differentiate it from tempo-related contributions when music is used as the inducer.

The nature of music from a biological perspective

Music, as language, is a universal human trait. Throughout human history and across all cultures, people have produced and enjoyed music. Despite its ubiquity, the musical capacity is rarely studied as a biological function. Music is typically viewed as a cultural invention. In this paper, the evidence bearing on the biological perspective of the musical capacity is reviewed. Related issues, such as domain-specificity, innateness, and brain localization, are addressed in an attempt to offer a unified conceptual basis for the study of music processing. This scheme should facilitate the study of the biological foundations of music by bringing together the fields of genetics, developmental and comparative research, neurosciences, and musicology.

Brain regions involved in the recognition of happiness and sadness in music

Here, we used functional magnetic resonance imaging to test for the lateralization of the brain regions specifically involved in the recognition of negatively and positively valenced musical emotions. The manipulation of two major musical features (mode and tempo), resulting in the variation of emotional perception along the happiness-sadness axis, was shown to principally involve subcortical and neocortical brain structures, which are known to intervene in emotion processing in other modalities. In particular, the minor mode (sad excerpts) involved the left orbito and mid-dorsolateral frontal cortex, which does not confirm the valence lateralization model. We also show that the recognition of emotions elicited by variations of the two perceptual determinants rely on both common (BA 9) and distinct neural mechanisms.

Decoding speech prosody: do music lessons help?

Three experiments revealed that music lessons promote sensitivity to emotions conveyed by speech prosody. After hearing semantically neutral utterances spoken with emotional (i.e., happy, sad, fearful, or angry) prosody, or tone sequences that mimicked the utterances' prosody, participants identified the emotion conveyed. In Experiment 1 (n=20), musically trained adults performed better than untrained adults. In Experiment 2 (n=56), musically trained adults outperformed untrained adults at identifying sadness, fear, or neutral emotion. In Experiment 3 (n=43), 6-year-olds were tested after being randomly assigned to 1 year of keyboard, vocal, drama, or no lessons. The keyboard group performed equivalently to the drama group and better than the no-lessons group at identifying anger or fear.

Communication of emotions in vocal expression and music performance: different channels, same code?

Many authors have speculated about a close relationship between vocal expression of emotions and musical expression of emotions. but evidence bearing on this relationship has unfortunately been lacking. This review of 104 studies of vocal expression and 41 studies of music performance reveals similarities between the 2 channels concerning (a) the accuracy with which discrete emotions were communicated to listeners and (b) the emotion-specific patterns of acoustic cues used to communicate each emotion. The patterns are generally consistent with K. R. Scherer's (1986) theoretical predictions. The results can explain why music is perceived as expressive of emotion, and they are consistent with an evolutionary perspective on vocal expression of emotions. Discussion focuses on theoretical accounts and directions for future research.