The role of expectation in music: from the score to emotions and the brain

Lights on music cognition: A systematic and critical review of fNIRS applications and future perspectives

Research investigating the neural processes related to music perception and production constitutes a well-established field within the cognitive neurosciences. While most neuroimaging tools have limitations in studying the complexity of musical experiences, functional Near-Infrared Spectroscopy (fNIRS) represents a promising, relatively new tool for studying music processes in both laboratory and ecological settings, which is also suitable for both typical and pathological populations across development. Here we systematically review fNIRS studies on music cognition, highlighting prospects and potentialities. We also include an overview of fNIRS basic theory, together with a brief comparison to characteristics of other neuroimaging tools. Fifty-nine studies meeting inclusion criteria (i.e., using fNIRS with music as the primary stimulus) are presented across five thematic sections. Critical discussion of methodology leads us to propose guidelines of good practices aiming for robust signal analyses and reproducibility. A continuously updated world map is proposed, including basic information from studies meeting the inclusion criteria. It provides an organized, accessible, and updatable reference database, which could serve as a catalyst for future collaborations within the community. In conclusion, fNIRS shows potential for investigating cognitive processes in music, particularly in ecological contexts and with special populations, aligning with current research priorities in music cognition.

Perceptual representations mediate effects of stimulus properties on liking for music

Perceptual pleasure and its concomitant hedonic value play an essential role in everyday life, motivating behavior and thus influencing how individuals choose to spend their time and resources. However, how pleasure arises from perception of sensory information remains relatively poorly understood. In particular, research has neglected the question of how perceptual representations mediate the relationships between stimulus properties and liking (e.g., stimulus symmetry can only affect liking if it is perceived). The present research addresses this gap for the first time, analyzing perceptual and liking ratings of 96 nonmusicians (power of 0.99) and finding that perceptual representations mediate effects of feature-based and information-based stimulus properties on liking for a novel set of melodies varying in balance, contour, symmetry, or complexity. Moreover, variability due to individual differences and stimuli accounts for most of the variance in liking. These results have broad implications for psychological research on sensory valuation, advocating a more explicit account of random variability and the mediating role of perceptual representations of stimulus properties.

Temporal Predictions in Space: Isochronous Rhythms Promote Forward Projections of the Body

A regular rhythmic stimulation increases people's ability to anticipate future events in time and to move their body in space. Temporal concepts are usually prescribed to spatial locations through a past-behind and future-ahead mapping. In this study, we tested the hypothesis that a regular rhythmic stimulation could promote the forward-body (i.e., toward the future) projections in the peri-personal space. In a Visual Approach/Avoidance by the Self Task (VAAST), participants (N = 24) observed a visual scene on the screen (i.e., a music studio with a metronome in the middle). They were exposed to 3 s of auditory isochronous or non-isochronous rhythms, after which they were asked to make as quickly as possible a perceptual judgment on the visual scene (i.e., whether the metronome pendulum was pointing to the right or left). The responses could trigger a forward or backward visual flow, i.e., approaching or moving them away from the scene. Results showed a significant interaction between the rhythmic stimulation and the movement projections (p < 0.001): participants were faster for responses triggering forward-body projections (but not backward-body projections) after the exposure to isochronous (but not non-isochronous) rhythm. By highlighting the strong link between isochronous rhythms and forward-body projections, these findings support the idea that temporal predictions driven by a regular auditory stimulation are grounded in a perception-action system integrating temporal and spatial information.

Cortical activity during naturalistic music listening reflects short-range predictions based on long-term experience

Expectations shape our experience of music. However, the internal model upon which listeners form melodic expectations is still debated. Do expectations stem from Gestalt-like principles or statistical learning? If the latter, does long-term experience play an important role, or are short-term regularities sufficient? And finally, what length of context informs contextual expectations? To answer these questions, we presented human listeners with diverse naturalistic compositions from Western classical music, while recording neural activity using MEG. We quantified note-level melodic surprise and uncertainty using various computational models of music, including a state-of-the-art transformer neural network. A time-resolved regression analysis revealed that neural activity over fronto-temporal sensors tracked melodic surprise particularly around 200ms and 300-500ms after note onset. This neural surprise response was dissociated from sensory-acoustic and adaptation effects. Neural surprise was best predicted by computational models that incorporated long-term statistical learning-rather than by simple, Gestalt-like principles. Yet, intriguingly, the surprise reflected primarily short-range musical contexts of less than ten notes. We present a full replication of our novel MEG results in an openly available EEG dataset. Together, these results elucidate the internal model that shapes melodic predictions during naturalistic music listening.

The Human Cerebellum as a Hub of the Predictive Brain

Although the cerebellum has long been believed to be involved uniquely in sensorimotor processes, recent research works pointed to its participation in a wide range of cognitive predictive functions. Here, we review the available evidence supporting a generalized role of the cerebellum in predictive computation. We then discuss the anatomo-physiological properties that make the cerebellum the ideal hub of the predictive brain. We further argue that cerebellar involvement in cognition may follow a continuous gradient, with higher cerebellar activity occurring for tasks relying more on predictive processes, and outline the empirical scenarios to probe this hypothesis.

Different theta connectivity patterns underlie pleasantness evoked by familiar and unfamiliar music

Music-evoked pleasantness has been extensively reported to be modulated by familiarity. Nevertheless, while the brain temporal dynamics underlying the process of giving value to music are beginning to be understood, little is known about how familiarity might modulate the oscillatory activity associated with music-evoked pleasantness. The goal of the present experiment was to study the influence of familiarity in the relation between theta phase synchronization and music-evoked pleasantness. EEG was recorded from 22 healthy participants while they were listening to both familiar and unfamiliar music and rating the experienced degree of evoked pleasantness. By exploring interactions, we found that right fronto-temporal theta synchronization was positively associated with music-evoked pleasantness when listening to unfamiliar music. On the contrary, inter-hemispheric temporo-parietal theta synchronization was positively associated with music-evoked pleasantness when listening to familiar music. These results shed some light on the possible oscillatory mechanisms underlying fronto-temporal and temporo-parietal connectivity and their relationship with music-evoked pleasantness and familiarity.

Surface and structural effects of pitch and time on global melodic expectancies

We investigated how the surface and structural information of pitch and time in melodies contribute to the perceived expectancy of melodic segments. The contour (pitch surface), tonality (pitch structure), rhythm (time surface) and metre (time structure) were preserved or altered in factorial fashion, either for the full length of a melody (Full condition) or only its last phrase (Last condition). Participants (N = 24) with a range of musical training received instructions to rate how expected the second portion of a melody was, having heard its first part. Additionally, instructions varied across blocks to attend selectively to pitch, time, or both. Expectancy ratings for the Last condition were lower than for the Full condition, indicating that ratings truly reflected expectancy (rather than overall goodness, which would predict the opposite). Interestingly, tonality and rhythm contributed to global expectancy ratings, but not contour or metre. Furthermore, listeners were unable to ignore entirely either dimension, but successfully attenuated their influence in accordance with instructions. These findings offer a unique insight into music perception by testing expectancies of melody segments (beyond single-note continuations), factorially varying both the surface and structure of pitch and time, and using a selective attention manipulation.

Studying Musical and Linguistic Prediction in Comparable Ways: The Melodic Cloze Probability Method

Prediction or expectancy is thought to play an important role in both music and language processing. However, prediction is currently studied independently in the two domains, limiting research on relations between predictive mechanisms in music and language. One limitation is a difference in how expectancy is quantified. In language, expectancy is typically measured using the cloze probability task, in which listeners are asked to complete a sentence fragment with the first word that comes to mind. In contrast, previous production-based studies of melodic expectancy have asked participants to sing continuations following only one to two notes. We have developed a melodic cloze probability task in which listeners are presented with the beginning of a novel tonal melody (5-9 notes) and are asked to sing the note they expect to come next. Half of the melodies had an underlying harmonic structure designed to constrain expectations for the next note, based on an implied authentic cadence (AC) within the melody. Each such 'authentic cadence' melody was matched to a 'non-cadential' (NC) melody matched in terms of length, rhythm and melodic contour, but differing in implied harmonic structure. Participants showed much greater consistency in the notes sung following AC vs. NC melodies on average. However, significant variation in degree of consistency was observed within both AC and NC melodies. Analysis of individual melodies suggests that pitch prediction in tonal melodies depends on the interplay of local factors just prior to the target note (e.g., local pitch interval patterns) and larger-scale structural relationships (e.g., melodic patterns and implied harmonic structure). We illustrate how the melodic cloze method can be used to test a computational model of melodic expectation. Future uses for the method include exploring the interplay of different factors shaping melodic expectation, and designing experiments that compare the cognitive mechanisms of prediction in music and language.

Toward a general psychological model of tension and suspense

Tension and suspense are powerful emotional experiences that occur in a wide variety of contexts (e.g., in music, film, literature, and everyday life). The omnipresence of tension and suspense suggests that they build on very basic cognitive and affective mechanisms. However, the psychological underpinnings of tension experiences remain largely unexplained, and tension and suspense are rarely discussed from a general, domain-independent perspective. In this paper, we argue that tension experiences in different contexts (e.g., musical tension or suspense in a movie) build on the same underlying psychological processes. We discuss key components of tension experiences and propose a domain-independent model of tension and suspense. According to this model, tension experiences originate from states of conflict, instability, dissonance, or uncertainty that trigger predictive processes directed at future events of emotional significance. We also discuss possible neural mechanisms underlying tension and suspense. The model provides a theoretical framework that can inform future empirical research on tension phenomena.