Intrinsically regulated learning is modulated by synaptic dopamine signaling

Enhancing musical pleasure through shared musical experience

Music and social interactions represent two of the most important sources of pleasure in our lives, both engaging the mesolimbic dopaminergic system. However, there is limited understanding regarding whether and how sharing a musical activity in a social context influences and modifies individuals' rewarding experiences. Here, we aimed at (1) modulating the pleasure derived from music under different social scenarios and (2) further investigating its impact on reward-related prosocial behavior and memory. Across three online experiments, we simulated a socially shared music listening and found that participants' music reward was significantly modulated by the social context, with higher reported pleasure for greater levels of social sharing. Furthermore, the increased pleasure reported by the participants positively influenced prosocial behavior and memory outcomes, highlighting the facilitating role of socially boosted reward. These findings provide evidence about the rewarding nature of socially driven music experiences, with important potential implications in educational and clinical settings.

The neuroscience of active learning and direct instruction

Throughout the educational system, students experiencing active learning pedagogy perform better and fail less than those taught through direct instruction. Can this be ascribed to differences in learning from a neuroscientific perspective? This review examines mechanistic, neuroscientific evidence that might explain differences in cognitive engagement contributing to learning outcomes between these instructional approaches. In classrooms, direct instruction comprehensively describes academic content, while active learning provides structured opportunities for learners to explore, apply, and manipulate content. Synaptic plasticity and its modulation by arousal or novelty are central to all learning and both approaches. As a form of social learning, direct instruction relies upon working memory. The reinforcement learning circuit, associated agency, curiosity, and peer-to-peer social interactions combine to enhance motivation, improve retention, and build higher-order-thinking skills in active learning environments. When working memory becomes overwhelmed, additionally engaging the reinforcement learning circuit improves retention, providing an explanation for the benefits of active learning. This analysis provides a mechanistic examination of how emerging neuroscience principles might inform pedagogical choices at all educational levels.

Elevator music as a tool for the quantitative characterization of reward

While certain musical genres and songs are widely popular, there is still large variability in the music that individuals find rewarding or emotional, even among those with a similar musical enculturation. Interestingly, there is one Western genre that is intended to attract minimal attention and evoke a mild emotional response: elevator music. In a series of behavioral experiments, we show that elevator music consistently elicits low pleasure and surprise. Participants reported elevator music as being less pleasurable than music from popular genres, even when participants did not regularly listen to the comparison genre. Participants reported elevator music to be familiar even when they had not explicitly heard the presented song before. Computational and behavioral measures of surprisal showed that elevator music was less surprising, and thus more predictable, than other well-known genres. Elevator music covers of popular songs were rated as less pleasurable, surprising, and arousing than their original counterparts. Finally, we used elevator music as a control for self-selected rewarding songs in a proof-of-concept physiological (electrodermal activity and piloerection) experiment. Our results suggest that elevator music elicits low emotional responses consistently across Western music listeners, making it a unique control stimulus for studying musical novelty, pleasure, and surprise.

The role of intrinsic reward in adolescent word learning

Relatively little work has focused on why we are motivated to learn words. In adults, recent experiments have shown that intrinsic reward signals accompany successful word learning from context. In addition, the experience of reward facilitated long-term memory for words. In adolescence, developmental changes are seen in reward and motivation systems as well as in reading and language systems. Here, in the face of this developmental change, we ask whether adolescents experience reward from word learning, and how the reward and memory benefit seen in adults is modulated by age. We used a naturalistic reading paradigm, which involved extracting novel word meanings from sentence context without the need for explicit feedback. By exploring ratings of enjoyment during the learning phase, as well as recognition memory for words a day later, we assessed whether adolescents show the same reward and learning patterns as adults. We tested 345 children between the ages of 10-18 (N > 84 in each 2-year age-band) using this paradigm. We found evidence for our first prediction: children aged 10-18 report greater enjoyment for successful word learning. However, we did not find evidence for age-related change in this developmental period, or memory benefits. This work gives us greater insight into the process of language acquisition and sets the stage for further investigations of intrinsic reward in typical and atypical development. RESEARCH HIGHLIGHTS: We constantly learn words from context, even in the absence of explicit rewards or feedback. In adults, intrinsic reward experienced during word learning is linked to a dopaminergic circuit in the brain, which also fuels enhancements in memory for words. We find adolescents also report enhanced reward or enjoyment when they successfully learn words from sentence context. The relationship between reward and learning is maintained between the ages of 10 and 18. Unlike in adults, we did not observe ensuing memory benefits.

Dopamine Increases Accuracy and Lengthens Deliberation Time in Explicit Motor Skill Learning

Although animal research implicates a central role for dopamine in motor skill learning, a direct causal link has yet to be established in neurotypical humans. Here, we tested if a pharmacological manipulation of dopamine alters motor learning, using a paradigm which engaged explicit, goal-directed strategies. Participants (27 females; 11 males; aged 18-29 years) first consumed either 100 mg of levodopa (n = 19), a dopamine precursor that increases dopamine availability, or placebo (n = 19). Then, during training, participants learnt the explicit strategy of aiming away from presented targets by instructed angles of varying sizes. Targets jumped mid-movement by the instructed aiming angle. Task success was thus contingent upon aiming accuracy and not speed. The effect of the dopamine manipulations on skill learning was assessed during training and after an overnight follow-up. Increasing dopamine availability at training improved aiming accuracy and lengthened reaction times, particularly for larger, more difficult aiming angles, both at training and, importantly, at follow-up, despite prominent session-by-session performance improvements in both accuracy and speed. Exogenous dopamine thus seems to result in a learnt, persistent propensity to better adhere to task goals. Results support the proposal that dopamine is important in engagement of instrumental motivation to optimize adherence to task goals, particularly when learning to execute goal-directed strategies in motor skill learning.

Sensory cortex plasticity supports auditory social learning

Social learning (SL) through experience with conspecifics can facilitate the acquisition of many behaviors. Thus, when Mongolian gerbils are exposed to a demonstrator performing an auditory discrimination task, their subsequent task acquisition is facilitated, even in the absence of visual cues. Here, we show that transient inactivation of auditory cortex (AC) during exposure caused a significant delay in task acquisition during the subsequent practice phase, suggesting that AC activity is necessary for SL. Moreover, social exposure induced an improvement in AC neuron sensitivity to auditory task cues. The magnitude of neural change during exposure correlated with task acquisition during practice. In contrast, exposure to only auditory task cues led to poorer neurometric and behavioral outcomes. Finally, social information during exposure was encoded in the AC of observer animals. Together, our results suggest that auditory SL is supported by AC neuron plasticity occurring during social exposure and prior to behavioral performance.

Prioritizing genes associated with brain disorders by leveraging enhancer-promoter interactions in diverse neural cells and tissues

BACKGROUND

Prioritizing genes that underlie complex brain disorders poses a considerable challenge. Despite previous studies have found that they shared symptoms and heterogeneity, it remained difficult to systematically identify the risk genes associated with them.

METHODS

By using the CAGE (Cap Analysis of Gene Expression) read alignment files for 439 human cell and tissue types (including primary cells, tissues and cell lines) from FANTOM5 project, we predicted enhancer-promoter interactions (EPIs) of 439 cell and tissue types in human, and examined their reliability. Then we evaluated the genetic heritability of 17 diverse brain disorders and behavioral-cognitive phenotypes in each neural cell type, brain region, and developmental stage. Furthermore, we prioritized genes associated with brain disorders and phenotypes by leveraging the EPIs in each neural cell and tissue type, and analyzed their pleiotropy and functionality for different categories of disorders and phenotypes. Finally, we characterized the spatiotemporal expression dynamics of these associated genes in cells and tissues.

RESULTS

We found that identified EPIs showed activity specificity and network aggregation in cell and tissue types, and enriched TF binding in neural cells played key roles in synaptic plasticity and nerve cell development, i.e., EGR1 and SOX family. We also discovered that most neurological disorders exhibit heritability enrichment in neural stem cells and astrocytes, while psychiatric disorders and behavioral-cognitive phenotypes exhibit enrichment in neurons. Furthermore, our identified genes recapitulated well-known risk genes, which exhibited widespread pleiotropy between psychiatric disorders and behavioral-cognitive phenotypes (i.e., FOXP2), and indicated expression specificity in neural cell types, brain regions, and developmental stages associated with disorders and phenotypes. Importantly, we showed the potential associations of brain disorders with brain regions and developmental stages that have not been well studied.

CONCLUSIONS

Overall, our study characterized the gene-enhancer regulatory networks and genetic mechanisms in the human neural cells and tissues, and illustrated the value of reanalysis of publicly available genomic datasets.

Using a willingness to wait design to assess how readers value text

What affects moment-to-moment motivation to read? Existing reading motivation questionnaires are trait-based and not well suited to capturing the dynamic, situational influences of text or social context. Drawing on the decision science literature, we have created a paradigm to measure situational enjoyment during reading. Using this paradigm, we find reading enjoyment is associated with further decision-making about the text and with reading comprehension.

Children's affective involvement in early word learning

The current study set out to examine the underlying physiological mechanisms of and the emotional response associated with word learning success in young 3-year-old predominantly white children. In particular, we examined whether children's physiological arousal following a word learning task predicts their word learning success and whether successful learning in turn predicts children's subsequent positive emotions. We presented children (n = 50) with a cross-situational word learning task and measured their pupillary arousal following completion of the task, as well as changes to their upper body posture following completion of the task, as indices of children's emotions following task completion. Children who showed greater physiological arousal following the novel word recognition task (n = 40) showed improved subsequent word recognition performance. We found that children showed more elevated posture after completing a familiar word learning task compared to completing a novel word learning task (n = 33) but results on children's individual learning success and postural elevation were mixed. We discuss the findings with regards to children's affective involvement in word learning.

The influence of music liking on episodic memory for rich spatiotemporal contexts

It is thought that the presence of music influences episodic memory encoding. However, no studies have isolated the influence of music liking - the hedonic value listeners attribute to a musical stimulus - from that of the core affect induced by the presence of that music. In an online survey, participants rated musical excerpts in terms of how much they liked them, as well as in terms of felt valence, felt arousal and familiarity. These ratings were then used to inform the stimuli presented in an online episodic memory task which, across different scenarios, involved dragging cued objects to cued locations and then recalling details of what was moved, where they were moved to and the order of movements made. Our results showed an influence of liking and music-reward sensitivity on memory for what was moved, as well as a detrimental effect of arousing musical stimuli on memory for un-cued scenario details. Taken together, our study showcases the importance of episodic memory paradigms that involve rich spatiotemporal contexts and provides insights into how different aspects of episodic memory may be influenced by the presence of music.

Can rhythm-mediated reward boost learning, memory, and social connection? Perspectives for future research

Studies of rhythm processing and of reward have progressed separately, with little connection between the two. However, consistent links between rhythm and reward are beginning to surface, with research suggesting that synchronization to rhythm is rewarding, and that this rewarding element may in turn also boost this synchronization. The current mini review shows that the combined study of rhythm and reward can be beneficial to better understand their independent and combined roles across two central aspects of cognition: 1) learning and memory, and 2) social connection and interpersonal synchronization; which have so far been studied largely independently. From this basis, it is discussed how connections between rhythm and reward can be applied to learning and memory and social connection across different populations, taking into account individual differences, clinical populations, human development, and animal research. Future research will need to consider the rewarding nature of rhythm, and that rhythm can in turn boost reward, potentially enhancing other cognitive and social processes.

Individuals with congenital amusia remember music they like

Music is better recognized when it is liked. Does this association remain evident when music perception and memory are severely impaired, as in congenital amusia? We tested 11 amusic and 11 matched control participants, asking whether liking of a musical excerpt influences subsequent recognition. In an initial exposure phase, participants-unaware that their recognition would be tested subsequently-listened to 24 musical excerpts and judged how much they liked each excerpt. In the test phase that followed, participants rated whether they recognized the previously heard excerpts, which were intermixed with an equal number of foils matched for mode, tempo, and musical genre. As expected, recognition was in general impaired for amusic participants compared with control participants. For both groups, however, recognition was better for excerpts that were liked, and the liking enhancement did not differ between groups. These results contribute to a growing body of research that examines the complex interplay between emotions and cognitive processes. More specifically, they extend previous findings related to amusics' impairments to a new memory paradigm and suggest that (1) amusic individuals are sensitive to an aesthetic and subjective dimension of the music-listening experience, and (2) emotions can support memory processes even in a population with impaired music perception and memory.

Entering into a self-regulated learning mode prevents detrimental effects of feedback removal on memory

Incentives can decrease performance by undermining intrinsic motivation. How such an interplay of external reinforcers and internal self-regulation influences memory processes, however, is less known. Here, we investigated their interaction on memory performance while learning the meaning of new-words from their context. Specifically, participants inferred congruent meanings of new-words from semantic context (congruent trials) or lack of congruence (incongruent trials), while receiving external feedback in the first or second half of trials only. Removing feedback during learning of congruent word meanings lowered subsequent recognition rates a day later, whereas recognition remained high in the group, which received feedback only in the second half. In contrast, feedback did not substantially alter recognition rates for learning that new-words had no congruent meanings. Our findings suggest that external reinforcers can selectively impair memories if internal self-regulated processes are not already established, but whether they do so depends on what is being learned (specific word-meanings vs. unspecific incongruence). This highlights the relevance of self-regulated learning in education to support stable memory formation.

Memory modulations through musical pleasure

Music, thanks to its strong evocative power, is considered a powerful mnemonic tool for both normal and clinical populations. However, the mechanisms underpinning the music-driven benefits on memory remain unclear. In memory research, reward dopaminergic signals have been highlighted as a major modulator of memory traces consolidation. Over the last years, via behavioral and pharmacological approaches, we have investigated the hypothesis that dopaminergic-dependent musical pleasure is a crucial mechanism underpinning music-driven memory benefits. Our results show that the pleasure felt during music listening, modulated by both the dopaminergic transmission and participants' sensitivity to music reward, can increase episodic memory performance for the music itself as well as for nonmusical-associated information. In this commentary paper, we aim to review the main findings obtained from three different studies, in order to discuss current advances and future directions in this research area.

Non-sensory Influences on Auditory Learning and Plasticity

Distinguishing between regular and irregular heartbeats, conversing with speakers of different accents, and tuning a guitar-all rely on some form of auditory learning. What drives these experience-dependent changes? A growing body of evidence suggests an important role for non-sensory influences, including reward, task engagement, and social or linguistic context. This review is a collection of contributions that highlight how these non-sensory factors shape auditory plasticity and learning at the molecular, physiological, and behavioral level. We begin by presenting evidence that reward signals from the dopaminergic midbrain act on cortico-subcortical networks to shape sound-evoked responses of auditory cortical neurons, facilitate auditory category learning, and modulate the long-term storage of new words and their meanings. We then discuss the role of task engagement in auditory perceptual learning and suggest that plasticity in top-down cortical networks mediates learning-related improvements in auditory cortical and perceptual sensitivity. Finally, we present data that illustrates how social experience impacts sound-evoked activity in the auditory midbrain and forebrain and how the linguistic environment rapidly shapes speech perception. These findings, which are derived from both human and animal models, suggest that non-sensory influences are important regulators of auditory learning and plasticity and are often implemented by shared neural substrates. Application of these principles could improve clinical training strategies and inform the development of treatments that enhance auditory learning in individuals with communication disorders.

Aesthetic chills cause an emotional drift in valence and arousal

Aesthetic chills are an embodied peak emotional experience induced by stimuli such as music, films, and speeches and characterized by dopaminergic release. The emotional consequences of chills in terms of valence and arousal are still debated and the existing empirical data is conflicting. In this study, we tested the effects of ChillsDB, an open-source repository of chills-inducing stimuli, on the emotional ratings of 600+ participants. We found that participants experiencing chills reported significantly more positive valence and greater arousal during the experience, compared to participants who did not experience chills. This suggests that the embodied experience of chills may influence one's perception and affective evaluation of the context, in favor of theoretical models emphasizing the role of interoceptive signals such as chills in the process of perception and decision-making. We also found an interesting pattern in the valence ratings of participants, which tended to harmonize toward a similar mean after the experiment, though initially disparately distributed. We discuss the significance of these results for the diagnosis and treatment of dopaminergic disorders such as Parkinson's, schizophrenia, and depression.

Better language through chemistry: Augmenting speech-language therapy with pharmacotherapy in the treatment of aphasia

Speech and language therapy is the standard treatment of aphasia. However, many individuals have barriers in seeking this measure of extensive rehabilitation treatment. Investigating ways to augment therapy is key to improving poststroke language outcomes for all patients with aphasia, and pharmacotherapies provide one such potential solution. Although no medications are currently approved for the treatment of aphasia by the United States Food and Drug Administration, numerous candidate mechanisms for pharmaceutical manipulation continue to be identified based on our evolving understanding of the neurometabolic experience of stroke recovery across molecular, cellular, and functional levels of inquiry. This chapter will review evidence for catecholaminergic, glutamatergic, cholinergic, and serotonergic drug therapies and discuss future directions for both candidate drug selection and pharmacotherapy practice in people with aphasia.

Language statistical learning responds to reinforcement learning principles rooted in the striatum

Statistical learning (SL) is the ability to extract regularities from the environment. In the domain of language, this ability is fundamental in the learning of words and structural rules. In lack of reliable online measures, statistical word and rule learning have been primarily investigated using offline (post-familiarization) tests, which gives limited insights into the dynamics of SL and its neural basis. Here, we capitalize on a novel task that tracks the online SL of simple syntactic structures combined with computational modeling to show that online SL responds to reinforcement learning principles rooted in striatal function. Specifically, we demonstrate—on 2 different cohorts—that a temporal difference model, which relies on prediction errors, accounts for participants’ online learning behavior. We then show that the trial-by-trial development of predictions through learning strongly correlates with activity in both ventral and dorsal striatum. Our results thus provide a detailed mechanistic account of language-related SL and an explanation for the oft-cited implication of the striatum in SL tasks. This work, therefore, bridges the long-standing gap between language learning and reinforcement learning phenomena.

Statistical learning is the ability to extract regularities from the environment; in the domain of language, this ability is fundamental in the learning of words and structural rules. This study uses a combination of computational modelling and functional MRI to reveal a fundamental link between online language statistical learning and reinforcement learning at the algorithmic and implementational levels.

Dopamine modulations of reward-driven music memory consolidation

Music listening provides one of the most significant abstract rewards for humans because hearing music activates the dopaminergic mesolimbic system. Given the strong link between reward, dopamine, and memory, we aimed here to investigate the hypothesis that dopamine-dependent musical reward can drive memory improvements. Twenty-nine healthy participants of both sexes provided reward ratings of unfamiliar musical excerpts that had to be remembered following a consolidation period under three separate conditions: after the ingestion of a dopaminergic antagonist, a dopaminergic precursor, or a placebo. Linear mixed modeling of the intervention data showed that the effect of reward on memory-i.e., the greater the reward experienced while listening to the musical excerpts, the better the memory recollection performance-was modulated by both dopaminergic signaling and individual differences in reward processing. Greater pleasure was consistently associated with better memory outcomes in participants with high sensitivity to musical reward, but this effect was lost when dopaminergic signaling was disrupted in participants with average or low musical hedonia. Our work highlights the flexibility of the human dopaminergic system, which can enhance memory formation not only through explicit and/or primary reinforcers but also via abstract and aesthetic rewards such as music.

Dopaminergic signaling supports auditory social learning

Explicit rewards are commonly used to reinforce a behavior, a form of learning that engages the dopaminergic neuromodulatory system. In contrast, skill acquisition can display dramatic improvements from a social learning experience, even though the observer receives no explicit reward. Here, we test whether a dopaminergic signal contributes to social learning in naïve gerbils that are exposed to, and learn from, a skilled demonstrator performing an auditory discrimination task. Following five exposure sessions, naïve observer gerbils were allowed to practice the auditory task and their performance was assessed across days. We first tested the effect of an explicit food reward in the observer's compartment that was yoked to the demonstrator's performance during exposure sessions. Naïve observer gerbils with the yoked reward learned the discrimination task significantly faster, as compared to unrewarded observers. The effect of this explicit reward was abolished by administration of a D1/D5 dopamine receptor antagonist during the exposure sessions. Similarly, the D1/D5 antagonist reduced the rate of learning in unrewarded observers. To test whether a dopaminergic signal was sufficient to enhance social learning, we administered a D1/D5 receptor agonist during the exposure sessions in which no reward was present and found that the rate of learning occurred significantly faster. Finally, a quantitative analysis of vocalizations during the exposure sessions suggests one behavioral strategy that contributes to social learning. Together, these results are consistent with a dopamine-dependent reward signal during social learning.

Corticostriatal Regulation of Language Functions

The role of corticostriatal circuits in language functions is unclear. In this review, we consider evidence from language learning, syntax, and controlled language production and comprehension tasks that implicate various corticostriatal circuits. Converging evidence from neuroimaging in healthy individuals, studies in populations with subcortical dysfunction, pharmacological studies, and brain stimulation suggests a domain-general regulatory role of corticostriatal systems in language operations. The role of corticostriatal systems in language operations identified in this review is likely to reflect a broader function of the striatum in responding to uncertainty and conflict which demands selection, sequencing, and cognitive control. We argue that this role is dynamic and varies depending on the degree and form of cognitive control required, which in turn will recruit particular corticostriatal circuits and components organised in a cognitive hierarchy.

Unraveling the Temporal Dynamics of Reward Signals in Music-Induced Pleasure with TMS

Music's ability to induce feelings of pleasure has been the subject of intense neuroscientific research lately. Prior neuroimaging studies have shown that music-induced pleasure engages cortico-striatal circuits related to the anticipation and receipt of biologically relevant rewards/incentives, but these reports are necessarily correlational. Here, we studied both the causal role of this circuitry and its temporal dynamics by applying transcranial magnetic stimulation (TMS) over the left dorsolateral PFC combined with fMRI in 17 male and female participants. Behaviorally, we found that, in accord with previous findings, excitation of fronto-striatal pathways enhanced subjective reports of music-induced pleasure and motivation, whereas inhibition of the same circuitry led to the reduction of both. fMRI activity patterns indicated that these behavioral changes were driven by bidirectional TMS-induced alteration of fronto-striatal function. Specifically, changes in activity in the NAcc predicted modulation of both hedonic and motivational responses, with a dissociation between pre-experiential versus experiential components of musical reward. In addition, TMS-induced changes in the fMRI functional connectivity between the NAcc and frontal and auditory cortices predicted the degree of modulation of hedonic responses. These results indicate that the engagement of cortico-striatal pathways and the NAcc, in particular, is indispensable to experience rewarding feelings from music.SIGNIFICANCE STATEMENT Neuroimaging studies have shown that music-induced pleasure engages cortico-striatal circuits involved in the processing of biologically relevant rewards. Yet, these reports are necessarily correlational. Here, we studied both the causal role of this circuitry and its temporal dynamics by combining brain stimulation over the frontal cortex with functional imaging. Behaviorally, we found that excitation and inhibition of fronto-striatal pathways enhanced and disrupted, respectively, subjective reports of music-induced pleasure and motivation. These changes were associated with changes in NAcc activity and NAcc coupling with frontal and auditory cortices, dissociating between pre-experimental versus experiential components of musical reward. These results indicate that the engagement of cortico-striatal pathways, and the NAcc in particular, is indispensable to experience rewarding feeling from music.

Beneficial effects of choir singing on cognition and well-being of older adults: Evidence from a cross-sectional study

Background and objectives

Choir singing has been associated with better mood and quality of life (QOL) in healthy older adults, but little is known about its potential cognitive benefits in aging. In this study, our aim was to compare the subjective (self-reported) and objective (test-based) cognitive functioning of senior choir singers and matched control subjects, coupled with assessment of mood, QOL, and social functioning.

Research design and methods

We performed a cross-sectional questionnaire study in 162 healthy older (age ≥ 60 years) adults (106 choir singers, 56 controls), including measures of cognition, mood, social engagement, QOL, and role of music in daily life. The choir singers were divided to low (1–10 years, N = 58) and high (>10 years, N = 48) activity groups based on years of choir singing experience throughout their life span. A subcohort of 74 participants (39 choir singers, 35 controls) were assessed also with a neuropsychological testing battery.

Results

In the neuropsychological testing, choir singers performed better than controls on the verbal flexibility domain of executive function, but not on other cognitive domains. In questionnaires, high activity choir singers showed better social integration than controls and low activity choir singers. In contrast, low activity choir singers had better general health than controls and high activity choir singers.

Discussion and implications

In healthy older adults, regular choir singing is associated with better verbal flexibility. Long-standing choir activity is linked to better social engagement and more recently commenced choir activity to better general health.

Signed Reward Prediction Errors in the Ventral Striatum Drive Episodic Memory

Recent behavioral evidence implicates reward prediction errors (RPEs) as a key factor in the acquisition of episodic memory. Yet, important neural predictions related to the role of RPEs in episodic memory acquisition remain to be tested. Humans (both sexes) performed a novel variable-choice task where we experimentally manipulated RPEs and found support for key neural predictions with fMRI. Our results show that in line with previous behavioral observations, episodic memory accuracy increases with the magnitude of signed (i.e., better/worse-than-expected) RPEs (SRPEs). Neurally, we observe that SRPEs are encoded in the ventral striatum (VS). Crucially, we demonstrate through mediation analysis that activation in the VS mediates the experimental manipulation of SRPEs on episodic memory accuracy. In particular, SRPE-based responses in the VS (during learning) predict the strength of subsequent episodic memory (during recollection). Furthermore, functional connectivity between task-relevant processing areas (i.e., face-selective areas) and hippocampus and ventral striatum increased as a function of RPE value (during learning), suggesting a central role of these areas in episodic memory formation. Our results consolidate reinforcement learning theory and striatal RPEs as key factors subtending the formation of episodic memory.SIGNIFICANCE STATEMENT Recent behavioral research has shown that reward prediction errors (RPEs), a key concept of reinforcement learning theory, are crucial to the formation of episodic memories. In this study, we reveal the neural underpinnings of this process. Using fMRI, we show that signed RPEs (SRPEs) are encoded in the ventral striatum (VS), and crucially, that SRPE VS activity is responsible for the subsequent recollection accuracy of one-shot learned episodic memory associations.

The impact of musical pleasure and musical hedonia on verbal episodic memory

Music listening is one of the most pleasurable activities in our life. As a rewarding stimulus, pleasant music could induce long-term memory improvements for the items encoded in close temporal proximity. In the present study, we behaviourally investigated (1) whether musical pleasure and musical hedonia enhance verbal episodic memory, and (2) whether such enhancement takes place even when the pleasant stimulus is not present during the encoding. Participants (N = 100) were asked to encode words presented in different auditory contexts (highly and lowly pleasant classical music, and control white noise), played before and during (N = 49), or only before (N = 51) the encoding. The Barcelona Music Reward Questionnaire was used to measure participants’ sensitivity to musical reward. 24 h later, participants’ verbal episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed that participants with a high musical reward sensitivity present an increased recollection performance, especially for words encoded in a highly pleasant musical context. Furthermore, this effect persists even when the auditory stimulus is not concurrently present during the encoding of target items. Taken together, these findings suggest that musical pleasure might constitute a helpful encoding context able to drive memory improvements via reward mechanisms.

The impact of musical pleasure and musical hedonia on verbal episodic memory

Music listening is one of the most pleasurable activities in our life. As a rewarding stimulus, pleasant music could induce long-term memory improvements for the items encoded in close temporal proximity. In the present study, we behaviourally investigated (1) whether musical pleasure and musical hedonia enhance verbal episodic memory, and (2) whether such enhancement takes place even when the pleasant stimulus is not present during the encoding. Participants (N = 100) were asked to encode words presented in different auditory contexts (highly and lowly pleasant classical music, and control white noise), played before and during (N = 49), or only before (N = 51) the encoding. The Barcelona Music Reward Questionnaire was used to measure participants' sensitivity to musical reward. 24 h later, participants' verbal episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed that participants with a high musical reward sensitivity present an increased recollection performance, especially for words encoded in a highly pleasant musical context. Furthermore, this effect persists even when the auditory stimulus is not concurrently present during the encoding of target items. Taken together, these findings suggest that musical pleasure might constitute a helpful encoding context able to drive memory improvements via reward mechanisms.

Elizabeth Usher Memorial Lecture: Lost in Translation? Challenges and future prospects for a neurobiological approach to aphasia rehabilitation

While there has been considerable progress in conducting trials of aphasia therapy, there is no consistent evidence for long-term benefits of aphasia treatment, suggesting the need to reconsider current approaches. There are also no accurate methods for determining the amount, type and timing of aphasia therapy that should be provided for an individual. At the same time, there has been increasing interest in applying various principles of neuroplasticity to aphasia treatment and using measures of brain structure and function to predict recovery. This article will consider the potential of neuroplasticity principles and neurobiological predictors to improve our current approach to aphasia rehabilitation and optimise outcomes. Reviewing these principles highlights some of the challenges of translating animal model-based principles and emphases the need to also consider relevant theories of human learning. While considerable progress has been made in considering neurobiological principles and using measures of brain structure and function to predict recovery, there is significant work required to achieve the full potential of this neurobiological approach to aphasia management.

How Curiosity Enhances Hippocampus-Dependent Memory: The Prediction, Appraisal, Curiosity, and Exploration (PACE) Framework

Curiosity plays a fundamental role for learning and memory, but the neural mechanisms that stimulate curiosity and its effect on memory are poorly understood. Accumulating evidence suggests that curiosity states are related to modulations in activity in the dopaminergic circuit and that these modulations impact memory encoding and consolidation for both targets of curiosity and incidental information encountered during curiosity states. To account for this evidence, we propose the Prediction, Appraisal, Curiosity, and Exploration (PACE) framework, which attempts to explain curiosity and memory in terms of cognitive processes, neural circuits, behavior, and subjective experience. The PACE framework generates testable predictions that can stimulate future investigation of the mechanisms underlying curiosity-related memory enhancements.

White noise facilitates new-word learning from context

Listening to white noise may facilitate cognitive performance, including new word learning, for some individuals. This study investigated whether auditory white noise facilitates the learning of novel written words from context in healthy young adults. Sixty-nine participants were required to determine the meaning of novel words placed within sentence contexts during a silent reading task. Learning was performed either with or without white noise, and recognition of novel word meanings was tested immediately after learning and after a short delay. Immediate recognition accuracy for learned novel word meanings was higher in the noise group relative to the no noise group, however this effect was no longer evident at the delayed recognition test. These findings suggest that white noise has the capacity to facilitate meaning acquisition from context, however further research is needed to clarify its capacity to improve longer-term retention of meaning.

Predictability and Uncertainty in the Pleasure of Music: A Reward for Learning?

Music ranks among the greatest human pleasures. It consistently engages the reward system, and converging evidence implies it exploits predictions to do so. Both prediction confirmations and errors are essential for understanding one's environment, and music offers many of each as it manipulates interacting patterns across multiple timescales. Learning models suggest that a balance of these outcomes (i.e., intermediate complexity) optimizes the reduction of uncertainty to rewarding and pleasurable effect. Yet evidence of a similar pattern in music is mixed, hampered by arbitrary measures of complexity. In the present studies, we applied a well-validated information-theoretic model of auditory expectation to systematically measure two key aspects of musical complexity: predictability (operationalized as information content [IC]), and uncertainty (entropy). In Study 1, we evaluated how these properties affect musical preferences in 43 male and female participants; in Study 2, we replicated Study 1 in an independent sample of 27 people and assessed the contribution of veridical predictability by presenting the same stimuli seven times. Both studies revealed significant quadratic effects of IC and entropy on liking that outperformed linear effects, indicating reliable preferences for music of intermediate complexity. An interaction between IC and entropy further suggested preferences for more predictability during more uncertain contexts, which would facilitate uncertainty reduction. Repeating stimuli decreased liking ratings but did not disrupt the preference for intermediate complexity. Together, these findings support long-hypothesized optimal zones of predictability and uncertainty in musical pleasure with formal modeling, relating the pleasure of music listening to the intrinsic reward of learning.SIGNIFICANCE STATEMENT Abstract pleasures, such as music, claim much of our time, energy, and money despite lacking any clear adaptive benefits like food or shelter. Yet as music manipulates patterns of melody, rhythm, and more, it proficiently exploits our expectations. Given the importance of anticipating and adapting to our ever-changing environments, making and evaluating uncertain predictions can have strong emotional effects. Accordingly, we present evidence that listeners consistently prefer music of intermediate predictive complexity, and that preferences shift toward expected musical outcomes in more uncertain contexts. These results are consistent with theories that emphasize the intrinsic reward of learning, both by updating inaccurate predictions and validating accurate ones, which is optimal in environments that present manageable predictive challenges (i.e., reducible uncertainty).

SynGO: An Evidence-Based, Expert-Curated Knowledge Base for the Synapse

Synapses are fundamental information-processing units of the brain, and synaptic dysregulation is central to many brain disorders ("synaptopathies"). However, systematic annotation of synaptic genes and ontology of synaptic processes are currently lacking. We established SynGO, an interactive knowledge base that accumulates available research about synapse biology using Gene Ontology (GO) annotations to novel ontology terms: 87 synaptic locations and 179 synaptic processes. SynGO annotations are exclusively based on published, expert-curated evidence. Using 2,922 annotations for 1,112 genes, we show that synaptic genes are exceptionally well conserved and less tolerant to mutations than other genes. Many SynGO terms are significantly overrepresented among gene variations associated with intelligence, educational attainment, ADHD, autism, and bipolar disorder and among de novo variants associated with neurodevelopmental disorders, including schizophrenia. SynGO is a public, universal reference for synapse research and an online analysis platform for interpretation of large-scale -omics data (https://syngoportal.org and http://geneontology.org).

Dopamine modulates the reward experiences elicited by music

Understanding how the brain translates a structured sequence of sounds, such as music, into a pleasant and rewarding experience is a fascinating question which may be crucial to better understand the processing of abstract rewards in humans. Previous neuroimaging findings point to a challenging role of the dopaminergic system in music-evoked pleasure. However, there is a lack of direct evidence showing that dopamine function is causally related to the pleasure we experience from music. We addressed this problem through a double blind within-subject pharmacological design in which we directly manipulated dopaminergic synaptic availability while healthy participants (n = 27) were engaged in music listening. We orally administrated to each participant a dopamine precursor (levodopa), a dopamine antagonist (risperidone), and a placebo (lactose) in three different sessions. We demonstrate that levodopa and risperidone led to opposite effects in measures of musical pleasure and motivation: while the dopamine precursor levodopa, compared with placebo, increased the hedonic experience and music-related motivational responses, risperidone led to a reduction of both. This study shows a causal role of dopamine in musical pleasure and indicates that dopaminergic transmission might play different or additive roles than the ones postulated in affective processing so far, particularly in abstract cognitive activities.