Learning-dependent plasticity in human auditory cortex during appetitive operant conditioning

Dopamine in the songbird auditory cortex shapes auditory preference

Vocal communication signals can provide listeners with information about the signaler and elicit motivated responses. Auditory cortical and mesolimbic reward circuits are often considered to have distinct roles in these processes, with auditory cortical circuits responsible for detecting and discriminating sounds and mesolimbic circuits responsible for ascribing salience and modulating preference for those sounds. Here, we investigated whether dopamine within auditory cortical circuits themselves can shape the incentive salience of a vocal signal. Female zebra finches demonstrate natural preferences for vocal signals produced by males ("songs"), and we found that brief pairing of passive song playback with pharmacological dopamine manipulations in the secondary auditory cortex significantly altered song preferences. In particular, pairing passive song playback with retrodialysis of dopamine agonists into the auditory cortex enhanced preferences for less-preferred songs. Plasticity of song preferences by dopamine persisted for at least 1 week and was mediated by D1 receptors. In contrast, song preferences were not shaped by norepinephrine. In line with this, while we found that the ventral tegmental area, substantia nigra pars compacta, and locus coeruleus all project to the secondary auditory cortex, only dopamine-producing neurons in the ventral tegmental area differentially responded to preferred versus less-preferred songs. In contrast, norepinephrine neurons in the locus coeruleus increased expression of activity-dependent neural markers for both preferred and less-preferred songs. These data suggest that dopamine acting directly in sensory-processing areas can shape the incentive salience of communication signals.

Quantitative EEG measures in profoundly deaf and normal hearing individuals while performing a vibrotactile temporal discrimination task

Challenges in early oral language acquisition in profoundly deaf individuals have an impact on cognitive neurodevelopment. This has led to the exploration of alternative sound perception methods involving training of vibrotactile discrimination of sounds within the language spectrum. In particular, stimulus duration plays an important role in linguistic categorical perception. We comparatively evaluated vibrotactile temporal discrimination of sound and how specific training can modify the underlying electrical brain activity. Fifteen profoundly deaf (PD) and 15 normal-hearing (NH) subjects performed a vibrotactile oddball task with simultaneous EEG recording, before and after a short training period (5 one-hour sessions; in 2.5-3 weeks). The stimuli consisted of 700 Hz pure-tones with different duration (target: long 500 ms; non-target: short 250 ms). The sound-wave stimuli were delivered by a small device worn on the right index finger. A similar behavioral training effect was observed in both groups showing significant improvement in sound-duration discrimination. However, quantitative EEG measurements reveal distinct neurophysiological patterns characterized by higher and more diffuse delta band magnitudes in the PD group, together with a generalized decrement in absolute power in both groups that might reflect a facilitating process associated to learning. Furthermore, training-related changes were found in the beta-band in NH. Findings suggest PD have different cognitive adaptive mechanisms which are not a mere amplification effect due to greater cortical excitability.

Dorsal posterior cingulate cortex encodes the informational value of feedback in human-computer interaction

In communication between humans as well as in human–computer interaction, feedback is ubiquitous. It is essential for keeping up the dialogue between interaction partners, evaluating the adequacy of an action, or improving task performance. While the neuroscientific view on feedback has largely focused on its function as reward, more general definitions also emphasise its function as information about aspects of one’s task performance. Using fMRI in a computer-controlled auditory categorisation task, we studied the neural correlates of the informational value of computer-given feedback independent of reward. Feedback about the correctness of a decision, compared with feedback only indicating the registration of a decision, increases activation of the dorsal posterior cingulate cortex, supporting this region’s role in adapting to behaviourally relevant information. Both conditions elicit equally strong activation of the dorsal striatum which does not support an interpretation of feedback information as a type of reward. Instead, we suggest that it reflects a more fundamental aspect of human interaction behaviour, namely the establishment of a state that enables us to continue with the next step of the interaction.

Choice-Selective Neurons in the Auditory Cortex and in Its Striatal Target Encode Reward Expectation

Learned behavioral responses to sounds depend largely on the expected outcomes associated with each potential choice. Where and how the nervous system integrates expectations about reward with auditory sensory information to drive appropriate decisions is not fully understood. Using a two-alternative choice task in which the expected reward associated with each sound varied over time, we investigated potential sites along the corticostriatal pathway for the integration of sound signals, behavioral choice, and reward information in male mice. We found that auditory cortical neurons encode not only sound identity, but also the animal's choice and the expected size of reward. This influence of reward expectation on sound- and choice-related activity was further enhanced in the major striatal target of the auditory cortex: the posterior tail of the dorsal striatum. These results indicate that choice-specific information is integrated with reward signals throughout the corticostriatal pathway, potentially contributing to adaptation in sound-driven behavior.SIGNIFICANCE STATEMENT Learning and maintenance of sensory-motor associations require that neural circuits keep track of sensory stimuli, choices, and outcomes. It is not clear at what stages along the auditory sensorimotor pathway these signals are integrated to influence future behavior in response to sounds. Our results show that the activity of auditory cortical neurons and of their striatal targets encodes the animals' choices and expectation of reward, in addition to stimulus identity. These results challenge previous views of the influence of motor signals on auditory circuits and identifies potential loci for integration of task-related information necessary for updating auditory decisions in changing environments.

Is it still speech? Different processing strategies in learning to discriminate stimuli in the transition from speech to non-speech including feedback evaluation

Processing of speech was investigated by using stimuli gradually changing from speech (vowels) to non-speech (spectral rotated vowels). Stimuli were presented in descending levels of vocalization blends, from pure speech to non-speech, through step-wise combinations, resulting in ambiguous versions of the sounds. Participants performed a two-alternative forced choice task: categorization of sounds were made according to whether they contained more speech or non-speech. Performance feedback was presented visually on each trial. Reaction times (RT) after sound presentation, and functional magnetic resonance imaging (fMRI) data during auditory and visual processing, were analyzed. RT data suggested individual differences with a distinct group, good performers, functioning better in distinguishing stimuli with a higher degree of ambiguous blends compared to poor performers, who were not able to distinguish these stimuli correctly. fMRI data confirmed this finding. During auditory stimulation, good performers showed neural activation in the ventral auditory pathway, including the primary auditory cortex and the anterior superior temporal sulcus (responsible for speech processing). Poor performers, in contrast, showed neural activation in the dorsal auditory pathway, including the bilateral superior temporal gyrus. Group differences were also found for visual feedback processing. Differences observed between the groups were interpreted as reflecting different neural processing strategies.

Common Sense in Choice: The Effect of Sensory Modality on Neural Value Representations

Although it is well established that the ventromedial prefrontal cortex (vmPFC) represents value using a common currency across categories of rewards, it is unknown whether the vmPFC represents value irrespective of the sensory modality in which alternatives are presented. In the current study, male and female human subjects completed a decision-making task while their neural activity was recorded using functional magnetic resonance imaging. On each trial, subjects chose between a safe alternative and a lottery, which was presented visually or aurally. A univariate conjunction analysis revealed that the anterior portion of the vmPFC tracks subjective value (SV) irrespective of the sensory modality. Using a novel cross-modality multivariate classifier, we were able to decode auditory value based on visual trials and vice versa. In addition, we found that the visual and auditory sensory cortices, which were identified using functional localizers, are also sensitive to the value of stimuli, albeit in a modality-specific manner. Whereas both primary and higher-order auditory cortices represented auditory SV (aSV), only a higher-order visual area represented visual SV (vSV). These findings expand our understanding of the common currency network of the brain and shed a new light on the interplay between sensory and value information processing.

Effect of sequential comparison on active processing of sound duration

Previous studies on active duration processing on sounds showed opposing results regarding the predominant involvement of the left or right hemisphere. Duration of an acoustic event is normally judged relative to other sounds. This requires sequential comparison as auditory events unfold over time. We hypothesized that increasing the demand on sequential comparison in a task increases the involvement of the left auditory cortex. With the current fMRI study, we investigated the effect of sequential comparison in active duration discrimination by comparing a categorical with a comparative task. During the categorical task, the participant had to categorize the tones according to their duration (short vs long). During the comparative task, they had to decide for each tone whether its length matched the tone presented before. We used the contralateral noise procedure to reveal the degree of participation of the left and right auditory cortex during these tasks. We found that both tasks more strongly involve the left than the right auditory cortex. Furthermore, the left auditory cortex was more strongly involved during comparison than during categorization. Together with previous studies, this suggests that additional demand for sequential comparison during processing of different basic acoustic parameters leads to an increased recruitment of the left auditory cortex. In addition, the comparison task more strongly involved several brain areas outside the auditory cortex, which may also be related to the demand for additional cognitive resources as compared to the more efficient categorization of sounds. Hum Brain Mapp 38:4459-4469, 2017. © 2017 Wiley Periodicals, Inc.

Reversal Learning in Humans and Gerbils: Dynamic Control Network Facilitates Learning

Biologically plausible modeling of behavioral reinforcement learning tasks has seen great improvements over the past decades. Less work has been dedicated to tasks involving contingency reversals, i.e., tasks in which the original behavioral goal is reversed one or multiple times. The ability to adjust to such reversals is a key element of behavioral flexibility. Here, we investigate the neural mechanisms underlying contingency-reversal tasks. We first conduct experiments with humans and gerbils to demonstrate memory effects, including multiple reversals in which subjects (humans and animals) show a faster learning rate when a previously learned contingency re-appears. Motivated by recurrent mechanisms of learning and memory for object categories, we propose a network architecture which involves reinforcement learning to steer an orienting system that monitors the success in reward acquisition. We suggest that a model sensory system provides feature representations which are further processed by category-related subnetworks which constitute a neural analog of expert networks. Categories are selected dynamically in a competitive field and predict the expected reward. Learning occurs in sequentialized phases to selectively focus the weight adaptation to synapses in the hierarchical network and modulate their weight changes by a global modulator signal. The orienting subsystem itself learns to bias the competition in the presence of continuous monotonic reward accumulation. In case of sudden changes in the discrepancy of predicted and acquired reward the activated motor category can be switched. We suggest that this subsystem is composed of a hierarchically organized network of dis-inhibitory mechanisms, dubbed a dynamic control network (DCN), which resembles components of the basal ganglia. The DCN selectively activates an expert network, corresponding to the current behavioral strategy. The trace of the accumulated reward is monitored such that large sudden deviations from the monotonicity of its evolution trigger a reset after which another expert subnetwork can be activated-if it has already been established before-or new categories can be recruited and associated with novel behavioral patterns.

It's Sad but I Like It: The Neural Dissociation Between Musical Emotions and Liking in Experts and Laypersons

Emotion-related areas of the brain, such as the medial frontal cortices, amygdala, and striatum, are activated during listening to sad or happy music as well as during listening to pleasurable music. Indeed, in music, like in other arts, sad and happy emotions might co-exist and be distinct from emotions of pleasure or enjoyment. Here we aimed at discerning the neural correlates of sadness or happiness in music as opposed those related to musical enjoyment. We further investigated whether musical expertise modulates the neural activity during affective listening of music. To these aims, 13 musicians and 16 non-musicians brought to the lab their most liked and disliked musical pieces with a happy and sad connotation. Based on a listening test, we selected the most representative 18 sec excerpts of the emotions of interest for each individual participant. Functional magnetic resonance imaging (fMRI) recordings were obtained while subjects listened to and rated the excerpts. The cortico-thalamo-striatal reward circuit and motor areas were more active during liked than disliked music, whereas only the auditory cortex and the right amygdala were more active for disliked over liked music. These results discern the brain structures responsible for the perception of sad and happy emotions in music from those related to musical enjoyment. We also obtained novel evidence for functional differences in the limbic system associated with musical expertise, by showing enhanced liking-related activity in fronto-insular and cingulate areas in musicians.

Functional neuroimaging of visuospatial working memory tasks enables accurate detection of attention deficit and hyperactivity disorder

Finding neurobiological markers for neurodevelopmental disorders, such as attention deficit and hyperactivity disorder (ADHD), is a major objective of clinicians and neuroscientists. We examined if functional Magnetic Resonance Imaging (fMRI) data from a few distinct visuospatial working memory (VSWM) tasks enables accurately detecting cases with ADHD. We tested 20 boys with ADHD combined type and 20 typically developed (TD) boys in four VSWM tasks that differed in feedback availability (feedback, no-feedback) and reward size (large, small). We used a multimodal analysis based on brain activity in 16 regions of interest, significantly activated or deactivated in the four VSWM tasks (based on the entire participants' sample). Dimensionality of the data was reduced into 10 principal components that were used as the input variables to a logistic regression classifier. fMRI data from the four VSWM tasks enabled a classification accuracy of 92.5%, with high predicted ADHD probability values for most clinical cases, and low predicted ADHD probabilities for most TDs. This accuracy level was higher than those achieved by using the fMRI data of any single task, or the respective behavioral data. This indicates that task-based fMRI data acquired while participants perform a few distinct VSWM tasks enables improved detection of clinical cases.

Feedback associated with expectation for larger-reward improves visuospatial working memory performances in children with ADHD

•

Children with ADHD and normal controls were tested in working memory tasks.

•

Availability of feedback and expectation for monetary reward were manipulated.

•

ADHDs showed improved working memory when feedback was associated with larger-reward.

•

Performance improvement in ADHD was associated with brain activity normalization.

We tested the interactive effect of feedback and reward on visuospatial working memory in children with ADHD. Seventeen boys with ADHD and 17 Normal Control (NC) boys underwent functional magnetic resonance imaging (fMRI) while performing four visuospatial 2-back tasks that required monitoring the spatial location of letters presented on a display. Tasks varied in reward size (large; small) and feedback availability (no-feedback; feedback). While the performance of NC boys was high in all conditions, boys with ADHD exhibited higher performance (similar to those of NC boys) only when they received feedback associated with large-reward. Performance pattern in both groups was mirrored by neural activity in an executive function neural network comprised of few distinct frontal brain regions. Specifically, neural activity in the left and right middle frontal gyri of boys with ADHD became normal-like only when feedback was available, mainly when feedback was associated with large-reward. When feedback was associated with small-reward, or when large-reward was expected but feedback was not available, boys with ADHD exhibited altered neural activity in the medial orbitofrontal cortex and anterior insula. This suggests that contextual support normalizes activity in executive brain regions in children with ADHD, which results in improved working memory.

Ventral tegmental area activation promotes firing precision and strength through circuit inhibition in the primary auditory cortex

The activation of the ventral tegmental area (VTA) can rebuild the tonotopic representation in the primary auditory cortex (A1), but the cellular mechanisms remain largely unknown. Here, we investigated the firing patterns and membrane potential dynamics of neurons in A1 under the influence of VTA activation using in vivo intracellular recording. We found that VTA activation can significantly reduce the variability of sound evoked responses and promote the firing precision and strength of A1 neurons. Furthermore, the compressed response window was caused by an early hyperpolarization as a result of enhanced circuit inhibition. Our study suggested a possible mechanism of how the reward system affects information processing in sensory cortex: VTA activation strengthens cortical inhibition, which shortens the response window of post-synaptic cortical neurons and further promotes the precision and strength of neuronal activity.

Biological impact of auditory expertise across the life span: musicians as a model of auditory learning

Experience-dependent characteristics of auditory function, especially with regard to speech-evoked auditory neurophysiology, have garnered increasing attention in recent years. This interest stems from both pragmatic and theoretical concerns as it bears implications for the prevention and remediation of language-based learning impairment in addition to providing insight into mechanisms engendering experience-dependent changes in human sensory function. Musicians provide an attractive model for studying the experience-dependency of auditory processing in humans due to their distinctive neural enhancements compared to nonmusicians. We have only recently begun to address whether these enhancements are observable early in life, during the initial years of music training when the auditory system is under rapid development, as well as later in life, after the onset of the aging process. Here we review neural enhancements in musically trained individuals across the life span in the context of cellular mechanisms that underlie learning, identified in animal models. Musicians' subcortical physiologic enhancements are interpreted according to a cognitive framework for auditory learning, providing a model in which to study mechanisms of experience-dependent changes in human auditory function.

Positive and negative reinforcement activate human auditory cortex

Prior studies suggest that reward modulates neural activity in sensory cortices, but less is known about punishment. We used functional magnetic resonance imaging and an auditory discrimination task, where participants had to judge the duration of frequency modulated tones. In one session correct performance resulted in financial gains at the end of the trial, in a second session incorrect performance resulted in financial loss. Incorrect performance in the rewarded as well as correct performance in the punishment condition resulted in a neutral outcome. The size of gains and losses was either low or high (10 or 50 Euro cent) depending on the direction of frequency modulation. We analyzed neural activity at the end of the trial, during reinforcement, and found increased neural activity in auditory cortex when gaining a financial reward as compared to gaining no reward and when avoiding financial loss as compared to receiving a financial loss. This was independent on the size of gains and losses. A similar pattern of neural activity for both gaining a reward and avoiding a loss was also seen in right middle temporal gyrus, bilateral insula and pre-supplemental motor area, here however neural activity was lower after correct responses compared to incorrect responses. To summarize, this study shows that the activation of sensory cortices, as previously shown for gaining a reward is also seen during avoiding a loss.

Feedback that confirms reward expectation triggers auditory cortex activity

Associative learning studies have shown that the anticipation of reward and punishment shapes the representation of sensory stimuli, which is further modulated by dopamine. Less is known about whether and how reward delivery activates sensory cortices and the role of dopamine at that time point of learning. We used an appetitive instrumental learning task in which participants had to learn that a specific class of frequency-modulated tones predicted a monetary reward following fast and correct responses in a succeeding reaction time task. These fMRI data were previously analyzed regarding the effect of reward anticipation, but here we focused on neural activity to the reward outcome relative to the reward expectation and tested whether such activation in the reward reception phase is modulated by L-DOPA. We analyzed neural responses at the time point of reward outcome under three different conditions: 1) when a reward was expected and received, 2) when a reward was expected but not received, and 3) when a reward was not expected and not received. Neural activity in auditory cortex was enhanced during feedback delivery either when an expected reward was received or when the expectation of obtaining no reward was correct. This differential neural activity in auditory cortex was only seen in subjects who learned the reward association and not under dopaminergic modulation. Our data provide evidence that auditory cortices are active at the time point of reward outcome. However, responses are not dependent on the reward itself but on whether the outcome confirmed the subject's expectations.

Effects of L-dopa during auditory instrumental learning in humans

The dopaminergic neurotransmitter system is critically involved in promoting plasticity in auditory cortex. We combined functional magnetic resonance imaging (fMRI) and a pharmacological manipulation to investigate dopaminergic modulation of neural activity in auditory cortex during instrumental learning. Volunteers either received 100 mg L-dopa (Madopar) or placebo in an appetitive, differential instrumental conditioning paradigm, which involved learning that a specific category of frequency modulated tones predicts a monetary reward when fast responses were made in a subsequent reaction time task. The other category of frequency modulated tones was not related to a reward. Our behavioral data provides evidence that dopaminergic stimulation differentially impacts on the speed of instrumental responding in rewarded and unrewarded trials. L-dopa increased neural BOLD activity in left auditory cortex to tones in rewarded and unrewarded trials. This increase was related to plasma L-dopa levels and learning rate. Our data thus provides evidence for dopaminergic modulation of neural activity in auditory cortex, which occurs for both auditory stimuli related to a later reward and those not related to a reward.