Segregation of task-relevant conditioned stimuli from background stimuli by associative learning

β-adrenergic modulation of discrimination learning and memory in the auditory cortex

Despite vast literature on catecholaminergic neuromodulation of auditory cortex functioning in general, knowledge about its role for long‐term memory formation is scarce. Our previous pharmacological studies on cortex‐dependent frequency‐modulated tone‐sweep discrimination learning of Mongolian gerbils showed that auditory‐cortical D_1/5‐dopamine receptor activity facilitates memory consolidation and anterograde memory formation. Considering overlapping functions of D_1/5‐dopamine receptors and β‐adrenoceptors, we hypothesised a role of β‐adrenergic signalling in the auditory cortex for sweep discrimination learning and memory. Supporting this hypothesis, the β_1/2‐adrenoceptor antagonist propranolol bilaterally applied to the gerbil auditory cortex after task acquisition prevented the discrimination increment that was normally monitored 1 day later. The increment in the total number of hurdle crossings performed in response to the sweeps per se was normal. Propranolol infusion after the seventh training session suppressed the previously established sweep discrimination. The suppressive effect required antagonist injection in a narrow post‐session time window. When applied to the auditory cortex 1 day before initial conditioning, β₁‐adrenoceptor‐antagonising and β₁‐adrenoceptor‐stimulating agents retarded and facilitated, respectively, sweep discrimination learning, whereas β₂‐selective drugs were ineffective. In contrast, single‐sweep detection learning was normal after propranolol infusion. By immunohistochemistry, β₁‐ and β₂‐adrenoceptors were identified on the neuropil and somata of pyramidal and non‐pyramidal neurons of the gerbil auditory cortex. The present findings suggest that β‐adrenergic signalling in the auditory cortex has task‐related importance for discrimination learning of complex sounds: as previously shown for D_1/5‐dopamine receptor signalling, β‐adrenoceptor activity supports long‐term memory consolidation and reconsolidation; additionally, tonic input through β₁‐adrenoceptors may control mechanisms permissive for memory acquisition.

Dopaminergic neuromodulation of high gamma stimulus phase-locking in gerbil primary auditory cortex mediated by D1/D5-receptors

Cortical release of the neurotransmitter dopamine has been implied in adapting cortical processing with respect to various functions including coding of stimulus salience, expectancy, error prediction, behavioral relevance and learning. Dopamine agonists have been shown to modulate recurrent cortico-thalamic feedback, and should therefore also affect synchronization and amplitude of thalamo-cortical oscillations. In this study, we have used multitaper spectral and time-frequency analysis of stimulus-evoked and spontaneous current source density patterns in primary auditory cortex of Mongolian gerbils to characterize dopaminergic neuromodulation of the oscillatory structure of current sources and sinks. We systemically applied D1/D5-receptor agonist SKF-38393 followed by competitive D1/D5-receptor antagonist SCH-23390. Our results reveal an increase in stimulus phase-locking in the high gamma-band (88-97 Hz) by SKF-38393, specifically in layers III/IV at the best frequency, which occurred at 20 ms after tone onset, and was reversed by SCH-23390. However, changes in induced oscillatory power after SKF-38393 treatment occurred stimulus-independently in the background activity in different layers than phase-locking effects and were not reversed by SCH-23390. These effects might either reflect longer-lasting changes in neural background noise, non-specific changes due to ketamine anesthesia, or an interaction of both. Without concomitant stimulus-induced power increase, increased stimulus phase-locking in layers III/IV indicates enhanced phase-resetting of neural oscillations by the stimulus after D1/D5-receptor activation. The frequency characteristics, together with the demonstrated stimulus specificity and layer specificity, suggest that changes in phase-resetting originate from dopaminergic neuromodulation of thalamo-cortical interactions. Enhanced phase-resetting might be a key step in the recruitment of cortical activity modes interpreting sensory input.

Improving Accuracy and Temporal Resolution of Learning Curve Estimation for within- and across-Session Analysis

Estimation of learning curves is ubiquitously based on proportions of correct responses within moving trial windows. Thereby, it is tacitly assumed that learning performance is constant within the moving windows, which, however, is often not the case. In the present study we demonstrate that violations of this assumption lead to systematic errors in the analysis of learning curves, and we explored the dependency of these errors on window size, different statistical models, and learning phase. To reduce these errors in the analysis of single-subject data as well as on the population level, we propose adequate statistical methods for the estimation of learning curves and the construction of confidence intervals, trial by trial. Applied to data from an avoidance learning experiment with rodents, these methods revealed performance changes occurring at multiple time scales within and across training sessions which were otherwise obscured in the conventional analysis. Our work shows that the proper assessment of the behavioral dynamics of learning at high temporal resolution can shed new light on specific learning processes, and, thus, allows to refine existing learning concepts. It further disambiguates the interpretation of neurophysiological signal changes recorded during training in relation to learning.

Dopaminergic impact on local and global cortical circuit processing during learning

We have learned to detect, predict and behaviorally respond to important changes in our environment on short and longer time scales. Therefore, brains of humans and higher animals build upon a perceptual and semantic salience stored in their memories mainly generated by associative reinforcement learning. Functionally, the brain needs to extract and amplify a small number of features of sensory input with behavioral relevance to a particular situation in order to guide behavior. In this review, I argue that dopamine action, particularly in sensory cortex, orchestrates layer-dependent local and long-range cortical circuits integrating sensory associated bottom-up and semantically relevant top-down information, respectively. Available evidence reveals that dopamine thereby controls both the selection of perceptually or semantically salient signals as well as feedback processing from higher-order areas in the brain. Sensory cortical dopamine thereby governs the integration of selected sensory information within a behavioral context. This review proposes that dopamine enfolds this function by temporally distinct actions on particular layer-dependent local and global cortical circuits underlying the integration of sensory, and non-sensory cognitive and behavioral variables.

Combined Shuttle-Box Training with Electrophysiological Cortex Recording and Stimulation as a Tool to Study Perception and Learning

Shuttle-box avoidance learning is a well-established method in behavioral neuroscience and experimental setups were traditionally custom-made; the necessary equipment is now available by several commercial companies. This protocol provides a detailed description of a two-way shuttle-box avoidance learning paradigm in rodents (here Mongolian gerbils; Meriones unguiculatus) in combination with site-specific electrical intracortical microstimulation (ICMS) and simultaneous chronical electrophysiological in vivo recordings. The detailed protocol is applicable to study multiple aspects of learning behavior and perception in different rodent species. Site-specific ICMS of auditory cortical circuits as conditioned stimuli here is used as a tool to test the perceptual relevance of specific afferent, efferent and intracortical connections. Distinct activation patterns can be evoked by using different stimulation electrode arrays for local, layer-dependent ICMS or distant ICMS sites. Utilizing behavioral signal detection analysis it can be determined which stimulation strategy is most effective for eliciting a behaviorally detectable and salient signal. Further, parallel multichannel-recordings using different electrode designs (surface electrodes, depth electrodes, etc.) allow for investigating neuronal observables over the time course of such learning processes. It will be discussed how changes of the behavioral design can increase the cognitive complexity (e.g. detection, discrimination, reversal learning).

Differential effects of dopamine signalling on long-term memory formation and consolidation in rodent brain

Background

Using auditory discrimination learning in gerbils, we have previously shown that activation of auditory-cortical D1/D5 dopamine receptors facilitates mTOR-mediated, protein synthesis-dependent mechanisms of memory consolidation and anterograde memory formation. To understand molecular mechanisms of this facilitatory effect, we tested the impact of local pharmacological activation of different D1/D5 dopamine receptor signalling modes in the auditory cortex. To this end, protein patterns in soluble and synaptic protein-enriched fractions from cortical, hippocampal and striatal brain regions of ligand- and vehicle-treated gerbils were analysed by 2D gel electrophoresis and mass spectrometry 24 h after intervention.

Results

After auditory-cortical injection of SKF38393 – a D1/D5 dopamine receptor-selective agonist reported to activate the downstream effectors adenylyl cyclase and phospholipase C – prominent proteomic alterations compared to vehicle-treated controls appeared in the auditory cortex, striatum, and hippocampus, whereas only minor changes were detectable in the frontal cortex. In contrast, auditory-cortical injection of SKF83959 – a D1/D5 agonist reported to preferentially stimulate phospholipase C – induced pronounced changes in the frontal cortex. At the molecular level, we detected altered regulation of cytoskeletal and scaffolding proteins, changes in proteins with functions in energy metabolism, local protein synthesis, and synaptic signalling. Interestingly, abundance and/or subcellular localisation of the predominantly presynaptic protein α-synuclein displayed dopaminergic regulation. To assess the role of α-synuclein for dopaminergic mechanisms of memory modulation, we tested the impact of post-conditioning systemic pharmacological activation of different D1/D5 dopamine receptor signalling modes on auditory discrimination learning in α-synuclein-mutant mice. In C57BL/6JOlaHsd mice, bearing a spontaneous deletion of the α-synuclein-encoding gene, but not in the related substrains C57BL/6JCrl and C57BL/6JRccHsd, adenylyl cyclase-mediated signalling affected acquisition rates over future learning episodes, whereas phospholipase C-mediated signalling affected final memory performance.

Conclusions

Dopamine signalling modes via D1/D5 receptors in the auditory cortex differentially impact protein profiles related to rearrangement of cytomatrices, energy metabolism, and synaptic neurotransmission in cortical, hippocampal, and basal brain structures. Altered dopamine neurotransmission in α-synuclein-deficient mice revealed that distinct D1/D5 receptor signalling modes may control different aspects of memory consolidation.

Electronic supplementary material

The online version of this article (doi:10.1186/s12953-015-0069-2) contains supplementary material, which is available to authorized users.

Behavioral semantics of learning and crossmodal processing in auditory cortex: the semantic processor concept

Two phenomena of auditory cortex activity have recently attracted attention, namely that the primary field can show different types of learning-related changes of sound representation and that during learning even this early auditory cortex is under strong multimodal influence. Based on neuronal recordings in animal auditory cortex during instrumental tasks, in this review we put forward the hypothesis that these two phenomena serve to derive the task-specific meaning of sounds by associative learning. To understand the implications of this tenet, it is helpful to realize how a behavioral meaning is usually derived for novel environmental sounds. For this purpose, associations with other sensory, e.g. visual, information are mandatory to develop a connection between a sound and its behaviorally relevant cause and/or the context of sound occurrence. This makes it plausible that in instrumental tasks various non-auditory sensory and procedural contingencies of sound generation become co-represented by neuronal firing in auditory cortex. Information related to reward or to avoidance of discomfort during task learning, that is essentially non-auditory, is also co-represented. The reinforcement influence points to the dopaminergic internal reward system, the local role of which for memory consolidation in auditory cortex is well-established. Thus, during a trial of task performance, the neuronal responses to the sounds are embedded in a sequence of representations of such non-auditory information. The embedded auditory responses show task-related modulations of auditory responses falling into types that correspond to three basic logical classifications that may be performed with a perceptual item, i.e. from simple detection to discrimination, and categorization. This hierarchy of classifications determine the semantic "same-different" relationships among sounds. Different cognitive classifications appear to be a consequence of learning task and lead to a recruitment of different excitatory and inhibitory mechanisms and to distinct spatiotemporal metrics of map activation to represent a sound. The described non-auditory firing and modulations of auditory responses suggest that auditory cortex, by collecting all necessary information, functions as a "semantic processor" deducing the task-specific meaning of sounds by learning.