Associative learning and timing

Analysis of fast calcium dynamics of honey bee olfactory coding

Odour processing exhibits multiple parallels between vertebrate and invertebrate olfactory systems. Insects, in particular, have emerged as relevant models for olfactory studies because of the tractability of their olfactory circuits. Here, we used fast calcium imaging to track the activity of projection neurons in the honey bee antennal lobe (AL) during olfactory stimulation at high temporal resolution. We observed a heterogeneity of response profiles and an abundance of inhibitory activities, resulting in various response latencies and stimulus-specific post-odour neural signatures. Recorded calcium signals were fed to a mushroom body (MB) model constructed implementing the fundamental features of connectivity between olfactory projection neurons, Kenyon cells (KC), and MB output neurons (MBON). The model accounts for the increase of odorant discrimination in the MB compared to the AL and reveals the recruitment of two distinct KC populations that represent odorants and their aftersmell as two separate but temporally coherent neural objects. Finally, we showed that the learning-induced modulation of KC-to-MBON synapses can explain both the variations in associative learning scores across different conditioning protocols used in bees and the bees' response latency. Thus, it provides a simple explanation of how the time contingency between the stimulus and the reward can be encoded without the need for time tracking. This study broadens our understanding of olfactory coding and learning in honey bees. It demonstrates that a model based on simple MB connectivity rules and fed with real physiological data can explain fundamental aspects of odour processing and associative learning.

Learning About Reward Identities and Time

We discuss three empirical findings that we think any theory attempting to integrate interval timing with associative learning concepts will need to address. These empirical phenomena all come from studies that combine peak timing procedures with reinforcer devaluation or conditional discrimination tasks commonly employed, respectively, in interval timing or associative learning research traditions. The three phenomena we discuss include: (1) the observation that disruptions in reward identity encoding have little to no impact on the encoding of reward time in the a peak procedure (Delamater., 1998), (2) the findings that organisms tend to average their time estimates when presented with a stimulus compound consisting of separately learned stimuli indicating short or long reward times but that such temporal averaging, itself, is sensitive to post-conditioning selective reward devaluation, and (3) that rats can learn a temporal patterning task in which two stimuli presented independently indicate one time to reward availability while their compound indicates another. We review our prior results and present new findings illustrating these three phenomena and we discuss the special challenges they pose for cascade theories of timing, for multiple-oscillator models, and for any approach that attempts to integrate interval timing and associative models. We close by illustrating some ways in which multi-layer connectionist network models might begin to address some of our key findings. We believe this will require an approach that includes separate mechanisms that code for reward identity and time, but that does so in a way that permits for integration between the two systems.

Timing of behavioral responding to long-duration Pavlovian fear conditioned cues

Behavioral responding is most beneficial when it reflects event timing. Compared to reward, there are fewer studies on timing of defensive responding. We gave female and male rats Pavlovian fear conditioning over a baseline of reward seeking. Two 100-s cues predicted foot shock at different time points. Rats acquired timing of behavioral responding to both cues. Suppression of reward seeking was minimal at cue onset and maximal before shock delivery. Rats also came to minimize suppres-sion of reward seeking following cue offset. The results reveal timing as a mechanism to focus defen-sive responding to shock-imminent, cue periods.

Time-restricted feeding and cognitive function in sedentary and physically active elderly individuals: Ramadan diurnal intermittent fasting as a model

Objectives

This study aimed to investigate the effects of Ramadan diurnal intermittent fasting (RDIF) on cognitive performance, sleep quality, daytime sleepiness, and insomnia in physically active and sedentary elderly individuals.

Methods

A total of 58 participants (62.93 ± 3.99 years) were assigned to one of the following two groups: a sedentary group (control group) who observed Ramadan (n = 32) and a physically active group (n = 26) who continued to train while observing Ramadan. Participants were assessed 2 weeks before Ramadan and during the fourth week of Ramadan. On each occasion, participants completed a digital assessment of their cognitive performance and responded to the Pittsburgh sleep quality index (PSQI), the insomnia severity index (ISI) and the Epworth sleepiness scale (ESS) questionnaires to assess sleep parameters.

Results

Compared to before Ramadan, performance in executive function (p = 0.035), attention (p = 0.005), inhibition (p = 0.02), associative memory (p = 0.041), and recognition memory (p = 0.025) increased significantly during Ramadan in the physically active group. For the sedentary group, associative learning performance decreased (p = 0.041), whilst performances in the remaining domains remained unchanged during Ramadan. Global PSQI, ISI, and ESS scores indicated both groups suffered from poor sleep quality and excessive daytime sleepiness, with significantly higher negative effects of RDIF observed in the sedentary group.

Conclusion

Older adults who continue to train at least three times per week during Ramadan may improve their cognitive performance, despite the impairment of sleep quality. Future studies in older adults during Ramadan including objective measures of sleep (e.g., polysomnography, actigraphy) and brain function (e.g., functional magnetic resonance imaging) are warranted.

Higher-order trace conditioning in newborn rabbits

Temporal contingency is a key factor in associative learning but remains weakly investigated early in life. Few data suggest simultaneous presentation is required for young to associate different stimuli, whereas adults can learn them sequentially. Here, we investigated the ability of newborn rabbits to perform sensory preconditioning and second-order conditioning using trace intervals between odor presentations. Strikingly, pups are able to associate odor stimuli with 10- and 30-sec intervals in sensory preconditioning and second-order conditioning, respectively. The effectiveness of higher-order trace conditioning in newborn rabbits reveals that very young animals can display complex learning despite their relative immaturity.

Temporal Factors Modulate Haloperidol-Induced Conditioned Catalepsy

Repeated pairings of a neutral context and the effects of haloperidol give rise to conditioned catalepsy when the context is subsequently presented in a drug-free test. In order to confirm whether this response is based on Pavlovian processes, we conducted two experiments involving two manipulations that affect conditioning intensity in classical conditioning procedures: time of joint exposure to the conditioned and the unconditioned stimulus, and the length of the inter-stimulus interval (ISI). The results revealed that both an increase in the length of context-drug pairings during conditioning and a reduced ISI between drug administration and context exposure increased conditioned catalepsy. These results are discussed in terms of the temporal peculiarities of those procedures that involve drugs as the unconditioned stimulus along with the role of Pavlovian conditioning in context-dependent catalepsy.

Bidirectional role of microtubule dynamics in the acquisition and maintenance of temporal information in dorsolateral striatum

Accurate and precise timing is crucial for complex and purposeful behaviors, such as foraging for food or playing a musical instrument. The brain is capable of processing temporal information in a coordinated manner, as if it contains an 'internal clock'. Similar to the need for the brain to orient itself in space in order to understand its surroundings, temporal orientation and tracking is an essential component of cognition as well. While there have been multiple models explaining the neural correlates of timing, independent lines of research appear to converge on the conclusion that populations of neurons in the dorsal striatum encode information relating to where a subject is in time relative to an anticipated goal. Similar to other learning processes, acquisition and maintenance of this temporal information is dependent on synaptic plasticity. Microtubules are cytoskeletal proteins that have been implicated in synaptic plasticity mechanisms and therefore are considered key elements in learning and memory. In this study, we investigated the role of microtubule dynamics in temporal learning by local infusions of microtubule stabilizing and destabilizing agents into the dorsolateral striatum. Our results suggested a bidirectional role for microtubules in timing, such that microtubule stabilization improves the maintenance of learned target durations, but impairs the acquisition of a novel duration. On the other hand, microtubule destabilization enhances the acquisition of novel target durations, while compromising the maintenance of previously learned durations. These findings suggest that microtubule dynamics plays an important role in synaptic plasticity mechanisms in the dorsolateral striatum, which in turn modulates temporal learning and time perception.

Dorsal striatum and the temporal expectancy of an aversive event in Pavlovian odor fear learning

Interval timing, the ability to encode and retrieve the memory of intervals from seconds to minutes, guides fundamental animal behaviors across the phylogenetic tree. In Pavlovian fear conditioning, an initially neutral stimulus (conditioned stimulus, CS) predicts the arrival of an aversive unconditioned stimulus (US, generally a mild foot-shock) at a fixed time interval. Although some studies showed that temporal relations between CS and US events are learned from the outset of conditioning, the question of the memory of time and its underlying neural network in fear conditioning is still poorly understood. The aim of the present study was to investigate the role of the dorsal striatum in timing intervals in odor fear conditioning in male rats. To assess the animal's interval timing ability in this paradigm, we used the respiratory frequency. This enabled us to detect the emergence of temporal patterns related to the odor-shock time interval from the early stage of learning, confirming that rats are able to encode the odor-shock time interval after few training trials. We carried out reversible inactivation of the dorsal striatum before the acquisition session and before a shift in the learned time interval, and measured the effects of this treatment on the temporal pattern of the respiratory rate. In addition, using intracerebral microdialysis, we monitored extracellular dopamine level in the dorsal striatum throughout odor-shock conditioning and in response to a shift of the odor-shock time interval. Contrary to our initial predictions based on the existing literature on interval timing, we found evidence suggesting that transient inactivation of the dorsal striatum may favor a more precocious buildup of the respiratory frequency's temporal pattern during the odor-shock interval in a manner that reflected the duration of the interval. Our data further suggest that the conditioning and the learning of a novel time interval were associated with a decrease in dopamine level in the dorsal striatum, but not in the nucleus accumbens. These findings prompt a reassessment of the role of the striatum and striatal dopamine in interval timing, at least when considering Pavlovian aversive conditioning.

Interval Timing in Pediatric Multiple Sclerosis: Impaired in the Subsecond Range but Unimpaired in the One-Second Range

Background: For adult multiple sclerosis (MS) patients, impaired temporal processing of simultaneity/successiveness has been frequently reported although interval timing has been investigated in neither adult nor pediatric MS patients. We aim to extend previous research in two ways. First, we focus on interval timing (instead of simultaneity/successiveness) and differentiate between sensory-automatic processing of intervals in the subsecond range and cognitive processing of intervals in the one-second range. Second, we investigate whether impaired temporal information processing would also be observable in pediatric MS patients' interval timing in the subsecond and one-second ranges.

Methods: Participants were 22 pediatric MS patients and 22 healthy controls, matched for age, gender, and psychometric intelligence as measured by the Culture Fair Test 20-R. They completed two auditory interval-timing tasks with stimuli in the subsecond and one-second ranges, respectively, as well as a frequency discrimination task.

Results: Pediatric MS patients showed impaired interval timing in the subsecond range compared to healthy controls with a mean difference of the difference limen (DL) of 6.3 ms, 95% CI [1.7, 10.9 ms] and an effect size of Cohen's d = 0.830. The two groups did not differ significantly in interval timing in the one-second range (mean difference of the DL = 26.9 ms, 95% CI [−14.2, 67.9 ms], Cohen's d = 0.399) or in frequency discrimination (mean difference of the DL = 0.4 Hz, 95% CI [−1.1, 1.9 Hz], Cohen's d = 0.158).

Conclusion: The results indicate that, in particular, the sensory-automatic processing of intervals in the subsecond range but not the cognitive processing of longer intervals is impaired in pediatric MS patients. This differential pattern of results is unlikely to be explained by general deficits of auditory information processing. A tentative explanation, to be tested in future studies, points to subcortical deficits in pediatric MS patients, which might also underlie deficits in speech and visuomotor coordination typically reported in pediatric MS patients.

Layer 4 organization and respiration locking in the rodent nose somatosensory cortex

Rodents and other mammals acquire sensory information by precisely orchestrated head, whisker, and respiratory movements. We have, however, only limited information about integration of these signals. In the somatosensory domain, the integration of somatosensory information with other modalities is particularly pertinent for body parts such as eyes, ears, and nose, which serve another modality. Here we analyzed the nose/nostril representation in the rodent somatosensory cortex. We identified the representation of the nose/nostril in the rat somatosensory cortex by receptive field mapping and subsequent histological reconstruction. In tangential somatosensory cortical sections, the rat nostril cortex was evident as a prominent stripe-like recess of layer 4 revealed by cytochrome-c oxidase reactivity or by antibodies against the vesicular glutamate-transporter-2 (identifying thalamic afferents). We compared flattened somatosensory cortices of various rodents including rats, mice, gerbils, chinchillas, and chipmunks. We found that such a nose/nostril module was evident as a region with thinned or absent layer 4 at the expected somatotopic position of the nostril. Extracellular spike activity was strongly modulated by respiration in the rat somatosensory cortex, and field potential recordings revealed a stronger locking of nostril recording sites to respiration than for whisker/barrel cortex recoding sites. We conclude that the rodent nose/nostril representation has a conserved architecture and specifically interfaces with respiration signals.NEW & NOTEWORTHY We characterized the rodent nose somatosensory cortex. The nostril representation appeared as a kind of "hole" (i.e., as a stripe-like recess of layer 4) in tangential cortical sections. Neural activity in nose somatosensory cortex was locked to respiration, and simultaneous field recordings indicate that this locking was specific to this region. Our results reveal previously unknown cytoarchitectonic and physiological properties of the rodent nose somatosensory cortex, potentially enabling it to integrate multiple sensory modalities.

Multiple factors affect discrimination learning performance, but not between-individual variation, in wild mixed-species flocks of birds

Cognition arguably drives most behaviours in animals, but whether and why individuals in the wild vary consistently in their cognitive performance is scarcely known, especially under mixed-species scenarios. One reason for this is that quantifying the relative importance of individual, contextual, ecological and social factors remains a major challenge. We examined how many of these factors, and sources of bias, affected participation and performance, in an initial discrimination learning experiment and two reversal learning experiments during self-administered trials in a population of great tits and blue tits. Individuals were randomly allocated to different rewarding feeders within an array. Participation was high and only weakly affected by age and species. In the initial learning experiment, great tits learned faster than blue tits. Great tits also showed greater consistency in performance across two reversal learning experiments. Individuals assigned to the feeders on the edge of the array learned faster. More errors were made on feeders neighbouring the rewarded feeder and on feeders that had been rewarded in the previous experiment. Our estimates of learning consistency were unaffected by multiple factors, suggesting that, even though there was some influence of these factors on performance, we obtained a robust measure of discrimination learning in the wild.

The role of the gustatory cortex in incidental experience-evoked enhancement of later taste learning

The strength of learned associations between pairs of stimuli is affected by multiple factors, the most extensively studied of which is prior experience with the stimuli themselves. In contrast, little data is available regarding how experience with "incidental" stimuli (independent of any conditioning situation) impacts later learning. This lack of research is striking given the importance of incidental experience to survival. We have recently begun to fill this void using conditioned taste aversion (CTA), wherein an animal learns to avoid a taste that has been associated with malaise. We previously demonstrated that incidental exposure to salty and sour tastes (taste preexposure-TPE) enhances aversions learned later to sucrose. Here, we investigate the neurobiology underlying this phenomenon. First, we use immediate early gene (c-Fos) expression to identify gustatory cortex (GC) as a site at which TPE specifically increases the neural activation caused by taste-malaise pairing (i.e., TPE did not change c-Fos induced by either stimulus in isolation). Next, we use site-specific infection with the optical silencer Archaerhodopsin-T to show that GC inactivation during TPE inhibits the expected enhancements of both learning and CTA-related c-Fos expression, a full day later. Thus, we conclude that GC is almost certainly a vital part of the circuit that integrates incidental experience into later associative learning.

Inactivation of the Medial-Prefrontal Cortex Impairs Interval Timing Precision, but Not Timing Accuracy or Scalar Timing in a Peak-Interval Procedure in Rats

Motor sequence learning, planning and execution of goal-directed behaviors, and decision making rely on accurate time estimation and production of durations in the seconds-to-minutes range. The pathways involved in planning and execution of goal-directed behaviors include cortico-striato-thalamo-cortical circuitry modulated by dopaminergic inputs. A critical feature of interval timing is its scalar property, by which the precision of timing is proportional to the timed duration. We examined the role of medial prefrontal cortex (mPFC) in timing by evaluating the effect of its reversible inactivation on timing accuracy, timing precision and scalar timing. Rats were trained to time two durations in a peak-interval (PI) procedure. Reversible mPFC inactivation using GABA agonist muscimol resulted in decreased timing precision, with no effect on timing accuracy and scalar timing. These results are partly at odds with studies suggesting that ramping prefrontal activity is crucial to timing but closely match simulations with the Striatal Beat Frequency (SBF) model proposing that timing is coded by the coincidental activation of striatal neurons by cortical inputs. Computer simulations indicate that in SBF, gradual inactivation of cortical inputs results in a gradual decrease in timing precision with preservation of timing accuracy and scalar timing. Further studies are needed to differentiate between timing models based on coincidence detection and timing models based on ramping mPFC activity, and clarify whether mPFC is specifically involved in timing, or more generally involved in attention, working memory, or response selection/inhibition.

Hippocampal Processing of Ambiguity Enhances Fear Memory

Despite the ubiquitous use of Pavlovian fear conditioning as a model for fear learning, the highly predictable conditions used in the laboratory do not resemble real-world conditions, in which dangerous situations can lead to unpleasant outcomes in unpredictable ways. In the current experiments, we varied the timing of aversive events after predictive cues in rodents and discovered that temporal ambiguity of aversive events greatly enhances fear. During fear conditioning with unpredictably timed aversive events, pharmacological inactivation of the dorsal hippocampus or optogenetic silencing of cornu ammonis 1 cells during aversive negative prediction errors prevented this enhancement of fear without affecting fear learning for predictable events. Dorsal hippocampal inactivation also prevented ambiguity-related enhancement of fear during auditory fear conditioning under a partial-reinforcement schedule. These results reveal that information about the timing and occurrence of aversive events is rapidly acquired and that unexpectedly timed or omitted aversive events generate hippocampal signals to enhance fear learning.