1
|
Kehoe EJ, Ludvig EA, Sutton RS. Time course of the rabbit's conditioned nictitating membrane movements during acquisition, extinction, and reacquisition. ACTA ACUST UNITED AC 2014; 21:585-90. [PMID: 25320350 PMCID: PMC4201810 DOI: 10.1101/lm.034504.114] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
The present experiment tested whether or not the time course of a conditioned eyeblink response, particularly its duration, would expand and contract, as the magnitude of the conditioned response (CR) changed massively during acquisition, extinction, and reacquisition. The CR duration remained largely constant throughout the experiment, while CR onset and peak time occurred slightly later during extinction. The results suggest that computational models can account for these results by using two layers of plasticity conforming to the sequence of synapses in the cerebellar pathways that mediate eyeblink conditioning.
Collapse
Affiliation(s)
- E James Kehoe
- School of Psychology, University of New South Wales, Sydney 2052, Australia
| | - Elliot A Ludvig
- Department of Psychology, University of Warwick, Coventry CV4 7AL, United Kingdom
| | - Richard S Sutton
- Department of Computing Sciences, University of Alberta, Edmonton T6G 2E8, Canada
| |
Collapse
|
2
|
Decorrelation learning in the cerebellum: computational analysis and experimental questions. PROGRESS IN BRAIN RESEARCH 2014; 210:157-92. [PMID: 24916293 DOI: 10.1016/b978-0-444-63356-9.00007-8] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
Many cerebellar models use a form of synaptic plasticity that implements decorrelation learning. Parallel fibers carrying signals positively correlated with climbing-fiber input have their synapses weakened (long-term depression), whereas those carrying signals negatively correlated with climbing input have their synapses strengthened (long-term potentiation). Learning therefore ceases when all parallel-fiber signals have been decorrelated from climbing-fiber input. This is a computationally powerful rule for supervised learning and can be cast in a spike-timing dependent plasticity form for comparison with experimental evidence. Decorrelation learning is particularly well suited to sensory prediction, for example, in the reafference problem where external sensory signals are interfered with by reafferent signals from the organism's own movements, and the required circuit appears similar to the one found to mediate classical eye blink conditioning. However, for certain stimuli, avoidance is a much better option than simple prediction, and decorrelation learning can also be used to acquire appropriate avoidance movements. One example of a stimulus to be avoided is retinal slip that degrades visual processing, and decorrelation learning appears to play a role in the vestibulo-ocular reflex that stabilizes gaze in the face of unpredicted head movements. Decorrelation learning is thus suitable for both sensory prediction and motor control. It may also be well suited for generic spatial and temporal coordination, because of its ability to remove the unwanted side effects of movement. Finally, because it can be used with any kind of time-varying signal, the cerebellum could play a role in cognitive processing.
Collapse
|
3
|
Sánchez-Campusano R, Gruart A, Fernández-Mas R, Delgado-García JM. An agonist-antagonist cerebellar nuclear system controlling eyelid kinematics during motor learning. Front Neuroanat 2012; 6:8. [PMID: 22435053 PMCID: PMC3303085 DOI: 10.3389/fnana.2012.00008] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2011] [Accepted: 02/24/2012] [Indexed: 01/01/2023] Open
Abstract
The presence of two antagonistic groups of deep cerebellar nuclei neurons has been reported as necessary for a proper dynamic control of learned motor responses. Most models of cerebellar function seem to ignore the biomechanical need for a double activation–deactivation system controlling eyelid kinematics, since most of them accept that, for closing the eyelid, only the activation of the orbicularis oculi (OO) muscle (via the red nucleus to the facial motor nucleus) is necessary, without a simultaneous deactivation of levator palpebrae motoneurons (via unknown pathways projecting to the perioculomotor area). We have analyzed the kinetic neural commands of two antagonistic types of cerebellar posterior interpositus neuron (IPn) (types A and B), the electromyographic (EMG) activity of the OO muscle, and eyelid kinematic variables in alert behaving cats during classical eyeblink conditioning, using a delay paradigm. We addressed the hypothesis that the interpositus nucleus can be considered an agonist–antagonist system controlling eyelid kinematics during motor learning. To carry out a comparative study of the kinetic–kinematic relationships, we applied timing and dispersion pattern analyses. We concluded that, in accordance with a dominant role of cerebellar circuits for the facilitation of flexor responses, type A neurons fire during active eyelid downward displacements—i.e., during the active contraction of the OO muscle. In contrast, type B neurons present a high tonic rate when the eyelids are wide open, and stop firing during any active downward displacement of the upper eyelid. From a functional point of view, it could be suggested that type B neurons play a facilitative role for the antagonistic action of the levator palpebrae muscle. From an anatomical point of view, the possibility that cerebellar nuclear type B neurons project to the perioculomotor area—i.e., more or less directly onto levator palpebrae motoneurons—is highly appealing.
Collapse
|
4
|
Learning stimulus intervals--adaptive timing of conditioned purkinje cell responses. THE CEREBELLUM 2012; 10:523-35. [PMID: 21416378 DOI: 10.1007/s12311-011-0264-3] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Classical conditioning of motor responses, such as the eyeblink response, is an experimental model of associative learning and of adaptive timing of movements. A conditioned blink will have its maximum amplitude near the expected onset of the unconditioned blink-eliciting stimulus and it adapts to changes in the interval between the conditioned and unconditioned stimuli. Previous studies have shown that an eyeblink conditioning protocol can make cerebellar Purkinje cells learn to pause in response to the conditioned stimulus. According to the cerebellar cortical conditioning model, this conditioned Purkinje cell response drives the overt blink. If so, the model predicts that the temporal properties of the Purkinje cell response reflect the overt behaviour. To test this prediction, in vivo recordings of Purkinje cell activity were performed in decerebrate ferrets during conditioning, using direct stimulation of cerebellar mossy and climbing fibre afferents as conditioned and unconditioned stimuli. The results show that Purkinje cells not only develop a change in responsiveness to the conditioned stimulus. They also learn a particular temporal response profile where the timing, not only of onset and maximum but also of offset, is determined by the temporal interval between the conditioned and unconditioned stimuli.
Collapse
|
5
|
Chettih SN, McDougle SD, Ruffolo LI, Medina JF. Adaptive timing of motor output in the mouse: the role of movement oscillations in eyelid conditioning. Front Integr Neurosci 2011; 5:72. [PMID: 22144951 PMCID: PMC3226833 DOI: 10.3389/fnint.2011.00072] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2011] [Accepted: 10/11/2011] [Indexed: 11/25/2022] Open
Abstract
To survive, animals must learn to control their movements with millisecond-level precision, and adjust the kinematics if conditions, or task requirements, change. Here, we examine adaptive timing of motor output in mice, using a simple eyelid conditioning task. Mice were trained to blink in response to a light stimulus that was always followed by a corneal air-puff at a constant time interval. Different mice were trained with different intervals of time separating the onset of the light and the air-puff. As in previous work in other animal species, mice learned to control the speed of the blink, such that the time of maximum eyelid closure matched the interval used during training. However, we found that the time of maximum eyelid speed was always in the first 100 ms after movement onset and did not scale with the training interval, indicating that adaptive timing is not accomplished by slowing down (or speeding up) the eyelid movement uniformly throughout the duration of the blink. A new analysis, specifically designed to examine the kinematics of blinks in single trials, revealed that the underlying control signal responsible for the eyelid movement is made up of oscillatory bursts that are time-locked to the light stimulus at the beginning of the blink, becoming desynchronized later on. Furthermore, mice learn to blink at different speeds and time the movement appropriately by adjusting the amplitude, but not the frequency of the bursts in the eyelid oscillation.
Collapse
Affiliation(s)
- Selmaan N Chettih
- Department of Psychology, University of Pennsylvania Philadelphia, PA, USA
| | | | | | | |
Collapse
|
6
|
Kehoe EJ, Ludvig EA, Sutton RS. Timing in trace conditioning of the nictitating membrane response of the rabbit (Oryctolagus cuniculus): scalar, nonscalar, and adaptive features. Learn Mem 2010; 17:600-4. [PMID: 21075900 DOI: 10.1101/lm.1942210] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Using interstimulus intervals (ISIs) of 125, 250, and 500 msec in trace conditioning of the rabbit nictitating membrane response, the offset times and durations of conditioned responses (CRs) were collected along with onset and peak latencies. All measures were proportional to the ISI, but only onset and peak latencies conformed to the criterion for scalar timing. Regarding the CR's possible protective overlap of the unconditioned stimulus (US), CR duration increased with ISI, while the peak's alignment with the US declined. Implications for models of timing and CR adaptiveness are discussed.
Collapse
Affiliation(s)
- E James Kehoe
- School of Psychology, University of New South Wales, Sydney, New South Wales 2052, Australia.
| | | | | |
Collapse
|
7
|
Lepora NF, Porrill J, Yeo CH, Dean P. Sensory prediction or motor control? Application of marr-albus type models of cerebellar function to classical conditioning. Front Comput Neurosci 2010; 4:140. [PMID: 21031161 PMCID: PMC2965015 DOI: 10.3389/fncom.2010.00140] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2009] [Accepted: 09/12/2010] [Indexed: 11/23/2022] Open
Abstract
Marr-Albus adaptive filter models of the cerebellum have been applied successfully to a range of sensory and motor control problems. Here we analyze their properties when applied to classical conditioning of the nictitating membrane response in rabbits. We consider a system-level model of eyeblink conditioning based on the anatomy of the eyeblink circuitry, comprising an adaptive filter model of the cerebellum, a comparator model of the inferior olive and a linear dynamic model of the nictitating membrane plant. To our knowledge, this is the first model that explicitly includes all these principal components, in particular the motor plant that is vital for shaping and timing the behavioral response. Model assumptions and parameters were systematically investigated to disambiguate basic computational capacities of the model from features requiring tuning of properties and parameter values. Without such tuning, the model robustly reproduced a range of behaviors related to sensory prediction, by displaying appropriate trial-level associative learning effects for both single and multiple stimuli, including blocking and conditioned inhibition. In contrast, successful reproduction of the real-time motor behavior depended on appropriate specification of the plant, cerebellum and comparator models. Although some of these properties appear consistent with the system biology, fundamental questions remain about how the biological parameters are chosen if the cerebellar microcircuit applies a common computation to many distinct behavioral tasks. It is possible that the response profiles in classical conditioning of the eyeblink depend upon operant contingencies that have previously prevailed, for example in naturally occurring avoidance movements.
Collapse
Affiliation(s)
- Nathan F. Lepora
- Department of Psychology, University of SheffieldWestern Bank, Sheffield, UK
| | - John Porrill
- Department of Psychology, University of SheffieldWestern Bank, Sheffield, UK
| | - Christopher H. Yeo
- Department of Anatomy and Developmental Biology, University College LondonLondon, UK
| | - Paul Dean
- Department of Psychology, University of SheffieldWestern Bank, Sheffield, UK
| |
Collapse
|
8
|
Kellett DO, Fukunaga I, Chen-Kubota E, Dean P, Yeo CH. Memory consolidation in the cerebellar cortex. PLoS One 2010; 5:e11737. [PMID: 20686596 PMCID: PMC2912226 DOI: 10.1371/journal.pone.0011737] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2010] [Accepted: 06/29/2010] [Indexed: 11/23/2022] Open
Abstract
Several forms of learning, including classical conditioning of the eyeblink, depend upon the cerebellum. In examining mechanisms of eyeblink conditioning in rabbits, reversible inactivations of the control circuitry have begun to dissociate aspects of cerebellar cortical and nuclear function in memory consolidation. It was previously shown that post-training cerebellar cortical, but not nuclear, inactivations with the GABAA agonist muscimol prevented consolidation but these findings left open the question as to how final memory storage was partitioned across cortical and nuclear levels. Memory consolidation might be essentially cortical and directly disturbed by actions of the muscimol, or it might be nuclear, and sensitive to the raised excitability of the nuclear neurons following the loss of cortical inhibition. To resolve this question, we simultaneously inactivated cerebellar cortical lobule HVI and the anterior interpositus nucleus of rabbits during the post-training period, so protecting the nuclei from disinhibitory effects of cortical inactivation. Consolidation was impaired by these simultaneous inactivations. Because direct application of muscimol to the nuclei alone has no impact upon consolidation, we can conclude that post-training, consolidation processes and memory storage for eyeblink conditioning have critical cerebellar cortical components. The findings are consistent with a recent model that suggests the distribution of learning-related plasticity across cortical and nuclear levels is task-dependent. There can be transfer to nuclear or brainstem levels for control of high-frequency responses but learning with lower frequency response components, such as in eyeblink conditioning, remains mainly dependent upon cortical memory storage.
Collapse
Affiliation(s)
- Daniel O. Kellett
- Department of Neuroscience, Physiology and Pharmacology, University College London, London, United Kingdom
| | - Izumi Fukunaga
- Department of Neuroscience, Physiology and Pharmacology, University College London, London, United Kingdom
| | - Eva Chen-Kubota
- Department of Neuroscience, Physiology and Pharmacology, University College London, London, United Kingdom
| | - Paul Dean
- Department of Psychology, University of Sheffield, Sheffield, United Kingdom
| | - Christopher H. Yeo
- Department of Neuroscience, Physiology and Pharmacology, University College London, London, United Kingdom
- * E-mail:
| |
Collapse
|
9
|
Anderson SR, Lepora NF, Porrill J, Dean P. Nonlinear Dynamic Modeling of Isometric Force Production in Primate Eye Muscle. IEEE Trans Biomed Eng 2010; 57:1554-67. [DOI: 10.1109/tbme.2010.2044574] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
10
|
Lepora NF, Porrill J, Yeo CH, Evinger C, Dean P. Recruitment in retractor bulbi muscle during eyeblink conditioning: EMG analysis and common-drive model. J Neurophysiol 2009; 102:2498-513. [PMID: 19675295 PMCID: PMC2775390 DOI: 10.1152/jn.00204.2009] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
To analyze properly the role of the cerebellum in classical conditioning of the eyeblink and nictitating membrane (NM) response, the control of conditioned response dynamics must be better understood. Previous studies have suggested that the control signal is linearly related to the CR as a result of recruitment within the accessory abducens motoneuron pool, which acts to linearize retractor bulbi muscle and NM response mechanics. Here we investigate possible recruitment mechanisms. Data came from simultaneous recordings of NM position and multiunit electromyographic (EMG) activity from the retractor bulbi muscle of rabbits during eyeblink conditioning, in which tone and periocular shock act as conditional and unconditional stimuli, respectively. Action potentials (spikes) were extracted and classified by amplitude. Firing rates of spikes with different amplitudes were analyzed with respect to NM response temporal profiles and total EMG spike firing rate. Four main regularities were revealed and quantified: 1) spike amplitude increased with response amplitude; 2) smaller spikes always appeared before larger spikes; 3) subsequent firing rates covaried for spikes of different amplitude, with smaller spikes always firing at higher rates than larger ones; and 4) firing-rate profiles were approximately Gaussian for all amplitudes. These regularities suggest that recruitment does take place in the retractor bulbi muscle during conditioned NM responses and that all motoneurons receive the same command signal (common-drive hypothesis). To test this hypothesis, a model of the motoneuron pool was constructed in which motoneurons had a range of intrinsic thresholds distributed exponentially, with threshold linearly related to EMG spike amplitude. Each neuron received the same input signal as required by the common-drive assumption. This simple model reproduced the main features of the data, suggesting that conditioned NM responses are controlled by a common-drive mechanism that enables simple commands to determine response topography in a linear fashion.
Collapse
Affiliation(s)
- N F Lepora
- Department of Psychology, University of Sheffield, Western Bank, Sheffield, United Kingdom.
| | | | | | | | | |
Collapse
|
11
|
Anderson SR, Porrill J, Sklavos S, Gandhi NJ, Sparks DL, Dean P. Dynamics of primate oculomotor plant revealed by effects of abducens microstimulation. J Neurophysiol 2009; 101:2907-23. [PMID: 19297512 PMCID: PMC2694114 DOI: 10.1152/jn.91045.2008] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2008] [Accepted: 03/12/2009] [Indexed: 11/22/2022] Open
Abstract
Despite their importance for deciphering oculomotor commands, the mechanics of the extraocular muscles and orbital tissues (oculomotor plant) are poorly understood. In particular, the significance of plant nonlinearities is uncertain. Here primate plant dynamics were investigated by measuring the eye movements produced by stimulating the abducens nucleus with brief pulse trains of varying frequency. Statistical analysis of these movements indicated that the effects of stimulation lasted about 40 ms after the final pulse, after which the eye returned passively toward its position before stimulation. Behavior during the passive phase could be approximated by a linear plant model, corresponding to Voigt elements in series, with properties independent of initial eye position. In contrast, behavior during the stimulation phase revealed a sigmoidal relation between stimulation frequency and estimated steady-state tetanic tension, together with a frequency-dependent rate of tension increase, that appeared very similar to the nonlinearities previously found for isometric-force production in primate lateral rectus muscle. These results suggest that the dynamics of the oculomotor plant have an approximately linear component related to steady-state viscoelasticity and a nonlinear component related to changes in muscle activation. The latter may in part account for the nonlinear relations observed between eye-movement parameters and single-unit firing patterns in the abducens nucleus. These findings point to the importance of recruitment as a simplifying factor for motor control with nonlinear plants.
Collapse
Affiliation(s)
- Sean R Anderson
- Department of Psychology, Sheffield University, Western Bank, Sheffield S10 2TP, United Kingdom
| | | | | | | | | | | |
Collapse
|