Selective involvement of the spinal trigeminal nucleus in the conditioned nictitating membrane reflex of the rabbit

An embodied biologically constrained model of foraging: from classical and operant conditioning to adaptive real-world behavior in DAC-X

Animals successfully forage within new environments by learning, simulating and adapting to their surroundings. The functions behind such goal-oriented behavior can be decomposed into 5 top-level objectives: 'how', 'why', 'what', 'where', 'when' (H4W). The paradigms of classical and operant conditioning describe some of the behavioral aspects found in foraging. However, it remains unclear how the organization of their underlying neural principles account for these complex behaviors. We address this problem from the perspective of the Distributed Adaptive Control theory of mind and brain (DAC) that interprets these two paradigms as expressing properties of core functional subsystems of a layered architecture. In particular, we propose DAC-X, a novel cognitive architecture that unifies the theoretical principles of DAC with biologically constrained computational models of several areas of the mammalian brain. DAC-X supports complex foraging strategies through the progressive acquisition, retention and expression of task-dependent information and associated shaping of action, from exploration to goal-oriented deliberation. We benchmark DAC-X using a robot-based hoarding task including the main perceptual and cognitive aspects of animal foraging. We show that efficient goal-oriented behavior results from the interaction of parallel learning mechanisms accounting for motor adaptation, spatial encoding and decision-making. Together, our results suggest that the H4W problem can be solved by DAC-X building on the insights from the study of classical and operant conditioning. Finally, we discuss the advantages and limitations of the proposed biologically constrained and embodied approach towards the study of cognition and the relation of DAC-X to other cognitive architectures.

Real Time Operations of the Cerebellar Cortex

This manuscript reviews a series of experiments which support the notion that the cerebellum and more specifically the cerebellar cortex is principally involved in real time operations required for the regulation of coordinated motor activity. Experiments are reviewed which illustrate: (1) that the climbing fiber inputs to Purkinje cells can induce a short-lasting enhancement of their responses to mossy fiber-granule cell-parallel fiber inputs, (2) that the cerebellum is not essential for the acquisition and performance of the classically conditioned nictitating membrane reflex (NMR) of the rabbit, and (3) that the observations resulting from the microinjection of lidocaine and multiple single unit recordings within the brainstem support the notion that cell populations in this region may participate in establishing the modifications in neuronal interactions required for the acquisition of the conditioned NMR. In addition, preliminary data are shown comparing the capacity of a normal subject and a patient with a massive ipsilateral cerebellar stroke to learn certain tracing tasks and to redraw these learned tracing movements 90° to the orientation of the original image. The data support the notion that the cerebellum is essential, not for the initial learning of the tracing movement, but rather for performing the learned movement with the required rotation of the original image.

The representation of egocentric space in the posterior parietal cortex

The posterior parietal cortex (PPC) is the most likely site where egocentric spatial relationships are represented in the brain. PPC cells receive visual, auditory, somaesthetic, and vestibular sensory inputs; oculomotor, head, limb, and body motor signals; and strong motivational projections from the limbic system. Their discharge increases not only when an animal moves towards a sensory target, but also when it directs its attention to it. PPC lesions have the opposite effect: sensory inattention and neglect. The PPC does not seem to contain a "map" of the location of objects in space but a distributed neural network for transforming one set of sensory vectors into other sensory reference frames or into various motor coordinate systems. Which set of transformation rules is used probably depends on attention, which selectively enhances the synapses needed for making a particular sensory comparison or aiming a particular movement.

Does the nervous system depend on kinesthetic information to control natural limb movements?

This target article draws together two groups of experimental studies on the control of human movement through peripheral feedback and centrally generated signals of motor commands. First, during natural movement, feedback from muscle, joint, and cutaneous afferents changes; in human subjects these changes have reflex and kinesthetic consequences. Recent psychophysical and microneurographic evidence suggests that joint and even cutaneous afferents may have a proprioceptive role. Second, the role of centrally generated motor commands in the control of normal movements and movements following acute and chronic deafferentation is reviewed. There is increasing evidence that subjects can perceive their motor commands under various conditions, but that this is inadequate for normal movement; deficits in motor performance arise when the reliance on proprioceptive feedback is abolished either experimentally or because of pathology. During natural movement, the CNS appears to have access to functionally useful input from a range of peripheral receptors as well as from internally generated command signals. The unanswered questions that remain suggest a number of avenues for further research.

Implications of neural networks for how we think about brain function

Engineers use neural networks to control systems too complex for conventional engineering solutions. To examine the behavior of individual hidden units would defeat the purpose of this approach because it would be largely uninterpretable. Yet neurophysiologists spend their careers doing just that! Hidden units contain bits and scraps of signals that yield only arcane hints about network function and no information about how its individual units process signals. Most literature on single-unit recordings attests to this grim fact. On the other hand, knowing a system's function and describing it with elegant mathematics tell one very little about what to expect of interneuronal behavior. Examples of simple networks based on neurophysiology are taken from the oculomotor literature to suggest how single-unit interpretability might decrease with increasing task complexity. It is argued that trying to explain how any real neural network works on a cell-by-cell, reductionist basis is futile and we may have to be content with trying to understand the brain at higher levels of organization.

The role of interpositus nucleus in eyelid conditioned responses

One of the most widely used experimental models for the study of learning processes in mammals has been the classical conditioning of nictitating membrane/eyelid responses, using both trace and delay paradigms. Mainly on the basis of permanent or transitory lesions of putatively-involved structures, and using other stimulation and recording techniques, it has been proposed that cerebellar cortex and/or nuclei could be the place/s where this elemental form of associative learning is acquired and stored. We have used here an output-to-input approach to review recent evidence regarding the involvement of the cerebellar interpositus nucleus in the acquisition of these conditioned responses (CRs). Eyelid CRs appear to be different in profile, duration, and peak velocity from reflexively-evoked blinks. In addition, CRs are generated in a quantum manner across conditioning sessions, suggesting a gradual neural process for their proper acquisition. Accessory abducens and orbicularis oculi motoneurons have different membrane properties and contribute differently to the generation of CRs, with significant species differences. In particular, facial motoneurons seem to encode eyelid velocity during reflexively-evoked blinks and eyelid position during CRs, two facts suggestive of a differential somatic versus dendritic arrival of specific motor commands for each type of movement. Identified interpositus neurons recorded in alert cats during classical conditioning of eyelid responses show firing properties suggestive of an enhancing role for CR performance. However, as their firing started after CR onset, and because they do not seem to encode eyelid position during the CR, the interpositus nucleus cannot be conclusively considered as the place where this acquired motor response is generated. More information is needed regarding neural signal transformations taking place in each involved neural center, and it its proposed that more attention should be paid to functional states (as opposed to neural sites) able to generate motor learning in mammals. The contribution of feedforward mechanisms normally involved in the processing activities of related centers and circuits, and the possible functional interactions within neural systems subserving the associative strength between the conditioned and unconditioned stimuli, are also considered.

Central trigeminal and posterior eighth nerve projections in the turtle Chrysemys picta studied in vitro

Recent electrophysiological studies in the turtle Chrysemys picta have suggested that a neural correlate of the eye-blink reflex can be evoked in an in vitro brain-stem-cerebellum preparation by electrical rather than natural stimulation of the cranial nerves. Discharge recorded in the abducens nerve, which is similar to EMG recordings from extraocular muscles during eye retraction, is triggered by a brief electrical stimulus applied to the ipsilateral trigeminal nerve. Evidence also suggests that pairing a one-second electrical stimulus applied to the posterior eighth nerve immediately prior to a single shock to the trigeminal nerve results in classically conditioned abducens nerve discharge in response to the previously neutral eighth nerve stimulus. In view of these physiological findings, the aim of the present study was to examine the central projections of trigeminal and posterior eighth nerve inputs to elucidate the anatomical substrates that may underlie the in vitro eye-blink reflex and possible pathways involved in reflex conditioning. Neurobiotin (NB) or fluorescein dextran (FD) was pressure injected into the cut end of either the trigeminal or posterior eighth nerve of the in vitro brainstem-cerebellum. Following trigeminal nerve injections, both tracers showed label in the ipsilateral trigeminal nuclear complex. Direct projections to the ipsilateral principal and accessory abducens motor nuclei were observed, suggesting that the eye-blink reflex is monosynaptic. Trigeminal nerve axons were also observed to terminate in the ipsilateral cerebellar cortex. The results of the posterior eighth nerve injections showed axonal projections and terminals in the cochlear, vestibular and principal sensory trigeminal nuclei. Terminal label was also observed in the ipsilateral cerebellar cortex, deep cerebellar nuclei, and in the principal and accessory abducens motor nuclei. Results from the NB cases suggested transneuronal transport of this tracer substance, whereas the FD cases did not. The present findings suggest that convergence of trigeminal and posterior eighth nerve inputs occurs in the ipsilateral cerebellar cortex, the principal sensory trigeminal nucleus, and the principal and accessory abducens motor nuclei. These regions of convergence may therefore be considered as potential sites of synaptic modification during in vitro studies of the conditioned abducens nerve reflex.

The cerebellum and red nucleus are not required for In vitro classical conditioning of the turtle abducens nerve response

The role of the cerebellum during motor learning is a controversial issue. Many authors have suggested that the cerebellum and its connections with the red nucleus are essential for the acquisition of the conditioned eye blink reflex. Although there is little argument that the cerebellum is an important component to the generation of the conditioned response (CR), a number of studies have suggested that the cerebellum is not essential for conditioning. Using an in vitro model of the classically conditioned turtle abducens nerve response, we investigated the effect of cerebellar and red nucleus lesions on the acquisition, extinction, and reacquisition of CRs. Neural discharge was recorded from the abducens nerve after a single shock unconditioned stimulus (US) was applied to the ipsilateral trigeminal nerve. When the US was paired with a conditioned stimulus (CS) applied to the posterior eighth, or auditory, nerve, a positive slope of CR acquisition was recorded in the abducens nerve. After extinction stimuli in which the CS and US were alternated, the number of CRs decreased to near zero. When the CS and US were once again paired, reacquisition at a faster rate was recorded. The CRs showed unusual timing features compared with preparations in which the cerebellum was intact; they had significantly shorter latencies and showed burst-like responses. These data demonstrate that it is possible to classically condition this in vitro preparation in the absence of the cerebellum and red nucleus. However, the latencies of CRs were found to be dramatically altered in the cerebellar-lesioned preparations, suggesting that the cerebellum does play a role in the timing of the CR.

Effects of inactivating individual cerebellar nuclei on the performance and retention of an operantly conditioned forelimb movement

These experiments were designed to examine the effects of inactivating separately each of the major cerebellar nuclear regions in cats on the execution and retention of a previously learned, operantly conditioned volitional forelimb movement. The experiments test the postulates that the cerebellar nuclei, and particularly the interposed nuclei, contribute substantially to the spatial and temporal features of the interjoint coordination required to execute the task and that the engram necessary for the retention of this task is not located in any one of the cerebellar nuclei. All cats were trained to perform a task in which they were required to reach for and grasp a vertical bar at the sound of a tone and move the bar to a reward zone through a template consisting of two straight grooves in the shape of an inverted "L." After the task was learned, the effects of inactivating separately each nuclear region (the fastigial, interposed, and dentate nuclei) using muscimol microinjections were determined. Data were analyzed by quantifying several features of the movement's kinematics and by determining changes in the organization of the reaching component of the movement using an application of dimensionality analysis, an analysis that examines the correlation among the changes in joint angles and limb segment positions during the task. The retention of the previously learned task also was assessed after each injection. Injections of each nuclear region affected temporal and spatial features of the learned movement. However, the largest effects resulted from inactivating the interposed nuclei. These effects included an increased length of the reach trajectory, an accentuated deviation of the wrist trajectory from a straight line, cyclic movement of the distal extremity as the target was approached, a difficulty in grasping the bar, altered temporal features of the movement, and a highly characteristic change in the dimensionality measurements. The changes in dimensionality reflected a decreased correlation (linear interdependence) of the joint angular velocities coupled with an increased correlation among the linear velocities of markers located on the joints themselves. Related but less consistent changes in dimensionality resulted from fastigial injections. The motor sequence required to negotiate the template could be executed after the nuclear microinjections, indicating that retention of the motor sequence was not affected by the inactivation of any of the cerebellar nuclei. However, in two of the five animals, some decreases in performance were observed after dentate injection that were not characteristic of changes related to an effect on retention. These data suggest that the cerebellum plays an important role in regulating the consistent, stereotypic organization of complex goal-directed movements, including the temporal correlation among joint angle velocities. The data also indicate that the retention of the task is not dependent on any of the individual cerebellar nuclear regions. Consequently, these structures are unlikely to be critical storage sites for the engram established during the learning of this task.

Acquisition of a new-latency conditioned nictitating membrane response--major, but not complete, dependence on the ipsilateral cerebellum

Classical conditioning of the nictitating membrane response (NMR) of rabbits is simple associative learning of a motor response. In several two-stage experiments, reversible inactivations of the deep cerebellar nuclei in stage 1 appeared to prevent acquisition of NMR conditioning in naive rabbits--no conditioned responses (CRs) were evident after inactivations were lifted in stage 2. Results of a three-stage experiment were different. When subjects were first trained with a light conditional stimulus (CS) in stage 1, reversible cerebellar inactivations during conditioning to a different, tone CS during stage 2 did not appear to prevent new learning because CRs to the tone CS were evident when the inactivation was lifted. Results from the two-stage experiments support the suggestion that the cerebellum is essential for the acquisition of NMR conditioning, but results from the three-stage experiment do not. Here, we use a three-stage design with different interstimulus intervals (ISIs) in stages 1 and 2. Because CRs develop with latencies-to-peak dependent on the ISI, learning during stage 1 can be dissociated from that accruing in stage 2. Complete inactivation of the ipsilateral cerebellar nuclei with muscimol substantially but not completely prevented learning with the second ISI during stage 2 because small CR peaks around the stage 2 ISI could be detected in some subjects after the inactivation had been lifted in stage 3. We suggest that the weak levels of conditioning possible during unilateral inactivation depend on the contralateral cerebellum or on extracerebellar circuitry and that these may be capable of supporting transfer of conditioning in a previous three-stage experiment. But, we confirm that normal NMR conditioning is critically dependent on the ipsilateral cerebellum.

On the cerebellum, cutaneomuscular reflexes, movement control and the elusive engrams of memory

This review focuses on the role of the cerebellum in regulating cutaneomuscular reflexes and provides a hypothesis regarding the way in which this action contributes to the coordination of goal-directed movements of the extremities. Specific attention is directed towards the cerebellum's role in conditioned and unconditioned eyeblink reflexes and limb withdrawal reflexes as models of its interactions with the cutaneomuscular reflex systems. The implications regarding the cerebellum as a storage site for motor engrams also is discussed in the context of these two behaviors. The proposed hypothesis suggests that the cerebellum regulates important features of the cutaneomuscular reflex circuits including the integration of their activity with descending pathways in a manner that implements these fundamental reflex circuits in the organization and control of goal-directed movements of the extremities.

Kinematic analyses of classically-conditioned eyelid movements in the cat suggest a brain stem site for motor learning

Upper eyelid movements were conditioned in the alert cat to the presentation of either tones or short, weak air puffs applied to the ipsi- or contralateral cornea followed by an unconditioned stimulus consisting of a long, strong air puff applied to the ipsilateral cornea. Eyelid movements were measured with the search-coil technique. Electromyographs of the orbicularis oculi muscle were also recorded. Quantitative analysis of the latencies and topographic profiles of eyelid conditioned responses suggests that the primary site for their initiation is the brain stem reflex circuit involved, depending on the sensory modality of and on the side where the conditioning stimulus was applied. However, the kinematic of the conditioned response indicates that other neural structures are involved in its acquisition and consolidation.

The temporary inactivation of the red nucleus affects performance of both conditioned and unconditioned nictitating membrane responses in the rabbit

These experiments are part of a series of studies examining the role of the red nucleus in the performance of the conditioned and unconditioned nictitating membrane reflexes in the rabbit. Specifically, the experiments test the hypothesis that the temporary inactivation of the red nucleus selectively affects the performance of the conditioned reflex. The experiments were designed to assess the effects of lidocaine and control saline microinjections on conditioned as well as unconditioned responses in both paired and unpaired trials. Rabbits were chronically implanted with cannulae through which small injecting tubes were passed stereotaxically to the red nucleus. The animals were conditioned using a delay paradigm in which a 1 kHz tone and an air puff applied to the cornea were used as the unconditioned and conditioned stimulus, respectively. Once conditioned, the effects of either lidocaine or saline injection were evaluated while alternating paired trials with unpaired trials in which only the air puff was applied. The principal finding of this study was that the amplitudes of both the conditioned and unconditioned responses were reduced following lidocaine injection into the red nucleus. The effect on the unconditioned response amplitude could not be ascribed to any interaction between the conditioned and unconditioned responses, since it also was present in the unpaired trials. The reduction in amplitude of the conditioned and unconditioned responses was shown to be correlated with changes in other characteristics of the same responses. The data suggest that the red nucleus contributes to the performance of both the conditioned and unconditioned nictitating membrane reflexes and consequently is not likely to be involved only in pathways responsible for mediating and/or storing the engram for the conditioned reflex.