1
|
Hausknecht M, Li WK, Mauk M, Stone P. Machine Learning Capabilities of a Simulated Cerebellum. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:510-522. [PMID: 26829807 DOI: 10.1109/tnnls.2015.2512838] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
This paper describes the learning and control capabilities of a biologically constrained bottom-up model of the mammalian cerebellum. Results are presented from six tasks: 1) eyelid conditioning; 2) pendulum balancing; 3) proportional-integral-derivative control; 4) robot balancing; 5) pattern recognition; and 6) MNIST handwritten digit recognition. These tasks span several paradigms of machine learning, including supervised learning, reinforcement learning, control, and pattern recognition. Results over these six domains indicate that the cerebellar simulation is capable of robustly identifying static input patterns even when randomized across the sensory apparatus. This capability allows the simulated cerebellum to perform several different supervised learning and control tasks. On the other hand, both reinforcement learning and temporal pattern recognition prove problematic due to the delayed nature of error signals and the simulator's inability to solve the credit assignment problem. These results are consistent with previous findings which hypothesize that in the human brain, the basal ganglia is responsible for reinforcement learning, while the cerebellum handles supervised learning.
Collapse
|
2
|
McKinstry JL, Edelman GM. Temporal sequence learning in winner-take-all networks of spiking neurons demonstrated in a brain-based device. Front Neurorobot 2013; 7:10. [PMID: 23760804 PMCID: PMC3674315 DOI: 10.3389/fnbot.2013.00010] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2013] [Accepted: 05/20/2013] [Indexed: 11/24/2022] Open
Abstract
Animal behavior often involves a temporally ordered sequence of actions learned from experience. Here we describe simulations of interconnected networks of spiking neurons that learn to generate patterns of activity in correct temporal order. The simulation consists of large-scale networks of thousands of excitatory and inhibitory neurons that exhibit short-term synaptic plasticity and spike-timing dependent synaptic plasticity. The neural architecture within each area is arranged to evoke winner-take-all (WTA) patterns of neural activity that persist for tens of milliseconds. In order to generate and switch between consecutive firing patterns in correct temporal order, a reentrant exchange of signals between these areas was necessary. To demonstrate the capacity of this arrangement, we used the simulation to train a brain-based device responding to visual input by autonomously generating temporal sequences of motor actions.
Collapse
|
3
|
Chen CMA, Mathalon DH, Roach BJ, Cavus I, Spencer DD, Ford JM. The corollary discharge in humans is related to synchronous neural oscillations. J Cogn Neurosci 2011; 23:2892-904. [PMID: 20946054 PMCID: PMC4155919 DOI: 10.1162/jocn.2010.21589] [Citation(s) in RCA: 59] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
How do animals distinguish between sensations coming from external sources and those resulting from their own actions? A corollary discharge system has evolved that involves the transmission of a copy of motor commands to sensory cortex, where the expected sensation is generated. Through this mechanism, sensations are tagged as coming from self, and responsiveness to them is minimized. The present study investigated whether neural phase synchrony between motor command and auditory cortical areas is related to the suppression of the auditory cortical response. We recorded electrocorticograms from the human brain during a vocalizing/listening task. Neural phase synchrony between Broca's area and auditory cortex in the gamma band (35 to ∼50 Hz) in the 50-msec time window preceding speech onset was greater during vocalizing than during listening to a playback of the same spoken sounds. Because prespeech neural synchrony was correlated (r = -.83, p = .006), with the subsequent suppression of the auditory cortical response to the spoken sound, we hypothesize that phase synchrony in the gamma band between Broca's area and auditory cortex is the neural instantiation of the transmission of a copy of motor commands. We suggest that neural phase synchrony of gamma frequencies may contribute to transmission of corollary discharges in humans.
Collapse
Affiliation(s)
- Chi-Ming A. Chen
- Department of Psychiatry, Columbia University, 1051 Riverside Drive, Unit 21, New York, NY 10032
- Department of Psychiatry, Yale University, 300 George St., New Haven, CT 06511
| | - Daniel H. Mathalon
- Department of Psychiatry, Yale University, 300 George St., New Haven, CT 06511
- Department of Psychiatry, University of California, San Francisco, SFVA, 4150 Clement Street, Building 8, Room 9B-30 116D, San Francisco, CA 94121
| | - Brian J. Roach
- Department of Psychiatry, Yale University, 300 George St., New Haven, CT 06511
- Department of Psychiatry, University of California, San Francisco, SFVA, 4150 Clement Street, Building 8, Room 9B-30 116D, San Francisco, CA 94121
| | - Idil Cavus
- Department of Psychiatry, Yale University, 300 George St., New Haven, CT 06511
| | - Dennis D. Spencer
- Department of Neurosurgery, Yale University, 789 Howard Ave., New Haven, CT 06519
| | - Judith M. Ford
- Department of Psychiatry, Yale University, 300 George St., New Haven, CT 06511
- Department of Psychiatry, University of California, San Francisco, SFVA, 4150 Clement Street, Building 8, Room 9B-30 116D, San Francisco, CA 94121
| |
Collapse
|