1
|
van der Scheer HT, Doelman A. Synapse fits neuron: joint reduction by model inversion. BIOLOGICAL CYBERNETICS 2017; 111:309-334. [PMID: 28689352 PMCID: PMC5506247 DOI: 10.1007/s00422-017-0722-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2015] [Accepted: 06/19/2017] [Indexed: 06/07/2023]
Abstract
In this paper, we introduce a novel simplification method for dealing with physical systems that can be thought to consist of two subsystems connected in series, such as a neuron and a synapse. The aim of our method is to help find a simple, yet convincing model of the full cascade-connected system, assuming that a satisfactory model of one of the subsystems, e.g., the neuron, is already given. Our method allows us to validate a candidate model of the full cascade against data at a finer scale. In our main example, we apply our method to part of the squid's giant fiber system. We first postulate a simple, hypothetical model of cell-to-cell signaling based on the squid's escape response. Then, given a FitzHugh-type neuron model, we derive the verifiable model of the squid giant synapse that this hypothesis implies. We show that the derived synapse model accurately reproduces synaptic recordings, hence lending support to the postulated, simple model of cell-to-cell signaling, which thus, in turn, can be used as a basic building block for network models.
Collapse
Affiliation(s)
- H. T. van der Scheer
- Mathematical Institute, Leiden University, P.O. Box 9512, 2300 RA Leiden, The Netherlands
| | - A. Doelman
- Mathematical Institute, Leiden University, P.O. Box 9512, 2300 RA Leiden, The Netherlands
| |
Collapse
|
2
|
Green AM, Labelle JP. The influence of proprioceptive state on learning control of reach dynamics. Exp Brain Res 2015; 233:2961-75. [PMID: 26169102 DOI: 10.1007/s00221-015-4366-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2014] [Accepted: 06/18/2015] [Indexed: 11/29/2022]
Abstract
The motor system shows a remarkable capacity to generalize learned behavior to new contexts while simultaneously permitting learning of multiple and sometimes conflicting skills. To examine the influence of proprioceptive state on this capacity, we compared the effectiveness of changes in workspace location and limb orientation (horizontal vs. parasagittal plane posture) in facilitating learning of opposing dynamic force-field perturbations. When opposing fields were encountered in similar workspace positions and limb orientations, subjects failed to learn the two tasks. In contrast, differences in initial limb proprioceptive state were sufficient for significant learning to take place. The extent of learning was similar when the two fields were encountered in different arm orientations in a similar workspace location as compared to when learning took place in spatially separated workspace locations, consistent with the generalization of learning mainly in intrinsic joint coordinates. In keeping with these observations, examination of how trial-to-trial adaptation generalized showed that generalization tended to be greater across similar limb postures. However, when the two fields were encountered in distinct spatial locations, the extent of generalization of adaptation to one field depended on the limb orientation in which the other field was encountered. These results suggest that three-dimensional proprioceptive limb state plays an important role in modulating generalization patterns so as to permit the best compromise between broad generalization and the simultaneous learning of conflicting skills.
Collapse
Affiliation(s)
- Andrea M Green
- Département de Neurosciences, Université de Montréal, CP 6128, Succursale Centre-Ville, Montreal, QC, H3C 3J7, Canada.
| | - Jean-Philippe Labelle
- Département de Neurosciences, Université de Montréal, CP 6128, Succursale Centre-Ville, Montreal, QC, H3C 3J7, Canada
| |
Collapse
|
3
|
Rezai O, Kleinhans A, Matallanas E, Selby B, Tripp BP. Modeling the shape hierarchy for visually guided grasping. Front Comput Neurosci 2014; 8:132. [PMID: 25386134 PMCID: PMC4209868 DOI: 10.3389/fncom.2014.00132] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2014] [Accepted: 09/26/2014] [Indexed: 11/25/2022] Open
Abstract
The monkey anterior intraparietal area (AIP) encodes visual information about three-dimensional object shape that is used to shape the hand for grasping. We modeled shape tuning in visual AIP neurons and its relationship with curvature and gradient information from the caudal intraparietal area (CIP). The main goal was to gain insight into the kinds of shape parameterizations that can account for AIP tuning and that are consistent with both the inputs to AIP and the role of AIP in grasping. We first experimented with superquadric shape parameters. We considered superquadrics because they occupy a role in robotics that is similar to AIP, in that superquadric fits are derived from visual input and used for grasp planning. We also experimented with an alternative shape parameterization that was based on an Isomap dimension reduction of spatial derivatives of depth (i.e., distance from the observer to the object surface). We considered an Isomap-based model because its parameters lacked discontinuities between similar shapes. When we matched the dimension of the Isomap to the number of superquadric parameters, the superquadric model fit the AIP data somewhat more closely. However, higher-dimensional Isomaps provided excellent fits. Also, we found that the Isomap parameters could be approximated much more accurately than superquadric parameters by feedforward neural networks with CIP-like inputs. We conclude that Isomaps, or perhaps alternative dimension reductions of visual inputs to AIP, provide a promising model of AIP electrophysiology data. Further work is needed to test whether such shape parameterizations actually provide an effective basis for grasp control.
Collapse
Affiliation(s)
- Omid Rezai
- Department of Systems Design Engineering, Centre for Theoretical Neuroscience, University of Waterloo Waterloo, ON, Canada
| | - Ashley Kleinhans
- Mobile Intelligent Autonomous Systems, Council for Scientific and Industrial Research Pretoria, South Africa ; School of Mechanical and Industrial Engineering, University of Johannesburg Johannesburg, South Africa
| | | | - Ben Selby
- Department of Systems Design Engineering, Centre for Theoretical Neuroscience, University of Waterloo Waterloo, ON, Canada
| | - Bryan P Tripp
- Department of Systems Design Engineering, Centre for Theoretical Neuroscience, University of Waterloo Waterloo, ON, Canada
| |
Collapse
|
4
|
Fiori S, Rossi R. STIEFEL-MANIFOLD LEARNING BY IMPROVED RIGID-BODY THEORY APPLIED TO ICA. Int J Neural Syst 2011; 13:273-90. [PMID: 14652870 DOI: 10.1142/s0129065703001625] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2003] [Revised: 09/02/2003] [Accepted: 09/02/2003] [Indexed: 11/18/2022]
Abstract
In previous contributions we presented a new class of algorithms for orthonormal learning of a linear neural network with p inputs and m outputs, based on the equations describing the dynamics of a massive rigid frame in a submanifold of ℛp. While exhibiting interesting features, such as intrinsic numerical stability, strongly binding to the orthonormal submanifolds, and good controllability of the learning dynamics, tested on principal/independent component analysis, the proposed algorithms were not completely satisfactory from a computational-complexity point of view. The main drawback was the need to repeatedly evaluate a matrix exponential map. With the aim to lessen the computational efforts pertaining to these algorithms, we propose here an improvement based on the closed-form Rodriguez formula for the exponential map. Such formula is available in the p=3 and m=3 case, which is discussed with details here. In particular, experimental results on independent component analysis (ICA), carried out with both synthetic and real-world data, help confirming the computational gain due to the proposed improvement.
Collapse
Affiliation(s)
- Simone Fiori
- Faculty of Engineering, University of Perugia, Polo Didattico e Scientifico del Ternano, Loc. Pentima bassa, 21, I-05100 Terni, Italy.
| | | |
Collapse
|
5
|
Ajemian R, Green A, Bullock D, Sergio L, Kalaska J, Grossberg S. Assessing the function of motor cortex: single-neuron models of how neural response is modulated by limb biomechanics. Neuron 2008; 58:414-28. [PMID: 18466751 DOI: 10.1016/j.neuron.2008.02.033] [Citation(s) in RCA: 31] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2007] [Revised: 07/13/2007] [Accepted: 02/12/2008] [Indexed: 11/19/2022]
Abstract
Do neurons in primary motor cortex encode the generative details of motor behavior, such as individual muscle activities, or do they encode high-level movement attributes? Resolving this question has proven difficult, in large part because of the sizeable uncertainty inherent in estimating or measuring the joint torques and muscle forces that underlie movements made by biological limbs. We circumvented this difficulty by considering single-neuron responses in an isometric task, where joint torques and muscle forces can be straightforwardly computed from limb geometry. The response for each neuron was modeled as a linear function of a "preferred" joint torque vector, and this model was fit to individual neural responses across variations in limb posture. The resulting goodness of fit suggests that neurons in motor cortex do encode the kinetics of motor behavior and that the neural response properties of "preferred direction" and "gain" are dual components of a unitary response vector.
Collapse
Affiliation(s)
- Robert Ajemian
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | | | | | | | | | | |
Collapse
|
6
|
Churchland MM, Shenoy KV. Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. J Neurophysiol 2007; 97:4235-57. [PMID: 17376854 DOI: 10.1152/jn.00095.2007] [Citation(s) in RCA: 197] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The relationship between neural activity in motor cortex and movement is highly debated. Although many studies have examined the spatial tuning (e.g., for direction) of cortical responses, less attention has been paid to the temporal properties of individual neuron responses. We developed a novel task, employing two instructed speeds, that allows meaningful averaging of neural responses across reaches with nearly identical velocity profiles. Doing so preserves fine temporal structure and reveals considerable complexity and heterogeneity of response patterns in primary motor and premotor cortex. Tuning for direction was prominent, but the preferred direction was frequently inconstant with respect to time, instructed-speed, and/or reach distance. Response patterns were often temporally complex and multiphasic, and varied with direction and instructed speed in idiosyncratic ways. A wide variety of patterns was observed, and it was not uncommon for a neuron to exhibit a pattern shared by no other neuron in our dataset. Response patterns of individual neurons rarely, if ever, matched those of individual muscles. Indeed, the set of recorded responses spanned a much higher dimensional space than would be expected for a model in which neural responses relate to a moderate number of factors-dynamic, kinematic, or otherwise. Complex responses may provide a basis-set representing many parameters. Alternately, it may be necessary to discard the notion that responses exist to "represent" movement parameters. It has been argued that complex and heterogeneous responses are expected of a recurrent network that produces temporally patterned outputs, and the present results would seem to support this view.
Collapse
Affiliation(s)
- Mark M Churchland
- Neurosciences Program and Department of Electrical Engineering, Stanford University, Stanford, California 94305-4075, USA
| | | |
Collapse
|
7
|
Shoham S, Paninski LM, Fellows MR, Hatsopoulos NG, Donoghue JP, Normann RA. Statistical encoding model for a primary motor cortical brain-machine interface. IEEE Trans Biomed Eng 2005; 52:1312-22. [PMID: 16041995 DOI: 10.1109/tbme.2005.847542] [Citation(s) in RCA: 67] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
A number of studies of the motor system suggest that the majority of primary motor cortical neurons represent simple movement-related kinematic and dynamic quantities in their time-varying activity patterns. An example of such an encoding relationship is the cosine tuning of firing rate with respect to the direction of hand motion. We present a systematic development of statistical encoding models for movement-related motor neurons using multielectrode array recordings during a two-dimensional (2-D) continuous pursuit-tracking task. Our approach avoids massive averaging of responses by utilizing 2-D normalized occupancy plots, cascaded linear-nonlinear (LN) system models and a method for describing variability in discrete random systems. We found that the expected firing rate of most movement-related motor neurons is related to the kinematic values by a linear transformation, with a significant nonlinear distortion in about 1/3 of the neurons. The measured variability of the neural responses is markedly non-Poisson in many neurons and is well captured by a "normalized-Gaussian" statistical model that is defined and introduced here. The statistical model is seamlessly integrated into a nearly-optimal recursive method for decoding movement from neural responses based on a Sequential Monte Carlo filter.
Collapse
Affiliation(s)
- Shy Shoham
- Faculty of Biomedical Engineering, the Technion, Israel Institute of Technology, Haifa 32000, Israel.
| | | | | | | | | | | |
Collapse
|
8
|
Fiori S. Relative uncertainty learning theory: an essay. Int J Neural Syst 2004; 14:293-311. [PMID: 15593378 DOI: 10.1142/s0129065704002042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2004] [Revised: 09/07/2004] [Accepted: 09/21/2004] [Indexed: 11/18/2022]
Abstract
The aim of this manuscript is to present a detailed analysis of the algebraic and geometric properties of relative uncertainty theory (RUT) applied to neural networks learning. Through the algebraic analysis of the original learning criterion, it is shown that RUT gives rise to principal-subspace-analysis-type learning equations. Through an algebraic-geometric analysis, the behavior of such matrix-type learning equations is illustrated, with particular emphasis to the existence of certain invariant manifolds.
Collapse
Affiliation(s)
- Simone Fiori
- Facoltà di Ingegneria, Università di Perugia, Polo Didattico e Scientifico del Ternano, Loc. Pentima bassa 21, I-05100 Terni, Italy.
| |
Collapse
|
9
|
Siegel RM, Raffi M, Phinney RE, Turner JA, Jandó G. Functional architecture of eye position gain fields in visual association cortex of behaving monkey. J Neurophysiol 2003; 90:1279-94. [PMID: 12672786 DOI: 10.1152/jn.01179.2002] [Citation(s) in RCA: 35] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
In the behaving monkey, inferior parietal lobe cortical neurons combine visual information with eye position signals. However, an organized topographic map of these neurons' properties has never been demonstrated. Intrinsic optical imaging revealed a functional architecture for the effect of eye position on the visual response to radial optic flow. The map was distributed across two subdivisions of the inferior parietal lobule, area 7a and the dorsal prelunate area, DP. Area 7a contains a representation of the lower eye position gain fields while area DP represents the upper eye position gain fields. Horizontal eye position is represented orthogonal to the vertical eye position across the medial lateral extents of the cortices. Similar topographies were found in three hemispheres of two monkeys; the horizontal and vertical gain field representations were not isotropic with a greater modulation found with the vertical. Monte Carlo methods demonstrated the significance of the maps, and they were verified in part using multiunit recordings. The novel topographic organization of this association cortex area provides a substrate for constructing representations of surrounding space for perception and the guidance of motor behaviors.
Collapse
Affiliation(s)
- Ralph M Siegel
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey 07102, USA.
| | | | | | | | | |
Collapse
|
10
|
Fagg AH, Shah A, Barto AG. A computational model of muscle recruitment for wrist movements. J Neurophysiol 2002; 88:3348-58. [PMID: 12466451 DOI: 10.1152/jn.00621.2002] [Citation(s) in RCA: 75] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
To execute a movement, the CNS must appropriately select and activate the set of muscles that will produce the desired movement. This problem is particularly difficult because a variety of muscle subsets can usually be used to produce the same joint motion. The motor system is therefore faced with a motor redundancy problem that must be resolved to produce the movement. In this paper, we present a model of muscle recruitment in the wrist step-tracking task. Muscle activation levels for five muscles are selected so as to satisfy task constraints (moving to the designated target) while also minimizing a measure of the total effort in producing the movement. Imposing these constraints yields muscle activation patterns qualitatively similar to those observed experimentally. In particular, the model reproduces the observed cosine-like recruitment of muscles as a function of movement direction and also appropriately predicts that certain muscles will be recruited most strongly in movement directions that differ significantly from their direction of action. These results suggest that the observed recruitment behavior may not be an explicit strategy employed by the nervous system, but instead may result from a process of movement optimization.
Collapse
Affiliation(s)
- Andrew H Fagg
- Department of Computer Science, University of Massachusetts, Amherst, Massachusetts 01003, USA.
| | | | | |
Collapse
|
11
|
Abstract
Cosine tuning is ubiquitous in the motor system, yet a satisfying explanation of its origin is lacking. Here we argue that cosine tuning minimizes expected errors in force production, which makes it a natural choice for activating muscles and neurons in the final stages of motor processing. Our results are based on the empirically observed scaling of neuromotor noise, whose standard deviation is a linear function of the mean. Such scaling predicts a reduction of net force errors when redundant actuators pull in the same direction. We confirm this prediction by comparing forces produced with one versus two hands and generalize it across directions. Under the resulting neuromotor noise model, we prove that the optimal activation profile is a (possibly truncated) cosine--for arbitrary dimensionality of the workspace, distribution of force directions, correlated or uncorrelated noise, with or without a separate cocontraction command. The model predicts a negative force bias, truncated cosine tuning at low muscle cocontraction levels, and misalignment of preferred directions and lines of action for nonuniform muscle distributions. All predictions are supported by experimental data.
Collapse
Affiliation(s)
- Emanuel Todorov
- Gatsby Computational Neuroscience Unit, University College London, London, UK.
| |
Collapse
|
12
|
Fiori S. Unsupervised neural learning on lie group. Int J Neural Syst 2002; 12:219-46. [PMID: 12370963 DOI: 10.1142/s012906570200114x] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2002] [Accepted: 06/25/2002] [Indexed: 11/18/2022]
Abstract
The present paper aims at introducing the concepts and mathematical details of unsupervised neural learning with orthonormality constrains. The neural structures considered are single non-linear layers and the learnable parameters are organized in matrices, as usual, which gives the parameters spaces the geometrical structure of the Euclidean manifold. The constraint of orthonormality for the connection-matrices further restricts the parameters spaces to differential manifolds such as the orthogonal group, the compact Stiefel manifold and its extensions. For these reasons, the instruments for characterizing and studying the behavior of learning equations for these particular networks are provided by the differential geometry of Lie groups. In particular, two sub-classes of the general Lie-group learning theories are studied in detail, dealing with first-order (gradient-based) and second-order (non-gradient-based) learning. Although the considered class of learning theories is very general, in the present paper special attention is paid to unsupervised learning paradigms.
Collapse
Affiliation(s)
- Simone Fiori
- Neural Network and Signal Processing Group, Faculty of Engineering, Perugia University Via Pentima Bassa, 21-05100 Terni, Italy.
| |
Collapse
|
13
|
Abstract
New concepts and computational models that integrate behavioral and neurophysiological observations have addressed several of the most fundamental long-standing problems in motor control. These problems include the selection of particular trajectories among the large number of possibilities, the solution of inverse kinematics and dynamics problems, motor adaptation and the learning of sequential behaviors.
Collapse
Affiliation(s)
- Tamar Flash
- Department of Computer Science and Applied Mathematics, The Weizmann Institute of Science, Rehovot, Israel 76100.
| | - Terrence J Sejnowski
- The Salk Institute, Howard Hughes Medical Institute, 10010 North Torrey Pines Road, La Jolla, CA 92037, USA.
| |
Collapse
|
14
|
Zhang K, Sejnowski TJ. Accuracy and learning in neuronal populations. PROGRESS IN BRAIN RESEARCH 2001; 130:333-42. [PMID: 11480286 DOI: 10.1016/s0079-6123(01)30022-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2023]
Affiliation(s)
- K Zhang
- Howard Hughes Medical Institute, Computational Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, CA 92037, USA.
| | | |
Collapse
|
15
|
Dinse HR, Jancke D. Comparative population analysis of cortical representations in parametric spaces of visual field and skin: a unifying role for nonlinear interactions as a basis for active information processing across modalities. PROGRESS IN BRAIN RESEARCH 2001; 130:155-73. [PMID: 11480273 DOI: 10.1016/s0079-6123(01)30011-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2023]
Affiliation(s)
- H R Dinse
- Institute for Neuroinformatics, Theoretical Biology, Ruhr-University Bochum, Bochum, Germany.
| | | |
Collapse
|
16
|
Ajemian R, Bullock D, Grossberg S. Kinematic coordinates in which motor cortical cells encode movement direction. J Neurophysiol 2000; 84:2191-203. [PMID: 11067965 DOI: 10.1152/jn.2000.84.5.2191] [Citation(s) in RCA: 36] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
During goal-directed reaching in primates, a sensorimotor transformation generates a dynamical pattern of muscle activation. Within the context of this sensorimotor transformation, a fundamental question concerns the coordinate systems in which individual cells in the primary motor cortex (MI) encode movement direction. This article develops a mathematical framework that computes, as a function of the coordinate system in which an individual cell is hypothesized to operate, the spatial preferred direction (pd) of that cell as the arm configuration and hand location vary. Three coordinate systems are explicitly modeled: Cartesian spatial, shoulder-centered, and joint angle. The computed patterns of spatial pds are distinct for each of these three coordinate systems, and experimental approaches are described that can capitalize on these differences to compare the empirical adequacy of each coordinate hypothesis. One particular experiment involving curved motion was analyzed from this perspective. Out of the three coordinate systems tested, the assumption of joint angle coordinates best explained the observed cellular response properties. The mathematical framework developed in this paper can also be used to design new experiments that are capable of disambiguating between a given set of specified coordinate hypotheses.
Collapse
Affiliation(s)
- R Ajemian
- Department of Cognitive and Neural Systems and Center for Adaptive Systems, Boston University, Boston, Massachusetts 02215, USA
| | | | | |
Collapse
|