1
|
Guo X, Zhou H, Xiang S, Yu Q, Zhang Y, Han Y, Hao Y. Photonic implementation of the input and reservoir layers for a reservoir computing system based on a single VCSEL with two Mach-Zehnder modulators. OPTICS EXPRESS 2024; 32:17452-17463. [PMID: 38858928 DOI: 10.1364/oe.522336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 04/13/2024] [Indexed: 06/12/2024]
Abstract
Hardware implementation of reservoir computing (RC), which could reduce the power consumption of machine learning and significantly enhance data processing speed, holds the potential to develop the next generation of machine learning hardware devices and chips. Due to the existing solution only implementing reservoir layers, the information processing speed of photonics RC system are limited. In this paper, a photonic implementation of a VMM-RC system based on single Vertical Cavity Surface Emitting Laser (VCSEL) with two Mach Zehnder modulators (MZMs) has been proposed. Unlike previous work, both the input and reservoir layers are realized in the optical domain. Additionally, the impact of various mask signals, such as Two-level mask, Six-level mask, and chaos mask signal, employed in system, has been investigated. The system's performance improves with the use of more complex mask(t). The minimum Normalized mean square error (NMSE) can reach 0.0020 (0.0456) for Santa-Fe chaotic time series prediction in simulation (experiment), while the minimum Word Error Rate (WER) can 0.0677 for handwritten digits recognition numerically. The VMM-RC proposed is instrumental in advancing the development of photonic RC by overcoming the long-standing limitations of photonic RC systems in reservoir implementation. Linear matrix computing units (the input layer) and nonlinear computing units (the reservoir layer) are simultaneously implemented in the optical domain, significantly enhancing the information processing speed of photonic RC systems.
Collapse
|
2
|
Kage H. Implementing associative memories by Echo State Network for the applications of natural language processing. MACHINE LEARNING WITH APPLICATIONS 2023. [DOI: 10.1016/j.mlwa.2023.100449] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023] Open
|
3
|
Giorgi I, Golosio B, Esposito M, Cangelosi A, Masala GL. Modeling Multiple Language Learning in a Developmental Cognitive Architecture. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2020.3033963] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
4
|
Pointeau G, Mirliaz S, Mealier AL, Dominey PF. Learning to Use Narrative Function Words for the Organization and Communication of Experience. Front Psychol 2021; 12:591703. [PMID: 33762991 PMCID: PMC7982915 DOI: 10.3389/fpsyg.2021.591703] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 01/22/2021] [Indexed: 11/16/2022] Open
Abstract
How do people learn to talk about the causal and temporal relations between events, and the motivation behind why people do what they do? The narrative practice hypothesis of Hutto and Gallagher holds that children are exposed to narratives that provide training for understanding and expressing reasons for why people behave as they do. In this context, we have recently developed a model of narrative processing where a structured model of the developing situation (the situation model) is built up from experienced events, and enriched by sentences in a narrative that describe event meanings. The main interest is to develop a proof of concept for how narrative can be used to structure, organize and describe experience. Narrative sentences describe events, and they also define temporal and causal relations between events. These relations are specified by a class of narrative function words, including “because, before, after, first, finally.” The current research develops a proof of concept that by observing how people describe social events, a developmental robotic system can begin to acquire early knowledge of how to explain the reasons for events. We collect data from naïve subjects who use narrative function words to describe simple scenes of human-robot interaction, and then employ algorithms for extracting the statistical structure of how narrative function words link events in the situation model. By using these statistical regularities, the robot can thus learn from human experience about how to properly employ in question-answering dialogues with the human, and in generating canonical narratives for new experiences. The behavior of the system is demonstrated over several behavioral interactions, and associated narrative interaction sessions, while a more formal extended evaluation and user study will be the subject of future research. Clearly this is far removed from the power of the full blown narrative practice capability, but it provides a first step in the development of an experimental infrastructure for the study of socially situated narrative practice in human-robot interaction.
Collapse
Affiliation(s)
- Gregoire Pointeau
- INSERM UMR 1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, Dijon, France.,Robot Cognition Laboratory, Marey Institute, Dijon, France
| | - Solène Mirliaz
- INSERM UMR 1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, Dijon, France.,Robot Cognition Laboratory, Marey Institute, Dijon, France.,École Normale Supérieure de Rennes, Bruz, France
| | - Anne-Laure Mealier
- INSERM UMR 1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, Dijon, France.,Robot Cognition Laboratory, Marey Institute, Dijon, France
| | - Peter Ford Dominey
- INSERM UMR 1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, Dijon, France.,Robot Cognition Laboratory, Marey Institute, Dijon, France
| |
Collapse
|
5
|
Schubert F, Gros C. Local Homeostatic Regulation of the Spectral Radius of Echo-State Networks. Front Comput Neurosci 2021; 15:587721. [PMID: 33732127 PMCID: PMC7958921 DOI: 10.3389/fncom.2021.587721] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Accepted: 01/25/2020] [Indexed: 12/02/2022] Open
Abstract
Recurrent cortical networks provide reservoirs of states that are thought to play a crucial role for sequential information processing in the brain. However, classical reservoir computing requires manual adjustments of global network parameters, particularly of the spectral radius of the recurrent synaptic weight matrix. It is hence not clear if the spectral radius is accessible to biological neural networks. Using random matrix theory, we show that the spectral radius is related to local properties of the neuronal dynamics whenever the overall dynamical state is only weakly correlated. This result allows us to introduce two local homeostatic synaptic scaling mechanisms, termed flow control and variance control, that implicitly drive the spectral radius toward the desired value. For both mechanisms the spectral radius is autonomously adapted while the network receives and processes inputs under working conditions. We demonstrate the effectiveness of the two adaptation mechanisms under different external input protocols. Moreover, we evaluated the network performance after adaptation by training the network to perform a time-delayed XOR operation on binary sequences. As our main result, we found that flow control reliably regulates the spectral radius for different types of input statistics. Precise tuning is however negatively affected when interneural correlations are substantial. Furthermore, we found a consistent task performance over a wide range of input strengths/variances. Variance control did however not yield the desired spectral radii with the same precision, being less consistent across different input strengths. Given the effectiveness and remarkably simple mathematical form of flow control, we conclude that self-consistent local control of the spectral radius via an implicit adaptation scheme is an interesting and biological plausible alternative to conventional methods using set point homeostatic feedback controls of neural firing.
Collapse
Affiliation(s)
- Fabian Schubert
- Institute for Theoretical Physics, Goethe University Frankfurt am Main, Frankfurt am Main, Germany
| | | |
Collapse
|
6
|
Abstract
Gated working memory is defined as the capacity of holding arbitrary information at any time in order to be used at a later time. Based on electrophysiological recordings, several computational models have tackled the problem using dedicated and explicit mechanisms. We propose instead to consider an implicit mechanism based on a random recurrent neural network. We introduce a robust yet simple reservoir model of gated working memory with instantaneous updates. The model is able to store an arbitrary real value at random time over an extended period of time. The dynamics of the model is a line attractor that learns to exploit reentry and a nonlinearity during the training phase using only a few representative values. A deeper study of the model shows that there is actually a large range of hyperparameters for which the results hold (e.g., number of neurons, sparsity, global weight scaling) such that any large enough population, mixing excitatory and inhibitory neurons, can quickly learn to realize such gated working memory. In a nutshell, with a minimal set of hypotheses, we show that we can have a robust model of working memory. This suggests this property could be an implicit property of any random population, that can be acquired through learning. Furthermore, considering working memory to be a physically open but functionally closed system, we give account on some counterintuitive electrophysiological recordings.
Collapse
Affiliation(s)
- Anthony Strock
- Inria Bordeaux Sud-Ouest, 33405 Talence Cedex, France; LaBRI, Université de Bordeaux, Institut Polytechnique de Bordeaux, Centre National de la Recherche Scientifique, 33405 Talence Cedex, France; and Institut des Maladies Neurodégénératives, Université de Bordeaux, Centre National de la Recherche Scientifique, 33076 Cedex, Bordeaux, France
| | - Xavier Hinaut
- Inria Bordeaux Sud-Ouest, 33405 Talence Cedex, France; LaBRI, Université de Bordeaux, Institut Polytechnique de Bordeaux, Centre National de la Recherche Scientifique, 33405 Talence Cedex, France; and Institut des Maladies Neurodégénératives, Université de Bordeaux, Centre National de la Recherche Scientifique, 33076 Cedex, Bordeaux, France
| | - Nicolas P Rougier
- Inria Bordeaux Sud-Ouest, 33405 Talence Cedex, France; LaBRI, Université de Bordeaux, Institut Polytechnique de Bordeaux, Centre National de la Recherche Scientifique, 33405 Talence Cedex, France; and Institut des Maladies Neurodégénératives, Université de Bordeaux, Centre National de la Recherche Scientifique, 33076 Cedex, Bordeaux, France
| |
Collapse
|
7
|
Mealier AL, Pointeau G, Mirliaz S, Ogawa K, Finlayson M, Dominey PF. Narrative Constructions for the Organization of Self Experience: Proof of Concept via Embodied Robotics. Front Psychol 2017; 8:1331. [PMID: 28861011 PMCID: PMC5559541 DOI: 10.3389/fpsyg.2017.01331] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2016] [Accepted: 07/20/2017] [Indexed: 11/13/2022] Open
Abstract
It has been proposed that starting from meaning that the child derives directly from shared experience with others, adult narrative enriches this meaning and its structure, providing causal links between unseen intentional states and actions. This would require a means for representing meaning from experience-a situation model-and a mechanism that allows information to be extracted from sentences and mapped onto the situation model that has been derived from experience, thus enriching that representation. We present a hypothesis and theory concerning how the language processing infrastructure for grammatical constructions can naturally be extended to narrative constructions to provide a mechanism for using language to enrich meaning derived from physical experience. Toward this aim, the grammatical construction models are augmented with additional structures for representing relations between events across sentences. Simulation results demonstrate proof of concept for how the narrative construction model supports multiple successive levels of meaning creation which allows the system to learn about the intentionality of mental states, and argument substitution which allows extensions to metaphorical language and analogical problem solving. Cross-linguistic validity of the system is demonstrated in Japanese. The narrative construction model is then integrated into the cognitive system of a humanoid robot that provides the memory systems and world-interaction required for representing meaning in a situation model. In this context proof of concept is demonstrated for how the system enriches meaning in the situation model that has been directly derived from experience. In terms of links to empirical data, the model predicts strong usage based effects: that is, that the narrative constructions used by children will be highly correlated with those that they experience. It also relies on the notion of narrative or discourse function words. Both of these are validated in the experimental literature.
Collapse
Affiliation(s)
- Anne-Laure Mealier
- Human and Robot Cognitive Systems, Stem Cell and Brain Research Institute U1208, Institut National de la Santé et de la Recherche MédicaleLyon, France
| | - Gregoire Pointeau
- Human and Robot Cognitive Systems, Stem Cell and Brain Research Institute U1208, Institut National de la Santé et de la Recherche MédicaleLyon, France
| | - Solène Mirliaz
- Human and Robot Cognitive Systems, Stem Cell and Brain Research Institute U1208, Institut National de la Santé et de la Recherche MédicaleLyon, France
- Computer Science Department, Ecole Normale Supérieure de RennesRennes, France
| | - Kenji Ogawa
- Graduate School of Letters, Hokkaido UniversitySapporo, Japan
| | - Mark Finlayson
- School of Computing and Information Sciences, Florida International UniversityMiami, FL, United States
| | - Peter F. Dominey
- Human and Robot Cognitive Systems, Stem Cell and Brain Research Institute U1208, Institut National de la Santé et de la Recherche MédicaleLyon, France
| |
Collapse
|
8
|
Pointeau G, Dominey PF. The Role of Autobiographical Memory in the Development of a Robot Self. Front Neurorobot 2017; 11:27. [PMID: 28676751 PMCID: PMC5476692 DOI: 10.3389/fnbot.2017.00027] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2016] [Accepted: 05/22/2017] [Indexed: 11/13/2022] Open
Abstract
This article briefly reviews research in cognitive development concerning the nature of the human self. It then reviews research in developmental robotics that has attempted to retrace parts of the developmental trajectory of the self. This should be of interest to developmental psychologists, and researchers in developmental robotics. As a point of departure, one of the most characteristic aspects of human social interaction is cooperation-the process of entering into a joint enterprise to achieve a common goal. Fundamental to this ability to cooperate is the underlying ability to enter into, and engage in, a self-other relation. This suggests that if we intend for robots to cooperate with humans, then to some extent robots must engage in these self-other relations, and hence they must have some aspect of a self. Decades of research in human cognitive development indicate that the self is not fully present from the outset, but rather that it is developed in a usage-based fashion, that is, through engaging with the world, including the physical world and the social world of animate intentional agents. In an effort to characterize the self, Ulric Neisser noted that self is not unitary, and he thus proposed five types of self-knowledge that correspond to five distinct components of self: ecological, interpersonal, conceptual, temporally extended, and private. He emphasized the ecological nature of each of these levels, how they are developed through the engagement of the developing child with the physical and interpersonal worlds. Crucially, development of the self has been shown to rely on the child's autobiographical memory. From the developmental robotics perspective, this suggests that in principal it would be possible to develop certain aspects of self in a robot cognitive system where the robot is engaged in the physical and social world, equipped with an autobiographical memory system. We review a series of developmental robotics studies that make progress in this enterprise. We conclude with a summary of the properties that are required for the development of these different levels of self, and we identify topics for future research.
Collapse
Affiliation(s)
- Gregoire Pointeau
- Institut National de la Santé et de la Recherche Médicale, Stem Cell and Brain Research Institute U1208, Univ Lyon, Université Claude Bernard Lyon 1Lyon, France.,Robot Cognition Laboratory, Centre National de la Recherche ScientifiqueLyon, France
| | - Peter Ford Dominey
- Institut National de la Santé et de la Recherche Médicale, Stem Cell and Brain Research Institute U1208, Univ Lyon, Université Claude Bernard Lyon 1Lyon, France.,Robot Cognition Laboratory, Centre National de la Recherche ScientifiqueLyon, France
| |
Collapse
|
9
|
Garagnani M, Lucchese G, Tomasello R, Wennekers T, Pulvermüller F. A Spiking Neurocomputational Model of High-Frequency Oscillatory Brain Responses to Words and Pseudowords. Front Comput Neurosci 2017; 10:145. [PMID: 28149276 PMCID: PMC5241316 DOI: 10.3389/fncom.2016.00145] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2016] [Accepted: 12/26/2016] [Indexed: 12/22/2022] Open
Abstract
Experimental evidence indicates that neurophysiological responses to well-known meaningful sensory items and symbols (such as familiar objects, faces, or words) differ from those to matched but novel and senseless materials (unknown objects, scrambled faces, and pseudowords). Spectral responses in the high beta- and gamma-band have been observed to be generally stronger to familiar stimuli than to unfamiliar ones. These differences have been hypothesized to be caused by the activation of distributed neuronal circuits or cell assemblies, which act as long-term memory traces for learned familiar items only. Here, we simulated word learning using a biologically constrained neurocomputational model of the left-hemispheric cortical areas known to be relevant for language and conceptual processing. The 12-area spiking neural-network architecture implemented replicates physiological and connectivity features of primary, secondary, and higher-association cortices in the frontal, temporal, and occipital lobes of the human brain. We simulated elementary aspects of word learning in it, focussing specifically on semantic grounding in action and perception. As a result of spike-driven Hebbian synaptic plasticity mechanisms, distributed, stimulus-specific cell-assembly (CA) circuits spontaneously emerged in the network. After training, presentation of one of the learned "word" forms to the model correlate of primary auditory cortex induced periodic bursts of activity within the corresponding CA, leading to oscillatory phenomena in the entire network and spontaneous across-area neural synchronization. Crucially, Morlet wavelet analysis of the network's responses recorded during presentation of learned meaningful "word" and novel, senseless "pseudoword" patterns revealed stronger induced spectral power in the gamma-band for the former than the latter, closely mirroring differences found in neurophysiological data. Furthermore, coherence analysis of the simulated responses uncovered dissociated category specific patterns of synchronous oscillations in distant cortical areas, including indirectly connected primary sensorimotor areas. Bridging the gap between cellular-level mechanisms, neuronal-population behavior, and cognitive function, the present model constitutes the first spiking, neurobiologically, and anatomically realistic model able to explain high-frequency oscillatory phenomena indexing language processing on the basis of dynamics and competitive interactions of distributed cell-assembly circuits which emerge in the brain as a result of Hebbian learning and sensorimotor experience.
Collapse
Affiliation(s)
- Max Garagnani
- Department of Computing, Goldsmiths, University of LondonLondon, UK
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität BerlinBerlin, Germany
| | - Guglielmo Lucchese
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität BerlinBerlin, Germany
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität BerlinBerlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität zu BerlinBerlin, Germany
| | - Thomas Wennekers
- Centre for Robotics and Neural Systems, University of PlymouthPlymouth, UK
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität BerlinBerlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität zu BerlinBerlin, Germany
| |
Collapse
|
10
|
Enel P, Procyk E, Quilodran R, Dominey PF. Reservoir Computing Properties of Neural Dynamics in Prefrontal Cortex. PLoS Comput Biol 2016; 12:e1004967. [PMID: 27286251 PMCID: PMC4902312 DOI: 10.1371/journal.pcbi.1004967] [Citation(s) in RCA: 70] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2015] [Accepted: 05/08/2016] [Indexed: 11/25/2022] Open
Abstract
Primates display a remarkable ability to adapt to novel situations. Determining what is most pertinent in these situations is not always possible based only on the current sensory inputs, and often also depends on recent inputs and behavioral outputs that contribute to internal states. Thus, one can ask how cortical dynamics generate representations of these complex situations. It has been observed that mixed selectivity in cortical neurons contributes to represent diverse situations defined by a combination of the current stimuli, and that mixed selectivity is readily obtained in randomly connected recurrent networks. In this context, these reservoir networks reproduce the highly recurrent nature of local cortical connectivity. Recombining present and past inputs, random recurrent networks from the reservoir computing framework generate mixed selectivity which provides pre-coded representations of an essentially universal set of contexts. These representations can then be selectively amplified through learning to solve the task at hand. We thus explored their representational power and dynamical properties after training a reservoir to perform a complex cognitive task initially developed for monkeys. The reservoir model inherently displayed a dynamic form of mixed selectivity, key to the representation of the behavioral context over time. The pre-coded representation of context was amplified by training a feedback neuron to explicitly represent this context, thereby reproducing the effect of learning and allowing the model to perform more robustly. This second version of the model demonstrates how a hybrid dynamical regime combining spatio-temporal processing of reservoirs, and input driven attracting dynamics generated by the feedback neuron, can be used to solve a complex cognitive task. We compared reservoir activity to neural activity of dorsal anterior cingulate cortex of monkeys which revealed similar network dynamics. We argue that reservoir computing is a pertinent framework to model local cortical dynamics and their contribution to higher cognitive function. One of the most noteworthy properties of primate behavior is its diversity and adaptability. Human and non-human primates can learn an astonishing variety of novel behaviors that could not have been directly anticipated by evolution. How then can the nervous system be prewired to anticipate the ability to represent such an open class of behaviors? Recent developments in a branch of recurrent neural networks, referred to as reservoir computing, begins to shed light on this question. The novelty of reservoir computing is that the recurrent connections in the network are fixed, and only the connections from these neurons to the output neurons change with learning. The fixed recurrent connections provide the network with an inherent high dimensional dynamics that creates essentially all possible spatial and temporal combinations of the inputs which can then be selected, by learning, to perform the desired task. This high dimensional mixture of activity inherent to reservoirs has begun to be found in the primate cortex. Here we make direct comparisons between dynamic coding in the cortex and in reservoirs performing the same task, and contribute to the emerging evidence that cortex has significant reservoir properties.
Collapse
Affiliation(s)
- Pierre Enel
- Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
- Icahn School of Medicine at Mount Sinai, New York, New York, United States of America
| | - Emmanuel Procyk
- Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
| | - René Quilodran
- Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
- Escuela de Medicina, Departamento de Pre-clínicas, Universidad de Valparaíso, Hontaneda, Valparaíso, Chile
| | - Peter Ford Dominey
- Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
- * E-mail:
| |
Collapse
|
11
|
Taniguchi T, Nagai T, Nakamura T, Iwahashi N, Ogata T, Asoh H. Symbol emergence in robotics: a survey. Adv Robot 2016. [DOI: 10.1080/01691864.2016.1164622] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|