Connecting brains to robots: an artificial body for studying the computational properties of neural tissues

An Overview of In Vitro Biological Neural Networks for Robot Intelligence

In vitro biological neural networks (BNNs) interconnected with robots, so-called BNN-based neurorobotic systems, can interact with the external world, so that they can present some preliminary intelligent behaviors, including learning, memory, robot control, etc. This work aims to provide a comprehensive overview of the intelligent behaviors presented by the BNN-based neurorobotic systems, with a particular focus on those related to robot intelligence. In this work, we first introduce the necessary biological background to understand the 2 characteristics of the BNNs: nonlinear computing capacity and network plasticity. Then, we describe the typical architecture of the BNN-based neurorobotic systems and outline the mainstream techniques to realize such an architecture from 2 aspects: from robots to BNNs and from BNNs to robots. Next, we separate the intelligent behaviors into 2 parts according to whether they rely solely on the computing capacity (computing capacity-dependent) or depend also on the network plasticity (network plasticity-dependent), which are then expounded respectively, with a focus on those related to the realization of robot intelligence. Finally, the development trends and challenges of the BNN-based neurorobotic systems are discussed.

Technological Approach to Mind Everywhere: An Experimentally-Grounded Framework for Understanding Diverse Bodies and Minds

Synthetic biology and bioengineering provide the opportunity to create novel embodied cognitive systems (otherwise known as minds) in a very wide variety of chimeric architectures combining evolved and designed material and software. These advances are disrupting familiar concepts in the philosophy of mind, and require new ways of thinking about and comparing truly diverse intelligences, whose composition and origin are not like any of the available natural model species. In this Perspective, I introduce TAME-Technological Approach to Mind Everywhere-a framework for understanding and manipulating cognition in unconventional substrates. TAME formalizes a non-binary (continuous), empirically-based approach to strongly embodied agency. TAME provides a natural way to think about animal sentience as an instance of collective intelligence of cell groups, arising from dynamics that manifest in similar ways in numerous other substrates. When applied to regenerating/developmental systems, TAME suggests a perspective on morphogenesis as an example of basal cognition. The deep symmetry between problem-solving in anatomical, physiological, transcriptional, and 3D (traditional behavioral) spaces drives specific hypotheses by which cognitive capacities can increase during evolution. An important medium exploited by evolution for joining active subunits into greater agents is developmental bioelectricity, implemented by pre-neural use of ion channels and gap junctions to scale up cell-level feedback loops into anatomical homeostasis. This architecture of multi-scale competency of biological systems has important implications for plasticity of bodies and minds, greatly potentiating evolvability. Considering classical and recent data from the perspectives of computational science, evolutionary biology, and basal cognition, reveals a rich research program with many implications for cognitive science, evolutionary biology, regenerative medicine, and artificial intelligence.

Neuroethics and Animals: Report and Recommendations From the University of Pennsylvania Animal Research Neuroethics Workshop

Growing awareness of the ethical implications of neuroscience in the early years of the 21st century led to the emergence of the new academic field of “neuroethics,” which studies the ethical implications of developments in the neurosciences. However, despite the acceleration and evolution of neuroscience research on nonhuman animals, the unique ethical issues connected with neuroscience research involving nonhuman animals remain underdiscussed. This is a significant oversight given the central place of animal models in neuroscience. To respond to these concerns, the Center for Neuroscience and Society and the Center for the Interaction of Animals and Society at the University of Pennsylvania hosted a workshop on the “Neuroethics of Animal Research” in Philadelphia, Pennsylvania. At the workshop, expert speakers and attendees discussed ethical issues arising from neuroscience research involving nonhuman animals, including the use of animal models in the study of pain and psychiatric conditions, animal brain-machine interfaces, animal–animal chimeras, cerebral organoids, and the relevance of neuroscience to debates about personhood. This paper highlights important emerging ethical issues based on the discussions at the workshop. This paper includes recommendations for research in the United States from the authors based on the discussions at the workshop, loosely following the format of the 2 Gray Matters reports on neuroethics published by the Presidential Commission for the Study of Bioethical Issues.

Understanding the Impact of Neural Variations and Random Connections on Inference

Recent research suggests that in vitro neural networks created from dissociated neurons may be used for computing and performing machine learning tasks. To develop a better artificial intelligent system, a hybrid bio-silicon computer is worth exploring, but its performance is still inferior to that of a silicon-based computer. One reason may be that a living neural network has many intrinsic properties, such as random network connectivity, high network sparsity, and large neural and synaptic variability. These properties may lead to new design considerations, and existing algorithms need to be adjusted for living neural network implementation. This work investigates the impact of neural variations and random connections on inference with learning algorithms. A two-layer hybrid bio-silicon platform is constructed and a five-step design method is proposed for the fast development of living neural network algorithms. Neural variations and dynamics are verified by fitting model parameters with biological experimental results. Random connections are generated under different connection probabilities to vary network sparsity. A multi-layer perceptron algorithm is tested with biological constraints on the MNIST dataset. The results show that a reasonable inference accuracy can be achieved despite the presence of neural variations and random network connections. A new adaptive pre-processing technique is proposed to ensure good learning accuracy with different living neural network sparsity.

Living Things Are Not (20th Century) Machines: Updating Mechanism Metaphors in Light of the Modern Science of Machine Behavior

One of the most useful metaphors for driving scientific and engineering progress has been that of the “machine.” Much controversy exists about the applicability of this concept in the life sciences. Advances in molecular biology have revealed numerous design principles that can be harnessed to understand cells from an engineering perspective, and build novel devices to rationally exploit the laws of chemistry, physics, and computation. At the same time, organicists point to the many unique features of life, especially at larger scales of organization, which have resisted decomposition analysis and artificial implementation. Here, we argue that much of this debate has focused on inessential aspects of machines – classical properties which have been surpassed by advances in modern Machine Behavior and no longer apply. This emerging multidisciplinary field, at the interface of artificial life, machine learning, and synthetic bioengineering, is highlighting the inadequacy of existing definitions. Key terms such as machine, robot, program, software, evolved, designed, etc., need to be revised in light of technological and theoretical advances that have moved past the dated philosophical conceptions that have limited our understanding of both evolved and designed systems. Moving beyond contingent aspects of historical and current machines will enable conceptual tools that embrace inevitable advances in synthetic and hybrid bioengineering and computer science, toward a framework that identifies essential distinctions between fundamental concepts of devices and living agents. Progress in both theory and practical applications requires the establishment of a novel conception of “machines as they could be,” based on the profound lessons of biology at all scales. We sketch a perspective that acknowledges the remarkable, unique aspects of life to help re-define key terms, and identify deep, essential features of concepts for a future in which sharp boundaries between evolved and designed systems will not exist.

Life, death, and self: Fundamental questions of primitive cognition viewed through the lens of body plasticity and synthetic organisms

Central to the study of cognition is being able to specify the Subject that is making decisions and owning memories and preferences. However, all real cognitive agents are made of parts (such as brains made of cells). The integration of many active subunits into a coherent Self appearing at a larger scale of organization is one of the fundamental questions of evolutionary cognitive science. Typical biological model systems, whether basal or advanced, have a static anatomical structure which obscures important aspects of the mind-body relationship. Recent advances in bioengineering now make it possible to assemble, disassemble, and recombine biological structures at the cell, organ, and whole organism levels. Regenerative biology and controlled chimerism reveal that studies of cognition in intact, "standard", evolved animal bodies are just a narrow slice of a much bigger and as-yet largely unexplored reality: the incredible plasticity of dynamic morphogenesis of biological forms that house and support diverse types of cognition. The ability to produce living organisms in novel configurations makes clear that traditional concepts, such as body, organism, genetic lineage, death, and memory are not as well-defined as commonly thought, and need considerable revision to account for the possible spectrum of living entities. Here, I review fascinating examples of experimental biology illustrating that the boundaries demarcating somatic and cognitive Selves are fluid, providing an opportunity to sharpen inquiries about how evolution exploits physical forces for multi-scale cognition. Developmental (pre-neural) bioelectricity contributes a novel perspective on how the dynamic control of growth and form of the body evolved into sophisticated cognitive capabilities. Most importantly, the development of functional biobots - synthetic living machines with behavioral capacity - provides a roadmap for greatly expanding our understanding of the origin and capacities of cognition in all of its possible material implementations, especially those that emerge de novo, with no lengthy evolutionary history of matching behavioral programs to bodyplan. Viewing fundamental questions through the lens of new, constructed living forms will have diverse impacts, not only in basic evolutionary biology and cognitive science, but also in regenerative medicine of the brain and in artificial intelligence.

Plasticity and Adaptation in Neuromorphic Biohybrid Systems

Neuromorphic systems take inspiration from the principles of biological information processing to form hardware platforms that enable the large-scale implementation of neural networks. The recent years have seen both advances in the theoretical aspects of spiking neural networks for their use in classification and control tasks and a progress in electrophysiological methods that is pushing the frontiers of intelligent neural interfacing and signal processing technologies. At the forefront of these new technologies, artificial and biological neural networks are tightly coupled, offering a novel "biohybrid" experimental framework for engineers and neurophysiologists. Indeed, biohybrid systems can constitute a new class of neuroprostheses opening important perspectives in the treatment of neurological disorders. Moreover, the use of biologically plausible learning rules allows forming an overall fault-tolerant system of co-developing subsystems. To identify opportunities and challenges in neuromorphic biohybrid systems, we discuss the field from the perspectives of neurobiology, computational neuroscience, and neuromorphic engineering.

Experimental and Computational Study on Motor Control and Recovery After Stroke: Toward a Constructive Loop Between Experimental and Virtual Embodied Neuroscience

Being able to replicate real experiments with computational simulations is a unique opportunity to refine and validate models with experimental data and redesign the experiments based on simulations. However, since it is technically demanding to model all components of an experiment, traditional approaches to modeling reduce the experimental setups as much as possible. In this study, our goal is to replicate all the relevant features of an experiment on motor control and motor rehabilitation after stroke. To this aim, we propose an approach that allows continuous integration of new experimental data into a computational modeling framework. First, results show that we could reproduce experimental object displacement with high accuracy via the simulated embodiment in the virtual world by feeding a spinal cord model with experimental registration of the cortical activity. Second, by using computational models of multiple granularities, our preliminary results show the possibility of simulating several features of the brain after stroke, from the local alteration in neuronal activity to long-range connectivity remodeling. Finally, strategies are proposed to merge the two pipelines. We further suggest that additional models could be integrated into the framework thanks to the versatility of the proposed approach, thus allowing many researchers to achieve continuously improved experimental design.

Spatial Properties of STDP in a Self-Learning Spiking Neural Network Enable Controlling a Mobile Robot

Development of spiking neural networks (SNNs) controlling mobile robots is one of the modern challenges in computational neuroscience and artificial intelligence. Such networks, being replicas of biological ones, are expected to have a higher computational potential than traditional artificial neural networks (ANNs). The critical problem is in the design of robust learning algorithms aimed at building a “living computer” based on SNNs. Here, we propose a simple SNN equipped with a Hebbian rule in the form of spike-timing-dependent plasticity (STDP). The SNN implements associative learning by exploiting the spatial properties of STDP. We show that a LEGO robot controlled by the SNN can exhibit classical and operant conditioning. Competition of spike-conducting pathways in the SNN plays a fundamental role in establishing associations of neural connections. It replaces the irrelevant associations by new ones in response to a change in stimuli. Thus, the robot gets the ability to relearn when the environment changes. The proposed SNN and the stimulation protocol can be further enhanced and tested in developing neuronal cultures, and also admit the use of memristive devices for hardware implementation.

A Biohybrid Setup for Coupling Biological and Neuromorphic Neural Networks

Developing technologies for coupling neural activity and artificial neural components, is key for advancing neural interfaces and neuroprosthetics. We present a biohybrid experimental setting, where the activity of a biological neural network is coupled to a biomimetic hardware network. The implementation of the hardware network (denoted NeuroSoC) exhibits complex dynamics with a multiplicity of time-scales, emulating 2880 neurons and 12.7 M synapses, designed on a VLSI chip. This network is coupled to a neural network in vitro, where the activities of both the biological and the hardware networks can be recorded, processed, and integrated bidirectionally in real-time. This experimental setup enables an adjustable and well-monitored coupling, while providing access to key functional features of neural networks. We demonstrate the feasibility to functionally couple the two networks and to implement control circuits to modify the biohybrid activity. Overall, we provide an experimental model for neuromorphic-neural interfaces, hopefully to advance the capability to interface with neural activity, and with its irregularities in pathology.

Using insects to drive mobile robots - hybrid robots bridge the gap between biological and artificial systems

The use of mobile robots is an effective method of validating sensory-motor models of animals in a real environment. The well-identified insect sensory-motor systems have been the major targets for modeling. Furthermore, mobile robots implemented with such insect models attract engineers who aim to avail advantages from organisms. However, directly comparing the robots with real insects is still difficult, even if we successfully model the biological systems, because of the physical differences between them. We developed a hybrid robot to bridge the gap. This hybrid robot is an insect-controlled robot, in which a tethered male silkmoth (Bombyx mori) drives the robot in order to localize an odor source. This robot has the following three advantages: 1) from a biomimetic perspective, the robot enables us to evaluate the potential performance of future insect-mimetic robots; 2) from a biological perspective, the robot enables us to manipulate the closed-loop of an onboard insect for further understanding of its sensory-motor system; and 3) the robot enables comparison with insect models as a reference biological system. In this paper, we review the recent works regarding insect-controlled robots and discuss the significance for both engineering and biology.

Coupling Resistive Switching Devices with Neurons: State of the Art and Perspectives

Here we provide the state-of-the-art of bioelectronic interfacing between biological neuronal systems and artificial components, focusing the attention on the potentiality offered by intrinsically neuromorphic synthetic devices based on Resistive Switching (RS). Neuromorphic engineering is outside the scopes of this Perspective. Instead, our focus is on those materials and devices featuring genuine physical effects that could be sought as non-linearity, plasticity, excitation, and extinction which could be directly and more naturally coupled with living biological systems. In view of important applications, such as prosthetics and future life augmentation, a cybernetic parallelism is traced, between biological and artificial systems. We will discuss how such intrinsic features could reduce the complexity of conditioning networks for a more natural direct connection between biological and synthetic worlds. Putting together living systems with RS devices could represent a feasible though innovative perspective for the future of bionics.

Implications of the Dependence of Neuronal Activity on Neural Network States for the Design of Brain-Machine Interfaces

Brain-machine interfaces (BMIs) can improve the quality of life of patients with sensory and motor disabilities by both decoding motor intentions expressed by neural activity, and by encoding artificially sensed information into patterns of neural activity elicited by causal interventions on the neural tissue. Yet, current BMIs can exchange relatively small amounts of information with the brain. This problem has proved difficult to overcome by simply increasing the number of recording or stimulating electrodes, because trial-to-trial variability of neural activity partly arises from intrinsic factors (collectively known as the network state) that include ongoing spontaneous activity and neuromodulation, and so is shared among neurons. Here we review recent progress in characterizing the state dependence of neural responses, and in particular of how neural responses depend on endogenous slow fluctuations of network excitability. We then elaborate on how this knowledge may be used to increase the amount of information that BMIs exchange with brain. Knowledge of network state can be used to fine-tune the stimulation pattern that should reliably elicit a target neural response used to encode information in the brain, and to discount part of the trial-by-trial variability of neural responses, so that they can be decoded more accurately.

Implantable neurotechnologies: bidirectional neural interfaces--applications and VLSI circuit implementations

A bidirectional neural interface is a device that transfers information into and out of the nervous system. This class of devices has potential to improve treatment and therapy in several patient populations. Progress in very large-scale integration has advanced the design of complex integrated circuits. System-on-chip devices are capable of recording neural electrical activity and altering natural activity with electrical stimulation. Often, these devices include wireless powering and telemetry functions. This review presents the state of the art of bidirectional circuits as applied to neuroprosthetic, neurorepair, and neurotherapeutic systems.

Closed-loop neuro-robotic experiments to test computational properties of neuronal networks

Information coding in the Central Nervous System (CNS) remains unexplored. There is mounting evidence that, even at a very low level, the representation of a given stimulus might be dependent on context and history. If this is actually the case, bi-directional interactions between the brain (or if need be a reduced model of it) and sensory-motor system can shed a light on how encoding and decoding of information is performed. Here an experimental system is introduced and described in which the activity of a neuronal element (i.e., a network of neurons extracted from embryonic mammalian hippocampi) is given context and used to control the movement of an artificial agent, while environmental information is fed back to the culture as a sequence of electrical stimuli. This architecture allows a quick selection of diverse encoding, decoding, and learning algorithms to test different hypotheses on the computational properties of neuronal networks.

Toward metabolic robotics: insights from modeling embodied cognition in a biomechatronic symbiont

We present a novel example of a biomechatronic hybrid system. The living component of the system, embedded within microbial fuel cells, relies on the availability of food and water in order to produce electrical energy. The latter is essential to the operations of the mechatronic component, responsible for finding and collecting food and water, and for the execution of work. In simulation, we explore the behavioral and cognitive consequences of this symbiotic relation. In particular we highlight the importance of the integration of sensorimotor and metabolic signals within an evolutionary perspective, in order to create sound cognitive living technology.

Closed-Loop, Multichannel Experimentation Using the Open-Source NeuroRighter Electrophysiology Platform

Single neuron feedback control techniques, such as voltage clamp and dynamic clamp, have enabled numerous advances in our understanding of ion channels, electrochemical signaling, and neural dynamics. Although commercially available multichannel recording and stimulation systems are commonly used for studying neural processing at the network level, they provide little native support for real-time feedback. We developed the open-source NeuroRighter multichannel electrophysiology hardware and software platform for closed-loop multichannel control with a focus on accessibility and low cost. NeuroRighter allows 64 channels of stimulation and recording for around US $10,000, along with the ability to integrate with other software and hardware. Here, we present substantial enhancements to the NeuroRighter platform, including a redesigned desktop application, a new stimulation subsystem allowing arbitrary stimulation patterns, low-latency data servers for accessing data streams, and a new application programming interface (API) for creating closed-loop protocols that can be inserted into NeuroRighter as plugin programs. This greatly simplifies the design of sophisticated real-time experiments without sacrificing the power and speed of a compiled programming language. Here we present a detailed description of NeuroRighter as a stand-alone application, its plugin API, and an extensive set of case studies that highlight the system’s abilities for conducting closed-loop, multichannel interfacing experiments.

Shaping the dynamics of a bidirectional neural interface

Progress in decoding neural signals has enabled the development of interfaces that translate cortical brain activities into commands for operating robotic arms and other devices. The electrical stimulation of sensory areas provides a means to create artificial sensory information about the state of a device. Taken together, neural activity recording and microstimulation techniques allow us to embed a portion of the central nervous system within a closed-loop system, whose behavior emerges from the combined dynamical properties of its neural and artificial components. In this study we asked if it is possible to concurrently regulate this bidirectional brain-machine interaction so as to shape a desired dynamical behavior of the combined system. To this end, we followed a well-known biological pathway. In vertebrates, the communications between brain and limb mechanics are mediated by the spinal cord, which combines brain instructions with sensory information and organizes coordinated patterns of muscle forces driving the limbs along dynamically stable trajectories. We report the creation and testing of the first neural interface that emulates this sensory-motor interaction. The interface organizes a bidirectional communication between sensory and motor areas of the brain of anaesthetized rats and an external dynamical object with programmable properties. The system includes (a) a motor interface decoding signals from a motor cortical area, and (b) a sensory interface encoding the state of the external object into electrical stimuli to a somatosensory area. The interactions between brain activities and the state of the external object generate a family of trajectories converging upon a selected equilibrium point from arbitrary starting locations. Thus, the bidirectional interface establishes the possibility to specify not only a particular movement trajectory but an entire family of motions, which includes the prescribed reactions to unexpected perturbations.

Embodied artificial evolution: Artificial evolutionary systems in the 21st Century

Evolution is one of the major omnipresent powers in the universe that has been studied for about two centuries. Recent scientific and technical developments make it possible to make the transition from passively understanding to actively using evolutionary processes. Today this is possible in Evolutionary Computing, where human experimenters can design and manipulate all components of evolutionary processes in digital spaces. We argue that in the near future it will be possible to implement artificial evolutionary processes outside such imaginary spaces and make them physically embodied. In other words, we envision the "Evolution of Things", rather than just the evolution of digital objects, leading to a new field of Embodied Artificial Evolution (EAE). The main objective of this paper is to present a unifying vision in order to aid the development of this high potential research area. To this end, we introduce the notion of EAE, discuss a few examples and applications, and elaborate on the expected benefits as well as the grand challenges this developing field will have to address.

Closed-loop, open-source electrophysiology

Multiple extracellular microelectrodes (multi-electrode arrays, or MEAs) effectively record rapidly varying neural signals, and can also be used for electrical stimulation. Multi-electrode recording can serve as artificial output (efferents) from a neural system, while complex spatially and temporally targeted stimulation can serve as artificial input (afferents) to the neuronal network. Multi-unit or local field potential (LFP) recordings can not only be used to control real world artifacts, such as prostheses, computers or robots, but can also trigger or alter subsequent stimulation. Real-time feedback stimulation may serve to modulate or normalize aberrant neural activity, to induce plasticity, or to serve as artificial sensory input. Despite promising closed-loop applications, commercial electrophysiology systems do not yet take advantage of the bidirectional capabilities of multi-electrodes, especially for use in freely moving animals. We addressed this lack of tools for closing the loop with NeuroRighter, an open-source system including recording hardware, stimulation hardware, and control software with a graphical user interface. The integrated system is capable of multi-electrode recording and simultaneous patterned microstimulation (triggered by recordings) with minimal stimulation artifact. The potential applications of closed-loop systems as research tools and clinical treatments are broad; we provide one example where epileptic activity recorded by a multi-electrode probe is used to trigger targeted stimulation, via that probe, to freely moving rodents.

Connecting neurons to a mobile robot: an in vitro bidirectional neural interface

One of the key properties of intelligent behaviors is the capability to learn and adapt to changing environmental conditions. These features are the result of the continuous and intense interaction of the brain with the external world, mediated by the body. For this reason “embodiment” represents an innovative and very suitable experimental paradigm when studying the neural processes underlying learning new behaviors and adapting to unpredicted situations. To this purpose, we developed a novel bidirectional neural interface. We interconnected in vitro neurons, extracted from rat embryos and plated on a microelectrode array (MEA), to external devices, thus allowing real-time closed-loop interaction. The novelty of this experimental approach entails the necessity to explore different computational schemes and experimental hypotheses. In this paper, we present an open, scalable architecture, which allows fast prototyping of different modules and where coding and decoding schemes and different experimental configurations can be tested. This hybrid system can be used for studying the computational properties and information coding in biological neuronal networks with far-reaching implications for the future development of advanced neuroprostheses.

Virtual Partner Interaction (VPI): exploring novel behaviors via coordination dynamics

Inspired by the dynamic clamp of cellular neuroscience, this paper introduces VPI -- Virtual Partner Interaction -- a coupled dynamical system for studying real time interaction between a human and a machine. In this proof of concept study, human subjects coordinate hand movements with a virtual partner, an avatar of a hand whose movements are driven by a computerized version of the Haken-Kelso-Bunz (HKB) equations that have been shown to govern basic forms of human coordination. As a surrogate system for human social coordination, VPI allows one to examine regions of the parameter space not typically explored during live interactions. A number of novel behaviors never previously observed are uncovered and accounted for. Having its basis in an empirically derived theory of human coordination, VPI offers a principled approach to human-machine interaction and opens up new ways to understand how humans interact with human-like machines including identification of underlying neural mechanisms.

Interfacing insect brain for space applications

Insects exhibit remarkable navigation capabilities that current control architectures are still far from successfully mimic and reproduce. In this chapter, we present the results of a study on conceptualizing insect/machine hybrid controllers for improving autonomy of exploratory vehicles. First, the different principally possible levels of interfacing between insect and machine are examined followed by a review of current approaches towards hybridity and enabling technologies. Based on the insights of this activity, we propose a double hybrid control architecture which hinges around the concept of "insect-in-a-cockpit." It integrates both biological/artificial (insect/robot) modules and deliberative/reactive behavior. The basic assumption is that "low-level" tasks are managed by the robot, while the "insect intelligence" is exploited whenever high-level problem solving and decision making is required. Both neural and natural interfacing have been considered to achieve robustness and redundancy of exchanged information.

Techniques and devices to restore cognition

Executive planning, the ability to direct and sustain attention, language and several types of memory may be compromised by conditions such as stroke, traumatic brain injury, cancer, autism, cerebral palsy and Alzheimer's disease. No medical devices are currently available to help restore these cognitive functions. Recent findings about the neurophysiology of these conditions in humans coupled with progress in engineering devices to treat refractory neurological conditions imply that the time has arrived to consider the design and evaluation of a new class of devices. Like their neuromotor counterparts, neurocognitive prostheses might sense or modulate neural function in a non-invasive manner or by means of implanted electrodes. In order to paint a vision for future device development, it is essential to first review what can be achieved using behavioral and external modulatory techniques. While non-invasive approaches might strengthen a patient's remaining intact cognitive abilities, neurocognitive prosthetics comprised of direct brain-computer interfaces could in theory physically reconstitute and augment the substrate of cognition itself.

Shaping embodied neural networks for adaptive goal-directed behavior

The acts of learning and memory are thought to emerge from the modifications of synaptic connections between neurons, as guided by sensory feedback during behavior. However, much is unknown about how such synaptic processes can sculpt and are sculpted by neuronal population dynamics and an interaction with the environment. Here, we embodied a simulated network, inspired by dissociated cortical neuronal cultures, with an artificial animal (an animat) through a sensory-motor loop consisting of structured stimuli, detailed activity metrics incorporating spatial information, and an adaptive training algorithm that takes advantage of spike timing dependent plasticity. By using our design, we demonstrated that the network was capable of learning associations between multiple sensory inputs and motor outputs, and the animat was able to adapt to a new sensory mapping to restore its goal behavior: move toward and stay within a user-defined area. We further showed that successful learning required proper selections of stimuli to encode sensory inputs and a variety of training stimuli with adaptive selection contingent on the animat's behavior. We also found that an individual network had the flexibility to achieve different multi-task goals, and the same goal behavior could be exhibited with different sets of network synaptic strengths. While lacking the characteristic layered structure of in vivo cortical tissue, the biologically inspired simulated networks could tune their activity in behaviorally relevant manners, demonstrating that leaky integrate-and-fire neural networks have an innate ability to process information. This closed-loop hybrid system is a useful tool to study the network properties intermediating synaptic plasticity and behavioral adaptation. The training algorithm provides a stepping stone towards designing future control systems, whether with artificial neural networks or biological animats themselves.

The ability of a brain to learn has been studied at various levels. However, a large gap exists between behavioral studies of learning and memory and studies of cellular plasticity. In particular, much remains unknown about how cellular plasticity scales to affect network population dynamics. In previous studies, we have addressed this by growing mammalian brain cells in culture and creating a long-term, two-way interface between a cultured network and a robot or an artificial animal. Behavior and learning could now be observed in concert with the detailed and long-term electrophysiology. In this work, we used modeling/simulation of living cortical cultures to investigate the network's capability to learn goal-directed behavior. A biologically inspired simulated network was used to determine an effective closed-loop training algorithm, and the system successfully exhibited multi-task goal-directed adaptive behavior. The results suggest that even though lacking the characteristic layered structure of a brain, the network still could be functionally shaped and showed meaningful behavior. Knowledge gained from working with such closed-loop systems could influence the design of future artificial neural networks, more effective neuroprosthetics, and even the use of living networks themselves as a biologically based control system.

Excitability of skeletal muscle during development, denervation, and tissue culture

A quantitative understanding of the bulk excitability of skeletal muscle tissues is important for the design of muscle tissue bioreactor systems, implantable muscle stimulators, and other systems where electrical pulses are employed to elicit contractions in muscle tissue both in vitro and in vivo. The purpose of the present study is to systematically compare the excitability of mammalian (rat) skeletal muscle under a range of conditions (including neonatal development, denervation, and chronic in vivo stimulation of denervated muscle) and of self-organized muscle tissue constructs engineered in vitro from both primary cells and cell lines. Excitability is represented by rheobase (R(50), units = V/mm) and chronaxie (C(50), units = microseconds) values, with lower values for each indicating greater excitability. Adult skeletal muscle is the most excitable (R(50) ~ 0.29, C(50) ~ 100); chronically denervated whole muscles (R(50) ~ 2.54, C(50) ~ 690) and muscle engineered in vitro from cell lines (C2C12 + 10T1/2) (R(50) ~ 1.93, C(50) ~ 416) have exceptionally low excitability; muscle engineered in vitro from primary myocytes (R(50) ~ 0.99, C(50) ~ 496) has excitability similar to that of day 14 neonatal rat muscle (R(50) ~ 0.65, C(50) ~ 435); stimulated-denervated muscles retain excellent excitability when chronically electrically stimulated (R(50) ~ 0.40, C(50) ~ 100); and neonatal rat muscle excitability improves during the first 6 weeks of development, steadily approaching that of adult muscle.

MEART: The Semi-Living Artist

Here, we and others describe an unusual neurorobotic project, a merging of art and science called MEART, the semi-living artist. We built a pneumatically actuated robotic arm to create drawings, as controlled by a living network of neurons from rat cortex grown on a multi-electrode array (MEA). Such embodied cultured networks formed a real-time closed-loop system which could now behave and receive electrical stimulation as feedback on its behavior. We used MEART and simulated embodiments, or animats, to study the network mechanisms that produce adaptive, goal-directed behavior. This approach to neural interfacing will help instruct the design of other hybrid neural-robotic systems we call hybrots. The interfacing technologies and algorithms developed have potential applications in responsive deep brain stimulation systems and for motor prosthetics using sensory components. In a broader context, MEART educates the public about neuroscience, neural interfaces, and robotics. It has paved the way for critical discussions on the future of bio-art and of biotechnology.

Therapeutic potential of computer to cerebral cortex implantable devices

In this article, an overview of some of the latest developments in the field of cerebral cortex to computer interfacing (CCCI) is given. This is posed in the more general context of Brain-Computer Interfaces in order to assess advantages and disadvantages. The emphasis is clearly placed on practical studies that have been undertaken and reported on, as opposed to those speculated, simulated or proposed as future projects. Related areas are discussed briefly only in the context of their contribution to the studies being undertaken. The area of focus is notably the use of invasive implant technology, where a connection is made directly with the cerebral cortex and/or nervous system. Tests and experimentation which do not involve human subjects are invariably carried out a priori to indicate the eventual possibilities before human subjects are themselves involved. Some of the more pertinent animal studies from this area are discussed. The paper goes on to describe human experimentation, in which neural implants have linked the human nervous system bidirectionally with technology and the internet. A view is taken as to the prospects for the future for CCCI, in terms of its broad therapeutic role.

A survey of signal processing algorithms in brain-computer interfaces based on electrical brain signals

Brain-computer interfaces (BCIs) aim at providing a non-muscular channel for sending commands to the external world using the electroencephalographic activity or other electrophysiological measures of the brain function. An essential factor in the successful operation of BCI systems is the methods used to process the brain signals. In the BCI literature, however, there is no comprehensive review of the signal processing techniques used. This work presents the first such comprehensive survey of all BCI designs using electrical signal recordings published prior to January 2006. Detailed results from this survey are presented and discussed. The following key research questions are addressed: (1) what are the key signal processing components of a BCI, (2) what signal processing algorithms have been used in BCIs and (3) which signal processing techniques have received more attention?

Learning in human neural networks on microelectrode arrays

This paper describes experiments involving the growth of human neural networks of stem cells on a MEA (microelectrode array) support. The microelectrode arrays (MEAs) are constituted by a glass support in which a set of tungsten electrodes are inserted. The artificial neural network (ANN) paradigm was used by stimulating the neurons in parallel with digital patterns distributed on eight channels, then by analyzing a parallel multichannel output. In particular, the microelectrodes were connected following two different architectures, one inspired by the Kohonen's SOM, the other by the Hopfield network. The output signals have been analyzed in order to evaluate the possibility of organized reactions by the natural neurons.f The results show that the network of human neurons reacts selectively to the subministered digital signals, i.e., it produces similar output signals referred to identical or similar patterns, and clearly differentiates the outputs coming from different stimulations. Analyses performed with a special artificial neural network called ITSOM show the possibility to codify the neural responses to different patterns, thus to interpret the signals coming from the network of biological neurons, assigning a code to each output. It is straightforward to verify that identical codes are generated by the neural reactions to similar patterns. Further experiments are to be designed that improve the hybrid neural networks' capabilities and to test the possibility of utilizing the organized answers of the neurons in several ways.

Encoding of time-varying stimuli in populations of cultured neurons

We wondered whether random populations of dissociated cultured cortical neurons, despite of their lack of structure and/or regional specialization, are capable of modulating their neural activity as the effect of a time-varying stimulation - a simulated 'sensory' afference. More specifically, we used localized low-frequency, non-periodic trains of stimuli to simulate sensory afferences, and asked how much information about the original trains of stimuli could be extracted from the neural activity recorded at the different sites. Furthermore, motivated by the results of studies performed both in vivo and in vitro on different preparations, which suggested that isolated spikes and bursts may play different roles in coding time-varying signals, we explored the amount of such 'sensory' information that could be associated to these different firing modes. Finally, we asked whether and how such 'sensory' information is transferred from the sites of stimulation (i.e., the 'sensory' areas), to the other regions of the neural populations. To do this we applied stimulus reconstruction techniques and information theoretic concepts that are typically used to investigate neural coding in sensory systems.Our main results are that (1) slow variations of the rate of stimulation are coded into isolated spikes and in the time of occurrence of bursts (but not in the bursts' temporal structure); (2) increasing the rate of stimulation has the effect of increasing the proportion of isolated spikes in the average evoked response and their importance in coding for the stimuli; and, (3) the ability to recover the time course of the pattern of stimulation is strongly related to the degree of functional connectivity between stimulation and recording sites. These observations parallel similar findings in intact nervous systems regarding the complementary roles of bursts and tonic spikes in encoding sensory information.Our results also have interesting implications in the field of neuro-robotic interfaces. In fact, the ability of populations of neurons to code information is a prerequisite for obtaining hybrid systems, in which neuronal populations are used to control external devices.

Dynamical dimension of a hybrid neurorobotic system

The goal of this work is to understand how neural tissue can be programed to execute predetermined functions. We developed a research tool that includes the brainstem of a lamprey and a two-wheeled robot interconnected in a closed loop. We report here the development of a framework for studying the dynamics of the neural tissue based on the interaction of this tissue with the robot.