1
|
Chen Z, Liang Q, Wei Z, Chen X, Shi Q, Yu Z, Sun T. An Overview of In Vitro Biological Neural Networks for Robot Intelligence. CYBORG AND BIONIC SYSTEMS 2023; 4:0001. [PMID: 37040493 PMCID: PMC10076061 DOI: 10.34133/cbsystems.0001] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Accepted: 10/17/2022] [Indexed: 01/12/2023] Open
Abstract
In vitro biological neural networks (BNNs) interconnected with robots, so-called BNN-based neurorobotic systems, can interact with the external world, so that they can present some preliminary intelligent behaviors, including learning, memory, robot control, etc. This work aims to provide a comprehensive overview of the intelligent behaviors presented by the BNN-based neurorobotic systems, with a particular focus on those related to robot intelligence. In this work, we first introduce the necessary biological background to understand the 2 characteristics of the BNNs: nonlinear computing capacity and network plasticity. Then, we describe the typical architecture of the BNN-based neurorobotic systems and outline the mainstream techniques to realize such an architecture from 2 aspects: from robots to BNNs and from BNNs to robots. Next, we separate the intelligent behaviors into 2 parts according to whether they rely solely on the computing capacity (computing capacity-dependent) or depend also on the network plasticity (network plasticity-dependent), which are then expounded respectively, with a focus on those related to the realization of robot intelligence. Finally, the development trends and challenges of the BNN-based neurorobotic systems are discussed.
Collapse
Affiliation(s)
- Zhe Chen
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China
- Key Laboratory of Biomimetic Robots and Systems (Beijing Institute of Technology), Ministry of Education, Beijing 10081, China
- Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China
| | - Qian Liang
- Key Laboratory of Biomimetic Robots and Systems (Beijing Institute of Technology), Ministry of Education, Beijing 10081, China
- Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Zihou Wei
- Key Laboratory of Biomimetic Robots and Systems (Beijing Institute of Technology), Ministry of Education, Beijing 10081, China
- Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Xie Chen
- Key Laboratory of Biomimetic Robots and Systems (Beijing Institute of Technology), Ministry of Education, Beijing 10081, China
- Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Qing Shi
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China
- Key Laboratory of Biomimetic Robots and Systems (Beijing Institute of Technology), Ministry of Education, Beijing 10081, China
- Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Zhiqiang Yu
- Key Laboratory of Biomimetic Robots and Systems (Beijing Institute of Technology), Ministry of Education, Beijing 10081, China
- Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Tao Sun
- Key Laboratory of Biomimetic Robots and Systems (Beijing Institute of Technology), Ministry of Education, Beijing 10081, China
- Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
| |
Collapse
|
2
|
Bayat FK, Alp Mİ, Bostan S, Gülçür HÖ, Öztürk G, Güveniş A. An improved platform for cultured neuronal network electrophysiology: multichannel optogenetics integrated with MEAs. EUROPEAN BIOPHYSICS JOURNAL : EBJ 2022; 51:503-514. [PMID: 35930029 DOI: 10.1007/s00249-022-01613-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 05/11/2022] [Accepted: 07/24/2022] [Indexed: 06/15/2023]
Abstract
Cultured neuronal networks (CNNs) are powerful tools for studying how neuronal representation and adaptation emerge in networks of controlled populations of neurons. To ensure the interaction of a CNN and an artificial setting, reliable operation in both open and closed loops should be provided. In this study, we integrated optogenetic stimulation with microelectrode array (MEA) recordings using a digital micromirror device and developed an improved research tool with a 64-channel interface for neuronal network control and data acquisition. We determined the ideal stimulation parameters including light intensity, frequency, and duty cycle for our configuration. This resulted in robust and reproducible neuronal responses. We also demonstrated both open and closed loop configurations in the new platform involving multiple bidirectional channels. Unlike previous approaches that combined optogenetic stimulation and MEA recordings, we did not use binary grid patterns, but assigned an adjustable-size, non-binary optical spot to each electrode. This approach allowed simultaneous use of multiple input-output channels and facilitated adaptation of the stimulation parameters. Hence, we advanced a 64-channel interface in that each channel can be controlled individually in both directions simultaneously without any interference or interrupts. The presented setup meets the requirements of research in neuronal plasticity, network encoding and representation, closed-loop control of firing rate and synchronization. Researchers who develop closed-loop control techniques and adaptive stimulation strategies for network activity will benefit much from this novel setup.
Collapse
Affiliation(s)
- F Kemal Bayat
- Institute of Biomedical Engineering, Bogazici University, Istanbul, Turkey.
| | - M İkbal Alp
- Regenerative and Restorative Medicine Research Center (REMER), Research Institute for Health Sciences and Technologies (SABITA), Istanbul Medipol University, Istanbul, Turkey
| | - Sevginur Bostan
- Regenerative and Restorative Medicine Research Center (REMER), Research Institute for Health Sciences and Technologies (SABITA), Istanbul Medipol University, Istanbul, Turkey
| | - H Özcan Gülçür
- Institute of Biomedical Engineering, Bogazici University, Istanbul, Turkey
| | - Gürkan Öztürk
- Regenerative and Restorative Medicine Research Center (REMER), Research Institute for Health Sciences and Technologies (SABITA), Istanbul Medipol University, Istanbul, Turkey
| | - Albert Güveniş
- Institute of Biomedical Engineering, Bogazici University, Istanbul, Turkey
| |
Collapse
|
3
|
Zhu Y, Zhang L, Manoonpong P. Generic Mechanism for Waveform Regulation and Synchronization of Oscillators: An Application for Robot Behavior Diversity Generation. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:4495-4507. [PMID: 33170791 DOI: 10.1109/tcyb.2020.3029062] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
While nonlinear oscillators have been widely used for central pattern generators to produce basic rhythmic signals for robot locomotion control, methods to shape and regulate the signal waveform without changing the characteristics of the oscillators have not been fully investigated, especially during the network synchronization process. To illustrate the principle and process of waveform regulation of nonlinear oscillators in detail and ensure that the influence can be controlled, we present a method for waveform regulation and synchronization and analyze the relationship of different factors (e.g., initial conditions, network parameters, phase, and waveform regulation factors) in synchronization deviation. Then, the method is indicated to be effective in other commonly used nonlinear oscillators and neural oscillators. As an example application, a three-layer behavioral control architecture for a legged robot is constructed based on the proposed method. Modules for the body behavior, leg coordination, and single-leg adjustment are established to realize diverse robot behaviors. The effectiveness of the method is validated by a series of experiments. The results prove that the method performs well in terms of signal control accuracy, behavior pattern diversity, and smooth motion transition.
Collapse
|