Locomotion Control of Cyborg Insects by Charge-Balanced Biphasic Electrical Stimulation

The integration of electronic stimulation devices with insects in the context of cyborg insect systems has great application potential, particularly in the fields of environmental monitoring, urban surveillance, and rescue missions. Despite considerable advantages compared to the current robot technology, including flexibility, durability, and low energy consumption, this integration faces certain challenges related to the potential risk of charge accumulation caused by prolonged and repetitive electrical stimulations. To address these challenges, this study proposes a universal system for remote signal output control using infrared signals. The proposed system integrates high-precision digital-to-analog converters capable of generating customized waveform electrical stimulation signals within defined ranges. This enhances the accuracy of locomotion control in cyborg insects while maintaining real-time control and dynamic parameter adjustment. The proposed system is verified by experiments. The experimental results show that the signals generated by the proposed system have a success rate of over 76.25% in controlling the turning locomotion of cyborg insects, which is higher than previously reported results. In addition, the charge-balanced characteristics of these signals can minimize muscle tissue damage, thus substantially enhancing control repeatability. This study provides a comprehensive solution for the remote control and monitoring of cyborg insects, whose flexibility and adaptability can meet various application and experimental requirements. The results presented in this study lay a robust foundation for further advancement of various technologies, particularly those related to cyborg insect locomotion control systems and wireless control mechanisms for cyborg insects.

A Review of Energy Supply for Biomachine Hybrid Robots

Biomachine hybrid robots have been proposed for important scenarios, such as wilderness rescue, ecological monitoring, and hazardous area surveying. The energy supply unit used to power the control backpack carried by these robots determines their future development and practical application. Current energy supply devices for control backpacks are mainly chemical batteries. To achieve self-powered devices, researchers have developed solar energy, bioenergy, biothermal energy, and biovibration energy harvesters. This review provides an overview of research in the development of chemical batteries and self-powered devices for biomachine hybrid robots. Various batteries for different biocarriers and the entry points for the design of self-powered devices are outlined in detail. Finally, an overview of the future challenges and possible directions for the development of energy supply devices used to biomachine hybrid robots is provided.

A hierarchical model for external electrical control of an insect, accounting for inter-individual variation of muscle force properties

Cyborg control of insect movement is promising for developing miniature, high-mobility, and efficient biohybrid robots. However, considering the inter-individual variation of the insect neuromuscular apparatus and its neural control is challenging. We propose a hierarchical model including inter-individual variation of muscle properties of three leg muscles involved in propulsion (retractor coxae), joint stiffness (pro- and retractor coxae), and stance-swing transition (protractor coxae and levator trochanteris) in the stick insect Carausius morosus. To estimate mechanical effects induced by external muscle stimulation, the model is based on the systematic evaluation of joint torques as functions of electrical stimulation parameters. A nearly linear relationship between the stimulus burst duration and generated torque was observed. This stimulus-torque characteristic holds for burst durations of up to 500ms, corresponding to the stance and swing phase durations of medium to fast walking stick insects. Hierarchical Bayesian modeling revealed that linearity of the stimulus-torque characteristic was invariant, with individually varying slopes. Individual prediction of joint torques provides significant benefits for precise cyborg control.

Grade-control outdoor turning flight of robo-pigeon with quantitative stimulus parameters

Introduction

The robo-pigeon using homing pigeons as a motion carrier has great potential in search and rescue operations due to its superior weight-bearing capacity and sustained flight capabilities. However, before deploying such robo-pigeons, it is necessary to establish a safe, stable, and long-term effective neuro-electrical stimulation interface and quantify the motion responses to various stimuli.

Methods

In this study, we investigated the effects of stimulation variables such as stimulation frequency (SF), stimulation duration (SD), and inter-stimulus interval (ISI) on the turning flight control of robo-pigeons outdoors, and evaluated the efficiency and accuracy of turning flight behavior accordingly.

Results

The results showed that the turning angle can be significantly controlled by appropriately increasing SF and SD. Increasing ISI can significantly control the turning radius of robotic pigeons. The success rate of turning flight control decreases significantly when the stimulation parameters exceed SF > 100 Hz or SD > 5 s. Thus, the robo-pigeon's turning angle from 15 to 55° and turning radius from 25 to 135 m could be controlled in a graded manner by selecting varying stimulus variables.

Discussion

These findings can be used to optimize the stimulation strategy of robo-pigeons to achieve precise control of their turning flight behavior outdoors. The results also suggest that robo-pigeons have potential for use in search and rescue operations where precise control of flight behavior is required.

MXene-Enabled Self-Adaptive Hydrogel Interface for Active Electroencephalogram Interactions

Human-machine interaction plays a significant role in promoting convenience, production efficiency, and usage experience. Because of the universality and characteristics of electroencephalogram (EEG) signals, active EEG interaction is a promising and cutting-edge method for human-machine interaction. The seamless, skin-compliant, and motion-robust human-machine interface (HMI) for active EEG interaction has been in focus. Herein, we report a self-adaptive HMI (PAAS-MXene hydrogel) that can activate rapid gelation (5 s) using MXene cross-linking and conformably self-adapt to the scalp to help improve signal transduction. In addition to exhibiting satisfactory skin compliance, appropriate adhesion, and good biocompatibility, PAAS-MXene has demonstrated electrical performance reliability, such as low impedance (<50 Ω) at physiologically relevant frequencies, stable polarization potential (the rate of change is less than 6.5 × 10^-4 V/min), negligible ion conductivity, and impedance change after 1000 stretch cycles, thereby realizing acquisition of EEG signals. In addition, a cap-free EEG signal acquisition method based on PAAS-MXene has been proposed. These findings confirm the high-precision detection ability of PAAS-MXene for electrocardiogram signals and EEG signals. Therefore, PAAS-MXene offers an option to actively control intention, motion, and vision through active EEG signals.

A Cyborg Insect Reveals a Function of a Muscle in Free Flight

While engineers put lots of effort, resources, and time in building insect scale micro aerial vehicles (MAVs) that fly like insects, insects themselves are the real masters of flight. What if we would use living insect as platform for MAV instead? Here, we reported a flight control via electrical stimulation of a flight muscle of an insect-computer hybrid robot, which is the interface of a mountable wireless backpack controller and a living beetle. The beetle uses indirect flight muscles to drive wing flapping and three major direct flight muscles (basalar, subalar, and third axilliary (3Ax) muscles) to control the kinematics of the wings for flight maneuver. While turning control was already achieved by stimulating basalar and 3Ax muscles, electrical stimulation of subalar muscles resulted in braking and elevation control in flight. We also demonstrated around 20 degrees of contralateral yaw and roll by stimulating individual subalar muscle. Stimulating both subalar muscles lead to an increase of 20 degrees in pitch and decelerate the flight by 1.5 m/s² as well as an induce in elevation of 2 m/s².

Behavioral control and changes in brain activity of honeybee during flapping

INTRODUCTION

Insect cyborg is a kind of novel robot based on insect-machine interface and principles of neurobiology. The key idea is to stimulate live insects by specific stimuli; thus, the flight trajectory of insects could be controlled as anticipated. However, the neuroregulatory mechanism of insect flight has not been elucidated completely at present.

METHODS

To explore the neuro-mechanism of insect flight behaviors, a series of electrical stimulation was applied on the optic lobes of semi-constrained honeybees. Times of flight initiation, flapping frequency, and duration were recorded by a high-speed camera. In addition, flapping and steering initiation experiments of the cyborg honeybee were verified. Moreover, series of local field potential signals of optic lobes during flapping were collected, pre-processed to remove baseline wander and DC components, then analyzed by power spectrum estimation.

RESULTS

A quantitative optimization method and optimal stimulation parameters of flight initiation were presented. Stimulation results showed that the flapping duration differed greatly while the flapping frequency varied with little difference among different individuals. Moreover, there was always a fluctuation peak around 20-30 Hz in power spectral density (PSD) curves during flapping, distinguishing from calm state, which indicated some brain activity changes during flapping.

CONCLUSIONS

Our study presented a range of relatively optimal electrical parameters to initiate honeybee flight behavior. Meanwhile, the regularity of flapping duration and flapping frequency under electrical stimulations with different parameters were given. The feasibility of controlling a honeybee's flight behavior by brain electrical stimulation was verified through the flapping and steering initiation experiment of honeybees under semi-constrained state. PSD fluctuations reflected changes in brain activity during flapping and that those fluctuation characteristics at the specific frequency band could be sensitive determinants to distinguish whether the honeybee was flying or not, which benefits our understanding of honeybee's flapping behavior and furthers the study of honeybee cyborgs.

Implantable Microfluidic Device: An Epoch of Technology

Implantable microfluidic devices are milestones in developing devices that can either measure parameters like ocular pressure and blood glucose level or deliver various components for therapeutic needs or behavioral modification. Researchers are currently focusing on the miniaturization of almost all its tools for a better healthcare platform. Implantable microfluidic devices are a combination of various systems including, but not limited to, microfluidic platforms, reservoirs, sensors, and actuators, implanted inside the body of a living entity (in vivo) with the purpose of directly or indirectly helping the entity. It is a multidisciplinary approach with immense potential in the area of the biomedical field. Significant resources are utilizing on for the research and development of these devices for various applications. The induction of an implantable microfluidic device into an animal would enable us to measure the responses without any repeated invasive procedures. Such data would help in the development of a better drug delivery profile. Implantable microfluidic devices with reservoirs deliver specific chemical or biological products to treat situations like cancers and diabetes. They can also deliver fluorophores for specific imaging inside the body. Implantable microfluidic devices help provide a microenvironment for various cell differentiation procedure. These devices know no boundaries, and this article reviews these devices based on their design and applications.

Stationary wavelet transform based ECG signal denoising method

Electrocardiogram (ECG) signals are used to diagnose cardiovascular diseases. During ECG signal acquisition, various noises like power line interference, baseline wandering, motion artifacts, and electromyogram noise corrupt the ECG signal. As an ECG signal is non-stationary, removing these noises from the recorded ECG signal is quite tricky. In this paper, along with the proposed denoising technique using stationary wavelet transform, various denoising techniques like lowpass filtering, highpass filtering, empirical mode decomposition, Fourier decomposition method, discrete wavelet transform are studied to denoise an ECG signal corrupted with noise. Signal-to-noise ratio, percentage root-mean-square difference, and root mean square error are used to compare the ECG signal denoising performance. The experimental result showed that the proposed stationary wavelet transform based ECG denoising technique outperformed the other ECG denoising techniques as more ECG signal components are preserved than other denoising algorithms.

Neurotransmitter-Loaded Nanocapsule Triggers On-Demand Muscle Relaxation in Living Organism

This paper reports the on-demand artificial muscle relaxation using a thermosensitive liposome encapsulating γ-aminobutyric acid (GABA) inhibitory neurotransmitter. Muscle relaxation is not feasible in principle, although muscle contraction can be easily induced by electrical stimulation. Herein, thermosensitive liposomes (phase transition temperature = 40 °C) were synthesized to encapsulate GABA and were injected into a leg of a living beetle. The leg was wrapped around by a Ni-Cr wire heater integrated with a thermocouple to enable the feedback control and to manipulate the leg temperature. The injected leg was temporarily immobilized by heating it up to 45 °C. The leg did not swing even by electrically stimulating the leg muscle. Subsequently, the leg recovered to swing. The result indicates that GABA was released from liposomes and fed to the leg muscle, enabling temporal muscle relaxation.

Insect-Computer Hybrid Robot

An insect–computer hybrid robot, often referred to as a biological machine or an insect cyborg, is the fusion of a living insect platform and artificial microdevices, including stimulators, sensors, and computers. When compared with the artificial robots, a hybrid robot can be operated as an autonomous mobile machine with low energy consumption and hardware costs. A hybrid machine can verify various biological hypotheses, such as function determination, by stimulating a muscle or any other structure.

Preliminary statistical assessment towards characterization of biobotic control

Biobotic research involving neurostimulation of instrumented insects to control their locomotion is finding potential as an alternative solution towards development of centimeter-scale distributed swarm robotics. To improve the reliability of biobotic agents, their control mechanism needs to be precisely characterized. To achieve this goal, this paper presents our initial efforts for statistical assessment of the angular response of roach biobots to the applied bioelectrical stimulus. Subsequent findings can help to understand the effect of each stimulation parameter individually or collectively and eventually reach reliable and consistent biobotic control suitable for real life scenarios.

Maze learning by a hybrid brain-computer system

The combination of biological and artificial intelligence is particularly driven by two major strands of research: one involves the control of mechanical, usually prosthetic, devices by conscious biological subjects, whereas the other involves the control of animal behaviour by stimulating nervous systems electrically or optically. However, to our knowledge, no study has demonstrated that spatial learning in a computer-based system can affect the learning and decision making behaviour of the biological component, namely a rat, when these two types of intelligence are wired together to form a new intelligent entity. Here, we show how rule operations conducted by computing components contribute to a novel hybrid brain-computer system, i.e., ratbots, exhibit superior learning abilities in a maze learning task, even when their vision and whisker sensation were blocked. We anticipate that our study will encourage other researchers to investigate combinations of various rule operations and other artificial intelligence algorithms with the learning and memory processes of organic brains to develop more powerful cyborg intelligence systems. Our results potentially have profound implications for a variety of applications in intelligent systems and neural rehabilitation.

Insect-computer hybrid legged robot with user-adjustable speed, step length and walking gait

We have constructed an insect-computer hybrid legged robot using a living beetle (Mecynorrhina torquata; Coleoptera). The protraction/retraction and levation/depression motions in both forelegs of the beetle were elicited by electrically stimulating eight corresponding leg muscles via eight pairs of implanted electrodes. To perform a defined walking gait (e.g., gallop), different muscles were individually stimulated in a predefined sequence using a microcontroller. Different walking gaits were performed by reordering the applied stimulation signals (i.e., applying different sequences). By varying the duration of the stimulation sequences, we successfully controlled the step frequency and hence the beetle's walking speed. To the best of our knowledge, this paper presents the first demonstration of living insect locomotion control with a user-adjustable walking gait, step length and walking speed.

Kinect-based system for automated control of terrestrial insect biobots

Centimeter scale mobile biobots offer unique advantages in uncertain environments. Our previous experimentation has demonstrated neural stimulation techniques in order to control the motion of Madagascar hissing cockroaches. These trials relied on stimulation by a human operator using a remote control. We have developed a Kinect-based system for computer operated automatic control of cockroaches. Using image processing techniques and a radio transmitter, this platform both detects the position of the roach biobot and sends stimulation commands to an implanted microcontroller-based receiver. The work presented here enables repeatable experimentation and allows precise quantification of the line following capabilities of the roach biobot. This system will help refine our model for the stimulation response of the insect and improve our ability to direct them in increasingly dynamic situations.

Oral dosing of chemical indicators for in vivo monitoring of Ca2+ dynamics in insect muscle

This paper proposes a remarkably facile staining protocol to visually investigate dynamic physiological events in insect tissues. We attempted to monitor Ca²⁺ dynamics during contraction of electrically stimulated living muscle. Advances in circuit miniaturization and insect neuromuscular physiology have enabled the hybridization of living insects and man-made electronic components, such as microcomputers, the result of which has been often referred as a Living Machine, Biohybrid, or Cyborg Insect. In order for Cyborg Insects to be of practical use, electrical stimulation parameters need to be optimized to induce desired muscle response (motor action) and minimize the damage in the muscle due to the electrical stimuli. Staining tissues and organs as well as measuring the dynamics of chemicals of interest in muscle should be conducted to quantitatively and systematically evaluate the effect of various stimulation parameters on the muscle response. However, existing staining processes require invasive surgery and/or arduous procedures using genetically encoded sensors. In this study, we developed a non-invasive and remarkably facile method for staining, in which chemical indicators can be orally administered (oral dosing). A chemical Ca²⁺ indicator was orally introduced into an insect of interest via food containing the chemical indicator and the indicator diffused from the insect digestion system to the target muscle tissue. We found that there was a positive relationship between the fluorescence intensity of the indicator and the frequency of electrical stimulation which indicates the orally dosed indicator successfully monitored Ca²⁺ dynamics in the muscle tissue. This oral dosing method has a potential to globally stain tissues including neurons, and investigating various physiological events in insects.

Early metamorphic insertion technology for insect flight behavior monitoring

Early Metamorphosis Insertion Technology (EMIT) is a novel methodology for integrating microfabricated neuromuscular recording and actuation platforms on insects during their metamorphic development. Here, the implants are fused within the structure and function of the neuromuscular system as a result of metamorphic tissue remaking. The implants emerge with the insect where the development of tissue around the electronics during pupal development results in a bioelectrically and biomechanically enhanced tissue interface. This relatively more reliable and stable interface would be beneficial for many researchers exploring the neural basis of the insect locomotion with alleviated traumatic effects caused during adult stage insertions. In this article, we implant our electrodes into the indirect flight muscles of Manduca sexta. Located in the dorsal-thorax, these main flight powering dorsoventral and dorsolongitudinal muscles actuate the wings and supply the mechanical power for up and down strokes. Relative contraction of these two muscle groups has been under investigation to explore how the yaw maneuver is neurophysiologically coordinated. To characterize the flight dynamics, insects are often tethered with wires and their flight is recorded with digital cameras. We also developed a novel way to tether Manduca sexta on a magnetically levitating frame where the insect is connected to a commercially available wireless neural amplifier. This set up can be used to limit the degree of freedom to yawing "only" while transmitting the related electromyography signals from dorsoventral and dorsolongitudinal muscle groups.

Towards fenceless boundaries for solar powered insect biobots

Demonstration of remote navigation with instrumented insects, such as the Madagascar Hissing Cockroach, Gromphadorhina portentosa, has enabled the concept of biobotic agents for search and rescue missions and environmental monitoring applications. The biobots can form the nodes of a mobile sensor network to be established, for example, in unknown and dynamic environments after natural disasters to pinpoint surviving victims. We demonstrate here, for the first time, the concept of an invisible fence for insect biobots with an ultimate goal of keeping insect biobots within a certain distance of each other or a base station to ensure a reliable wireless network. For extended mission durations, this fenceless boundary would also be used to guide insects towards light sources for autonomous solar charging of their on-board batteries.

Posture estimation for a canine machine interface based training system

Dogs and humans have worked in partnership throughout history thanks to dogs' unique capability of detecting signals in human voices or gestures and learning from human inputs. Traditional canine training methods rely solely on subjective visual observations made by trainers. We propose a canine body-area-network (cBAN) to incorporate context-aware sensing with objective detection algorithms to augment the sensitivity and specificity of human trainer's awareness of the dogs they are training. As an initial effort, we developed a Bluetooth-based wireless infrastructure and tested inertial measurement units as cBAN sensor nodes to electronically assess the posture of the dogs. As a result, we were able to optimize the sensor locations and distinguish different postures using the distinct patterns in the measured angles.

Line following terrestrial insect biobots

The present day technology falls short in offering centimeter scale mobile robots that can function effectively under unknown and dynamic environmental conditions. Insects, on the other hand, exhibit an unmatched ability to navigate through a wide variety of environments and overcome perturbations by successfully maintaining control and stability. In this study, we use neural stimulation systems to wirelessly navigate cockroaches to follow lines to enable terrestrial insect biobots. We also propose a system-on-chip based ZigBee enabled wireless neurostimulation backpack system with on-board tissue-electrode bioelectrical coupling verification. Such a capability ensures an electrochemically safe stimulation and avoids irreversible damage to the interface which is often misinterpreted as habituation of the insect to the applied stimulation.

Electromagnetic levitation platform for wireless study of insect flight neurophysiology

An electromagnetic levitation platform for use in a light emitting diode (LED) arena based virtual reality environment was developed for wireless recording of neural and neuromuscular signals from the flight related muscle groups in Manduca sexta. The platform incorporates the use of Early Metamorphosis Insertion Technology to implant recording electrodes into the flight muscles of late stage pupal moths. Analysis of the insects' response to changes in the LED arena rotation direction indicate that this setup could be used to perform a variety of flight behavior studies during yaw maneuvers.

Neuromuscular control of free-flight yaw turns in the hawkmoth Manduca sexta

The biomechanical properties of an animal's locomotor structures profoundly influence the relationship between neuromuscular inputs and body movements. In particular, passive stability properties are of interest as they may offer a non-neural mechanism for simplifying control of locomotion. Here, we hypothesized that a passive stability property of animal flight, flapping counter-torque (FCT), allows hawkmoths to control planar yaw turns in a damping-dominated framework that makes rotational velocity directly proportional to neuromuscular activity. This contrasts with a more familiar inertia-dominated framework where acceleration is proportional to force and neuromuscular activity. To test our hypothesis, we collected flight muscle activation timing, yaw velocity and acceleration data from freely flying hawkmoths engaged in planar yaw turns. Statistical models built from these data then allowed us to infer the degree to which the moths inhabit either damping- or inertia-dominated control domains. Contrary to our hypothesis, a combined model corresponding to inertia-dominated control of yaw but including substantial damping effects best linked the neuromuscular and kinematic data. This result shows the importance of including passive stability properties in neuromechanical models of flight control and reveals possible trade-offs between manoeuvrability and stability derived from damping.

Bioelectrical enhancement in tissue-electrode coupling with metamorphic-stage insertions for insect machine interfaces

Implanting microtechnologies into insects with an aim of domesticating its locomotion poses certain challenges, however, performing surgical implantation during the early stages of metamorphic growth was shown to mitigate some of the related detriments. This study reports the bioelectrical enhancement at the tissue-electrode interface allowed with these metamorphic stage insertions, where the electrodes implanted in the insect during the early pupal stages and right after emergence were compared. An average 1 kHz impedance of 8.9 kΩ was obtained with pupal stage inserted electrodes, ten days after the emergence, as compared to 12.1 kΩ observed when electrodes were implanted in the adult state. Charge storage capacity also increased to 52 mC/cm(2) from 38 mC/cm(2) with the early metamorphic insertions. The performed voltage excursion studies also confirmed the enhancement demonstrating an increase from 3.5 mC/cm(2) to 5.1 mC/cm(2) in the injectable amount of charge in the water window.

Recent developments in the remote radio control of insect flight

The continuing miniaturization of digital circuits and the development of low power radio systems coupled with continuing studies into the neurophysiology and dynamics of insect flight are enabling a new class of implantable interfaces capable of controlling insects in free flight for extended periods. We provide context for these developments, review the state-of-the-art and discuss future directions in this field.