Shape-position perceptive fusion electronic skin with autonomous learning for gesture interaction

Wearable devices, such as data gloves and electronic skins, can perceive human instructions, behaviors and even emotions by tracking a hand's motion, with the help of knowledge learning. The shape or position single-mode sensor in such devices often lacks comprehensive information to perceive interactive gestures. Meanwhile, the limited computing power of wearable applications restricts the multimode fusion of different sensing data and the deployment of deep learning networks. We propose a perceptive fusion electronic skin (PFES) with a bioinspired hierarchical structure that utilizes the magnetization state of a magnetostrictive alloy film to be sensitive to external strain or magnetic field. Installed at the joints of a hand, the PFES realizes perception of curvature (joint shape) and magnetism (joint position) information by mapping corresponding signals to the two-directional continuous distribution such that the two edges represent the contributions of curvature radius and magnetic field, respectively. By autonomously selecting knowledge closer to the user's hand movement characteristics, the reinforced knowledge distillation method is developed to learn and compress a teacher model for rapid deployment on wearable devices. The PFES integrating the autonomous learning algorithm can fuse curvature-magnetism dual information, ultimately achieving human machine interaction with gesture recognition and haptic feedback for cross-space perception and manipulation.

Flexible Multimodal Magnetoresistive Sensors Based on Alginate/Poly(vinyl alcohol) Foam with Stimulus Discriminability for Soft Electronics Using Machine Learning

Flexible foam-based sensors have attracted substantial interest due to their high specific surface area, light weight, superior deformability, and ease of manufacture. However, it is still a challenge to integrate multimodal stimuli-responsiveness, high sensitivity, reliable stability, and good biocompatibility into a single foam sensor. To achieve this, a magnetoresistive foam sensor was fabricated by an in situ freezing-polymerization strategy based on the interpenetrating networks of sodium alginate, poly(vinyl alcohol) in conjunction with glycerol, and physical reinforcement of core-shell bidisperse magnetic particles. The assembled sensor exhibited preferable magnetic/strain-sensing capability (GF ≈ 0.41 T-1 for magnetic field, 4.305 for tension, -0.735 for bending, and -1.345 for pressing), quick response time, and reliable durability up to 6000 cycles under external stimuli. Importantly, a machine learning algorithm was developed to identify the encryption information, enabling high recognition accuracies of 99.22% and 99.34%. Moreover, they could be employed as health systems to detect human physiological motion and integrated as smart sensor arrays to perceive external pressure/magnetic field distributions. This work provides a simple and ecofriendly strategy to fabricate biocompatible foam-based multimodal sensors with potential applications in next-generation soft electronics.

Multifunctional cross-sensitive magnetic alginate-chitosan-polyethylene oxide nanofiber sensor for human-machine interaction

Flexible nanofiber membranes are compelling materials for the development of functional multi-mode sensors; however, their essential features such as high cross-sensitivity, reliable stability and signal discrimination capability have rarely been realized simultaneously in one sensor. Here, a novel multi-mode sensor with a nanofiber membrane structure based on multiple interpenetrating networks of bidisperse magnetic particles, sodium alginate (SA), chitosan (CHI) in conjunction with polyethylene oxide hydrogels was prepared in a controllable electrospinning technology. Specifically, the morphology distributions of nanofibers could be regulated by the crosslinking degree of the interpenetrating networks and the spinning process parameters. The incorporation of SA and CHI endowed the sensor with desirable flexibility, ideal biocompatibility and skin-friendly property. Besides, the assembled sensors not only displayed preferable magnetic sensitivity of 0.34 T-1 and reliable stability, but also exhibited favorable cross-sensitivity, quick response time, and long-term durability for over 5000 cycles under various mechanical stimuli. Importantly, the multi-mode stimuli could be discriminated via producing opposite electrical signals. Furthermore, based on the signal distinguishability of the sensor, a wearable Morse code translation system assisted by the machine learning algorithm was demonstrated, enabling a high recognizing accuracy (>99.1 %) for input letters and numbers information. Due to the excellent multifunctional sensing characteristics, we believe that the sensor will have a high potential in wearable soft electronics and human-machine interactions.

Bio-Inspired Magnetically Responsive Silicone Cilia: Fabrication Strategy and Interaction with Biological Mucus

Cilia are biological structures essential to drive the mobility of secretions and maintain the proper function of the respiratory airways. However, this motile self-cleaning process is significantly compromised in the presence of silicone tracheal prosthesis, leading to biofilm growth and impeding effective treatment. To address this challenge and enhance the performance of these devices, we propose the fabrication of magnetic silicone cilia, with the prospect of their integration onto silicone prostheses. The present study presents a fabrication method based on magnetic self-assembly and assesses the interaction behavior of the cilia array with biological mucus. This protocol allows for the customization of cilia dimensions across a wide range of aspect ratios (from 6 to 85) and array densities (from 10 to 80 cilia/mm2) by adjusting the fabrication parameters, offering flexibility for adjustments according to their required characteristics. Furthermore, we evaluated the suitability of different cilia arrays for biomedical applications by analyzing their interaction with bullfrog mucus, simulating the airways environment. Our findings demonstrate that the fabricated cilia are mechanically resistant to the viscous fluid and still exhibit controlled movement under the influence of an external moving magnet. A correlation between cilia dimensions and mucus wettability profile suggests a potential role in facilitating mucus depuration, paving the way for further advancements aimed at enhancing the performance of silicone prostheses in clinical settings.

Recent progress on the development of bioinspired surfaces with high aspect ratio microarray structures: From fabrication to applications

Surfaces with high aspect ratio microarray structures can implement sophisticated assignment in typical fields including microfluidics, sensor, biomedicine, et al. via regulating their deformation or the material properties. Inspired by natural materials and systems, for example sea cockroaches, water spiders, cacti, lotus leaves, rice leaves, and cedar leaves, many researchers have focused on microneedle functional surface studies. When the surface with high aspect ratio microarray structures is stimulated by the external fields, such as optical, electric, thermal, magnetic, the high aspect ratio microarray structures can undergo hydrophilic and hydrophobic switching or shape change, which may be gifted the surfaces with the ability to perform complex task, including directional liquid/air transport, targeted drug delivery, microfluidic chip sensing. In this review, the fabrication principles of various surfaces with high aspect ratio microarray structures are classified and summarized. Mechanisms of liquid manipulation on hydrophilic/hydrophobic surfaces with high aspect ratio microarray structures are clarified based on Wenzel model, Cassie model, Laplace pressure theories and so on. Then the intelligent control strategies have been demonstrated. The applications in microfluidic, drug delivery, patch sensors have been discussed. Finally, current challenges and new insights of future prospects for dynamic manipulation of liquid/air based on biomimetic surface with high aspect ratio microarray structures are also addressed.

Functional magnetic alginate/gelatin sponge-based flexible sensor with multi-mode response and discrimination detection properties for human motion monitoring

The functional flexible sensors that can simultaneously detect multiple external excitations have exhibited great potential in the human-machine interaction and wearable electronics. However, it is still a primary challenge to develop a multi-mode sensor that can achieve sensitivity equilibrium towards different stimuli, and effectively recognize external stimulus while in a facile and cost-effective material and methodology. This study presented a functional flexible sensor based on natural polymer sodium alginate and gelatin sponge electrode which could detect both external mechanical and magnetic stimuli with superiorities of outstanding sensing capability and stability. With the optimal multilayered structure, it possessed high magnetic responsive sensitivity of 0.45 T-1, excellent stability and recoverability. Its electrical property variations also displayed high sensitivity and durability under cyclic stretching, bending and compressing stimuli for 1000 cycles. More importantly, the sensor could not only respond to magnetic field and compression stimuli with contrary electrical responses, but also recognize the respective input signals to decouple different stimuli in real time. Furthermore, it was developed as electronic skins and smart sensor arrays for human physiological signals and mechanical-magnetic detection. Based on excellent multifunctional response characteristics, the sensor showed significant potential in next-generation intelligent multifunctional electronic system and artificial intelligence.

Magnetically Induced Grid Structure for Enhancing the Performance of a Dual-Mode Flexible Sensor with Tactile/Touchless Perception

As an advanced sensing technology, dual-mode flexible sensing, integrating both tactile and touchless perception, propels numerous intelligent devices toward a more practical and efficient direction. The ability to incorporate multiple sensing modes and accurately distinguish them in real time has become crucial for technological advancements. Here, we proposed a dual-mode sensing system (B-MIGS) consisting of a dual-layer sensing device with a magnetically induced grid structure and a testing device. The system was capable of utilizing mechanical pressure to perceive tactile stimulation and magnetic sensing to simultaneously transduce touchless stimulation simultaneously. By leveraging the triboelectric effect, the decoupling of tactile and touchless signals in the presence of unknown signal sources was achieved. Additionally, the sensing characteristics of the B-MIGS were optimized by varying the curing magnetic induction intensity and magnetic particle concentration. The influence of the temperature and humidity on the sensing signals was also discussed. Finally, the practical value of the B-MIGS as a dual-mode monitoring system was demonstrated on soft petals and sensor arrays, along with exploration of its potential application in underwater environments.

A nanonewton-scale biomimetic mechanosensor

Biomimetic mechanosensors have profound implications for various areas, including health care, prosthetics, human‒machine interfaces, and robotics. As one of the most important parameters, the sensitivity of mechanosensors is intrinsically determined by the detection resolution to mechanical force. In this manuscript, we expand the force detection resolution of current biomimetic mechanosensors from the micronewton to nanonewton scale. We develop a nanocrack-based electronic whisker-type mechanosensor that has a detection resolution of 72.2 nN. We achieve the perception of subtle mechanical stimuli, such as tiny objects and airflow, and the recognition of surface morphology down to a 30 nm height, which is the finest resolution ever reported in biomimetic mechanosensors. More importantly, we explore the use of this mechanosensor in wearable devices for sensing gravity field orientation with respect to the body, which has not been previously achieved by these types of sensors. We develop a wearable smart system for sensing the body's posture and movements, which can be used for remote monitoring of falls in elderly people. In summary, the proposed device offers great advantages for not only improving sensing ability but also expanding functions and thus can be used in many fields not currently served by mechanosensors.

Synthesis and Sensing Performance of Chitin Fiber/MoS2 Composites

In this study, chitin fibers (CFs) were combined with molybdenum sulfide (MoS₂) to develop high-performance sensors, and chitin carbon materials were innovatively introduced into the application of gas sensing. MoS₂/CFs composites were synthesized via a one-step hydrothermal method. The surface properties of the composites were greatly improved, and the fire resistance effect was remarkable compared with that of the chitin monomer. In the gas-sensitive performance test, the overall performance of the MoS₂/CFs composite was more than three times better than that of the MoS₂ monomer and showed excellent long-term stability, with less than 10% performance degradation in three months. Extending to the field of strain sensing, MoS₂/CFs composites can realize real-time signal conversion in tensile and motion performance tests, which can help inspectors make analytical judgments in response to the analysis results. The extensive application of sensing materials in more fields is expected to be further developed. Based on the recycling of waste chitin textile materials, this paper expands the potential applications of chitin materials in the fields of gas monitoring, biomedicine, behavioral discrimination and intelligent monitoring.

Fabrication, control, and modeling of robots inspired by flagella and cilia

Flagella and cilia are slender structures that serve important functionalities in the microscopic world through their locomotion induced by fluid and structure interaction. With recent developments in microscopy, fabrication, biology, and modeling capability, robots inspired by the locomotion of these organelles in low Reynolds number flow have been manufactured and tested on the micro-and macro-scale, ranging from medicalin vivomicrobots, microfluidics to macro prototypes. We present a collection of modeling theories, control principles, and fabrication methods for flagellated and ciliary robots.

Research Progresses in Microstructure Designs of Flexible Pressure Sensors

Flexible electronic technology is one of the research hotspots, and numerous wearable devices have been widely used in our daily life. As an important part of wearable devices, flexible sensors can effectively detect various stimuli related to specific environments or biological species, having a very bright development prospect. Therefore, there has been lots of studies devoted to developing high-performance flexible pressure sensors. In addition to developing a variety of materials with excellent performances, the microstructure designs of materials can also effectively improve the performances of sensors, which has brought new ideas to scientists and attracted their attention increasingly. This paper will summarize the flexible pressure sensors based on material microstructure designs in recent years. The paper will mainly discuss the processing methods and characteristics of various sensors with different microstructures, and compare the advantages, disadvantages, and application scenarios of them. At the same time, the main application fields of flexible pressure sensors based on microstructure designs will be listed, and their future development and challenges will be discussed.

Ordered Magnetic Cilia Array Induced by the Micro-cavity Effect for the In Situ Adjustable Pressure Sensor

Cilia are fundamental functional structures in natural biology. As the primary option of artificial cilia, magnetic cilia have been drawing extensive attention due to their excellent biocompatibility, sensitive response, and contactless actuation. However, most of the ordered magnetic cilia are fabricated by molds, suffering from high cost and low efficiency. In this paper, an ultrafast fabrication method of ordered cilia array using the micro-cavity inducing effect was proposed. With the impact of static and dynamic magnetic fields, the fine cilia were first formed in out-cavity area and then converged above cavities forming complete cilia structures. The mechanism of the micro-cavity inducing effect was further revealed. Finally, the ordered cilia array was used to develop the pressure sensor with variable stiffness, making the in situ adjustment of the sensor performance possible. The ordered cilia array was applied as a micro-mixer and largely improved the mixing efficiency for different mediums. The ordered cilia array also successfully served as the info carrier for rapid sub-encryption. This method allows the fast and controlled forming of ordered cilia arrays within 30 s, and the cilia structure can be adjusted in a large range of aspect ratios (1-9), providing an approach to large-scale producing the magnetic cilia for different applications.

Microfluidic Applications of Artificial Cilia: Recent Progress, Demonstration, and Future Perspectives

Artificial cilia-based microfluidics is a promising alternative in lab-on-a-chip applications which provides an efficient way to manipulate fluid flow in a microfluidic environment with high precision. Additionally, it can induce favorable local flows toward practical biomedical applications. The endowment of artificial cilia with their anatomy and capabilities such as mixing, pumping, transporting, and sensing lead to advance next-generation applications including precision medicine, digital nanofluidics, and lab-on-chip systems. This review summarizes the importance and significance of the artificial cilia, delineates the recent progress in artificial cilia-based microfluidics toward microfluidic application, and provides future perspectives. The presented knowledge and insights are envisaged to pave the way for innovative advances for the research communities in miniaturization.

Materials, Actuators, and Sensors for Soft Bioinspired Robots

Biological systems can perform complex tasks with high compliance levels. This makes them a great source of inspiration for soft robotics. Indeed, the union of these fields has brought about bioinspired soft robotics, with hundreds of publications on novel research each year. This review aims to survey fundamental advances in bioinspired soft actuators and sensors with a focus on the progress between 2017 and 2020, providing a primer for the materials used in their design.

Bioinspired Color-Changeable Organogel Tactile Sensor with Excellent Overall Performance

Inspired by chameleons' structural color regulation capability, a simple, but effective, swelling method is proposed for the first time to prepare an ionic polyacrylamide (PAAm) organogel for simultaneous tactile sensing and interactive color changing. The PAAm organogel obtained by swelling the PAAm scaffold in the dimethyl sulfoxide solution of organic electrochromic material (OECM) shows an extremely large stretchability with an elongation of 1600%, a supersoftness with a compressive modulus of 7.2 kPa, an excellent transmittance up to 90%, and a very fast response time of 0.5 s combined with the characteristic of interactive color changing. The PAAm organogel also suggests a universal design ability to tailor coloration spectra for tactile sensors via simply changing the type and content of OECM. The tactile sensor based on a PAAm organogel is capable of serving as a wearable device for precisely tracing human body motion performance and directly visualizing the stress distribution via interactive color changing capability. It is demonstrated that the swelling method proposed here is a simple and practical strategy to prepare ionic organogels with both piezo-resistive and electrochromic effects.

Spider-Inspired Ultrasensitive Flexible Vibration Sensor for Multifunctional Sensing

Flexible vibration sensors can not only capture broad classes of physiologically relevant information, including mechano-vibration signatures of body processes and precision kinematics of core-body motions, but also detect environmental seismic waves, providing early warning to wearers in time. Spider is one of the most vibration-sensitive creatures because of its hairlike sensilla and lyriform slit structure. Here, a spider-inspired ultrasensitive flexible vibration sensor is designed and fabricated for multifunctional sensing. The vibration sensitivity of the flexible sensor is increased over 2 orders of magnitude from 0.006 to 0.5 mV/g, and the strain sensitivity is hugely enhanced from 0.08 to 150 compared to a plain sensor counterpart. It is shown that the synergistic effect of cilium arrays and cracks is the key for achieving the greatly enhanced vibration and strain sensitivity. The dynamic sensitivity of 0.5 mV/g outperforms the corresponding commercial vibration sensors. The flexible sensor is demonstrated to be generally feasible for detecting vibration signals caused by walk, tumble, and explosion as well as capturing human body motions, indicating its great potential for applications in human health-monitoring devices, posture control in robotics, early earthquake warning, and so forth.

Bioinspired Electronics for Artificial Sensory Systems

Humans have a myriad of sensory receptors in different sense organs that form the five traditionally recognized senses of sight, hearing, smell, taste, and touch. These receptors detect diverse stimuli originating from the world and turn them into brain-interpretable electrical impulses for sensory cognitive processing, enabling us to communicate and socialize. Developments in biologically inspired electronics have led to the demonstration of a wide range of electronic sensors in all five traditional categories, with the potential to impact a broad spectrum of applications. Here, recent advances in bioinspired electronics that can function as potential artificial sensory systems, including prosthesis and humanoid robots are reviewed. The mechanisms and demonstrations in mimicking biological sensory systems are individually discussed and the remaining future challenges that must be solved for their versatile use are analyzed. Recent progress in bioinspired electronic sensors shows that the five traditional senses are successfully mimicked using novel electronic components and the performance regarding sensitivity, selectivity, and accuracy have improved to levels that outperform human sensory organs. Finally, neural interfacing techniques for connecting artificial sensors to the brain are discussed.

Dynamic Optics with Transparency and Color Changes under Ambient Conditions

Mechanochromic materials have recently received tremendous attention because of their potential applications in humanoid robots, smart windows, strain sensors, anti-counterfeit tags, etc. However, improvements in device design are highly desired for practical implementation in a broader working environment with a high stability. In this article, a novel and robust mechanochromism was designed and fabricated via a facile method. Silica nanoparticles (NPs) that serve as a trigger of color switch were embedded in elastomer to form a bi-layer hybrid film. Upon stretching under ambient conditions, the hybrid film can change color as well as transparency. Furthermore, it demonstrates excellent reversibility and reproducibility and is promising for widespread application.