3D motion tracking display enabled by magneto-interactive electroluminescence

Omnidirectionally Stretchable Spin-Valve Sensor Array with Stable Giant Magnetoresistance Performance

Flexible magnetic sensors, which have advantages such as deformability, vector field sensing, and noncontact detection, are an important branch of flexible electronics and have significant applications in fields such as magnetosensitive electronic skin. Human skin surfaces have complicated deformations, which pose a demand for magnetic sensors that can withstand omnidirectional strain while maintaining stable performance. However, existing flexible magnetic sensor arrays can only withstand stretching along specific directions and are prone to failure under complicated deformations. Here, we demonstrate an omnidirectionally stretchable spin-valve sensor array with high stretchability and excellent performance. By integrating the modulus-distributed structure with liquid metal, the sensor can maintain its performance under complex deformations, enabling the overall system with omnidirectional stretchability. The fabricated spin-valve sensor exhibits a nearly unchanged giant magnetoresistance ratio of 8% and a maximum sensitivity of 0.93%/Oe upon omnidirectional strain up to 86% and can maintain stable performance without fatigue for over 1000 stretching cycles. Furthermore, this spin-valve sensor array is characterized by stable sensing performance for magnetic fields under complicated deformations and can be applied as a magnetosensitive electronic skin. Our results provide insights into the development of next-generation stretchable and wearable magnetoelectronics.

Alternating current electroluminescence devices: recent advances and functional applications

Wearable smart devices and visualisation sensors based on alternating current electroluminescence (ACEL) have received considerable attention in recent years. Due to the unique properties of ACEL devices, such as high mechanical strength, adaptability to complex environments, and no need for energy level matching, ACEL is suitable for multifunctional applications and visualisation sensing platforms. This review comprehensively outlines the latest developments in ACEL devices, starting with an analysis of the mechanism, classification, and optimisation strategies of ACEL. It introduces the functional applications of ACEL in multicolour displays, high-durability displays, stretchable and wearable displays, and autonomous function displays. Particularly, it emphasises the research progress of ACEL in sensory displays under interactive conditions such as liquid sensing, environmental factor sensing, kinetic energy sensing, and biosensing. Finally, it forecasts the challenges and new opportunities faced by future functional and interactive ACEL devices in fields such as artificial intelligence, smart robotics, and human-computer interaction.

Contactless User-Interactive Sensing Display for Human-Human and Human-Machine Interactions

Creating a large-scale contactless user-interactive sensing display (CUISD) with optimal features is challenging but crucial for efficient human-human or human-machine interactions. This study reports a CUISD based on dynamic alternating current electroluminescence (ACEL) that responds to humidity. Subsecond humidity-induced luminescence is achieved by integrating a highly responsive hydrogel into the ACEL layer. The patterned silver nanofiber electrode and luminescence layer, produced through electrospinning and microfabrication, result in a stretchable, large-scale, high-resolution, multicolor, and dynamic CUISD. The CUISD is implemented for the real-time control of a remote-controlled car, wherein the luminescence signals induced by touchless finger movements are distinguished and encoded to deliver specific commands. Moreover, the distinctive recognition of breathing facilitates the CUISD to serve as a visual signal transmitter for information interaction, which is particularly beneficial for individuals with disabilities. The paradigm shift depicts in this work is expected to reshape the way authors interact with each other and devices, discovering niche applications in virtual/augmented reality and the metaverse.

Soft Sensors and Actuators for Wearable Human-Machine Interfaces

Haptic human-machine interfaces (HHMIs) combine tactile sensation and haptic feedback to allow humans to interact closely with machines and robots, providing immersive experiences and convenient lifestyles. Significant progress has been made in developing wearable sensors that accurately detect physical and electrophysiological stimuli with improved softness, functionality, reliability, and selectivity. In addition, soft actuating systems have been developed to provide high-quality haptic feedback by precisely controlling force, displacement, frequency, and spatial resolution. In this Review, we discuss the latest technological advances of soft sensors and actuators for the demonstration of wearable HHMIs. We particularly focus on highlighting material and structural approaches that enable desired sensing and feedback properties necessary for effective wearable HHMIs. Furthermore, promising practical applications of current HHMI technology in various areas such as the metaverse, robotics, and user-interactive devices are discussed in detail. Finally, this Review further concludes by discussing the outlook for next-generation HHMI technology.

Flexible and Stretchable Light-Emitting Diodes and Photodetectors for Human-Centric Optoelectronics

Optoelectronic devices with unconventional form factors, such as flexible and stretchable light-emitting or photoresponsive devices, are core elements for the next-generation human-centric optoelectronics. For instance, these deformable devices can be utilized as closely fitted wearable sensors to acquire precise biosignals that are subsequently uploaded to the cloud for immediate examination and diagnosis, and also can be used for vision systems for human-interactive robotics. Their inception was propelled by breakthroughs in novel optoelectronic material technologies and device blueprinting methodologies, endowing flexibility and mechanical resilience to conventional rigid optoelectronic devices. This paper reviews the advancements in such soft optoelectronic device technologies, honing in on various materials, manufacturing techniques, and device design strategies. We will first highlight the general approaches for flexible and stretchable device fabrication, including the appropriate material selection for the substrate, electrodes, and insulation layers. We will then focus on the materials for flexible and stretchable light-emitting diodes, their device integration strategies, and representative application examples. Next, we will move on to the materials for flexible and stretchable photodetectors, highlighting the state-of-the-art materials and device fabrication methods, followed by their representative application examples. At the end, a brief summary will be given, and the potential challenges for further development of functional devices will be discussed as a conclusion.

Alternating Current Electroluminescence for Human-Interactive Sensing Displays

The development of stimuli-interactive displays based on alternating current (AC)-driven electroluminescence (EL) is of great interest, owing to their simple device architectures suitable for wearable applications requiring resilient mechanical flexibility and stretchability. AC-EL displays can serve as emerging platforms for various human-interactive sensing displays (HISDs) where human information is electrically detected and directly visualized using EL, promoting the development of the interaction of human-machine technologies. This review provides a holistic overview of the latest developments in AC-EL displays with an emphasis on their applications for HISDs. AC-EL displays based on exciton recombination or impact excitations of hot electrons are classified into four representative groups depending upon their device architecture: 1) displays without insulating layers, 2) displays with single insulating layers, 3) displays with double insulating layers, and 4) displays with EL materials embedded in an insulating matrix. State-of-the-art AC HISDs are discussed. Furthermore, emerging stimuli-interactive AC-EL displays are described, followed by a discussion of scientific and engineering challenges and perspectives for future stimuli-interactive AC-EL displays serving as photo-electronic human-machine interfaces.

Interfacing Lanthanide Metal-Organic Frameworks with ZnO Nanowires for Alternating Current Electroluminescence

Alternating current electroluminescence (ACEL) devices are attractive candidates in cost-effective lighting, sensing, and flexible displays due to their uniform luminescence, stable performance, and outstanding deformability. However, ACEL devices have suffered from limited options for the light-emitting layer, which presents a significant constraint in the progress of utilizing ACEL. Herein, a new class of ACEL phosphors based on lanthanide metal-organic frameworks (Ln-MOFs) is devised. A synthesis of lanthanide-benzenetricarboxylate (Ln-BTC) thin film on a brass grid substrate seeded with ZnO nanowires (NWs) as anchors is developed. The as-synthesized Ln-BTC thin film is employed as the emissive layer and shows visible electroluminescence driven by alternating current (2.9 V µm-1 , 1 kHz) for the first time. Mechanistic investigations reveal that the Ln-based ACEL stems from impact excitation by accelerated electrons from ZnO NWs. Fine-tuning of the ACEL color is also demonstrated by controlling the Ln-MOF compositions and introducing an extra ZnS emitting layer. The advances in these optical materials expand the application of ACEL devices in anti-counterfeiting.

Touchless Artificial Perception beyond Fingertip Probing

Touchless perception technology allows us to acquire information beyond the contact interfaces, making it ideal for scenarios where physical engagements are not possible. Unlike tactile devices, which have so far achieved impressive results, touchless strategies are fascinating yet underdeveloped. We envisage that touchless technologies could be powerful supplements to current haptics. In this Perspective, we include emerging touchless electronics, aiming to provide a broader and comprehensive picture toward artificial perceptual realm. We overview popular touchless protocols, sketch what could be detected by touchless probing, and summarize their latest spectacular achievements. In addition, we present the promises and challenges posed by touchless technologies and discuss possible directions for their future deployments.

Soft Human-Machine Interface Sensing Displays: Materials and Devices

The development of human-interactive sensing displays (HISDs) that simultaneously detect and visualize stimuli is important for numerous cutting-edge human-machine interface technologies. Therefore, innovative device platforms with optimized architectures of HISDs combined with novel high-performance sensing and display materials are demonstrated. This study comprehensively reviews the recent advances in HISDs, particularly the device architectures that enable scaling-down and simplifying the HISD, as well as material designs capable of directly visualizing input information received by various sensors. Various HISD platforms for integrating sensors and displays are described. HISDs consist of a sensor and display connected through a microprocessor, and attempts to assemble the two devices by eliminating the microprocessor are detailed. Single-device HISD technologies are highlighted in which input stimuli acquired by sensory components are directly visualized with various optical components, such as electroluminescence, mechanoluminescence and structural color. The review forecasts future HISD technologies that demand the development of materials with molecular-level synthetic precision that enables simultaneous sensing and visualization. Furthermore, emerging HISDs combined with artificial intelligence technologies and those enabling simultaneous detection and visualization of extrasensory information are discussed.

Dual-light emitting 3D encryption with printable fluorescent-phosphorescent metal-organic frameworks

Optical encryption technologies based on room-temperature light-emitting materials are of considerable interest. Herein, we present three-dimensional (3D) printable dual-light-emitting materials for high-performance optical pattern encryption. These are based on fluorescent perovskite nanocrystals (NCs) embedded in metal-organic frameworks (MOFs) designed for phosphorescent host-guest interactions. Notably, perovskite-containing MOFs emit a highly efficient blue phosphorescence, and perovskite NCs embedded in the MOFs emit characteristic green or red fluorescence under ultraviolet (UV) irradiation. Such dual-light-emitting MOFs with independent fluorescence and phosphorescence emissions are employed in pochoir pattern encryption, wherein actual information with transient phosphorescence is efficiently concealed behind fake information with fluorescence under UV exposure. Moreover, a 3D cubic skeleton is developed with the dual-light-emitting MOF powder dispersed in 3D-printable polymer filaments for 3D dual-pattern encryption. This article outlines a universal principle for developing MOF-based room-temperature multi-light-emitting materials and a strategy for multidimensional information encryption with enhanced capacity and security.

Wireless Stand-Alone Trimodal Interactive Display Enabled by Direct Capacitive Coupling

With recent advances in interactive displays, the development of a stand-alone interactive display with no electrical interconnection is of great interest. Here, a wireless stand-alone interactive display (WiSID), enabled by direct capacitive coupling, consisting of three layers: two in-plane metal electrodes separated by a gap, a composite layer for field-induced electroluminescence (EL) and inverse piezoelectric sound, and a stimuli-responsive layer, from bottom to top, is presented. Alternating current power necessary for field-induced EL and inverse piezoelectric sound is wirelessly transferred from a power unit, with two in-plane electrodes remotely separated from the WiSID. The unique in-plane power transfer through the stimuli-sensitive polar bridge allows stand-alone operation of the WiSID, making it suitable for the wireless dynamic monitoring of medical fluids. Moreover, a haptic wireless stand-alone trimodal interactive display mounted on a human finger is demonstrated, whereby touch is wirelessly displayed in various outputs of EL, inverse piezoelectric sound, and tactile vibration, making it suitable for a wireless three-mode smart braille display.

Asymmetrically Enhanced Coplanar-Electrode Electroluminescence for Information Encryption and Ultrahighly Stretchable Displays

Traditional alternating-current-driven electroluminescent (AC-EL) devices adopting a sandwich structure are commonly used in solid-state lighting and displays, while the emerging coplanar-electrode alternating-current-driven light-emitting variants manifest excellent application prospects in intelligent, multifunctional, and full-color displays, and sensing purposes. In this work, an asymmetrically enhanced coplanar-electrode AC-EL device with a universal and straightforward architecture is designed based on the impedance adjustment strategy. This newly devised asymmetric structure extends the functionalities of the coplanar-electrode AC-EL devices by overcoming the bottlenecks of complicated patterning procedures and high driving voltages of symmetric configuration. The developed device design enables a new type of information encryption and ultrahighly stretchable patterned displays. Notably, the novel encryption appliances demonstrate feasible encryption/decryption features, multiple encryptions, and practical applicability; the biaxially stretchable display devices achieve the highest tensile performance in the field of stretchable electroluminescent pattern displays, and outperform the ultrahighly stretchable sandwich devices in terms of simple patterning process, higher brightness, wider color gamut, and long-term stability. The proposed configuration opens up new avenues for AC-EL devices toward a plethora of smart applications in wearable electronics with intelligent displays, dynamic interaction of human-machine interface, and soft robotics.

Chromism-Integrated Sensors and Devices for Visual Indicators

The bifunctionality of chromism-integrated sensors and devices has been highlighted because of their reversibility, fast response, and visual indication. For example, one of the representative chromism electrochromic materials exhibits optical modulation under ion insertion/extraction by applying a potential. This operation mechanism can be integrated with various sensors (pressure, strain, biomolecules, gas, etc.) and devices (energy conversion/storage systems) as visual indicators for user-friendly operation. In this review, recent advances in the field of chromism-integrated systems for visual indicators are categorized for various chromism-integrated sensors and devices. This review can provide insights for researchers working on chromism, sensors, or devices. The integrated chromic devices are evaluated in terms of coloration-bleach operation, cycling stability, and coloration efficiency. In addition, the existing challenges and prospects for chromism-integrated sensors and devices are summarized for further research.

Bird-Inspired Self-Navigating Artificial Synaptic Compass

Extrasensory neuromorphic devices that can recognize, memorize, and learn stimuli imperceptible to human beings are of considerable interest in interactive intelligent electronics research. This study presents an artificially intelligent magnetoreceptive synapse inspired by the magnetocognitive ability used by birds for navigation and orientation. The proposed synaptic platform is based on arrays of ferroelectric field-effect transistors with air-suspended magneto-interactive top-gates. A suspended gate of an elastomeric composite with superparamagnetic particles laminated with an electrically conductive polymer is mechanically deformed under a magnetic field, facilitating control of the magnetic-field-dependent contact area of the suspended gate with an underlying ferroelectric layer. The remanent polarization of the ferroelectric layer is electrically programmed with the deformed suspended gate, resulting in analog conductance modulation as a function of the magnitude, number, and time interval of the input magnetic pulses. The proposed extrasensory magnetoreceptive synapse may be used as an artificially intelligent synaptic compass that facilitates barrier-adaptable navigation and mapping of a moving object.

Stimulus-responsive nanomaterials under physical regulation for biomedical applications

Cancer is a growing threat to human beings. Traditional treatments for malignant tumors usually involve invasive means to healthy human tissues, such as surgical treatment and chemotherapy. In recent years the use of specific stimulus-responsive materials in combination with some non-contact, non-invasive stimuli can lead to better efficacy and has become an important area of research. It promises to develop personalized treatment systems for four types of physical stimuli: light, ultrasound, magnetic field, and temperature. Nanomaterials that are responsive to these stimuli can be used to enhance drug delivery, cancer treatment, and tissue engineering. This paper reviews the principles of the stimuli mentioned above, their effects on materials, and how they work with nanomaterials. For this aim, we focus on specific applications in controlled drug release, cancer therapy, tissue engineering, and virus detection, with particular reference to recent photothermal, photodynamic, sonodynamic, magnetothermal, radiation, and other types of therapies. It is instructive for the future development of stimulus-responsive nanomaterials for these aspects.

High Inclusiveness and Accuracy Motion Blur Real-Time Gesture Recognition Based on YOLOv4 Model Combined Attention Mechanism and DeblurGanv2

The combination of gesture recognition and aerospace exploration robots can realize the efficient non-contact control of the robots. In the harsh aerospace environment, the captured gesture images are usually blurred and damaged inevitably. The motion blurred images not only cause part of the transmitted information to be lost, but also affect the effect of neural network training in the later stage. To improve the speed and accuracy of motion blurred gestures recognition, the algorithm of YOLOv4 (You Only Look Once, vision 4) is studied from the two aspects of motion blurred image processing and model optimization. The DeblurGanv2 is employed to remove the motion blur of the gestures in YOLOv4 network input pictures. In terms of model structure, the K-means++ algorithm is used to cluster the priori boxes for obtaining the more appropriate size parameters of the priori boxes. The CBAM attention mechanism and SPP (spatial pyramid pooling layer) structure are added to YOLOv4 model to improve the efficiency of network learning. The dataset for network training is designed for the human–computer interaction in the aerospace space. To reduce the redundant features of the captured images and enhance the effect of model training, the Wiener filter and bilateral filter are superimposed on the blurred images in the dataset to simply remove the motion blur. The augmentation of the model is executed by imitating different environments. A YOLOv4-gesture model is built, which collaborates with K-means++ algorithm, the CBAM and SPP mechanism. A DeblurGanv2 model is built to process the input images of the YOLOv4 target recognition. The YOLOv4-motion-blur-gesture model is composed of the YOLOv4-gesture and the DeblurGanv2. The augmented and enhanced gesture data set is used to simulate the model training. The experimental results demonstrate that the YOLOv4-motion-blur-gesture model has relatively better performance. The proposed model has the high inclusiveness and accuracy recognition effect in the real-time interaction of motion blur gestures, it improves the network training speed by 30%, the target detection accuracy by 10%, and the value of mAP by about 10%. The constructed YOLOv4-motion-blur-gesture model has a stable performance. It can not only meet the real-time human–computer interaction in aerospace space under real-time complex conditions, but also can be applied to other application environments under complex backgrounds requiring real-time detection.