Soft, miniaturized, wireless olfactory interface for virtual reality

Advances in olfactory augmented virtual reality towards future metaverse applications

Recent advances in virtual reality technologies accelerate the immersive interaction between human and augmented 3D virtual worlds. Here, the authors discuss olfactory feedback technologies that facilitate interaction with real and virtual objects and the evolution of wearable devices for immersive VR/AR applications.

Development and Application of IoT Monitoring Systems for Typical Large Amusement Facilities

The advent of internet of things (IoT) technology has ushered in a new dawn for the digital realm, offering innovative avenues for real-time surveillance and assessment of the operational conditions of intricate mechanical systems. Nowadays, mechanical system monitoring technologies are extensively utilized in various sectors, such as rotating and reciprocating machinery, expansive bridges, and intricate aircraft. Nevertheless, in comparison to standard mechanical frameworks, large amusement facilities, which constitute the primary manned electromechanical installations in amusement parks and scenic locales, showcase a myriad of structural designs and multiple failure patterns. The predominant method for fault diagnosis still relies on offline manual evaluations and intermittent testing of vital elements. This practice heavily depends on the inspectors' expertise and proficiency for effective detection. Moreover, periodic inspections cannot provide immediate feedback on the safety status of crucial components, they lack preemptive warnings for potential malfunctions, and fail to elevate safety measures during equipment operation. Hence, developing an equipment monitoring system grounded in IoT technology and sensor networks is paramount, especially considering the structural nuances and risk profiles of large amusement facilities. This study aims to develop customized operational status monitoring sensors and an IoT platform for large roller coasters, encompassing the design and fabrication of sensors and IoT platforms and data acquisition and processing. The ultimate objective is to enable timely warnings when monitoring signals deviate from normal ranges or violate relevant standards, thereby facilitating the prompt identification of potential safety hazards and equipment faults.

Wireless Technologies in Flexible and Wearable Sensing: From Materials Design, System Integration to Applications

Wireless and wearable sensors attract considerable interest in personalized healthcare by providing a unique approach for remote, noncontact, and continuous monitoring of various health-related signals without interference with daily life. Recent advances in wireless technologies and wearable sensors have promoted practical applications due to their significantly improved characteristics, such as reduction in size and thickness, enhancement in flexibility and stretchability, and improved conformability to the human body. Currently, most researches focus on active materials and structural designs for wearable sensors, with just a few exceptions reflecting on the technologies for wireless data transmission. This review provides a comprehensive overview of the state-of-the-art wireless technologies and related studies on empowering wearable sensors. The emerging functional nanomaterials utilized for designing unique wireless modules are highlighted, which include metals, carbons, and MXenes. Additionally, the review outlines the system-level integration of wireless modules with flexible sensors, spanning from novel design strategies for enhanced conformability to efficient transmitting data wirelessly. Furthermore, the review introduces representative applications for remote and noninvasive monitoring of physiological signals through on-skin and implantable wireless flexible sensing systems. Finally, the challenges, perspectives, and unprecedented opportunities for wireless and wearable sensors are discussed.

Mass-Produced Skin-Inspired Piezoresistive Sensing Array with Interlocking Interface for Object Recognition

E-skins, capable of responding to mechanical stimuli, hold significant potential in the field of robot haptics. However, it is a challenge to obtain e-skins with both high sensitivity and mechanical stability. Here, we present a bioinspired piezoresistive sensor with hierarchical structures based on polyaniline/polystyrene core-shell nanoparticles polymerized on air-laid paper. The combination of laser-etched reusable templates and sensitive materials that can be rapidly synthesized enables large-scale production. Benefiting from the substantially enlarged deformation of the hierarchical structure, the developed piezoresistive electronics exhibit a decent sensitivity of 21.67 kPa-1 and a subtle detection limit of 3.4 Pa. Moreover, an isolation layer is introduced to enhance the interface stability of the e-skin, with a fracture limit of 66.34 N/m. Furthermore, the e-skin can be seamlessly integrated onto gloves without any detachment issues. With the assistance of deep learning, it achieves a 98% accuracy rate in object recognition. We anticipate that this strategy will render e-skin with more robust interfaces and heightened sensing capabilities, offering a favorable pathway for large-scale production.

Intuition-and-Tactile Bimodal Sensing Based on Artificial-Intelligence-Motivated All-Fabric Bionic Electronic Skin for Intelligent Material Perception

Developing electronic skins (e-skins) with extraordinary perception through bionic strategies has far-reaching significance for the intellectualization of robot skins. Here, an artificial intelligence (AI)-motivated all-fabric bionic (AFB) e-skin is proposed, where the overall structure is inspired by the interlocked bionics of the epidermis-dermis interface inside the skin, while the structural design inspiration of the dielectric layer derives from the branch-needle structure of conifers. More importantly, AFB e-skin achieves intuition sensing in proximity mode and tactile sensing in pressure mode based on the fringing and iontronic effects, respectively, and is simulated and verified through COMSOL finite element analysis. The proposed AFB e-skin in pressure mode exhibits maximum sensitivity of 15.06 kPa-1 (<50 kPa), linear sensitivity of 6.06 kPa-1 (50-200 kPa), and fast response/recovery time of 5.6 ms (40 kPa). By integrating AFB e-skin with AI algorithm, and with the support of material inference mechanisms based on dielectric constant and softness/hardness, an intelligent material perception system capable of recognizing nine materials with indistinguishable surfaces within one proximity-pressure cycle is established, demonstrating abilities that surpass human perception.

Bioinspired 3D flexible devices and functional systems

Flexible devices and functional systems with elaborated three-dimensional (3D) architectures can endow better mechanical/electrical performances, more design freedom, and unique functionalities, when compared to their two-dimensional (2D) counterparts. Such 3D flexible devices/systems are rapidly evolving in three primary directions, including the miniaturization, the increasingly merged physical/artificial intelligence and the enhanced adaptability and capabilities of heterogeneous integration. Intractable challenges exist in this emerging research area, such as relatively poor controllability in the locomotion of soft robotic systems, mismatch of bioelectronic interfaces, and signal coupling in multi-parameter sensing. By virtue of long-time-optimized materials, structures and processes, natural organisms provide rich sources of inspiration to address these challenges, enabling the design and manufacture of many bioinspired 3D flexible devices/systems. In this Review, we focus on bioinspired 3D flexible devices and functional systems, and summarize their representative design concepts, manufacturing methods, principles of structure-function relationship and broad-ranging applications. Discussions on existing challenges, potential solutions and future opportunities are also provided to usher in further research efforts toward realizing bioinspired 3D flexible devices/systems with precisely programmed shapes, enhanced mechanical/electrical performances, and high-level physical/artificial intelligence.

Soft Sensors and Actuators for Wearable Human-Machine Interfaces

Haptic human-machine interfaces (HHMIs) combine tactile sensation and haptic feedback to allow humans to interact closely with machines and robots, providing immersive experiences and convenient lifestyles. Significant progress has been made in developing wearable sensors that accurately detect physical and electrophysiological stimuli with improved softness, functionality, reliability, and selectivity. In addition, soft actuating systems have been developed to provide high-quality haptic feedback by precisely controlling force, displacement, frequency, and spatial resolution. In this Review, we discuss the latest technological advances of soft sensors and actuators for the demonstration of wearable HHMIs. We particularly focus on highlighting material and structural approaches that enable desired sensing and feedback properties necessary for effective wearable HHMIs. Furthermore, promising practical applications of current HHMI technology in various areas such as the metaverse, robotics, and user-interactive devices are discussed in detail. Finally, this Review further concludes by discussing the outlook for next-generation HHMI technology.

Porous Conductive Textiles for Wearable Electronics

Over the years, researchers have made significant strides in the development of novel flexible/stretchable and conductive materials, enabling the creation of cutting-edge electronic devices for wearable applications. Among these, porous conductive textiles (PCTs) have emerged as an ideal material platform for wearable electronics, owing to their light weight, flexibility, permeability, and wearing comfort. This Review aims to present a comprehensive overview of the progress and state of the art of utilizing PCTs for the design and fabrication of a wide variety of wearable electronic devices and their integrated wearable systems. To begin with, we elucidate how PCTs revolutionize the form factors of wearable electronics. We then discuss the preparation strategies of PCTs, in terms of the raw materials, fabrication processes, and key properties. Afterward, we provide detailed illustrations of how PCTs are used as basic building blocks to design and fabricate a wide variety of intrinsically flexible or stretchable devices, including sensors, actuators, therapeutic devices, energy-harvesting and storage devices, and displays. We further describe the techniques and strategies for wearable electronic systems either by hybridizing conventional off-the-shelf rigid electronic components with PCTs or by integrating multiple fibrous devices made of PCTs. Subsequently, we highlight some important wearable application scenarios in healthcare, sports and training, converging technologies, and professional specialists. At the end of the Review, we discuss the challenges and perspectives on future research directions and give overall conclusions. As the demand for more personalized and interconnected devices continues to grow, PCT-based wearables hold immense potential to redefine the landscape of wearable technology and reshape the way we live, work, and play.

Artificial Intelligence-Powered Electronic Skin

Skin-interfaced electronics is gradually changing medical practices by enabling continuous and noninvasive tracking of physiological and biochemical information. With the rise of big data and digital medicine, next-generation electronic skin (e-skin) will be able to use artificial intelligence (AI) to optimize its design as well as uncover user-personalized health profiles. Recent multimodal e-skin platforms have already employed machine learning (ML) algorithms for autonomous data analytics. Unfortunately, there is a lack of appropriate AI protocols and guidelines for e-skin devices, resulting in overly complex models and non-reproducible conclusions for simple applications. This review aims to present AI technologies in e-skin hardware and assess their potential for new inspired integrated platform solutions. We outline recent breakthroughs in AI strategies and their applications in engineering e-skins as well as understanding health information collected by e-skins, highlighting the transformative deployment of AI in robotics, prosthetics, virtual reality, and personalized healthcare. We also discuss the challenges and prospects of AI-powered e-skins as well as predictions for the future trajectory of smart e-skins.

Skin-Integrated Wireless Odor Message Delivery Electronics for the Deaf-blind

Deaf-blindness limits daily human activities, especially interactive modes of audio and visual perception. Although the developed standards have been verified as alternative communication methods, they are uncommon to the nondisabled due to the complicated learning process and inefficiency in terms of communicating distance and throughput. Therefore, the development of communication techniques employing innate sensory abilities including olfaction related to the cerebral limbic system processing emotions, memories, and recognition has been suggested for reducing the training level and increasing communication efficiency. Here, a skin-integrated and wireless olfactory interface system exploiting arrays of miniaturized odor generators (OGs) based on melting/solidifying odorous wax to release smell is introduced for establishing an advanced communication system between deaf-blind and non-deaf-blind. By optimizing the structure design of the OGs, each OG device is as small as 0.24 cm3 (length × width × height of 11 mm × 10 mm × 2.2 mm), enabling integration of up to 8 OGs on the epidermis between nose and lip for direct and rapid olfactory drive with a weight of only 24.56 g. By generating single or mixed odors, different linked messages could be delivered to a user within a short period in a wireless and programmable way. By adopting the olfactory interface message delivery system, the recognition rates for the messages have been improved 1.5 times that of the touch-based method, while the response times were immensely decreased 4 times. Thus, the presented wearable olfactory interface system exhibits great potential as an alternative message delivery method for the deaf-blind.