Tactile Sensors for Robotic Applications

A multifunctional flexible sensor based on PI-MXene/SrTiO3 hybrid aerogel for tactile perception

The inadequacy of tactile perception systems in humanoid robotic manipulators limits the breadth of available robotic applications. Here, we designed a multifunctional flexible tactile sensor for robotic fingers that provides capabilities similar to those of human skin sensing modalities. This sensor utilizes a novel PI-MXene/SrTiO3 hybrid aerogel developed as a sensing unit with the additional abilities of electromagnetic transmission and thermal insulation to adapt to certain complex environments. Moreover, polyimide (PI) provides a high-strength skeleton, MXene realizes a pressure-sensing function, and MXene/SrTiO3 achieves both thermoelectric and infrared radiation response behaviors. Furthermore, via the pressure response mechanism and unsteady-state heat transfer, these aerogel-derived flexible sensors realize multimodal sensing and recognition capabilities with minimal cross-coupling. They can differentiate among 13 types of hardness and four types of material from objects with accuracies of 94% and 85%, respectively, using a decision tree algorithm. In addition, based on the infrared radiation-sensing function, a sensory array was assembled, and different shapes of objects were successfully recognized. These findings demonstrate that this PI-MXene/SrTiO3 aerogel provides a new concept for expanding the multifunctionality of flexible sensors such that the manipulator can more closely reach the tactile level of the human hand. This advancement reduces the difficulty of integrating humanoid robots and provides a new breadth of application scenarios for their possibility.

Haptic Sensing and Feedback Techniques toward Virtual Reality

Haptic interactions between human and machines are essential for information acquisition and object manipulation. In virtual reality (VR) system, the haptic sensing device can gather information to construct virtual elements, while the haptic feedback part can transfer feedbacks to human with virtual tactile sensation. Therefore, exploring high-performance haptic sensing and feedback interface imparts closed-loop haptic interaction to VR system. This review summarizes state-of-the-art VR-related haptic sensing and feedback techniques based on the hardware parts. For the haptic sensor, we focus on mechanism scope (piezoresistive, capacitive, piezoelectric, and triboelectric) and introduce force sensor, gesture translation, and touch identification in the functional view. In terms of the haptic feedbacks, methodologies including mechanical, electrical, and elastic actuators are surveyed. In addition, the interactive application of virtual control, immersive entertainment, and medical rehabilitation is also summarized. The challenges of virtual haptic interactions are given including the accuracy, durability, and technical conflicts of the sensing devices, bottlenecks of various feedbacks, as well as the closed-loop interaction system. Besides, the prospects are outlined in artificial intelligence of things, wise information technology of medicine, and multimedia VR areas.

Real-Time Compression for Tactile Internet Data Streams

The Tactile Internet will require ultra-low latencies for combining machines and humans in systems where humans are in the control loop. Real-time and perceptual coding in these systems commonly require content-specific approaches. We present a generic approach based on deliberately reduced number accuracy and evaluate the trade-off between savings achieved and errors introduced with real-world data for kinesthetic movement and tele-surgery. Our combination of bitplane-level accuracy adaptability with perceptual threshold-based limits allows for great flexibility in broad application scenarios. Combining the attainable savings with the relatively small introduced errors enables the optimal selection of a working point for the method in actual implementations.