A Wearable Textile 3D Gesture Recognition Sensor Based on Screen-Printing Technology

Novel near E-Field Topography Sensor for Human-Machine Interfacing in Robotic Applications

This work investigates a new sensing technology for use in robotic human-machine interface (HMI) applications. The proposed method uses near E-field sensing to measure small changes in the limb surface topography due to muscle actuation over time. The sensors introduced in this work provide a non-contact, low-computational-cost, and low-noise method for sensing muscle activity. By evaluating the key sensor characteristics, such as accuracy, hysteresis, and resolution, the performance of this sensor is validated. Then, to understand the potential performance in intention detection, the unmodified digital output of the sensor is analysed against movements of the hand and fingers. This is done to demonstrate the worst-case scenario and to show that the sensor provides highly targeted and relevant data on muscle activation before any further processing. Finally, a convolutional neural network is used to perform joint angle prediction over nine degrees of freedom, achieving high-level regression performance with an RMSE value of less than six degrees for thumb and wrist movements and 11 degrees for finger movements. This work demonstrates the promising performance of this novel approach to sensing for use in human-machine interfaces.

Manipulator Control System Based on Flexible Sensor Technology

The research on the remote control of manipulators based on flexible sensor technology is gradually extensive. In order to achieve stable, accurate, and efficient control of the manipulator, it is necessary to reasonably design the structure of the sensor with excellent tensile strength and flexibility. The acquisition of manual information by high-performance sensors is the basis of manipulator control. This paper starts with the manufacturing of materials of the flexible sensor for the manipulator, introduces the substrate, sensor, and flexible electrode materials, respectively, and summarizes the performance of different flexible sensors. From the perspective of manufacturing, it introduces their basic principles and compares their advantages and disadvantages. Then, according to the different ways of wearing, the two control methods of data glove control and surface EMG control are respectively introduced, the principle, control process, and detection accuracy are summarized, and the problems of material microstructure, reducing the cost, optimizing the circuit design and so on are emphasized in this field. Finally, the commercial application in this field is explained and the future research direction is proposed from two aspects: how to ensure real-time control and better receive the feedback signal from the manipulator.

Haptic Feedback Device Using 3D-Printed Flexible, Multilayered Piezoelectric Coating for In-Car Touchscreen Interface

This study focuses on the development of a piezoelectric device capable of generating feedback vibrations to the user who manipulates it. The objective here is to explore the possibility of developing a haptic system that can replace physical buttons on the tactile screen of in-car systems. The interaction between the user and the developed device allows completing the feedback loop, where the user's action generates an input signal that is translated and outputted by the device, and then detected and interpreted by the user's haptic sensors and brain. An FEM (finite element model) via ANSYS multiphysics software was implemented to optimize the haptic performance of the wafer structure consisting of a BaTiO3 multilayered piezocomposite coated on a PET transparent flexible substrate. Several parameters relating to the geometric and mechanical properties of the wafer, together with those of the electrodes, are demonstrated to have significant impact on the actuation ability of the haptic device. To achieve the desired vibration effect on the human skin, the haptic system must be able to drive displacement beyond the detection threshold (~2 µm) at a frequency range of 100-700 Hz. The most optimized actuation ability is obtained when the ratio of the dimension (radius and thickness) between the piezoelectric coating and the substrate layer is equal to ~0.6. Regarding the simulation results, it is revealed that the presence of the conductive electrodes provokes a decrease in the displacement by approximately 25-30%, as the wafer structure becomes stiffer. To ensure the minimum displacement generated by the haptic device above 2 µm, the piezoelectric coating is screen-printed by two stacked layers, electrically connected in parallel. This architecture is expected to boost the displacement amplitude under the same electric field (denoted E) subjected to the single-layered coating. Accordingly, multilayered design seems to be a good alternative to enhance the haptic performance while keeping moderate values of E so as to prevent any undesired electrical breakdown of the coating. Practical characterizations confirmed that E=20 V/μm is sufficient to generate feedback vibrations (under a maximum input load of 5 N) perceived by the fingertip. This result confirms the reliability of the proposed haptic device, despite discrepancies between the predicted theory and the real measurements. Lastly, a demonstrator comprising piezoelectric buttons together with electronic command and conditioning circuits are successfully developed, offering an efficient way to create multiple sensations for the user. On the basis of empirical data acquired from several trials conducted on 20 subjects, statistical analyses together with relevant numerical indicators were implemented to better assess the performance of the developed haptic device.

A review of medical wearables: materials, power sources, sensors, and manufacturing aspects of human wearable technologies

Wearable technology is a promising and revolutionary technology that is changing some aspects of our standard of living to a great extent, including health monitoring, sport and fitness, performance tracking, education, and entertainment. This article presents a comprehensive literature review of over 160 articles related to state-of-the-art human wearable technologies. We provide a thorough understanding of the materials, power sources, sensors, and manufacturing processes, and the relationships between these to capture opportunities for enhancement and challenges to overcome in wearables. As a result of our review, we have determined the need for the development of a comprehensive, robust manufacturing system alongside specific standards and regulations that take into account wearables' unique characteristics. Seeing the whole picture will provide a frame reference and road map for researchers and industries through the design, manufacturing, and commercialisation of effective, portable, self-powered, multi-sensing ultimate future wearable devices and create opportunities for new innovations and applications.

Ultra-Low Power Hand Gesture Sensor Using Electrostatic Induction

This paper presents an ultra-low power hand gesture sensor using electrostatic induction for mobile devices. Two electrodes, which consist of electret foils stacked on metal sheets, are used to recognize two gestures such as hand movements from left to right and right to left. The hand gesture recognition is realized by detecting the electrostatic induction currents induced by hand movements. However, the electrostatic induction currents are significantly small; hence, a hand gesture recognition chip is first designed in this study to amplify and detect the small electrostatic induction currents with low power. This chip is fabricated in a commercial 180 nm complementary metal oxide semiconductor (CMOS) process, and the measurement results indicate that the fabricated gesture recognition chip consumes 406 nW, which is less than 1/100th of the power dissipation of conventional gesture sensors.

Textile-Based Mechanical Sensors: A Review

Innovations related to textiles-based sensors have drawn great interest due to their outstanding merits of flexibility, comfort, low cost, and wearability. Textile-based sensors are often tied to certain parts of the human body to collect mechanical, physical, and chemical stimuli to identify and record human health and exercise. Until now, much research and review work has been carried out to summarize and promote the development of textile-based sensors. As a feature, we focus on textile-based mechanical sensors (TMSs), especially on their advantages and the way they achieve performance optimizations in this review. We first adopt a novel approach to introduce different kinds of TMSs by combining sensing mechanisms, textile structure, and novel fabricating strategies for implementing TMSs and focusing on critical performance criteria such as sensitivity, response range, response time, and stability. Next, we summarize their great advantages over other flexible sensors, and their potential applications in health monitoring, motion recognition, and human-machine interaction. Finally, we present the challenges and prospects to provide meaningful guidelines and directions for future research. The TMSs play an important role in promoting the development of the emerging Internet of Things, which can make health monitoring and everyday objects connect more smartly, conveniently, and comfortably efficiently in a wearable way in the coming years.

Magnetized Micropillar-Enabled Wearable Sensors for Touchless and Intelligent Information Communication

The wearable sensors have recently attracted considerable attentions as communication interfaces through the information perception, decoding, and conveying process. However, it is still challenging to obtain a sensor that can convert detectable signals into multiple outputs for convenient, efficient, cryptic, and high-capacity information transmission. Herein, we present a capacitive sensor of magnetic field based on a tilted flexible micromagnet array (t-FMA) as the proposed interaction interface. With the bidirectional bending capability of t-FMA actuated by magnetic torque, the sensor can recognize both the magnitude and orientation of magnetic field in real time with non-overlapping capacitance signals. The optimized sensor exhibits the high sensitivity of over 1.3 T^-1 and detection limit down to 1 mT with excellent durability. As a proof of concept, the sensor has been successfully demonstrated for convenient, efficient, and programmable interaction systems, e.g., touchless Morse code and Braille communication. The distinguishable recognition of the magnetic field orientation and magnitude further enables the sensor unit as a high-capacity transmitter for cryptic information interaction (e.g., encoded ID recognition) and multi-control instruction outputting. We believe that the proposed magnetic field sensor can open up a potential avenue for future applications including information communication, virtual reality device, and interactive robotics.

Review on the Integration of Microelectronics for E-Textile

Modern electronic textiles are moving towards flexible wearable textiles, so-called e-textiles that have micro-electronic elements embedded onto the textile fabric that can be used for varied classes of functionalities. There are different methods of integrating rigid microelectronic components into/onto textiles for the development of smart textiles, which include, but are not limited to, physical, mechanical, and chemical approaches. The integration systems must satisfy being flexible, lightweight, stretchable, and washable to offer a superior usability, comfortability, and non-intrusiveness. Furthermore, the resulting wearable garment needs to be breathable. In this review work, three levels of integration of the microelectronics into/onto the textile structures are discussed, the textile-adapted, the textile-integrated, and the textile-based integration. The textile-integrated and the textile-adapted e-textiles have failed to efficiently meet being flexible and washable. To overcome the above problems, researchers studied the integration of microelectronics into/onto textile at fiber or yarn level applying various mechanisms. Hence, a new method of integration, textile-based, has risen to the challenge due to the flexibility and washability advantages of the ultimate product. In general, the aim of this review is to provide a complete overview of the different interconnection methods of electronic components into/onto textile substrate.

Development of Real-Time Hand Gesture Recognition for Tabletop Holographic Display Interaction Using Azure Kinect

The use of human gesturing to interact with devices such as computers or smartphones has presented several problems. This form of interaction relies on gesture interaction technology such as Leap Motion from Leap Motion, Inc, which enables humans to use hand gestures to interact with a computer. The technology has excellent hand detection performance, and even allows simple games to be played using gestures. Another example is the contactless use of a smartphone to take a photograph by simply folding and opening the palm. Research on interaction with other devices via hand gestures is in progress. Similarly, studies on the creation of a hologram display from objects that actually exist are also underway. We propose a hand gesture recognition system that can control the Tabletop holographic display based on an actual object. The depth image obtained using the latest Time-of-Flight based depth camera Azure Kinect is used to obtain information about the hand and hand joints by using the deep-learning model CrossInfoNet. Using this information, we developed a real time system that defines and recognizes gestures indicating left, right, up, and down basic rotation, and zoom in, zoom out, and continuous rotation to the left and right.

Comparison of E-Textile Techniques and Materials for 3D Gesture Sensor with Boosted Electrode Design

There is an interest in new wearable solutions that can be directly worn on the curved human body or integrated into daily objects. Textiles offer properties that are suitable to be used as holders for electronics or sensors components. Many sensing technologies have been explored considering textiles substrates in combination with conductive materials in the last years. In this work, a novel solution of a gesture recognition touchless sensor is implemented with satisfactory results. Moreover, three manufacturing techniques have been considered as alternatives: screen-printing with conductive ink, embroidery with conductive thread and thermosealing with conductive fabric. The main critical parameters have been analyzed for each prototype including the sensitivity of the sensor, which is an important and specific parameter of this type of sensor. In addition, user validation has been performed, testing several gestures with different subjects. During the tests carried out, flick gestures obtained detection rates from 79% to 89% on average. Finally, in order to evaluate the stability and strength of the solutions, some tests have been performed to assess environmental variations and washability deteriorations. The obtained results are satisfactory regarding temperature and humidity variations. The washability tests revealed that, except for the screen-printing prototype, the sensors can be washed with minimum degradation.