Bimodal Intelligent Electronic Skin Based on Proximity and Tactile Interaction for Pressure and Configuration Perception

The flexible bimodal e-skin exhibits significant promise for integration into the next iteration of human-computer interactions, owing to the integration of tactile and proximity perception. However, those challenges, such as low tactile sensitivity, complex fabrication processes, and incompatibility with bimodal interactions, have restricted the widespread adoption of bimodal e-skin. Herein, a bimodal capacitive e-skin capable of simultaneous tactile and proximity sensing has been developed. The entire process eliminates intricate fabrication techniques, employing DLP-3D printing for the electrode layers and sacrificial templating for the dielectric layers, conferring high tactile sensitivity (1.672 kPa-1) and rapid response capability (∼30 ms) to the bimodal e-skin. Moreover, exploiting the "fringing electric field" effect inherent in parallel-plate capacitors has facilitated touchless sensing, thereby enabling static distance recognition and dynamic gesture recognition of varying materials. Interestingly, an e-skin sensing array was created to identify the positions and pressure levels of various objects of different masses. Furthermore, with the aid of machine learning techniques, an artificial neural network has been established to possess intelligent object recognition capabilities, facilitating the identification, classification, and training of various object configurations. The advantages of the bimodal e-skin render it highly promising for extensive applications in the field of next-generation human-machine interaction.

Touchless Artificial Perception beyond Fingertip Probing

Touchless perception technology allows us to acquire information beyond the contact interfaces, making it ideal for scenarios where physical engagements are not possible. Unlike tactile devices, which have so far achieved impressive results, touchless strategies are fascinating yet underdeveloped. We envisage that touchless technologies could be powerful supplements to current haptics. In this Perspective, we include emerging touchless electronics, aiming to provide a broader and comprehensive picture toward artificial perceptual realm. We overview popular touchless protocols, sketch what could be detected by touchless probing, and summarize their latest spectacular achievements. In addition, we present the promises and challenges posed by touchless technologies and discuss possible directions for their future deployments.

Development of an Interactive Touchless Technology Based on Static-Electricity-Induced Luminescence

Touchless technology has garnered significant interest in recent years because of its effectiveness in combating infectious diseases such as the novel coronavirus (COVID-19). The goal of this study was to develop an inexpensive and high-precision touchless technology. A base substrate was coated with a luminescent material that emitted static-electricity-induced luminescence (SEL), and it was applied at high voltage. An inexpensive web camera was used to verify the relationship between the non-contact distance to a needle and the applied-voltage-triggered luminescence. The SEL was emitted at 20-200 mm from the luminescent device upon voltage application, and the web camera detected the SEL position with an accuracy of less than 1 mm. We used this developed touchless technology to demonstrate a highly accurate real-time detection of the position of a human finger based on SEL.

GaVe: A Webcam-Based Gaze Vending Interface Using One-Point Calibration

Gaze input, i.e., information input via eye of users, represents a promising method for contact- free interaction in human-machine systems. In this paper, we present the GazeVending interface (GaVe), which lets users control actions on a display with their eyes. The interface works on a regular webcam, available on most of today's laptops, and only requires a short one-point calibration before use. GaVe is designed in a hierarchical structure, presenting broad item cluster to users first and subsequently guiding them through another selection round, which allows the presentation of a large number of items. Cluster/item selection in GaVe is based on the dwell time, i.e., the time duration that users look at a given Cluster/ item. A user study (N=22) was conducted to test optimal dwell time thresholds and comfortable human-to-display distances. Users' perception of the system, as well as error rates and task completion time were registered. We found that all participants were able to quickly understand and know how to interact with the interface, and showed good performance, selecting a target item within a group of 12 items in 6.76 seconds on average. We provide design guidelines for GaVe and discuss the potentials of the system.

Comparison of E-Textile Techniques and Materials for 3D Gesture Sensor with Boosted Electrode Design

There is an interest in new wearable solutions that can be directly worn on the curved human body or integrated into daily objects. Textiles offer properties that are suitable to be used as holders for electronics or sensors components. Many sensing technologies have been explored considering textiles substrates in combination with conductive materials in the last years. In this work, a novel solution of a gesture recognition touchless sensor is implemented with satisfactory results. Moreover, three manufacturing techniques have been considered as alternatives: screen-printing with conductive ink, embroidery with conductive thread and thermosealing with conductive fabric. The main critical parameters have been analyzed for each prototype including the sensitivity of the sensor, which is an important and specific parameter of this type of sensor. In addition, user validation has been performed, testing several gestures with different subjects. During the tests carried out, flick gestures obtained detection rates from 79% to 89% on average. Finally, in order to evaluate the stability and strength of the solutions, some tests have been performed to assess environmental variations and washability deteriorations. The obtained results are satisfactory regarding temperature and humidity variations. The washability tests revealed that, except for the screen-printing prototype, the sensors can be washed with minimum degradation.

A Wearable Textile 3D Gesture Recognition Sensor Based on Screen-Printing Technology

Research has developed various solutions in order for computers to recognize hand gestures in the context of human machine interface (HMI). The design of a successful hand gesture recognition system must address functionality and usability. The gesture recognition market has evolved from touchpads to touchless sensors, which do not need direct contact. Their application in textiles ranges from the field of medical environments to smart home applications and the automotive industry. In this paper, a textile capacitive touchless sensor has been developed by using screen-printing technology. Two different designs were developed to obtain the best configuration, obtaining good results in both cases. Finally, as a real application, a complete solution of the sensor with wireless communications is presented to be used as an interface for a mobile phone.

Design and evaluation of an eye tracking support system for the scrub nurse

BACKGROUND

The availability of an increasing number of medical devices in the digital operating room has led to increased interaction demands of the surgical staff. To counteract the risk of bacterial contamination induced by device interactions, touchless interaction techniques are required. Support systems based on eye tracking enable interaction while maintaining sterility and freeing the hands to manipulate surgical instruments.

METHODS

A system using eye tracking glasses was developed. In an evaluation, participants completed tasks using gaze gestures. Three use cases were evaluated in an intraoperative setup. System performance, user acceptance, and workload were measured.

RESULTS

The system was evaluated in a laboratory environment with 26 participants. The precision of the gaze gesture recognition is 97.9%, and the true positive rate is 98.5%. The participants rated the system useful and were satisfied.

CONCLUSIONS

Touchless interaction ensures sterility, although the increasing availability of medical devices in the operating room.

Ultrahigh Sensitive and Flexible Magnetoelectronics with Magnetic Nanocomposites: Toward an Additional Perception of Artificial Intelligence

In recent years, flexible magnetoelectronics has attracted a great attention for its intriguing functionalities and potential applications, such as healthcare, memory, soft robots, navigation, and touchless human-machine interaction systems. Here, we provide the first attempt to demonstrate a new type of magneto-piezoresistance device, which possesses an ultrahigh sensitivity with several orders of resistance change under an external magnetic field (100 mT). In our device, Fe-Ni alloy powders are embedded in the silver nanowire-coated micropyramid polydimethylsiloxane films. Our devices can not only serve as an on/off switch but also act as a sensor that can detect different magnetic fields because of its ultrahigh sensitivity, which is very useful for the application in analog signal communication. Moreover, our devices contain several key features, including large-area and easy fabrication processes, fast response time, low working voltage, low power consumption, excellent flexibility, and admirable compatibility onto a freeform surface, which are the critical criteria for the future development of touchless human-machine interaction systems. On the basis of all of these unique characteristics, we have demonstrated a nontouch piano keyboard, instantaneous magnetic field visualization, and autonomous power system, making our new devices be integrable with magnetic field and enable to be implemented into our daily life applications with unfamiliar human senses. Our approach therefore paves a useful route for the development of wearable electronics and intelligent systems.

Cell/tissue processing information system for regenerative medicine

When conducting clinical studies of regenerative medicine, compliance to good manufacturing practice (GMP) is mandatory, and thus much time is needed for manufacturing and quality management. It is therefore desired to introduce the manufacturing execution system (MES), which is being adopted by factories manufacturing pharmaceutical products. Meanwhile, in manufacturing human cell/tissue processing autologous products, it is necessary to protect patients' personal information, prevent patients from being identified and obtain information for cell/tissue identification. We therefore considered it difficult to adopt conventional MES to regenerative medicine-related clinical trials, and so developed novel software for production/quality management to be used in cell-processing centres (CPCs), conforming to GMP. Since this system satisfies the requirements of regulations in Japan and the USA for electronic records and electronic signatures (ER/ES), the use of ER/ES has been allowed, and the risk of contamination resulting from the use of recording paper has been eliminated, thanks to paperless operations within the CPC. Moreover, to reduce the risk of mix-up and cross-contamination due to contact during production, we developed a touchless input device with built-in radio frequency identification (RFID) reader-writer devices and optical sensors. The use of this system reduced the time to prepare and issue manufacturing instructions by 50% or more, compared to the conventional handwritten system. The system contributes to producing more large-scale production and to reducing production costs for cell and tissue products in regenerative medicine. Copyright © 2014 John Wiley & Sons, Ltd.