1
|
Guo Y, Li K, Yue W, Kim NY, Li Y, Shen G, Lee JC. A Rapid Adaptation Approach for Dynamic Air-Writing Recognition Using Wearable Wristbands with Self-Supervised Contrastive Learning. NANO-MICRO LETTERS 2024; 17:41. [PMID: 39407061 PMCID: PMC11480301 DOI: 10.1007/s40820-024-01545-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2024] [Accepted: 09/23/2024] [Indexed: 10/19/2024]
Abstract
Wearable wristband systems leverage deep learning to revolutionize hand gesture recognition in daily activities. Unlike existing approaches that often focus on static gestures and require extensive labeled data, the proposed wearable wristband with self-supervised contrastive learning excels at dynamic motion tracking and adapts rapidly across multiple scenarios. It features a four-channel sensing array composed of an ionic hydrogel with hierarchical microcone structures and ultrathin flexible electrodes, resulting in high-sensitivity capacitance output. Through wireless transmission from a Wi-Fi module, the proposed algorithm learns latent features from the unlabeled signals of random wrist movements. Remarkably, only few-shot labeled data are sufficient for fine-tuning the model, enabling rapid adaptation to various tasks. The system achieves a high accuracy of 94.9% in different scenarios, including the prediction of eight-direction commands, and air-writing of all numbers and letters. The proposed method facilitates smooth transitions between multiple tasks without the need for modifying the structure or undergoing extensive task-specific training. Its utility has been further extended to enhance human-machine interaction over digital platforms, such as game controls, calculators, and three-language login systems, offering users a natural and intuitive way of communication.
Collapse
Affiliation(s)
- Yunjian Guo
- Department of Electronic Convergence Engineering, Kwangwoon University, Seoul, 01897, South Korea
| | - Kunpeng Li
- Department of Electronic Convergence Engineering, Kwangwoon University, Seoul, 01897, South Korea
| | - Wei Yue
- Radio Frequency Integrated Circuit (RFIC) Bio Centre, Kwangwoon University, Seoul, 01897, South Korea
- Department of Electronic Engineering, Kwangwoon University, Seoul, 01897, South Korea
| | - Nam-Young Kim
- Radio Frequency Integrated Circuit (RFIC) Bio Centre, Kwangwoon University, Seoul, 01897, South Korea
- Department of Electronic Engineering, Kwangwoon University, Seoul, 01897, South Korea
| | - Yang Li
- School of Microelectronics, Shandong University, Jinan, 250101, People's Republic of China.
- State Key Laboratory of Integrated Chips and Systems, Fudan University, Shanghai, 200433, People's Republic of China.
| | - Guozhen Shen
- School of Integrated Circuits and Electronics, Beijing Institute of Technology, Beijing, 100081, People's Republic of China.
| | - Jong-Chul Lee
- Department of Electronic Convergence Engineering, Kwangwoon University, Seoul, 01897, South Korea.
| |
Collapse
|
2
|
Ouyang W, Luo F, Yao Y, Qu B, Feng C, Xie Y, Chen B. A Triboelectric Sensor with Double Bubble Structure Applied in a High Security Double Lock System. ACS Sens 2023; 8:4615-4624. [PMID: 38063342 DOI: 10.1021/acssensors.3c01574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2023]
Abstract
With more attention on personal privacy and the need for a security defense, it is necessary to design an intelligent lock system with a higher security performance. Here, a novel high security double lock system integrating triboelectric nanogenerators (TENGs) with a double bubble structure (DB-TENG) and deep learning models is proposed. The TENG as a self-powered sensor is developed using silicone rubber and copper foil. By optimizing the thickness of the top layer film, surface microstructure, the size of the air bubble, and design of the double bubble structure, the sensitivity of the DB-TENG reaches 19.08 V/kPa. For the feasibility study, the sensor is fabricated to a smart belt to collect respiratory behaviors as a respiratory code. A Long Short-Term Memory network is adopted to identify four typical respiratory signals with an average accuracy of 97.00%. The system is deployed on a Raspberry Pi to determine whether the user is permitted through both the collected respiratory code and the related face image and will send an alarm message if one of the two does not match. It is worth mentioning that users can send alarm signals undiscovered by controlling their respiratory signals. Therefore, the proposed system has superb potential in security demanding environments.
Collapse
Affiliation(s)
- Wei Ouyang
- Chongqing Key Laboratory of Non-linear Circuit and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, Chongqing 400715, China
| | - Fangyuan Luo
- Chongqing Key Laboratory of Non-linear Circuit and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, Chongqing 400715, China
| | - Youbin Yao
- Chongqing Key Laboratory of Non-linear Circuit and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, Chongqing 400715, China
| | - Bingbing Qu
- Chongqing Key Laboratory of Non-linear Circuit and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, Chongqing 400715, China
| | - Changhao Feng
- Chongqing Key Laboratory of Non-linear Circuit and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, Chongqing 400715, China
| | - Yiyuan Xie
- Chongqing Key Laboratory of Non-linear Circuit and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, Chongqing 400715, China
| | - Bin Chen
- Chongqing Key Laboratory of Non-linear Circuit and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, Chongqing 400715, China
| |
Collapse
|