1
|
Rukmini PG, Hegde RB, Basavarajappa BK, Bhat AK, Pujari AN, Gargiulo GD, Gunawardana U, Jan T, Naik GR. Recent Innovations in Footwear and the Role of Smart Footwear in Healthcare-A Survey. SENSORS (BASEL, SWITZERLAND) 2024; 24:4301. [PMID: 39001080 PMCID: PMC11243832 DOI: 10.3390/s24134301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Revised: 06/16/2024] [Accepted: 06/27/2024] [Indexed: 07/16/2024]
Abstract
Smart shoes have ushered in a new era of personalised health monitoring and assistive technologies. Smart shoes leverage technologies such as Bluetooth for data collection and wireless transmission, and incorporate features such as GPS tracking, obstacle detection, and fitness tracking. As the 2010s unfolded, the smart shoe landscape diversified and advanced rapidly, driven by sensor technology enhancements and smartphones' ubiquity. Shoes have begun incorporating accelerometers, gyroscopes, and pressure sensors, significantly improving the accuracy of data collection and enabling functionalities such as gait analysis. The healthcare sector has recognised the potential of smart shoes, leading to innovations such as shoes designed to monitor diabetic foot ulcers, track rehabilitation progress, and detect falls among older people, thus expanding their application beyond fitness into medical monitoring. This article provides an overview of the current state of smart shoe technology, highlighting the integration of advanced sensors for health monitoring, energy harvesting, assistive features for the visually impaired, and deep learning for data analysis. This study discusses the potential of smart footwear in medical applications, particularly for patients with diabetes, and the ongoing research in this field. Current footwear challenges are also discussed, including complex construction, poor fit, comfort, and high cost.
Collapse
Affiliation(s)
- Pradyumna G. Rukmini
- Department of Electronics & Communication Engineering, NMAM Institute Technology, NITTE (Deemed to be University), Nitte 574110, India; (P.G.R.); (R.B.H.); (B.K.B.); (A.K.B.)
| | - Roopa B. Hegde
- Department of Electronics & Communication Engineering, NMAM Institute Technology, NITTE (Deemed to be University), Nitte 574110, India; (P.G.R.); (R.B.H.); (B.K.B.); (A.K.B.)
| | - Bommegowda K. Basavarajappa
- Department of Electronics & Communication Engineering, NMAM Institute Technology, NITTE (Deemed to be University), Nitte 574110, India; (P.G.R.); (R.B.H.); (B.K.B.); (A.K.B.)
| | - Anil Kumar Bhat
- Department of Electronics & Communication Engineering, NMAM Institute Technology, NITTE (Deemed to be University), Nitte 574110, India; (P.G.R.); (R.B.H.); (B.K.B.); (A.K.B.)
| | - Amit N. Pujari
- School of Physics, Engineering and Computer Science, University of Hertfordshire, Hertfordshire AL10 9AB, UK;
- School of Engineering, University of Aberdeen, Aberdeen AB24 3FX, UK
| | - Gaetano D. Gargiulo
- School of Engineering, Design and Built Environment, Western Sydney University, Penrith, NSW 2751, Australia; (G.D.G.); (U.G.)
- The MARCS Institute for Brain, Behaviour, and Development, Western Sydney University, Penrith, NSW 2751, Australia
- Translational Health Research Institute, Western Sydney University, Penrith, NSW 2751, Australia
- The Ingham Institute for Applied Medical Research, Liverpool, NSW 2170, Australia
| | - Upul Gunawardana
- School of Engineering, Design and Built Environment, Western Sydney University, Penrith, NSW 2751, Australia; (G.D.G.); (U.G.)
| | - Tony Jan
- Centre for Artificial Intelligence Research and Optimization (AIRO), Design and Creative Technology Vertical, Torrens University, Ultimo, NSW 2007, Australia;
| | - Ganesh R. Naik
- Centre for Artificial Intelligence Research and Optimization (AIRO), Design and Creative Technology Vertical, Torrens University, Ultimo, NSW 2007, Australia;
- College of Medicine and Public Health, Flinders University, Adelaide, SA 5042, Australia
- Design and Creative Technology Vertical, Torrens University, Wakefield Street, Adelaide, SA 5000, Australia
| |
Collapse
|
2
|
Chen L, Xia C, Zhao Z, Fu H, Chen Y. AI-Driven Sensing Technology: Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:2958. [PMID: 38793814 PMCID: PMC11125233 DOI: 10.3390/s24102958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2024] [Revised: 04/30/2024] [Accepted: 05/04/2024] [Indexed: 05/26/2024]
Abstract
Machine learning and deep learning technologies are rapidly advancing the capabilities of sensing technologies, bringing about significant improvements in accuracy, sensitivity, and adaptability. These advancements are making a notable impact across a broad spectrum of fields, including industrial automation, robotics, biomedical engineering, and civil infrastructure monitoring. The core of this transformative shift lies in the integration of artificial intelligence (AI) with sensor technology, focusing on the development of efficient algorithms that drive both device performance enhancements and novel applications in various biomedical and engineering fields. This review delves into the fusion of ML/DL algorithms with sensor technologies, shedding light on their profound impact on sensor design, calibration and compensation, object recognition, and behavior prediction. Through a series of exemplary applications, the review showcases the potential of AI algorithms to significantly upgrade sensor functionalities and widen their application range. Moreover, it addresses the challenges encountered in exploiting these technologies for sensing applications and offers insights into future trends and potential advancements.
Collapse
Affiliation(s)
| | | | | | - Haoran Fu
- Department of Civil Engineering, Zhejiang University, Hangzhou 310058, China; (L.C.); (C.X.); (Z.Z.)
| | | |
Collapse
|
3
|
Moore SR, Martinez A, Kröll J, Strutzenberger G, Schwameder H. Simple foot strike angle calculation from three-dimensional kinematics: A methodological comparison. J Sports Sci 2022; 40:1343-1350. [DOI: 10.1080/02640414.2022.2080162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Stephanie R. Moore
- Department of Sport and Exercise Science, University of Salzburg, Salzburg, Austria
| | - Aaron Martinez
- Department of Sport and Exercise Science, University of Salzburg, Salzburg, Austria
- Red Bull Athlete Performance Center, Thalgau, Austria
| | - Josef Kröll
- Department of Sport and Exercise Science, University of Salzburg, Salzburg, Austria
| | - Gerda Strutzenberger
- Research Unit for Orthopaedic Sports Medicine and Injury Prevention, Institute for Sports Medicine, Alpine Medicine and Health Tourism, Private University for Health Sciences, Hall, Austria
- MOTUM Human Performance Institute, Innsbruck, Austria
| | - Hermann Schwameder
- Department of Sport and Exercise Science, University of Salzburg, Salzburg, Austria
| |
Collapse
|
4
|
Tan T, Strout ZA, Cheung RT, Shull PB. Strike index estimation using a convolutional neural network with a single, shoe-mounted inertial sensor. J Biomech 2022; 139:111145. [DOI: 10.1016/j.jbiomech.2022.111145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 05/06/2022] [Accepted: 05/06/2022] [Indexed: 10/18/2022]
|
5
|
Machine Learning for Healthcare Wearable Devices: The Big Picture. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:4653923. [PMID: 35480146 PMCID: PMC9038375 DOI: 10.1155/2022/4653923] [Citation(s) in RCA: 30] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 03/22/2022] [Indexed: 02/07/2023]
Abstract
Using artificial intelligence and machine learning techniques in healthcare applications has been actively researched over the last few years. It holds promising opportunities as it is used to track human activities and vital signs using wearable devices and assist in diseases' diagnosis, and it can play a great role in elderly care and patient's health monitoring and diagnostics. With the great technological advances in medical sensors and miniaturization of electronic chips in the recent five years, more applications are being researched and developed for wearable devices. Despite the remarkable growth of using smart watches and other wearable devices, a few of these massive research efforts for machine learning applications have found their way to market. In this study, a review of the different areas of the recent machine learning research for healthcare wearable devices is presented. Different challenges facing machine learning applications on wearable devices are discussed. Potential solutions from the literature are presented, and areas open for improvement and further research are highlighted.
Collapse
|
6
|
Anderson W, Choffin Z, Jeong N, Callihan M, Jeong S, Sazonov E. Empirical Study on Human Movement Classification Using Insole Footwear Sensor System and Machine Learning. SENSORS 2022; 22:s22072743. [PMID: 35408358 PMCID: PMC9003281 DOI: 10.3390/s22072743] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 03/25/2022] [Accepted: 03/29/2022] [Indexed: 02/04/2023]
Abstract
This paper presents a plantar pressure sensor system (P2S2) integrated in the insoles of shoes to detect thirteen commonly used human movements including walking, stooping left and right, pulling a cart backward, squatting, descending, ascending stairs, running, and falling (front, back, right, left). Six force sensitive resistors (FSR) sensors were positioned on critical pressure points on the insoles to capture the electrical signature of pressure change in the various movements. A total of 34 adult participants were tested with the P2S2. The pressure data were collected and processed using a Principal Component Analysis (PCA) for input to the multiple machine learning (ML) algorithms, including k-NN, neural network and Support-Vector Machine (SVM) algorithms. The ML models were trained using four-fold cross-validation. Each fold kept subject data independent from other folds. The model proved effective with an accuracy of 86%, showing a promising result in predicting human movements using the P2S2 integrated in shoes.
Collapse
Affiliation(s)
- Wolfe Anderson
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA; (W.A.); (Z.C.); (E.S.)
| | - Zachary Choffin
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA; (W.A.); (Z.C.); (E.S.)
| | - Nathan Jeong
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA; (W.A.); (Z.C.); (E.S.)
- Correspondence: ; Tel.: +1-(205)-348-4820
| | - Michael Callihan
- College of Nursing, The University of Alabama, Tuscaloosa, AL 35487, USA;
| | - Seongcheol Jeong
- Department of Electrical Engineering, Pohang University of Science and Technology, Pohang 37673, Korea;
| | - Edward Sazonov
- Department of Electrical and Computer Engineering, The University of Alabama, Tuscaloosa, AL 35487, USA; (W.A.); (Z.C.); (E.S.)
| |
Collapse
|
7
|
Joo H, Kim H, Ryu JK, Ryu S, Lee KM, Kim SC. Estimation of Fine-Grained Foot Strike Patterns with Wearable Smartwatch Devices. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19031279. [PMID: 35162308 PMCID: PMC8835219 DOI: 10.3390/ijerph19031279] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 01/19/2022] [Accepted: 01/21/2022] [Indexed: 12/14/2022]
Abstract
People who exercise may benefit or be injured depending on their foot striking (FS) style. In this study, we propose an intelligent system that can recognize subtle differences in FS patterns while walking and running using measurements from a wearable smartwatch device. Although such patterns could be directly measured utilizing pressure distribution of feet while striking on the ground, we instead focused on analyzing hand movements by assuming that striking patterns consequently affect temporal movements of the whole body. The advantage of the proposed approach is that FS patterns can be estimated in a portable and less invasive manner. To this end, first, we developed a wearable system for measuring inertial movements of hands and then conducted an experiment where participants were asked to walk and run while wearing a smartwatch. Second, we trained and tested the captured multivariate time series signals in supervised learning settings. The experimental results obtained demonstrated high and robust classification performances (weighted-average F1 score > 90%) when recent deep neural network models, such as 1D-CNN and GRUs, were employed. We conclude this study with a discussion of potential future work and applications that increase benefits while walking and running properly using the proposed approach.
Collapse
Affiliation(s)
- Hyeyeoun Joo
- Interdisciplinary Program in Cognitive Science, Seoul National University, Seoul 08826, Korea; (H.J.); (K.-M.L.)
| | - Hyejoo Kim
- Machine Learning Systems Laboratory, Department of Sports Science, Sungkyunkwan University, Suwon 16419, Korea;
| | - Jeh-Kwang Ryu
- Department of Physical Education, College of Education, Dongguk University, Seoul 04620, Korea;
| | - Semin Ryu
- Intelligent Robotics Laboratory, School of Artificial Intelligence Convergence, Hallym University, Chuncheon 24252, Korea;
| | - Kyoung-Min Lee
- Interdisciplinary Program in Cognitive Science, Seoul National University, Seoul 08826, Korea; (H.J.); (K.-M.L.)
| | - Seung-Chan Kim
- Machine Learning Systems Laboratory, Department of Sports Science, Sungkyunkwan University, Suwon 16419, Korea;
- Correspondence: ; Tel.: +82-31-299-6918
| |
Collapse
|
8
|
Aznar-Gimeno R, Labata-Lezaun G, Adell-Lamora A, Abadía-Gallego D, del-Hoyo-Alonso R, González-Muñoz C. Deep Learning for Walking Behaviour Detection in Elderly People Using Smart Footwear. ENTROPY 2021; 23:e23060777. [PMID: 34205259 PMCID: PMC8235668 DOI: 10.3390/e23060777] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 06/05/2021] [Accepted: 06/15/2021] [Indexed: 12/18/2022]
Abstract
The increase in the proportion of elderly in Europe brings with it certain challenges that society needs to address, such as custodial care. We propose a scalable, easily modulated and live assistive technology system, based on a comfortable smart footwear capable of detecting walking behaviour, in order to prevent possible health problems in the elderly, facilitating their urban life as independently and safety as possible. This brings with it the challenge of handling the large amounts of data generated, transmitting and pre-processing that information and analysing it with the aim of obtaining useful information in real/near-real time. This is the basis of information theory. This work presents a complete system aiming at elderly people that can detect different user behaviours/events (sitting, standing without imbalance, standing with imbalance, walking, running, tripping) through information acquired from 20 types of sensor measurements (16 piezoelectric pressure sensors, one accelerometer returning reading for the 3 axis and one temperature sensor) and warn the relatives about possible risks in near-real time. For the detection of these events, a hierarchical structure of cascading binary models is designed and applied using artificial neural network (ANN) algorithms and deep learning techniques. The best models are achieved with convolutional layered ANN and multilayer perceptrons. The overall event detection performance achieves an average accuracy and area under the ROC curve of 0.84 and 0.96, respectively.
Collapse
|