1
|
Duncanson KA, Horst F, Abbasnejad E, Hanly G, Robertson WSP, Thewlis D. Modelling individual variation in human walking gait across populations and walking conditions via gait recognition. J R Soc Interface 2024; 21:20240565. [PMID: 39657792 PMCID: PMC11631418 DOI: 10.1098/rsif.2024.0565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2024] [Revised: 10/15/2024] [Accepted: 11/01/2024] [Indexed: 12/12/2024] Open
Abstract
Human walking gait is a personal story written by the body, a tool for understanding biological identity in healthcare and security. Gait analysis methods traditionally diverged between these domains but are now merging their complementary strengths to unlock new possibilities. Using large ground reaction force (GRF) datasets for gait recognition is a way to uncover subtle variations that define individual gait patterns. Previously, this was done by developing and evaluating machine learning models on the same individuals or the same dataset, potentially biasing findings towards population samples or walking conditions. This study introduces a new method for analysing gait variation across individuals, groups and datasets to explore how demographics and walking conditions shape individual gait patterns. Machine learning models were implemented using numerous configurations of four large walking GRF datasets from different countries (740 individuals, 7400 samples) and analysed using explainable artificial intelligence tools. Recognition accuracy ranged from 52 to 100%, with factors like footwear, walking speed and body mass playing interactive roles in defining gait. Models developed with individuals walking in personal footwear at multiple speeds effectively recognized novel individuals across populations and conditions (89-99% accuracy). Integrating force platform hardware and gait recognition software could be invaluable for reading the complex stories of human walking.
Collapse
Affiliation(s)
- Kayne A. Duncanson
- Adelaide Medical School, The University of Adelaide, Adelaide5005, Australia
| | - Fabian Horst
- Department of Training and Movement Science, Johannes Gutenberg-University, Mainz55122, Germany
| | - Ehsan Abbasnejad
- Australian Institute for Machine Learning, The University of Adelaide, Adelaide5000, Australia
| | - Gary Hanly
- Information Sciences Division, Defence Science and Technology Group, Edinburgh5111, Australia
| | - William S. P. Robertson
- School of Electrical and Mechanical Engineering, The University of Adelaide, Adelaide5005, Australia
| | - Dominic Thewlis
- Adelaide Medical School, The University of Adelaide, Adelaide5005, Australia
| |
Collapse
|
2
|
Derlatka M, Parfieniuk M. Real-world measurements of ground reaction forces of normal gait of young adults wearing various footwear. Sci Data 2023; 10:60. [PMID: 36717573 PMCID: PMC9886849 DOI: 10.1038/s41597-023-01964-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Accepted: 01/12/2023] [Indexed: 01/31/2023] Open
Abstract
For years, researchers have been recognizing patterns in gait for purposes of medical diagnostics, rehabilitation, and biometrics. A method for observing gait is to measure ground reaction forces (GRFs) between the foot and solid plate with tension sensors. The presented dataset consists of 13,702 measurements of bipedal GRFs of one step of normal gait of 324 students wearing shoes of various types. Each measurement includes raw digital signals of two force plates. A signal comprises stance-related samples but also preceding and following ones, in which one can observe noise, interferences, and artifacts caused by imperfections of devices and walkway. Such real-world time series can be used to study methods for detecting foot-strike and foot-off events, and for coping with artifacts. For user convenience, processed data are also available, which describe only the stance phase of gait and form ready-to-use patterns suitable for experiments in GRF-based recognition of persons and footwear, and for generating synthetic GRF waveforms. The dataset is accompanied by Matlab and Python programs for organizing and validating data.
Collapse
Affiliation(s)
- Marcin Derlatka
- Bialystok University of Technology, Faculty of Mechanical Engineering, Bialystok, Poland.
| | - Marek Parfieniuk
- University of Bialystok, Institute of Computer Science, Bialystok, Poland.
| |
Collapse
|
3
|
Derlatka M, Borowska M. Ensemble of Heterogeneous Base Classifiers for Human Gait Recognition. SENSORS (BASEL, SWITZERLAND) 2023; 23:508. [PMID: 36617105 PMCID: PMC9824449 DOI: 10.3390/s23010508] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 12/23/2022] [Accepted: 12/26/2022] [Indexed: 06/17/2023]
Abstract
Human gait recognition is one of the most interesting issues within the subject of behavioral biometrics. The most significant problems connected with the practical application of biometric systems include their accuracy as well as the speed at which they operate, understood both as the time needed to recognize a particular person as well as the time necessary to create and train a biometric system. The present study made use of an ensemble of heterogeneous base classifiers to address these issues. A Heterogeneous ensemble is a group of classification models trained using various algorithms and combined to output an effective recognition A group of parameters identified on the basis of ground reaction forces was accepted as input signals. The proposed solution was tested on a sample of 322 people (5980 gait cycles). Results concerning the accuracy of recognition (meaning the Correct Classification Rate quality at 99.65%), as well as operation time (meaning the time of model construction at <12.5 min and the time needed to recognize a person at <0.1 s), should be considered as very good and exceed in quality other methods so far described in the literature.
Collapse
|
4
|
Jamari J, Ammarullah MI, Santoso G, Sugiharto S, Supriyono T, Permana MS, Winarni TI, van der Heide E. Adopted walking condition for computational simulation approach on bearing of hip joint prosthesis: review over the past 30 years. Heliyon 2022; 8:e12050. [PMID: 36506403 PMCID: PMC9730145 DOI: 10.1016/j.heliyon.2022.e12050] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 07/23/2022] [Accepted: 11/24/2022] [Indexed: 12/11/2022] Open
Abstract
Bearing on artificial hip joint experiences friction, wear, and surface damage that impact on overall performance and leading to failure at a particular time due to continuous contact that endangers the user. Assessing bearing hip joint using clinical study, experimental testing, and mathematical formula approach is challenging because there are some obstacles from each approach. Computational simulation is an effective alternative approach that is affordable, relatively fast, and more accessible than other approaches in examining various complex conditions requiring extensive resources and several different parameters. In particular, different gait cycles affect the sliding distance and distribution of gait loading acting on the joints. Appropriate selection and addition of gait cycles in computation modelling are crucial for accurate and reliable prediction and analysis of bearing performance such as wear a failure of implants. However, a wide spread of gait cycles and loading data are being considered and studied by researchers as reported in literature. The current article describes a comprehensive literature review adopted walking condition that has been carried out to study bearing using computational simulation approach over the past 30 years. Many knowledge gaps related to adoption procedures, simplification, and future research have been identified to obtain bearing analysis results with more realistic computational simulation approach according to physiological human hip joints.
Collapse
Affiliation(s)
- J. Jamari
- Department of Mechanical Engineering, Faculty of Engineering, Diponegoro University, Semarang 50275, Central Java, Indonesia
- Undip Biomechanics Engineering & Research Centre (UBM-ERC), Diponegoro University, Semarang 50275, Central Java, Indonesia
| | - Muhammad Imam Ammarullah
- Undip Biomechanics Engineering & Research Centre (UBM-ERC), Diponegoro University, Semarang 50275, Central Java, Indonesia
- Department of Mechanical Engineering, Faculty of Engineering, Pasundan University, Bandung 40153, West Java, Indonesia
- Biomechanics and Biomedics Engineering Research Centre, Pasundan University, Bandung 40153, West Java, Indonesia
| | - Gatot Santoso
- Department of Mechanical Engineering, Faculty of Engineering, Pasundan University, Bandung 40153, West Java, Indonesia
- Biomechanics and Biomedics Engineering Research Centre, Pasundan University, Bandung 40153, West Java, Indonesia
| | - S. Sugiharto
- Department of Mechanical Engineering, Faculty of Engineering, Pasundan University, Bandung 40153, West Java, Indonesia
- Biomechanics and Biomedics Engineering Research Centre, Pasundan University, Bandung 40153, West Java, Indonesia
| | - Toto Supriyono
- Department of Mechanical Engineering, Faculty of Engineering, Pasundan University, Bandung 40153, West Java, Indonesia
- Biomechanics and Biomedics Engineering Research Centre, Pasundan University, Bandung 40153, West Java, Indonesia
| | - Muki Satya Permana
- Department of Mechanical Engineering, Faculty of Engineering, Pasundan University, Bandung 40153, West Java, Indonesia
- Biomechanics and Biomedics Engineering Research Centre, Pasundan University, Bandung 40153, West Java, Indonesia
| | - Tri Indah Winarni
- Undip Biomechanics Engineering & Research Centre (UBM-ERC), Diponegoro University, Semarang 50275, Central Java, Indonesia
- Department of Anatomy, Faculty of Medicine, Diponegoro University, Semarang 50275, Central Java, Indonesia
- Center for Biomedical Research (CEBIOR), Faculty of Medicine, Diponegoro University, Semarang 50275, Central Java, Indonesia
| | - Emile van der Heide
- Department of Mechanics of Solids, Surfaces & Systems (MS3), Faculty of Engineering Technology, University of Twente, P.O. Box 217, 7500 AE Enschede, the Netherlands
- Laboratory for Surface Technology and Tribology, Faculty of Engineering Technology, University of Twente, Postbox 217, 7500 AE Enschede, the Netherlands
| |
Collapse
|
5
|
Bożko A, Ambroziak L. Influence of Insufficient Dataset Augmentation on IoU and Detection Threshold in CNN Training for Object Detection on Aerial Images. SENSORS (BASEL, SWITZERLAND) 2022; 22:9080. [PMID: 36501781 PMCID: PMC9740240 DOI: 10.3390/s22239080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 11/18/2022] [Accepted: 11/21/2022] [Indexed: 06/17/2023]
Abstract
The objects and events detection tasks are being performed progressively often by robotic systems like unmanned aerial vehicles (UAV) or unmanned surface vehicles (USV). Autonomous operations and intelligent sensing are becoming standard in numerous scenarios such as supervision or even search and rescue (SAR) missions. The low cost of autonomous vehicles, vision sensors and portable computers allows the incorporation of the deep learning, mainly convolutional neural networks (CNN) in these solutions. Many systems meant for custom purposes rely on insufficient training datasets, what may cause a decrease of effectiveness. Moreover, the system's accuracy is usually dependent on the returned bounding boxes highlighting the supposed targets. In desktop applications, precise localisation might not be particularly relevant; however, in real situations, with low visibility and non-optimal camera orientation, it becomes crucial. One of the solutions for dataset enhancement is its augmentation. The presented work is an attempt to evaluate the influence of the training images augmentation on the detection parameters important for the effectiveness of neural networks in the context of object detection. In this research, network appraisal relies on the detection confidence and bounding box prediction accuracy (IoU). All the applied image modifications were simple pattern and colour alterations. The obtained results imply that there is a measurable impact of the augmentation process on the localisation accuracy. It was concluded that a positive or negative influence is related to the complexity and variability of the objects classes.
Collapse
|
6
|
Bębas E, Borowska M, Derlatka M, Oczeretko E, Hładuński M, Szumowski P, Mojsak M. Machine-learning-based classification of the histological subtype of non-small-cell lung cancer using MRI texture analysis. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102446] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
7
|
Li X, Zhou Z, Wu J, Xiong Y. Human Posture Detection Method Based on Wearable Devices. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:8879061. [PMID: 33833862 PMCID: PMC8016574 DOI: 10.1155/2021/8879061] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 11/20/2020] [Accepted: 03/14/2021] [Indexed: 12/04/2022]
Abstract
The dynamic detection of human motion is important, which is widely applied in the fields of motion state capture and rehabilitation engineering. In this study, based on multimodal information of surface electromyography (sEMG) signals of upper limb and triaxial acceleration and plantar pressure signals of lower limb, the effective virtual driving control and gait recognition methods were proposed. The effective way of wearable human posture detection was also constructed. Firstly, the moving average window and threshold comparison were used to segment the sEMG signals of the upper limb. The standard deviation and singular values of wavelet coefficients were extracted as the features. After the training and classification by optimized support vector machine (SVM) algorithm, the real-time detection and analysis of three virtual driving actions were performed. The average identification accuracy was 90.90%. Secondly, the mean, standard deviation, variance, and wavelet energy spectrum of triaxial acceleration were extracted, and these parameters were combined with plantar pressure as the gait features. The optimized SVM was selected for the gait identification, and the average accuracy was 90.48%. The experimental results showed that, through different combinations of wearable sensors on the upper and lower limbs, the motion posture information could be dynamically detected, which could be used in the design of virtual rehabilitation system and walking auxiliary system.
Collapse
Affiliation(s)
- Xiaoou Li
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China
| | - Zhiyong Zhou
- School of Design and Art, Shanghai Dianji University, Shanghai 200240, China
| | - Jiajia Wu
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China
| | - Yichao Xiong
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China
| |
Collapse
|
8
|
Recurrent Neural Network for Inertial Gait User Recognition in Smartphones. SENSORS 2019; 19:s19184054. [PMID: 31546976 PMCID: PMC6767850 DOI: 10.3390/s19184054] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Revised: 09/05/2019] [Accepted: 09/12/2019] [Indexed: 11/17/2022]
Abstract
In this article, a gait recognition algorithm is presented based on the information obtained from inertial sensors embedded in a smartphone, in particular, the accelerometers and gyroscopes typically embedded on them. The algorithm processes the signal by extracting gait cycles, which are then fed into a Recurrent Neural Network (RNN) to generate feature vectors. To optimize the accuracy of this algorithm, we apply a random grid hyperparameter selection process followed by a hand-tuning method to reach the final hyperparameter configuration. The different configurations are tested on a public database with 744 users and compared with other algorithms that were previously tested on the same database. After reaching the best-performing configuration for our algorithm, we obtain an equal error rate (EER) of 11.48% when training with only 20% of the users. Even better, when using 70% of the users for training, that value drops to 7.55%. The system manages to improve on state-of-the-art methods, but we believe the algorithm could reach a significantly better performance if it was trained with more visits per user. With a large enough database with several visits per user, the algorithm could improve substantially.
Collapse
|
9
|
Kozlow P, Abid N, Yanushkevich S. Gait Type Analysis Using Dynamic Bayesian Networks. SENSORS 2018; 18:s18103329. [PMID: 30287787 PMCID: PMC6210198 DOI: 10.3390/s18103329] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/26/2018] [Revised: 09/20/2018] [Accepted: 09/28/2018] [Indexed: 11/30/2022]
Abstract
This paper focuses on gait abnormality type identification—specifically, recognizing antalgic gait. Through experimentation, we demonstrate that detecting an individual’s gait type is a viable biometric that can be used along with other common biometrics for applications such as forensics. To classify gait, the gait data is represented by coordinates that reflect the body joint coordinates obtained using a Microsoft Kinect v2 system. Features such as cadence, stride length, and other various joint angles are extracted from the input data. Using approaches such as the dynamic Bayesian network, the obtained features are used to model as well as perform gait type classification. The proposed approach is compared with other classification techniques and experimental results reveal that it is capable of obtaining a 88.68% recognition rate. The results illustrate the potential of using a dynamic Bayesian network for gait abnormality classification.
Collapse
Affiliation(s)
- Patrick Kozlow
- Department of Electrical and Computer Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB T2N 1N4, Canada.
| | - Noor Abid
- Department of Electrical and Computer Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB T2N 1N4, Canada.
| | - Svetlana Yanushkevich
- Department of Electrical and Computer Engineering, Schulich School of Engineering, University of Calgary, Calgary, AB T2N 1N4, Canada.
| |
Collapse
|