1
|
Yuhai O, Choi A, Cho Y, Kim H, Mun JH. Deep-Learning-Based Recovery of Missing Optical Marker Trajectories in 3D Motion Capture Systems. Bioengineering (Basel) 2024; 11:560. [PMID: 38927796 DOI: 10.3390/bioengineering11060560] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Revised: 05/17/2024] [Accepted: 05/30/2024] [Indexed: 06/28/2024] Open
Abstract
Motion capture (MoCap) technology, essential for biomechanics and motion analysis, faces challenges from data loss due to occlusions and technical issues. Traditional recovery methods, based on inter-marker relationships or independent marker treatment, have limitations. This study introduces a novel U-net-inspired bi-directional long short-term memory (U-Bi-LSTM) autoencoder-based technique for recovering missing MoCap data across multi-camera setups. Leveraging multi-camera and triangulated 3D data, this method employs a sophisticated U-shaped deep learning structure with an adaptive Huber regression layer, enhancing outlier robustness and minimizing reconstruction errors, proving particularly beneficial for long-term data loss scenarios. Our approach surpasses traditional piecewise cubic spline and state-of-the-art sparse low rank methods, demonstrating statistically significant improvements in reconstruction error across various gap lengths and numbers. This research not only advances the technical capabilities of MoCap systems but also enriches the analytical tools available for biomechanical research, offering new possibilities for enhancing athletic performance, optimizing rehabilitation protocols, and developing personalized treatment plans based on precise biomechanical data.
Collapse
Affiliation(s)
- Oleksandr Yuhai
- Department of Bio-Mechatronic Engineering, College of Biotechnology and Bioengineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Ahnryul Choi
- Department of Biomedical Engineering, College of Medical Convergence, Catholic Kwandong University, Gangneung 25601, Republic of Korea
| | - Yubin Cho
- Department of Bio-Mechatronic Engineering, College of Biotechnology and Bioengineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Hyunggun Kim
- Department of Bio-Mechatronic Engineering, College of Biotechnology and Bioengineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Joung Hwan Mun
- Department of Bio-Mechatronic Engineering, College of Biotechnology and Bioengineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
| |
Collapse
|
2
|
Burnie L, Chockalingam N, Holder A, Claypole T, Kilduff L, Bezodis N. Testing protocols and measurement techniques when using pressure sensors for sport and health applications: A comparative review. Foot (Edinb) 2024; 59:102094. [PMID: 38579518 DOI: 10.1016/j.foot.2024.102094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/16/2024] [Accepted: 03/24/2024] [Indexed: 04/07/2024]
Abstract
Plantar pressure measurement systems are routinely used in sports and health applications to assess locomotion. The purpose of this review is to describe and critically discuss: (a) applications of the pressure measurement systems in sport and healthcare, (b) testing protocols and considerations for clinical gait analysis, (c) clinical recommendations for interpreting plantar pressure data, (d) calibration procedures and their accuracy, and (e) the future of pressure sensor data analysis. Rigid pressure platforms are typically used to measure plantar pressures for the assessment of foot function during standing and walking, particularly when barefoot, and are the most accurate for measuring plantar pressures. For reliable data, two step protocol prior to contacting the pressure plate is recommended. In-shoe systems are most suitable for measuring plantar pressures in the field during daily living or dynamic sporting movements as they are often wireless and can measure multiple steps. They are the most suitable equipment to assess the effects of footwear and orthotics on plantar pressures. However, they typically have lower spatial resolution and sampling frequency than platform systems. Users of pressure measurement systems need to consider the suitability of the calibration procedures for their chosen application when selecting and using a pressure measurement system. For some applications, a bespoke calibration procedure is required to improve validity and reliability of the pressure measurement system. The testing machines that are commonly used for dynamic calibration of pressure measurement systems frequently have loading rates of less than even those found in walking, so the development of testing protocols that truly measure the loading rates found in many sporting movements are required. There is clear potential for AI techniques to assist in the analysis and interpretation of plantar pressure data to enable the more complete use of pressure system data in clinical diagnoses and monitoring.
Collapse
Affiliation(s)
- Louise Burnie
- Department of Sport, Exercise and Rehabilitation, Faculty of Health & Life Sciences, Northumbria University, Newcastle upon Tyne NE1 8ST, UK; Applied Sports, Technology, Exercise and Medicine (A-STEM) Research Centre, Faculty of Science and Engineering, Swansea University, Swansea SA1 8EN, UK.
| | - Nachiappan Chockalingam
- Centre for Biomechanics and Rehabilitation Technologies, Staffordshire University, Stoke on Trent ST4 2RU, UK
| | | | - Tim Claypole
- Welsh Centre for Printing and Coating (WCPC), Faculty of Science and Engineering, Swansea University, Swansea SA1 8EN, UK
| | - Liam Kilduff
- Applied Sports, Technology, Exercise and Medicine (A-STEM) Research Centre, Faculty of Science and Engineering, Swansea University, Swansea SA1 8EN, UK
| | - Neil Bezodis
- Applied Sports, Technology, Exercise and Medicine (A-STEM) Research Centre, Faculty of Science and Engineering, Swansea University, Swansea SA1 8EN, UK
| |
Collapse
|
3
|
Choi A, Kim TH, Yuhai O, Jeong S, Kim K, Kim H, Mun JH. Deep Learning-Based Near-Fall Detection Algorithm for Fall Risk Monitoring System Using a Single Inertial Measurement Unit. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2385-2394. [PMID: 35969550 DOI: 10.1109/tnsre.2022.3199068] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Proactively detecting falls and preventing injuries are among the primary keys to a healthy life for the elderly. Near-fall remote monitoring in daily life could provide key information to prevent future falls and obtain quantitative rehabilitation status for patients with weak balance ability. In this study, we developed a deep learning-based novel classification algorithm to precisely categorize three classes (falls, near-falls, and activities of daily living (ADLs)) using a single inertial measurement unit (IMU) device attached to the waist. A total of 34 young participants were included in this study. An IMU containing accelerometer and gyroscope sensors was fabricated to acquire acceleration and angular velocity signals. A comprehensive experiment including thirty-six types of activities (10 types of falls, 10 types of near-falls, and 16 types of ADLs) was designed based on previous studies. A modified directed acyclic graph-convolution neural network (DAG-CNN) architecture with hyperparameter optimization was proposed to predict fall, near-fall, and ADLs. Prediction results of the modified DAG-CNN structure were found to be approximately 7% more accurate than the traditional CNN structure. For the case of near-falls, the modified DAG-CNN demonstrated excellent prediction performance with accuracy of over 98% by combining gyroscope and accelerometer features. Additionally, by combining acceleration and angular velocity the trained model showed better performance than each model of acceleration and angular velocity. It is believed that information to preemptively handle the risk of falls and quantitatively evaluate the rehabilitation status of the elderly with weak balance will be provided by monitoring near-falls.
Collapse
|
4
|
Choi A, Park E, Kim TH, Im GJ, Mun JH. A novel optimization-based convolution neural network to estimate the contribution of sensory inputs to postural stability during quiet standing. IEEE J Biomed Health Inform 2022; 26:4414-4425. [PMID: 35759603 DOI: 10.1109/jbhi.2022.3186436] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Adequate postural control is maintained by integrating signals from the visual, somatosensory, and vestibular systems. The purpose of this study is to propose a novel convolutional neural network (CNN)-based protocol that can evaluate the contributions of each sensory input for postural stability (calculated a sensory analysis index) using center of pressure (COP) signals in a quiet standing posture. Raw COP signals in the anterior/posterior and medial/lateral directions were extracted from 330 patients in a quiet standing with their eyes open for 20 seconds. The COP signals augmented using jittering and pooling techniques were transformed into the frequency domain. The sensory analysis indices were used as the output information from the deep learning models. A ResNet-50 CNN was combined with the k-nearest neighbor, random forest, and support vector machine classifiers for the training model. Additionally, a novel optimization process was proposed to include an encoding design variable that can group outputs into sub-classes along with hyperparameters. The results of optimization considering only hyperparameters showed low performance, with an accuracy of 55% or less and F-1 scores of 54% or less in all models. However, when optimization was performed using the encoding design variable, the performance was markedly increased in the CNN-classifier combined models (r = 0.975). These results suggest it is possible to evaluate the contribution of sensory inputs for postural stability using COP signals during a quiet standing. This study will facilitate the expanded dissemination of a system that can quantitatively evaluate the balance ability and rehabilitation progress of patients with dizziness.
Collapse
|
5
|
Sethuram L, Thomas J, Mukherjee A, Chandrasekaran N. A review on contemporary nanomaterial-based therapeutics for the treatment of diabetic foot ulcers (DFUs) with special reference to the Indian scenario. NANOSCALE ADVANCES 2022; 4:2367-2398. [PMID: 36134136 PMCID: PMC9418054 DOI: 10.1039/d1na00859e] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Accepted: 04/06/2022] [Indexed: 05/08/2023]
Abstract
Diabetes mellitus (DM) is a predominant chronic metabolic syndrome, resulting in various complications and high mortality associated with diabetic foot ulcers (DFUs). Approximately 15-30% of diabetic patients suffer from DFUs, which is expected to increase annually. The major challenges in treating DFUs are associated with wound infections, alterations to inflammatory responses, angiogenesis and lack of extracellular matrix (ECM) components. Furthermore, the lack of targeted therapy and efficient wound dressings for diabetic wounds often results in extended hospitalization and limb amputations. Hence, it is essential to develop and improve DFU-specific therapies. Nanomaterial-based innovative approaches have tremendous potential for preventing and treating wound infections of bacterial origin. They have greater benefits compared to traditional wound dressing approaches. In this approach, the physiochemical features of nanomaterials allow researchers to employ different methods for diabetic wound healing applications. In this review, the status and prevalence of diabetes mellitus (DM) and amputations due to DFUs in India, the pathophysiology of DFUs and their complications are discussed. Additionally, nanomaterial-based approaches such as the use of nanoemulsions, nanoparticles, nanoliposomes and nanofibers for the treatment of DFUs are studied. Besides, emerging therapeutics such as bioengineered skin substitutes and nanomaterial-based innovative approaches such as antibacterial hyperthermia therapy and gene therapy for the treatment of DFUs are highlighted. The present nanomaterial-based techniques provide a strong base for future therapeutic approaches for skin regeneration strategies in the treatment of diabetic wounds.
Collapse
Affiliation(s)
- Lakshimipriya Sethuram
- Centre for Nanobiotechnology, Vellore Institute of Technology Vellore Tamilnadu India +91 416 2243092 +91 416 2202624
| | - John Thomas
- Centre for Nanobiotechnology, Vellore Institute of Technology Vellore Tamilnadu India +91 416 2243092 +91 416 2202624
| | - Amitava Mukherjee
- Centre for Nanobiotechnology, Vellore Institute of Technology Vellore Tamilnadu India +91 416 2243092 +91 416 2202624
| | - Natarajan Chandrasekaran
- Centre for Nanobiotechnology, Vellore Institute of Technology Vellore Tamilnadu India +91 416 2243092 +91 416 2202624
| |
Collapse
|
6
|
Machine Learning Strategies for Low-Cost Insole-Based Prediction of Center of Gravity during Gait in Healthy Males. SENSORS 2022; 22:s22093499. [PMID: 35591188 PMCID: PMC9100257 DOI: 10.3390/s22093499] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 04/28/2022] [Accepted: 04/28/2022] [Indexed: 02/04/2023]
Abstract
Whole-body center of gravity (CG) movements in relation to the center of pressure (COP) offer insights into the balance control strategies of the human body. Existing CG measurement methods using expensive measurement equipment fixed in a laboratory environment are not intended for continuous monitoring. The development of wireless sensing technology makes it possible to expand the measurement in daily life. The insole system is a wearable device that can evaluate human balance ability by measuring pressure distribution on the ground. In this study, a novel protocol (data preparation and model training) for estimating the 3-axis CG trajectory from vertical plantar pressures was proposed and its performance was evaluated. Input and target data were obtained through gait experiments conducted on 15 adult and 15 elderly males using a self-made insole prototype and optical motion capture system. One gait cycle was divided into four semantic phases. Features specified for each phase were extracted and the CG trajectory was predicted using a bi-directional long short-term memory (Bi-LSTM) network. The performance of the proposed CG prediction model was evaluated by a comparative study with four prediction models having no gait phase segmentation. The CG trajectory calculated with the optoelectronic system was used as a golden standard. The relative root mean square error of the proposed model on the 3-axis of anterior/posterior, medial/lateral, and proximal/distal showed the best prediction performance, with 2.12%, 12.97%, and 12.47%. Biomechanical analysis of two healthy male groups was conducted. A statistically significant difference between CG trajectories of the two groups was shown in the proposed model. Large CG sway of the medial/lateral axis trajectory and CG fall of the proximal/distal axis trajectory is shown in the old group. The protocol proposed in this study is a basic step to have gait analysis in daily life. It is expected to be utilized as a key element for clinical applications.
Collapse
|