1
|
Ramli AA, Liu X, Berndt K, Goude E, Hou J, Kaethler LB, Liu R, Lopez A, Nicorici A, Owens C, Rodriguez D, Wang J, Zhang H, Aranki D, McDonald CM, Henricson EK. Gait Characterization in Duchenne Muscular Dystrophy (DMD) Using a Single-Sensor Accelerometer: Classical Machine Learning and Deep Learning Approaches. Sensors (Basel) 2024; 24:1123. [PMID: 38400281 PMCID: PMC10892016 DOI: 10.3390/s24041123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 02/02/2024] [Accepted: 02/05/2024] [Indexed: 02/25/2024]
Abstract
Differences in gait patterns of children with Duchenne muscular dystrophy (DMD) and typically developing (TD) peers are visible to the eye, but quantifications of those differences outside of the gait laboratory have been elusive. In this work, we measured vertical, mediolateral, and anteroposterior acceleration using a waist-worn iPhone accelerometer during ambulation across a typical range of velocities. Fifteen TD and fifteen DMD children from 3 to 16 years of age underwent eight walking/running activities, including five 25 m walk/run speed-calibration tests at a slow walk to running speeds (SC-L1 to SC-L5), a 6-min walk test (6MWT), a 100 m fast walk/jog/run (100MRW), and a free walk (FW). For clinical anchoring purposes, participants completed a Northstar Ambulatory Assessment (NSAA). We extracted temporospatial gait clinical features (CFs) and applied multiple machine learning (ML) approaches to differentiate between DMD and TD children using extracted temporospatial gait CFs and raw data. Extracted temporospatial gait CFs showed reduced step length and a greater mediolateral component of total power (TP) consistent with shorter strides and Trendelenberg-like gait commonly observed in DMD. ML approaches using temporospatial gait CFs and raw data varied in effectiveness at differentiating between DMD and TD controls at different speeds, with an accuracy of up to 100%. We demonstrate that by using ML with accelerometer data from a consumer-grade smartphone, we can capture DMD-associated gait characteristics in toddlers to teens.
Collapse
Affiliation(s)
- Albara Ah Ramli
- Department of Computer Science, School of Engineering, University of California, Davis, CA 95616, USA; (A.A.R.); (X.L.); (R.L.)
| | - Xin Liu
- Department of Computer Science, School of Engineering, University of California, Davis, CA 95616, USA; (A.A.R.); (X.L.); (R.L.)
| | - Kelly Berndt
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Erica Goude
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Jiahui Hou
- Department of Electrical and Computer Engineering, School of Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada;
| | - Lynea B. Kaethler
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Rex Liu
- Department of Computer Science, School of Engineering, University of California, Davis, CA 95616, USA; (A.A.R.); (X.L.); (R.L.)
| | - Amanda Lopez
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Alina Nicorici
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Corey Owens
- UC Davis Center for Health and Technology, University of California, Davis, CA 95616, USA;
| | - David Rodriguez
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Jane Wang
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Huanle Zhang
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Daniel Aranki
- Berkeley School of Information, University of California Berkeley, Berkeley, CA 94720, USA;
| | - Craig M. McDonald
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
| | - Erik K. Henricson
- Department of Physical Medicine and Rehabilitation, School of Medicine, University of California, Davis, CA 95616, USA; (K.B.); (E.G.); (L.B.K.); (A.L.); (A.N.); (D.R.); (J.W.); (H.Z.); (C.M.M.)
- Graduate Group in Computer Science (GGCS), University of California, Davis, CA 95616, USA
| |
Collapse
|
2
|
Koska OI, Çilengir AH, Uluç ME, Yücel A, Tosun Ö. All-star approach to a small medical imaging dataset: combined deep, transfer, and classical machine learning approaches for the determination of radial head fractures. Acta Radiol 2022; 64:1476-1483. [PMID: 36062584 DOI: 10.1177/02841851221122424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Radial head fractures are often evaluated in emergency departments and can easily be missed. Automated or semi-automated detection methods that help physicians may be valuable regarding the high miss rate. PURPOSE To evaluate the accuracy of combined deep, transfer, and classical machine learning approaches on a small dataset for determination of radial head fractures. MATERIAL AND METHODS A total of 48 patients with radial head fracture and 56 patients without fracture on elbow radiographs were retrospectively evaluated. The input images were obtained by cropping anteroposterior elbow radiographs around a center-point on the radial head. For fracture determination, an algorithm based on feature extraction using distinct prototypes of pretrained networks (VGG16, ResNet50, InceptionV3, MobileNetV2) representing four different approaches was developed. Reduction of feature space dimensions, feeding the most relevant features, and development of ensemble of classifiers were utilized. RESULTS The algorithm with the best performance consisted of preprocessing the input, computation of global maximum and global mean outputs of four distinct pretrained networks, dimensionality reduction by applying univariate and ensemble feature selectors, and applying Support Vector Machines and Random Forest classifiers to the transformed and reduced dataset. A maximum accuracy of 90% with MobileNetV2 pretrained features was reached for fracture determination with a small sample size. CONCLUSION Radial head fractures can be determined with a combined approach and limitations of the small sample size can be overcome by utilizing pretrained deep networks with classical machine learning methods.
Collapse
Affiliation(s)
- Ozgur I Koska
- Department of Biomedical Engineering, 37508Dokuz Eylül University Engineering Faculty, İzmir, Turkey.,ETHZ Computer Vision Laboratory, Zurich, Switzerland
| | | | - Muhsin Engin Uluç
- Department of Radiology, Izmir Katip Celebi University Ataturk Training and Research Hospital, Izmir, Turkey
| | - Aylin Yücel
- 534521Department of Radiology, Afyonkarahisar Health Sciences University, Afyonkarahisar, Turkey
| | - Özgür Tosun
- Department of Radiology, Izmir Katip Celebi University Ataturk Training and Research Hospital, Izmir, Turkey
| |
Collapse
|
3
|
Khandakar A, Chowdhury MEH, Reaz MBI, Ali SHM, Kiranyaz S, Rahman T, Chowdhury MH, Ayari MA, Alfkey R, Bakar AAA, Malik RA, Hasan A. A Novel Machine Learning Approach for Severity Classification of Diabetic Foot Complications Using Thermogram Images. Sensors (Basel) 2022; 22:s22114249. [PMID: 35684870 PMCID: PMC9185274 DOI: 10.3390/s22114249] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Revised: 04/27/2022] [Accepted: 05/09/2022] [Indexed: 05/14/2023]
Abstract
Diabetes mellitus (DM) is one of the most prevalent diseases in the world, and is correlated to a high index of mortality. One of its major complications is diabetic foot, leading to plantar ulcers, amputation, and death. Several studies report that a thermogram helps to detect changes in the plantar temperature of the foot, which may lead to a higher risk of ulceration. However, in diabetic patients, the distribution of plantar temperature does not follow a standard pattern, thereby making it difficult to quantify the changes. The abnormal temperature distribution in infrared (IR) foot thermogram images can be used for the early detection of diabetic foot before ulceration to avoid complications. There is no machine learning-based technique reported in the literature to classify these thermograms based on the severity of diabetic foot complications. This paper uses an available labeled diabetic thermogram dataset and uses the k-mean clustering technique to cluster the severity risk of diabetic foot ulcers using an unsupervised approach. Using the plantar foot temperature, the new clustered dataset is verified by expert medical doctors in terms of risk for the development of foot ulcers. The newly labeled dataset is then investigated in terms of robustness to be classified by any machine learning network. Classical machine learning algorithms with feature engineering and a convolutional neural network (CNN) with image-enhancement techniques are investigated to provide the best-performing network in classifying thermograms based on severity. It is found that the popular VGG 19 CNN model shows an accuracy, precision, sensitivity, F1-score, and specificity of 95.08%, 95.08%, 95.09%, 95.08%, and 97.2%, respectively, in the stratification of severity. A stacking classifier is proposed using extracted features of the thermogram, which is created using the trained gradient boost classifier, XGBoost classifier, and random forest classifier. This provides a comparable performance of 94.47%, 94.45%, 94.47%, 94.43%, and 93.25% for accuracy, precision, sensitivity, F1-score, and specificity, respectively.
Collapse
Affiliation(s)
- Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar; (A.K.); (S.K.); (T.R.)
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia; (S.H.M.A.); (M.H.C.); (A.A.A.B.)
| | - Muhammad E. H. Chowdhury
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar; (A.K.); (S.K.); (T.R.)
- Correspondence: (M.E.H.C.); (M.B.I.R.)
| | - Mamun Bin Ibne Reaz
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia; (S.H.M.A.); (M.H.C.); (A.A.A.B.)
- Correspondence: (M.E.H.C.); (M.B.I.R.)
| | - Sawal Hamid Md Ali
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia; (S.H.M.A.); (M.H.C.); (A.A.A.B.)
| | - Serkan Kiranyaz
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar; (A.K.); (S.K.); (T.R.)
| | - Tawsifur Rahman
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar; (A.K.); (S.K.); (T.R.)
| | - Moajjem Hossain Chowdhury
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia; (S.H.M.A.); (M.H.C.); (A.A.A.B.)
| | - Mohamed Arselene Ayari
- Department of Civil and Architectural Engineering, Qatar University, Doha 2713, Qatar;
- Technology Innovation and Engineering Education Unit, Qatar University, Doha 2713, Qatar
| | - Rashad Alfkey
- Acute Care Surgery and General Surgery, Hamad Medical Corporation, Doha 3050, Qatar;
| | - Ahmad Ashrif A. Bakar
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia; (S.H.M.A.); (M.H.C.); (A.A.A.B.)
| | | | - Anwarul Hasan
- Department of Industrial and Mechanical Engineering, Qatar University, Doha 2713, Qatar;
| |
Collapse
|
4
|
Aman F, Rauf A, Ali R, Hussain J, Ahmed I. Balancing Complex Signals for Robust Predictive Modeling. Sensors (Basel) 2021; 21:s21248465. [PMID: 34960557 PMCID: PMC8706336 DOI: 10.3390/s21248465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 12/12/2021] [Accepted: 12/14/2021] [Indexed: 01/10/2023]
Abstract
Robust predictive modeling is the process of creating, validating, and testing models to obtain better prediction outcomes. Datasets usually contain outliers whose trend deviates from the most data points. Conventionally, outliers are removed from the training dataset during preprocessing before building predictive models. Such models, however, may have poor predictive performance on the unseen testing data involving outliers. In modern machine learning, outliers are regarded as complex signals because of their significant role and are not suggested for removal from the training dataset. Models trained in modern regimes are interpolated (over trained) by increasing their complexity to treat outliers locally. However, such models become inefficient as they require more training due to the inclusion of outliers, and this also compromises the models’ accuracy. This work proposes a novel complex signal balancing technique that may be used during preprocessing to incorporate the maximum number of complex signals (outliers) in the training dataset. The proposed approach determines the optimal value for maximum possible inclusion of complex signals for training with the highest performance of the model in terms of accuracy, time, and complexity. The experimental results show that models trained after preprocessing with the proposed technique achieve higher predictive accuracy with improved execution time and low complexity as compared to traditional predictive modeling.
Collapse
Affiliation(s)
- Fazal Aman
- Department of Computer Science, University of Peshawar, Peshawar 25120, Pakistan; (F.A.); (I.A.)
| | - Azhar Rauf
- Department of Computer Science, University of Peshawar, Peshawar 25120, Pakistan; (F.A.); (I.A.)
- Correspondence: (A.R.); (J.H.)
| | - Rahman Ali
- Quaid-e-Azam College of Commerce, University of Peshawar, Peshawar 25120, Pakistan;
| | - Jamil Hussain
- Department of Data Science, Sejong University, Seoul 05006, Korea
- Correspondence: (A.R.); (J.H.)
| | - Ibrar Ahmed
- Department of Computer Science, University of Peshawar, Peshawar 25120, Pakistan; (F.A.); (I.A.)
| |
Collapse
|
5
|
Awais M, Chiari L, Ihlen EAF, Helbostad JL, Palmerini L. Classical Machine Learning Versus Deep Learning for the Older Adults Free-Living Activity Classification. Sensors (Basel) 2021; 21:4669. [PMID: 34300409 DOI: 10.3390/s21144669] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Revised: 06/29/2021] [Accepted: 07/05/2021] [Indexed: 11/25/2022]
Abstract
Physical activity has a strong influence on mental and physical health and is essential in healthy ageing and wellbeing for the ever-growing elderly population. Wearable sensors can provide a reliable and economical measure of activities of daily living (ADLs) by capturing movements through, e.g., accelerometers and gyroscopes. This study explores the potential of using classical machine learning and deep learning approaches to classify the most common ADLs: walking, sitting, standing, and lying. We validate the results on the ADAPT dataset, the most detailed dataset to date of inertial sensor data, synchronised with high frame-rate video labelled data recorded in a free-living environment from older adults living independently. The findings suggest that both approaches can accurately classify ADLs, showing high potential in profiling ADL patterns of the elderly population in free-living conditions. In particular, both long short-term memory (LSTM) networks and Support Vector Machines combined with ReliefF feature selection performed equally well, achieving around 97% F-score in profiling ADLs.
Collapse
|
6
|
Kaczorowska M, Karczmarek P, Plechawska-Wójcik M, Tokovarov M. On the Improvement of Eye Tracking-Based Cognitive Workload Estimation Using Aggregation Functions. Sensors (Basel) 2021; 21:s21134542. [PMID: 34283098 PMCID: PMC8272248 DOI: 10.3390/s21134542] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Revised: 06/25/2021] [Accepted: 06/30/2021] [Indexed: 11/18/2022]
Abstract
Cognitive workload, being a quantitative measure of mental effort, draws significant interest of researchers, as it allows to monitor the state of mental fatigue. Estimation of cognitive workload becomes especially important for job positions requiring outstanding engagement and responsibility, e.g., air-traffic dispatchers, pilots, car or train drivers. Cognitive workload estimation finds its applications also in the field of education material preparation. It allows to monitor the difficulty degree for specific tasks enabling to adjust the level of education materials to typical abilities of students. In this study, we present the results of research conducted with the goal of examining the influence of various fuzzy or non-fuzzy aggregation functions upon the quality of cognitive workload estimation. Various classic machine learning models were successfully applied to the problem. The results of extensive in-depth experiments with over 2000 aggregation operators shows the applicability of the approach based on the aggregation functions. Moreover, the approach based on aggregation process allows for further improvement of classification results. A wide range of aggregation functions is considered and the results suggest that the combination of classical machine learning models and aggregation methods allows to achieve high quality of cognitive workload level recognition preserving low computational cost.
Collapse
|