1
|
Al Mudawi N, Batool M, Alazeb A, Alqahtani Y, Almujally NA, Algarni A, Jalal A, Liu H. A robust multimodal detection system: physical exercise monitoring in long-term care environments. Front Bioeng Biotechnol 2024; 12:1398291. [PMID: 39175622 PMCID: PMC11338868 DOI: 10.3389/fbioe.2024.1398291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Accepted: 07/16/2024] [Indexed: 08/24/2024] Open
Abstract
Introduction Falls are a major cause of accidents that can lead to serious injuries, especially among geriatric populations worldwide. Ensuring constant supervision in hospitals or smart environments while maintaining comfort and privacy is practically impossible. Therefore, fall detection has become a significant area of research, particularly with the use of multimodal sensors. The lack of efficient techniques for automatic fall detection hampers the creation of effective preventative tools capable of identifying falls during physical exercise in long-term care environments. The primary goal of this article is to examine the benefits of using multimodal sensors to enhance the precision of fall detection systems. Methods The proposed paper combines time-frequency features of inertial sensors with skeleton-based modeling of depth sensors to extract features. These multimodal sensors are then integrated using a fusion technique. Optimization and a modified K-Ary classifier are subsequently applied to the resultant fused data. Results The suggested model achieved an accuracy of 97.97% on the UP-Fall Detection dataset and 97.89% on the UR-Fall Detection dataset. Discussion This indicates that the proposed model outperforms state-of-the-art classification results. Additionally, the proposed model can be utilized as an IoT-based solution, effectively promoting the development of tools to prevent fall-related injuries.
Collapse
Affiliation(s)
- Naif Al Mudawi
- Department of Computer Science, College of Computer Science and Information System, Najran University, Najran, Saudi Arabia
| | - Mouazma Batool
- Department of Computer Science, Air University, Islamabad, Pakistan
| | - Abdulwahab Alazeb
- Department of Computer Science, College of Computer Science and Information System, Najran University, Najran, Saudi Arabia
| | - Yahay Alqahtani
- Department of Computer Science, King Khalid University, Abha, Saudi Arabia
| | - Nouf Abdullah Almujally
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia
| | - Asaad Algarni
- Department of Computer Science, Faculty of Computing and Information Technology, Northern Border University, Rafha, Saudi Arabia
| | - Ahmad Jalal
- Department of Computer Science, Air University, Islamabad, Pakistan
| | - Hui Liu
- Cognitive Systems Lab, University of Bremen, Bremen, Germany
| |
Collapse
|
2
|
Tuckwell GA, Keal JA, Gupta CC, Ferguson SA, Kowlessar JD, Vincent GE. A Deep Learning Approach to Classify Sitting and Sleep History from Raw Accelerometry Data during Simulated Driving. SENSORS (BASEL, SWITZERLAND) 2022; 22:6598. [PMID: 36081057 PMCID: PMC9460180 DOI: 10.3390/s22176598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 08/17/2022] [Accepted: 08/29/2022] [Indexed: 06/15/2023]
Abstract
Prolonged sitting and inadequate sleep can impact driving performance. Therefore, objective knowledge of a driver's recent sitting and sleep history could help reduce safety risks. This study aimed to apply deep learning to raw accelerometry data collected during a simulated driving task to classify recent sitting and sleep history. Participants (n = 84, Mean ± SD age = 23.5 ± 4.8, 49% Female) completed a seven-day laboratory study. Raw accelerometry data were collected from a thigh-worn accelerometer during a 20-min simulated drive (8:10 h and 17:30 h each day). Two convolutional neural networks (CNNs; ResNet-18 and DixonNet) were trained to classify accelerometry data into four classes (sitting or breaking up sitting and 9-h or 5-h sleep). Accuracy was determined using five-fold cross-validation. ResNet-18 produced higher accuracy scores: 88.6 ± 1.3% for activity (compared to 77.2 ± 2.6% from DixonNet) and 88.6 ± 1.1% for sleep history (compared to 75.2 ± 2.6% from DixonNet). Class activation mapping revealed distinct patterns of movement and postural changes between classes. Findings demonstrate the suitability of CNNs in classifying sitting and sleep history using thigh-worn accelerometer data collected during a simulated drive. This approach has implications for the identification of drivers at risk of fatigue-related impairment.
Collapse
Affiliation(s)
- Georgia A. Tuckwell
- School of Health, Medical and Applied Sciences, Central Queensland University, Adelaide 5001, Australia
| | - James A. Keal
- School of Physical Sciences, The University of Adelaide, Adelaide 5005, Australia
| | - Charlotte C. Gupta
- School of Health, Medical and Applied Sciences, Central Queensland University, Adelaide 5001, Australia
| | - Sally A. Ferguson
- School of Health, Medical and Applied Sciences, Central Queensland University, Adelaide 5001, Australia
| | - Jarrad D. Kowlessar
- College of Humanities and Social Sciences, Flinders University, Adelaide 5005, Australia
| | - Grace E. Vincent
- School of Health, Medical and Applied Sciences, Central Queensland University, Adelaide 5001, Australia
| |
Collapse
|
3
|
Masengo Wa Umba S, Abu-Mahfouz AM, Ramotsoela D. Artificial Intelligence-Driven Intrusion Detection in Software-Defined Wireless Sensor Networks: Towards Secure IoT-Enabled Healthcare Systems. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19095367. [PMID: 35564763 PMCID: PMC9103430 DOI: 10.3390/ijerph19095367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 04/05/2022] [Accepted: 04/22/2022] [Indexed: 01/15/2023]
Abstract
Wireless Sensor Networks (WSNs) are increasingly deployed in Internet of Things (IoT) systems for applications such as smart transportation, telemedicine, smart health monitoring and fall detection systems for the elderly people. Given that huge amount of data, vital and critical information can be exchanged between the different parts of a WSN, good management and protection schemes are needed to ensure an efficient and secure operation of the WSN. To ensure an efficient management of WSNs, the Software-Defined Wireless Sensor Network (SDWSN) paradigm has been recently introduced in the literature. In the same vein, Intrusion Detection Systems, have been used in the literature to safeguard the security of SDWSN-based IoTs. In this paper, three popular Artificial Intelligence techniques (Decision Tree, Naïve Bayes, and Deep Artificial Neural Network) are trained to be deployed as anomaly detectors in IDSs. It is shown that an IDS using the Decision Tree-based anomaly detector yields the best performances metrics both in the binary classification and in the multinomial classification. Additionally, it was found that an IDS using the Naïve Bayes-based anomaly detector was only adapted for binary classification of intrusions in low memory capacity SDWSN-based IoT (e.g., wearable fitness tracker). Moreover, new state-of-the-art accuracy (binary classification) and F-scores (multinomial classification) were achieved by introducing an end-to-end feature engineering scheme aimed at obtaining 118 features from the 41 features of the Network Security Laboratory-Knowledge Discovery in Databases (NSL-KDD) dataset. The state-of-the-art accuracy was pushed to 0.999777 using the Decision Tree-based anomaly detector. Finally, it was found that the Deep Artificial Neural Network should be expected to become the next default anomaly detector in the light of its current performance metrics and the increasing abundance of training data.
Collapse
Affiliation(s)
- Shimbi Masengo Wa Umba
- Department of Electrical, Electronic and Computer Engineering, University of Pretoria, Pretoria 0002, South Africa; (S.M.W.U.); (D.R.)
| | - Adnan M. Abu-Mahfouz
- Department of Electrical, Electronic and Computer Engineering, University of Pretoria, Pretoria 0002, South Africa; (S.M.W.U.); (D.R.)
- Council for Scientific and Industrial Research (CSIR), Pretoria 0184, South Africa
- Correspondence:
| | - Daniel Ramotsoela
- Department of Electrical, Electronic and Computer Engineering, University of Pretoria, Pretoria 0002, South Africa; (S.M.W.U.); (D.R.)
| |
Collapse
|
4
|
A Novel Feature Set Extraction Based on Accelerometer Sensor Data for Improving the Fall Detection System. ELECTRONICS 2022. [DOI: 10.3390/electronics11071030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Because falls are the second leading cause of injury deaths, especially in the elderly according to WHO statistics, there have been a lot of studies on developing a fall detection and warning system. Many approaches based on wearable sensors, cameras, Infrared sensors, radar, etc., have been proposed to detect falls efficiently. However, it still faces many challenges due to noise and no clear definition of fall activities. This paper proposes a new way to extract 44 features based on the time domain, frequency domain, and Hjorth parameters to deal with this. The effect of the proposed feature set has been evaluated on several classification algorithms, such as SVM, k-NN, ANN, J48, and RF. Our method achieves a relative high performance (F1-Score metric) in detecting fall and non-fall activities, i.e., 95.23% (falls), 99.11% (non-falls), and 96.16% (falls), 99.90% (non-falls) for the MobileAct 2.0 and UP-Fall datasets, respectively.
Collapse
|
5
|
Wu X, Zheng Y, Chu CH, Cheng L, Kim J. Applying deep learning technology for automatic fall detection using mobile sensors. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103355] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
6
|
A study on the impact of the users' characteristics on the performance of wearable fall detection systems. Sci Rep 2021; 11:23011. [PMID: 34836975 PMCID: PMC8626458 DOI: 10.1038/s41598-021-02537-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 11/11/2021] [Indexed: 11/28/2022] Open
Abstract
Wearable Fall Detection Systems (FDSs) have gained much research interest during last decade. In this regard, Machine Learning (ML) classifiers have shown great efficiency in discriminating falls and conventional movements or Activities of Daily Living (ADLs) based on the analysis of the signals captured by transportable inertial sensors. Due to the intrinsic difficulties of training and testing this type of detectors in realistic scenarios and with their target audience (older adults), FDSs are normally benchmarked against a predefined set of ADLs and emulated falls executed by volunteers in a controlled environment. In most studies, however, samples from the same experimental subjects are used to both train and evaluate the FDSs. In this work, we investigate the performance of ML-based FDS systems when the test subjects have physical characteristics (weight, height, body mass index, age, gender) different from those of the users considered for the test phase. The results seem to point out that certain divergences (weight, height) of the users of both subsets (training ad test) may hamper the effectiveness of the classifiers (a reduction of up 20% in sensitivity and of up to 5% in specificity is reported). However, it is shown that the typology of the activities included in these subgroups has much greater relevance for the discrimination capability of the classifiers (with specificity losses of up to 95% if the activity types for training and testing strongly diverge).
Collapse
|
7
|
Development of an Anomaly Alert System Triggered by Unusual Behaviors at Home. SENSORS 2021; 21:s21165454. [PMID: 34450896 PMCID: PMC8400924 DOI: 10.3390/s21165454] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/23/2021] [Accepted: 08/11/2021] [Indexed: 12/26/2022]
Abstract
In many countries, the number of elderly people has grown due to the increase in the life expectancy of the population, many of whom currently live alone and are prone to having accidents that they cannot report, especially if they are immobilized. For this reason, we have developed a non-intrusive IoT device, which, through multiple integrated sensors, collects information on habitual user behavior patterns and uses it to generate unusual behavior rules. These rules are used by our SecurHome system to send alert messages to the dependent person’s family members or caregivers if their behavior changes abruptly over the course of their daily life. This document describes in detail the design and development of the SecurHome system.
Collapse
|
8
|
Innovative IoT Solutions and Wearable Sensing Systems for Monitoring Human Biophysical Parameters: A Review. ELECTRONICS 2021. [DOI: 10.3390/electronics10141660] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Digital and information technologies are heavily pervading several aspects of human activities, improving our life quality. Health systems are undergoing a real technological revolution, radically changing how medical services are provided, thanks to the wide employment of the Internet of Things (IoT) platforms supporting advanced monitoring services and intelligent inferring systems. This paper reports, at first, a comprehensive overview of innovative sensing systems for monitoring biophysical and psychophysical parameters, all suitable for integration with wearable or portable accessories. Wearable devices represent a headstone on which the IoT-based healthcare platforms are based, providing capillary and real-time monitoring of patient’s conditions. Besides, a survey of modern architectures and supported services by IoT platforms for health monitoring is presented, providing useful insights for developing future healthcare systems. All considered architectures employ wearable devices to gather patient parameters and share them with a cloud platform where they are processed to provide real-time feedback. The reported discussion highlights the structural differences between the discussed frameworks, from the point of view of network configuration, data management strategy, feedback modality, etc.
Collapse
|
9
|
IoT-Based Applications in Healthcare Devices. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:6632599. [PMID: 33791084 PMCID: PMC7997744 DOI: 10.1155/2021/6632599] [Citation(s) in RCA: 60] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/25/2020] [Revised: 02/13/2021] [Accepted: 03/10/2021] [Indexed: 12/16/2022]
Abstract
The last decade has witnessed extensive research in the field of healthcare services and their technological upgradation. To be more specific, the Internet of Things (IoT) has shown potential application in connecting various medical devices, sensors, and healthcare professionals to provide quality medical services in a remote location. This has improved patient safety, reduced healthcare costs, enhanced the accessibility of healthcare services, and increased operational efficiency in the healthcare industry. The current study gives an up-to-date summary of the potential healthcare applications of IoT- (HIoT-) based technologies. Herein, the advancement of the application of the HIoT has been reported from the perspective of enabling technologies, healthcare services, and applications in solving various healthcare issues. Moreover, potential challenges and issues in the HIoT system are also discussed. In sum, the current study provides a comprehensive source of information regarding the different fields of application of HIoT intending to help future researchers, who have the interest to work and make advancements in the field to gain insight into the topic.
Collapse
|