1
|
Mohammad Z, Anwary AR, Mridha MF, Shovon MSH, Vassallo M. An Enhanced Ensemble Deep Neural Network Approach for Elderly Fall Detection System Based on Wearable Sensors. SENSORS (BASEL, SWITZERLAND) 2023; 23:4774. [PMID: 37430686 DOI: 10.3390/s23104774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 04/27/2023] [Accepted: 05/12/2023] [Indexed: 07/12/2023]
Abstract
Fatal injuries and hospitalizations caused by accidental falls are significant problems among the elderly. Detecting falls in real-time is challenging, as many falls occur in a short period. Developing an automated monitoring system that can predict falls before they happen, provide safeguards during the fall, and issue remote notifications after the fall is essential to improving the level of care for the elderly. This study proposed a concept for a wearable monitoring framework that aims to anticipate falls during their beginning and descent, activating a safety mechanism to minimize fall-related injuries and issuing a remote notification after the body impacts the ground. However, the demonstration of this concept in the study involved the offline analysis of an ensemble deep neural network architecture based on a Convolutional Neural Network (CNN) and a Recurrent Neural Network (RNN) and existing data. It is important to note that this study did not involve the implementation of hardware or other elements beyond the developed algorithm. The proposed approach utilized CNN for robust feature extraction from accelerometer and gyroscope data and RNN to model the temporal dynamics of the falling process. A distinct class-based ensemble architecture was developed, where each ensemble model identified a specific class. The proposed approach was evaluated on the annotated SisFall dataset and achieved a mean accuracy of 95%, 96%, and 98% for Non-Fall, Pre-Fall, and Fall detection events, respectively, outperforming state-of-the-art fall detection methods. The overall evaluation demonstrated the effectiveness of the developed deep learning architecture. This wearable monitoring system will prevent injuries and improve the quality of life of elderly individuals.
Collapse
Affiliation(s)
- Zabir Mohammad
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh
| | - Arif Reza Anwary
- School of Computing, Edinburgh Napier University, Edinburgh EH10 5DT, UK
| | - Muhammad Firoz Mridha
- Department of Computer Science, American International University-Bangladesh (AIUB), Dhaka 1229, Bangladesh
| | - Md Sakib Hossain Shovon
- Department of Computer Science, American International University-Bangladesh (AIUB), Dhaka 1229, Bangladesh
| | | |
Collapse
|
2
|
Yan J, Wang X, Shi J, Hu S. Skeleton-Based Fall Detection with Multiple Inertial Sensors Using Spatial-Temporal Graph Convolutional Networks. SENSORS (BASEL, SWITZERLAND) 2023; 23:2153. [PMID: 36850753 PMCID: PMC9962182 DOI: 10.3390/s23042153] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 02/02/2023] [Accepted: 02/08/2023] [Indexed: 06/18/2023]
Abstract
The application of wearable devices for fall detection has been the focus of much research over the past few years. One of the most common problems in established fall detection systems is the large number of false positives in the recognition schemes. In this paper, to make full use of the dependence between human joints and improve the accuracy and reliability of fall detection, a fall-recognition method based on the skeleton and spatial-temporal graph convolutional networks (ST-GCN) was proposed, using the human motion data of body joints acquired by inertial measurement units (IMUs). Firstly, the motion data of five inertial sensors were extracted from the UP-Fall dataset and a human skeleton model for fall detection was established through the natural connection relationship of body joints; after that, the ST-GCN-based fall-detection model was established to extract the motion features of human falls and the activities of daily living (ADLs) at the spatial and temporal scales for fall detection; then, the influence of two hyperparameters and window size on the algorithm performance was discussed; finally, the recognition results of ST-GCN were also compared with those of MLP, CNN, RNN, LSTM, TCN, TST, and MiniRocket. The experimental results showed that the ST-GCN fall-detection model outperformed the other seven algorithms in terms of accuracy, precision, recall, and F1-score. This study provides a new method for IMU-based fall detection, which has the reference significance for improving the accuracy and robustness of fall detection.
Collapse
Affiliation(s)
- Jianjun Yan
- Shanghai Key Laboratory of Intelligent Sensing and Detection Technology, East China University of Science and Technology, Shanghai 200237, China
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Xueqiang Wang
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Jiangtao Shi
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Shuai Hu
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
| |
Collapse
|
3
|
Liu KC, Hung KH, Hsieh CY, Huang HY, Chan CT, Tsao Y. Deep-Learning-Based Signal Enhancement of Low-Resolution Accelerometer for Fall Detection Systems. IEEE Trans Cogn Dev Syst 2022. [DOI: 10.1109/tcds.2021.3116228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Kai-Chun Liu
- Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
| | - Kuo-Hsuan Hung
- Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
| | - Chia-Yeh Hsieh
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Hsiang-Yun Huang
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Chia-Tai Chan
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Yu Tsao
- Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
| |
Collapse
|
4
|
Yusoff AHM, Salleh SM, Tokhi MO. Towards understanding on the development of wearable fall detection: an experimental approach. HEALTH AND TECHNOLOGY 2022. [DOI: 10.1007/s12553-022-00642-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
5
|
A dual-stream fused neural network for fall detection in multi-camera and $$360^{\circ }$$ videos. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06495-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
|
6
|
Alizadeh J, Bogdan M, Classen J, Fricke C. Support Vector Machine Classifiers Show High Generalizability in Automatic Fall Detection in Older Adults. SENSORS 2021; 21:s21217166. [PMID: 34770473 PMCID: PMC8588363 DOI: 10.3390/s21217166] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 10/12/2021] [Accepted: 10/25/2021] [Indexed: 11/29/2022]
Abstract
Falls are a major cause of morbidity and mortality in neurological disorders. Technical means of detecting falls are of high interest as they enable rapid notification of caregivers and emergency services. Such approaches must reliably differentiate between normal daily activities and fall events. A promising technique might be based on the classification of movements based on accelerometer signals by machine-learning algorithms, but the generalizability of classifiers trained on laboratory data to real-world datasets is a common issue. Here, three machine-learning algorithms including Support Vector Machine (SVM), k-Nearest Neighbors (kNN), and Random Forest (RF) were trained to detect fall events. We used a dataset containing intentional falls (SisFall) to train the classifier and validated the approach on a different dataset which included real-world accidental fall events of elderly people (FARSEEING). The results suggested that the linear SVM was the most suitable classifier in this cross-dataset validation approach and reliably distinguished a fall event from normal everyday activity at an accuracy of 93% and similarly high sensitivity and specificity. Thus, classifiers based on linear SVM might be useful for automatic fall detection in real-world applications.
Collapse
Affiliation(s)
- Jalal Alizadeh
- Department of Neurology, Leipzig University, 04103 Leipzig, Germany; (J.A.); (J.C.)
- Department of Neuromorphic Information Processing, Leipzig University, 04009 Leipzig, Germany;
| | - Martin Bogdan
- Department of Neuromorphic Information Processing, Leipzig University, 04009 Leipzig, Germany;
| | - Joseph Classen
- Department of Neurology, Leipzig University, 04103 Leipzig, Germany; (J.A.); (J.C.)
| | - Christopher Fricke
- Department of Neurology, Leipzig University, 04103 Leipzig, Germany; (J.A.); (J.C.)
- Correspondence:
| |
Collapse
|
7
|
Šeketa G, Pavlaković L, Džaja D, Lacković I, Magjarević R. Event-Centered Data Segmentation in Accelerometer-Based Fall Detection Algorithms. SENSORS (BASEL, SWITZERLAND) 2021; 21:4335. [PMID: 34202820 PMCID: PMC8272179 DOI: 10.3390/s21134335] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Revised: 06/16/2021] [Accepted: 06/23/2021] [Indexed: 12/27/2022]
Abstract
Automatic fall detection systems ensure that elderly people get prompt assistance after experiencing a fall. Fall detection systems based on accelerometer measurements are widely used because of their portability and low cost. However, the ability of these systems to differentiate falls from Activities of Daily Living (ADL) is still not acceptable for everyday usage at a large scale. More work is still needed to raise the performance of these systems. In our research, we explored an essential but often neglected part of accelerometer-based fall detection systems-data segmentation. The aim of our work was to explore how different configurations of windows for data segmentation affect detection accuracy of a fall detection system and to find the best-performing configuration. For this purpose, we designed a testing environment for fall detection based on a Support Vector Machine (SVM) classifier and evaluated the influence of the number and duration of segmentation windows on the overall detection accuracy. Thereby, an event-centered approach for data segmentation was used, where windows are set relative to a potential fall event detected in the input data. Fall and ADL data records from three publicly available datasets were utilized for the test. We found that a configuration of three sequential windows (pre-impact, impact, and post-impact) provided the highest detection accuracy on all three datasets. The best results were obtained when either a 0.5 s or a 1 s long impact window was used, combined with pre- and post-impact windows of 3.5 s or 3.75 s.
Collapse
Affiliation(s)
| | | | | | - Igor Lacković
- Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia; (G.Š.); (L.P.); (D.D.); (R.M.)
| | | |
Collapse
|
8
|
Liu KC, Chan M, Kuo HC, Hsieh CY, Huang HY, Chan CT, Tsao Y. Domain-Adaptive Fall Detection Using Deep Adversarial Training. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1243-1251. [PMID: 34133280 DOI: 10.1109/tnsre.2021.3089685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Fall detection (FD) systems are important assistive technologies for healthcare that can detect emergency fall events and alert caregivers. However, it is not easy to obtain large-scale annotated fall events with various specifications of sensors or sensor positions during the implementation of accurate FD systems. Moreover, the knowledge obtained through machine learning has been restricted to tasks in the same domain. The mismatch between different domains might hinder the performance of FD systems. Cross-domain knowledge transfer is very beneficial for machine-learning based FD systems to train a reliable FD model with well-labeled data in new environments. In this study, we propose domain-adaptive fall detection (DAFD) using deep adversarial training (DAT) to tackle cross-domain problems, such as cross-position and cross-configuration. The proposed DAFD can transfer knowledge from the source domain to the target domain by minimizing the domain discrepancy to avoid mismatch problems. The experimental results show that the average F1-score improvement when using DAFD ranges from 1.5% to 7% in the cross-position scenario, and from 3.5% to 12% in the cross-configuration scenario, compared to using the conventional FD model without domain adaptation training. The results demonstrate that the proposed DAFD successfully helps to deal with cross-domain problems and to achieve better detection performance.
Collapse
|
9
|
Hsieh CY, Huang HY, Liu KC, Liu CP, Chan CT, Hsu SJP. Multiphase Identification Algorithm for Fall Recording Systems Using a Single Wearable Inertial Sensor. SENSORS 2021; 21:s21093302. [PMID: 34068804 PMCID: PMC8126206 DOI: 10.3390/s21093302] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/22/2021] [Revised: 05/07/2021] [Accepted: 05/07/2021] [Indexed: 12/19/2022]
Abstract
Fall-related information can help clinical professionals make diagnoses and plan fall prevention strategies. The information includes various characteristics of different fall phases, such as falling time and landing responses. To provide the information of different phases, this pilot study proposes an automatic multiphase identification algorithm for phase-aware fall recording systems. Seven young adults are recruited to perform the fall experiment. One inertial sensor is worn on the waist to collect the data of body movement, and a total of 525 trials are collected. The proposed multiphase identification algorithm combines machine learning techniques and fragment modification algorithm to identify pre-fall, free-fall, impact, resting and recovery phases in a fall process. Five machine learning techniques, including support vector machine, k-nearest neighbor (kNN), naïve Bayesian, decision tree and adaptive boosting, are applied to identify five phases. Fragment modification algorithm uses the rules to detect the fragment whose results are different from the neighbors. The proposed multiphase identification algorithm using the kNN technique achieves the best performance in 82.17% sensitivity, 85.74% precision, 73.51% Jaccard coefficient, and 90.28% accuracy. The results show that the proposed algorithm has the potential to provide automatic fine-grained fall information for clinical measurement and assessment.
Collapse
Affiliation(s)
- Chia-Yeh Hsieh
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan; (C.-Y.H.); (H.-Y.H.); (C.-P.L.); (C.-T.C.)
| | - Hsiang-Yun Huang
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan; (C.-Y.H.); (H.-Y.H.); (C.-P.L.); (C.-T.C.)
| | - Kai-Chun Liu
- Research Center for Information Technology Innovation, Academia Sinica, Taipei 11529, Taiwan;
| | - Chien-Pin Liu
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan; (C.-Y.H.); (H.-Y.H.); (C.-P.L.); (C.-T.C.)
| | - Chia-Tai Chan
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan; (C.-Y.H.); (H.-Y.H.); (C.-P.L.); (C.-T.C.)
| | - Steen Jun-Ping Hsu
- Department of Information Management, Minghsin University of Science and Technology, Hsinchu 30401, Taiwan
- Correspondence:
| |
Collapse
|
10
|
A Machine Learning Multi-Class Approach for Fall Detection Systems Based on Wearable Sensors with a Study on Sampling Rates Selection. SENSORS 2021; 21:s21030938. [PMID: 33573347 PMCID: PMC7866865 DOI: 10.3390/s21030938] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 01/25/2021] [Accepted: 01/26/2021] [Indexed: 11/17/2022]
Abstract
Falls are dangerous for the elderly, often causing serious injuries especially when the fallen person stays on the ground for a long time without assistance. This paper extends our previous work on the development of a Fall Detection System (FDS) using an inertial measurement unit worn at the waist. Data come from SisFall, a publicly available dataset containing records of Activities of Daily Living and falls. We first applied a preprocessing and a feature extraction stage before using five Machine Learning algorithms, allowing us to compare them. Ensemble learning algorithms such as Random Forest and Gradient Boosting have the best performance, with a Sensitivity and Specificity both close to 99%. Our contribution is: a multi-class classification approach for fall detection combined with a study of the effect of the sensors' sampling rate on the performance of the FDS. Our multi-class classification approach splits the fall into three phases: pre-fall, impact, post-fall. The extension to a multi-class problem is not trivial and we present a well-performing solution. We experimented sampling rates between 1 and 200 Hz. The results show that, while high sampling rates tend to improve performance, a sampling rate of 50 Hz is generally sufficient for an accurate detection.
Collapse
|
11
|
Accelerometer-Based Fall Detection Using Machine Learning: Training and Testing on Real-World Falls. SENSORS 2020; 20:s20226479. [PMID: 33202738 PMCID: PMC7697900 DOI: 10.3390/s20226479] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Revised: 11/06/2020] [Accepted: 11/11/2020] [Indexed: 12/21/2022]
Abstract
Falling is a significant health problem. Fall detection, to alert for medical attention, has been gaining increasing attention. Still, most of the existing studies use falls simulated in a laboratory environment to test the obtained performance. We analyzed the acceleration signals recorded by an inertial sensor on the lower back during 143 real-world falls (the most extensive collection to date) from the FARSEEING repository. Such data were obtained from continuous real-world monitoring of subjects with a moderate-to-high risk of falling. We designed and tested fall detection algorithms using features inspired by a multiphase fall model and a machine learning approach. The obtained results suggest that algorithms can learn effectively from features extracted from a multiphase fall model, consistently overperforming more conventional features. The most promising method (support vector machines and features from the multiphase fall model) obtained a sensitivity higher than 80%, a false alarm rate per hour of 0.56, and an F-measure of 64.6%. The reported results and methodologies represent an advancement of knowledge on real-world fall detection and suggest useful metrics for characterizing fall detection systems for real-world use.
Collapse
|
12
|
Acceleration Magnitude at Impact Following Loss of Balance Can Be Estimated Using Deep Learning Model. SENSORS 2020; 20:s20216126. [PMID: 33126491 PMCID: PMC7663134 DOI: 10.3390/s20216126] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 10/16/2020] [Accepted: 10/22/2020] [Indexed: 11/17/2022]
Abstract
Pre-impact fall detection can detect a fall before a body segment hits the ground. When it is integrated with a protective system, it can directly prevent an injury due to hitting the ground. An impact acceleration peak magnitude is one of key measurement factors that can affect the severity of an injury. It can be used as a design parameter for wearable protective devices to prevent injuries. In our study, a novel method is proposed to predict an impact acceleration magnitude after loss of balance using a single inertial measurement unit (IMU) sensor and a sequential-based deep learning model. Twenty-four healthy participants participated in this study for fall experiments. Each participant worn a single IMU sensor on the waist to collect tri-axial accelerometer and angular velocity data. A deep learning method, bi-directional long short-term memory (LSTM) regression, is applied to predict a fall's impact acceleration magnitude prior to fall impact (a fall in five directions). To improve prediction performance, a data augmentation technique with increment of dataset is applied. Our proposed model showed a mean absolute percentage error (MAPE) of 6.69 ± 0.33% with r value of 0.93 when all three different types of data augmentation techniques are applied. Additionally, there was a significant reduction of MAPE by 45.2% when the number of training datasets was increased by 4-fold. These results show that impact acceleration magnitude can be used as an activation parameter for fall prevention such as in a wearable airbag system by optimizing deployment process to minimize fall injury in real time.
Collapse
|
13
|
Smart Environments and Social Robots for Age-Friendly Integrated Care Services. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:ijerph17113801. [PMID: 32471108 PMCID: PMC7312538 DOI: 10.3390/ijerph17113801] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Revised: 05/25/2020] [Accepted: 05/26/2020] [Indexed: 12/13/2022]
Abstract
The world is facing major societal challenges because of an aging population that is putting increasing pressure on the sustainability of care. While demand for care and social services is steadily increasing, the supply is constrained by the decreasing workforce. The development of smart, physical, social and age-friendly environments is identified by World Health Organization (WHO) as a key intervention point for enabling older adults, enabling them to remain as much possible in their residences, delay institutionalization, and ultimately, improve quality of life. In this study, we survey smart environments, machine learning and robot assistive technologies that can offer support for the independent living of older adults and provide age-friendly care services. We describe two examples of integrated care services that are using assistive technologies in innovative ways to assess and deliver of timely interventions for polypharmacy management and for social and cognitive activity support in older adults. We describe the architectural views of these services, focusing on details about technology usage, end-user interaction flows and data models that are developed or enhanced to achieve the envisioned objective of healthier, safer, more independent and socially connected older people.
Collapse
|
14
|
A Survey on Recent Advances in Wearable Fall Detection Systems. BIOMED RESEARCH INTERNATIONAL 2020; 2020:2167160. [PMID: 32420327 PMCID: PMC7201510 DOI: 10.1155/2020/2167160] [Citation(s) in RCA: 54] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Revised: 10/08/2019] [Accepted: 11/23/2019] [Indexed: 11/18/2022]
Abstract
With advances in medicine and healthcare systems, the average life expectancy of human beings has increased to more than 80 yrs. As a result, the demographic old-age dependency ratio (people aged 65 or above relative to those aged 15–64) is expected to increase, by 2060, from ∼28% to ∼50% in the European Union and from ∼33% to ∼45% in Asia (Ageing Report European Economy, 2015). Therefore, the percentage of people who need additional care is also expected to increase. For instance, per studies conducted by the National Program for Health Care of the Elderly (NPHCE), elderly population in India will increase to 12% of the national population by 2025 with 8%–10% requiring utmost care. Geriatric healthcare has gained a lot of prominence in recent years, with specific focus on fall detection systems (FDSs) because of their impact on public lives. According to a World Health Organization report, the frequency of falls increases with increase in age and frailty. Older people living in nursing homes fall more often than those living in the community and 40% of them experience recurrent falls (World Health Organization, 2007). Machine learning (ML) has found its application in geriatric healthcare systems, especially in FDSs. In this paper, we examine the requirements of a typical FDS. Then we present a survey of the recent work in the area of fall detection systems, with focus on the application of machine learning. We also analyze the challenges in FDS systems based on the literature survey.
Collapse
|
15
|
Abstract
Due to the serious impact of falls on the quality of life of the elderly and on the economical sustainability of health systems, the study of new monitoring systems capable of automatically alerting about falls has gained much research interest during the last decade. In the field of Human Activity Recognition, Fall Detection Systems (FDSs) can be contemplated as pattern recognition architectures able to discriminate falls from ordinary Activities of Daily Living (ADLs). In this regard, the combined application of cellular communications and wearable devices that integrate inertial sensors offers a cost-efficient solution to track the user mobility almost ubiquitously. Inertial Measurement Units (IMUs) typically utilized for these architectures, embed an accelerometer and a gyroscope. This paper investigates if the use of the angular velocity (captured by the gyroscope) as an input feature of the movement classifier introduces any benefit with respect to the most common case in which the classification decision is uniquely based on the accelerometry signals. For this purpose, the work assesses the performance of a deep learning architecture (a convolutional neural network) which is optimized to differentiate falls from ADLs as a function of the raw data measured by the two inertial sensors (gyroscope and accelerometer). The system is evaluated against on a well-known public dataset with a high number of mobility traces (falls and ADL) measured from the movements of a wide group of experimental users.
Collapse
|
16
|
A Study on the Application of Convolutional Neural Networks to Fall Detection Evaluated with Multiple Public Datasets. SENSORS 2020; 20:s20051466. [PMID: 32155936 PMCID: PMC7085732 DOI: 10.3390/s20051466] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2020] [Revised: 03/04/2020] [Accepted: 03/05/2020] [Indexed: 01/15/2023]
Abstract
Due to the repercussion of falls on both the health and self-sufficiency of older people and on the financial sustainability of healthcare systems, the study of wearable fall detection systems (FDSs) has gained much attention during the last years. The core of a FDS is the algorithm that discriminates falls from conventional Activities of Daily Life (ADLs). This work presents and evaluates a convolutional deep neural network when it is applied to identify fall patterns based on the measurements collected by a transportable tri-axial accelerometer. In contrast with most works in the related literature, the evaluation is performed against a wide set of public data repositories containing the traces obtained from diverse groups of volunteers during the execution of ADLs and mimicked falls. Although the method can yield very good results when it is hyper-parameterized for a certain dataset, the global evaluation with the other repositories highlights the difficulty of extrapolating to other testbeds the network architecture that was configured and optimized for a particular dataset.
Collapse
|
17
|
Aprigliano F, Micera S, Monaco V. Pre-Impact Detection Algorithm to Identify Tripping Events Using Wearable Sensors. SENSORS (BASEL, SWITZERLAND) 2019; 19:E3713. [PMID: 31461908 PMCID: PMC6749342 DOI: 10.3390/s19173713] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2019] [Revised: 08/22/2019] [Accepted: 08/26/2019] [Indexed: 02/02/2023]
Abstract
This study aimed to investigate the performance of an updated version of our pre-impact detection algorithm parsing out the output of a set of Inertial Measurement Units (IMUs) placed on lower limbs and designed to recognize signs of lack of balance due to tripping. Eight young subjects were asked to manage tripping events while walking on a treadmill. An adaptive threshold-based algorithm, relying on a pool of adaptive oscillators, was tuned to identify abrupt kinematics modifications during tripping. Inputs of the algorithm were the elevation angles of lower limb segments, as estimated by IMUs located on thighs, shanks and feet. The results showed that the proposed algorithm can identify a lack of balance in about 0.37 ± 0.11 s after the onset of the perturbation, with a low percentage of false alarms (<10%), by using only data related to the perturbed shank. The proposed algorithm can hence be considered a multi-purpose tool to identify different perturbations (i.e., slippage and tripping). In this respect, it can be implemented for different wearable applications (e.g., smart garments or wearable robots) and adopted during daily life activities to enable on-demand injury prevention systems prior to fall impacts.
Collapse
Affiliation(s)
| | - Silvestro Micera
- The BioRobotics Institute, Scuola Superiore Sant'Anna, 56127 Pisa, Italy
- Bertarelli Foundation Chair in Translational Neuroengineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, Ecole Polytechnique Federale de Lausanne, 1015 Lausanne, Switzerland
| | - Vito Monaco
- The BioRobotics Institute, Scuola Superiore Sant'Anna, 56127 Pisa, Italy.
- IRCCS Fondazione Don Carlo Gnocchi, 20148 Milan, Italy.
| |
Collapse
|
18
|
Liu X, Li H, Lou C, Liang T, Liu X, Wang H. A New Approach to Fall Detection Based on Improved Dual Parallel Channels Convolutional Neural Network. SENSORS 2019; 19:s19122814. [PMID: 31238537 PMCID: PMC6630266 DOI: 10.3390/s19122814] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/05/2019] [Revised: 06/15/2019] [Accepted: 06/21/2019] [Indexed: 11/16/2022]
Abstract
Falls are the major cause of fatal and non-fatal injury among people aged more than 65 years. Due to the grave consequences of the occurrence of falls, it is necessary to conduct thorough research on falls. This paper presents a method for the study of fall detection using surface electromyography (sEMG) based on an improved dual parallel channels convolutional neural network (IDPC-CNN). The proposed IDPC-CNN model is designed to identify falls from daily activities using the spectral features of sEMG. Firstly, the classification accuracy of time domain features and spectrograms are compared using linear discriminant analysis (LDA), k-nearest neighbor (KNN) and support vector machine (SVM). Results show that spectrograms provide a richer way to extract pattern information and better classification performance. Therefore, the spectrogram features of sEMG are selected as the input of IDPC-CNN to distinguish between daily activities and falls. Finally, The IDPC-CNN is compared with SVM and three different structure CNNs under the same conditions. Experimental results show that the proposed IDPC-CNN achieves 92.55% accuracy, 95.71% sensitivity and 91.7% specificity. Overall, The IDPC-CNN is more effective than the comparison in accuracy, efficiency, training and generalization.
Collapse
Affiliation(s)
- Xiaoguang Liu
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China.
- Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding 071002, China.
| | - Huanliang Li
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China.
- Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding 071002, China.
| | - Cunguang Lou
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China.
- Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding 071002, China.
| | - Tie Liang
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China.
- Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding 071002, China.
| | - Xiuling Liu
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China.
- Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding 071002, China.
| | - Hongrui Wang
- College of Electronic and Information Engineering, Hebei University, Baoding 071002, China.
- Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding 071002, China.
| |
Collapse
|
19
|
Ribeiro NF, André J, Costa L, Santos CP. Development of a Strategy to Predict and Detect Falls Using Wearable Sensors. J Med Syst 2019; 43:134. [PMID: 30949770 DOI: 10.1007/s10916-019-1252-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2018] [Accepted: 03/18/2019] [Indexed: 11/27/2022]
Abstract
Falls are a prevalent problem in actual society. Some falls result in injuries and the cost associated with their treatment is high. This is a complex problem that requires several steps in order to be tackled. Firstly, it is crucial to develop strategies that recognize the locomotion mode, indicating the state of the subject in various situations. This article aims to develop a strategy capable of identifying normal gait, the pre-fall condition, and the fall situation, based on a wearable system (IMUs-based). This system was used to collect data from healthy subjects that mimicked falls. The strategy consists, essentially, in the construction and use of classifiers as tools for recognizing the locomotion modes. Two approaches were explored. Associative Skill Memories (ASMs) based classifier and a Convolutional Neural Network (CNN) classifier based on deep learning. Finally, these classifiers were compared, providing for a tool with a good accuracy in recognizing the locomotion modes. Results have shown that the accuracy of the classifiers was quite acceptable. The CNN presented the best results with 92.71% of accuracy considering the pre-fall step different from normal steps, and 100% when not considering.
Collapse
Affiliation(s)
- Nuno Ferrete Ribeiro
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058, Guimarães, Portugal.
| | - João André
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058, Guimarães, Portugal
| | - Lino Costa
- Production and Systems Department, University of Minho, 4800-058, Guimarães, Portugal
| | - Cristina P Santos
- Center for MicroElectroMechanical Systems (CMEMS), University of Minho, 4800-058, Guimarães, Portugal
| |
Collapse
|
20
|
Scheurer S, Koch J, Kucera M, Bryn H, Bärtschi M, Meerstetter T, Nef T, Urwyler P. Optimization and Technical Validation of the AIDE-MOI Fall Detection Algorithm in a Real-Life Setting with Older Adults. SENSORS 2019; 19:s19061357. [PMID: 30889925 PMCID: PMC6470846 DOI: 10.3390/s19061357] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Revised: 03/11/2019] [Accepted: 03/11/2019] [Indexed: 11/16/2022]
Abstract
Falls are the primary contributors of accidents in elderly people. An important factor of fall severity is the amount of time that people lie on the ground. To minimize consequences through a short reaction time, the motion sensor "AIDE-MOI" was developed. "AIDE-MOI" senses acceleration data and analyzes if an event is a fall. The threshold-based fall detection algorithm was developed using motion data of young subjects collected in a lab setup. The aim of this study was to improve and validate the existing fall detection algorithm. In the two-phase study, twenty subjects (age 86.25 ± 6.66 years) with a high risk of fall (Morse > 65 points) were recruited to record motion data in real-time using the AIDE-MOI sensor. The data collected in the first phase (59 days) was used to optimize the existing algorithm. The optimized second-generation algorithm was evaluated in a second phase (66 days). The data collected in the two phases, which recorded 31 real falls, was split-up into one-minute chunks for labelling as "fall" or "non-fall". The sensitivity and specificity of the threshold-based algorithm improved significantly from 27.3% to 80.0% and 99.9957% (0.43) to 99.9978% (0.17 false alarms per week and subject), respectively.
Collapse
Affiliation(s)
- Simon Scheurer
- Department of Engineering and Information Technology, Bern University of Applied Sciences, 3401 Burgdorf, Switzerland.
- Oxomed AG, 3097 Liebefeld, Switzerland.
| | - Janina Koch
- Department of Engineering and Information Technology, Bern University of Applied Sciences, 3401 Burgdorf, Switzerland.
- Oxomed AG, 3097 Liebefeld, Switzerland.
| | - Martin Kucera
- Department of Engineering and Information Technology, Bern University of Applied Sciences, 3401 Burgdorf, Switzerland.
| | - Hȧkon Bryn
- Department of Engineering and Information Technology, Bern University of Applied Sciences, 3401 Burgdorf, Switzerland.
| | - Marcel Bärtschi
- Department of Engineering and Information Technology, Bern University of Applied Sciences, 3401 Burgdorf, Switzerland.
| | - Tobias Meerstetter
- Department of Engineering and Information Technology, Bern University of Applied Sciences, 3401 Burgdorf, Switzerland.
- Oxomed AG, 3097 Liebefeld, Switzerland.
| | - Tobias Nef
- Gerontechnology and Rehabilitation Group, University of Bern, 3008 Bern, Switzerland.
- ARTORG Center for Biomedical Engineering Research, University of Bern, 3008 Bern, Switzerland.
| | - Prabitha Urwyler
- Gerontechnology and Rehabilitation Group, University of Bern, 3008 Bern, Switzerland.
- ARTORG Center for Biomedical Engineering Research, University of Bern, 3008 Bern, Switzerland.
- University Neurorehabilitation Unit, Department of Neurology, University Hospital Inselspital, 3010 Bern, Switzerland.
| |
Collapse
|
21
|
Falls management framework for supporting an independent lifestyle for older adults: a systematic review. Aging Clin Exp Res 2018; 30:1275-1286. [PMID: 30196346 DOI: 10.1007/s40520-018-1026-6] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2018] [Accepted: 08/13/2018] [Indexed: 10/28/2022]
Abstract
Falls are one of the common health and well-being issues among the older adults. Internet of things (IoT)-based health monitoring systems have been developed over the past two decades for improving healthcare services for older adults to support an independent lifestyle. This research systematically reviews technological applications related to falls detection and falls management. The systematic review was conducted in accordance to the preferred reporting items for systematic reviews and meta-analysis statement (PRISMA). Twenty-four studies out of 806 articles published between 2015 and 2017 were identified and included in this review. Selected studies were related to pre-fall and post-fall applications using motion sensors (10; 41.67%), environment sensors (10; 41.67%) and few studies used the combination of these types of sensors (4; 16.67%). As an outcome of this review, we postulated a falls management framework (FMF). FMF considered pre- and post-fall strategies to support older adults live independently. A part of this approach involved active analysis of sensor data with the aim of helping the older adults manage their risk of fall and stay safe in their home. FMF aimed to serve the researchers, developers, clinicians and policy makers with pre- and post-falls management strategies to enhance the older adults' independent living and well-being.
Collapse
|
22
|
Accurate Fall Detection and Localization for Elderly People Based on Neural Network and Energy-Efficient Wireless Sensor Network. ENERGIES 2018. [DOI: 10.3390/en11112866] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Falls are the main source of injury for elderly patients with epilepsy and Parkinson’s disease. Elderly people who carry battery powered health monitoring systems can move unhindered from one place to another according to their activities, thus improving their quality of life. This paper aims to detect when an elderly individual falls and to provide accurate location of the incident while the individual is moving in indoor environments such as in houses, medical health care centers, and hospitals. Fall detection is accurately determined based on a proposed sensor-based fall detection algorithm, whereas the localization of the elderly person is determined based on an artificial neural network (ANN). In addition, the power consumption of the fall detection system (FDS) is minimized based on a data-driven algorithm. Results show that an elderly fall can be detected with accuracy levels of 100% and 92.5% for line-of-sight (LOS) and non-line-of-sight (NLOS) environments, respectively. In addition, elderly indoor localization error is improved with a mean absolute error of 0.0094 and 0.0454 m for LOS and NLOS, respectively, after the application of the ANN optimization technique. Moreover, the battery life of the FDS is improved relative to conventional implementation due to reduced computational effort. The proposed FDS outperforms existing systems in terms of fall detection accuracy, localization errors, and power consumption.
Collapse
|
23
|
Mao A, Ma X, He Y, Luo J. Highly Portable, Sensor-Based System for Human Fall Monitoring. SENSORS 2017; 17:s17092096. [PMID: 28902149 PMCID: PMC5620950 DOI: 10.3390/s17092096] [Citation(s) in RCA: 61] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/12/2017] [Revised: 09/04/2017] [Accepted: 09/11/2017] [Indexed: 11/16/2022]
Abstract
Falls are a very dangerous situation especially among elderly people, because they may lead to fractures, concussion, and other injuries. Without timely rescue, falls may even endanger their lives. The existing optical sensor-based fall monitoring systems have some disadvantages, such as limited monitoring range and inconvenience to carry for users. Furthermore, the fall detection system based only on an accelerometer often mistakenly determines some activities of daily living (ADL) as falls, leading to low accuracy in fall detection. We propose a human fall monitoring system consisting of a highly portable sensor unit including a triaxis accelerometer, a triaxis gyroscope, and a triaxis magnetometer, and a mobile phone. With the data from these sensors, we obtain the acceleration and Euler angle (yaw, pitch, and roll), which represents the orientation of the user's body. Then, a proposed fall detection algorithm was used to detect falls based on the acceleration and Euler angle. With this monitoring system, we design a series of simulated falls and ADL and conduct the experiment by placing the sensors on the shoulder, waist, and foot of the subjects. Through the experiment, we re-identify the threshold of acceleration for accurate fall detection and verify the best body location to place the sensors by comparing the detection performance on different body segments. We also compared this monitoring system with other similar works and found that better fall detection accuracy and portability can be achieved by our system.
Collapse
Affiliation(s)
- Aihua Mao
- School of Computer Science & Engineering, South China University of Technology, Guangzhou 510006, China.
| | - Xuedong Ma
- School of Electronic and Information Engineering, South China University of Technology, Guangzhou 510006, China.
| | - Yinan He
- School of Computer Science & Engineering, South China University of Technology, Guangzhou 510006, China.
| | - Jie Luo
- School of Fine Art and Artistic Design, Guangzhou University, Guangzhou 510006, China.
| |
Collapse
|
24
|
Guvensan MA, Kansiz AO, Camgoz NC, Turkmen HI, Yavuz AG, Karsligil ME. An Energy-Efficient Multi-Tier Architecture for Fall Detection Using Smartphones. SENSORS (BASEL, SWITZERLAND) 2017; 17:E1487. [PMID: 28644378 PMCID: PMC5539688 DOI: 10.3390/s17071487] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2017] [Revised: 06/12/2017] [Accepted: 06/17/2017] [Indexed: 11/27/2022]
Abstract
Automatic detection of fall events is vital to providing fast medical assistance to the causality, particularly when the injury causes loss of consciousness. Optimization of the energy consumption of mobile applications, especially those which run 24/7 in the background, is essential for longer use of smartphones. In order to improve energy-efficiency without compromising on the fall detection performance, we propose a novel 3-tier architecture that combines simple thresholding methods with machine learning algorithms. The proposed method is implemented on a mobile application, called uSurvive, for Android smartphones. It runs as a background service and monitors the activities of a person in daily life and automatically sends a notification to the appropriate authorities and/or user defined contacts when it detects a fall. The performance of the proposed method was evaluated in terms of fall detection performance and energy consumption. Real life performance tests conducted on two different models of smartphone demonstrate that our 3-tier architecture with feature reduction could save up to 62% of energy compared to machine learning only solutions. In addition to this energy saving, the hybrid method has a 93% of accuracy, which is superior to thresholding methods and better than machine learning only solutions.
Collapse
Affiliation(s)
- M Amac Guvensan
- Department of Computer Engineering, Yildiz Technical University, 34220 Istanbul, Turkey.
| | - A Oguz Kansiz
- IT Department, Garanti Technology, 34212 Istanbul, Turkey.
| | - N Cihan Camgoz
- Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, GU2 7XH Guildford, UK.
| | - H Irem Turkmen
- Department of Computer Engineering, Yildiz Technical University, 34220 Istanbul, Turkey.
| | - A Gokhan Yavuz
- Department of Computer Engineering, Yildiz Technical University, 34220 Istanbul, Turkey.
| | - M Elif Karsligil
- Department of Computer Engineering, Yildiz Technical University, 34220 Istanbul, Turkey.
| |
Collapse
|
25
|
Godfrey A. Wearables for independent living in older adults: Gait and falls. Maturitas 2017; 100:16-26. [PMID: 28539173 DOI: 10.1016/j.maturitas.2017.03.317] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2017] [Accepted: 03/22/2017] [Indexed: 01/15/2023]
Abstract
Solutions are needed to satisfy care demands of older adults to live independently. Wearable technology (wearables) is one approach that offers a viable means for ubiquitous, sustainable and scalable monitoring of the health of older adults in habitual free-living environments. Gait has been presented as a relevant (bio)marker in ageing and pathological studies, with objective assessment achievable by inertial-based wearables. Commercial wearables have struggled to provide accurate analytics and have been limited by non-clinically oriented gait outcomes. Moreover, some research-grade wearables also fail to provide transparent functionality due to limitations in proprietary software. Innovation within this field is often sporadic, with large heterogeneity of wearable types and algorithms for gait outcomes leading to a lack of pragmatic use. This review provides a summary of the recent literature on gait assessment through the use of wearables, focusing on the need for an algorithm fusion approach to measurement, culminating in the ability to better detect and classify falls. A brief presentation of wearables in one pathological group is presented, identifying appropriate work for researchers in other cohorts to utilise. Suggestions for how this domain needs to progress are also summarised.
Collapse
Affiliation(s)
- A Godfrey
- Newcastle University Business School, Newcastle University Institute for Ageing, Newcastle University, Newcastle upon Tyne, United Kingdom; Institute of Neuroscience, Newcastle University Institute for Ageing, Newcastle University, Newcastle upon Tyne, United Kingdom.
| |
Collapse
|