1
|
Moutsis SN, Tsintotas KA, Gasteratos A. PIPTO: Precise Inertial-Based Pipeline for Threshold-Based Fall Detection Using Three-Axis Accelerometers. SENSORS (BASEL, SWITZERLAND) 2023; 23:7951. [PMID: 37766008 PMCID: PMC10534597 DOI: 10.3390/s23187951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 09/04/2023] [Accepted: 09/11/2023] [Indexed: 09/29/2023]
Abstract
After traffic-related incidents, falls are the second cause of human death, presenting the highest percentage among the elderly. Aiming to address this problem, the research community has developed methods built upon different sensors, such as wearable, ambiance, or hybrid, and various techniques, such as those that are machine learning- and heuristic based. Concerning the models used in the former case, they classify the input data between fall and no fall, and specific data dimensions are required. Yet, when algorithms that adopt heuristic techniques, mainly using thresholds, are combined with the previous models, they reduce the computational cost. To this end, this article presents a pipeline for detecting falls through a threshold-based technique over the data provided by a three-axis accelerometer. This way, we propose a low-complexity system that can be adopted from any acceleration sensor that receives information at different frequencies. Moreover, the input lengths can differ, while we achieve to detect multiple falls in a time series of sum vector magnitudes, providing the specific time range of the fall. As evaluated on several datasets, our pipeline reaches high performance results at 90.40% and 91.56% sensitivity on MMsys and KFall, respectively, while the generated specificity is 93.96% and 85.90%. Lastly, aiming to facilitate the research community, our framework, entitled PIPTO (drawing inspiration from the Greek verb "πι´πτω", signifying "to fall"), is open sourced in Python and C.
Collapse
Affiliation(s)
- Stavros N. Moutsis
- Department of Production and Management Engineering, Democritus University of Thrace, 12 Vas. Sophias, GR-671 32 Xanthi, Greece; (K.A.T.); (A.G.)
| | | | | |
Collapse
|
2
|
Lin HC, Chen MJ, Lee CH, Kung LC, Huang JT. Fall Recognition Based on an IMU Wearable Device and Fall Verification through a Smart Speaker and the IoT. SENSORS (BASEL, SWITZERLAND) 2023; 23:5472. [PMID: 37420638 DOI: 10.3390/s23125472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Revised: 06/05/2023] [Accepted: 06/06/2023] [Indexed: 07/09/2023]
Abstract
A fall is one of the most devastating events that aging people can experience. Fall-related physical injuries, hospital admission, or even mortality among the elderly are all critical health issues. As the population continues to age worldwide, there is an imperative need to develop fall detection systems. We propose a system for the recognition and verification of falls based on a chest-worn wearable device, which can be used for elderly health institutions or home care. The wearable device utilizes a built-in three-axis accelerometer and gyroscope in the nine-axis inertial sensor to determine the user's postures, such as standing, sitting, and lying down. The resultant force was obtained by calculation with three-axis acceleration. Integration of three-axis acceleration and a three-axis gyroscope can obtain a pitch angle through the gradient descent algorithm. The height value was converted from a barometer. Integration of the pitch angle with the height value can determine the behavior state including sitting down, standing up, walking, lying down, and falling. In our study, we can clearly determine the direction of the fall. Acceleration changes during the fall can determine the force of the impact. Furthermore, with the IoT (Internet of Things) and smart speakers, we can verify whether the user has fallen by asking from smart speakers. In this study, posture determination is operated directly on the wearable device through the state machine. The ability to recognize and report a fall event in real-time can help to lessen the response time of a caregiver. The family members or care provider monitor, in real-time, the user's current posture via a mobile device app or internet webpage. All collected data supports subsequent medical evaluation and further intervention.
Collapse
Affiliation(s)
- Hsin-Chang Lin
- Graduate Institute of Mechanical and Electrical Engineering, National Taipei University of Technology, Taipei City 10608, Taiwan
- Division of Nephrology, Department of Internal Medicine, MacKay Memorial Hospital, Taipei City 10449, Taiwan
- Department of Medicine, MacKay Medical College, New Taipei City 25245, Taiwan
- Department of Nursing, MacKay Junior College of Medicine, Nursing, and Management, Taipei City 11260, Taiwan
| | - Ming-Jen Chen
- Department of Medicine, MacKay Medical College, New Taipei City 25245, Taiwan
- Department of Nursing, MacKay Junior College of Medicine, Nursing, and Management, Taipei City 11260, Taiwan
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, MacKay Memorial Hospital, Taipei City 10449, Taiwan
| | - Chao-Hsiung Lee
- Graduate Institute of Mechanical and Electrical Engineering, National Taipei University of Technology, Taipei City 10608, Taiwan
| | - Lu-Chih Kung
- Graduate Institute of Mechanical and Electrical Engineering, National Taipei University of Technology, Taipei City 10608, Taiwan
| | - Jung-Tang Huang
- Graduate Institute of Mechanical and Electrical Engineering, National Taipei University of Technology, Taipei City 10608, Taiwan
| |
Collapse
|
3
|
Bernaś M, Płaczek B, Lewandowski M. Ensemble of RNN Classifiers for Activity Detection Using a Smartphone and Supporting Nodes. SENSORS (BASEL, SWITZERLAND) 2022; 22:9451. [PMID: 36502154 PMCID: PMC9739648 DOI: 10.3390/s22239451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Revised: 11/27/2022] [Accepted: 12/01/2022] [Indexed: 06/17/2023]
Abstract
Nowadays, sensor-equipped mobile devices allow us to detect basic daily activities accurately. However, the accuracy of the existing activity recognition methods decreases rapidly if the set of activities is extended and includes training routines, such as squats, jumps, or arm swings. Thus, this paper proposes a model of a personal area network with a smartphone (as a main node) and supporting sensor nodes that deliver additional data to increase activity-recognition accuracy. The introduced personal area sensor network takes advantage of the information from multiple sensor nodes attached to different parts of the human body. In this scheme, nodes process their sensor readings locally with the use of recurrent neural networks (RNNs) to categorize the activities. Then, the main node collects results from supporting sensor nodes and performs a final activity recognition run based on a weighted voting procedure. In order to save energy and extend the network's lifetime, sensor nodes report their local results only for specific types of recognized activity. The presented method was evaluated during experiments with sensor nodes attached to the waist, chest, leg, and arm. The results obtained for a set of eight activities show that the proposed approach achieves higher recognition accuracy when compared with the existing methods. Based on the experimental results, the optimal configuration of the sensor nodes was determined to maximize the activity-recognition accuracy and reduce the number of transmissions from supporting sensor nodes.
Collapse
Affiliation(s)
- Marcin Bernaś
- Department of Computer Science and Automatics, University of Bielsko-Biała, Willowa 2, 43-309 Bielsko-Biała, Poland
| | - Bartłomiej Płaczek
- Institute of Computer Science, University of Silesia, Będzińska 39, 41-200 Sosnowiec, Poland
| | - Marcin Lewandowski
- Institute of Computer Science, University of Silesia, Będzińska 39, 41-200 Sosnowiec, Poland
| |
Collapse
|
4
|
Kolobe TC, Tu C, Owolawi PA. A Review on Fall Detection in Smart Home for Elderly and Disabled People. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS 2022. [DOI: 10.20965/jaciii.2022.p0747] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Falling is a major challenge faced by elderly and disabled people who live alone. They therefore need reliable surveillance so they can be assisted in the event of a fall. An effective fall detection system is needed to provide good care to such people as it will allow for communication with caregivers. Such a system will not only reduce the medical costs related to falls but also lower the death rate among elderly and disabled people due to falls. This review paper presents a survey of different fall detection techniques and algorithms used for fall detection. Various fall detection approaches including wearable, vision, ambience, and multimodal systems are analyzed and compared and recommendations are presented.
Collapse
|
5
|
Si W, Tan R, Yang G. A novel Internet of Things based fall detection system in smart home. INT J INTELL SYST 2022. [DOI: 10.1002/int.23043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Wen Si
- Department of IoT Engineering Shanghai Business School Shanghai China
| | - Rong Tan
- Department of IoT Engineering Shanghai Business School Shanghai China
| | - Gelan Yang
- Department of Information Science and Engineering Hunan City University Yiyang China
| |
Collapse
|
6
|
Application of Accelerometer to Monitor Students’ Exercise Load in 50 m Round Trip. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:3142677. [PMID: 35814553 PMCID: PMC9259259 DOI: 10.1155/2022/3142677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 05/13/2022] [Accepted: 06/01/2022] [Indexed: 11/17/2022]
Abstract
With the further advancement of microelectronics innovation and sensors, sensors can be broadly implanted in cell phone gadgets, compact gadgets, and so forth. The utilization of speed increase sensors for human running checking has expansive application possibilities. From one perspective, the everyday development of the human body is firmly connected with the physical and emotional wellness of the person. Observing the day-to-day developments of the human body is of incredible importance in planning a logical running activity plan and working on actual wellbeing. On the other hand, it is also of practical value to monitor human abnormal movements. This kind of abnormal movement caused by accidental falls can bring certain harm to the human body. Real-time monitoring of the fall can provide timely assistance to the person and reduce the risk brought by the fall. This article analyzes and summarizes the research theories and common research methods in the field of 50 m round-trip movement monitoring based on the acceleration sensor. According to the process of 50 m round-trip movement pattern recognition, the data collection, preprocessing, feature extraction, and selection of 50 m round-trip movement are evaluated. The classification and recognition of each module were analyzed. This article proposes a human body motion recognition mechanism based on acceleration sensors by looking at the three trademark upsides, the wavefront edge, wavefront limit, and time stretch between the pinnacle and valley of the speed increase sensor vertical information waveform, and joining the rule of choice tree order to accomplish the activities of hunching down, taking off, and running. To get an accurate recognizable proof and recognize ways of behaving, a human fall identification calculation is proposed. This calculation removes human movement attributes throughout the fall and focuses on four sorts of falls: forward fall, reverse fall, left fall, and right fall by utilizing the connection of the three tomahawks of the speed increase sensor. The trial results show that the normal right acknowledgment pace of the human body's 50 m full-circle running way of behaviour is more than 90%, which has specific useful application esteem.
Collapse
|
7
|
Alizadeh J, Bogdan M, Classen J, Fricke C. Support Vector Machine Classifiers Show High Generalizability in Automatic Fall Detection in Older Adults. SENSORS 2021; 21:s21217166. [PMID: 34770473 PMCID: PMC8588363 DOI: 10.3390/s21217166] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 10/12/2021] [Accepted: 10/25/2021] [Indexed: 11/29/2022]
Abstract
Falls are a major cause of morbidity and mortality in neurological disorders. Technical means of detecting falls are of high interest as they enable rapid notification of caregivers and emergency services. Such approaches must reliably differentiate between normal daily activities and fall events. A promising technique might be based on the classification of movements based on accelerometer signals by machine-learning algorithms, but the generalizability of classifiers trained on laboratory data to real-world datasets is a common issue. Here, three machine-learning algorithms including Support Vector Machine (SVM), k-Nearest Neighbors (kNN), and Random Forest (RF) were trained to detect fall events. We used a dataset containing intentional falls (SisFall) to train the classifier and validated the approach on a different dataset which included real-world accidental fall events of elderly people (FARSEEING). The results suggested that the linear SVM was the most suitable classifier in this cross-dataset validation approach and reliably distinguished a fall event from normal everyday activity at an accuracy of 93% and similarly high sensitivity and specificity. Thus, classifiers based on linear SVM might be useful for automatic fall detection in real-world applications.
Collapse
Affiliation(s)
- Jalal Alizadeh
- Department of Neurology, Leipzig University, 04103 Leipzig, Germany; (J.A.); (J.C.)
- Department of Neuromorphic Information Processing, Leipzig University, 04009 Leipzig, Germany;
| | - Martin Bogdan
- Department of Neuromorphic Information Processing, Leipzig University, 04009 Leipzig, Germany;
| | - Joseph Classen
- Department of Neurology, Leipzig University, 04103 Leipzig, Germany; (J.A.); (J.C.)
| | - Christopher Fricke
- Department of Neurology, Leipzig University, 04103 Leipzig, Germany; (J.A.); (J.C.)
- Correspondence:
| |
Collapse
|
8
|
Usmani S, Saboor A, Haris M, Khan MA, Park H. Latest Research Trends in Fall Detection and Prevention Using Machine Learning: A Systematic Review. SENSORS 2021; 21:s21155134. [PMID: 34372371 PMCID: PMC8347190 DOI: 10.3390/s21155134] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Revised: 07/16/2021] [Accepted: 07/24/2021] [Indexed: 12/15/2022]
Abstract
Falls are unusual actions that cause a significant health risk among older people. The growing percentage of people of old age requires urgent development of fall detection and prevention systems. The emerging technology focuses on developing such systems to improve quality of life, especially for the elderly. A fall prevention system tries to predict and reduce the risk of falls. In contrast, a fall detection system observes the fall and generates a help notification to minimize the consequences of falls. A plethora of technical and review papers exist in the literature with a primary focus on fall detection. Similarly, several studies are relatively old, with a focus on wearables only, and use statistical and threshold-based approaches with a high false alarm rate. Therefore, this paper presents the latest research trends in fall detection and prevention systems using Machine Learning (ML) algorithms. It uses recent studies and analyzes datasets, age groups, ML algorithms, sensors, and location. Additionally, it provides a detailed discussion of the current trends of fall detection and prevention systems with possible future directions. This overview can help researchers understand the current systems and propose new methodologies by improving the highlighted issues.
Collapse
Affiliation(s)
- Sara Usmani
- School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (S.U.); (M.H.)
| | - Abdul Saboor
- Department of Electrical Engineering (ESAT), Katholieke Universiteit (KU) Leuven, 3000 Leuven, Belgium;
| | - Muhammad Haris
- School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (S.U.); (M.H.)
| | - Muneeb A. Khan
- Department of Software, Sangmyung University, Cheonan 31066, Korea;
| | - Heemin Park
- Department of Software, Sangmyung University, Cheonan 31066, Korea;
- Correspondence:
| |
Collapse
|
9
|
Koo B, Kim J, Nam Y, Kim Y. The Performance of Post-Fall Detection Using the Cross-Dataset: Feature Vectors, Classifiers and Processing Conditions. SENSORS 2021; 21:s21144638. [PMID: 34300378 PMCID: PMC8309569 DOI: 10.3390/s21144638] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Revised: 07/01/2021] [Accepted: 07/03/2021] [Indexed: 11/16/2022]
Abstract
In this study, algorithms to detect post-falls were evaluated using the cross-dataset according to feature vectors (time-series and discrete data), classifiers (ANN and SVM), and four different processing conditions (normalization, equalization, increase in the number of training data, and additional training with external data). Three-axis acceleration and angular velocity data were obtained from 30 healthy male subjects by attaching an IMU to the middle of the left and right anterior superior iliac spines (ASIS). Internal and external tests were performed using our lab dataset and SisFall public dataset, respectively. The results showed that ANN and SVM were suitable for the time-series and discrete data, respectively. The classification performance generally decreased, and thus, specific feature vectors from the raw data were necessary when untrained motions were tested using a public dataset. Normalization made SVM and ANN more and less effective, respectively. Equalization increased the sensitivity, even though it did not improve the overall performance. The increase in the number of training data also improved the classification performance. Machine learning was vulnerable to untrained motions, and data of various movements were needed for the training.
Collapse
|
10
|
Šeketa G, Pavlaković L, Džaja D, Lacković I, Magjarević R. Event-Centered Data Segmentation in Accelerometer-Based Fall Detection Algorithms. SENSORS (BASEL, SWITZERLAND) 2021; 21:4335. [PMID: 34202820 PMCID: PMC8272179 DOI: 10.3390/s21134335] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Revised: 06/16/2021] [Accepted: 06/23/2021] [Indexed: 12/27/2022]
Abstract
Automatic fall detection systems ensure that elderly people get prompt assistance after experiencing a fall. Fall detection systems based on accelerometer measurements are widely used because of their portability and low cost. However, the ability of these systems to differentiate falls from Activities of Daily Living (ADL) is still not acceptable for everyday usage at a large scale. More work is still needed to raise the performance of these systems. In our research, we explored an essential but often neglected part of accelerometer-based fall detection systems-data segmentation. The aim of our work was to explore how different configurations of windows for data segmentation affect detection accuracy of a fall detection system and to find the best-performing configuration. For this purpose, we designed a testing environment for fall detection based on a Support Vector Machine (SVM) classifier and evaluated the influence of the number and duration of segmentation windows on the overall detection accuracy. Thereby, an event-centered approach for data segmentation was used, where windows are set relative to a potential fall event detected in the input data. Fall and ADL data records from three publicly available datasets were utilized for the test. We found that a configuration of three sequential windows (pre-impact, impact, and post-impact) provided the highest detection accuracy on all three datasets. The best results were obtained when either a 0.5 s or a 1 s long impact window was used, combined with pre- and post-impact windows of 3.5 s or 3.75 s.
Collapse
Affiliation(s)
| | | | | | - Igor Lacković
- Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia; (G.Š.); (L.P.); (D.D.); (R.M.)
| | | |
Collapse
|
11
|
Hsieh CY, Huang HY, Liu KC, Liu CP, Chan CT, Hsu SJP. Multiphase Identification Algorithm for Fall Recording Systems Using a Single Wearable Inertial Sensor. SENSORS 2021; 21:s21093302. [PMID: 34068804 PMCID: PMC8126206 DOI: 10.3390/s21093302] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/22/2021] [Revised: 05/07/2021] [Accepted: 05/07/2021] [Indexed: 12/19/2022]
Abstract
Fall-related information can help clinical professionals make diagnoses and plan fall prevention strategies. The information includes various characteristics of different fall phases, such as falling time and landing responses. To provide the information of different phases, this pilot study proposes an automatic multiphase identification algorithm for phase-aware fall recording systems. Seven young adults are recruited to perform the fall experiment. One inertial sensor is worn on the waist to collect the data of body movement, and a total of 525 trials are collected. The proposed multiphase identification algorithm combines machine learning techniques and fragment modification algorithm to identify pre-fall, free-fall, impact, resting and recovery phases in a fall process. Five machine learning techniques, including support vector machine, k-nearest neighbor (kNN), naïve Bayesian, decision tree and adaptive boosting, are applied to identify five phases. Fragment modification algorithm uses the rules to detect the fragment whose results are different from the neighbors. The proposed multiphase identification algorithm using the kNN technique achieves the best performance in 82.17% sensitivity, 85.74% precision, 73.51% Jaccard coefficient, and 90.28% accuracy. The results show that the proposed algorithm has the potential to provide automatic fine-grained fall information for clinical measurement and assessment.
Collapse
Affiliation(s)
- Chia-Yeh Hsieh
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan; (C.-Y.H.); (H.-Y.H.); (C.-P.L.); (C.-T.C.)
| | - Hsiang-Yun Huang
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan; (C.-Y.H.); (H.-Y.H.); (C.-P.L.); (C.-T.C.)
| | - Kai-Chun Liu
- Research Center for Information Technology Innovation, Academia Sinica, Taipei 11529, Taiwan;
| | - Chien-Pin Liu
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan; (C.-Y.H.); (H.-Y.H.); (C.-P.L.); (C.-T.C.)
| | - Chia-Tai Chan
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan; (C.-Y.H.); (H.-Y.H.); (C.-P.L.); (C.-T.C.)
| | - Steen Jun-Ping Hsu
- Department of Information Management, Minghsin University of Science and Technology, Hsinchu 30401, Taiwan
- Correspondence:
| |
Collapse
|
12
|
Classifier-Based Data Transmission Reduction in Wearable Sensor Network for Human Activity Monitoring. SENSORS 2020; 21:s21010085. [PMID: 33375625 PMCID: PMC7795086 DOI: 10.3390/s21010085] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 12/21/2020] [Accepted: 12/22/2020] [Indexed: 01/12/2023]
Abstract
The recent development of wireless wearable sensor networks offers a spectrum of new applications in fields of healthcare, medicine, activity monitoring, sport, safety, human-machine interfacing, and beyond. Successful use of this technology depends on lifetime of the battery-powered sensor nodes. This paper presents a new method for extending the lifetime of the wearable sensor networks by avoiding unnecessary data transmissions. The introduced method is based on embedded classifiers that allow sensor nodes to decide if current sensor readings have to be transmitted to cluster head or not. In order to train the classifiers, a procedure was elaborated, which takes into account the impact of data selection on accuracy of a recognition system. This approach was implemented in a prototype of wearable sensor network for human activity monitoring. Real-world experiments were conducted to evaluate the new method in terms of network lifetime, energy consumption, and accuracy of human activity recognition. Results of the experimental evaluation have confirmed that, the proposed method enables significant prolongation of the network lifetime, while preserving high accuracy of the activity recognition. The experiments have also revealed advantages of the method in comparison with state-of-the-art algorithms for data transmission reduction.
Collapse
|
13
|
Accelerometer-Based Fall Detection Using Machine Learning: Training and Testing on Real-World Falls. SENSORS 2020; 20:s20226479. [PMID: 33202738 PMCID: PMC7697900 DOI: 10.3390/s20226479] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Revised: 11/06/2020] [Accepted: 11/11/2020] [Indexed: 12/21/2022]
Abstract
Falling is a significant health problem. Fall detection, to alert for medical attention, has been gaining increasing attention. Still, most of the existing studies use falls simulated in a laboratory environment to test the obtained performance. We analyzed the acceleration signals recorded by an inertial sensor on the lower back during 143 real-world falls (the most extensive collection to date) from the FARSEEING repository. Such data were obtained from continuous real-world monitoring of subjects with a moderate-to-high risk of falling. We designed and tested fall detection algorithms using features inspired by a multiphase fall model and a machine learning approach. The obtained results suggest that algorithms can learn effectively from features extracted from a multiphase fall model, consistently overperforming more conventional features. The most promising method (support vector machines and features from the multiphase fall model) obtained a sensitivity higher than 80%, a false alarm rate per hour of 0.56, and an F-measure of 64.6%. The reported results and methodologies represent an advancement of knowledge on real-world fall detection and suggest useful metrics for characterizing fall detection systems for real-world use.
Collapse
|
14
|
Shi J, Chen D, Wang M. Pre-Impact Fall Detection with CNN-Based Class Activation Mapping Method. SENSORS (BASEL, SWITZERLAND) 2020; 20:E4750. [PMID: 32842652 PMCID: PMC7506847 DOI: 10.3390/s20174750] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/15/2020] [Revised: 08/18/2020] [Accepted: 08/18/2020] [Indexed: 11/21/2022]
Abstract
In this paper, we report our improvement on the prediction accuracy of pre-impact fall detection by applying a learning-based method on the real-time data from an IMU (inertial measurement unit)-sensor mounted on the waist, making it possible to achieve a high accuracy on a wearable device with the extracted features. Using the fixed threshold method is difficult for achieving satisfactory detection accuracy, due to various characteristics and behaviors in the movement of different individuals. In contrast, one could realize high-accuracy detection with machine learning-based methods, but it is difficult to apply them in the wearable devices due to the high hardware requirement. Our method merges the two methods above. We build a convolutional neural network (CNN) with a class activation mapping (CAM) method, which could highlight the class-specific region in the data and obtain a hot map of the fall data. After training on the MobiAct dataset, the model could achieve high-accuracy detection (95.55%) and obtain the region with high contributions to the classification. Then, we manually extract effective features and characteristics of this region and form our special threshold method, achieving pre-impact fall detection in real-world data. Consequently, our method achieves accuracy of 95.33% and a detection time of within 400 ms.
Collapse
Affiliation(s)
- Jingyi Shi
- Institute of Robotics, School of Mechanical Engineering and Automation, Beihang University, Beijing 100191, China;
| | - Diansheng Chen
- Institute of Robotics, School of Mechanical Engineering and Automation, Beihang University, Beijing 100191, China;
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China
| | - Min Wang
- School of General Engineering, Beihang University, Beijing 100191, China;
| |
Collapse
|
15
|
Wang X, Ellul J, Azzopardi G. Elderly Fall Detection Systems: A Literature Survey. Front Robot AI 2020; 7:71. [PMID: 33501238 PMCID: PMC7805655 DOI: 10.3389/frobt.2020.00071] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 04/30/2020] [Indexed: 01/21/2023] Open
Abstract
Falling is among the most damaging event elderly people may experience. With the ever-growing aging population, there is an urgent need for the development of fall detection systems. Thanks to the rapid development of sensor networks and the Internet of Things (IoT), human-computer interaction using sensor fusion has been regarded as an effective method to address the problem of fall detection. In this paper, we provide a literature survey of work conducted on elderly fall detection using sensor networks and IoT. Although there are various existing studies which focus on the fall detection with individual sensors, such as wearable ones and depth cameras, the performance of these systems are still not satisfying as they suffer mostly from high false alarms. Literature shows that fusing the signals of different sensors could result in higher accuracy and lower false alarms, while improving the robustness of such systems. We approach this survey from different perspectives, including data collection, data transmission, sensor fusion, data analysis, security, and privacy. We also review the benchmark data sets available that have been used to quantify the performance of the proposed methods. The survey is meant to provide researchers in the field of elderly fall detection using sensor networks with a summary of progress achieved up to date and to identify areas where further effort would be beneficial.
Collapse
Affiliation(s)
- Xueyi Wang
- Department of Computer Science, Bernoulli Institute for Mathematics, Computer Science and Artificial Intelligence, University of Groningen, Groningen, Netherlands
| | - Joshua Ellul
- Computer Science, Faculty of Information & Communication Technology, University of Malta, Msida, Malta
| | - George Azzopardi
- Department of Computer Science, Bernoulli Institute for Mathematics, Computer Science and Artificial Intelligence, University of Groningen, Groningen, Netherlands
| |
Collapse
|
16
|
A Survey on Recent Advances in Wearable Fall Detection Systems. BIOMED RESEARCH INTERNATIONAL 2020; 2020:2167160. [PMID: 32420327 PMCID: PMC7201510 DOI: 10.1155/2020/2167160] [Citation(s) in RCA: 54] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Revised: 10/08/2019] [Accepted: 11/23/2019] [Indexed: 11/18/2022]
Abstract
With advances in medicine and healthcare systems, the average life expectancy of human beings has increased to more than 80 yrs. As a result, the demographic old-age dependency ratio (people aged 65 or above relative to those aged 15–64) is expected to increase, by 2060, from ∼28% to ∼50% in the European Union and from ∼33% to ∼45% in Asia (Ageing Report European Economy, 2015). Therefore, the percentage of people who need additional care is also expected to increase. For instance, per studies conducted by the National Program for Health Care of the Elderly (NPHCE), elderly population in India will increase to 12% of the national population by 2025 with 8%–10% requiring utmost care. Geriatric healthcare has gained a lot of prominence in recent years, with specific focus on fall detection systems (FDSs) because of their impact on public lives. According to a World Health Organization report, the frequency of falls increases with increase in age and frailty. Older people living in nursing homes fall more often than those living in the community and 40% of them experience recurrent falls (World Health Organization, 2007). Machine learning (ML) has found its application in geriatric healthcare systems, especially in FDSs. In this paper, we examine the requirements of a typical FDS. Then we present a survey of the recent work in the area of fall detection systems, with focus on the application of machine learning. We also analyze the challenges in FDS systems based on the literature survey.
Collapse
|
17
|
Abstract
Due to the serious impact of falls on the quality of life of the elderly and on the economical sustainability of health systems, the study of new monitoring systems capable of automatically alerting about falls has gained much research interest during the last decade. In the field of Human Activity Recognition, Fall Detection Systems (FDSs) can be contemplated as pattern recognition architectures able to discriminate falls from ordinary Activities of Daily Living (ADLs). In this regard, the combined application of cellular communications and wearable devices that integrate inertial sensors offers a cost-efficient solution to track the user mobility almost ubiquitously. Inertial Measurement Units (IMUs) typically utilized for these architectures, embed an accelerometer and a gyroscope. This paper investigates if the use of the angular velocity (captured by the gyroscope) as an input feature of the movement classifier introduces any benefit with respect to the most common case in which the classification decision is uniquely based on the accelerometry signals. For this purpose, the work assesses the performance of a deep learning architecture (a convolutional neural network) which is optimized to differentiate falls from ADLs as a function of the raw data measured by the two inertial sensors (gyroscope and accelerometer). The system is evaluated against on a well-known public dataset with a high number of mobility traces (falls and ADL) measured from the movements of a wide group of experimental users.
Collapse
|
18
|
A Study on the Application of Convolutional Neural Networks to Fall Detection Evaluated with Multiple Public Datasets. SENSORS 2020; 20:s20051466. [PMID: 32155936 PMCID: PMC7085732 DOI: 10.3390/s20051466] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2020] [Revised: 03/04/2020] [Accepted: 03/05/2020] [Indexed: 01/15/2023]
Abstract
Due to the repercussion of falls on both the health and self-sufficiency of older people and on the financial sustainability of healthcare systems, the study of wearable fall detection systems (FDSs) has gained much attention during the last years. The core of a FDS is the algorithm that discriminates falls from conventional Activities of Daily Life (ADLs). This work presents and evaluates a convolutional deep neural network when it is applied to identify fall patterns based on the measurements collected by a transportable tri-axial accelerometer. In contrast with most works in the related literature, the evaluation is performed against a wide set of public data repositories containing the traces obtained from diverse groups of volunteers during the execution of ADLs and mimicked falls. Although the method can yield very good results when it is hyper-parameterized for a certain dataset, the global evaluation with the other repositories highlights the difficulty of extrapolating to other testbeds the network architecture that was configured and optimized for a particular dataset.
Collapse
|
19
|
Kong X, Chen L, Wang Z, Chen Y, Meng L, Tomiyama H. Robust Self-Adaptation Fall-Detection System Based on Camera Height. SENSORS (BASEL, SWITZERLAND) 2019; 19:E3768. [PMID: 31480384 PMCID: PMC6749320 DOI: 10.3390/s19173768] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/21/2019] [Revised: 08/28/2019] [Accepted: 08/29/2019] [Indexed: 11/16/2022]
Abstract
Vision-based fall-detection methods have been previously studied but many have limitations in terms of practicality. Due to differences in rooms, users do not set the camera or sensors at the same height. However, few studies have taken this into consideration. Moreover, some fall-detection methods are lacking in terms of practicality because only standing, sitting and falling are taken into account. Hence, this study constructs a data set consisting of various daily activities and fall events and studies the effect of camera/sensor height on fall-detection accuracy. Each activity in the data set is carried out by eight participants in eight directions and taken with the depth camera at five different heights. Many related studies heavily depended on human segmentation by using Kinect SDK but this is not reliable enough. To address this issue, this study proposes Enhanced Tracking and Denoising Alex-Net (ETDA-Net) to improve tracking and denoising performance and classify fall and non-fall events. Experimental results indicate that fall-detection accuracy is affected by camera height, against which ETDA-Net is robust, outperforming traditional deep learning based fall-detection methods.
Collapse
Affiliation(s)
- Xiangbo Kong
- Graduate School of Science and Engineering, Ritsumeikan University, Kyoto 525-8577, Japan
| | - Lehan Chen
- Graduate School of Science and Engineering, Ritsumeikan University, Kyoto 525-8577, Japan
| | - Zhichen Wang
- Graduate School of Science and Engineering, Ritsumeikan University, Kyoto 525-8577, Japan
| | - Yuxi Chen
- Graduate School of Science and Engineering, Ritsumeikan University, Kyoto 525-8577, Japan.
| | - Lin Meng
- Department of Electronic and Computer Engineering, College of Science and Engineering, Ritsumeikan University, Kyoto 525-8577, Japan.
| | - Hiroyuki Tomiyama
- Department of Electronic and Computer Engineering, College of Science and Engineering, Ritsumeikan University, Kyoto 525-8577, Japan.
| |
Collapse
|
20
|
Villar JR, de la Cal E, Fañez M, González VM, Sedano J. User-centered fall detection using supervised, on-line learning and transfer learning. PROGRESS IN ARTIFICIAL INTELLIGENCE 2019. [DOI: 10.1007/s13748-019-00190-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
|
21
|
Min F, Wang G, Liu N. Collision Detection and Identification on Robot Manipulators Based on Vibration Analysis. SENSORS 2019; 19:s19051080. [PMID: 30832421 PMCID: PMC6427331 DOI: 10.3390/s19051080] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/25/2018] [Revised: 02/11/2019] [Accepted: 02/27/2019] [Indexed: 11/16/2022]
Abstract
Robot manipulators should be able to quickly detect collisions to limit damage due to physical contact. Traditional model-based detection methods in robotics are mainly concentrated on the difference between the estimated and actual applied torque. In this paper, a model independent collision detection method is presented, based on the vibration features generated by collisions. Firstly, the natural frequencies and vibration modal features of the manipulator under collisions are extracted with illustrative examples. Then, a peak frequency based method is developed for the estimation of the vibration modal along the manipulator structure. The vibration modal features are utilized for the construction and training of the artificial neural network for the collision detection task. Furthermore, the proposed networks also generate the location and direction information about contact. The experimental results show the validity of the collision detection and identification scheme, and that it can achieve considerable accuracy.
Collapse
Affiliation(s)
- Feiyan Min
- Department of Electronic Engineering, College of Information Science and Technology, Jinan University, Guangzhou 510632, China.
- Robotics Research Institue of Jinan University, Guangzhou 510632, China.
| | - Gao Wang
- Department of Electronic Engineering, College of Information Science and Technology, Jinan University, Guangzhou 510632, China.
- Robotics Research Institue of Jinan University, Guangzhou 510632, China.
| | - Ning Liu
- Department of Electronic Engineering, College of Information Science and Technology, Jinan University, Guangzhou 510632, China.
- Robotics Research Institue of Jinan University, Guangzhou 510632, China.
| |
Collapse
|
22
|
An Event-Triggered Fault Detection Approach in Cyber-Physical Systems with Sensor Nonlinearities and Deception Attacks. ELECTRONICS 2018. [DOI: 10.3390/electronics7090168] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In this paper, a general event-triggered framework is constructed to investigate the problem of remote fault detection for stochastic cyber-physical systems subject to the additive disturbances, sensor nonlinearities and deception attacks. Both fault-detection residual generation and evaluation module are fully described. Two energy norm indices are presented so that the fault-detection residual has the best sensitivity to faults and the best robustness to unwanted factors including additive disturbances and false information injected by attacker. Moreover, the filter gain and residual weighting matrix are formulated in terms of stochastic Lyapunov function, which can be conveniently solved via standard numerical software. Finally, an application example is presented to verify the performance of fault detection by comparative simulations. The prolonged battery life is experimentally evaluated and analyzed via a wireless node platform.
Collapse
|
23
|
Event-Based Communication and Finite-Time Consensus Control of Mobile Sensor Networks for Environmental Monitoring. SENSORS 2018; 18:s18082547. [PMID: 30081518 PMCID: PMC6112118 DOI: 10.3390/s18082547] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/08/2018] [Revised: 07/28/2018] [Accepted: 08/01/2018] [Indexed: 11/17/2022]
Abstract
This paper deals with the problem of environmental monitoring by designing a cooperative control scheme for mobile sensor networks. The proposed cooperative control scheme includes three main modules: a wireless communication module, a direction decision module, and a motion control module. In the wireless communication module, an event-based communication rule is proposed, which means that mobile sensor nodes do not send their positions, velocities, and the data of environmental attributes to the other sensor nodes in real-time for the coordination and control of mobile sensor networks. Due to using the event-based communication rule, the communication bandwidth can be saved. In the direction decision module, a radial basis function network is used to model the monitored environment and is updated in terms of the sampled environmental data and the environmental data from the other sensor nodes by the wireless communication module. The updated environment model is used to guide the mobile sensor network to move towards the region of interest in order to efficiently model the distribution map of environmental attributes, such as temperature, salinity, and pH values for the monitored environment. In the motion control module, a finite-time consensus control approach is proposed to enable the sensor nodes to quickly change their movement directions in light of the gradient information from the environment model. As a result of using the event-based communication rule in the wireless communication module, the proposed control approach can also lower the updating times of the control signal. In particular, the proposed cooperative control scheme is still efficient under the directed wireless communication situation. Finally, the effectiveness of the proposed cooperative control scheme is illustrated for the problem of environmental monitoring.
Collapse
|
24
|
Gao Y, Li Y, Peng L, Liu J. Design of Event-Triggered Fault-Tolerant Control for Stochastic Systems with Time-Delays. SENSORS 2018; 18:s18061929. [PMID: 29899314 PMCID: PMC6021862 DOI: 10.3390/s18061929] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/18/2018] [Revised: 06/09/2018] [Accepted: 06/11/2018] [Indexed: 11/16/2022]
Abstract
This paper proposes two novel, event-triggered fault-tolerant control strategies for a class of stochastic systems with state delays. The plant is disturbed by a Gaussian process, actuator faults, and unknown disturbances. First, a special case about fault signals that are coupled to the unknown disturbances is discussed, and then a fault-tolerant strategy is designed based on an event condition on system states. Subsequently, a send-on-delta transmission framework is established to deal with the problem of fault-tolerant control strategy against fault signals separated from the external disturbances. Two criteria are provided to design feedback controllers in order to guarantee that the systems are exponentially mean-square stable, and the corresponding H∞-norm disturbance attenuation levels are achieved. Two theorems were obtained by synthesizing the feedback control gains and the desired event conditions in terms of linear matrix inequalities (LMIs). Finally, two numerical examples are provided to illustrate the effectiveness of the proposed theoretical results.
Collapse
Affiliation(s)
- Yi Gao
- Engineering Research Center of Internet of Things Technology Applications Ministry of Education, Jiangnan University, Wuxi 214122, China.
- Jiangsu Provincial Sensor Network Engineering Technology Research Center, Wuxi Institute of Technology, Wuxi 214121, China.
| | - YunJi Li
- Engineering Research Center of Internet of Things Technology Applications Ministry of Education, Jiangnan University, Wuxi 214122, China.
| | - Li Peng
- Engineering Research Center of Internet of Things Technology Applications Ministry of Education, Jiangnan University, Wuxi 214122, China.
- Jiangsu Key Laboratory of IOT Application Technology, Taihu University of Wuxi, Wuxi 214064, China.
| | - Junyu Liu
- Dublin Institute of Technology, 19A Lower Kevin Street, Dublin 8, Ireland.
| |
Collapse
|
25
|
Li Y, Peng L. Event-Triggered Fault Estimation for Stochastic Systems over Multi-Hop Relay Networks with Randomly Occurring Sensor Nonlinearities and Packet Dropouts. SENSORS 2018; 18:s18030731. [PMID: 29495648 PMCID: PMC5876741 DOI: 10.3390/s18030731] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/29/2018] [Revised: 02/24/2018] [Accepted: 02/26/2018] [Indexed: 11/17/2022]
Abstract
Wireless sensors have many new applications where remote estimation is essential. Considering that a remote estimator is located far away from the process and the wireless transmission distance of sensor nodes is limited, sensor nodes always forward data packets to the remote estimator through a series of relays over a multi-hop link. In this paper, we consider a network with sensor nodes and relay nodes where the relay nodes can forward the estimated values to the remote estimator. An event-triggered remote estimator of state and fault with the corresponding data-forwarding scheme is investigated for stochastic systems subject to both randomly occurring nonlinearity and randomly occurring packet dropouts governed by Bernoulli-distributed sequences to achieve a trade-off between estimation accuracy and energy consumption. Recursive Riccati-like matrix equations are established to calculate the estimator gain to minimize an upper bound of the estimator error covariance. Subsequently, a sufficient condition and data-forwarding scheme are presented under which the error covariance is mean-square bounded in the multi-hop links with random packet dropouts. Furthermore, implementation issues of the theoretical results are discussed where a new data-forwarding communication protocol is designed. Finally, the effectiveness of the proposed algorithms and communication protocol are extensively evaluated using an experimental platform that was established for performance evaluation with a sensor and two relay nodes.
Collapse
Affiliation(s)
- Yunji Li
- Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Jiangnan University, Wuxi 214122, China.
| | - Li Peng
- Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Jiangnan University, Wuxi 214122, China.
| |
Collapse
|