1
|
Choi A, Kim TH, Yuhai O, Jeong S, Kim K, Kim H, Mun JH. Deep Learning-Based Near-Fall Detection Algorithm for Fall Risk Monitoring System Using a Single Inertial Measurement Unit. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2385-2394. [PMID: 35969550 DOI: 10.1109/tnsre.2022.3199068] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Proactively detecting falls and preventing injuries are among the primary keys to a healthy life for the elderly. Near-fall remote monitoring in daily life could provide key information to prevent future falls and obtain quantitative rehabilitation status for patients with weak balance ability. In this study, we developed a deep learning-based novel classification algorithm to precisely categorize three classes (falls, near-falls, and activities of daily living (ADLs)) using a single inertial measurement unit (IMU) device attached to the waist. A total of 34 young participants were included in this study. An IMU containing accelerometer and gyroscope sensors was fabricated to acquire acceleration and angular velocity signals. A comprehensive experiment including thirty-six types of activities (10 types of falls, 10 types of near-falls, and 16 types of ADLs) was designed based on previous studies. A modified directed acyclic graph-convolution neural network (DAG-CNN) architecture with hyperparameter optimization was proposed to predict fall, near-fall, and ADLs. Prediction results of the modified DAG-CNN structure were found to be approximately 7% more accurate than the traditional CNN structure. For the case of near-falls, the modified DAG-CNN demonstrated excellent prediction performance with accuracy of over 98% by combining gyroscope and accelerometer features. Additionally, by combining acceleration and angular velocity the trained model showed better performance than each model of acceleration and angular velocity. It is believed that information to preemptively handle the risk of falls and quantitatively evaluate the rehabilitation status of the elderly with weak balance will be provided by monitoring near-falls.
Collapse
|
2
|
|
3
|
Lin F, Wang Z, Zhao H, Qiu S, Shi X, Wu L, Gravina R, Fortino G. Adaptive Multimodal Fusion Framework for Activity Monitoring of People with Mobility Disability. IEEE J Biomed Health Inform 2022; 26:4314-4324. [PMID: 35439149 DOI: 10.1109/jbhi.2022.3168004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The development of activity recognition based on multi-modal data makes it possible to reduce human intervention in the process of monitoring. This paper proposes an efficient and cost-effective multi-modal sensing framework for activity monitoring, it can automatically identify human activities based on multi-modal data, and provide help to patients with moderate disabilities. The multi-modal sensing framework for activity monitoring relies on parallel processing of videos and inertial data. A new supervised adaptive multi-modal fusion method (AMFM) is used to process multi-modal human activity data. Spatio-temporal graph convolution network with adaptive loss function (ALSTGCN) is proposed to extract skeleton sequence features, and long short-term memory fully convolutional network (LSTM-FCN) module with adaptive loss function is adapted to extract inertial data features. An adaptive learning method is proposed at the decision level to learn the contribution of the two modalities to the classification results. The effectiveness of the algorithm is demonstrated on two public multi-modal datasets (UTD-MHAD and C-MHAD) and a new multi-modal dataset H-MHAD collected from our laboratory. The results show that the performance of the AMFM approach on three datasets is better than the performance of the video or the inertial-based single-modality model. The class-balanced cross-entropy loss function further improves the model performance based on the H-MHAD dataset. The accuracy of action recognition is 91.18%, and the recall rate of falling activity is 100%. The results illustrate that using multiple heterogeneous sensors to realize automatic process monitoring is a feasible alternative to the manual response.
Collapse
|
4
|
|
5
|
Fáñez M, Villar JR, de la Cal E, González VM, Sedano J, Khojasteh SB. Mixing user-centered and generalized models for Fall Detection. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.02.133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
6
|
Yu X, Jang J, Xiong S. A Large-Scale Open Motion Dataset (KFall) and Benchmark Algorithms for Detecting Pre-impact Fall of the Elderly Using Wearable Inertial Sensors. Front Aging Neurosci 2021; 13:692865. [PMID: 34335231 PMCID: PMC8322729 DOI: 10.3389/fnagi.2021.692865] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Accepted: 06/15/2021] [Indexed: 11/18/2022] Open
Abstract
Research on pre-impact fall detection with wearable inertial sensors (detecting fall accidents prior to body-ground impacts) has grown rapidly in the past decade due to its great potential for developing an on-demand fall-related injury prevention system. However, most researchers use their own datasets to develop fall detection algorithms and rarely make these datasets publicly available, which poses a challenge to fairly evaluate the performance of different algorithms on a common basis. Even though some open datasets have been established recently, most of them are impractical for pre-impact fall detection due to the lack of temporal labels for fall time and limited types of motions. In order to overcome these limitations, in this study, we proposed and publicly provided a large-scale motion dataset called “KFall,” which was developed from 32 Korean participants while wearing an inertial sensor on the low back and performing 21 types of activities of daily living and 15 types of simulated falls. In addition, ready-to-use temporal labels of the fall time based on synchronized motion videos were published along with the dataset. Those enhancements make KFall the first public dataset suitable for pre-impact fall detection, not just for post-fall detection. Importantly, we have also developed three different types of latest algorithms (threshold based, support-vector machine, and deep learning), using the KFall dataset for pre-impact fall detection so that researchers and practitioners can flexibly choose the corresponding algorithm. Deep learning algorithm achieved both high overall accuracy and balanced sensitivity (99.32%) and specificity (99.01%) for pre-impact fall detection. Support vector machine also demonstrated a good performance with a sensitivity of 99.77% and specificity of 94.87%. However, the threshold-based algorithm showed relatively poor results, especially the specificity (83.43%) was much lower than the sensitivity (95.50%). The performance of these algorithms could be regarded as a benchmark for further development of better algorithms with this new dataset. This large-scale motion dataset and benchmark algorithms could provide researchers and practitioners with valuable data and references to develop new technologies and strategies for pre-impact fall detection and proactive injury prevention for the elderly.
Collapse
Affiliation(s)
- Xiaoqun Yu
- Department of Industrial and Systems Engineering, College of Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | - Jaehyuk Jang
- Department of Industrial and Systems Engineering, College of Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | - Shuping Xiong
- Department of Industrial and Systems Engineering, College of Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| |
Collapse
|
7
|
Pishgar M, Issa SF, Sietsema M, Pratap P, Darabi H. REDECA: A Novel Framework to Review Artificial Intelligence and Its Applications in Occupational Safety and Health. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18136705. [PMID: 34206378 PMCID: PMC8296875 DOI: 10.3390/ijerph18136705] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 06/09/2021] [Accepted: 06/15/2021] [Indexed: 01/04/2023]
Abstract
Introduction: The field of artificial intelligence (AI) is rapidly expanding, with many applications seen routinely in health care, industry, and education, and increasingly in workplaces. Although there is growing evidence of applications of AI in workplaces across all industries to simplify and/or automate tasks there is a limited understanding of the role that AI contributes in addressing occupational safety and health (OSH) concerns. Methods: This paper introduces a new framework called Risk Evolution, Detection, Evaluation, and Control of Accidents (REDECA) that highlights the role that AI plays in the anticipation and control of exposure risks in a worker’s immediate environment. Two hundred and sixty AI papers across five sectors (oil and gas, mining, transportation, construction, and agriculture) were reviewed using the REDECA framework to highlight current applications and gaps in OSH and AI fields. Results: The REDECA framework highlighted the unique attributes and research focus of each of the five industrial sectors. The majority of evidence of AI in OSH research within the oil/gas and transportation sectors focused on the development of sensors to detect hazardous situations. In construction the focus was on the use of sensors to detect incidents. The research in the agriculture sector focused on sensors and actuators that removed workers from hazardous conditions. Application of the REDECA framework highlighted AI/OSH strengths and opportunities in various industries and potential areas for collaboration. Conclusions: As AI applications across industries continue to increase, further exploration of the benefits and challenges of AI applications in OSH is needed to optimally protect worker health, safety and well-being.
Collapse
Affiliation(s)
- Maryam Pishgar
- Mechanical and Industrial Engineering, University of Illinois at Chicago, Chicago, IL 60609, USA;
| | - Salah Fuad Issa
- Agricultural and Biological Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA;
| | - Margaret Sietsema
- Environmental and Occupational Health Sciences, University of Illinois at Chicago, Chicago, IL 60612, USA; (M.S.); (P.P.)
| | - Preethi Pratap
- Environmental and Occupational Health Sciences, University of Illinois at Chicago, Chicago, IL 60612, USA; (M.S.); (P.P.)
| | - Houshang Darabi
- Mechanical and Industrial Engineering, University of Illinois at Chicago, Chicago, IL 60609, USA;
- Correspondence:
| |
Collapse
|
8
|
Bonifazi G, Corradini E, Ursino D, Virgili L, Anceschi E, De Donato MC. A machine learning based sentient multimedia framework to increase safety at work. MULTIMEDIA TOOLS AND APPLICATIONS 2021; 81:141-169. [PMID: 34025207 PMCID: PMC8122213 DOI: 10.1007/s11042-021-10984-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 01/26/2021] [Accepted: 04/30/2021] [Indexed: 06/12/2023]
Abstract
In the last few decades, we have witnessed an increasing focus on safety in the workplace. ICT has always played a leading role in this context. One ICT sector that is increasingly important in ensuring safety at work is the Internet of Things and, in particular, the new architectures referring to it, such as SIoT, MIoT and Sentient Multimedia Systems. All these architectures handle huge amounts of data to extract predictive and prescriptive information. For this purpose, they often make use of Machine Learning. In this paper, we propose a framework that uses both Sentient Multimedia Systems and Machine Learning to support safety in the workplace. After the general presentation of the framework, we describe its specialization to a particular case, i.e., fall detection. As for this application scenario, we describe a Machine Learning based wearable device for fall detection that we designed, built and tested. Moreover, we illustrate a safety coordination platform for monitoring the work environment, activating alarms in case of falls, and sending appropriate advices to help workers involved in falls.
Collapse
Affiliation(s)
- Gianluca Bonifazi
- Department of Information Engineering, Polytechnic University of Marche, Ancona, Italy
| | - Enrico Corradini
- Department of Information Engineering, Polytechnic University of Marche, Ancona, Italy
| | - Domenico Ursino
- Department of Information Engineering, Polytechnic University of Marche, Ancona, Italy
| | - Luca Virgili
- Department of Information Engineering, Polytechnic University of Marche, Ancona, Italy
| | | | | |
Collapse
|
9
|
Maitre J, Bouchard K, Gaboury S. Fall Detection With UWB Radars and CNN-LSTM Architecture. IEEE J Biomed Health Inform 2021; 25:1273-1283. [PMID: 33017299 DOI: 10.1109/jbhi.2020.3027967] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Fall detection is a major challenge for researchers. Indeed, a fall can cause injuries such as femoral neck fracture, brain hemorrhage, or skin burns, leading to significant pain. However, in some cases, trauma caused by an undetected fall can get worse with the time and conducts to painful end of life or even death. One solution is to detect falls efficiently to alert somebody (e.g., nurses) as quickly as possible. To respond to this need, we propose to detect falls in a real apartment of 40 square meters by exploiting three ultra-wideband radars and a deep neural network model. The deep neural network is composed of a convolutional neural network stacked with a long-short term memory network and a fully connected neural network to identify falls. In other words, the problem addressed in this paper is a binary classification attempting to differentiate fall and non-fall events. As it can be noticed in real cases, the falls can have different forms. Hence, the data to train and test the classification model have been generated with falls (four types) simulated by 10 participants in three locations in the apartment. Finally, the train and test stages have been achieved according to three strategies, including the leave-one-subject-out method. This latter method allows for obtaining the performances of the proposed system in a generalization context. The results are very promising since we reach almost 90% of accuracy.
Collapse
|
10
|
Rastogi S, Singh J. A systematic review on machine learning for fall detection system. Comput Intell 2021. [DOI: 10.1111/coin.12441] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Shikha Rastogi
- School of Engineering GD Goenka University, Sohna Gurugram Road Sohna Haryana India
| | - Jaspreet Singh
- School of Engineering GD Goenka University, Sohna Gurugram Road Sohna Haryana India
| |
Collapse
|
11
|
Acceleration Magnitude at Impact Following Loss of Balance Can Be Estimated Using Deep Learning Model. SENSORS 2020; 20:s20216126. [PMID: 33126491 PMCID: PMC7663134 DOI: 10.3390/s20216126] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 10/16/2020] [Accepted: 10/22/2020] [Indexed: 11/17/2022]
Abstract
Pre-impact fall detection can detect a fall before a body segment hits the ground. When it is integrated with a protective system, it can directly prevent an injury due to hitting the ground. An impact acceleration peak magnitude is one of key measurement factors that can affect the severity of an injury. It can be used as a design parameter for wearable protective devices to prevent injuries. In our study, a novel method is proposed to predict an impact acceleration magnitude after loss of balance using a single inertial measurement unit (IMU) sensor and a sequential-based deep learning model. Twenty-four healthy participants participated in this study for fall experiments. Each participant worn a single IMU sensor on the waist to collect tri-axial accelerometer and angular velocity data. A deep learning method, bi-directional long short-term memory (LSTM) regression, is applied to predict a fall's impact acceleration magnitude prior to fall impact (a fall in five directions). To improve prediction performance, a data augmentation technique with increment of dataset is applied. Our proposed model showed a mean absolute percentage error (MAPE) of 6.69 ± 0.33% with r value of 0.93 when all three different types of data augmentation techniques are applied. Additionally, there was a significant reduction of MAPE by 45.2% when the number of training datasets was increased by 4-fold. These results show that impact acceleration magnitude can be used as an activation parameter for fall prevention such as in a wearable airbag system by optimizing deployment process to minimize fall injury in real time.
Collapse
|
12
|
Innovative Head-Mounted System Based on Inertial Sensors and Magnetometer for Detecting Falling Movements. SENSORS 2020; 20:s20205774. [PMID: 33053827 PMCID: PMC7600986 DOI: 10.3390/s20205774] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Revised: 09/29/2020] [Accepted: 10/02/2020] [Indexed: 11/17/2022]
Abstract
This work presents a fall detection system that is worn on the head, where the acceleration and posture are stable such that everyday movement can be identified without disturbing the wearer. Falling movements are recognized by comparing the acceleration and orientation of a wearer's head using prespecified thresholds. The proposed system consists of a triaxial accelerometer, gyroscope, and magnetometer; as such, a Madgwick's filter is adopted to improve the accuracy of the estimation of orientation. Moreover, with its integrated Wi-Fi module, the proposed system can notify an emergency contact in a timely manner to provide help for the falling person. Based on experimental results concerning falling movements and activities of daily living, the proposed system achieved a sensitivity of 96.67% in fall detection, with a specificity of 98.27%, and, therefore, is suitable for detecting falling movements in daily life.
Collapse
|
13
|
Detection of Pre-Impact Falls from Heights Using an Inertial Measurement Unit Sensor. SENSORS 2020; 20:s20185388. [PMID: 32962282 PMCID: PMC7570923 DOI: 10.3390/s20185388] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 09/16/2020] [Accepted: 09/16/2020] [Indexed: 02/02/2023]
Abstract
Many safety accidents can occur in industrial sites. Among them, falls from heights (FFHs) are the most frequent accidents and have the highest fatality rate. Therefore, some existing studies have developed personal wearable airbags to mitigate the damage caused by FFHs. To utilize these airbags effectively, it is essential to detect FFHs before collision with the floor. In this study, an inertial measurement unit (IMU) sensor attached to the seventh thoracic vertebrae (T7) was used to develop an FFH detection algorithm. The vertical angle and vertical velocity were calculated using the inertial data obtained from the IMU sensor. Forty young and healthy males were recruited to perform non-FFH and FFH motions. In addition, experiments using a human mannequin and dynamics simulations were performed to obtain FFH data at heights above 2 m. The developed algorithm achieved 100% FFH detection accuracy and provided sufficient lead time such that the airbags could be inflated completely before collision with the floor.
Collapse
|
14
|
Abstract
Among humans, falls are a serious health problem causing severe injuries and even death for the elderly population. Besides, falls are also a major safety threat to bikers, skiers, construction workers, and others. Fortunately, with the advancements of technologies, the number of proposed fall detection systems and devices has increased dramatically and some of them are already in the market. Fall detection devices/systems can be categorized based on their architectures as wearable devices, ambient systems, image processing-based systems, and hybrid systems, which employ a combination of two or more of these methodologies. In this review paper, a comparison is made among these major fall detection systems, devices, and algorithms in terms of their proposed approaches and measure of performance. Issues with the current systems such as lack of portability and reliability are presented as well. Development trends such as the use of smartphones, machine learning, and EEG are recognized. Challenges with privacy issues, limited real fall data, and ergonomic design deficiency are also discussed.
Collapse
|
15
|
Non-Contact Sensing Testbed for Post-Surgery Monitoring by Exploiting Artificial-Intelligence. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10144886] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Non-contact health care monitoring is a unique feature in the emerging 5G networks that is achieved by exploiting artificial intelligence (AI). The ratio of the number of health care problems and patients is increasing exponentially and creating burgeoning data. The integration of AI and Internet of things (IoT) systems enables us to increase the huge volume of data to be generated. The approach by which AI is applied to the IoT systems enhances the intelligence of the health care system. In post-surgery monitoring of the patient, timely consultation is essential before further loss. Unfortunately, even after the advice of the doctor to the patient, he/she may forget to perform the activity in the correct way, which may lead to complications in recovery. In this research, the idea is to design a non-contact sensing testbed using AI for the classification of post-surgery activities. Universal software-defined radio peripheral (USRP) is utilized to collect the data of spinal cord operated patients during weight lifting activity. The wireless channel state information (WCSI) is extracted by using orthogonal frequency division multiplexing (OFDM) technique. AI applies machine learning to classify the correct and wrong way of weight lifting activity that was considered for experimental analysis. The accuracy achieved by the proposed testbed by using a fine K-nearest neighbor (FKNN) algorithm is 99.6%.
Collapse
|
16
|
Wang X, Ellul J, Azzopardi G. Elderly Fall Detection Systems: A Literature Survey. Front Robot AI 2020; 7:71. [PMID: 33501238 PMCID: PMC7805655 DOI: 10.3389/frobt.2020.00071] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 04/30/2020] [Indexed: 01/21/2023] Open
Abstract
Falling is among the most damaging event elderly people may experience. With the ever-growing aging population, there is an urgent need for the development of fall detection systems. Thanks to the rapid development of sensor networks and the Internet of Things (IoT), human-computer interaction using sensor fusion has been regarded as an effective method to address the problem of fall detection. In this paper, we provide a literature survey of work conducted on elderly fall detection using sensor networks and IoT. Although there are various existing studies which focus on the fall detection with individual sensors, such as wearable ones and depth cameras, the performance of these systems are still not satisfying as they suffer mostly from high false alarms. Literature shows that fusing the signals of different sensors could result in higher accuracy and lower false alarms, while improving the robustness of such systems. We approach this survey from different perspectives, including data collection, data transmission, sensor fusion, data analysis, security, and privacy. We also review the benchmark data sets available that have been used to quantify the performance of the proposed methods. The survey is meant to provide researchers in the field of elderly fall detection using sensor networks with a summary of progress achieved up to date and to identify areas where further effort would be beneficial.
Collapse
Affiliation(s)
- Xueyi Wang
- Department of Computer Science, Bernoulli Institute for Mathematics, Computer Science and Artificial Intelligence, University of Groningen, Groningen, Netherlands
| | - Joshua Ellul
- Computer Science, Faculty of Information & Communication Technology, University of Malta, Msida, Malta
| | - George Azzopardi
- Department of Computer Science, Bernoulli Institute for Mathematics, Computer Science and Artificial Intelligence, University of Groningen, Groningen, Netherlands
| |
Collapse
|
17
|
Yu X, Qiu H, Xiong S. A Novel Hybrid Deep Neural Network to Predict Pre-impact Fall for Older People Based on Wearable Inertial Sensors. Front Bioeng Biotechnol 2020; 8:63. [PMID: 32117941 PMCID: PMC7028683 DOI: 10.3389/fbioe.2020.00063] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2019] [Accepted: 01/24/2020] [Indexed: 11/13/2022] Open
Abstract
Falls in the elderly is a major public health concern due to its high prevalence, serious consequences and heavy burden on the society. Many falls in older people happen within a very short time, which makes it difficult to predict a fall before it occurs and then to provide protection for the person who is falling. The primary objective of this study was to develop deep neural networks for predicting a fall during its initiation and descending but before the body impacts to the ground so that a safety mechanism can be enabled to prevent fall-related injuries. We divided the falling process into three stages (non-fall, pre-impact fall and fall) and developed deep neutral networks to perform three-class classification. Three deep learning models, convolutional neural network (CNN), long short term memory (LSTM), and a novel hybrid model integrating both convolution and long short term memory (ConvLSTM) were proposed and evaluated on a large public dataset of various falls and activities of daily living (ADL) acquired with wearable inertial sensors (accelerometer and gyroscope). Fivefold cross validation results showed that the hybrid ConvLSTM model had mean sensitivities of 93.15, 93.78, and 96.00% for non-fall, pre-impact fall and fall, respectively, which were higher than both LSTM (except the fall class) and CNN models. ConvLSTM model also showed higher specificities for all three classes (96.59, 94.49, and 98.69%) than LSTM and CNN models. In addition, latency test on a microcontroller unit showed that ConvLSTM model had a short latency of 1.06 ms, which was much lower than LSTM model (3.15 ms) and comparable with CNN model (0.77 ms). High prediction accuracy (especially for pre-impact fall) and low latency on the microboard indicated that the proposed hybrid ConvLSTM model outperformed both LSTM and CNN models. These findings suggest that our proposed novel hybrid ConvLSTM model has great potential to be embedded into wearable inertial sensor-based systems to predict pre-impact fall in real-time so that protective devices could be triggered in time to prevent fall-related injuries for older people.
Collapse
Affiliation(s)
- Xiaoqun Yu
- Department of Industrial and Systems Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea
| | - Hai Qiu
- CETHIK Group Corporation Research Institute, Hangzhou, China
| | - Shuping Xiong
- Department of Industrial and Systems Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea
| |
Collapse
|
18
|
Aprigliano F, Guaitolini M, Sabatini AM, Micera S, Monaco V. Pre-impact detection algorithm to identify lack of balance due to tripping-like perturbations. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:2430-2433. [PMID: 31946389 DOI: 10.1109/embc.2019.8856383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
This study investigates the performance of an updated version of our pre-impact detection algorithm while parsing out hip kinematics in order to identify unexpected tripping-like perturbations during walking. This approach grounds on the hypothesis that due to unexpected gait disturbances, the cyclic features of hip kinematics are suddenly altered thus promptly highlighting that the balance is challenged. To achieve our goal, hip angles of eight healthy young subjects were recorded while they were managing unexpected tripping trials delivered during the steady locomotion. Results showed that the updated version of our pre-impact detection algorithm allows for identifying a lack of balance due to tripping-like perturbations, after a suitable tuning of the algorithm parameters. The best performance is represented by a mean detection time ranging within 0.8-0.9 s with a low percentage of false alarms (i.e., lower than 10%). Accordingly, we can conclude that the proposed strategy is able to detect lack of balance due to different kinds of gait disturbances (e.g., slippages, tripping) and that it could be easily implemented in lower limb orthoses/prostheses since it only relies on joint angles.
Collapse
|
19
|
Guaitolini M, Aprigliano F, Mannini A, Monaco V, Micera S, Sabatini AM. Evaluation of time-frequency features as detectors of lack of balance due to tripping-like perturbations. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:2443-2446. [PMID: 31946392 DOI: 10.1109/embc.2019.8857442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Unbalancing events during gait can end up in falls and, thus, injury. Detecting events that could bring to fall and consequently activating fall prevention systems before the impact may help to mitigate related injuries. However, there is uncertainty about signals and methods that could offer the best performance. In this paper we investigated a novel trip detection method based on time-frequency features to evaluate the performances of these features as trip detectors. Hip angles of eight healthy young subjects were recorded while performing unexpected tripping trials delivered during steady locomotion. Then the Short-Time Fourier Transform (STFT) of the hip angle was estimated. Median frequency, power, centroidal frequency as well as frequency dispersion were computed for each time sliced power spectrum. These features were used as input for a trip detection algorithm. We assessed detection time (Tdetect), specificity (Spec) and sensitivity (Sens) for each feature. Performances obtained with median frequencies over time(Tdetect 0.91 ± 0.47 s; Sens 0.96) were better than those obtained using the hip angle signal in time domain (Tdetect 1.19 ± 0.27 s; Sens 0.83). Other features did not show significant results. Thus, median frequency over time expected to achieve effective real-time event detection systems, with the aim of a future on-board application concerning detection and prevention measures.
Collapse
|
20
|
Learning the Orientation of a Loosely-Fixed Wearable IMU Relative to the Body Improves the Recognition Rate of Human Postures and Activities. SENSORS 2019; 19:s19132845. [PMID: 31248016 PMCID: PMC6651658 DOI: 10.3390/s19132845] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2019] [Revised: 06/18/2019] [Accepted: 06/21/2019] [Indexed: 01/06/2023]
Abstract
Features were developed which accounted for the changing orientation of the inertial measurement unit (IMU) relative to the body, and demonstrably improved the performance of models for human activity recognition (HAR). The method is proficient at separating periods of standing and sedentary activity (i.e., sitting and/or lying) using only one IMU, even if it is arbitrarily oriented or subsequently re-oriented relative to the body; since the body is upright during walking, learning the IMU orientation during walking provides a reference orientation against which sitting and/or lying can be inferred. Thus, the two activities can be identified (irrespective of the cohort) by analyzing the magnitude of the angle of shortest rotation which would be required to bring the upright direction into coincidence with the average orientation from the most recent 2.5 s of IMU data. Models for HAR were trained using data obtained from a cohort of 37 older adults (83.9 ± 3.4 years) or 20 younger adults (21.9 ± 1.7 years). Test data were generated from the training data by virtually re-orienting the IMU so that it is representative of carrying the phone in five different orientations (relative to the thigh). The overall performance of the model for HAR was consistent whether the model was trained with the data from the younger cohort, and tested with the data from the older cohort after it had been virtually re-oriented (Cohen's Kappa 95% confidence interval [0.782, 0.793]; total class sensitivity 95% confidence interval [84.9%, 85.6%]), or the reciprocal scenario in which the model was trained with the data from the older cohort, and tested with the data from the younger cohort after it had been virtually re-oriented (Cohen's Kappa 95% confidence interval [0.765, 0.784]; total class sensitivity 95% confidence interval [82.3%, 83.7%]).
Collapse
|
21
|
Villar JR, de la Cal E, Fañez M, González VM, Sedano J. User-centered fall detection using supervised, on-line learning and transfer learning. PROGRESS IN ARTIFICIAL INTELLIGENCE 2019. [DOI: 10.1007/s13748-019-00190-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
|
22
|
Kim TH, Choi A, Heo HM, Kim K, Lee K, Mun JH. Machine learning-based pre-impact fall detection model to discriminate various types of fall. J Biomech Eng 2019; 141:2730876. [PMID: 30968932 DOI: 10.1115/1.4043449] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2018] [Indexed: 11/08/2022]
Abstract
Preimpact fall detection can send alarm service faster to reduce long-lie conditions and decrease the risk of hospitalization. Detecting various types of fall to determine the impact site or direction prior to impact is important because it increases the chance of decreasing the incidence or severity of fall-related injuries. In this study, a robust preimpact fall detection model was developed to classify various activities and falls as multi-class and its performance was compared with the performance of previous developed models. Twelve healthy subjects participated in this study. All subjects were asked to place an inertial measuring unit module by fixing on a belt near the left iliac crest to collect accelerometer data for each activity. Our novel proposed model consists of feature calculation and infinite latent feature selection algorithm, auto labeling of activities, application of machine learning classifiers for discrete and continuous time series data. Nine machine-learning classifiers were applied to detect falls prior to impact and derive final detection results by sorting the classifier. Our model showed the highest classification accuracy. Results for the proposed model that could classify as multi-class showed significantly higher average classification accuracy of 99.57 ± 0.01% for discrete data-based classifiers and 99.84 ± 0.02% for continuous time series-based classifiers than previous models (p < 0.01). In the future, multi-class preimpact fall detection models can be applied to fall protector devices by detecting various activities for sending alerts or immediate feedback reactions to prevent falls.
Collapse
Affiliation(s)
- Tae Hyong Kim
- Department of Biomechatronic Engineering, College of Biotechnology and Bioengineering, Sungkyunkwan University, Republic of Korea, 2066 Seoburo, Jangangu, Suwon, Gyeonggi, 16419, Republic of Korea
| | - Ahnryul Choi
- Department of Biomechatronic Engineering, College of Biotechnology and Bioengineering, Sungkyunkwan University, Republic of Korea, 2066 Seoburo, Jangangu, Suwon, Gyeonggi, 16419, Republic of Korea; Department of Biomedical Engineering, College of Medical Convergence, Catholic Kwandong University, Republic of Korea, 24, Beomil-ro 579 beon-gill, Gangneung, Gangwon, Republic of Korea
| | - Hyun Mu Heo
- Department of Biomechatronic Engineering, College of Biotechnology and Bioengineering, Sungkyunkwan University, Republic of Korea, 2066 Seoburo, Jangangu, Suwon, Gyeonggi, 16419, Republic of Korea
| | - Kyungran Kim
- Agricultural Health and Safety Division, Rural Development Administration, Republic of Korea, 300 Nongsaengmyeong-ro, Wansan-gu, Jeonju, Jeollabuk 54875, Republic of Korea
| | - Kyungsuk Lee
- Agricultural Health and Safety Division, Rural Development Administration, Republic of Korea, 300 Nongsaengmyeong-ro, Wansan-gu, Jeonju, Jeollabuk 54875, Republic of Korea
| | - Joung Hwan Mun
- Department of Biomechatronic Engineering, College of Biotechnology and Bioengineering, Sungkyunkwan University, Republic of Korea, 2066 Seoburo, Jangangu, Suwon, Gyeonggi, 16419, Republic of Korea, Tel: +82-31-290-7827, Fax: +82-31-290-7830
| |
Collapse
|
23
|
Danger-Pose Detection System Using Commodity Wi-Fi for Bathroom Monitoring. SENSORS 2019; 19:s19040884. [PMID: 30791629 PMCID: PMC6412933 DOI: 10.3390/s19040884] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2019] [Revised: 02/10/2019] [Accepted: 02/18/2019] [Indexed: 11/23/2022]
Abstract
A bathroom has higher probability of accidents than other rooms due to a slippery floor and temperature change. Because of high privacy and humidity, we face difficulties in monitoring inside a bathroom using traditional healthcare methods based on cameras and wearable sensors. In this paper, we present a danger-pose detection system using commodity Wi-Fi devices, which can be applied to bathroom monitoring, preserving privacy. A machine learning-based detection method usually requires data collected in target situations, which is difficult in detection-of-danger situations. We therefore employ a machine learning-based anomaly-detection method that requires a small amount of data in anomaly conditions, minimizing the required training data collected in dangerous conditions. We first derive the amplitude and phase shift from Wi-Fi channel state information (CSI) to extract low-frequency components that are related to human activities. We then separately extract static and dynamic features from the CSI changes in time. Finally, the static and dynamic features are fed into a one-class support vector machine (SVM), which is used as an anomaly-detection method, to classify whether a user is not in bathtub, bathing safely, or in dangerous conditions. We conducted experimental evaluations and demonstrated that our danger-pose detection system achieved a high detection performance in a non-line-of-sight (NLOS) scenario.
Collapse
|
24
|
Abstract
Due to advances in medical technology, the elderly population has continued to grow. Elderly healthcare issues have been widely discussed—especially fall accidents—because a fall can lead to a fracture and have serious consequences. Therefore, the effective detection of fall accidents is important for both elderly people and their caregivers. In this work, we designed an Image-based FAll Detection System (IFADS) for nursing homes, where public areas are usually equipped with surveillance cameras. Unlike existing fall detection algorithms, we mainly focused on falls that occur while sitting down and standing up from a chair, because the two activities together account for a higher proportion of falls than forward walking. IFADS first applies an object detection algorithm to identify people in a video frame. Then, a posture recognition method is used to keep tracking the status of the people by checking the relative positions of the chair and the people. An alarm is triggered when a fall is detected. In order to evaluate the effectiveness of IFADS, we not only simulated different fall scenarios, but also adopted YouTube and Giphy videos that captured real falls. Our experimental results showed that IFADS achieved an average accuracy of 95.96%. Therefore, IFADS can be used by nursing homes to improve the quality of residential care facilities.
Collapse
|
25
|
Wearable Inertial Sensing for ICT Management of Fall Detection, Fall Prevention, and Assessment in Elderly. TECHNOLOGIES 2018. [DOI: 10.3390/technologies6040091] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Falls are one of the most common causes of accidental injury: approximately, 37.3 million falls requiring medical intervention occur each year. Fall-related injuries may cause disabilities, and in some extreme cases, premature death among older adults, which has a significant impact on health and social care services. In recent years, information and communication technologies (ICT) have helped enhance the autonomy and quality of life of elderly people, and significantly reduced the costs associated with elderly care. We designed and developed an integrated fall detection and prevention ICT service for elderly people, which was based on two wearable smart sensors, called, respectively, WIMU fall detector and WIMU data-logger (Wearable Inertial Measurement Unit, WIMU); their goal was either to detect falls and promptly react in case of fall events, or to quantify fall risk instrumentally. The WIMU fall detector is intended to be worn at the waist level for use during activities of daily living; the WIMU logger is intended for the quantitative assessment of tested individuals during the execution of clinical tests. Both devices provide their service in conjunction with an Android mobile device. The ICT service was developed and tested within the European project I-DONT-FALL (Integrated prevention and Detection sOlutioNs Tailored to the population and risk factors associated with FALLs, funded by EU, action EU CIP-ICT-PSP-2011-5: GA #CIP-297225). Sensor description and preliminary testing results are provided in this paper.
Collapse
|
26
|
Improving Fall Detection Using an On-Wrist Wearable Accelerometer. SENSORS 2018; 18:s18051350. [PMID: 29701721 PMCID: PMC5982860 DOI: 10.3390/s18051350] [Citation(s) in RCA: 83] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/12/2018] [Revised: 04/18/2018] [Accepted: 04/23/2018] [Indexed: 12/03/2022]
Abstract
Fall detection is a very important challenge that affects both elderly people and the carers. Improvements in fall detection would reduce the aid response time. This research focuses on a method for fall detection with a sensor placed on the wrist. Falls are detected using a published threshold-based solution, although a study on threshold tuning has been carried out. The feature extraction is extended in order to balance the dataset for the minority class. Alternative models have been analyzed to reduce the computational constraints so the solution can be embedded in smart-phones or smart wristbands. Several published datasets have been used in the Materials and Methods section. Although these datasets do not include data from real falls of elderly people, a complete comparison study of fall-related datasets shows statistical differences between the simulated falls and real falls from participants suffering from impairment diseases. Given the obtained results, the rule-based systems represent a promising research line as they perform similarly to neural networks, but with a reduced computational cost. Furthermore, support vector machines performed with a high specificity. However, further research to validate the proposal in real on-line scenarios is needed. Furthermore, a slight improvement should be made to reduce the number of false alarms.
Collapse
|
27
|
An Event-Triggered Machine Learning Approach for Accelerometer-Based Fall Detection. SENSORS 2017; 18:s18010020. [PMID: 29271895 PMCID: PMC5795925 DOI: 10.3390/s18010020] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Revised: 12/15/2017] [Accepted: 12/18/2017] [Indexed: 11/17/2022]
Abstract
The fixed-size non-overlapping sliding window (FNSW) and fixed-size overlapping sliding window (FOSW) approaches are the most commonly used data-segmentation techniques in machine learning-based fall detection using accelerometer sensors. However, these techniques do not segment by fall stages (pre-impact, impact, and post-impact) and thus useful information is lost, which may reduce the detection rate of the classifier. Aligning the segment with the fall stage is difficult, as the segment size varies. We propose an event-triggered machine learning (EvenT-ML) approach that aligns each fall stage so that the characteristic features of the fall stages are more easily recognized. To evaluate our approach, two publicly accessible datasets were used. Classification and regression tree (CART), k-nearest neighbor (k-NN), logistic regression (LR), and the support vector machine (SVM) were used to train the classifiers. EvenT-ML gives classifier F-scores of 98% for a chest-worn sensor and 92% for a waist-worn sensor, and significantly reduces the computational cost compared with the FNSW- and FOSW-based approaches, with reductions of up to 8-fold and 78-fold, respectively. EvenT-ML achieves a significantly better F-score than existing fall detection approaches. These results indicate that aligning feature segments with fall stages significantly increases the detection rate and reduces the computational cost.
Collapse
|
28
|
Godfrey A. Wearables for independent living in older adults: Gait and falls. Maturitas 2017; 100:16-26. [PMID: 28539173 DOI: 10.1016/j.maturitas.2017.03.317] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2017] [Accepted: 03/22/2017] [Indexed: 01/15/2023]
Abstract
Solutions are needed to satisfy care demands of older adults to live independently. Wearable technology (wearables) is one approach that offers a viable means for ubiquitous, sustainable and scalable monitoring of the health of older adults in habitual free-living environments. Gait has been presented as a relevant (bio)marker in ageing and pathological studies, with objective assessment achievable by inertial-based wearables. Commercial wearables have struggled to provide accurate analytics and have been limited by non-clinically oriented gait outcomes. Moreover, some research-grade wearables also fail to provide transparent functionality due to limitations in proprietary software. Innovation within this field is often sporadic, with large heterogeneity of wearable types and algorithms for gait outcomes leading to a lack of pragmatic use. This review provides a summary of the recent literature on gait assessment through the use of wearables, focusing on the need for an algorithm fusion approach to measurement, culminating in the ability to better detect and classify falls. A brief presentation of wearables in one pathological group is presented, identifying appropriate work for researchers in other cohorts to utilise. Suggestions for how this domain needs to progress are also summarised.
Collapse
Affiliation(s)
- A Godfrey
- Newcastle University Business School, Newcastle University Institute for Ageing, Newcastle University, Newcastle upon Tyne, United Kingdom; Institute of Neuroscience, Newcastle University Institute for Ageing, Newcastle University, Newcastle upon Tyne, United Kingdom.
| |
Collapse
|
29
|
Abstract
Pre-impact fall detection has been proposed to be an effective fall prevention strategy. In particular, it can help activate on-demand fall injury prevention systems (e.g. inflatable hip protectors) prior to fall impacts, and thus directly prevent the fall-related physical injuries. This paper gave a systematical review on pre-impact fall detection, and focused on the following aspects of the existing pre-impact fall detection research: fall detection apparatus, fall detection indicators, fall detection algorithms, and types of falls for fall detection evaluation. In addition, the performance of the existing pre-impact fall detection solutions were also reviewed and reported in terms of their sensitivity, specificity, and detection/lead time. This review also summarized the limitations in the existing pre-impact fall detection research, and proposed future research directions in this field.
Collapse
Affiliation(s)
- Xinyao Hu
- Institute of Human Factors and Ergonomics, College of Mechatronics and Control Engineering, Shenzhen University, 3688 Nanhai Avenue, Shenzhen City, Guangdong Province, China
| | - Xingda Qu
- Institute of Human Factors and Ergonomics, College of Mechatronics and Control Engineering, Shenzhen University, 3688 Nanhai Avenue, Shenzhen City, Guangdong Province, China.
| |
Collapse
|