1
|
Yang J, He Y, Zhu J, Lv Z, Jin W. Fall Detection Method for Infrared Videos Based on Spatial-Temporal Graph Convolutional Network. SENSORS (BASEL, SWITZERLAND) 2024; 24:4647. [PMID: 39066046 PMCID: PMC11280873 DOI: 10.3390/s24144647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 06/30/2024] [Accepted: 07/09/2024] [Indexed: 07/28/2024]
Abstract
The timely detection of falls and alerting medical aid is critical for health monitoring in elderly individuals living alone. This paper mainly focuses on issues such as poor adaptability, privacy infringement, and low recognition accuracy associated with traditional visual sensor-based fall detection. We propose an infrared video-based fall detection method utilizing spatial-temporal graph convolutional networks (ST-GCNs) to address these challenges. Our method used fine-tuned AlphaPose to extract 2D human skeleton sequences from infrared videos. Subsequently, the skeleton data was represented in Cartesian and polar coordinates and processed through a two-stream ST-GCN to recognize fall behaviors promptly. To enhance the network's recognition capability for fall actions, we improved the adjacency matrix of graph convolutional units and introduced multi-scale temporal graph convolution units. To facilitate practical deployment, we optimized time window and network depth of the ST-GCN, striking a balance between model accuracy and speed. The experimental results on a proprietary infrared human action recognition dataset demonstrated that our proposed algorithm accurately identifies fall behaviors with the highest accuracy of 96%. Moreover, our algorithm performed robustly, identifying falls in both near-infrared and thermal-infrared videos.
Collapse
Affiliation(s)
| | - Yuqing He
- MOE Key Laboratory of Optoelectronic Imaging Technology and System, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | | | | | | |
Collapse
|
2
|
Kwok WH, Zhang Y, Wang G. Artificial intelligence in perinatal mental health research: A scoping review. Comput Biol Med 2024; 177:108685. [PMID: 38838557 DOI: 10.1016/j.compbiomed.2024.108685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 04/28/2024] [Accepted: 06/01/2024] [Indexed: 06/07/2024]
Abstract
The intersection of Artificial Intelligence (AI) and perinatal mental health research presents promising avenues, yet uncovers significant challenges for innovation. This review explicitly focuses on this multidisciplinary field and undertakes a comprehensive exploration of existing research therein. Through a scoping review guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework, we searched relevant literature spanning a decade (2013-2023) and selected fourteen studies for our analysis. We first provide an overview of the main AI techniques and their development, including traditional methods across different categories, as well as recent emerging methods in the field. Then, through our analysis of the literature, we summarize the predominant AI and ML techniques adopted and their applications in perinatal mental health studies, such as identifying risk factors, predicting perinatal mental health disorders, voice assistants, and Q&A chatbots. We also discuss existing limitations and potential challenges that hinder AI technologies from improving perinatal mental health outcomes, and suggest several promising directions for future research to meet real needs in the field and facilitate the translation of research into clinical settings.
Collapse
Affiliation(s)
- Wai Hang Kwok
- School of Nursing and Midwifery, Edith Cowan University, WA, Australia
| | - Yuanpeng Zhang
- Department of Medical Informatics, Nantong University, Nantong, 226001, China
| | - Guanjin Wang
- School of Information Technology, Murdoch University, Murdoch, WA, Australia.
| |
Collapse
|
3
|
González-Castro A, Leirós-Rodríguez R, Prada-García C, Benítez-Andrades JA. The Applications of Artificial Intelligence for Assessing Fall Risk: Systematic Review. J Med Internet Res 2024; 26:e54934. [PMID: 38684088 DOI: 10.2196/54934] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 01/30/2024] [Accepted: 02/13/2024] [Indexed: 05/02/2024] Open
Abstract
BACKGROUND Falls and their consequences are a serious public health problem worldwide. Each year, 37.3 million falls requiring medical attention occur. Therefore, the analysis of fall risk is of great importance for prevention. Artificial intelligence (AI) represents an innovative tool for creating predictive statistical models of fall risk through data analysis. OBJECTIVE The aim of this review was to analyze the available evidence on the applications of AI in the analysis of data related to postural control and fall risk. METHODS A literature search was conducted in 6 databases with the following inclusion criteria: the articles had to be published within the last 5 years (from 2018 to 2024), they had to apply some method of AI, AI analyses had to be applied to data from samples consisting of humans, and the analyzed sample had to consist of individuals with independent walking with or without the assistance of external orthopedic devices. RESULTS We obtained a total of 3858 articles, of which 22 were finally selected. Data extraction for subsequent analysis varied in the different studies: 82% (18/22) of them extracted data through tests or functional assessments, and the remaining 18% (4/22) of them extracted through existing medical records. Different AI techniques were used throughout the articles. All the research included in the review obtained accuracy values of >70% in the predictive models obtained through AI. CONCLUSIONS The use of AI proves to be a valuable tool for creating predictive models of fall risk. The use of this tool could have a significant socioeconomic impact as it enables the development of low-cost predictive models with a high level of accuracy. TRIAL REGISTRATION PROSPERO CRD42023443277; https://tinyurl.com/4sb72ssv.
Collapse
Affiliation(s)
- Ana González-Castro
- Nursing and Physical Therapy Department, Universidad de León, Ponferrada, Spain
| | - Raquel Leirós-Rodríguez
- SALBIS Research Group, Nursing and Physical Therapy Department, Universidad de León, Ponferrada, Spain
| | - Camino Prada-García
- Department of Preventive Medicine and Public Health, Universidad de Valladolid, Valladolid, Spain
| | | |
Collapse
|
4
|
Chato L, Regentova E. Survey of Transfer Learning Approaches in the Machine Learning of Digital Health Sensing Data. J Pers Med 2023; 13:1703. [PMID: 38138930 PMCID: PMC10744730 DOI: 10.3390/jpm13121703] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 12/01/2023] [Accepted: 12/08/2023] [Indexed: 12/24/2023] Open
Abstract
Machine learning and digital health sensing data have led to numerous research achievements aimed at improving digital health technology. However, using machine learning in digital health poses challenges related to data availability, such as incomplete, unstructured, and fragmented data, as well as issues related to data privacy, security, and data format standardization. Furthermore, there is a risk of bias and discrimination in machine learning models. Thus, developing an accurate prediction model from scratch can be an expensive and complicated task that often requires extensive experiments and complex computations. Transfer learning methods have emerged as a feasible solution to address these issues by transferring knowledge from a previously trained task to develop high-performance prediction models for a new task. This survey paper provides a comprehensive study of the effectiveness of transfer learning for digital health applications to enhance the accuracy and efficiency of diagnoses and prognoses, as well as to improve healthcare services. The first part of this survey paper presents and discusses the most common digital health sensing technologies as valuable data resources for machine learning applications, including transfer learning. The second part discusses the meaning of transfer learning, clarifying the categories and types of knowledge transfer. It also explains transfer learning methods and strategies, and their role in addressing the challenges in developing accurate machine learning models, specifically on digital health sensing data. These methods include feature extraction, fine-tuning, domain adaptation, multitask learning, federated learning, and few-/single-/zero-shot learning. This survey paper highlights the key features of each transfer learning method and strategy, and discusses the limitations and challenges of using transfer learning for digital health applications. Overall, this paper is a comprehensive survey of transfer learning methods on digital health sensing data which aims to inspire researchers to gain knowledge of transfer learning approaches and their applications in digital health, enhance the current transfer learning approaches in digital health, develop new transfer learning strategies to overcome the current limitations, and apply them to a variety of digital health technologies.
Collapse
Affiliation(s)
- Lina Chato
- Department of Electrical and Computer Engineering, University of Nevada, Las Vegas, NV 89154, USA;
| | | |
Collapse
|
5
|
Duan M, Wang Y, Zhao D, Liu H, Zhang G, Li K, Zhang H, Huang L, Zhang R, Zhou F. Orchestrating information across tissues via a novel multitask GAT framework to improve quantitative gene regulation relation modeling for survival analysis. Brief Bioinform 2023; 24:bbad238. [PMID: 37427963 DOI: 10.1093/bib/bbad238] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2023] [Revised: 05/29/2023] [Accepted: 06/08/2023] [Indexed: 07/11/2023] Open
Abstract
Survival analysis is critical to cancer prognosis estimation. High-throughput technologies facilitate the increase in the dimension of genic features, but the number of clinical samples in cohorts is relatively small due to various reasons, including difficulties in participant recruitment and high data-generation costs. Transcriptome is one of the most abundantly available OMIC (referring to the high-throughput data, including genomic, transcriptomic, proteomic and epigenomic) data types. This study introduced a multitask graph attention network (GAT) framework DQSurv for the survival analysis task. We first used a large dataset of healthy tissue samples to pretrain the GAT-based HealthModel for the quantitative measurement of the gene regulatory relations. The multitask survival analysis framework DQSurv used the idea of transfer learning to initiate the GAT model with the pretrained HealthModel and further fine-tuned this model using two tasks i.e. the main task of survival analysis and the auxiliary task of gene expression prediction. This refined GAT was denoted as DiseaseModel. We fused the original transcriptomic features with the difference vector between the latent features encoded by the HealthModel and DiseaseModel for the final task of survival analysis. The proposed DQSurv model stably outperformed the existing models for the survival analysis of 10 benchmark cancer types and an independent dataset. The ablation study also supported the necessity of the main modules. We released the codes and the pretrained HealthModel to facilitate the feature encodings and survival analysis of transcriptome-based future studies, especially on small datasets. The model and the code are available at http://www.healthinformaticslab.org/supp/.
Collapse
Affiliation(s)
- Meiyu Duan
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China, 130012
| | - Yueying Wang
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China, 130012
| | - Dong Zhao
- School of Biology and Engineering, and Engineering Research Center of Medical Biotechnology, Guizhou Medical University, Guiyang, Guizhou 550025, China
| | - Hongmei Liu
- School of Biology and Engineering, and Engineering Research Center of Medical Biotechnology, Guizhou Medical University, Guiyang, Guizhou 550025, China
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China, 130012
| | - Gongyou Zhang
- School of Biology and Engineering, and Engineering Research Center of Medical Biotechnology, Guizhou Medical University, Guiyang, Guizhou 550025, China
| | - Kewei Li
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China, 130012
| | - Haotian Zhang
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China, 130012
| | - Lan Huang
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China, 130012
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China, 130012
| | - Ruochi Zhang
- School of Artificial Intelligence, Jilin University, Changchun, China, 130012
| | - Fengfeng Zhou
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China, 130012
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China, 130012
| |
Collapse
|
6
|
Reinker L, Bläsing D, Bierl R, Ulbricht S, Dendorfer S. Correlation of Acceleration Curves in Gravitational Direction for Different Body Segments during High-Impact Jumping Exercises. SENSORS (BASEL, SWITZERLAND) 2023; 23:2276. [PMID: 36850874 PMCID: PMC9967370 DOI: 10.3390/s23042276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Revised: 02/09/2023] [Accepted: 02/16/2023] [Indexed: 06/18/2023]
Abstract
Osteoporosis is a common disease of old age. However, in many cases, it can be very well prevented and counteracted with physical activity, especially high-impact exercises. Wearables have the potential to provide data that can help with continuous monitoring of patients during therapy phases or preventive exercise programs in everyday life. This study aimed to determine the accuracy and reliability of measured acceleration data at different body positions compared to accelerations at the pelvis during different jumping exercises. Accelerations at the hips have been investigated in previous studies with regard to osteoporosis prevention. Data were collected using an IMU-based motion capture system (Xsens) consisting of 17 sensors. Forty-nine subjects were included in this study. The analysis shows the correlation between impacts and the corresponding drop height, which are dependent on the respective exercise. Very high correlations (0.83-0.94) were found between accelerations at the pelvis and the other measured segments at the upper body. The foot sensors provided very weak correlations (0.20-0.27). Accelerations measured at the pelvis during jumping exercises can be tracked very well on the upper body and upper extremities, including locations where smart devices are typically worn, which gives possibilities for remote and continuous monitoring of programs.
Collapse
Affiliation(s)
- Lukas Reinker
- Laboratory for Biomechanics, OTH Regensburg, 93053 Regensburg, Germany
- Regensburg Center of Biomedical Engineering (RCBE), OTH Regensburg and University of Regensburg, 93053 Regensburg, Germany
| | - Dominic Bläsing
- Department of Prevention Research and Social Medicine, Institute for Community Medicine, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17475 Greifswald, Germany
- German Centre for Cardiovascular Research (DZHK), Partner Site Greifswald, 17475 Greifswald, Germany
| | - Rudolf Bierl
- Sensorik-ApplikationsZentrum, OTH Regensburg, 93053 Regensburg, Germany
| | - Sabina Ulbricht
- Department of Prevention Research and Social Medicine, Institute for Community Medicine, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17475 Greifswald, Germany
- German Centre for Cardiovascular Research (DZHK), Partner Site Greifswald, 17475 Greifswald, Germany
| | - Sebastian Dendorfer
- Laboratory for Biomechanics, OTH Regensburg, 93053 Regensburg, Germany
- Regensburg Center of Biomedical Engineering (RCBE), OTH Regensburg and University of Regensburg, 93053 Regensburg, Germany
| |
Collapse
|