1
|
Xu X, Jigeer G, Gunn DA, Liu Y, Chen X, Guo Y, Li Y, Gu X, Ma Y, Wang J, Wang S, Sun L, Lin X, Gao X. Facial aging, cognitive impairment, and dementia risk. Alzheimers Res Ther 2024; 16:245. [PMID: 39506848 PMCID: PMC11539626 DOI: 10.1186/s13195-024-01611-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2024] [Accepted: 10/28/2024] [Indexed: 11/08/2024]
Abstract
BACKGROUND Facial aging, cognitive impairment, and dementia are all age-related conditions. However, the temporal relation between facial age and future risk of dementia was not systematically examined. OBJECTIVES To investigate the relationship between facial age (both subjective/perceived and objective) and cognitive impairment and/or dementia risk. METHODS The study included 195,329 participants (age ≥ 60 y) from the UK Biobank (UKB) with self-perceived facial age and 612 participants from the Nutrition and Health of Aging Population in China Project (NHAPC) study (age ≥ 56 y) with objective assessment of facial age. Cox proportional hazards model was used to prospectively examine the hazard ratios (HRs) and their 95% confidence intervals (CIs) of self-perceived facial age and dementia risk in the UKB, adjusting for age, sex, education, APOE ε4 allele, and other potential confounders. Linear and logistic regressions were performed to examine the cross-sectional association between facial age (perceived and objective) and cognitive impairment in the UKB and NHAPC, with potential confounders adjusted. RESULTS During a median follow-up of 12.3 years, 5659 dementia cases were identified in the UKB. The fully-adjusted HRs comparing high vs. low perceived facial age were 1.61 (95% CI, 1.33 ~ 1.96) for dementia (P-trend ≤ 0.001). Subjective facial age and cognitive impairment was also observed in the UKB. In the NHAPC, facial age, as assessed by three objective wrinkle parameters, was associated with higher odds of cognitive impairment (P-trend < 0.05). Specifically, the fully-adjusted OR for cognitive impairment comparing the highest versus the lowest quartiles of crow's feet wrinkles number was 2.48 (95% CI, 1.06 ~ 5.78). CONCLUSIONS High facial age was associated with cognitive impairment, dementia and its subtypes after adjusting for conventional risk factors for dementia. Facial aging may be an indicator of cognitive decline and dementia risk in older adults, which can aid in the early diagnosis and management of age-related conditions.
Collapse
Affiliation(s)
- Xinming Xu
- Department of Nutrition and Food Hygiene, Ministry of Education Key Laboratory of Public Health Safety, School of Public Health, Institute of Nutrition, Fudan University, 130 Dongan Road, Shanghai, 200030, China
| | - Guliyeerke Jigeer
- Department of Nutrition and Food Hygiene, Ministry of Education Key Laboratory of Public Health Safety, School of Public Health, Institute of Nutrition, Fudan University, 130 Dongan Road, Shanghai, 200030, China
| | - David Andrew Gunn
- Unilever R&D Colworth Science Part, Sharnbrook, Bedfordshire, MK44 1LQ, UK
| | - Yizhou Liu
- State Key Laboratory of Genetic Engineering, School of Life Sciences & Human Phenome Institute, Fudan University, Shanghai, 200438, China
| | - Xinrui Chen
- State Key Laboratory of Genetic Engineering, School of Life Sciences & Human Phenome Institute, Fudan University, Shanghai, 200438, China
| | - Yi Guo
- Department of Biostatistics, School of Public Health, Key Laboratory of Public Health Safety and Collaborative Innovation Center of Social Risks Governance in Health, Fudan University, Shanghai, 200030, China
| | - Yaqi Li
- Department of Nutrition and Food Hygiene, Ministry of Education Key Laboratory of Public Health Safety, School of Public Health, Institute of Nutrition, Fudan University, 130 Dongan Road, Shanghai, 200030, China
| | - Xuelan Gu
- Unilever R&D Shanghai, Shanghai, 200335, China
| | - Yanyun Ma
- Unilever R&D Colworth Science Part, Sharnbrook, Bedfordshire, MK44 1LQ, UK
| | - Jiucun Wang
- State Key Laboratory of Genetic Engineering, School of Life Sciences & Human Phenome Institute, Fudan University, Shanghai, 200438, China
| | - Sijia Wang
- CAS Key Laboratory of Computational Biology, Shanghai Institute of Nutrition and Health, Shanghai Institute for Biological Sciences, CAS-MPG Partner Institute for Computational Biology, University of Chinese Academy of Sciences, Chinese Academy of Sciences, 320 Yue Yang Road, Shanghai, 200031, China
| | - Liang Sun
- Department of Nutrition and Food Hygiene, Ministry of Education Key Laboratory of Public Health Safety, School of Public Health, Institute of Nutrition, Fudan University, 130 Dongan Road, Shanghai, 200030, China.
| | - Xu Lin
- Shanghai Institute of Nutrition and Health, University of Chinese Academy of Sciences, Chinese Academy of Sciences, Shanghai, 200031, China.
- Key Laboratory of Systems Biology, Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Chinese Academy of Sciences, Hangzhou, 310024, China.
| | - Xiang Gao
- Department of Nutrition and Food Hygiene, Ministry of Education Key Laboratory of Public Health Safety, School of Public Health, Institute of Nutrition, Fudan University, 130 Dongan Road, Shanghai, 200030, China.
| |
Collapse
|
2
|
Takeshige-Amano H, Oyama G, Ogawa M, Fusegi K, Kambe T, Shiina K, Ueno SI, Okuzumi A, Hatano T, Motoi Y, Kawakami I, Ando M, Nakayama S, Ishida Y, Maei S, Lu X, Kobayashi T, Wooden R, Ota S, Morito K, Ito Y, Nakajima Y, Yoritaka A, Kato T, Hattori N. Digital detection of Alzheimer's disease using smiles and conversations with a chatbot. Sci Rep 2024; 14:26309. [PMID: 39487204 PMCID: PMC11530557 DOI: 10.1038/s41598-024-77220-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2024] [Accepted: 10/21/2024] [Indexed: 11/04/2024] Open
Abstract
In super-aged societies, dementia has become a critical issue, underscoring the urgent need for tools to assess cognitive status effectively in various sectors, including financial and business settings. Facial and speech features have been tried as cost-effective biomarkers of dementia including Alzheimer's disease (AD). We aimed to establish an easy, automatic, and extensive screening tool for AD using a chatbot and artificial intelligence. Smile images and visual and auditory data of natural conversations with a chatbot from 99 healthy controls (HCs) and 93 individuals with AD or mild cognitive impairment due to AD (PwA) were analyzed using machine learning. A subset of 8 facial and 21 sound features successfully distinguished PwA from HCs, with a high area under the receiver operating characteristic curve of 0.94 ± 0.05. Another subset of 8 facial and 20 sound features predicted the cognitive test scores, with a mean absolute error as low as 5.78 ± 0.08. These results were superior to those obtained from face or auditory data alone or from conventional image depiction tasks. Thus, by combining spontaneous sound and facial data obtained through conversations with a chatbot, the proposed model can be put to practical use in real-life scenarios.
Collapse
Affiliation(s)
- Haruka Takeshige-Amano
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Genko Oyama
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan.
| | - Mayuko Ogawa
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Keiko Fusegi
- Department of Neurology, Faculty of Medicine, Juntendo University Koshigaya Hospital, Saitama, Japan
| | - Taiki Kambe
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Kenta Shiina
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Shin-Ichi Ueno
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Ayami Okuzumi
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Taku Hatano
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Yumiko Motoi
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Ito Kawakami
- Department of Psychiatry, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - Maya Ando
- Department of Neurology, Faculty of Medicine, Juntendo University Koshigaya Hospital, Saitama, Japan
| | - Sachiko Nakayama
- Department of Neurology, Faculty of Medicine, Juntendo University Koshigaya Hospital, Saitama, Japan
| | | | - Shun Maei
- IBM Consulting, IBM Japan, Ltd., Tokyo, Japan
| | - Xiangxun Lu
- IBM Consulting, IBM Japan, Ltd., Tokyo, Japan
| | | | - Rina Wooden
- IBM Consulting, IBM Japan, Ltd., Tokyo, Japan
| | - Susumu Ota
- IBM Consulting, IBM Japan, Ltd., Tokyo, Japan
| | | | | | | | - Asako Yoritaka
- Department of Neurology, Faculty of Medicine, Juntendo University Koshigaya Hospital, Saitama, Japan
| | - Tadafumi Kato
- Department of Psychiatry, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - Nobutaka Hattori
- Department of Neurology, Faculty of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan.
- Neurodegenerative Disorders Collaborative Laboratory, RIKEN Center for Brain Science, Saitama, Japan.
| |
Collapse
|
3
|
Deak F. Alzheimer's disease and other memory disorders in the age of AI: reflection and perspectives on the 120th anniversary of the birth of Dr. John von Neumann. GeroScience 2024:10.1007/s11357-024-01378-8. [PMID: 39419932 DOI: 10.1007/s11357-024-01378-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2024] [Accepted: 10/03/2024] [Indexed: 10/19/2024] Open
Abstract
Two themes are coming to the forefront in this decade: Cognitive impairment of an aging population and the quantum leap in developing artificial intelligence (AI). Both can be described as growing exponentially and presenting serious challenges. Although many questions have been addressed about the dangers of AI, we want to go beyond the fearful aspects of this topic and focus on the possible contribution of AI to solve the problem of chronic disorders of the elderly leading to cognitive impairment, like Alzheimer's disease, Parkinson's disease, and Lewy body dementia. Our second goal is to look at the ways in which modern neuroscience can influence the future design of computers and the development of AI. We wish to honor the memory of Dr. John von Neumann, who came up with many breakthrough details of the first electronic computer. Remarkably, Dr. von Neumann dedicated his last book to the comparison of the human brain and the computer as it stood in those years of the mid-1950s. We will point out how his ideas are more relevant than ever in the age of supercomputers, AI and brain implants.
Collapse
Affiliation(s)
- Ferenc Deak
- Department of Neuroscience and Regenerative Medicine, Medical College of Georgia, Augusta University, Augusta, GA, 30912, USA.
| |
Collapse
|
4
|
Alsuhaibani M, Dodge HH, Mahoor MH. Mild cognitive impairment detection from facial video interviews by applying spatial-to-temporal attention module. EXPERT SYSTEMS WITH APPLICATIONS 2024; 252:124185. [PMID: 38881832 PMCID: PMC11174143 DOI: 10.1016/j.eswa.2024.124185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2024]
Abstract
Early detection of Mild Cognitive Impairment (MCI) leads to early interventions to slow the progression from MCI into dementia. Deep Learning (DL) algorithms could help achieve early non-invasive and low-cost detection of MCI. This paper presents the detection of MCI in older adults using DL models based only on facial features extracted from video-recorded conversations at home. We used the data collected from the I-CONECT behavioral intervention study (NCT02871921), where several sessions of semi-structured interviews between socially isolated older individuals and interviewers were video recorded. We develop a framework that extracts holistic spatial facial features using a convolutional autoencoder and temporal information using transformers. We proposed the Spatial-to-Temporal Attention Module (STAM) to detect the I-CONECT study participants' cognitive conditions (MCI vs. those with normal cognition (NC)) using facial and interaction features. The interaction features of the facial features improved the prediction performance compared with applying facial features solely. The detection accuracy using this combined method reached 88%, whereas the accuracy without applying the segments and sequences information of the facial features within a video on a certain theme was 84%. Overall, the results show that spatiotemporal facial features modeled using DL algorithms have a discriminating power for the detection of MCI.
Collapse
Affiliation(s)
- Muath Alsuhaibani
- Department of Electrical and Computer Engineering, University of Denver, Denver 80208, CO, United States
- Department of Electrical Engineering, Prince Sattam Bin Abdulaziz University, Al-Kharj 11942, Saudi Arabia
| | - Hiroko H. Dodge
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston 02114, MA, United States
| | - Mohammad H. Mahoor
- Department of Electrical and Computer Engineering, University of Denver, Denver 80208, CO, United States
| |
Collapse
|
5
|
Lee CC, Chau HHH, Wang HL, Chuang YF, Chau Y. Mild cognitive impairment prediction based on multi-stream convolutional neural networks. BMC Bioinformatics 2024; 22:638. [PMID: 39266977 PMCID: PMC11394935 DOI: 10.1186/s12859-024-05911-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Accepted: 08/20/2024] [Indexed: 09/14/2024] Open
Abstract
BACKGROUND Mild cognitive impairment (MCI) is the transition stage between the cognitive decline expected in normal aging and more severe cognitive decline such as dementia. The early diagnosis of MCI plays an important role in human healthcare. Current methods of MCI detection include cognitive tests to screen for executive function impairments, possibly followed by neuroimaging tests. However, these methods are expensive and time-consuming. Several studies have demonstrated that MCI and dementia can be detected by machine learning technologies from different modality data. This study proposes a multi-stream convolutional neural network (MCNN) model to predict MCI from face videos. RESULTS The total effective data are 48 facial videos from 45 participants, including 35 videos from normal cognitive participants and 13 videos from MCI participants. The videos are divided into several segments. Then, the MCNN captures the latent facial spatial features and facial dynamic features of each segment and classifies the segment as MCI or normal. Finally, the aggregation stage produces the final detection results of the input video. We evaluate 27 MCNN model combinations including three ResNet architectures, three optimizers, and three activation functions. The experimental results showed that the ResNet-50 backbone with Swish activation function and Ranger optimizer produces the best results with an F1-score of 89% at the segment level. However, the ResNet-18 backbone with Swish and Ranger achieves the F1-score of 100% at the participant level. CONCLUSIONS This study presents an efficient new method for predicting MCI from facial videos. Studies have shown that MCI can be detected from facial videos, and facial data can be used as a biomarker for MCI. This approach is very promising for developing accurate models for screening MCI through facial data. It demonstrates that automated, non-invasive, and inexpensive MCI screening methods are feasible and do not require highly subjective paper-and-pencil questionnaires. Evaluation of 27 model combinations also found that ResNet-50 with Swish is more stable for different optimizers. Such results provide directions for hyperparameter tuning to further improve MCI predictions.
Collapse
Affiliation(s)
- Chien-Cheng Lee
- Department of Electrical Engineering, Yuan Ze University, Taoyuan, 320, Taiwan.
| | - Hong-Han Hank Chau
- Department of Electrical Engineering, Yuan Ze University, Taoyuan, 320, Taiwan
| | - Hsiao-Lun Wang
- Department of Electrical Engineering, Yuan Ze University, Taoyuan, 320, Taiwan
| | - Yi-Fang Chuang
- Institute of Public Health, College of Medicine, National Yang Ming Chiao Tung University, Taipei, 112, Taiwan
- Department of Psychiatry, Far Eastern Memorial Hospital, New Taipei City, 220, Taiwan
| | - Yawgeng Chau
- Department of Electrical Engineering, Yuan Ze University, Taoyuan, 320, Taiwan
| |
Collapse
|
6
|
Hashimoto W, Kaneda S. A smartphone application for personalized facial aesthetic monitoring. Skin Res Technol 2024; 30:e13824. [PMID: 38978223 PMCID: PMC11230921 DOI: 10.1111/srt.13824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2024] [Accepted: 06/03/2024] [Indexed: 07/10/2024]
Abstract
BACKGROUND Methods available at home for capturing facial images to track changes in skin quality and evaluate skincare treatments are limited. In this study, we developed a smartphone camera application (app) for personalized facial aesthetic monitoring. MATERIALS AND METHODS A face alignment indicators (FAIN) system utilizing facial landmark detection, an artificial intelligence technique, to estimate key facial parts, was implemented into the app to maintain a consistent facial appearance during image capture. The FAIN system is composed of a fixed target indicator and an alignment indicator that dynamically changes its shape according to the user's face position, size, and orientation. Users align their faces to match the alignment indicator with the fixed target indicator, and the image is automatically captured when alignment is achieved. RESULTS We investigated the app's effectiveness in ensuring a consistent facial appearance by analyzing both geometric and colorimetric data. Geometric information from captured faces and colorimetric data from stickers applied to the faces were utilized. The coefficients of variation (CVs) for the L*, a*, and b* values of the stickers were higher compared to those measured by a colorimeter, with CVs of 14.9 times, 8.14 times, and 4.41 times for L*, a*, and b*, respectively. To assess the feasibility of the app for facial aesthetic monitoring, we tracked changes in pseudo-skin color on the cheek of a participant using skin-colored stickers. As a result, we observed the smallest color difference ∆Eab of 1.901, which can be considered as the experimentally validated detection limit using images acquired by the app. CONCLUSION While the current monitoring method is a relative quantification approach, it contributes to evidence-based evaluations of skincare treatments.
Collapse
Affiliation(s)
- Wataru Hashimoto
- Mechanical Engineering Program, Graduate School of Engineering, Kogakuin University, Shinjuku-ku, Tokyo, Japan
| | - Shohei Kaneda
- Mechanical Engineering Program, Graduate School of Engineering, Kogakuin University, Shinjuku-ku, Tokyo, Japan
| |
Collapse
|
7
|
Sun J, Dodge HH, Mahoor MH. MC-ViViT: Multi-branch Classifier-ViViT to Detect Mild Cognitive Impairment in Older Adults Using Facial Videos. EXPERT SYSTEMS WITH APPLICATIONS 2024; 238:121929. [PMID: 39238945 PMCID: PMC11375964 DOI: 10.1016/j.eswa.2023.121929] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/07/2024]
Abstract
Deep machine learning models including Convolutional Neural Networks (CNN) have been successful in the detection of Mild Cognitive Impairment (MCI) using medical images, questionnaires, and videos. This paper proposes a novel Multi-branch Classifier-Video Vision Transformer (MC-ViViT) model to distinguish MCI from those with normal cognition by analyzing facial features. The data comes from the I-CONECT, a behavioral intervention trial aimed at improving cognitive function by providing frequent video chats. MC-ViViT extracts spatiotemporal features of videos in one branch and augments representations by the MC module. The I-CONECT dataset is challenging as the dataset is imbalanced containing Hard-Easy and Positive-Negative samples, which impedes the performance of MC-ViViT. We propose a loss function for Hard-Easy and Positive-Negative Samples (HP Loss) by combining Focal loss and AD-CORRE loss to address the imbalanced problem. Our experimental results on the I-CONECT dataset show the great potential of MC-ViViT in predicting MCI with a high accuracy of 90.63% accuracy on some of the interview videos.
Collapse
Affiliation(s)
- Jian Sun
- Department Of Computer Science, University of Denver, 2155 E Wesley Ave, Denver, Colorado, 80210, United States of America
| | - Hiroko H Dodge
- Department Of Neurology at Harvard Medical School, Harvard University, Massachusetts General Hospital, 55 Fruit St, Boston, Massachusetts, 02114, United States of America
| | - Mohammad H Mahoor
- Department Of Computer Engineering, University of Denver, 2155 E Wesley Ave, Denver, Colorado, 80210, United States of America
| |
Collapse
|
8
|
Umeda‐Kameyama Y, Kameyama M, Kojima T, Tanaka T, Iijima K, Ogawa S, Iizuka T, Akishita M. Investigation of a model for evaluating cognitive decline from facial photographs using AI. Geriatr Gerontol Int 2024; 24 Suppl 1:393-394. [PMID: 38168884 PMCID: PMC11503600 DOI: 10.1111/ggi.14793] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 11/30/2023] [Accepted: 12/11/2023] [Indexed: 01/05/2024]
Affiliation(s)
- Yumi Umeda‐Kameyama
- Dementia CenterThe University of Tokyo HospitalTokyoJapan
- Department of Geriatric MedicineThe University of TokyoTokyoJapan
| | - Masashi Kameyama
- Tokyo Metropolitan Institute for Geriatrics and GerontologyTokyoJapan
| | - Taro Kojima
- Department of Geriatric MedicineThe University of TokyoTokyoJapan
| | - Tomoki Tanaka
- Institute of Gerontology, The University of TokyoTokyoJapan
| | - Katsuya Iijima
- Institute of Gerontology, The University of TokyoTokyoJapan
- Institute for Future Initiatives, The University of TokyoTokyoJapan
| | - Sumito Ogawa
- Department of Geriatric MedicineThe University of TokyoTokyoJapan
| | | | | |
Collapse
|
9
|
Hiruma T, Saji M, Izumi Y, Higuchi R, Takamisawa I, Shimizu J, Nanasato M, Shimokawa T, Isobe M. Frailty assessment using photographs in patients undergoing transcatheter aortic valve replacement. J Cardiol 2024; 83:155-162. [PMID: 37517607 DOI: 10.1016/j.jjcc.2023.07.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 06/29/2023] [Accepted: 07/18/2023] [Indexed: 08/01/2023]
Abstract
BACKGROUND When frailty is considered in patient selection, better outcomes are achieved in transcatheter aortic valve replacement (TAVR) procedures. This study investigated whether patient photographs could be utilized to qualitatively assess patient frailty and independently predict poor outcomes following TAVR. METHODS This study included 1345 patients with severe aortic stenosis who underwent TAVR at the Sakakibara Heart Institute, Japan, between 2013 and 2022. Patient photographs were taken prior to the initial outpatient clinic examination or at discharge in case the patient's first visit was unplanned admission. Frailty was assessed from patient photographs using a four-point photographic frailty scale; 1 (non-frail), 2 (vulnerable), 3 (mild frail), and 4 (frail). Photographic frailty scale of 3 and 4 were defined as high. The primary endpoint was all-cause mortality following TAVR. RESULTS Seven hundred ninety-six patients who had their facial photographs taken within six months before the TAVR procedure were analyzed. Patients with a higher photographic frailty scale belonged to New York Heart Association classes III/IV, and had higher Society of Thoracic Surgeons scores, higher incidence of wheelchair usage, lower hemoglobin, and smaller aortic valve areas. According to the frailty assessment, patients with a higher photographic frailty scale exhibited slower performance in the 5-m walk test, reduced hand grip strength, more severe dementia, had a higher clinical frailty scale, and lower serum albumin level. Multivariable Cox regression analysis revealed that the high photographic frailty scale was independently associated with all-cause mortality (adjusted hazard ratio 1.62, 95 % confidence interval 1.12-2.33, p = 0.010). Kaplan-Meier analysis indicated that patients with high photographic frailty scale had higher all-cause mortality rates compared to those with low scale (log-rank p = 0.011). CONCLUSIONS Patient registration photographs can be used to obtain qualitative assessments of frailty in severe aortic stenosis cases, and such assessments can independently predict poor outcomes following TAVR.
Collapse
Affiliation(s)
- Takashi Hiruma
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan; Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Mike Saji
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan; Department of Cardiovascular Medicine, Toho University Faculty of Medicine, Tokyo, Japan.
| | - Yuki Izumi
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan
| | - Ryosuke Higuchi
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan
| | - Itaru Takamisawa
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan
| | - Jun Shimizu
- Department of Anesthesia, Sakakibara Heart Institute, Tokyo, Japan
| | - Mamoru Nanasato
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan
| | - Tomoki Shimokawa
- Department of Cardiovascular Surgery, Sakakibara Heart Institute, Tokyo, Japan
| | | |
Collapse
|
10
|
Kameyama M, Umeda‐Kameyama Y. Applications of artificial intelligence in dementia. Geriatr Gerontol Int 2024; 24 Suppl 1:25-30. [PMID: 37916614 PMCID: PMC11503597 DOI: 10.1111/ggi.14709] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 09/29/2023] [Accepted: 10/04/2023] [Indexed: 11/03/2023]
Abstract
The recent evolution of artificial intelligence (AI) can be considered life-changing. In particular, there is great interest in emerging hot topics in AI such as image classification and natural language processing. Our world has been revolutionized by convolutional neural networks and transformer for image classification and natural language processing, respectively. Moreover, these techniques can be used in the field of dementia. We introduce some applications of AI systems for treating and diagnosing dementia, including image-classification AI for recognizing facial features associated with dementia, image-classification AI for classifying leukoaraiosis in MRI images, object-detection AI for detecting microbleeding in MRI images, object-detection AI for support care, natural language-processing AI for detecting dementia within conversations, and natural language-processing AI for chatbots. Such AI technologies can significantly transform the future of dementia diagnosis and treatment. Geriatr Gerontol Int 2024; 24: 25-30.
Collapse
Affiliation(s)
- Masashi Kameyama
- AI and Theoretical Image Processing, Research Team for Neuroimaging, Tokyo Metropolitan Institute for Geriatrics and GerontologyTokyoJapan
| | - Yumi Umeda‐Kameyama
- Dementia CenterThe University of TokyoTokyoJapan
- Department of Geriatric MedicineGraduate School of Medicine, The University of TokyoTokyoJapan
| |
Collapse
|
11
|
Chien CF, Sung JL, Wang CP, Yen CW, Yang YH. Analyzing Facial Asymmetry in Alzheimer's Dementia Using Image-Based Technology. Biomedicines 2023; 11:2802. [PMID: 37893175 PMCID: PMC10604711 DOI: 10.3390/biomedicines11102802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 10/12/2023] [Accepted: 10/13/2023] [Indexed: 10/29/2023] Open
Abstract
Several studies have demonstrated accelerated brain aging in Alzheimer's dementia (AD). Previous studies have also reported that facial asymmetry increases with age. Because obtaining facial images is much easier than obtaining brain images, the aim of this work was to investigate whether AD exhibits accelerated aging patterns in facial asymmetry. We developed new facial asymmetry measures to compare Alzheimer's patients with healthy controls. A three-dimensional camera was used to capture facial images, and 68 facial landmarks were identified using an open-source machine-learning algorithm called OpenFace. A standard image registration method was used to align the three-dimensional original and mirrored facial images. This study used the registration error, representing landmark superimposition asymmetry distances, to examine 29 pairs of landmarks to characterize facial asymmetry. After comparing the facial images of 150 patients with AD with those of 150 age- and sex-matched non-demented controls, we found that the asymmetry of 20 landmarks was significantly different in AD than in the controls (p < 0.05). The AD-linked asymmetry was concentrated in the face edge, eyebrows, eyes, nostrils, and mouth. Facial asymmetry evaluation may thus serve as a tool for the detection of AD.
Collapse
Affiliation(s)
- Ching-Fang Chien
- Department of Neurology, Kaohsiung Municipal Ta-Tung Hospital, Kaohsiung Medical University Hospital, Kaohsiung Medical University, Kaohsiung 80756, Taiwan
- Department of Neurology, Kaohsiung Medical University Hospital, Kaohsiung Medical University, Kaohsiung 80756, Taiwan
| | - Jia-Li Sung
- Department of Mechanical and Electromechanical Engineering, National Sun Yat-sen University, Kaohsiung 80424, Taiwan
| | - Chung-Pang Wang
- Department of Mechanical and Electromechanical Engineering, National Sun Yat-sen University, Kaohsiung 80424, Taiwan
| | - Chen-Wen Yen
- Department of Mechanical and Electromechanical Engineering, National Sun Yat-sen University, Kaohsiung 80424, Taiwan
- Department of and Master’s Program in Neurology, Faculty of Medicine, College of Medicine, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
- Neuroscience Research Center, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
| | - Yuan-Han Yang
- Department of Neurology, Kaohsiung Municipal Ta-Tung Hospital, Kaohsiung Medical University Hospital, Kaohsiung Medical University, Kaohsiung 80756, Taiwan
- Department of Neurology, Kaohsiung Medical University Hospital, Kaohsiung Medical University, Kaohsiung 80756, Taiwan
- Department of and Master’s Program in Neurology, Faculty of Medicine, College of Medicine, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
- Neuroscience Research Center, Kaohsiung Medical University, Kaohsiung 80708, Taiwan
| |
Collapse
|
12
|
Zheng C, Bouazizi M, Ohtsuki T, Kitazawa M, Horigome T, Kishimoto T. Detecting Dementia from Face-Related Features with Automated Computational Methods. Bioengineering (Basel) 2023; 10:862. [PMID: 37508889 PMCID: PMC10376259 DOI: 10.3390/bioengineering10070862] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 07/13/2023] [Accepted: 07/14/2023] [Indexed: 07/30/2023] Open
Abstract
Alzheimer's disease (AD) is a type of dementia that is more likely to occur as people age. It currently has no known cure. As the world's population is aging quickly, early screening for AD has become increasingly important. Traditional screening methods such as brain scans or psychiatric tests are stressful and costly. The patients are likely to feel reluctant to such screenings and fail to receive timely intervention. While researchers have been exploring the use of language in dementia detection, less attention has been given to face-related features. The paper focuses on investigating how face-related features can aid in detecting dementia by exploring the PROMPT dataset that contains video data collected from patients with dementia during interviews. In this work, we extracted three types of features from the videos, including face mesh, Histogram of Oriented Gradients (HOG) features, and Action Units (AU). We trained traditional machine learning models and deep learning models on the extracted features and investigated their effectiveness in dementia detection. Our experiments show that the use of HOG features achieved the highest accuracy of 79% in dementia detection, followed by AU features with 71% accuracy, and face mesh features with 66% accuracy. Our results show that face-related features have the potential to be a crucial indicator in automated computational dementia detection.
Collapse
Affiliation(s)
- Chuheng Zheng
- Graduate School of Science and Technology, Keio University, Yokohama 223-0061, Kanagawa, Japan
| | - Mondher Bouazizi
- Faculty of Science and Technology, Keio University, Yokohama 223-0061, Kanagawa, Japan
| | - Tomoaki Ohtsuki
- Faculty of Science and Technology, Keio University, Yokohama 223-0061, Kanagawa, Japan
| | - Momoko Kitazawa
- School of Medicine, Keio University, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Toshiro Horigome
- School of Medicine, Keio University, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Taishiro Kishimoto
- School of Medicine, Keio University, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| |
Collapse
|
13
|
Chu CS, Wang DY, Liang CK, Chou MY, Hsu YH, Wang YC, Liao MC, Chu WT, Lin YT. Automated Video Analysis of Audio-Visual Approaches to Predict and Detect Mild Cognitive Impairment and Dementia in Older Adults. J Alzheimers Dis 2023; 92:875-886. [PMID: 36847001 DOI: 10.3233/jad-220999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2023]
Abstract
BACKGROUND Early identification of different stages of cognitive impairment is important to provide available intervention and timely care for the elderly. OBJECTIVE This study aimed to examine the ability of the artificial intelligence (AI) technology to distinguish participants with mild cognitive impairment (MCI) from those with mild to moderate dementia based on automated video analysis. METHODS A total of 95 participants were recruited (MCI, 41; mild to moderate dementia, 54). The videos were captured during the Short Portable Mental Status Questionnaire process; the visual and aural features were extracted using these videos. Deep learning models were subsequently constructed for the binary differentiation of MCI and mild to moderate dementia. Correlation analysis of the predicted Mini-Mental State Examination, Cognitive Abilities Screening Instrument scores, and ground truth was also performed. RESULTS Deep learning models combining both the visual and aural features discriminated MCI from mild to moderate dementia with an area under the curve (AUC) of 77.0% and accuracy of 76.0% . The AUC and accuracy increased to 93.0% and 88.0%, respectively, when depression and anxiety were excluded. Significant moderate correlations were observed between the predicted cognitive function and ground truth, and the correlation was strong excluding depression and anxiety. Interestingly, female, but not male, exhibited a correlation. CONCLUSION The study showed that video-based deep learning models can differentiate participants with MCI from those with mild to moderate dementia and can predict cognitive function. This approach may offer a cost-effective and easily applicable method for early detection of cognitive impairment.
Collapse
Affiliation(s)
- Che-Sheng Chu
- Department of Psychiatry, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan.,Center for Geriatrics and Gerontology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan.,Non-Invasive Neuromodulation Consortium for Mental Disorders, Society of Psychophysiology, Taipei, Taiwan.,Graduate Institute of Medicine, College of Medicine, Kaohsiung Medical University, Kaohsiung, Taiwan
| | - Di-Yuan Wang
- Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan
| | - Chih-Kuang Liang
- Center for Geriatrics and Gerontology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan.,Aging and Health Research Center, National Yang Ming Chiao Tung University, Taipei, Taiwan, Taipei City, Taiwan.,Department of Geriatric Medicine, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan, Taipei City, Taiwan.,Department of Internal Medicine, Division of Neurology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan, Kaohsiung City, Taiwan
| | - Ming-Yueh Chou
- Center for Geriatrics and Gerontology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan.,Aging and Health Research Center, National Yang Ming Chiao Tung University, Taipei, Taiwan, Taipei City, Taiwan.,Department of Geriatric Medicine, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan, Taipei City, Taiwan
| | - Ying-Hsin Hsu
- Center for Geriatrics and Gerontology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan.,Department of Internal Medicine, Division of Neurology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan, Kaohsiung City, Taiwan.,Chia Nan University, Tainan, Taiwan, Tainan City, Taiwan
| | - Yu-Chun Wang
- Center for Geriatrics and Gerontology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan
| | - Mei-Chen Liao
- Center for Geriatrics and Gerontology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan
| | - Wei-Ta Chu
- Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan
| | - Yu-Te Lin
- Center for Geriatrics and Gerontology, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan.,Aging and Health Research Center, National Yang Ming Chiao Tung University, Taipei, Taiwan, Taipei City, Taiwan.,Department of Pharmacy, Tajen University, Pingtung, Taiwan, Yanpu Township, Pingtung County, Taiwan
| |
Collapse
|
14
|
Karako K, Song P, Chen Y. Recent deep learning models for dementia as point-of-care testing: Potential for early detection. Intractable Rare Dis Res 2023; 12:1-4. [PMID: 36873669 PMCID: PMC9976095 DOI: 10.5582/irdr.2023.01015] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 02/22/2023] [Indexed: 02/25/2023] Open
Abstract
Deep learning has been intensively researched over the last decade, yielding several new models for natural language processing, images, speech and time series processing that have dramatically improved performance. This wave of technological developments in deep learning is also spreading to medicine. The effective use of deep learning in medicine is concentrated in diagnostic imaging-related applications, but deep learning has the potential to lead to early detection and prevention of diseases. Physical aspects of disease that went unnoticed can now be used in diagnosis with deep learning. In particular, deep learning models for the early detection of dementia have been proposed to predict cognitive function based on various information such as blood test results, speech, and the appearance of the face, where the effects of dementia can be seen. Deep learning is a useful diagnostic tool, as it has the potential to detect diseases early based on trivial aspects before clear signs of disease appear. The ability to easily make a simple diagnosis based on information such as blood test results, voice, pictures of the body, and lifestyle is a method suited to point-of-cate testing, which requires immediate testing at the desired time and place. Over the past few years, the process of predicting disease can now be visualized using deep learning, providing insights into new methods of diagnosis.
Collapse
Affiliation(s)
- Kenji Karako
- Department of Human and Engineered Environmental Studies, Graduate School of Frontier Sciences, The University of Tokyo, Chiba, Japan
| | - Peipei Song
- Center for Clinical Sciences, National Center for Global Health and Medicine, Tokyo, Japan
- National College of Nursing, Japan
- Address correspondence to:Peipei Song, Center for Clinical Sciences, National Center for Global Health and Medicine, 1-21-1 Toyama, Shinjuku, Tokyo 162-8655, Japan. E-mail:
| | - Yu Chen
- Department of Human and Engineered Environmental Studies, Graduate School of Frontier Sciences, The University of Tokyo, Chiba, Japan
- Address correspondence to:Peipei Song, Center for Clinical Sciences, National Center for Global Health and Medicine, 1-21-1 Toyama, Shinjuku, Tokyo 162-8655, Japan. E-mail:
| |
Collapse
|
15
|
Ieki H, Ito K, Saji M, Kawakami R, Nagatomo Y, Takada K, Kariyasu T, Machida H, Koyama S, Yoshida H, Kurosawa R, Matsunaga H, Miyazawa K, Ozaki K, Onouchi Y, Katsushika S, Matsuoka R, Shinohara H, Yamaguchi T, Kodera S, Higashikuni Y, Fujiu K, Akazawa H, Iguchi N, Isobe M, Yoshikawa T, Komuro I. Deep learning-based age estimation from chest X-rays indicates cardiovascular prognosis. COMMUNICATIONS MEDICINE 2022; 2:159. [PMID: 36494479 PMCID: PMC9734197 DOI: 10.1038/s43856-022-00220-6] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Accepted: 11/21/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND In recent years, there has been considerable research on the use of artificial intelligence to estimate age and disease status from medical images. However, age estimation from chest X-ray (CXR) images has not been well studied and the clinical significance of estimated age has not been fully determined. METHODS To address this, we trained a deep neural network (DNN) model using more than 100,000 CXRs to estimate the patients' age solely from CXRs. We applied our DNN to CXRs of 1562 consecutive hospitalized heart failure patients, and 3586 patients admitted to the intensive care unit with cardiovascular disease. RESULTS The DNN's estimated age (X-ray age) showed a strong significant correlation with chronological age on the hold-out test data and independent test data. Elevated X-ray age is associated with worse clinical outcomes (heart failure readmission and all-cause death) for heart failure. Additionally, elevated X-ray age was associated with a worse prognosis in 3586 patients admitted to the intensive care unit with cardiovascular disease. CONCLUSIONS Our results suggest that X-ray age can serve as a useful indicator of cardiovascular abnormalities, which will help clinicians to predict, prevent and manage cardiovascular diseases.
Collapse
Affiliation(s)
- Hirotaka Ieki
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan
| | - Kaoru Ito
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan.
| | - Mike Saji
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan
| | - Rei Kawakami
- Department of Computer Science, School of Computing, Tokyo Institute of Technology, Tokyo, Japan
| | - Yuji Nagatomo
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan
- Department of Cardiology, National Defense Medical College, Tokorozawa, Japan
| | - Kaori Takada
- Department of Radiology, Sakakibara Heart Institute, Tokyo, Japan
| | - Toshiya Kariyasu
- Department of Radiology, Sakakibara Heart Institute, Tokyo, Japan
- Department of Radiology, Tokyo Women's Medical University, Medical Center East, Tokyo, Japan
| | - Haruhiko Machida
- Department of Radiology, Sakakibara Heart Institute, Tokyo, Japan
- Department of Radiology, Tokyo Women's Medical University, Medical Center East, Tokyo, Japan
| | - Satoshi Koyama
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan
| | - Hiroki Yoshida
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Ryo Kurosawa
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan
| | - Hiroshi Matsunaga
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Kazuo Miyazawa
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan
| | - Kouichi Ozaki
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan
- Division for Genomic Medicine, Medical Genome Center, National Center for Geriatrics and Gerontology, Obu, Japan
| | - Yoshihiro Onouchi
- Laboratory for Cardiovascular Genomics and Informatics, RIKEN Center for Integrative Medical Sciences, Yokohama, Japan
- Department of Public Health, Chiba University Graduate School of Medicine, Chiba, Japan
| | - Susumu Katsushika
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Ryo Matsuoka
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Hiroki Shinohara
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Toshihiro Yamaguchi
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
- Center for Epidemiology and Preventive Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Satoshi Kodera
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Yasutomi Higashikuni
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Katsuhito Fujiu
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Hiroshi Akazawa
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Nobuo Iguchi
- Department of Cardiology, Sakakibara Heart Institute, Tokyo, Japan
| | | | | | - Issei Komuro
- Department of Cardiovascular Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
| |
Collapse
|
16
|
Sohn M, Yang J, Sohn J, Lee JH. Digital healthcare for dementia and cognitive impairment: A scoping review. Int J Nurs Stud 2022; 140:104413. [PMID: 36821951 DOI: 10.1016/j.ijnurstu.2022.104413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 11/11/2022] [Accepted: 11/24/2022] [Indexed: 12/12/2022]
Abstract
BACKGROUND Cognitive disorders, such as Alzheimer's disease, are a global health problem. Digital healthcare technology is an innovative management tool for delaying the progression of dementia and mild cognitive impairment. Thanks to digital technology, the possibility of safe and effective care for patients at home and in the community is increasing, even in situations that threaten the continuity of care, such as the COVID-19 pandemic. However, it is difficult to select appropriate technology and alternatives due to the lack of comprehensive reviews on the types and characteristics of digital technology for cognitive impairment, including their effects and limitations. OBJECTIVE This study aims to identify the types of digital healthcare technology for dementia and mild cognitive impairment and comprehensively examine how its outcome measures were constructed in line with each technology's purpose. METHODS According to the Preferred Reporting Items for Systematic reviews and Meta-Analysis extension for Scoping Reviews guidelines, a literature search was conducted in August 2021 using Medline (Ovid), EMBASE, and Cochrane library. The search terms were constructed based on Population-Concept-Context mnemonic: 'dementia', 'cognitive impairment', and 'cognitive decline'; digital healthcare technology, such as big data, artificial intelligence, virtual reality, robots, applications, and so on; and the outcomes of digital technology, such as accuracy of diagnosis and physical, mental, and social health. After grasping overall research trends, the literature was classified and analysed in terms of the type of service users and technology. RESULTS In total, 135 articles were selected. Since 2015, an increase in literature has been observed, and various digital healthcare technologies were identified. For people with mild cognitive impairment, technology for predicting and diagnosing the onset of dementia was studied, and for people with dementia, intervention technology to prevent the deterioration of health and induce significant improvement was considered. Regarding caregivers, many studies were conducted on monitoring and daily living assistive technologies that reduce the burden of care. However, problems such as data collection, storage, safety, and the digital divide persisted at different intensities for each technology type. CONCLUSIONS This study revealed that appropriate technology options and considerations may differ depending on the characteristics of users. It also emphasises the role of humans in designing and managing technology to apply digital healthcare technology more effectively.
Collapse
Affiliation(s)
- Minsung Sohn
- Division of Health and Medical Sciences, The Cyber University of Korea, Seoul, Republic of Korea
| | - JungYeon Yang
- Transdisciplinary Major in Learning Health Systems, Department of Public Health Science, Graduate School, Korea University, Republic of Korea
| | - Junyoung Sohn
- Department of Artificial Intelligence, Korea University, Seoul, Republic of Korea
| | - Jun-Hyup Lee
- Department of Health Policy and Management, College of Health Sciences, Korea University, Republic of Korea.
| |
Collapse
|
17
|
Hajjo R, Sabbah DA, Abusara OH, Al Bawab AQ. A Review of the Recent Advances in Alzheimer's Disease Research and the Utilization of Network Biology Approaches for Prioritizing Diagnostics and Therapeutics. Diagnostics (Basel) 2022; 12:diagnostics12122975. [PMID: 36552984 PMCID: PMC9777434 DOI: 10.3390/diagnostics12122975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Revised: 11/16/2022] [Accepted: 11/18/2022] [Indexed: 11/29/2022] Open
Abstract
Alzheimer's disease (AD) is a polygenic multifactorial neurodegenerative disease that, after decades of research and development, is still without a cure. There are some symptomatic treatments to manage the psychological symptoms but none of these drugs can halt disease progression. Additionally, over the last few years, many anti-AD drugs failed in late stages of clinical trials and many hypotheses surfaced to explain these failures, including the lack of clear understanding of disease pathways and processes. Recently, different epigenetic factors have been implicated in AD pathogenesis; thus, they could serve as promising AD diagnostic biomarkers. Additionally, network biology approaches have been suggested as effective tools to study AD on the systems level and discover multi-target-directed ligands as novel treatments for AD. Herein, we provide a comprehensive review on Alzheimer's disease pathophysiology to provide a better understanding of disease pathogenesis hypotheses and decipher the role of genetic and epigenetic factors in disease development and progression. We also provide an overview of disease biomarkers and drug targets and suggest network biology approaches as new tools for identifying novel biomarkers and drugs. We also posit that the application of machine learning and artificial intelligence to mining Alzheimer's disease multi-omics data will facilitate drug and biomarker discovery efforts and lead to effective individualized anti-Alzheimer treatments.
Collapse
Affiliation(s)
- Rima Hajjo
- Department of Pharmacy, Faculty of Pharmacy, Al-Zaytoonah University of Jordan, P.O. Box 130, Amman 11733, Jordan
- Laboratory for Molecular Modeling, Division of Chemical Biology and Medicinal Chemistry, Eshelman School of Pharmacy, The University of North Carlina at Chapel Hill, Chapel Hill, NC 27599, USA
- National Center for Epidemics and Communicable Disease Control, Amman 11118, Jordan
- Correspondence:
| | - Dima A. Sabbah
- Department of Pharmacy, Faculty of Pharmacy, Al-Zaytoonah University of Jordan, P.O. Box 130, Amman 11733, Jordan
| | - Osama H. Abusara
- Department of Pharmacy, Faculty of Pharmacy, Al-Zaytoonah University of Jordan, P.O. Box 130, Amman 11733, Jordan
| | - Abdel Qader Al Bawab
- Department of Pharmacy, Faculty of Pharmacy, Al-Zaytoonah University of Jordan, P.O. Box 130, Amman 11733, Jordan
| |
Collapse
|
18
|
Review on Facial-Recognition-Based Applications in Disease Diagnosis. Bioengineering (Basel) 2022; 9:bioengineering9070273. [PMID: 35877324 PMCID: PMC9311612 DOI: 10.3390/bioengineering9070273] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2022] [Revised: 06/13/2022] [Accepted: 06/20/2022] [Indexed: 01/19/2023] Open
Abstract
Diseases not only manifest as internal structural and functional abnormalities, but also have facial characteristics and appearance deformities. Specific facial phenotypes are potential diagnostic markers, especially for endocrine and metabolic syndromes, genetic disorders, facial neuromuscular diseases, etc. The technology of facial recognition (FR) has been developed for more than a half century, but research in automated identification applied in clinical medicine has exploded only in the last decade. Artificial-intelligence-based FR has been found to have superior performance in diagnosis of diseases. This interdisciplinary field is promising for the optimization of the screening and diagnosis process and assisting in clinical evaluation and decision-making. However, only a few instances have been translated to practical use, and there is need of an overview for integration and future perspectives. This review mainly focuses on the leading edge of technology and applications in varieties of disease, and discusses implications for further exploration.
Collapse
|
19
|
Sato K, Niimi Y, Mano T, Iwata A, Iwatsubo T. Automated Evaluation of Conventional Clock-Drawing Test Using Deep Neural Network: Potential as a Mass Screening Tool to Detect Individuals With Cognitive Decline. Front Neurol 2022; 13:896403. [PMID: 35592474 PMCID: PMC9110693 DOI: 10.3389/fneur.2022.896403] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Accepted: 04/05/2022] [Indexed: 11/13/2022] Open
Abstract
Introduction The Clock-Drawing Test (CDT) is a simple cognitive tool to examine multiple domains of cognition including executive function. We aimed to build a CDT-based deep neural network (DNN) model using data from a large cohort of older adults, to automatically detect cognitive decline, and explore its potential as a mass screening tool. Methods Over 40,000 CDT images were obtained from the National Health and Aging Trends Study (NHATS) database, which collects the annual surveys of nationally representative community-dwelling older adults in the United States. A convolutional neural network was utilized in deep learning architecture to predict the cognitive status of participants based on drawn clock images. Results The trained DNN model achieved balanced accuracy of 90.1 ± 0.6% in identifying those with a decline in executive function compared to those without [positive likelihood ratio (PLH) = 16.3 ± 6.8, negative likelihood ratio (NLH) = 0.14 ± 0.03], and 77.2 ± 2.7 % balanced accuracy for identifying those with probable dementia from those without (PLH = 5.1 ± 0.5, NLH = 0.37 ± 0.07). Conclusions This study demonstrated the feasibility of implementing conventional CDT to be automatically evaluated by DNN with a fair performance in a larger scale than ever, suggesting its potential as a mass screening test for ruling-in or ruling-out those with executive dysfunction or with probable dementia.
Collapse
Affiliation(s)
- Kenichiro Sato
- Department of Neuropathology, Graduate School of Medicine, The University of Tokyo, Bunkyo, Japan
- Unit for Early and Exploratory Clinical Development, The University of Tokyo Hospital, Tokyo, Japan
- *Correspondence: Kenichiro Sato
| | - Yoshiki Niimi
- Unit for Early and Exploratory Clinical Development, The University of Tokyo Hospital, Tokyo, Japan
| | - Tatsuo Mano
- Department of Neurology, Graduate School of Medicine, The University of Tokyo, Bunkyo, Japan
| | - Atsushi Iwata
- Department of Neurology, Tokyo Metropolitan Geriatric Center Hospital, Tokyo, Japan
| | - Takeshi Iwatsubo
- Department of Neuropathology, Graduate School of Medicine, The University of Tokyo, Bunkyo, Japan
- Unit for Early and Exploratory Clinical Development, The University of Tokyo Hospital, Tokyo, Japan
- Takeshi Iwatsubo
| |
Collapse
|
20
|
Chen LY, Tsai TH, Ho A, Li CH, Ke LJ, Peng LN, Lin MH, Hsiao FY, Chen LK. Predicting neuropsychiatric symptoms of persons with dementia in a day care center using a facial expression recognition system. Aging (Albany NY) 2022; 14:1280-1291. [PMID: 35113806 PMCID: PMC8876896 DOI: 10.18632/aging.203869] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Accepted: 01/17/2022] [Indexed: 11/25/2022]
Abstract
BACKGROUND Behavioral and psychological symptoms of dementia (BPSD) affect 90% of persons with dementia (PwD), resulting in various adverse outcomes and aggravating care burdens among their caretakers. This study aimed to explore the potential of artificial intelligence-based facial expression recognition systems (FERS) in predicting BPSDs among PwD. METHODS A hybrid of human labeling and a preconstructed deep learning model was used to differentiate basic facial expressions of individuals to predict the results of Neuropsychiatric Inventory (NPI) assessments by stepwise linear regression (LR), random forest (RF) with importance ranking, and ensemble method (EM) of equal importance, while the accuracy was determined by mean absolute error (MAE) and root-mean-square error (RMSE) methods. RESULTS Twenty-three PwD from an adult day care center were enrolled with ≥ 11,500 FERS data series and 38 comparative NPI scores. The overall accuracy was 86% on facial expression recognition. Negative facial expressions and variance in emotional switches were important features of BPSDs. A strong positive correlation was identified in each model (EM: r = 0.834, LR: r = 0.821, RF: r = 0.798 by the patientwise method; EM: r = 0.891, LR: r = 0.870, RF: r = 0.886 by the MinimPy method), and EM exhibited the lowest MAE and RMSE. CONCLUSIONS FERS successfully predicted the BPSD of PwD by negative emotions and the variance in emotional switches. This finding enables early detection and management of BPSDs, thus improving the quality of dementia care.
Collapse
Affiliation(s)
- Liang-Yu Chen
- Aging and Health Research Center, Taipei, Taiwan
- Institute of Public Health, National Yang-Ming Chiao-Tung University, Taipei, Taiwan
- Center for Geriatrics and Gerontology, Taipei, Taiwan
- uAge Day Care Center, Taipei Veterans General Hospital, Taipei, Taiwan
| | | | - Andy Ho
- Value Lab, Acer Incorporated, New Taipei City, Taiwan
| | - Chun-Hsien Li
- Value Lab, Acer Incorporated, New Taipei City, Taiwan
| | - Li-Ju Ke
- uAge Day Care Center, Taipei Veterans General Hospital, Taipei, Taiwan
| | - Li-Ning Peng
- Aging and Health Research Center, Taipei, Taiwan
- Center for Geriatrics and Gerontology, Taipei, Taiwan
| | - Ming-Hsien Lin
- Aging and Health Research Center, Taipei, Taiwan
- Center for Geriatrics and Gerontology, Taipei, Taiwan
| | - Fei-Yuan Hsiao
- Graduate Institute of Clinical Pharmacy, National Taiwan University, Taipei, Taiwan
- School of Pharmacy, National Taiwan University, Taipei, Taiwan
- Department of Pharmacy, National Taiwan University Hospital, Taipei, Taiwan
| | - Liang-Kung Chen
- Aging and Health Research Center, Taipei, Taiwan
- Center for Geriatrics and Gerontology, Taipei, Taiwan
- Taipei Municipal Gan-Dau Hospital, Taipei, Taiwan
| |
Collapse
|
21
|
AIM in Neurodegenerative Diseases: Parkinson and Alzheimer. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
22
|
K. P. MN, P. T. Alzheimer's classification using dynamic ensemble of classifiers selection algorithms: A performance analysis. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102729] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
23
|
Davids J, Ashrafian H. AIM in Neurodegenerative Diseases: Parkinson and Alzheimer. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_190-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|