1
|
Xie X, Shi R, Yu H, Wan X, Liu T, Duan D, Li D, Wen D. Executive function rehabilitation and evaluation based on brain-computer interface and virtual reality: our opinion. Front Neurosci 2024; 18:1377097. [PMID: 38808030 PMCID: PMC11130371 DOI: 10.3389/fnins.2024.1377097] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 04/29/2024] [Indexed: 05/30/2024] Open
Affiliation(s)
- Xueguang Xie
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Ruihang Shi
- School of Information Science and Engineering, Yanshan University, Qinhuangdao, Hebei, China
| | - Hao Yu
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Xianglong Wan
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Tiange Liu
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Dingna Duan
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Danyang Li
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Dong Wen
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| |
Collapse
|
2
|
Catania V, Rundo F, Panerai S, Ferri R. Virtual Reality for the Rehabilitation of Acquired Cognitive Disorders: A Narrative Review. Bioengineering (Basel) 2023; 11:35. [PMID: 38247912 PMCID: PMC10813804 DOI: 10.3390/bioengineering11010035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 12/19/2023] [Accepted: 12/27/2023] [Indexed: 01/23/2024] Open
Abstract
This review article explores the use of Virtual Reality (VR) technology in cognitive rehabilitation for individuals with neurological conditions, such as stroke, traumatic brain injury, and neurodegenerative diseases. The introduction highlights the challenges posed by cognitive impairments and the limitations of traditional rehabilitation methods. VR is presented as a transformative tool that immerses individuals in interactive environments, offering promising opportunities for enhancing cognitive functions and improving quality of life. This article covers the foundational principles of VR, its applications across different clinical conditions and cognitive domains, and evaluates empirical evidence supporting its efficacy. It also discusses the advantages, limitations, challenges, and ethical considerations in the use of VR for cognitive rehabilitation. This review concludes by exploring future developments, including advancements in VR technology, the integration of Augmented Reality (AR) and artificial intelligence (AI), and the importance of standardized assessment tools for the objective evaluation of rehabilitation outcomes.
Collapse
Affiliation(s)
| | | | | | - Raffaele Ferri
- Units of Psychology I.C. and Unit of Bioinformatics and Statistics, Oasi Research Institute-IRCCS, 94018 Troina, Italy; (V.C.); (F.R.); (S.P.)
| |
Collapse
|
3
|
Oh GS, Kim J, Jeong W, Oh S, Whangbo TK. Development and Effectiveness Verification of Metaverse Cognitive Therapy Contents for MCI Patients. SENSORS (BASEL, SWITZERLAND) 2023; 23:6010. [PMID: 37447859 DOI: 10.3390/s23136010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 06/19/2023] [Accepted: 06/24/2023] [Indexed: 07/15/2023]
Abstract
It is very important to prevent dementia by intervening in advance in the stage of mild cognitive impairment, which is the pre-stage of dementia. Recently, cognitive therapy research using metaverse has been on the rise. We propose a way to utilize metaverse cognitive therapy content as a non-drug treatment method of mild cognitive impairment patients. This paper shows the results of clinical trials using metaverse cognitive therapy contents developed by us. We collected data from MCI patient groups and normal groups through MMSE-KC tests and in-content data collection systems. We conducted paired t-tests and repeat measurement ANOVA based on the collected data. The results of this study show how metaverse cognitive therapy content affects MCI patients, and suggest various factors to be considered when creating functional content.
Collapse
Affiliation(s)
- Gi Sung Oh
- Department of IT Convergence Engineering, Gachon University, Seongnam-si 13120, Republic of Korea
| | - Jehyun Kim
- Department of IT Convergence Engineering, Gachon University, Seongnam-si 13120, Republic of Korea
| | - Wonjun Jeong
- Department of IT Convergence Engineering, Gachon University, Seongnam-si 13120, Republic of Korea
| | - Seokhee Oh
- Korea Creative Content Agency, Daejeon Metropolitan City 34863, Republic of Korea
| | - Taeg Keun Whangbo
- Department of Computer Engineering, Gachon University, Seongnam-si 13120, Republic of Korea
| |
Collapse
|
4
|
Panerai S, Catania V, Rundo F, Tasca D, Musso S, Babiloni C, Prestianni G, Muratore S, Ferri R. Functional Living Skills in Patients with Major Neurocognitive Disorder Due to Degenerative or Non-Degenerative Conditions: Effectiveness of a Non-Immersive Virtual Reality Training. SENSORS (BASEL, SWITZERLAND) 2023; 23:1896. [PMID: 36850494 PMCID: PMC9966630 DOI: 10.3390/s23041896] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Revised: 01/26/2023] [Accepted: 02/06/2023] [Indexed: 06/18/2023]
Abstract
Virtual reality has gained attention as an effective tool for cognitive, motor, and daily activity rehabilitation in patients with major neurocognitive disorder (M-NCD). The first objective of this study was to check for differences between M-NCD caused by degenerative and non-degenerative conditions (DC and NDC, respectively) in terms of relearning four functional living skills (FLSs), by means of a non-immersive virtual reality training (VRT). The second purpose was to verify whether spontaneous transfer from the virtual environment to the real environment occurred. Four FLS apps were developed in our institute (Information, Suitcase, Medicine, and Supermarket). A nonrandomized interventional study was carried out, comparing experimental and control groups (EG and CG, respectively). The study included three phases: in vivo test at T1; VRT at T2 only for EG; in vivo test at T3. During the in vivo test, the four FLSs were assessed in their natural environments. Both EG-DC and EG-NDC significantly improved in all of the VRT variable scores (the EG-NDC group seemed to show better outcomes than the EG-DC group). Moderate-to-high satisfaction with the VRT was reported. EG-DC and EG-NDC also enhanced their performances in the in vivo test. No statistically significant differences between them were found. CG-DC and CG-NDC improved only in the execution time of Information in the in vivo test. These findings confirm the ecological validity of VRT for FLSs.
Collapse
Affiliation(s)
- Simonetta Panerai
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy
| | - Valentina Catania
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy
| | - Francesco Rundo
- Unit of Bioinformatics and Statistics, Oasi Research Institute-IRCCS, 94018 Troina, Italy
| | - Domenica Tasca
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy
| | - Sabrina Musso
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy
| | - Claudio Babiloni
- Department of Physiology and Pharmacology “V. Erspamer”, Sapienza University of Rome, 00185 Rome, Italy
| | | | - Stefano Muratore
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy
| | - Raffaele Ferri
- Unit of Neurology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy
| |
Collapse
|
5
|
Muñoz D, Barria P, Cifuentes CA, Aguilar R, Baleta K, Azorín JM, Múnera M. EEG Evaluation in a Neuropsychological Intervention Program Based on Virtual Reality in Adults with Parkinson's Disease. BIOSENSORS 2022; 12:bios12090751. [PMID: 36140136 PMCID: PMC9496185 DOI: 10.3390/bios12090751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 08/09/2022] [Accepted: 08/18/2022] [Indexed: 05/05/2023]
Abstract
Nowadays, several strategies for treating neuropsychologic function loss in Parkinson’s disease (PD) have been proposed, such as physical activity performance and developing games to exercise the mind. However, few studies illustrate the incidence of these therapies in neuronal activity. This work aims to study the feasibility of a virtual reality-based program oriented to the cognitive functions’ rehabilitation of PD patients. For this, the study was divided into intervention with the program, acquisition of signals, data processing, and results analysis. The alpha and beta bands’ power behavior was determined by evaluating the electroencephalography (EEG) signals obtained during the execution of control tests and games of the “Hand Physics Lab” Software, from which five games related to attention, planning, and sequencing, concentration, and coordination were taken. Results showed the characteristic performance of the cerebral bands during resting states and activity states. In addition, it was determined that the beta band increased its activity in all the cerebral lobes in all the tested games (p-value < 0.05). On the contrary, just one game exhibited an adequate performance of the alpha band activity of the temporal and frontal lobes (p-value < 0.02). Furthermore, the visual attention and the capacity to process and interpret the information given by the surroundings was favored during the execution of trials (p-value < 0.05); thus, the efficacy of the virtual reality program to recover cognitive functions was verified. The study highlights implementing new technologies to rehabilitate people with neurodegenerative diseases.
Collapse
Affiliation(s)
- Daniela Muñoz
- Biomedical Engineering Department, Colombian School of Engineering Julio Garavito, Bogota 111166, Colombia
| | - Patricio Barria
- Club de Leones Cruz del Sur Rehabilitation Center, Punta Arenas 6210133, Chile
- Electrical Engineering Deparment, University of Magallanes, Punta Arenas 6210427, Chile
- Systems Engineering and Automation Department, Brain-Machine Interface Systems Lab, Miguel Hernández University of Elche UMH, 03202 Elche, Spain
| | - Carlos A. Cifuentes
- Bristol Robotics Laboratory, University of the West of England, Bristol BS16 1QY, UK
- School of Engineering, Science and Technology, Universidad del Rosario, Bogotá 111711, Colombia
- Correspondence:
| | - Rolando Aguilar
- Electrical Engineering Deparment, University of Magallanes, Punta Arenas 6210427, Chile
| | - Karim Baleta
- Club de Leones Cruz del Sur Rehabilitation Center, Punta Arenas 6210133, Chile
| | - José M. Azorín
- Systems Engineering and Automation Department, Brain-Machine Interface Systems Lab, Miguel Hernández University of Elche UMH, 03202 Elche, Spain
| | - Marcela Múnera
- Biomedical Engineering Department, Colombian School of Engineering Julio Garavito, Bogota 111166, Colombia
| |
Collapse
|
6
|
Wen D, Li R, Tang H, Liu Y, Wan X, Dong X, Saripan MI, Lan X, Song H, Zhou Y. Task-state EEG signal classification for spatial cognitive evaluation based on multi-scale high-density convolutional neural network. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1041-1051. [PMID: 35404820 DOI: 10.1109/tnsre.2022.3166224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
In this study, a multi-scale high-density convolutional neural network (MHCNN) classification method for spatial cognitive ability assessment was proposed, aiming at achieving the binary classification of task-state EEG signals before and after spatial cognitive training. Besides, the multi-dimensional conditional mutual information method was used to extract the frequency band features of the EEG data. And the coupling features under the combination of multi-frequency bands were transformed into multi-spectral images. At the same time, the idea of Densenet was introduced to improve the multi-scale convolutional neural network. Firstly, according to the discreteness of multispectral EEG image features, two-scale convolution kernels were used to calculate and learn useful channel and frequency band feature information in multispectral image data. Secondly, to enhance feature propagation and reduce the number of parameters, the dense network was connected after the multi-scale convolutional network, and the learning rate change function of the stochastic gradient descent algorithm was optimized to objectively evaluate the training effect. The experimental results showed that compared with the classical convolution neural network (CNN) and multi-scale convolution neural network, the proposed MHCNN had better classification performance in the six frequency band combinations with the highest accuracy of 98%: Theta-Alpha2-Gamma, Alpha2-Beta2-Gamma, Beta1-Beta2-Gamma, Theta-Beta2-Gamma, Theta-Alpha1-Gamma, and Alpha1-Alpha2-Gamma. By comparing the classification results of six frequency band combinations, it was found that the combination of the Theta-Beta2-Gamma band had the best classification effect. The MHCNN classification method proposed in this research could be used as an effective biological indicator of spatial cognitive training effect and could be extended to other brain function evaluations.
Collapse
|
7
|
Wen D, Xu J, Wu Z, Liu Y, Zhou Y, Li J, Wang S, Dong X, Saripan MI, Song H. The Effective Cognitive Assessment and Training Methods for COVID-19 Patients With Cognitive Impairment. Front Aging Neurosci 2022; 13:827273. [PMID: 35087399 PMCID: PMC8787269 DOI: 10.3389/fnagi.2021.827273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Accepted: 12/16/2021] [Indexed: 11/13/2022] Open
Affiliation(s)
- Dong Wen
- Brain Computer Intelligence and Intelligent Health Institution, Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing, China
| | - Jian Xu
- The Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province, School of Information Science and Engineering, Yanshan University, Qinhuangdao, China
| | - Zhonglin Wu
- The Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province, School of Information Science and Engineering, Yanshan University, Qinhuangdao, China
| | - Yijun Liu
- Department of Statistics, School of Science, Yanshan University, Qinhuangdao, China
| | - Yanhong Zhou
- Department of Computer Science and Technology, School of Mathematics and Information Science and Technology, Hebei Normal University of Science and Technology, Qinhuangdao, China
- *Correspondence: Yanhong Zhou
| | - Jingjing Li
- The Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province, School of Information Science and Engineering, Yanshan University, Qinhuangdao, China
| | - Shaochang Wang
- The Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province, School of Information Science and Engineering, Yanshan University, Qinhuangdao, China
| | - Xianlin Dong
- Department of Biomedical Engineering, Chengde Medical University, Chengde, China
| | - M. Iqbal Saripan
- Department of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia, Serdang, Malaysia
| | - Haiqing Song
- Department of Neurology, Xuanwu Hospital of Capital Medical University, Beijing, China
- Haiqing Song
| |
Collapse
|
8
|
Monaghesh E, Samad-Soltani T, Farhang S. Virtual reality-based interventions for patients with paranoia: A systematic review. Psychiatry Res 2022; 307:114338. [PMID: 34922239 DOI: 10.1016/j.psychres.2021.114338] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Revised: 12/07/2021] [Accepted: 12/09/2021] [Indexed: 12/31/2022]
Abstract
BACKGROUND AND OBJECTIVE Paranoia is an important psychiatric symptom with a remarkable effect on daily life. Virtual reality (VR)-based treatments are influential and safe for patients with paranoia. This study aimed to evaluate the effectiveness, and define the clinical and technical characteristics of available VR strategies for the treatment of patients with paranoia. MATERIALS AND METHODS Studies published up to 25/11/2021 reporting VR-based interventions for the treatment of patients with paranoia were reviewed in five databases, including PubMed, Embase, Web of Science, PsycINFO, and Scopus. RESULTS Out of 302 initial search results, eight were included in the present study based on the inclusion criteria. Six studies were randomized clinical trials with the interventions in the experimental group being based on VR, compared to routine interventions as controls. Two were before-after studies. The most commonly used hardware and software were head-mounted display and Unity3D, respectively. Interventions had a range of 1-16 sessions with follow-up durations of 0-6 months. All investigations showed positive results in the main target, including improved social participation, reduced level of anxiety, as well as diminished suspicious ideas and paranoid symptoms. CONCLUSIONS Our findings demonstrated that VR-based interventions are effective treatments. Although the use of VR technology is limited for a variety of reasons, such as cost, it improves symptoms in patients with paranoia.
Collapse
Affiliation(s)
- Elham Monaghesh
- Department of Health Information Technology, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Taha Samad-Soltani
- Department of Health Information Technology, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Sara Farhang
- Research Center of Psychiatry and Behavioral Sciences, Tabriz University of Medical Sciences, Tabriz, Iran; University of Groningen, University medical center Groningen, University Center for Psychiatry, Rob Giel research center, Hanzeplein 1, Postbus: 30.001, HPC CC72, Groningen, RB 9700, Netherlands.
| |
Collapse
|
9
|
Faw MH, Buley T, Malinin LH. Being There: Exploring Virtual Symphonic Experience as a Salutogenic Design Intervention for Older Adults. Front Psychol 2021; 12:541656. [PMID: 34925115 PMCID: PMC8674500 DOI: 10.3389/fpsyg.2021.541656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2020] [Accepted: 11/12/2021] [Indexed: 11/13/2022] Open
Abstract
This co-design study examined salutogenic potential of mobile virtual reality (VR) experiences as an alternative to participation in a community-based symphonic engagement program (B Sharp), previously found to benefit people with dementia (PWD) and their informal caregivers. Six focus groups were conducted with sixteen adults aged 76–90; three participants had dementia, and two were informal spousal caregivers. No participants had prior VR experience. The study assessed the feasibility of replicating the community-based-arts program in VR, with the goal of enhancing its salutogenic qualities (e.g., positive distraction, engagement, and social connection). Video-recordings of participants while using a mobile head-mounted display (HMD) were analyzed using qualitative thematic analysis to compare perceptions of different virtual experiences, including replication or enhancement of B Sharp and a campus tour. Findings suggest participants had positive perceptions of enhanced VR experiences with no adverse effects, although PWD were less enthusiastic and HMD usability was complicated by eyewear use and comfort with technology. Participants reacted most favorably to the enhanced symphonic experience, where they were “virtually” onstage during the performance, suggesting unique experiences beyond what is possible in the real world have the greatest potential for deep immersion for older adults. Results suggest VR has strong potential to replicate and enhance salutogenic qualities of community-based programming by enabling greater access to experiences for older adults and by increasing enjoyment and engagement through experiences not otherwise feasible. Furthermore, this study illuminates advantages of a user-centered, co-design approach when developing VR experiences with community partners and older adults.
Collapse
Affiliation(s)
- Meara H Faw
- Department of Communication Studies, Colorado State University, Fort Collins, CO, United States
| | - Taylor Buley
- Department of Communication Studies, Colorado State University, Fort Collins, CO, United States
| | - Laura Healey Malinin
- Department of Design and Merchandising, College of Health and Human Sciences, Colorado State University, Fort Collins, CO, United States
| |
Collapse
|
10
|
Panerai S, Gelardi D, Catania V, Rundo F, Tasca D, Musso S, Prestianni G, Muratore S, Babiloni C, Ferri R. Functional Living Skills: A Non-Immersive Virtual Reality Training for Individuals with Major Neurocognitive Disorders. SENSORS 2021; 21:s21175751. [PMID: 34502642 PMCID: PMC8433763 DOI: 10.3390/s21175751] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/19/2021] [Revised: 08/15/2021] [Accepted: 08/24/2021] [Indexed: 11/16/2022]
Abstract
The loss of functional living skills (FLS) is an essential feature of major neurocognitive disorders (M-NCD); virtual reality training (VRT) offers many possibilities for improving FLS in people with M-NCD. The aim of our study was to verify the effectiveness of a non-immersive VRT on FLS for patients with M-NCD. VRT was carried out for 10 to 20 sessions, by means of four 3D apps developed in our institute and installed on a large touch screen. The experimental group (EG) and the control group (CG) included 24 and 18 patients with M-NCD, respectively. They were administered the in vivo test (in specific hospital places reproducing the natural environments) at T1 (pre-training) and T3 (post-training); at T2, only EG was administered VRT. Statistically significant differences between EG and CG in all the in vivo tests were found in the number of correct responses; during VRT, the number of correct responses increased, while the execution times and the number of clues decreased. The improvement in the in vivo tests appeared to be related to the specific VRT applied. The satisfaction of participants with the VRT was moderate to high.
Collapse
Affiliation(s)
- Simonetta Panerai
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy; (S.P.); (D.G.); (V.C.); (D.T.); (S.M.); (G.P.); (S.M.)
| | - Donatella Gelardi
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy; (S.P.); (D.G.); (V.C.); (D.T.); (S.M.); (G.P.); (S.M.)
| | - Valentina Catania
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy; (S.P.); (D.G.); (V.C.); (D.T.); (S.M.); (G.P.); (S.M.)
| | - Francesco Rundo
- Unit of Bioinformatics and Statistics, Oasi Research Institute-IRCCS, 94018 Troina, Italy;
| | - Domenica Tasca
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy; (S.P.); (D.G.); (V.C.); (D.T.); (S.M.); (G.P.); (S.M.)
| | - Sabrina Musso
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy; (S.P.); (D.G.); (V.C.); (D.T.); (S.M.); (G.P.); (S.M.)
| | - Giuseppina Prestianni
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy; (S.P.); (D.G.); (V.C.); (D.T.); (S.M.); (G.P.); (S.M.)
| | - Stefano Muratore
- Unit of Psychology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy; (S.P.); (D.G.); (V.C.); (D.T.); (S.M.); (G.P.); (S.M.)
| | - Claudio Babiloni
- Department of Physiology and Pharmacology “V. Erspamer”, Sapienza University of Rome, 00185 Rome, Italy;
| | - Raffaele Ferri
- Unit of Neurology I.C., Oasi Research Institute-IRCCS, 94018 Troina, Italy
- Correspondence:
| |
Collapse
|
11
|
Iliadou P, Paliokas I, Zygouris S, Lazarou E, Votis K, Tzovaras D, Tsolaki M. A Comparison of Traditional and Serious Game-Based Digital Markers of Cognition in Older Adults with Mild Cognitive Impairment and Healthy Controls. J Alzheimers Dis 2021; 79:1747-1759. [PMID: 33459650 PMCID: PMC7990420 DOI: 10.3233/jad-201300] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Background: Electroencephalography (EEG) has been used to assess brain activity while users are playing an immersive serious game. Objective: To assess differences in brain activation as measured with a non-intrusive wearable EEG device, differences in game performance and correlations between EEG power, game performance and global cognition, between cognitively impaired and non-impaired older adults, during the administration of a novel self-administered serious game-based test, the Virtual Supermarket Test (VST). Methods: 43 older adults with subjective cognitive decline (SCD) and 33 older adults with mild cognitive impairment (MCI) were recruited from day centers for cognitive disorders. Global cognition was assessed with the Montreal Cognitive Assessment (MoCA). Brain activity was measured with a non-intrusive wearable EEG device in a resting state condition and while they were administered the VST. Results: During resting state condition, the MCI group showed increased alpha, beta, delta, and theta band power compared to the SCD group. During the administration of the VST, the MCI group showed increased beta and theta band power compared to the SCD group. Regarding game performance, alpha, beta, delta, and theta rhythms were positively correlated with average duration, while delta rhythm was positively correlated with mean errors. MoCA correlated with alpha, beta, delta, and theta rhythms and with average game duration and mean game errors indicating that elevated EEG rhythms in MCI may be associated with an overall cognitive decline. Conclusion: VST performance can be used as a digital biomarker. Cheap commercially available wearable EEG devices can be used for obtaining brain activity biomarkers.
Collapse
Affiliation(s)
| | - Ioannis Paliokas
- Centre for Research and Technology Hellas/ Information Technologies Institute, Thessaloniki, Greece
| | - Stelios Zygouris
- School of Medicine, Aristotle University of Thessaloniki, Greece.,Network Aging Research, Heidelberg University, Germany
| | - Eftychia Lazarou
- Greek Association of Alzheimer's Disease and Related Disorders, Thessaloniki, Greece
| | - Konstantinos Votis
- Centre for Research and Technology Hellas/ Information Technologies Institute, Thessaloniki, Greece
| | - Dimitrios Tzovaras
- Centre for Research and Technology Hellas/ Information Technologies Institute, Thessaloniki, Greece
| | - Magdalini Tsolaki
- School of Medicine, Aristotle University of Thessaloniki, Greece.,Greek Association of Alzheimer's Disease and Related Disorders, Thessaloniki, Greece
| |
Collapse
|
12
|
Tan W, Xu Y, Liu P, Liu C, Li Y, Du Y, Chen C, Wang Y, Zhang Y. A method of VR-EEG scene cognitive rehabilitation training. Health Inf Sci Syst 2020; 9:4. [PMID: 33269073 DOI: 10.1007/s13755-020-00132-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Accepted: 10/27/2020] [Indexed: 11/28/2022] Open
Abstract
Virtual reality technology can intuitively provide patients of neuropsychological diseases with an almost real environment for cognitive rehabilitation training . In this paper, virtual reality technology is used to construct specific scenes that are universal and related to MCI patients to restore and train patients' scene memory cognitive ability to help patients strengthen or gradually restore scene memory cognitive ability. The construction of virtual reality scenes with different contents such as life, environment, transportation and tourism, real-time detection is carried out in combination with EEG signals of patients in different scenes. The experimental results of the analysis of EEG signals of patients shows that memory rehabilitation training is strengthened by using specific stimulation scenes.
Collapse
Affiliation(s)
- Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, 110189 China.,Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou, 510006 China
| | - Yang Xu
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Pan Liu
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Chunyan Liu
- Department of Neurology, Xuanwu Hospital, Capital Medical University, Beijing, 100053 China
| | - Yujin Li
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Yanrui Du
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Chao Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, 300384 China
| | - Yuping Wang
- Department of Neurology, Xuanwu Hospital, Capital Medical University, Beijing, 100053 China
| | - Yanchun Zhang
- Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou, 510006 China.,Institute for Sustainable Industries and Liveable Cities, Victoria University, Melbourne, VIC 8001 Australia
| |
Collapse
|
13
|
Combining brain-computer interface and virtual reality for rehabilitation in neurological diseases: A narrative review. Ann Phys Rehabil Med 2020; 64:101404. [PMID: 32561504 DOI: 10.1016/j.rehab.2020.03.015] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2019] [Revised: 02/24/2020] [Accepted: 03/09/2020] [Indexed: 12/13/2022]
Abstract
BACKGROUND The traditional rehabilitation for neurological diseases lacks the active participation of patients, its process is monotonous and tedious, and the effects need to be improved. Therefore, a new type of rehabilitation technology with more active participation combining brain-computer interface (BCI) with virtual reality (VR) has developed rapidly in recent years and has been used in rehabilitation in neurological diseases. OBJECTIVES This narrative review analyzed and characterized the development and application of the new training system (BCI-VR) in rehabilitation of neurological diseases from the perspective of the BCI paradigm, to provide a pathway for future research in this field. METHODS The review involved a search of the Web of Science-Science Citation Index/Social Sciences Citation Index and the China National Knowledge Infrastructure databases; 39 papers were selected. Advantages and challenges of BCI-VR - based neurological rehabilitation were analyzed in detail. RESULTS Most BCI-VR studies included could be classified by 3 major BCI paradigms: motor imagery, P300, and steady-state visual-evoked potential. Integrating VR scenes into BCI systems could effectively promote the recovery process from nervous system injuries as compared with traditional methods. CONCLUSION As compared with rehabilitation based on traditional BCI, rehabilitation based on BCI-VR can provide better feedback information for patients and promote the recovery of brain function. By solving the challenges and continual development, the BCI-VR system can be broadly applied to the clinical treatment of various neurological diseases.
Collapse
|
14
|
Wen D, Yuan J, Zhou Y, Xu J, Song H, Liu Y, Xu Y, Jung TP. The EEG Signal Analysis for Spatial Cognitive Ability Evaluation Based on Multivariate Permutation Conditional Mutual Information-Multi-Spectral Image. IEEE Trans Neural Syst Rehabil Eng 2020; 28:2113-2122. [PMID: 32833638 DOI: 10.1109/tnsre.2020.3018959] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This study aims to find an effective method to evaluate the efficacy of cognitive training of spatial memory under a virtual reality environment, by classifying the EEG signals of subjects in the early and late stages of spatial cognitive training. This study proposes a new EEG signal analysis method based on Multivariate Permutation Conditional Mutual Information-Multi-Spectral Image (MPCMIMSI). This method mainly considers the relationship between the coupled features of EEG signals in different channel pairs and transforms the multivariate permutation conditional mutual information features into multi-spectral images. Then, a convolutional neural networks (CNN) model classifies the resultant image data into different stages of cognitive training to objectively assess the efficacy of the training. Compared to the multi-spectral image transformation method based on Granger causality analysis (GCA) and permutation conditional mutual information (PCMI), the MPCMIMSI led to better classification performance, which can be as high as 95% accuracy. More specifically, the Theta-Beta2-Gamma-band combination has the best accuracy. The proposed MPCMIMSI method outperforms the multi-spectral image transformation methods based on GCA and PCMI in terms of classification performance. The MPCMIMSI feature in the Theta-Beta2-Gamma band is an effective biomarker for assessing the efficacy of spatial memory training. The proposed EEG feature-extraction method based on MPCMIMSI offers a new window to characterize spatial information of the noninvasive EEG recordings and might apply to assessing other brain functions.
Collapse
|
15
|
Ning H, Li R, Ye X, Zhang Y, Liu L. A Review on Serious Games for Dementia Care in Ageing Societies. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE-JTEHM 2020; 8:1400411. [PMID: 32537264 PMCID: PMC7279699 DOI: 10.1109/jtehm.2020.2998055] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Revised: 04/02/2020] [Accepted: 05/23/2020] [Indexed: 11/25/2022]
Abstract
Dementia is a severe disease threatening ageing societies, which not only causes great harm to patients both physically and psychologically but also places a heavy burden on patients’ families. Medications have been used for the treatment of dementia but with little success. However, serious games, as a new form of dementia therapy, stand out from various therapeutic methods and pave the way for dementia treatment. In the field of serious games for dementia care (SGDC) in ageing societies, there exists abundant research related to this topic. While, a detailed review of the development route and a category framework for characteristics of dementia are still needed. Besides, due to the large number of games, it is difficult to select out effective ones. Yet, there is no unified and comprehensive assessment methods for SGDC. So a reliable assessment model is worth studying. In this paper, we review these existing research work on SGDC from two perspectives: (1) the development of SGDC; (2) the different symptoms in different dementia stages. We also propose a comprehensive and professional assessment model of the therapeutic effectiveness of SGDC to compensate for the simplicity of existing assessment methods. Finally, a discussion related to SGDC is presented.
Collapse
Affiliation(s)
- Huansheng Ning
- School of Computer and Communication EngineeringUniversity of Science and Technology BeijingBeijing100083China.,Beijing Engineering Research Center for Cyberspace Data Analysis and ApplicationsBeijing100083China
| | - Rongyang Li
- School of Computer and Communication EngineeringUniversity of Science and Technology BeijingBeijing100083China
| | - Xiaozhen Ye
- School of Computer and Communication EngineeringUniversity of Science and Technology BeijingBeijing100083China
| | - Yudong Zhang
- School of InformaticsUniversity of LeicesterLeicesterLE1 7RHU.K
| | - Lu Liu
- School of InformaticsUniversity of LeicesterLeicesterLE1 7RHU.K
| |
Collapse
|
16
|
Wang S, Yin H, Li G, Jia Y, Leng M, Meng Q, Wang C, Chen L. Detection of Mild Cognitive Impairment Based on Virtual Reality: A Scoping Review. Curr Alzheimer Res 2020; 17:126-140. [PMID: 32183674 DOI: 10.2174/1567205017666200317100421] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2019] [Revised: 12/09/2019] [Accepted: 02/04/2020] [Indexed: 11/22/2022]
Abstract
BACKGROUND To delay the decline in cognition and reduce the incidence of dementia, the precise detection of Mild Cognitive Impairment (MCI) is necessary. The application of Virtual Reality (VR) technology in this detection can overcome the shortage of traditional paper-and-pencil tests. OBJECTIVE This review aimed to summarize the research progress of the detection of MCI using VR. METHODS Eight databases from their inception to November 19, 2019, were systematically searched for studies applying VR in the detection of MCI. A thematic analysis was conducted according to the specific detection purpose and the main corresponding cognitive domains assessed were summarized; characteristics of the VR applications were also summarized. RESULTS Twenty-eight studies were finally included. The detection purposes included discrimination between healthy controls and those with MCI, discrimination between aMCI subtypes, detection of MCI patients at risk of Alzheimer's Disease (AD), and discrimination between MCI and AD. VR tasks assessing spatial memory were applicable for all detection purposes, and the assessment of combinations of memory and executive function seemed more sensitive. Executive function and intentional episodic memory could be assessed to discriminate among healthy controls, individuals with MCI and those with AD. Incidental episodic memory was effective in detecting MCI with hippocampal atrophy. The most common characteristics of the VR applications were the use of semi-immersion, joysticks or gamepad interactions and simple, one-time behavioral assessments. CONCLUSION VR applications are promising in the detection of MCI, but further research is needed for clinical use.
Collapse
Affiliation(s)
- Shuo Wang
- School of Nursing, Jilin University, 965 Xinjiang Street, Changchun, 130000, China
| | - Huiru Yin
- School of Nursing, Jilin University, 965 Xinjiang Street, Changchun, 130000, China
| | - Guichen Li
- School of Nursing, Jilin University, 965 Xinjiang Street, Changchun, 130000, China
| | - Yong Jia
- School of Nursing, Jilin University, 965 Xinjiang Street, Changchun, 130000, China
| | - Minmin Leng
- School of Nursing, Jilin University, 965 Xinjiang Street, Changchun, 130000, China
| | - Qiuyan Meng
- School of Nursing, Jilin University, 965 Xinjiang Street, Changchun, 130000, China
| | - Chunyan Wang
- Senior Officials Inpatient Ward, First Hospital of Jilin University, Changchun, 130000, China
| | - Li Chen
- School of Nursing, Jilin University, 965 Xinjiang Street, Changchun, 130000, China
| |
Collapse
|
17
|
Neurorehabilitation of Spatial Memory Using Virtual Environments: A Systematic Review. J Clin Med 2019; 8:jcm8101516. [PMID: 31547137 PMCID: PMC6833109 DOI: 10.3390/jcm8101516] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2019] [Revised: 09/10/2019] [Accepted: 09/19/2019] [Indexed: 12/27/2022] Open
Abstract
In recent years, virtual reality (VR) technologies have become widely used in clinical settings because they offer impressive opportunities for neurorehabilitation of different cognitive deficits. Specifically, virtual environments (VEs) have ideal characteristics for navigational training aimed at rehabilitating spatial memory. A systematic search, following PRISMA guidelines, was carried out to explore the current scenario in neurorehabilitation of spatial memory using virtual reality. The literature on this topic was queried, 5048 papers were screened, and 16 studies were included, covering patients presenting different neuropsychological diseases. Our findings highlight the potential of the navigational task in virtual environments (VEs) for enhancing navigation and orientation abilities in patients with spatial memory disorders. The results are promising and suggest that VR training can facilitate neurorehabilitation, promoting brain plasticity processes. An overview of how VR-based training has been implemented is crucial for using these tools in clinical settings. Hence, in the current manuscript, we have critically debated the structure and the length of training protocols, as well as a different type of exploration through VR devices with different degrees of immersion. Furthermore, we analyzed and highlighted the crucial role played by the selection of the assessment tools.
Collapse
|
18
|
Maggio MG, Maresca G, De Luca R, Stagnitti MC, Porcari B, Ferrera MC, Galletti F, Casella C, Manuli A, Calabrò RS. The Growing Use of Virtual Reality in Cognitive Rehabilitation: Fact, Fake or Vision? A Scoping Review. J Natl Med Assoc 2019; 111:457-463. [PMID: 30739728 DOI: 10.1016/j.jnma.2019.01.003] [Citation(s) in RCA: 54] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2018] [Revised: 01/07/2019] [Accepted: 01/08/2019] [Indexed: 12/30/2022]
Abstract
OBJECTIVE This review aims to evaluate the role of Virtual Reality (VR) in cognitive rehabilitation of different neurological diseases, and the accessibility to healthcare systems providing this type of treatment. METHOD OF RESEARCH Studies performed between 2003 and 2017 and fulfilling the selected criteria were found on PubMed, Scopus, Cochrane and Web of Sciences databases. The search combined the terms VR rehabilitation with different neurological disease. RESULTS Our findings showed that neurological patients performed significant improvement in many cognitive domains (executive and visual-spatial abilities; speech, attention and memory skills) following the use of VR training. CONCLUSIONS This review supports the idea that rehabilitation through new VR tools could positively affect neurological patients' outcomes, by boosting motivation and participation so to get a better response to treatment. In particular, VR can be used to enhance the effects of conventional therapies, promoting longer training sessions and a reduction in overall hospitalization time.
Collapse
Affiliation(s)
| | | | | | | | - Bruno Porcari
- IRCCS Centro Neurolesi "Bonino-Pulejo", Messina, Italy
| | | | | | | | | | | |
Collapse
|