1
|
Wang D, Wang J, Zhao H, Liang Y, Zhang W, Li M, Liu H, Hu D, Zhang S, Xing E, Su Y, Yu W, Sun J, Yang A. The relationship between the prefrontal cortex and limb motor function in stroke: A study based on resting-state functional near-infrared spectroscopy. Brain Res 2023; 1805:148269. [PMID: 36736871 DOI: 10.1016/j.brainres.2023.148269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 01/13/2023] [Accepted: 01/30/2023] [Indexed: 02/05/2023]
Abstract
BACKGROUND With the ageing of the world population, the incidence of stroke has been increasing annually, becoming a public health problem affecting adult health. Limb motor dysfunction is one of the common complications of stroke and an important factor in disability. Therefore, restoring limb function is an important task in current rehabilitation. Accurate assessment of motor function in stroke patients is the basis for formulating effective rehabilitation strategies. With the development of neuroimaging technology, scholars have begun to study objective evaluation methods for limb motor dysfunction in stroke to determine reliable neural biomarkers to accurately identify brain functional activity and its relationship with limb motor function. The prefrontal cortex (PFC) plays an important role in motor control and in response to motor state changes. Our previous study found that the PFC network characteristics of stroke patients are related to their motor function status and the topological properties of the PFC network under resting state can predict the motor function of stroke patients to some extent. Therefore, this study used functional near-infrared spectroscopy (fNIRS) to evaluate prefrontal neuroplasticity markers and the relationships between such neural markers and limb motor function in stroke patients with limb motor dysfunction, which could be helpful to further clarify the relationship between brain neuroplasticity and cerebral haemodynamics. At the same time, through accurate and objective means of evaluation, it could be helpful for clinicians to formulate and optimize individualized rehabilitation treatment plans and accurately determine the rehabilitation efficacy and prognosis. METHODS This study recruited 17 S patients with limb motor dysfunction and 9 healthy subjects. fNIRS was used to collect 22 channels of cerebral blood oxygen signals in the PFC in the resting state. The differences in prefrontal oxygenated haemoglobin (HbO) and deoxygenated haemoglobin (HbR) concentrations were analysed between stroke patients and healthy subjects, and the lateralization index (LI) of HbO in stroke patients was also calculated. Pearson's correlation analysis was performed between the LI and the scores of the Fugl-Meyer Assessment Scale (FMA) of motor function in stroke patients. RESULTS The results found that the prefrontal HbO concentration was significantly decreased in stroke patients with limb motor dysfunction compared with healthy subjects, and there was a significant, positive correlation between the LI of the PFC and FMA scores in stroke patients. CONCLUSION These study results showed that stroke can cause cerebral haemodynamic changes in the PFC, and the functional imbalance of the left and right PFC in the resting state is correlated with the severity of limb motor dysfunction. Furthermore, we emphasize that the cerebral haemodynamic activity reflected by fNIRS could be used as a reliable neural biomarker for assessing limb motor dysfunction in stroke.
Collapse
Affiliation(s)
- Dan Wang
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Jie Wang
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Hongbo Zhao
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Yahui Liang
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Wenyue Zhang
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Mingxi Li
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Hua Liu
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Di Hu
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Sibin Zhang
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Enlong Xing
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Ying Su
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Wanchen Yu
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China
| | - Jinyan Sun
- School of Medicine, Foshan University, Foshan, China.
| | - Aoran Yang
- Department of Traditional Chinese Medicine, Beijing Rehabilitation Hospital of Capital Medical University, Beijing, China.
| |
Collapse
|
2
|
Ayaz H, Baker WB, Blaney G, Boas DA, Bortfeld H, Brady K, Brake J, Brigadoi S, Buckley EM, Carp SA, Cooper RJ, Cowdrick KR, Culver JP, Dan I, Dehghani H, Devor A, Durduran T, Eggebrecht AT, Emberson LL, Fang Q, Fantini S, Franceschini MA, Fischer JB, Gervain J, Hirsch J, Hong KS, Horstmeyer R, Kainerstorfer JM, Ko TS, Licht DJ, Liebert A, Luke R, Lynch JM, Mesquida J, Mesquita RC, Naseer N, Novi SL, Orihuela-Espina F, O’Sullivan TD, Peterka DS, Pifferi A, Pollonini L, Sassaroli A, Sato JR, Scholkmann F, Spinelli L, Srinivasan VJ, St. Lawrence K, Tachtsidis I, Tong Y, Torricelli A, Urner T, Wabnitz H, Wolf M, Wolf U, Xu S, Yang C, Yodh AG, Yücel MA, Zhou W. Optical imaging and spectroscopy for the study of the human brain: status report. NEUROPHOTONICS 2022; 9:S24001. [PMID: 36052058 PMCID: PMC9424749 DOI: 10.1117/1.nph.9.s2.s24001] [Citation(s) in RCA: 48] [Impact Index Per Article: 24.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.
Collapse
Affiliation(s)
- Hasan Ayaz
- Drexel University, School of Biomedical Engineering, Science, and Health Systems, Philadelphia, Pennsylvania, United States
- Drexel University, College of Arts and Sciences, Department of Psychological and Brain Sciences, Philadelphia, Pennsylvania, United States
| | - Wesley B. Baker
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, United States
| | - Giles Blaney
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - David A. Boas
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Heather Bortfeld
- University of California, Merced, Departments of Psychological Sciences and Cognitive and Information Sciences, Merced, California, United States
| | - Kenneth Brady
- Lurie Children’s Hospital, Northwestern University Feinberg School of Medicine, Department of Anesthesiology, Chicago, Illinois, United States
| | - Joshua Brake
- Harvey Mudd College, Department of Engineering, Claremont, California, United States
| | - Sabrina Brigadoi
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
| | - Erin M. Buckley
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
- Emory University School of Medicine, Department of Pediatrics, Atlanta, Georgia, United States
| | - Stefan A. Carp
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Robert J. Cooper
- University College London, Department of Medical Physics and Bioengineering, DOT-HUB, London, United Kingdom
| | - Kyle R. Cowdrick
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Joseph P. Culver
- Washington University School of Medicine, Department of Radiology, St. Louis, Missouri, United States
| | - Ippeita Dan
- Chuo University, Faculty of Science and Engineering, Tokyo, Japan
| | - Hamid Dehghani
- University of Birmingham, School of Computer Science, Birmingham, United Kingdom
| | - Anna Devor
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Turgut Durduran
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
- Institució Catalana de Recerca I Estudis Avançats (ICREA), Barcelona, Spain
| | - Adam T. Eggebrecht
- Washington University in St. Louis, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States
| | - Lauren L. Emberson
- University of British Columbia, Department of Psychology, Vancouver, British Columbia, Canada
| | - Qianqian Fang
- Northeastern University, Department of Bioengineering, Boston, Massachusetts, United States
| | - Sergio Fantini
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - Maria Angela Franceschini
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Jonas B. Fischer
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Judit Gervain
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
- Université Paris Cité, CNRS, Integrative Neuroscience and Cognition Center, Paris, France
| | - Joy Hirsch
- Yale School of Medicine, Department of Psychiatry, Neuroscience, and Comparative Medicine, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Keum-Shik Hong
- Pusan National University, School of Mechanical Engineering, Busan, Republic of Korea
- Qingdao University, School of Automation, Institute for Future, Qingdao, China
| | - Roarke Horstmeyer
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
- Duke University, Department of Electrical and Computer Engineering, Durham, North Carolina, United States
- Duke University, Department of Physics, Durham, North Carolina, United States
| | - Jana M. Kainerstorfer
- Carnegie Mellon University, Department of Biomedical Engineering, Pittsburgh, Pennsylvania, United States
- Carnegie Mellon University, Neuroscience Institute, Pittsburgh, Pennsylvania, United States
| | - Tiffany S. Ko
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Daniel J. Licht
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
| | - Adam Liebert
- Polish Academy of Sciences, Nalecz Institute of Biocybernetics and Biomedical Engineering, Warsaw, Poland
| | - Robert Luke
- Macquarie University, Department of Linguistics, Sydney, New South Wales, Australia
- Macquarie University Hearing, Australia Hearing Hub, Sydney, New South Wales, Australia
| | - Jennifer M. Lynch
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Jaume Mesquida
- Parc Taulí Hospital Universitari, Critical Care Department, Sabadell, Spain
| | - Rickson C. Mesquita
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology, Campinas, São Paulo, Brazil
| | - Noman Naseer
- Air University, Department of Mechatronics and Biomedical Engineering, Islamabad, Pakistan
| | - Sergio L. Novi
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Western University, Department of Physiology and Pharmacology, London, Ontario, Canada
| | | | - Thomas D. O’Sullivan
- University of Notre Dame, Department of Electrical Engineering, Notre Dame, Indiana, United States
| | - Darcy S. Peterka
- Columbia University, Zuckerman Mind Brain Behaviour Institute, New York, United States
| | | | - Luca Pollonini
- University of Houston, Department of Engineering Technology, Houston, Texas, United States
| | - Angelo Sassaroli
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - João Ricardo Sato
- Federal University of ABC, Center of Mathematics, Computing and Cognition, São Bernardo do Campo, São Paulo, Brazil
| | - Felix Scholkmann
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Lorenzo Spinelli
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Vivek J. Srinivasan
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- NYU Langone Health, Department of Ophthalmology, New York, New York, United States
- NYU Langone Health, Department of Radiology, New York, New York, United States
| | - Keith St. Lawrence
- Lawson Health Research Institute, Imaging Program, London, Ontario, Canada
- Western University, Department of Medical Biophysics, London, Ontario, Canada
| | - Ilias Tachtsidis
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Yunjie Tong
- Purdue University, Weldon School of Biomedical Engineering, West Lafayette, Indiana, United States
| | - Alessandro Torricelli
- Politecnico di Milano, Dipartimento di Fisica, Milan, Italy
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Tara Urner
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Heidrun Wabnitz
- Physikalisch-Technische Bundesanstalt (PTB), Berlin, Germany
| | - Martin Wolf
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Ursula Wolf
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
| | - Shiqi Xu
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
| | - Changhuei Yang
- California Institute of Technology, Department of Electrical Engineering, Pasadena, California, United States
| | - Arjun G. Yodh
- University of Pennsylvania, Department of Physics and Astronomy, Philadelphia, Pennsylvania, United States
| | - Meryem A. Yücel
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Wenjun Zhou
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- China Jiliang University, College of Optical and Electronic Technology, Hangzhou, Zhejiang, China
| |
Collapse
|
3
|
Fu Y, Wang F, Li Y, Gong A, Qian Q, Su L, Zhao L. Real-time recognition of different imagined actions on the same side of a single limb based on the fNIRS correlation coefficient. BIOMED ENG-BIOMED TE 2022; 67:173-183. [PMID: 35420003 DOI: 10.1515/bmt-2021-0422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Accepted: 03/25/2022] [Indexed: 11/15/2022]
Abstract
Functional near-infrared spectroscopy (fNIRS) is a type of functional brain imaging. Brain-computer interfaces (BCIs) based on fNIRS have recently been implemented. Most existing fNIRS-BCI studies have involved off-line analyses, but few studies used online performance testing. Furthermore, existing online fNIRS-BCI experimental paradigms have not yet carried out studies using different imagined movements of the same side of a single limb. In the present study, a real-time fNIRS-BCI system was constructed to identify two imagined movements of the same side of a single limb (right forearm and right hand). Ten healthy subjects were recruited and fNIRS signal was collected and real-time analyzed with two imagined movements (leftward movement involving the right forearm and right-hand clenching). In addition to the mean and slope features of fNIRS signals, the correlation coefficient between fNIRS signals induced by different imagined actions was extracted. A support vector machine (SVM) was used to classify the imagined actions. The average accuracy of real-time classification of the two imagined movements was 72.25 ± 0.004%. The findings suggest that different imagined movements on the same side of a single limb can be recognized real-time based on fNIRS, which may help to further guide the practical application of online fNIRS-BCIs.
Collapse
Affiliation(s)
- Yunfa Fu
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China.,Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Fan Wang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China.,Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Yu Li
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China.,Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Anmin Gong
- School of Information Engineering, Chinese People's Armed Police Force Engineering University, Xian, China
| | - Qian Qian
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China.,Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Lei Su
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China.,Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Lei Zhao
- Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China.,Faculty of Science, Kunming University of Science and Technology, Kunming, China
| |
Collapse
|
4
|
Nogueira RC, Aries M, Minhas JS, H Petersen N, Xiong L, Kainerstorfer JM, Castro P. Review of studies on dynamic cerebral autoregulation in the acute phase of stroke and the relationship with clinical outcome. J Cereb Blood Flow Metab 2022; 42:430-453. [PMID: 34515547 PMCID: PMC8985432 DOI: 10.1177/0271678x211045222] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
Acute stroke is associated with high morbidity and mortality. In the last decades, new therapies have been investigated with the aim of improving clinical outcomes in the acute phase post stroke onset. However, despite such advances, a large number of patients do not demonstrate improvement, furthermore, some unfortunately deteriorate. Thus, there is a need for additional treatments targeted to the individual patient. A potential therapeutic target is interventions to optimize cerebral perfusion guided by cerebral hemodynamic parameters such as dynamic cerebral autoregulation (dCA). This narrative led to the development of the INFOMATAS (Identifying New targets FOr Management And Therapy in Acute Stroke) project, designed to foster interventions directed towards understanding and improving hemodynamic aspects of the cerebral circulation in acute cerebrovascular disease states. This comprehensive review aims to summarize relevant studies on assessing dCA in patients suffering acute ischemic stroke, intracerebral haemorrhage, and subarachnoid haemorrhage. The review will provide to the reader the most consistent findings, the inconsistent findings which still need to be explored further and discuss the main limitations of these studies. This will allow for the creation of a research agenda for the use of bedside dCA information for prognostication and targeted perfusion interventions.
Collapse
Affiliation(s)
- Ricardo C Nogueira
- Neurology Department, School of Medicine, Hospital das Clinicas, University of São Paulo, São Paulo, Brazil.,Department of Neurology, Hospital Nove de Julho, São Paulo, Brazil
| | - Marcel Aries
- Department of Intensive Care, University of Maastricht, Maastricht University Medical Center+, School for Mental Health and Neuroscience (MHeNS), Maastricht, The Netherlands
| | - Jatinder S Minhas
- Cerebral Haemodynamics in Ageing and Stroke Medicine (CHiASM) Research Group, Department of Cardiovascular Sciences, NIHR Leicester Biomedical Research Centre, Glenfield Hospital, Leicester, UK
| | - Nils H Petersen
- Department of Neurology, Yale University School of Medicine, New Haven, USA
| | - Li Xiong
- Department of Medicine & Therapeutics, The Chinese University of Hong Kong, Hong Kong, China
| | - Jana M Kainerstorfer
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, USA.,Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA
| | - Pedro Castro
- Department of Neurology, Faculty of Medicine of University of Porto, Centro Hospitalar Universitário de São João, Porto, Portugal
| |
Collapse
|
5
|
Optical Modalities for Research, Diagnosis, and Treatment of Stroke and the Consequent Brain Injuries. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12041891] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Stroke is the second most common cause of death and third most common cause of disability worldwide. Therefore, it is an important disease from a medical standpoint. For this reason, various studies have developed diagnostic and therapeutic techniques for stroke. Among them, developments and applications of optical modalities are being extensively studied. In this article, we explored three important optical modalities for research, diagnostic, and therapeutics for stroke and the brain injuries related to it: (1) photochemical thrombosis to investigate stroke animal models; (2) optical imaging techniques for in vivo preclinical studies on stroke; and (3) optical neurostimulation based therapy for stroke. We believe that an exploration and an analysis of previous studies will help us proceed from research to clinical applications of optical modalities for research, diagnosis, and treatment of stroke.
Collapse
|
6
|
Zabcikova M, Koudelkova Z, Jasek R, Navarro JJL. Recent Advances and Current Trends in Brain-Computer Interface (BCI) Research and Their Applications. Int J Dev Neurosci 2021; 82:107-123. [PMID: 34939217 DOI: 10.1002/jdn.10166] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Revised: 11/16/2021] [Accepted: 12/18/2021] [Indexed: 11/06/2022] Open
Abstract
Brain-Computer Interface (BCI) provides direct communication between the brain and an external device. BCI systems have become a trendy field of research in recent years. These systems can be used in a variety of applications to help both disabled and healthy people. Concerning significant BCI progress, we may assume that these systems are not very far from real-world applications. This review has taken into account current trends in BCI research. In this survey, one hundred most cited articles from the WOS database were selected over the last four years. This survey is divided into several sectors. These sectors are Medicine, Communication and Control, Entertainment, and Other BCI applications. The application area, recording method, signal acquisition types, and countries of origin have been identified in each article. This survey provides an overview of the BCI articles published from 2016 to 2020 and their current trends and advances in different application areas.
Collapse
Affiliation(s)
- Martina Zabcikova
- Department of Informatics and Artificial Intelligence, Faculty of Applied Informatics, Tomas Bata University in Zlin, Zlin, Czech Republic
| | - Zuzana Koudelkova
- Department of Informatics and Artificial Intelligence, Faculty of Applied Informatics, Tomas Bata University in Zlin, Zlin, Czech Republic
| | - Roman Jasek
- Department of Informatics and Artificial Intelligence, Faculty of Applied Informatics, Tomas Bata University in Zlin, Zlin, Czech Republic
| | - José Javier Lorenzo Navarro
- Departamento de Informática y Sistemas, Instituto Universitario de Sistemas Inteligentes y Aplicaciones Numéricas en Ingeniería, Universidad de Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain
| |
Collapse
|
7
|
Nogueira RC, Beishon L, Bor-Seng-Shu E, Panerai RB, Robinson TG. Cerebral Autoregulation in Ischemic Stroke: From Pathophysiology to Clinical Concepts. Brain Sci 2021; 11:511. [PMID: 33923721 PMCID: PMC8073938 DOI: 10.3390/brainsci11040511] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Revised: 04/02/2021] [Accepted: 04/09/2021] [Indexed: 11/17/2022] Open
Abstract
Ischemic stroke (IS) is one of the most impacting diseases in the world. In the last decades, new therapies have been introduced to improve outcomes after IS, most of them aiming for recanalization of the occluded vessel. However, despite this advance, there are still a large number of patients that remain disabled. One interesting possible therapeutic approach would be interventions guided by cerebral hemodynamic parameters such as dynamic cerebral autoregulation (dCA). Supportive hemodynamic therapies aiming to optimize perfusion in the ischemic area could protect the brain and may even extend the therapeutic window for reperfusion therapies. However, the knowledge of how to implement these therapies in the complex pathophysiology of brain ischemia is challenging and still not fully understood. This comprehensive review will focus on the state of the art in this promising area with emphasis on the following aspects: (1) pathophysiology of CA in the ischemic process; (2) methodology used to evaluate CA in IS; (3) CA studies in IS patients; (4) potential non-reperfusion therapies for IS patients based on the CA concept; and (5) the impact of common IS-associated comorbidities and phenotype on CA status. The review also points to the gaps existing in the current research to be further explored in future trials.
Collapse
Affiliation(s)
- Ricardo C. Nogueira
- Neurology Department, School of Medicine, Hospital das Clinicas, University of São Paulo, São Paulo 01246-904, Brazil;
- Department of Neurology, Hospital Nove de Julho, São Paulo 01409-002, Brazil
| | - Lucy Beishon
- Cerebral Haemodynamics in Ageing and Stroke Medicine Research Group, Department of Cardiovascular Sciences, University of Leicester, Leicester LE2 7LX, UK; (L.B.); (R.B.P.); (T.G.R.)
| | - Edson Bor-Seng-Shu
- Neurology Department, School of Medicine, Hospital das Clinicas, University of São Paulo, São Paulo 01246-904, Brazil;
| | - Ronney B. Panerai
- Cerebral Haemodynamics in Ageing and Stroke Medicine Research Group, Department of Cardiovascular Sciences, University of Leicester, Leicester LE2 7LX, UK; (L.B.); (R.B.P.); (T.G.R.)
- National Institute for Health Research (NIHR) Leicester Biomedical Research Centre, University of Leicester, Leicester LE5 4PW, UK
| | - Thompson G. Robinson
- Cerebral Haemodynamics in Ageing and Stroke Medicine Research Group, Department of Cardiovascular Sciences, University of Leicester, Leicester LE2 7LX, UK; (L.B.); (R.B.P.); (T.G.R.)
- National Institute for Health Research (NIHR) Leicester Biomedical Research Centre, University of Leicester, Leicester LE5 4PW, UK
| |
Collapse
|
8
|
Yang D, Shin YI, Hong KS. Systemic Review on Transcranial Electrical Stimulation Parameters and EEG/fNIRS Features for Brain Diseases. Front Neurosci 2021; 15:629323. [PMID: 33841079 PMCID: PMC8032955 DOI: 10.3389/fnins.2021.629323] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Accepted: 02/25/2021] [Indexed: 01/09/2023] Open
Abstract
Background Brain disorders are gradually becoming the leading cause of death worldwide. However, the lack of knowledge of brain disease’s underlying mechanisms and ineffective neuropharmacological therapy have led to further exploration of optimal treatments and brain monitoring techniques. Objective This study aims to review the current state of brain disorders, which utilize transcranial electrical stimulation (tES) and daily usable noninvasive neuroimaging techniques. Furthermore, the second goal of this study is to highlight available gaps and provide a comprehensive guideline for further investigation. Method A systematic search was conducted of the PubMed and Web of Science databases from January 2000 to October 2020 using relevant keywords. Electroencephalography (EEG) and functional near-infrared spectroscopy were selected as noninvasive neuroimaging modalities. Nine brain disorders were investigated in this study, including Alzheimer’s disease, depression, autism spectrum disorder, attention-deficit hyperactivity disorder, epilepsy, Parkinson’s disease, stroke, schizophrenia, and traumatic brain injury. Results Sixty-seven studies (1,385 participants) were included for quantitative analysis. Most of the articles (82.6%) employed transcranial direct current stimulation as an intervention method with modulation parameters of 1 mA intensity (47.2%) for 16–20 min (69.0%) duration of stimulation in a single session (36.8%). The frontal cortex (46.4%) and the cerebral cortex (47.8%) were used as a neuroimaging modality, with the power spectrum (45.7%) commonly extracted as a quantitative EEG feature. Conclusion An appropriate stimulation protocol applying tES as a therapy could be an effective treatment for cognitive and neurological brain disorders. However, the optimal tES criteria have not been defined; they vary across persons and disease types. Therefore, future work needs to investigate a closed-loop tES with monitoring by neuroimaging techniques to achieve personalized therapy for brain disorders.
Collapse
Affiliation(s)
- Dalin Yang
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Yong-Il Shin
- Department of Rehabilitation Medicine, Pusan National University School of Medicine, Pusan National University Yangsan Hospital, Yangsan-si, South Korea
| | - Keum-Shik Hong
- Department of Rehabilitation Medicine, Pusan National University School of Medicine, Pusan National University Yangsan Hospital, Yangsan-si, South Korea
| |
Collapse
|
9
|
Yang D, Hong KS. Quantitative Assessment of Resting-State for Mild Cognitive Impairment Detection: A Functional Near-Infrared Spectroscopy and Deep Learning Approach. J Alzheimers Dis 2021; 80:647-663. [PMID: 33579839 DOI: 10.3233/jad-201163] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
BACKGROUND Mild cognitive impairment (MCI) is considered a prodromal stage of Alzheimer's disease. Early diagnosis of MCI can allow for treatment to improve cognitive function and reduce modifiable risk factors. OBJECTIVE This study aims to investigate the feasibility of individual MCI detection from healthy control (HC) using a minimum duration of resting-state functional near-infrared spectroscopy (fNIRS) signals. METHODS In this study, nine different measurement durations (i.e., 30, 60, 90, 120, 150, 180, 210, 240, and 270 s) were evaluated for MCI detection via the graph theory analysis and traditional machine learning approach, such as linear discriminant analysis, support vector machine, and K-nearest neighbor algorithms. Moreover, feature representation- and classification-based transfer learning (TL) methods were applied to identify MCI from HC through the input of connectivity maps with 30 and 90 s duration. RESULTS There was no significant difference among the nine various time windows in the machine learning and graph theory analysis. The feature representation-based TL showed improved accuracy in both 30 and 90 s cases (i.e., 30 s: 81.27% and 90 s: 76.73%). Notably, the classification-based TL method achieved the highest accuracy of 95.81% using the pre-trained convolutional neural network (CNN) model with the 30 s interval functional connectivity map input. CONCLUSION The results indicate that a 30 s measurement of the resting-state with fNIRS could be used to detect MCI. Moreover, the combination of neuroimaging (e.g., functional connectivity maps) and deep learning methods (e.g., CNN and TL) can be considered as novel biomarkers for clinical computer-assisted MCI diagnosis.
Collapse
Affiliation(s)
- Dalin Yang
- School of Mechanical Engineering, Pusan National University, Guemjeong-gu, Busan, Republic of Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Guemjeong-gu, Busan, Republic of Korea.,Department of Cogno-Mechatronics Engineering, Pusan National University, Guemjeong-gu, Busan, Republic of Korea
| |
Collapse
|
10
|
Kelley MS, Noah JA, Zhang X, Scassellati B, Hirsch J. Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot. Front Robot AI 2021; 7:599581. [PMID: 33585574 PMCID: PMC7879449 DOI: 10.3389/frobt.2020.599581] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Accepted: 12/07/2020] [Indexed: 01/17/2023] Open
Abstract
Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with eyes that blink and move right and left. Eye-contact was confirmed by eye-tracking for both conditions. Increased neural activity was observed in human social systems including the right temporal parietal junction and the dorsolateral prefrontal cortex during human-human eye contact but not human-robot eye-contact. This suggests that the type of human-robot eye-contact used here is not sufficient to engage the right temporoparietal junction in the human. This study establishes a foundation for future research into human-robot eye-contact to determine how elements of robot design and behavior impact human social processing within this type of interaction and may offer a method for capturing difficult to quantify components of human-robot interaction, such as social engagement.
Collapse
Affiliation(s)
- Megan S. Kelley
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Brian Scassellati
- Social Robotics Laboratory, Department of Computer Science, Yale University, New Haven, CT, United States
| | - Joy Hirsch
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
- Departments of Neuroscience and Comparative Medicine, Yale School of Medicine, New Haven, CT, United States
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| |
Collapse
|
11
|
Qing K, Huang R, Hong KS. Decoding Three Different Preference Levels of Consumers Using Convolutional Neural Network: A Functional Near-Infrared Spectroscopy Study. Front Hum Neurosci 2021; 14:597864. [PMID: 33488372 PMCID: PMC7815930 DOI: 10.3389/fnhum.2020.597864] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Accepted: 12/02/2020] [Indexed: 11/17/2022] Open
Abstract
This study decodes consumers' preference levels using a convolutional neural network (CNN) in neuromarketing. The classification accuracy in neuromarketing is a critical factor in evaluating the intentions of the consumers. Functional near-infrared spectroscopy (fNIRS) is utilized as a neuroimaging modality to measure the cerebral hemodynamic responses. In this study, a specific decoding structure, called CNN-based fNIRS-data analysis, was designed to achieve a high classification accuracy. Compared to other methods, the automated characteristics, constant training of the dataset, and learning efficiency of the proposed method are the main advantages. The experimental procedure required eight healthy participants (four female and four male) to view commercial advertisement videos of different durations (15, 30, and 60 s). The cerebral hemodynamic responses of the participants were measured. To compare the preference classification performances, CNN was utilized to extract the most common features, including the mean, peak, variance, kurtosis, and skewness. Considering three video durations, the average classification accuracies of 15, 30, and 60 s videos were 84.3, 87.9, and 86.4%, respectively. Among them, the classification accuracy of 87.9% for 30 s videos was the highest. The average classification accuracies of three preferences in females and males were 86.2 and 86.3%, respectively, showing no difference in each group. By comparing the classification performances in three different combinations (like vs. so-so, like vs. dislike, and so-so vs. dislike) between two groups, male participants were observed to have targeted preferences for commercial advertising, and the classification performance 88.4% between "like" vs. "dislike" out of three categories was the highest. Finally, pairwise classification performance are shown as follows: For female, 86.1% (like vs. so-so), 87.4% (like vs. dislike), 85.2% (so-so vs. dislike), and for male 85.7, 88.4, 85.1%, respectively.
Collapse
Affiliation(s)
- Kunqiang Qing
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Ruisen Huang
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
- Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
12
|
Yang D, Huang R, Yoo SH, Shin MJ, Yoon JA, Shin YI, Hong KS. Detection of Mild Cognitive Impairment Using Convolutional Neural Network: Temporal-Feature Maps of Functional Near-Infrared Spectroscopy. Front Aging Neurosci 2020; 12:141. [PMID: 32508627 PMCID: PMC7253632 DOI: 10.3389/fnagi.2020.00141] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2020] [Accepted: 04/27/2020] [Indexed: 12/16/2022] Open
Abstract
Mild cognitive impairment (MCI) is the clinical precursor of Alzheimer's disease (AD), which is considered the most common neurodegenerative disease in the elderly. Some MCI patients tend to remain stable over time and do not evolve to AD. It is essential to diagnose MCI in its early stages and provide timely treatment to the patient. In this study, we propose a neuroimaging approach to identify MCI using a deep learning method and functional near-infrared spectroscopy (fNIRS). For this purpose, fifteen MCI subjects and nine healthy controls (HCs) were asked to perform three mental tasks: N-back, Stroop, and verbal fluency (VF) tasks. Besides examining the oxygenated hemoglobin changes (ΔHbO) in the region of interest, ΔHbO maps at 13 specific time points (i.e., 5, 10, 15, 20, 25, 30, 35, 40, 45, 50, 55, 60, and 65 s) during the tasks and seven temporal feature maps (i.e., two types of mean, three types of slope, kurtosis, and skewness) in the prefrontal cortex were investigated. A four-layer convolutional neural network (CNN) was applied to identify the subjects into either MCI or HC, individually, after training the CNN model with ΔHbO maps and temporal feature maps above. Finally, we used the 5-fold cross-validation approach to evaluate the performance of the CNN. The results of temporal feature maps exhibited high classification accuracies: The average accuracies for the N-back task, Stroop task, and VFT, respectively, were 89.46, 87.80, and 90.37%. Notably, the highest accuracy of 98.61% was achieved from the ΔHbO slope map during 20-60 s interval of N-back tasks. Our results indicate that the fNIRS imaging approach based on temporal feature maps is a promising diagnostic method for early detection of MCI and can be used as a tool for clinical doctors to identify MCI from their patients.
Collapse
Affiliation(s)
- Dalin Yang
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Ruisen Huang
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - So-Hyeon Yoo
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Myung-Jun Shin
- Department of Rehabilitation Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, South Korea
| | - Jin A Yoon
- Department of Rehabilitation Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, South Korea
| | - Yong-Il Shin
- Department of Rehabilitation Medicine, Pusan National University School of Medicine, Pusan National University Yangsan Hospital, Yangsan-si, South Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
13
|
Zafar A, Hong KS. Reduction of Onset Delay in Functional Near-Infrared Spectroscopy: Prediction of HbO/HbR Signals. Front Neurorobot 2020; 14:10. [PMID: 32132918 PMCID: PMC7040361 DOI: 10.3389/fnbot.2020.00010] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2019] [Accepted: 01/30/2020] [Indexed: 12/14/2022] Open
Abstract
An intrinsic problem when using hemodynamic responses for the brain-machine interface is the slow nature of the physiological process. In this paper, a novel method that estimates the oxyhemoglobin changes caused by neuronal activations is proposed and validated. In monitoring the time responses of blood-oxygen-level-dependent signals with functional near-infrared spectroscopy (fNIRS), the early trajectories of both oxy- and deoxy-hemoglobins in their phase space are scrutinized. Furthermore, to reduce the detection time, a prediction method based upon a kernel-based recursive least squares (KRLS) algorithm is implemented. In validating the proposed approach, the fNIRS signals of finger tapping tasks measured from the left motor cortex are examined. The results show that the KRLS algorithm using the Gaussian kernel yields the best fitting for both ΔHbO (i.e., 87.5%) and ΔHbR (i.e., 85.2%) at q = 15 steps ahead (i.e., 1.63 s ahead at a sampling frequency of 9.19 Hz). This concludes that a neuronal activation can be concluded in about 0.1 s with fNIRS using prediction, which enables an almost real-time practice if combined with EEG.
Collapse
Affiliation(s)
- Amad Zafar
- School of Mechanical Engineering, Pusan National University, Busan, South Korea.,Department of Electrical Engineering, University of Wah, Wah Cantonment, Pakistan
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea.,Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
14
|
Dravida S, Ono Y, Noah JA, Zhang X, Hirsch J. Co-localization of theta-band activity and hemodynamic responses during face perception: simultaneous electroencephalography and functional near-infrared spectroscopy recordings. NEUROPHOTONICS 2019; 6:045002. [PMID: 31646152 PMCID: PMC6803809 DOI: 10.1117/1.nph.6.4.045002] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Accepted: 09/12/2019] [Indexed: 05/27/2023]
Abstract
Face-specific neural processes in the human brain have been localized to multiple anatomical structures and associated with diverse and dynamic social functions. The question of how various face-related systems and functions may be bound together remains an active area of investigation. We hypothesize that face processing may be associated with specific frequency band oscillations that serve to integrate distributed face processing systems. Using a multimodal imaging approach, including electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), simultaneous signals were acquired during face and object picture viewing. As expected for face processing, hemodynamic activity in the right occipital face area (OFA) increased during face viewing compared to object viewing, and in a subset of participants, the expected N170 EEG response was observed for faces. Based on recently reported associations between the theta band and visual processing, we hypothesized that increased hemodynamic activity in a face processing area would also be associated with greater theta-band activity originating in the same area. Consistent with our hypothesis, theta-band oscillations were also localized to the right OFA for faces, whereas alpha- and beta-band oscillations were not. Together, these findings suggest that theta-band oscillations originating in the OFA may be part of the distributed face-specific processing mechanism.
Collapse
Affiliation(s)
- Swethasri Dravida
- Yale School of Medicine, Interdepartmental Neuroscience Program, New Haven, Connecticut, United States
| | - Yumie Ono
- Yale School of Medicine, Department of Psychiatry, New Haven, Connecticut, United States
| | - J. Adam Noah
- Yale School of Medicine, Department of Psychiatry, New Haven, Connecticut, United States
| | - Xian Zhang
- Yale School of Medicine, Department of Psychiatry, New Haven, Connecticut, United States
| | - Joy Hirsch
- Yale School of Medicine, Department of Psychiatry, New Haven, Connecticut, United States
- Yale School of Medicine, Department of Neuroscience, New Haven, Connecticut, United States
- Yale School of Medicine, Department of Comparative Medicine, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| |
Collapse
|
15
|
Ghafoor U, Lee JH, Hong KS, Park SS, Kim J, Yoo HR. Effects of Acupuncture Therapy on MCI Patients Using Functional Near-Infrared Spectroscopy. Front Aging Neurosci 2019; 11:237. [PMID: 31543811 PMCID: PMC6730485 DOI: 10.3389/fnagi.2019.00237] [Citation(s) in RCA: 52] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2019] [Accepted: 08/16/2019] [Indexed: 01/25/2023] Open
Abstract
Acupuncture therapy (AT) is a non-pharmacological method of treatment that has been applied to various neurological diseases. However, studies on its longitudinal effect on the neural mechanisms of patients with mild cognitive impairment (MCI) for treatment purposes are still lacking in the literature. In this clinical study, we assess the longitudinal effects of ATs on MCI patients using two methods: (i) Montreal Cognitive Assessment test (MoCA-K, Korean version), and (ii) the hemodynamic response (HR) analyses using functional near-infrared spectroscopy (fNIRS). fNIRS signals of a working memory (WM) task were acquired from the prefrontal cortex. Twelve elderly MCI patients and 12 healthy people were recruited as target and healthy control (HC) groups, respectively. Each group went through an fNIRS scanning procedure three times: The initial data were obtained without any ATs, and subsequently a total of 24 AT sessions were conducted for MCI patients (i.e., MCI-0: the data prior to ATs, MCI-1: after 12 sessions of ATs for 6 weeks, MCI-2: another 12 sessions of ATs for 6 weeks). The mean HR responses of all MCI-0–2 cases were lower than those of HCs. To compare the effects of AT on MCI patients, MoCA-K results, temporal HR data, and spatial activation patterns (i.e., t-maps) were examined. In addition, analyses of functional connectivity (FC) and graph theory upon WM tasks were conducted. With ATs, (i) the averaged MoCA-K test scores were improved (MCI-1, p = 0.002; MCI-2, p = 2.9e–4); (ii) the mean HR response of WM tasks was increased (p < 0.001); and (iii) the t-maps of MCI-1 and MCI-2 were enhanced. Furthermore, an increased FC in the prefrontal cortex in both MCI-1/MCI-2 cases in comparison to MCI-0 was obtained (p < 0.01), and an increasing trend in the graph theory parameters was observed. All these findings reveal that ATs have a positive impact on improving the cognitive function of MCI patients. In conclusion, ATs can be used as a therapeutic tool for MCI patients as a non-pharmacological method (Clinical trial registration number: KCT 0002451 https://cris.nih.go.kr/cris/en/).
Collapse
Affiliation(s)
- Usman Ghafoor
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Jun-Hwan Lee
- Clinical Medicine Division, Korea Institute of Oriental Medicine, Daejeon, South Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Sang-Soo Park
- Korean Medicine Clinical Trial Center, Korean Medicine Hospital, Daejeon University, Daejeon, South Korea
| | - Jieun Kim
- Clinical Medicine Division, Korea Institute of Oriental Medicine, Daejeon, South Korea
| | - Ho-Ryong Yoo
- Department of Neurology Disorders, Dunsan Hospital, Daejeon University, Daejeon, South Korea
| |
Collapse
|
16
|
Niu R, Yu Y, Li Y, Liu Y. Use of fNIRS to Characterize the Neural Mechanism of Inter-Individual Rhythmic Movement Coordination. Front Physiol 2019; 10:781. [PMID: 31333478 PMCID: PMC6621928 DOI: 10.3389/fphys.2019.00781] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Accepted: 06/04/2019] [Indexed: 11/25/2022] Open
Abstract
Background: Inter-individual rhythmic movement coordination plays an important role in daily life, particularly in competitive sports. Behaviorally, it is more challenging to coordinate alternating movements than symmetrical movements. The neural activity underlying these different movement coordination modes remains to be clarified, particularly considering complex inter-individual coordination differences. Methods: To further test the neural basis of inter-individual rhythmic movement coordination, a revised experimental paradigm of inter-individual coordination was adopted. Participants were asked to perform symmetric, alternate, or single movements (swinging the lower part of the leg) in the same rhythm. A multi-channel, continuous wave, functional near-infrared spectral (fNIRS) imaging instrument was used to monitor hemodynamic activity while 40 volunteers (9 male pairs and 11 female pairs) performed the task. Multivariate analyses of variance were conducted to compare mean oxy-hemoglobin concentration ([HbO]) across experimental conditions. Results: A significant three-way interaction (leg-swing condition × ROI × laterality) on mean [HbO] was observed. Post hoc analysis revealed a significant main effect of leg-swing condition only in brain regions of interest [right inferior parietal lobule (IPL)] contralateral to movement execution. Activation in brain regions of interest [right inferior parietal lobule (IPL)] was much stronger in alternate mode compared with symmetric or single modes, and the differences between symmetric and single mode were not statistically significant. This result suggests that the alternate mode of movement coordination was more likely to be supported by the IPL region than the other modes. Conclusion: The present findings provide neural evidence relevant to the theory of self-organization of movement coordination, in which an alternating movement mode appeared to be a more demanding condition than symmetrical movement.
Collapse
Affiliation(s)
- Ruoyu Niu
- School of Kinesiology, Shanghai University of Sport, Shanghai, China
| | - Yanglan Yu
- School of Kinesiology, Shanghai University of Sport, Shanghai, China
| | - Yanan Li
- School of Kinesiology, Shanghai University of Sport, Shanghai, China
| | - Ying Liu
- School of Kinesiology, Shanghai University of Sport, Shanghai, China.,Key Lab of Cognitive Evaluation and Regulation in Sport, General Administration of Sport of China, Shanghai, China
| |
Collapse
|
17
|
Bandeira JS, Antunes LDC, Soldatelli MD, Sato JR, Fregni F, Caumo W. Functional Spectroscopy Mapping of Pain Processing Cortical Areas During Non-painful Peripheral Electrical Stimulation of the Accessory Spinal Nerve. Front Hum Neurosci 2019; 13:200. [PMID: 31263406 PMCID: PMC6585570 DOI: 10.3389/fnhum.2019.00200] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2018] [Accepted: 05/28/2019] [Indexed: 01/30/2023] Open
Abstract
Peripheral electrical stimulation (PES), which encompasses several techniques with heterogeneous physiological responses, has shown in some cases remarkable outcomes for pain treatment and clinical rehabilitation. However, results are still mixed, mainly because there is a lack of understanding regarding its neural mechanisms of action. In this study, we aimed to assess its effects by measuring cortical activation as indexed by functional near infrared spectroscopy (fNIRS). fNIRS is a functional optical imaging method to evaluate hemodynamic changes in oxygenated (HbO) and de-oxygenated (HbR) blood hemoglobin concentrations in cortical capillary networks that can be related to cortical activity. We hypothesized that non-painful PES of accessory spinal nerve (ASN) can promote cortical activation of sensorimotor cortex (SMC) and dorsolateral prefrontal cortex (DLPFC) pain processing cortical areas. Fifteen healthy volunteers received both active and sham ASN electrical stimulation in a crossover study. The hemodynamic cortical response to unilateral right ASN burst electrical stimulation with 10 Hz was measured by a 40-channel fNIRS system. The effect of ASN electrical stimulation over HbO concentration in cortical areas of interest (CAI) was observed through the activation of right-DLPFC (p = 0.025) and left-SMC (p = 0.042) in the active group but not in sham group. Regarding left-DLPFC (p = 0.610) and right-SMC (p = 0.174) there was no statistical difference between groups. As in non-invasive brain stimulation (NIBS) top-down modulation, bottom-up electrical stimulation to the ASN seems to activate the same critical cortical areas on pain pathways related to sensory-discriminative and affective-motivational pain dimensions. These results provide additional mechanistic evidence to develop and optimize the use of peripheral nerve electrical stimulation as a neuromodulatory tool (NCT 03295370— www.clinicaltrials.gov).
Collapse
Affiliation(s)
- Janete Shatkoski Bandeira
- Laboratory of Pain and Neuromodulation, Universidade Federal do Rio Grande do Sul (UFRGS), Porto Alegre, Brazil
| | - Luciana da Conceição Antunes
- Department of Nutrition, Health Science Center, Universidade Federal de Santa Catarina (UFSC), Florianópolis, Brazil
| | | | - João Ricardo Sato
- Department of Mathematics and Statistics, Universidade Federal do ABC, Santo André, Brazil
| | - Felipe Fregni
- Physical Medicine & Rehabilitation, Berenson-Allen Center for Noninvasive Brain Stimulation, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, United States
| | - Wolnei Caumo
- Laboratory of Pain and Neuromodulation, Department of Pain and Anesthesia in Surgery, Hospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul (UFRGS), Porto Alegre, Brazil
| |
Collapse
|
18
|
Yang M, Yang Z, Yuan T, Feng W, Wang P. A Systemic Review of Functional Near-Infrared Spectroscopy for Stroke: Current Application and Future Directions. Front Neurol 2019; 10:58. [PMID: 30804877 PMCID: PMC6371039 DOI: 10.3389/fneur.2019.00058] [Citation(s) in RCA: 70] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2018] [Accepted: 01/16/2019] [Indexed: 02/05/2023] Open
Abstract
Background: Survivors of stroke often experience significant disability and impaired quality of life. The recovery of motor or cognitive function requires long periods. Neuroimaging could measure changes in the brain and monitor recovery process in order to offer timely treatment and assess the effects of therapy. A non-invasive neuroimaging technique near-infrared spectroscopy (NIRS) with its ambulatory, portable, low-cost nature without fixation of subjects has attracted extensive attention. Methods: We conducted a comprehensive literature review in order to review the use of NIRS in stroke or post-stroke patients in July 2018. NCBI Pubmed database, EMBASE database, Cochrane Library and ScienceDirect database were searched. Results: Overall, we reviewed 66 papers. NIRS has a wide range of application, including in monitoring upper limb, lower limb recovery, motor learning, cortical function recovery, cerebral hemodynamic changes, cerebral oxygenation, as well as in therapeutic method, clinical researches, and evaluation of the risk for stroke. Conclusions: This study provides a preliminary evidence of the application of NIRS in stroke patients as a monitoring, therapeutic, and research tool. Further studies could give more emphasize on the combination of NIRS with other techniques and its utility in the prevention of stroke.
Collapse
Affiliation(s)
- Muyue Yang
- Department of Rehabilitation Medicine, Ruijin Hospital, Shanghai, China.,School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Zhen Yang
- Core Facility of West China Hospital, Sichuan University, Chengdu, China
| | - Tifei Yuan
- Shanghai Mental Health Centre, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Wuwei Feng
- Department of Neurology, Medical University of South Carolina, Charleston, SC, United States
| | - Pu Wang
- Department of Rehabilitation Medicine, Ruijin Hospital, Shanghai, China
| |
Collapse
|
19
|
Liu X, Kim CS, Hong KS. An fNIRS-based investigation of visual merchandising displays for fashion stores. PLoS One 2018; 13:e0208843. [PMID: 30533055 PMCID: PMC6289445 DOI: 10.1371/journal.pone.0208843] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2018] [Accepted: 11/25/2018] [Indexed: 02/06/2023] Open
Abstract
This paper investigates a brain-based approach for visual merchandising display (VMD) in fashion stores. In marketing, VMD has become a research topic of interest. However, VMD research using brain activation information is rare. We examine the hemodynamic responses (HRs) in the prefrontal cortex (PFC) using functional near-infrared spectroscopy (fNIRS) while positive/negative displays of four stores (menswear, womenswear, underwear, and sportswear) are shown to 20 subjects. As features for classifying the HRs, the mean, variance, peak, skewness, kurtosis, t-value, and slope of the signals for a 20-sec time window for the activated channels are analyzed. Linear discriminant analysis is used for classifying two-class (positive and negative displays) and four-class (four fashion stores) models. PFC brain activation maps based on t-values depicting the data from the 16 channels are provided. In the two-class classification, the underwear store had the highest average classification result of 67.04%, whereas the menswear store had the lowest value of 64.15%. Men's classification accuracy for the underwear stores with positive and negative displays was 71.38%, whereas the highest classification accuracy obtained by women for womenswear stores was 73%. The average accuracy over the 20 subjects for positive displays was 50.68%, while that of negative displays was 51.07%. Therefore, these findings suggest that human brain activation is involved in the evaluation of the fashion store displays. It is concluded that fNIRS can be used as a brain-based tool in the evaluation of fashion stores in a daily life environment.
Collapse
Affiliation(s)
- Xiaolong Liu
- School of Mechanical Engineering, Pusan National University, Geumjeong-gu, Busan, Republic of Korea
- School of Life Science and Technology, University of Electronic Science and Technology of China, West Hi-Tech Zone, Chengdu, Sichuan, P. R. China
| | - Chang-Seok Kim
- Department of Cogno-Mechatronics Engineering, Pusan National University, Geumjeong-gu, Busan, Republic of Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Geumjeong-gu, Busan, Republic of Korea
- Department of Cogno-Mechatronics Engineering, Pusan National University, Geumjeong-gu, Busan, Republic of Korea
- * E-mail:
| |
Collapse
|
20
|
Nguyen HD, Yoo SH, Bhutta MR, Hong KS. Adaptive filtering of physiological noises in fNIRS data. Biomed Eng Online 2018; 17:180. [PMID: 30514303 PMCID: PMC6278088 DOI: 10.1186/s12938-018-0613-2] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2018] [Accepted: 11/27/2018] [Indexed: 11/10/2022] Open
Abstract
The study presents a recursive least-squares estimation method with an exponential forgetting factor for noise removal in functional near-infrared spectroscopy data and extraction of hemodynamic responses (HRs) from the measured data. The HR is modeled as a linear regression form in which the expected HR, the first and second derivatives of the expected HR, a short-separation measurement data, three physiological noises, and the baseline drift are included as components in the regression vector. The proposed method is applied to left-motor-cortex experiments on the right thumb and little finger movements in five healthy male participants. The algorithm is evaluated with respect to its performance improvement in terms of contrast-to-noise ratio in comparison with Kalman filter, low-pass filtering, and independent component method. The experimental results show that the proposed model achieves reductions of 77% and 99% in terms of the number of channels exhibiting higher contrast-to-noise ratios in oxy-hemoglobin and deoxy-hemoglobin, respectively. The approach is robust in obtaining consistent HR data. The proposed method is applied for both offline and online noise removal.
Collapse
Affiliation(s)
- Hoang-Dung Nguyen
- Department of Automation Technology, Can Tho University, Can Tho, 900000, Vietnam
| | - So-Hyeon Yoo
- School of Mechanical Engineering, Pusan National University, Busan, 46241, Republic of Korea
| | - M Raheel Bhutta
- Department of Computer Science and Engineering, Sejong University, Seoul, 05006, Republic of Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, 46241, Republic of Korea. .,Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, 46241, Republic of Korea.
| |
Collapse
|
21
|
Khan MJ, Ghafoor U, Hong KS. Early Detection of Hemodynamic Responses Using EEG: A Hybrid EEG-fNIRS Study. Front Hum Neurosci 2018; 12:479. [PMID: 30555313 PMCID: PMC6281984 DOI: 10.3389/fnhum.2018.00479] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2018] [Accepted: 11/15/2018] [Indexed: 01/06/2023] Open
Abstract
Enhanced classification accuracy and a sufficient number of commands are highly demanding in brain computer interfaces (BCIs). For a successful BCI, early detection of brain commands in time is essential. In this paper, we propose a novel classifier using a modified vector phase diagram and the power of electroencephalography (EEG) signal for early prediction of hemodynamic responses. EEG and functional near-infrared spectroscopy (fNIRS) signals for a motor task (thumb tapping) were obtained concurrently. Upon the resting state threshold circle in the vector phase diagram that uses the maximum values of oxy- and deoxy-hemoglobin (ΔHbO and ΔHbR) during the resting state, we introduce a secondary (inner) threshold circle using the ΔHbO and ΔHbR magnitudes during the time window of 1 s where an EEG activity is noticeable. If the trajectory of ΔHbO and ΔHbR touches the resting state threshold circle after passing through the inner circle, this indicates that ΔHbO was increasing and ΔHbR was decreasing (i.e., the start of a hemodynamic response). It takes about 0.5 s for an fNIRS signal to cross the resting state threshold circle after crossing the EEG-based circle. Thus, an fNIRS-based BCI command can be generated in 1.5 s. We achieved an improved accuracy of 86.0% using the proposed method in comparison with the 63.8% accuracy obtained using linear discriminant analysis in a window of 0~1.5 s. Moreover, the active brain locations (identified using the proposed scheme) were spatially specific when a t-map was made after 10 s of stimulation. These results demonstrate the possibility of enhancing the classification accuracy for a brain-computer interface with a time window of 1.5 s using the proposed method.
Collapse
Affiliation(s)
- M Jawad Khan
- School of Mechanical Engineering, Pusan National University, Busan, South Korea.,School of Mechanical and Manufacturing Engineering, National University of Science and Technology, Islamabad, Pakistan
| | - Usman Ghafoor
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea.,Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
22
|
Machado A, Cai Z, Pellegrino G, Marcotte O, Vincent T, Lina JM, Kobayashi E, Grova C. Optimal positioning of optodes on the scalp for personalized functional near-infrared spectroscopy investigations. J Neurosci Methods 2018; 309:91-108. [PMID: 30107210 DOI: 10.1016/j.jneumeth.2018.08.006] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2017] [Revised: 08/07/2018] [Accepted: 08/08/2018] [Indexed: 12/21/2022]
Abstract
BACKGROUND Application of functional Near InfraRed Spectroscopy (fNIRS) in neurology is still limited as a good optical coupling and optimized optode coverage of specific brain regions remains challenging, notably for prolonged monitoring. METHODS We propose to evaluate a new procedure allowing accurate investigation of specific brain regions. The procedure consists in: (i) A priori maximization of spatial sensitivity of fNIRS measurements targeting specific brain regions, while reducing the number of applied optodes in order to decrease installation time and improve subject comfort. (ii) Utilization of a 3D neuronavigation device and usage of collodion to glue optodes on the scalp, ensuring good optical contact for prolonged investigations. (iii) Local reconstruction of the hemodynamic activity along the cortical surface using inverse modelling. RESULTS Using realistic simulations, we demonstrated that maps derived from optimal montage acquisitions showed, after reconstruction, spatial resolution only slightly lower to that of ultra high density montages while significantly reducing the number of optodes. The optimal montages provided overall good quantitative accuracy especially at the peak of the spatially reconstructed map. We also evaluated real motor responses in two healthy subjects and obtained reproducible motor responses over different sessions. COMPARISON WITH EXISTING METHODS We are among the first to propose a mathematical optimization strategy, allowing high sensitivity measurements. CONCLUSIONS Our results support that using personalized optimal montages should allow to conduct accurate fNIRS studies in clinical settings and realistic lifestyle conditions.
Collapse
Affiliation(s)
- A Machado
- Multimodal Functional Imaging Laboratory, Biomedical Engineering Department, McGill University, Canada.
| | - Z Cai
- Physics Department and PERFORM center, Concordia University, Montreal, Canada
| | - G Pellegrino
- Multimodal Functional Imaging Laboratory, Biomedical Engineering Department, McGill University, Canada; IRCCS Fondazione Ospedale San Camillo Via Alberoni, Venice, Italy
| | - O Marcotte
- GERAD, École des HEC, Montréal, Canada; Département d'informatique, Université du Québec à Montréal, Canada; Centre de Recherches Mathématiques, Université de Montréal, Québec, Canada
| | - T Vincent
- Physics Department and PERFORM center, Concordia University, Montreal, Canada
| | - J-M Lina
- École de technologie supérieure de l'Université du Québec, Canada; Centre de Recherches Mathématiques, Université de Montréal, Québec, Canada
| | - E Kobayashi
- Montreal Neurological Institute, Department of Neurology and Neurosurgery, McGill University, Canada
| | - C Grova
- Multimodal Functional Imaging Laboratory, Biomedical Engineering Department, McGill University, Canada; Physics Department and PERFORM center, Concordia University, Montreal, Canada; Montreal Neurological Institute, Department of Neurology and Neurosurgery, McGill University, Canada; Centre de Recherches Mathématiques, Université de Montréal, Québec, Canada
| |
Collapse
|
23
|
Hong KS, Khan MJ, Hong MJ. Feature Extraction and Classification Methods for Hybrid fNIRS-EEG Brain-Computer Interfaces. Front Hum Neurosci 2018; 12:246. [PMID: 30002623 PMCID: PMC6032997 DOI: 10.3389/fnhum.2018.00246] [Citation(s) in RCA: 105] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2018] [Accepted: 05/29/2018] [Indexed: 11/13/2022] Open
Abstract
In this study, a brain-computer interface (BCI) framework for hybrid functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) for locked-in syndrome (LIS) patients is investigated. Brain tasks, channel selection methods, and feature extraction and classification algorithms available in the literature are reviewed. First, we categorize various types of patients with cognitive and motor impairments to assess the suitability of BCI for each of them. The prefrontal cortex is identified as a suitable brain region for imaging. Second, the brain activity that contributes to the generation of hemodynamic signals is reviewed. Mental arithmetic and word formation tasks are found to be suitable for use with LIS patients. Third, since a specific targeted brain region is needed for BCI, methods for determining the region of interest are reviewed. The combination of a bundled-optode configuration and threshold-integrated vector phase analysis turns out to be a promising solution. Fourth, the usable fNIRS features and EEG features are reviewed. For hybrid BCI, a combination of the signal peak and mean fNIRS signals and the highest band powers of EEG signals is promising. For classification, linear discriminant analysis has been most widely used. However, further research on vector phase analysis as a classifier for multiple commands is desirable. Overall, proper brain region identification and proper selection of features will improve classification accuracy. In conclusion, five future research issues are identified, and a new BCI scheme, including brain therapy for LIS patients and using the framework of hybrid fNIRS-EEG BCI, is provided.
Collapse
Affiliation(s)
- Keum-Shik Hong
- Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, South Korea.,School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - M Jawad Khan
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Melissa J Hong
- Early Learning, FIRST 5 Santa Clara County, San Jose, CA, United States
| |
Collapse
|
24
|
Zafar A, Hong KS. Neuronal Activation Detection Using Vector Phase Analysis with Dual Threshold Circles: A Functional Near-Infrared Spectroscopy Study. Int J Neural Syst 2018; 28:1850031. [PMID: 30045647 DOI: 10.1142/s0129065718500314] [Citation(s) in RCA: 52] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
In this paper, a new vector phase diagram differentiating the initial decreasing phase (i.e. initial dip) and the delayed hemodynamic response (HR) phase of oxy-hemoglobin changes ( Δ HbO) of functional near-infrared spectroscopy (fNIRS) is developed. The vector phase diagram displays the trajectories of Δ HbO and deoxy-hemoglobin changes ( Δ HbR), as orthogonal components, in the Δ HbO- Δ HbR polar coordinates. To determine the occurrence of an initial dip, dual threshold circles (an inner circle from the resting state, an outer circle from the peak values of the initial dip and the main HR) are incorporated into the phase diagram for making decisions. The proposed scheme is then applied to a brain-computer interface scheme, and its performance is evaluated in classifying two finger tapping tasks (right-hand thumb and little finger) from the left motor cortex. Three gamma functions are used to model the initial dip, the main HR, and the undershoot in generating the designed HR function. In classifying two tapping tasks, the signal mean and signal minimum values during 0-2.5 s, as features of initial dip, are used. The linear discriminant analysis was utilized as a classifier. The experimental results show that the active brain locations of the two tasks were quite distinctive ( p < 0.05 ), and moreover, spatially specific if using the initial dip map at 4 s in comparison to the map of HRs at 14 s. Also, the average classification accuracy was improved from 59% to 74.9% when using the phase diagram of dual threshold circles.
Collapse
Affiliation(s)
- Amad Zafar
- 1 School of Mechanical Engineering, Pusan National University, 2 Busandaehak-ro, Geumjeong-gu, Busan 46241, Korea
| | - Keum-Shik Hong
- 1 School of Mechanical Engineering, Pusan National University, 2 Busandaehak-ro, Geumjeong-gu, Busan 46241, Korea
| |
Collapse
|
25
|
Iqbal M, Rehan M, Hong KS. Robust Adaptive Synchronization of Ring Configured Uncertain Chaotic FitzHugh-Nagumo Neurons under Direction-Dependent Coupling. Front Neurorobot 2018. [PMID: 29535622 PMCID: PMC5834533 DOI: 10.3389/fnbot.2018.00006] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
This paper exploits the dynamical modeling, behavior analysis, and synchronization of a network of four different FitzHugh–Nagumo (FHN) neurons with unknown parameters linked in a ring configuration under direction-dependent coupling. The main purpose is to investigate a robust adaptive control law for the synchronization of uncertain and perturbed neurons, communicating in a medium of bidirectional coupling. The neurons are assumed to be different and interconnected in a ring structure. The strength of the gap junctions is taken to be different for each link in the network, owing to the inter-neuronal coupling medium properties. Robust adaptive control mechanism based on Lyapunov stability analysis is employed and theoretical criteria are derived to realize the synchronization of the network of four FHN neurons in a ring form with unknown parameters under direction-dependent coupling and disturbances. The proposed scheme for synchronization of dissimilar neurons, under external electrical stimuli, coupled in a ring communication topology, having all parameters unknown, and subject to directional coupling medium and perturbations, is addressed for the first time as per our knowledge. To demonstrate the efficacy of the proposed strategy, simulation results are provided.
Collapse
Affiliation(s)
- Muhammad Iqbal
- Department of Computer and Information Sciences, Pakistan Institute of Engineering and Applied Sciences (PIEAS), Islamabad, Pakistan
| | - Muhammad Rehan
- Department of Electrical Engineering, Pakistan Institute of Engineering and Applied Sciences (PIEAS), Islamabad, Pakistan
| | - Keum-Shik Hong
- Department of Cogno-Mechatronics Engineering, School of Mechanical Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
26
|
Zafar A, Khan MJ, Park J, Hong KS. Initial-dip Based Quadcopter Control: Application to fNIRS-BCI. ACTA ACUST UNITED AC 2018. [DOI: 10.1016/j.ifacol.2018.09.072] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
|
27
|
Ding H, He Q, Zhou Y, Dan G, Cui S. An Individual Finger Gesture Recognition System Based on Motion-Intent Analysis Using Mechanomyogram Signal. Front Neurol 2017; 8:573. [PMID: 29167655 PMCID: PMC5682314 DOI: 10.3389/fneur.2017.00573] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2017] [Accepted: 10/12/2017] [Indexed: 12/03/2022] Open
Abstract
Motion-intent-based finger gesture recognition systems are crucial for many applications such as prosthesis control, sign language recognition, wearable rehabilitation system, and human–computer interaction. In this article, a motion-intent-based finger gesture recognition system is designed to correctly identify the tapping of every finger for the first time. Two auto-event annotation algorithms are firstly applied and evaluated for detecting the finger tapping frame. Based on the truncated signals, the Wavelet packet transform (WPT) coefficients are calculated and compressed as the features, followed by a feature selection method that is able to improve the performance by optimizing the feature set. Finally, three popular classifiers including naive Bayes (NBC), K-nearest neighbor (KNN), and support vector machine (SVM) are applied and evaluated. The recognition accuracy can be achieved up to 94%. The design and the architecture of the system are presented with full system characterization results.
Collapse
Affiliation(s)
- Huijun Ding
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Guangdong, China
| | - Qing He
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Guangdong, China
| | - Yongjin Zhou
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Guangdong, China
| | - Guo Dan
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Guangdong, China.,Center for Neurorehabilitation, Shenzhen Institute of Neuroscience, Guangdong, China
| | - Song Cui
- Institute of High Performance Computing, Singapore, Singapore
| |
Collapse
|
28
|
Ghafoor U, Kim S, Hong KS. Selectivity and Longevity of Peripheral-Nerve and Machine Interfaces: A Review. Front Neurorobot 2017; 11:59. [PMID: 29163122 PMCID: PMC5671609 DOI: 10.3389/fnbot.2017.00059] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2017] [Accepted: 10/17/2017] [Indexed: 11/22/2022] Open
Abstract
For those individuals with upper-extremity amputation, a daily normal living activity is no longer possible or it requires additional effort and time. With the aim of restoring their sensory and motor functions, theoretical and technological investigations have been carried out in the field of neuroprosthetic systems. For transmission of sensory feedback, several interfacing modalities including indirect (non-invasive), direct-to-peripheral-nerve (invasive), and cortical stimulation have been applied. Peripheral nerve interfaces demonstrate an edge over the cortical interfaces due to the sensitivity in attaining cortical brain signals. The peripheral nerve interfaces are highly dependent on interface designs and are required to be biocompatible with the nerves to achieve prolonged stability and longevity. Another criterion is the selection of nerves that allows minimal invasiveness and damages as well as high selectivity for a large number of nerve fascicles. In this paper, we review the nerve-machine interface modalities noted above with more focus on peripheral nerve interfaces, which are responsible for provision of sensory feedback. The invasive interfaces for recording and stimulation of electro-neurographic signals include intra-fascicular, regenerative-type interfaces that provide multiple contact channels to a group of axons inside the nerve and the extra-neural-cuff-type interfaces that enable interaction with many axons around the periphery of the nerve. Section Current Prosthetic Technology summarizes the advancements made to date in the field of neuroprosthetics toward the achievement of a bidirectional nerve-machine interface with more focus on sensory feedback. In the Discussion section, the authors propose a hybrid interface technique for achieving better selectivity and long-term stability using the available nerve interfacing techniques.
Collapse
Affiliation(s)
- Usman Ghafoor
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Sohee Kim
- Department of Robotics Engineering, Daegu Gyeongbuk Institute of Science and Technology, Daegu, South Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea.,Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
29
|
Hong KS, Khan MJ. Hybrid Brain-Computer Interface Techniques for Improved Classification Accuracy and Increased Number of Commands: A Review. Front Neurorobot 2017; 11:35. [PMID: 28790910 PMCID: PMC5522881 DOI: 10.3389/fnbot.2017.00035] [Citation(s) in RCA: 116] [Impact Index Per Article: 16.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2017] [Accepted: 07/03/2017] [Indexed: 12/11/2022] Open
Abstract
In this article, non-invasive hybrid brain-computer interface (hBCI) technologies for improving classification accuracy and increasing the number of commands are reviewed. Hybridization combining more than two modalities is a new trend in brain imaging and prosthesis control. Electroencephalography (EEG), due to its easy use and fast temporal resolution, is most widely utilized in combination with other brain/non-brain signal acquisition modalities, for instance, functional near infrared spectroscopy (fNIRS), electromyography (EMG), electrooculography (EOG), and eye tracker. Three main purposes of hybridization are to increase the number of control commands, improve classification accuracy and reduce the signal detection time. Currently, such combinations of EEG + fNIRS and EEG + EOG are most commonly employed. Four principal components (i.e., hardware, paradigm, classifiers, and features) relevant to accuracy improvement are discussed. In the case of brain signals, motor imagination/movement tasks are combined with cognitive tasks to increase active brain-computer interface (BCI) accuracy. Active and reactive tasks sometimes are combined: motor imagination with steady-state evoked visual potentials (SSVEP) and motor imagination with P300. In the case of reactive tasks, SSVEP is most widely combined with P300 to increase the number of commands. Passive BCIs, however, are rare. After discussing the hardware and strategies involved in the development of hBCI, the second part examines the approaches used to increase the number of control commands and to enhance classification accuracy. The future prospects and the extension of hBCI in real-time applications for daily life scenarios are provided.
Collapse
Affiliation(s)
- Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea.,Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, South Korea
| | - Muhammad Jawad Khan
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
30
|
Qureshi NK, Naseer N, Noori FM, Nazeer H, Khan RA, Saleem S. Enhancing Classification Performance of Functional Near-Infrared Spectroscopy- Brain-Computer Interface Using Adaptive Estimation of General Linear Model Coefficients. Front Neurorobot 2017; 11:33. [PMID: 28769781 PMCID: PMC5512010 DOI: 10.3389/fnbot.2017.00033] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Accepted: 06/22/2017] [Indexed: 11/20/2022] Open
Abstract
In this paper, a novel methodology for enhanced classification of functional near-infrared spectroscopy (fNIRS) signals utilizable in a two-class [motor imagery (MI) and rest; mental rotation (MR) and rest] brain–computer interface (BCI) is presented. First, fNIRS signals corresponding to MI and MR are acquired from the motor and prefrontal cortex, respectively, afterward, filtered to remove physiological noises. Then, the signals are modeled using the general linear model, the coefficients of which are adaptively estimated using the least squares technique. Subsequently, multiple feature combinations of estimated coefficients were used for classification. The best classification accuracies achieved for five subjects, for MI versus rest are 79.5, 83.7, 82.6, 81.4, and 84.1% whereas those for MR versus rest are 85.5, 85.2, 87.8, 83.7, and 84.8%, respectively, using support vector machine. These results are compared with the best classification accuracies obtained using the conventional hemodynamic response. By means of the proposed methodology, the average classification accuracy obtained was significantly higher (p < 0.05). These results serve to demonstrate the feasibility of developing a high-classification-performance fNIRS-BCI.
Collapse
Affiliation(s)
| | - Noman Naseer
- Department of Mechatronics Engineering, Air University, Islamabad, Pakistan
| | - Farzan Majeed Noori
- Department of Mechatronics Engineering, Air University, Islamabad, Pakistan.,Department of Electrical and Computer Engineering, Institute of Systems and Robotics, University of Coimbra, Coimbra, Portugal
| | - Hammad Nazeer
- Department of Mechatronics Engineering, Air University, Islamabad, Pakistan
| | - Rayyan Azam Khan
- Department of Mechatronics Engineering, Air University, Islamabad, Pakistan
| | - Sajid Saleem
- Faculty of Engineering and Computer Sciences, National University of Modern Languages, Islamabad, Pakistan
| |
Collapse
|
31
|
Classification of somatosensory cortex activities using fNIRS. Behav Brain Res 2017; 333:225-234. [PMID: 28668280 DOI: 10.1016/j.bbr.2017.06.034] [Citation(s) in RCA: 55] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2017] [Revised: 06/10/2017] [Accepted: 06/20/2017] [Indexed: 01/08/2023]
Abstract
The ability of the somatosensory cortex in differentiating various tactile sensations is very important for a person to perceive the surrounding environment. In this study, we utilize a lab-made multi-channel functional near-infrared spectroscopy (fNIRS) to discriminate the hemodynamic responses (HRs) of four different tactile stimulations (handshake, ball grasp, poking, and cold temperature) applied to the right hand of eight healthy male subjects. The activated brain areas per stimulation are identified with the t-values between the measured data and the desired hemodynamic response function. Linear discriminant analysis is utilized to classify the acquired data into four classes based on three features (mean, peak value, and skewness) of the associated oxy-hemoglobin (HbO) signals. The HRs evoked by the handshake and poking stimulations showed higher peak values in HbO than the ball grasp and cold temperature stimulations. For comparison purposes, additional two-class classifications of poking vs. temperature and handshake vs. ball grasp were performed. The attained classification accuracies were higher than the corresponding chance levels. Our results indicate that fNIRS can be used as an objective measure discriminating different tactile stimulations from the somatosensory cortex of human brain.
Collapse
|
32
|
Khan MJ, Hong KS. Hybrid EEG-fNIRS-Based Eight-Command Decoding for BCI: Application to Quadcopter Control. Front Neurorobot 2017; 11:6. [PMID: 28261084 PMCID: PMC5314821 DOI: 10.3389/fnbot.2017.00006] [Citation(s) in RCA: 99] [Impact Index Per Article: 14.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2016] [Accepted: 01/24/2017] [Indexed: 01/27/2023] Open
Abstract
In this paper, a hybrid electroencephalography–functional near-infrared spectroscopy (EEG–fNIRS) scheme to decode eight active brain commands from the frontal brain region for brain–computer interface is presented. A total of eight commands are decoded by fNIRS, as positioned on the prefrontal cortex, and by EEG, around the frontal, parietal, and visual cortices. Mental arithmetic, mental counting, mental rotation, and word formation tasks are decoded with fNIRS, in which the selected features for classification and command generation are the peak, minimum, and mean ΔHbO values within a 2-s moving window. In the case of EEG, two eyeblinks, three eyeblinks, and eye movement in the up/down and left/right directions are used for four-command generation. The features in this case are the number of peaks and the mean of the EEG signal during 1 s window. We tested the generated commands on a quadcopter in an open space. An average accuracy of 75.6% was achieved with fNIRS for four-command decoding and 86% with EEG for another four-command decoding. The testing results show the possibility of controlling a quadcopter online and in real-time using eight commands from the prefrontal and frontal cortices via the proposed hybrid EEG–fNIRS interface.
Collapse
Affiliation(s)
- Muhammad Jawad Khan
- School of Mechanical Engineering, Pusan National University , Busan , South Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea; Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
33
|
Zafar A, Hong KS. Detection and classification of three-class initial dips from prefrontal cortex. BIOMEDICAL OPTICS EXPRESS 2017; 8:367-383. [PMID: 28101424 PMCID: PMC5231305 DOI: 10.1364/boe.8.000367] [Citation(s) in RCA: 63] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2016] [Revised: 11/20/2016] [Accepted: 12/12/2016] [Indexed: 05/03/2023]
Abstract
In this paper, the use of initial dips using functional near-infrared spectroscopy (fNIRS) for brain-computer interface (BCI) is investigated. Features and window sizes for detecting initial dips are also discussed. Three mental tasks including mental arithmetic, mental counting, and puzzle solving are performed in obtaining fNIRS signals from the prefrontal cortex. Vector-based phase analysis method combined with a threshold circle, as a decision criterion, are used to detect the initial dips. Eight healthy subjects participate in experiment. Linear discriminant analysis is used as a classifier. To classify initial dips, five features (signal mean, peak value, signal slope, skewness, and kurtosis) of oxy-hemoglobin (HbO) and four different window sizes (0~1, 0~1.5, 0~2, and 0~2.5 sec) are examined. It is shown that a combination of signal mean and peak value and a time period of 0~2.5 sec provide the best average classification accuracy of 57.5% for three classes. To further validate the result, three-class classification using the conventional hemodynamic response (HR) is also performed, in which two features (signal mean and signal slope) and 2~7 sec window size have yielded the average classification accuracy of 65.9%. This reveals that fNIRS-based BCI using initial dip detection can reduce the command generation time from 7 sec to 2.5 sec while the classification accuracy is a bit sacrificed from 65.9% to 57.5% for three mental tasks. Further improvement can be made by using deoxy hemoglobin signals in coping with the slow HR problem.
Collapse
Affiliation(s)
- Amad Zafar
- School of Mechanical Engineering, Pusan National University, 2 Busandaehak-ro, Geumjeong-gu, Busan 46241, South Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, 2 Busandaehak-ro, Geumjeong-gu, Busan 46241, South Korea
- Department of Cogno-Mechatronics Engineering, Pusan National University, 2 Busandaehak-ro, Geumjeong-gu, Busan 46241, South Korea
| |
Collapse
|