1
|
Chiou N, Günal M, Koyejo S, Perpetuini D, Chiarelli AM, Low KA, Fabiani M, Gratton G. Single-Trial Detection and Classification of Event-Related Optical Signals for a Brain-Computer Interface Application. Bioengineering (Basel) 2024; 11:781. [PMID: 39199739 PMCID: PMC11351476 DOI: 10.3390/bioengineering11080781] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2024] [Revised: 07/23/2024] [Accepted: 07/27/2024] [Indexed: 09/01/2024] Open
Abstract
Event-related optical signals (EROS) measure fast modulations in the brain's optical properties related to neuronal activity. EROS offer a high spatial and temporal resolution and can be used for brain-computer interface (BCI) applications. However, the ability to classify single-trial EROS remains unexplored. This study evaluates the performance of neural network methods for single-trial classification of motor response-related EROS. EROS activity was obtained from a high-density recording montage covering the motor cortex during a two-choice reaction time task involving responses with the left or right hand. This study utilized a convolutional neural network (CNN) approach to extract spatiotemporal features from EROS data and perform classification of left and right motor responses. Subject-specific classifiers trained on EROS phase data outperformed those trained on intensity data, reaching an average single-trial classification accuracy of around 63%. Removing low-frequency noise from intensity data is critical for achieving discriminative classification results with this measure. Our results indicate that deep learning with high-spatial-resolution signals, such as EROS, can be successfully applied to single-trial classifications.
Collapse
Affiliation(s)
- Nicole Chiou
- Department of Computer Science, Stanford University, Stanford, CA 94305, USA;
| | - Mehmet Günal
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana, Champaign, Urbana, IL 61801, USA; (M.G.); (K.A.L.); (M.F.); (G.G.)
| | - Sanmi Koyejo
- Department of Computer Science, Stanford University, Stanford, CA 94305, USA;
| | - David Perpetuini
- Department of Engineering and Geology, “G. D’Annunzio University” of Chieti-Pescara, 65127 Pescara, Italy;
| | - Antonio Maria Chiarelli
- Department of Neuroscience, Imaging and Clinical Sciences, “G. D’Annunzio University” of Chieti-Pescara, 66100 Chieti, Italy;
- Institute for Advanced Biomedical Technologies, “G. D’Annunzio University” of Chieti-Pescara, 66100 Chieti, Italy
| | - Kathy A. Low
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana, Champaign, Urbana, IL 61801, USA; (M.G.); (K.A.L.); (M.F.); (G.G.)
| | - Monica Fabiani
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana, Champaign, Urbana, IL 61801, USA; (M.G.); (K.A.L.); (M.F.); (G.G.)
- Psychology Department, University of Illinois Urbana, Champaign, Champaign, IL 61820, USA
| | - Gabriele Gratton
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana, Champaign, Urbana, IL 61801, USA; (M.G.); (K.A.L.); (M.F.); (G.G.)
- Psychology Department, University of Illinois Urbana, Champaign, Champaign, IL 61820, USA
| |
Collapse
|
2
|
Acuña K, Sapahia R, Jiménez IN, Antonietti M, Anzola I, Cruz M, García MT, Krishnan V, Leveille LA, Resch MD, Galor A, Habash R, DeBuc DC. Functional Near-Infrared Spectrometry as a Useful Diagnostic Tool for Understanding the Visual System: A Review. J Clin Med 2024; 13:282. [PMID: 38202288 PMCID: PMC10779649 DOI: 10.3390/jcm13010282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 12/24/2023] [Accepted: 12/27/2023] [Indexed: 01/12/2024] Open
Abstract
This comprehensive review explores the role of Functional Near-Infrared Spectroscopy (fNIRS) in advancing our understanding of the visual system. Beginning with an introduction to fNIRS, we delve into its historical development, highlighting how this technology has evolved over time. The core of the review critically examines the advantages and disadvantages of fNIRS, offering a balanced view of its capabilities and limitations in research and clinical settings. We extend our discussion to the diverse applications of fNIRS beyond its traditional use, emphasizing its versatility across various fields. In the context of the visual system, this review provides an in-depth analysis of how fNIRS contributes to our understanding of eye function, including eye diseases. We discuss the intricacies of the visual cortex, how it responds to visual stimuli and the implications of these findings in both health and disease. A unique aspect of this review is the exploration of the intersection between fNIRS, virtual reality (VR), augmented reality (AR) and artificial intelligence (AI). We discuss how these cutting-edge technologies are synergizing with fNIRS to open new frontiers in visual system research. The review concludes with a forward-looking perspective, envisioning the future of fNIRS in a rapidly evolving technological landscape and its potential to revolutionize our approach to studying and understanding the visual system.
Collapse
Affiliation(s)
- Kelly Acuña
- School of Medicine, Georgetown University, Washington, DC 20007, USA;
| | - Rishav Sapahia
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Irene Newman Jiménez
- Department of Cognitive Science, Faculty of Arts & Science, McGill University, Montreal, QC H4A 3J1, Canada;
| | - Michael Antonietti
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Ignacio Anzola
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Marvin Cruz
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Michael T. García
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Varun Krishnan
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Lynn A. Leveille
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Miklós D. Resch
- Department of Ophthalmology, Semmelweis University, 1085 Budapest, Hungary;
| | - Anat Galor
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Ranya Habash
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| | - Delia Cabrera DeBuc
- Department of Ophthalmology, Bascom Palmer Eye Institute, University of Miami, Miami, FL 33136, USA; (R.S.); (M.A.); (M.T.G.); (V.K.); (L.A.L.); (A.G.)
| |
Collapse
|