1
|
Guan S, Li Y, Luo Y, Niu H, Gao Y, Yang D, Li R. Disentangling the impact of motion artifact correction algorithms on functional near-infrared spectroscopy-based brain network analysis. NEUROPHOTONICS 2024; 11:045006. [PMID: 39444555 PMCID: PMC11498316 DOI: 10.1117/1.nph.11.4.045006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Revised: 09/20/2024] [Accepted: 09/30/2024] [Indexed: 10/25/2024]
Abstract
Significance Functional near-infrared spectroscopy (fNIRS) has been widely used to assess brain functional networks due to its superior ecological validity. Generally, fNIRS signals are sensitive to motion artifacts (MA), which can be removed by various MA correction algorithms. Yet, fNIRS signals may also undergo varying degrees of distortion due to MA correction, leading to notable alternation in functional connectivity (FC) analysis results. Aim We aimed to investigate the effect of different MA correction algorithms on the performance of brain FC and topology analyses. Approach We evaluated various MA correction algorithms on simulated and experimental datasets, including principal component analysis, spline interpolation, correlation-based signal improvement, Kalman filtering, wavelet filtering, and temporal derivative distribution repair (TDDR). The mean FC of each pre-defined network, receiver operating characteristic (ROC), and graph theory metrics were investigated to assess the performance of different algorithms. Results Although most algorithms did not differ significantly from each other, the TDDR and wavelet filtering turned out to be the most effective methods for FC and topological analysis, as evidenced by their superior denoising ability, the best ROC, and an enhanced ability to recover the original FC pattern. Conclusions The findings of our study elucidate the varying impact of MA correction algorithms on brain FC analysis, which could serve as a reference for choosing the most appropriate method for future FC research. As guidance, we recommend using TDDR or wavelet filtering to minimize the impact of MA correction in brain network analysis.
Collapse
Affiliation(s)
- Shuo Guan
- University of Macau, Institute of Collaborative Innovation, Center for Cognitive and Brain Sciences, Taipa, Macau S.A.R., China
- University of Macau, Department of Psychology, Faculty of Social Science, Taipa, China
| | - Yuhang Li
- University of Macau, Institute of Collaborative Innovation, Center for Cognitive and Brain Sciences, Taipa, Macau S.A.R., China
- University of Macau, Department of Psychology, Faculty of Social Science, Taipa, China
| | - Yuxi Luo
- Sun Yat-Sen University, School of Biomedical Engineering, Shenzhen, China
| | - Haijing Niu
- Beijing Normal University, IDG/McGovern Institute for Brain Research, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing, China
| | - Yuanyuan Gao
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Dalin Yang
- Washington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States
| | - Rihui Li
- University of Macau, Institute of Collaborative Innovation, Center for Cognitive and Brain Sciences, Taipa, Macau S.A.R., China
- University of Macau, Department of Electrical and Computer Engineering, Faculty of Science and Technology, Taipa, China
| |
Collapse
|
2
|
Gerloff C, Yücel MA, Mehlem L, Konrad K, Reindl V. NiReject: toward automated bad channel detection in functional near-infrared spectroscopy. NEUROPHOTONICS 2024; 11:045008. [PMID: 39497725 PMCID: PMC11532795 DOI: 10.1117/1.nph.11.4.045008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Revised: 07/27/2024] [Accepted: 08/15/2024] [Indexed: 11/07/2024]
Abstract
Significance The increasing sample sizes and channel densities in functional near-infrared spectroscopy (fNIRS) necessitate precise and scalable identification of signals that do not permit reliable analysis to exclude them. Despite the relevance of detecting these "bad channels," little is known about the behavior of fNIRS detection methods, and the potential of unsupervised and semi-supervised machine learning remains unexplored. Aim We developed three novel machine learning-based detectors, unsupervised, semi-supervised, and hybrid NiReject, and compared them with existing approaches. Approach We conducted a systematic literature search and demonstrated the influence of bad channel detection. Based on 29,924 signals from two independently rated datasets and a simulated scenario space of diverse phenomena, we evaluated the NiReject models, six of the most established detection methods in fNIRS, and 11 prominent methods from other domains. Results Although the results indicated that a lack of proper detection can strongly bias findings, detection methods were reported in only 32% of the included studies. Semi-supervised models, specifically semi-supervised NiReject, outperformed both established thresholding-based and unsupervised detectors. Hybrid NiReject, utilizing a human feedback loop, addressed the practical challenges of semi-supervised methods while maintaining precise detection and low rating effort. Conclusions This work contributes toward more automated and reliable fNIRS signal quality control by comprehensively evaluating existing and introducing novel machine learning-based techniques and outlining practical considerations for bad channel detection.
Collapse
Affiliation(s)
- Christian Gerloff
- JARA Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), Jülich Research Centre, Jülich, Germany
- University Hospital RWTH Aachen, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Child Neuropsychology Section, Aachen, Germany
- University of Cambridge, Cambridge Centre for Data-Driven Discovery, Department of Applied Mathematics and Theoretical Physics, Cambridge, United Kingdom
| | - Meryem A. Yücel
- Boston University, Neurophotonics Center, Department of Biomedical Engineering, Boston, United States
- Massachusetts General Hospital, Harvard Medical School, MGH/HST Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Charlestown, Massachusetts, United States
| | - Lena Mehlem
- University Hospital RWTH Aachen, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Child Neuropsychology Section, Aachen, Germany
| | - Kerstin Konrad
- JARA Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), Jülich Research Centre, Jülich, Germany
- University Hospital RWTH Aachen, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Child Neuropsychology Section, Aachen, Germany
| | - Vanessa Reindl
- University Hospital RWTH Aachen, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Child Neuropsychology Section, Aachen, Germany
- Nanyang Technological University, School of Social Sciences, Department of Psychology, Singapore
| |
Collapse
|
3
|
Zinos A, Wagner JC, Beardsley SA, Chen WL, Conant L, Malloy M, Heffernan J, Quirk B, Prost R, Maheshwari M, Sugar J, Whelan HT. Spatial correspondence of cortical activity measured with whole head fNIRS and fMRI: Toward clinical use within subject. Neuroimage 2024; 290:120569. [PMID: 38461959 DOI: 10.1016/j.neuroimage.2024.120569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 12/15/2023] [Accepted: 03/07/2024] [Indexed: 03/12/2024] Open
Abstract
Functional near infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI) both measure the hemodynamic response, and so both imaging modalities are expected to have a strong correspondence in regions of cortex adjacent to the scalp. To assess whether fNIRS can be used clinically in a manner similar to fMRI, 22 healthy adult participants underwent same-day fMRI and whole-head fNIRS testing while they performed separate motor (finger tapping) and visual (flashing checkerboard) tasks. Analyses were conducted within and across subjects for each imaging approach, and regions of significant task-related activity were compared on the cortical surface. The spatial correspondence between fNIRS and fMRI detection of task-related activity was good in terms of true positive rate, with fNIRS overlap of up to 68 % of the fMRI for analyses across subjects (group analysis) and an average overlap of up to 47.25 % for individual analyses within subject. At the group level, the positive predictive value of fNIRS was 51 % relative to fMRI. The positive predictive value for within subject analyses was lower (41.5 %), reflecting the presence of significant fNIRS activity in regions without significant fMRI activity. This could reflect task-correlated sources of physiologic noise and/or differences in the sensitivity of fNIRS and fMRI measures to changes in separate (vs. combined) measures of oxy and de-oxyhemoglobin. The results suggest whole-head fNIRS as a noninvasive imaging modality with promising clinical utility for the functional assessment of brain activity in superficial regions of cortex physically adjacent to the skull.
Collapse
Affiliation(s)
- Anthony Zinos
- Department of Biomedical Engineering, Marquette University and Medical College of Wisconsin, Milwaukee, WI, USA
| | - Julie C Wagner
- Department of Biomedical Engineering, Marquette University and Medical College of Wisconsin, Milwaukee, WI, USA
| | - Scott A Beardsley
- Department of Biomedical Engineering, Marquette University and Medical College of Wisconsin, Milwaukee, WI, USA; Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA.
| | - Wei-Liang Chen
- Center for Neuroscience Research, Children's National Medical Center, George Washington University, Washington DC, USA
| | - Lisa Conant
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Marsha Malloy
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA; Department of Neurology, Children's Wisconsin, Milwaukee, WI, USA
| | - Joseph Heffernan
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Brendan Quirk
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Robert Prost
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Mohit Maheshwari
- Department of Radiology, Children's Wisconsin, Milwaukee, WI, USA
| | - Jeffrey Sugar
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Harry T Whelan
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA; Department of Neurology, Children's Wisconsin, Milwaukee, WI, USA
| |
Collapse
|
4
|
Peng K, Karunakaran KD, Green S, Borsook D. Machines, mathematics, and modules: the potential to provide real-time metrics for pain under anesthesia. NEUROPHOTONICS 2024; 11:010701. [PMID: 38389718 PMCID: PMC10883389 DOI: 10.1117/1.nph.11.1.010701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 01/08/2024] [Accepted: 01/16/2024] [Indexed: 02/24/2024]
Abstract
The brain-based assessments under anesthesia have provided the ability to evaluate pain/nociception during surgery and the potential to prevent long-term evolution of chronic pain. Prior studies have shown that the functional near-infrared spectroscopy (fNIRS)-measured changes in cortical regions such as the primary somatosensory and the polar frontal cortices show consistent response to evoked and ongoing pain in awake, sedated, and anesthetized patients. We take this basic approach and integrate it into a potential framework that could provide real-time measures of pain/nociception during the peri-surgical period. This application could have significant implications for providing analgesia during surgery, a practice that currently lacks quantitative evidence to guide patient tailored pain management. Through a simple readout of "pain" or "no pain," the proposed system could diminish or eliminate levels of intraoperative, early post-operative, and potentially, the transition to chronic post-surgical pain. The system, when validated, could also be applied to measures of analgesic efficacy in the clinic.
Collapse
Affiliation(s)
- Ke Peng
- University of Manitoba, Department of Electrical and Computer Engineering, Price Faculty of Engineering, Winnipeg, Manitoba, Canada
| | - Keerthana Deepti Karunakaran
- Massachusetts General Hospital, Harvard Medical School, Department of Psychiatry, Boston, Massachusetts, United States
| | - Stephen Green
- Massachusetts Institute of Technology, Department of Mechanical Engineering, Boston, Massachusetts, United States
| | - David Borsook
- Massachusetts General Hospital, Harvard Medical School, Department of Psychiatry, Boston, Massachusetts, United States
- Massachusetts General Hospital, Harvard Medical School, Department of Radiology, Boston, Massachusetts, United States
| |
Collapse
|
5
|
Gao Y, Rogers D, von Lühmann A, Ortega-Martinez A, Boas DA, Yücel MA. Short-separation regression incorporated diffuse optical tomography image reconstruction modeling for high-density functional near-infrared spectroscopy. NEUROPHOTONICS 2023; 10:025007. [PMID: 37228904 PMCID: PMC10203730 DOI: 10.1117/1.nph.10.2.025007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 04/08/2023] [Accepted: 05/03/2023] [Indexed: 05/27/2023]
Abstract
Significance Short-separation (SS) regression and diffuse optical tomography (DOT) image reconstruction, two widely adopted methods in functional near-infrared spectroscopy (fNIRS), were demonstrated to individually facilitate the separation of brain activation and physiological signals, with further improvement using both sequentially. We hypothesized that doing both simultaneously would further improve the performance. Aim Motivated by the success of these two approaches, we propose a method, SS-DOT, which applies SS and DOT simultaneously. Approach The method, which employs spatial and temporal basis functions to represent the hemoglobin concentration changes, enables us to incorporate SS regressors into the time series DOT model. To benchmark the performance of the SS-DOT model against conventional sequential models, we use fNIRS resting state data augmented with synthetic brain response as well as data acquired during a ball squeezing task. The conventional sequential models comprise performing SS regression and DOT. Results The results show that the SS-DOT model improves the image quality by increasing the contrast-to-background ratio by a threefold improvement. The benefits are marginal at small brain activation. Conclusions The SS-DOT model improves the fNIRS image reconstruction quality.
Collapse
Affiliation(s)
- Yuanyuan Gao
- Boston University, Neurophotonics Center, Boston, Massachusetts, United States
| | - De’Ja Rogers
- Boston University, Neurophotonics Center, Boston, Massachusetts, United States
| | | | | | - David A. Boas
- Boston University, Neurophotonics Center, Boston, Massachusetts, United States
| | - Meryem Ayşe Yücel
- Boston University, Neurophotonics Center, Boston, Massachusetts, United States
| |
Collapse
|
6
|
Vera DA, García HA, Waks-Serra MV, Carbone NA, Iriarte DI, Pomarico JA. Reconstruction of light absorption changes in the human head using analytically computed photon partial pathlengths in layered media. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2023; 40:C126-C137. [PMID: 37132982 DOI: 10.1364/josaa.482288] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Functional near infrared spectroscopy has been used in recent decades to sense and quantify changes in hemoglobin concentrations in the human brain. This noninvasive technique can deliver useful information concerning brain cortex activation associated with different motor/cognitive tasks or external stimuli. This is usually accomplished by considering the human head as a homogeneous medium; however, this approach does not explicitly take into account the detailed layered structure of the head, and thus, extracerebral signals can mask those arising at the cortex level. This work improves this situation by considering layered models of the human head during reconstruction of the absorption changes in layered media. To this end, analytically calculated mean partial pathlengths of photons are used, which guarantees fast and simple implementation in real-time applications. Results obtained from synthetic data generated by Monte Carlo simulations in two- and four-layered turbid media suggest that a layered description of the human head greatly outperforms typical homogeneous reconstructions, with errors, in the first case, bounded up to ∼20% maximum, while in the second case, the error is usually larger than 75%. Experimental measurements on dynamic phantoms support this conclusion.
Collapse
|
7
|
Goble M, Caddick V, Patel R, Modi H, Darzi A, Orihuela-Espina F, Leff DR. Optical neuroimaging and neurostimulation in surgical training and assessment: A state-of-the-art review. FRONTIERS IN NEUROERGONOMICS 2023; 4:1142182. [PMID: 38234498 PMCID: PMC10790870 DOI: 10.3389/fnrgo.2023.1142182] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 03/03/2023] [Indexed: 01/19/2024]
Abstract
Introduction Functional near-infrared spectroscopy (fNIRS) is a non-invasive optical neuroimaging technique used to assess surgeons' brain function. The aim of this narrative review is to outline the effect of expertise, stress, surgical technology, and neurostimulation on surgeons' neural activation patterns, and highlight key progress areas required in surgical neuroergonomics to modulate training and performance. Methods A literature search of PubMed and Embase was conducted to identify neuroimaging studies using fNIRS and neurostimulation in surgeons performing simulated tasks. Results Novice surgeons exhibit greater haemodynamic responses across the pre-frontal cortex than experts during simple surgical tasks, whilst expert surgical performance is characterized by relative prefrontal attenuation and upregulation of activation foci across other regions such as the supplementary motor area. The association between PFC activation and mental workload follows an inverted-U shaped curve, activation increasing then attenuating past a critical inflection point at which demands outstrip cognitive capacity Neuroimages are sensitive to the impact of laparoscopic and robotic tools on cognitive workload, helping inform the development of training programs which target neural learning curves. FNIRS differs in comparison to current tools to assess proficiency by depicting a cognitive state during surgery, enabling the development of cognitive benchmarks of expertise. Finally, neurostimulation using transcranial direct-current-stimulation may accelerate skill acquisition and enhance technical performance. Conclusion FNIRS can inform the development of surgical training programs which modulate stress responses, cognitive learning curves, and motor skill performance. Improved data processing with machine learning offers the possibility of live feedback regarding surgeons' cognitive states during operative procedures.
Collapse
Affiliation(s)
- Mary Goble
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | | | | | | | | | | | | |
Collapse
|
8
|
Li R, Hosseini H, Saggar M, Balters SC, Reiss AL. Current opinions on the present and future use of functional near-infrared spectroscopy in psychiatry. NEUROPHOTONICS 2023; 10:013505. [PMID: 36777700 PMCID: PMC9904322 DOI: 10.1117/1.nph.10.1.013505] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Accepted: 01/13/2023] [Indexed: 05/19/2023]
Abstract
Functional near-infrared spectroscopy (fNIRS) is an optical imaging technique for assessing human brain activity by noninvasively measuring the fluctuation of cerebral oxygenated- and deoxygenated-hemoglobin concentrations associated with neuronal activity. Owing to its superior mobility, low cost, and good tolerance for motion, the past few decades have witnessed a rapid increase in the research and clinical use of fNIRS in a variety of psychiatric disorders. In this perspective article, we first briefly summarize the state-of-the-art concerning fNIRS research in psychiatry. In particular, we highlight the diverse applications of fNIRS in psychiatric research, the advanced development of fNIRS instruments, and novel fNIRS study designs for exploring brain activity associated with psychiatric disorders. We then discuss some of the open challenges and share our perspectives on the future of fNIRS in psychiatric research and clinical practice. We conclude that fNIRS holds promise for becoming a useful tool in clinical psychiatric settings with respect to developing closed-loop systems and improving individualized treatments and diagnostics.
Collapse
Affiliation(s)
- Rihui Li
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Hadi Hosseini
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Manish Saggar
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Stephanie Christina Balters
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Allan L. Reiss
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
- Stanford University, Department of Radiology and Pediatrics, Stanford, California, United States
- Stanford University, Department of Pediatrics, Stanford, California, United States
- Address all correspondence to Allan L. Reiss,
| |
Collapse
|
9
|
Liu D, Zhang Y, Zhang P, Li T, Li Z, Zhang L, Gao F. Deep-learning informed Kalman filtering for priori-free and real-time hemodynamics extraction in functional near-infrared spectroscopy. BIOMEDICAL OPTICS EXPRESS 2022; 13:4787-4801. [PMID: 36187239 PMCID: PMC9484432 DOI: 10.1364/boe.467943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 08/04/2022] [Accepted: 08/05/2022] [Indexed: 06/16/2023]
Abstract
Separation of the physiological interferences and the neural hemodynamics has been a vitally important task in the realistic implementation of functional near-infrared spectroscopy (fNIRS). Although many efforts have been devoted, the established solutions to this issue additionally rely on priori information on the interferences and activation responses, such as time-frequency characteristics and spatial patterns, etc., also hindering the realization of real-time. To tackle the adversity, we herein propose a novel priori-free scheme for real-time physiological interference suppression. This method combines the robustness of deep-leaning-based interference characterization and adaptivity of Kalman filtering: a long short-term memory (LSTM) network is trained with the time-courses of the absorption perturbation baseline for interferences profiling, and successively, a Kalman filtering process is applied with reference to the noise prediction for real-time activation extraction. The proposed method is validated using both simulated dynamic data and in-vivo experiments, showing the comprehensively improved performance and promisingly appended superiority achieved in the purely data-driven way.
Collapse
Affiliation(s)
- Dongyuan Liu
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Yao Zhang
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Pengrui Zhang
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Tieni Li
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Zhiyong Li
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Limin Zhang
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| | - Feng Gao
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| |
Collapse
|
10
|
Li R, Yang D, Fang F, Hong KS, Reiss AL, Zhang Y. Concurrent fNIRS and EEG for Brain Function Investigation: A Systematic, Methodology-Focused Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22155865. [PMID: 35957421 PMCID: PMC9371171 DOI: 10.3390/s22155865] [Citation(s) in RCA: 55] [Impact Index Per Article: 27.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Revised: 07/27/2022] [Accepted: 07/30/2022] [Indexed: 05/29/2023]
Abstract
Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) stand as state-of-the-art techniques for non-invasive functional neuroimaging. On a unimodal basis, EEG has poor spatial resolution while presenting high temporal resolution. In contrast, fNIRS offers better spatial resolution, though it is constrained by its poor temporal resolution. One important merit shared by the EEG and fNIRS is that both modalities have favorable portability and could be integrated into a compatible experimental setup, providing a compelling ground for the development of a multimodal fNIRS-EEG integration analysis approach. Despite a growing number of studies using concurrent fNIRS-EEG designs reported in recent years, the methodological reference of past studies remains unclear. To fill this knowledge gap, this review critically summarizes the status of analysis methods currently used in concurrent fNIRS-EEG studies, providing an up-to-date overview and guideline for future projects to conduct concurrent fNIRS-EEG studies. A literature search was conducted using PubMed and Web of Science through 31 August 2021. After screening and qualification assessment, 92 studies involving concurrent fNIRS-EEG data recordings and analyses were included in the final methodological review. Specifically, three methodological categories of concurrent fNIRS-EEG data analyses, including EEG-informed fNIRS analyses, fNIRS-informed EEG analyses, and parallel fNIRS-EEG analyses, were identified and explained with detailed description. Finally, we highlighted current challenges and potential directions in concurrent fNIRS-EEG data analyses in future research.
Collapse
Affiliation(s)
- Rihui Li
- Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94305, USA
- Department of Biomedical Engineering, University of Houston, Houston, TX 77004, USA
| | - Dalin Yang
- School of Mechanical Engineering, Pusan National University, Pusan 43241, Korea
- Mallinckrodt Institute of Radiology, Washington University School of Medicine in St. Louis, 4515 McKinley Avenue, St. Louis, MO 63110, USA
| | - Feng Fang
- Department of Biomedical Engineering, University of Houston, Houston, TX 77004, USA
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Pusan 43241, Korea
| | - Allan L. Reiss
- Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94305, USA
| | - Yingchun Zhang
- Department of Biomedical Engineering, University of Houston, Houston, TX 77004, USA
| |
Collapse
|
11
|
Ayaz H, Baker WB, Blaney G, Boas DA, Bortfeld H, Brady K, Brake J, Brigadoi S, Buckley EM, Carp SA, Cooper RJ, Cowdrick KR, Culver JP, Dan I, Dehghani H, Devor A, Durduran T, Eggebrecht AT, Emberson LL, Fang Q, Fantini S, Franceschini MA, Fischer JB, Gervain J, Hirsch J, Hong KS, Horstmeyer R, Kainerstorfer JM, Ko TS, Licht DJ, Liebert A, Luke R, Lynch JM, Mesquida J, Mesquita RC, Naseer N, Novi SL, Orihuela-Espina F, O’Sullivan TD, Peterka DS, Pifferi A, Pollonini L, Sassaroli A, Sato JR, Scholkmann F, Spinelli L, Srinivasan VJ, St. Lawrence K, Tachtsidis I, Tong Y, Torricelli A, Urner T, Wabnitz H, Wolf M, Wolf U, Xu S, Yang C, Yodh AG, Yücel MA, Zhou W. Optical imaging and spectroscopy for the study of the human brain: status report. NEUROPHOTONICS 2022; 9:S24001. [PMID: 36052058 PMCID: PMC9424749 DOI: 10.1117/1.nph.9.s2.s24001] [Citation(s) in RCA: 55] [Impact Index Per Article: 27.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.
Collapse
Affiliation(s)
- Hasan Ayaz
- Drexel University, School of Biomedical Engineering, Science, and Health Systems, Philadelphia, Pennsylvania, United States
- Drexel University, College of Arts and Sciences, Department of Psychological and Brain Sciences, Philadelphia, Pennsylvania, United States
| | - Wesley B. Baker
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, United States
| | - Giles Blaney
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - David A. Boas
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Heather Bortfeld
- University of California, Merced, Departments of Psychological Sciences and Cognitive and Information Sciences, Merced, California, United States
| | - Kenneth Brady
- Lurie Children’s Hospital, Northwestern University Feinberg School of Medicine, Department of Anesthesiology, Chicago, Illinois, United States
| | - Joshua Brake
- Harvey Mudd College, Department of Engineering, Claremont, California, United States
| | - Sabrina Brigadoi
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
| | - Erin M. Buckley
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
- Emory University School of Medicine, Department of Pediatrics, Atlanta, Georgia, United States
| | - Stefan A. Carp
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Robert J. Cooper
- University College London, Department of Medical Physics and Bioengineering, DOT-HUB, London, United Kingdom
| | - Kyle R. Cowdrick
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Joseph P. Culver
- Washington University School of Medicine, Department of Radiology, St. Louis, Missouri, United States
| | - Ippeita Dan
- Chuo University, Faculty of Science and Engineering, Tokyo, Japan
| | - Hamid Dehghani
- University of Birmingham, School of Computer Science, Birmingham, United Kingdom
| | - Anna Devor
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Turgut Durduran
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
- Institució Catalana de Recerca I Estudis Avançats (ICREA), Barcelona, Spain
| | - Adam T. Eggebrecht
- Washington University in St. Louis, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States
| | - Lauren L. Emberson
- University of British Columbia, Department of Psychology, Vancouver, British Columbia, Canada
| | - Qianqian Fang
- Northeastern University, Department of Bioengineering, Boston, Massachusetts, United States
| | - Sergio Fantini
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - Maria Angela Franceschini
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Jonas B. Fischer
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Judit Gervain
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
- Université Paris Cité, CNRS, Integrative Neuroscience and Cognition Center, Paris, France
| | - Joy Hirsch
- Yale School of Medicine, Department of Psychiatry, Neuroscience, and Comparative Medicine, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Keum-Shik Hong
- Pusan National University, School of Mechanical Engineering, Busan, Republic of Korea
- Qingdao University, School of Automation, Institute for Future, Qingdao, China
| | - Roarke Horstmeyer
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
- Duke University, Department of Electrical and Computer Engineering, Durham, North Carolina, United States
- Duke University, Department of Physics, Durham, North Carolina, United States
| | - Jana M. Kainerstorfer
- Carnegie Mellon University, Department of Biomedical Engineering, Pittsburgh, Pennsylvania, United States
- Carnegie Mellon University, Neuroscience Institute, Pittsburgh, Pennsylvania, United States
| | - Tiffany S. Ko
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Daniel J. Licht
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
| | - Adam Liebert
- Polish Academy of Sciences, Nalecz Institute of Biocybernetics and Biomedical Engineering, Warsaw, Poland
| | - Robert Luke
- Macquarie University, Department of Linguistics, Sydney, New South Wales, Australia
- Macquarie University Hearing, Australia Hearing Hub, Sydney, New South Wales, Australia
| | - Jennifer M. Lynch
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Jaume Mesquida
- Parc Taulí Hospital Universitari, Critical Care Department, Sabadell, Spain
| | - Rickson C. Mesquita
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology, Campinas, São Paulo, Brazil
| | - Noman Naseer
- Air University, Department of Mechatronics and Biomedical Engineering, Islamabad, Pakistan
| | - Sergio L. Novi
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Western University, Department of Physiology and Pharmacology, London, Ontario, Canada
| | | | - Thomas D. O’Sullivan
- University of Notre Dame, Department of Electrical Engineering, Notre Dame, Indiana, United States
| | - Darcy S. Peterka
- Columbia University, Zuckerman Mind Brain Behaviour Institute, New York, United States
| | | | - Luca Pollonini
- University of Houston, Department of Engineering Technology, Houston, Texas, United States
| | - Angelo Sassaroli
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - João Ricardo Sato
- Federal University of ABC, Center of Mathematics, Computing and Cognition, São Bernardo do Campo, São Paulo, Brazil
| | - Felix Scholkmann
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Lorenzo Spinelli
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Vivek J. Srinivasan
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- NYU Langone Health, Department of Ophthalmology, New York, New York, United States
- NYU Langone Health, Department of Radiology, New York, New York, United States
| | - Keith St. Lawrence
- Lawson Health Research Institute, Imaging Program, London, Ontario, Canada
- Western University, Department of Medical Biophysics, London, Ontario, Canada
| | - Ilias Tachtsidis
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Yunjie Tong
- Purdue University, Weldon School of Biomedical Engineering, West Lafayette, Indiana, United States
| | - Alessandro Torricelli
- Politecnico di Milano, Dipartimento di Fisica, Milan, Italy
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Tara Urner
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Heidrun Wabnitz
- Physikalisch-Technische Bundesanstalt (PTB), Berlin, Germany
| | - Martin Wolf
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Ursula Wolf
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
| | - Shiqi Xu
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
| | - Changhuei Yang
- California Institute of Technology, Department of Electrical Engineering, Pasadena, California, United States
| | - Arjun G. Yodh
- University of Pennsylvania, Department of Physics and Astronomy, Philadelphia, Pennsylvania, United States
| | - Meryem A. Yücel
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Wenjun Zhou
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- China Jiliang University, College of Optical and Electronic Technology, Hangzhou, Zhejiang, China
| |
Collapse
|