1
|
Khan AF, Yuan H, Smith ZA, Ding L. Distinct Time-Resolved Brain-Wide Coactivations in Oxygenated and Deoxygenated Hemoglobin. IEEE Trans Biomed Eng 2024; 71:2463-2472. [PMID: 38478444 DOI: 10.1109/tbme.2024.3377109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/20/2024]
Abstract
OBJECTIVE Human resting-state networks (RSNs) estimated from oxygenated (HbO) and deoxygenated hemoglobin (HbR) data exhibit strong similarities, while task-based studies show different dynamics in HbR and HbO responses. Such a discrepancy might be explained due to time-averaged estimations of RSNs. Our study investigated differences between HbO and HbR on time-resolved brain-wide coactivation patterns (CAPs). METHODS Diffuse optical tomography was reconstructed from resting-state whole-head functional near-infrared spectroscopy data of HbR and HbO in individual healthy participants. Time-averaged RSNs were obtained using the group-level independent component analysis. Time-resolved CAPs were estimated using a clustering approach on the time courses of all obtained RSNs. Characteristics of the RSNs and CAPs from HbR and HbO were compared. RESULTS Spatial patterns of HbR and HbO RSNs exhibited significant similarities. Meanwhile, HbR CAPs revealed much more organized spatial and dynamic characteristics than HbO CAPs. The entire set of HbR CAPs suggests a superstructure resulted from brain-wide neuronal dynamics, which is less evident in the set of HbO CAPs. These differences between HbO and HbR CAPs were consistently replicated in individual session data. CONCLUSION Our results suggest that human resting brain-wide neuronal activations are preserved better in time-resolved brain-wide patterns, i.e., CAPs, from HbR than those from HbO, while such a difference is lost between time-averaged HbR and HbO RSNs. SIGNIFICANCE Our results reveal, for the first time, HbR concentration fluctuations are more directly coupled with resting dynamics of brain-wide neuronal activations in human brains.
Collapse
|
2
|
Curzel F, Tillmann B, Ferreri L. Lights on music cognition: A systematic and critical review of fNIRS applications and future perspectives. Brain Cogn 2024; 180:106200. [PMID: 38908228 DOI: 10.1016/j.bandc.2024.106200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Revised: 06/10/2024] [Accepted: 06/16/2024] [Indexed: 06/24/2024]
Abstract
Research investigating the neural processes related to music perception and production constitutes a well-established field within the cognitive neurosciences. While most neuroimaging tools have limitations in studying the complexity of musical experiences, functional Near-Infrared Spectroscopy (fNIRS) represents a promising, relatively new tool for studying music processes in both laboratory and ecological settings, which is also suitable for both typical and pathological populations across development. Here we systematically review fNIRS studies on music cognition, highlighting prospects and potentialities. We also include an overview of fNIRS basic theory, together with a brief comparison to characteristics of other neuroimaging tools. Fifty-nine studies meeting inclusion criteria (i.e., using fNIRS with music as the primary stimulus) are presented across five thematic sections. Critical discussion of methodology leads us to propose guidelines of good practices aiming for robust signal analyses and reproducibility. A continuously updated world map is proposed, including basic information from studies meeting the inclusion criteria. It provides an organized, accessible, and updatable reference database, which could serve as a catalyst for future collaborations within the community. In conclusion, fNIRS shows potential for investigating cognitive processes in music, particularly in ecological contexts and with special populations, aligning with current research priorities in music cognition.
Collapse
Affiliation(s)
- Federico Curzel
- Laboratoire d'Étude des Mécanismes Cognitifs (EMC), Université Lumière Lyon 2, Bron, Auvergne-Rhône-Alpes, 69500, France; Lyon Neuroscience Research Center (CRNL), INSERM, U1028, CNRS, UMR 5292, Université Claude Bernard Lyon1, Université de Lyon, Bron, Auvergne-Rhône-Alpes, 69500, France.
| | - Barbara Tillmann
- Lyon Neuroscience Research Center (CRNL), INSERM, U1028, CNRS, UMR 5292, Université Claude Bernard Lyon1, Université de Lyon, Bron, Auvergne-Rhône-Alpes, 69500, France; LEAD CNRS UMR5022, Université de Bourgogne-Franche Comté, Dijon, Bourgogne-Franche Comté 21000, France.
| | - Laura Ferreri
- Laboratoire d'Étude des Mécanismes Cognitifs (EMC), Université Lumière Lyon 2, Bron, Auvergne-Rhône-Alpes, 69500, France; Department of Brain and Behavioural Sciences, Università di Pavia, Pavia, Lombardia 27100, Italy.
| |
Collapse
|
3
|
Jiang S, Huang J, Yang H, Czuma R, Farley L, Cohen‐Oram A, Hartney K, Chechotka K, Kozel FA, Jiang H. Diffuse optical tomography for mapping cerebral hemodynamics and functional connectivity in delirium. Alzheimers Dement 2024; 20:4032-4042. [PMID: 38700095 PMCID: PMC11180861 DOI: 10.1002/alz.13827] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 03/07/2024] [Accepted: 03/08/2024] [Indexed: 05/05/2024]
Abstract
INTRODUCTION Delirium is associated with mortality and new onset dementia, yet the underlying pathophysiology remains poorly understood. Development of imaging biomarkers has been difficult given the challenging nature of imaging delirious patients. Diffuse optical tomography (DOT) offers a promising approach for investigating delirium given its portability and three-dimensional capabilities. METHODS Twenty-five delirious and matched non-delirious patients (n = 50) were examined using DOT, comparing cerebral oxygenation and functional connectivity in the prefrontal cortex during and after an episode of delirium. RESULTS Total hemoglobin values were significantly decreased in the delirium group, even after delirium resolution. Functional connectivity between the dorsolateral prefrontal cortex and dorsomedial prefrontal cortex was strengthened post-resolution compared to during an episode; however, this relationship was still significantly weaker compared to controls. DISCUSSION These findings highlight DOT's potential as an imaging biomarker to measure impaired cerebral oxygenation and functional dysconnectivity during and after delirium. Future studies should focus on the role of cerebral oxygenation in delirium pathogenesis and exploring the etiological link between delirium and dementias. HIGHLIGHTS We developed a portable diffuse optical tomography (DOT) system for bedside three-dimensional functional neuroimaging to study delirium in the hospital. We implemented a novel DOT task-focused seed-based correlation analysis. DOT revealed decreased cerebral oxygenation and functional connectivity strength in the delirium group, even after resolution of delirium.
Collapse
Affiliation(s)
- Shixie Jiang
- Department of Psychiatry and Behavioral NeurosciencesUniversity of South FloridaTampaFloridaUSA
- Department of PsychiatryUniversity of FloridaGainesvilleFloridaUSA
| | - Jingyu Huang
- Department of Medical EngineeringUniversity of South FloridaTampaFloridaUSA
| | - Hao Yang
- Department of Medical EngineeringUniversity of South FloridaTampaFloridaUSA
| | - Richard Czuma
- Department of Psychiatry and Behavioral NeurosciencesUniversity of South FloridaTampaFloridaUSA
| | - Lauren Farley
- Department of Surgery and Division of Vascular SurgeryUniversity of South FloridaTampaFloridaUSA
| | - Alexis Cohen‐Oram
- Department of Psychiatry and Behavioral NeurosciencesUniversity of South FloridaTampaFloridaUSA
| | - Kimberly Hartney
- Department of Psychiatry and Behavioral NeurosciencesUniversity of South FloridaTampaFloridaUSA
| | - Kristina Chechotka
- Department of Psychiatry and Behavioral NeurosciencesUniversity of South FloridaTampaFloridaUSA
| | - F. Andrew Kozel
- Department of Behavioral Sciences and Social MedicineFlorida State UniversityTallahasseeFloridaUSA
| | - Huabei Jiang
- Department of Medical EngineeringUniversity of South FloridaTampaFloridaUSA
| |
Collapse
|
4
|
Markow ZE, Tripathy K, Svoboda AM, Schroeder ML, Rafferty SM, Richter EJ, Eggebrecht AT, Anastasio MA, Chevillet MA, Mugler EM, Naufel SN, Yin A, Trobaugh JW, Culver JP. Identifying Naturalistic Movies from Human Brain Activity with High-Density Diffuse Optical Tomography. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.11.27.566650. [PMID: 38076976 PMCID: PMC10705261 DOI: 10.1101/2023.11.27.566650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/31/2024]
Abstract
Modern neuroimaging modalities, particularly functional MRI (fMRI), can decode detailed human experiences. Thousands of viewed images can be identified or classified, and sentences can be reconstructed. Decoding paradigms often leverage encoding models that reduce the stimulus space into a smaller yet generalizable feature set. However, the neuroimaging devices used for detailed decoding are non-portable, like fMRI, or invasive, like electrocorticography, excluding application in naturalistic use. Wearable, non-invasive, but lower-resolution devices such as electroencephalography and functional near-infrared spectroscopy (fNIRS) have been limited to decoding between stimuli used during training. Herein we develop and evaluate model-based decoding with high-density diffuse optical tomography (HD-DOT), a higher-resolution expansion of fNIRS with demonstrated promise as a surrogate for fMRI. Using a motion energy model of visual content, we decoded the identities of novel movie clips outside the training set with accuracy far above chance for single-trial decoding. Decoding was robust to modulations of testing time window, different training and test imaging sessions, hemodynamic contrast, and optode array density. Our results suggest that HD-DOT can translate detailed decoding into naturalistic use.
Collapse
|
5
|
Tripathy K, Fogarty M, Svoboda AM, Schroeder ML, Rafferty SM, Richter EJ, Tracy C, Mansfield PK, Booth M, Fishell AK, Sherafati A, Markow ZE, Wheelock MD, Arbeláez AM, Schlaggar BL, Smyser CD, Eggebrecht AT, Culver JP. Mapping brain function in adults and young children during naturalistic viewing with high-density diffuse optical tomography. Hum Brain Mapp 2024; 45:e26684. [PMID: 38703090 PMCID: PMC11069306 DOI: 10.1002/hbm.26684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 03/27/2024] [Accepted: 04/03/2024] [Indexed: 05/06/2024] Open
Abstract
Human studies of early brain development have been limited by extant neuroimaging methods. MRI scanners present logistical challenges for imaging young children, while alternative modalities like functional near-infrared spectroscopy have traditionally been limited by image quality due to sparse sampling. In addition, conventional tasks for brain mapping elicit low task engagement, high head motion, and considerable participant attrition in pediatric populations. As a result, typical and atypical developmental trajectories of processes such as language acquisition remain understudied during sensitive periods over the first years of life. We evaluate high-density diffuse optical tomography (HD-DOT) imaging combined with movie stimuli for high resolution optical neuroimaging in awake children ranging from 1 to 7 years of age. We built an HD-DOT system with design features geared towards enhancing both image quality and child comfort. Furthermore, we characterized a library of animated movie clips as a stimulus set for brain mapping and we optimized associated data analysis pipelines. Together, these tools could map cortical responses to movies and contained features such as speech in both adults and awake young children. This study lays the groundwork for future research to investigate response variability in larger pediatric samples and atypical trajectories of early brain development in clinical populations.
Collapse
Affiliation(s)
- Kalyan Tripathy
- Division of Biological and Biomedical SciencesWashington University in St. LouisSt. LouisMissouriUSA
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
- Western Psychiatric HospitalUniversity of Pittsburgh Medical CenterPittsburghPennsylvaniaUSA
| | - Morgan Fogarty
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
- Imaging Science ProgramWashington University in St. LouisSt. LouisMissouriUSA
| | - Alexandra M. Svoboda
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Mariel L. Schroeder
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Sean M. Rafferty
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Edward J. Richter
- Department of Electrical and Systems EngineeringWashington University in St. LouisSt. LouisMissouriUSA
| | - Christopher Tracy
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Patricia K. Mansfield
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Madison Booth
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Andrew K. Fishell
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Arefeh Sherafati
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
- Department of PhysicsWashington University in St. LouisSt. LouisMissouriUSA
| | - Zachary E. Markow
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
- Department of Biomedical EngineeringWashington University in St. LouisSt. LouisMissouriUSA
| | - Muriah D. Wheelock
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Ana María Arbeláez
- Department of PediatricsWashington University School of MedicineSt. LouisMissouriUSA
| | - Bradley L. Schlaggar
- Kennedy Krieger InstituteBaltimoreMarylandUSA
- Department of NeurologyJohns Hopkins University School of MedicineBaltimoreMarylandUSA
- Department of PediatricsJohns Hopkins University School of MedicineBaltimoreMarylandUSA
| | - Christopher D. Smyser
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
- Department of PediatricsWashington University School of MedicineSt. LouisMissouriUSA
- Department of NeurologyWashington University School of MedicineSt. LouisMissouriUSA
| | - Adam T. Eggebrecht
- Division of Biological and Biomedical SciencesWashington University in St. LouisSt. LouisMissouriUSA
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
- Imaging Science ProgramWashington University in St. LouisSt. LouisMissouriUSA
- Department of Electrical and Systems EngineeringWashington University in St. LouisSt. LouisMissouriUSA
- Department of PhysicsWashington University in St. LouisSt. LouisMissouriUSA
- Department of Biomedical EngineeringWashington University in St. LouisSt. LouisMissouriUSA
| | - Joseph P. Culver
- Mallinckrodt Institute of RadiologyWashington University School of MedicineSt. LouisMissouriUSA
- Imaging Science ProgramWashington University in St. LouisSt. LouisMissouriUSA
- Department of PhysicsWashington University in St. LouisSt. LouisMissouriUSA
- Department of Biomedical EngineeringWashington University in St. LouisSt. LouisMissouriUSA
| |
Collapse
|
6
|
Srinivasan S, Acharya D, Butters E, Collins-Jones L, Mancini F, Bale G. Subject-specific information enhances spatial accuracy of high-density diffuse optical tomography. FRONTIERS IN NEUROERGONOMICS 2024; 5:1283290. [PMID: 38444841 PMCID: PMC10910052 DOI: 10.3389/fnrgo.2024.1283290] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Accepted: 02/02/2024] [Indexed: 03/07/2024]
Abstract
Functional near-infrared spectroscopy (fNIRS) is a widely used imaging method for mapping brain activation based on cerebral hemodynamics. The accurate quantification of cortical activation using fNIRS data is highly dependent on the ability to correctly localize the positions of light sources and photodetectors on the scalp surface. Variations in head size and shape across participants greatly impact the precise locations of these optodes and consequently, the regions of the cortical surface being reached. Such variations can therefore influence the conclusions drawn in NIRS studies that attempt to explore specific cortical regions. In order to preserve the spatial identity of each NIRS channel, subject-specific differences in NIRS array registration must be considered. Using high-density diffuse optical tomography (HD-DOT), we have demonstrated the inter-subject variability of the same HD-DOT array applied to ten participants recorded in the resting state. We have also compared three-dimensional image reconstruction results obtained using subject-specific positioning information to those obtained using generic optode locations. To mitigate the error introduced by using generic information for all participants, photogrammetry was used to identify specific optode locations per-participant. The present work demonstrates the large variation between subjects in terms of which cortical parcels are sampled by equivalent channels in the HD-DOT array. In particular, motor cortex recordings suffered from the largest optode localization errors, with a median localization error of 27.4 mm between generic and subject-specific optodes, leading to large differences in parcel sensitivity. These results illustrate the importance of collecting subject-specific optode locations for all wearable NIRS experiments, in order to perform accurate group-level analysis using cortical parcellation.
Collapse
Affiliation(s)
- Sruthi Srinivasan
- Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Deepshikha Acharya
- Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Emilia Butters
- Department of Engineering, University of Cambridge, Cambridge, United Kingdom
- Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | - Liam Collins-Jones
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, United Kingdom
| | - Flavia Mancini
- Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Gemma Bale
- Department of Engineering, University of Cambridge, Cambridge, United Kingdom
- Department of Physics, University of Cambridge, Cambridge, United Kingdom
| |
Collapse
|
7
|
Kobayashi Frisk L, Verma M, Bešlija F, Lin CHP, Patil N, Chetia S, Trobaugh JW, Culver JP, Durduran T. Comprehensive workflow and its validation for simulating diffuse speckle statistics for optical blood flow measurements. BIOMEDICAL OPTICS EXPRESS 2024; 15:875-899. [PMID: 38404339 PMCID: PMC10890893 DOI: 10.1364/boe.502421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 12/19/2023] [Accepted: 12/20/2023] [Indexed: 02/27/2024]
Abstract
Diffuse optical methods including speckle contrast optical spectroscopy and tomography (SCOS and SCOT), use speckle contrast (κ) to measure deep blood flow. In order to design practical systems, parameters such as signal-to-noise ratio (SNR) and the effects of limited sampling of statistical quantities, should be considered. To that end, we have developed a method for simulating speckle contrast signals including effects of detector noise. The method was validated experimentally, and the simulations were used to study the effects of physical and experimental parameters on the accuracy and precision of κ. These results revealed that systematic detector effects resulted in decreased accuracy and precision of κ in the regime of low detected signals. The method can provide guidelines for the design and usage of SCOS and/or SCOT instruments.
Collapse
Affiliation(s)
- Lisa Kobayashi Frisk
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Manish Verma
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Faruk Bešlija
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Chen-Hao P. Lin
- Department of Physics, Washington University in St. Louis, St. Louis, Missouri 63110, USA
- Department of Radiology, Washington University School of Medicine, St. Louis, Missouri 63110, USA
| | - Nishighanda Patil
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Sumana Chetia
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Jason W. Trobaugh
- Department of Electrical and Systems Engineering, Washington University School of Medicine, St. Louis, Missouri 63110, USA
| | - Joseph P. Culver
- Department of Physics, Washington University in St. Louis, St. Louis, Missouri 63110, USA
- Department of Radiology, Washington University School of Medicine, St. Louis, Missouri 63110, USA
| | - Turgut Durduran
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
| |
Collapse
|
8
|
Yang D, Ghafoor U, Eggebrecht AT, Hong KS. Effectiveness assessment of repetitive transcranial alternating current stimulation with concurrent EEG and fNIRS measurement. Health Inf Sci Syst 2023; 11:35. [PMID: 37545487 PMCID: PMC10397167 DOI: 10.1007/s13755-023-00233-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 07/11/2023] [Indexed: 08/08/2023] Open
Abstract
Transcranial alternating current stimulation (tACS) exhibits the capability to interact with endogenous brain oscillations using an external low-intensity sinusoidal current and influences cerebral function. Despite its potential benefits, the physiological mechanisms and effectiveness of tACS are currently a subject of debate and disagreement. The aims of our study are to (i) evaluate the neurological and behavioral impact of tACS by conducting repetitive sham-controlled experiments and (ii) propose criteria to evaluate effectiveness, which can serve as a benchmark to determine optimal individual-based tACS protocols. In this study, 15 healthy adults participated in the experiment over two visiting: sham and tACS (i.e., 5 Hz, 1 mA). During each visit, we used multimodal recordings of the participants' brain, including simultaneous electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), along with a working memory (WM) score to quantify neurological effects and cognitive changes immediately after each repetitive sham/tACS session. Our results indicate increased WM scores, hemodynamic response strength, and EEG power in theta and delta bands both during and after the tACS period. Additionally, the observed effects do not increase with prolonged stimulation time, as the effects plateau towards the end of the experiment. In conclusion, our proposed closed-loop scheme offers a promising advance for evaluating the effectiveness of tACS during the stimulation session. Specifically, the assessment criteria use participant-specific brain-based signals along with a behavioral output. Moreover, we propose a feedback efficacy score that can aid in determining the optimal stimulation duration based on a participant-specific brain state, thereby preventing the risk of overstimulation.
Collapse
Affiliation(s)
- Dalin Yang
- School of Mechanical Engineering, Pusan National University, Busan, 46241 Republic of Korea
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO 63100 USA
| | - Usman Ghafoor
- School of Mechanical Engineering, Pusan National University, Busan, 46241 Republic of Korea
| | - Adam Thomas Eggebrecht
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO 63100 USA
- Department of Biomedical Engineering, Washington University, St. Louis, MO 63130 USA
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, 46241 Republic of Korea
- Institute for Future, School of Automation, Qingdao University, Qingdao, 266071 Shandong China
| |
Collapse
|
9
|
Bonilauri A, Pirastru A, Sangiuliano Intra F, Isernia S, Cazzoli M, Blasi V, Baselli G, Baglio F. Surface-based integration approach for fNIRS-fMRI reliability assessment. J Neurosci Methods 2023; 398:109952. [PMID: 37625649 DOI: 10.1016/j.jneumeth.2023.109952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 06/16/2023] [Accepted: 08/19/2023] [Indexed: 08/27/2023]
Abstract
INTRODUCTION Studies integrating functional near-infrared spectroscopy (fNIRS) with functional MRI (fMRI) employ heterogeneous methods in defining common regions of interest in which similarities are assessed. Therefore, spatial agreement and temporal correlation may not be reproducible across studies. In the present work, we address this issue by proposing a novel method for integration and analysis of fNIRS and fMRI over the cortical surface. MATERIALS AND METHODS Eighteen healthy volunteers (age mean±SD 30.55 ± 4.7, 7 males) performed a motor task during non-simultaneous fMRI and fNIRS acquisitions. First, fNIRS and fMRI data were integrated by projecting subject- and group-level source maps over the cortical surface mesh to define anatomically constrained functional ROIs (acfROI). Next, spatial agreement and temporal correlation were quantified as Dice Coefficient (DC) and Pearson's correlation coefficient between fNIRS-fMRI in the acfROIs. RESULTS Subject-level results revealed moderate to substantial spatial agreement (DC range 0.43 - 0.64), confirmed at the group-level only for blood oxygenation level-dependent (BOLD) signal vs. HbO2 (0.44 - 0.69), while lack of agreement was found for BOLD vs. HbR in some instances (0.05 - 0.49). Subject-level temporal correlation was moderate to strong (0.79 - 0.85 for BOLD vs. HbO2 and -0.62 to -0.72 for BOLD vs. HbR), while an overall strong correlation was found for group-level results (0.95 - 0.98 for BOLD vs. HbO2 and -0.91 to -0.94 for BOLD vs. HbR). CONCLUSION The proposed method directly compares fNIRS and fMRI by projecting individual source maps to the cortical surface. Our results indicate spatial and temporal correspondence between fNIRS and fMRI, and promotes the use of fNIRS when more ecological acquision settings are required, such as longitudinal monitoring of brain activity before and after rehabilitation.
Collapse
Affiliation(s)
- Augusto Bonilauri
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; IRCCS Fondazione Don Carlo Gnocchi ONLUS, 20148 Milan, Italy
| | - Alice Pirastru
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy; IRCCS Fondazione Don Carlo Gnocchi ONLUS, 20148 Milan, Italy.
| | | | - Sara Isernia
- IRCCS Fondazione Don Carlo Gnocchi ONLUS, 20148 Milan, Italy
| | - Marta Cazzoli
- IRCCS Fondazione Don Carlo Gnocchi ONLUS, 20148 Milan, Italy
| | - Valeria Blasi
- IRCCS Fondazione Don Carlo Gnocchi ONLUS, 20148 Milan, Italy
| | - Giuseppe Baselli
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy
| | | |
Collapse
|
10
|
Lin CHP, Orukari I, Frisk LK, Verma M, Chetia S, Beslija F, Eggebrecht AT, Durduran T, Culver JP, Trobaugh JW. Anatomical Modeling and Optimization of Speckle Contrast Optical Tomography. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.06.556565. [PMID: 37732196 PMCID: PMC10508753 DOI: 10.1101/2023.09.06.556565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/22/2023]
Abstract
Traditional methods for mapping cerebral blood flow (CBF), such as positron emission tomography and magnetic resonance imaging, offer only isolated snapshots of CBF due to scanner logistics. Speckle contrast optical tomography (SCOT) is a promising optical technique for mapping CBF. However, while SCOT has been established in mice, the method has not yet been demonstrated in humans - partly due to a lack of anatomical reconstruction methods and uncertainty over the optimal design parameters. Herein we develop SCOT reconstruction methods that leverage MRI-based anatomical head models and finite-element modeling of the SCOT forward problem (NIRFASTer). We then simulate SCOT for CBF perturbations to evaluate sensitivity of imaging performance to exposure time and SD-distances. We find image resolution comparable to intensity-based diffuse optical tomography at superficial cortical tissue depth (~1.5 cm). Localization errors can be reduced by including longer SD-measurements. With longer exposure times speckle contrast decreases, however, noise decreases faster, resulting in a net increase in SNR. Specifically, extending exposure time from 10μs to 10ms increased SCOT SNR by 1000X. Overall, our modeling methods provide anatomically-based image reconstructions that can be used to evaluate a broad range of tissue conditions, measurement parameters, and noise sources and inform SCOT system design.
Collapse
Affiliation(s)
- Chen-Hao P. Lin
- Department of Physics, Washington University in St. Louis, St. Louis, MO, 63130, USA
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, 63110, USA
| | - Inema Orukari
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, 63110, USA
| | - Lisa Kobayashi Frisk
- ICFO - Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Manish Verma
- ICFO - Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Sumana Chetia
- ICFO - Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Faruk Beslija
- ICFO - Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Adam T. Eggebrecht
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, 63110, USA
| | - Turgut Durduran
- ICFO - Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
| | - Joseph P. Culver
- Department of Physics, Washington University in St. Louis, St. Louis, MO, 63130, USA
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, 63110, USA
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, MO, 63130, USA
| | - Jason W. Trobaugh
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, MO, 63130, USA
| |
Collapse
|
11
|
Frisk LK, Verma M, Bešlija F, Lin CHP, Patil N, Chetia S, Trobaugh J, Culver JP, Durduran T. A comprehensive workflow and its validation for simulating diffuse speckle statistics for optical blood flow measurements. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.03.551830. [PMID: 37577491 PMCID: PMC10418286 DOI: 10.1101/2023.08.03.551830] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/15/2023]
Abstract
Diffuse optical methods including speckle contrast optical spectroscopy and tomography (SCOS and SCOT), use speckle contrast (κ ) to measure deep blood flow. In order to design practical systems, parameters such as signal-to-noise ratio (SNR) and the effects of limited sampling of statistical quantities, should be considered. To that end, we have developed a method for simulating speckle contrast signals including effects of detector noise. The method was validated experimentally, and the simulations were used to study the effects of physical and experimental parameters on the accuracy and precision of κ . These results revealed that systematic detector effects resulted in decreased accuracy and precision of κ in the regime of low detected signals. The method can provide guidelines for the design and usage of SCOS and/or SCOT instruments.
Collapse
Affiliation(s)
- Lisa Kobayashi Frisk
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Manish Verma
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Faruk Bešlija
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Chen-Hao P. Lin
- Department of Physics, Washington University in St. Louis, St. Louis, Missouri 63110, USA
- Department of Radiology, Washington University School of Medicine, St. Louis, Missouri 63110, USA
| | - Nishighanda Patil
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Sumana Chetia
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
| | - Jason Trobaugh
- Department of Electrical and Systems Engineering, Washington University School of Medicine, St. Louis, Missouri 63110, USA
| | - Joseph P. Culver
- Department of Physics, Washington University in St. Louis, St. Louis, Missouri 63110, USA
- Department of Radiology, Washington University School of Medicine, St. Louis, Missouri 63110, USA
| | - Turgut Durduran
- ICFO-Institut de Ciències Fotòniques, The Barcelona Institute of Science and Technology, Castelldefels (Barcelona), Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
| |
Collapse
|
12
|
Schroeder ML, Sherafati A, Ulbrich RL, Wheelock MD, Svoboda AM, Klein ED, George TG, Tripathy K, Culver JP, Eggebrecht AT. Mapping cortical activations underlying covert and overt language production using high-density diffuse optical tomography. Neuroimage 2023; 276:120190. [PMID: 37245559 PMCID: PMC10760405 DOI: 10.1016/j.neuroimage.2023.120190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 05/05/2023] [Accepted: 05/23/2023] [Indexed: 05/30/2023] Open
Abstract
Gold standard neuroimaging modalities such as functional magnetic resonance imaging (fMRI), positron emission tomography (PET), and more recently electrocorticography (ECoG) have provided profound insights regarding the neural mechanisms underlying the processing of language, but they are limited in applications involving naturalistic language production especially in developing brains, during face-to-face dialogues, or as a brain-computer interface. High-density diffuse optical tomography (HD-DOT) provides high-fidelity mapping of human brain function with comparable spatial resolution to that of fMRI but in a silent and open scanning environment similar to real-life social scenarios. Therefore, HD-DOT has potential to be used in naturalistic settings where other neuroimaging modalities are limited. While HD-DOT has been previously validated against fMRI for mapping the neural correlates underlying language comprehension and covert (i.e., "silent") language production, HD-DOT has not yet been established for mapping the cortical responses to overt (i.e., "out loud") language production. In this study, we assessed the brain regions supporting a simple hierarchy of language tasks: silent reading of single words, covert production of verbs, and overt production of verbs in normal hearing right-handed native English speakers (n = 33). First, we found that HD-DOT brain mapping is resilient to movement associated with overt speaking. Second, we observed that HD-DOT is sensitive to key activations and deactivations in brain function underlying the perception and naturalistic production of language. Specifically, statistically significant results were observed that show recruitment of regions in occipital, temporal, motor, and prefrontal cortices across all three tasks after performing stringent cluster-extent based thresholding. Our findings lay the foundation for future HD-DOT studies of imaging naturalistic language comprehension and production during real-life social interactions and for broader applications such as presurgical language assessment and brain-machine interfaces.
Collapse
Affiliation(s)
- Mariel L Schroeder
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA; Department of Speech, Language, and Hearing Sciences, Purdue University, West Lafayette, IN, USA
| | - Arefeh Sherafati
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA; Department of Neurology, University of California, San Francisco, San Francisco, CA, USA
| | - Rachel L Ulbrich
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA; University of Missouri School of Medicine, Columbia, MO, USA
| | - Muriah D Wheelock
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA
| | - Alexandra M Svoboda
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA; University of Cincinnati Medical Center, Cincinnati, Oh, USA
| | - Emma D Klein
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA; Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Tessa G George
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA
| | - Kalyan Tripathy
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA; Washington University School of Medicine, St Louis, MO, USA
| | - Joseph P Culver
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA; Division of Biology & Biomedical Sciences, Washington University School of Medicine, St Louis, MO, USA; Department of Physics, Washington University in St. Louis, St Louis, MO, USA; Department of Biomedical Engineering, Washington University in St. Louis, St Louis, MO, USA
| | - Adam T Eggebrecht
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, USA; Division of Biology & Biomedical Sciences, Washington University School of Medicine, St Louis, MO, USA; Department of Biomedical Engineering, Washington University in St. Louis, St Louis, MO, USA.
| |
Collapse
|
13
|
Markow ZE, Trobaugh JW, Richter EJ, Tripathy K, Rafferty SM, Svoboda AM, Schroeder ML, Burns-Yocum TM, Bergonzi KM, Chevillet MA, Mugler EM, Eggebrecht AT, Culver JP. Ultra-high density imaging arrays for diffuse optical tomography of human brain improve resolution, signal-to-noise, and information decoding. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.21.549920. [PMID: 37547013 PMCID: PMC10401969 DOI: 10.1101/2023.07.21.549920] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/08/2023]
Abstract
Functional magnetic resonance imaging (fMRI) has dramatically advanced non-invasive human brain mapping and decoding. Functional near-infrared spectroscopy (fNIRS) and high-density diffuse optical tomography (HD-DOT) non-invasively measure blood oxygen fluctuations related to brain activity, like fMRI, at the brain surface, using more-lightweight equipment that circumvents ergonomic and logistical limitations of fMRI. HD-DOT grids have smaller inter-optode spacing (∼13 mm) than sparse fNIRS (∼30 mm) and therefore provide higher image quality, with spatial resolution ∼1/2 that of fMRI. Herein, simulations indicated reducing inter-optode spacing to 6.5 mm would further improve image quality and noise-resolution tradeoff, with diminishing returns below 6.5 mm. We then constructed an ultra-high-density DOT system (6.5-mm spacing) with 140 dB dynamic range that imaged stimulus-evoked activations with 30-50% higher spatial resolution and repeatable multi-focal activity with excellent agreement with participant-matched fMRI. Further, this system decoded visual stimulus position with 19-35% lower error than previous HD-DOT, throughout occipital cortex.
Collapse
|
14
|
Cao J, Bulger E, Shinn-Cunningham B, Grover P, Kainerstorfer JM. Diffuse Optical Tomography Spatial Prior for EEG Source Localization in Human Visual Cortex. Neuroimage 2023:120210. [PMID: 37311535 DOI: 10.1016/j.neuroimage.2023.120210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 05/30/2023] [Indexed: 06/15/2023] Open
Abstract
Electroencephalography (EEG) and diffuse optical tomography (DOT) are imaging methods which are widely used for neuroimaging. While the temporal resolution of EEG is high, the spatial resolution is typically limited. DOT, on the other hand, has high spatial resolution, but the temporal resolution is inherently limited by the slow hemodynamics it measures. In our previous work, we showed using computer simulations that when using the results of DOT reconstruction as the spatial prior for EEG source reconstruction, high spatio-temporal resolution could be achieved. In this work, we experimentally validate the algorithm by alternatingly flashing two visual stimuli at a speed that is faster than the temporal resolution of DOT. We show that the joint reconstruction using both EEG and DOT clearly resolves the two stimuli temporally, and the spatial confinement is drastically improved in comparison to reconstruction using EEG alone.
Collapse
Affiliation(s)
- Jiaming Cao
- Department of Biomedical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States
| | - Eli Bulger
- Department of Biomedical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States
| | - Barbara Shinn-Cunningham
- Department of Biomedical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States; Department of Electrical and Computer Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States; Neuroscience Institute, Carnegie Mellon University, 4400 Fifth Avenue, Pittsburgh, 15213, Pennsylvania, United States; Department of Psychology, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States
| | - Pulkit Grover
- Department of Biomedical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States; Department of Electrical and Computer Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States; Neuroscience Institute, Carnegie Mellon University, 4400 Fifth Avenue, Pittsburgh, 15213, Pennsylvania, United States
| | - Jana M Kainerstorfer
- Department of Biomedical Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States; Department of Electrical and Computer Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, 15213, Pennsylvania, United States; Neuroscience Institute, Carnegie Mellon University, 4400 Fifth Avenue, Pittsburgh, 15213, Pennsylvania, United States.
| |
Collapse
|
15
|
Anaya D, Batra G, Bracewell P, Catoen R, Chakraborty D, Chevillet M, Damodara P, Dominguez A, Emms L, Jiang Z, Kim E, Klumb K, Lau F, Le R, Li J, Mateo B, Matloff L, Mehta A, Mugler EM, Murthy A, Nakagome S, Orendorff R, Saung EF, Schwarz R, Sethi R, Sevile R, Srivastava A, Sundberg J, Yang Y, Yin A. Scalable, modular continuous wave functional near-infrared spectroscopy system (Spotlight). JOURNAL OF BIOMEDICAL OPTICS 2023; 28:065003. [PMID: 37325190 PMCID: PMC10261976 DOI: 10.1117/1.jbo.28.6.065003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 04/26/2023] [Accepted: 05/01/2023] [Indexed: 06/17/2023]
Abstract
Significance We present a fiberless, portable, and modular continuous wave-functional near-infrared spectroscopy system, Spotlight, consisting of multiple palm-sized modules-each containing high-density light-emitting diode and silicon photomultiplier detector arrays embedded in a flexible membrane that facilitates optode coupling to scalp curvature. Aim Spotlight's goal is to be a more portable, accessible, and powerful functional near-infrared spectroscopy (fNIRS) device for neuroscience and brain-computer interface (BCI) applications. We hope that the Spotlight designs we share here can spur more advances in fNIRS technology and better enable future non-invasive neuroscience and BCI research. Approach We report sensor characteristics in system validation on phantoms and motor cortical hemodynamic responses in a human finger-tapping experiment, where subjects wore custom 3D-printed caps with two sensor modules. Results The task conditions can be decoded offline with a median accuracy of 69.6%, reaching 94.7% for the best subject, and at a comparable accuracy in real time for a subset of subjects. We quantified how well the custom caps fitted to each subject and observed that better fit leads to more observed task-dependent hemodynamic response and better decoding accuracy. Conclusions The advances presented here should serve to make fNIRS more accessible for BCI applications.
Collapse
Affiliation(s)
- Daniel Anaya
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Gautam Batra
- Meta Platforms, Inc., Menlo Park, California, United States
| | | | - Ryan Catoen
- Meta Platforms, Inc., Menlo Park, California, United States
| | | | - Mark Chevillet
- Meta Platforms, Inc., Menlo Park, California, United States
| | | | | | - Laurence Emms
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Zifan Jiang
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Ealgoo Kim
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Keith Klumb
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Frances Lau
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Rosemary Le
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Jamie Li
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Brett Mateo
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Laura Matloff
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Asha Mehta
- Meta Platforms, Inc., Menlo Park, California, United States
| | | | - Akansh Murthy
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Sho Nakagome
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Ryan Orendorff
- Meta Platforms, Inc., Menlo Park, California, United States
| | - E-Fann Saung
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Roland Schwarz
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Ruben Sethi
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Rudy Sevile
- Meta Platforms, Inc., Menlo Park, California, United States
| | | | - John Sundberg
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Ying Yang
- Meta Platforms, Inc., Menlo Park, California, United States
| | - Allen Yin
- Meta Platforms, Inc., Menlo Park, California, United States
| |
Collapse
|
16
|
Tang J, LeBel A, Jain S, Huth AG. Semantic reconstruction of continuous language from non-invasive brain recordings. Nat Neurosci 2023; 26:858-866. [PMID: 37127759 PMCID: PMC11304553 DOI: 10.1038/s41593-023-01304-9] [Citation(s) in RCA: 44] [Impact Index Per Article: 44.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 03/15/2023] [Indexed: 05/03/2023]
Abstract
A brain-computer interface that decodes continuous language from non-invasive recordings would have many scientific and practical applications. Currently, however, non-invasive language decoders can only identify stimuli from among a small set of words or phrases. Here we introduce a non-invasive decoder that reconstructs continuous language from cortical semantic representations recorded using functional magnetic resonance imaging (fMRI). Given novel brain recordings, this decoder generates intelligible word sequences that recover the meaning of perceived speech, imagined speech and even silent videos, demonstrating that a single decoder can be applied to a range of tasks. We tested the decoder across cortex and found that continuous language can be separately decoded from multiple regions. As brain-computer interfaces should respect mental privacy, we tested whether successful decoding requires subject cooperation and found that subject cooperation is required both to train and to apply the decoder. Our findings demonstrate the viability of non-invasive language brain-computer interfaces.
Collapse
Affiliation(s)
- Jerry Tang
- Department of Computer Science, The University of Texas at Austin, Austin, TX, USA
| | - Amanda LeBel
- Department of Neuroscience, The University of Texas at Austin, Austin, TX, USA
| | - Shailee Jain
- Department of Computer Science, The University of Texas at Austin, Austin, TX, USA
| | - Alexander G Huth
- Department of Computer Science, The University of Texas at Austin, Austin, TX, USA.
- Department of Neuroscience, The University of Texas at Austin, Austin, TX, USA.
| |
Collapse
|
17
|
Hirsch J, Zhang X, Noah JA, Bhattacharya A. Neural mechanisms for emotional contagion and spontaneous mimicry of live facial expressions. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210472. [PMID: 36871593 PMCID: PMC9985973 DOI: 10.1098/rstb.2021.0472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Accepted: 01/16/2023] [Indexed: 03/07/2023] Open
Abstract
Viewing a live facial expression typically elicits a similar expression by the observer (facial mimicry) that is associated with a concordant emotional experience (emotional contagion). The model of embodied emotion proposes that emotional contagion and facial mimicry are functionally linked although the neural underpinnings are not known. To address this knowledge gap, we employed a live two-person paradigm (n = 20 dyads) using functional near-infrared spectroscopy during live emotive face-processing while also measuring eye-tracking, facial classifications and ratings of emotion. One dyadic partner, 'Movie Watcher', was instructed to emote natural facial expressions while viewing evocative short movie clips. The other dyadic partner, 'Face Watcher', viewed the Movie Watcher's face. Task and rest blocks were implemented by timed epochs of clear and opaque glass that separated partners. Dyadic roles were alternated during the experiment. Mean cross-partner correlations of facial expressions (r = 0.36 ± 0.11 s.e.m.) and mean cross-partner affect ratings (r = 0.67 ± 0.04) were consistent with facial mimicry and emotional contagion, respectively. Neural correlates of emotional contagion based on covariates of partner affect ratings included angular and supramarginal gyri, whereas neural correlates of the live facial action units included motor cortex and ventral face-processing areas. Findings suggest distinct neural components for facial mimicry and emotional contagion. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.
Collapse
Affiliation(s)
- Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
- Department of Neuroscience, Yale School of Medicine, New Haven, CT 06511, USA
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT 06511, USA
- Wu Tsai Institute, Yale University, PO Box 208091, New Haven, CT 06520, USA
- Haskins Laboratories, 300 George Street, New Haven, CT 06511, USA
- Department of Medical Physics and Biomedical Engineering, University College London, London WC1E 6BT, UK
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | | |
Collapse
|
18
|
Gallagher A, Wallois F, Obrig H. Functional near-infrared spectroscopy in pediatric clinical research: Different pathophysiologies and promising clinical applications. NEUROPHOTONICS 2023; 10:023517. [PMID: 36873247 PMCID: PMC9982436 DOI: 10.1117/1.nph.10.2.023517] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
Over its 30 years of existence, functional near-infrared spectroscopy (fNIRS) has matured into a highly versatile tool to study brain function in infants and young children. Its advantages, amongst others, include its ease of application and portability, the option to combine it with electrophysiology, and its relatively good tolerance to movement. As shown by the impressive body of fNIRS literature in the field of cognitive developmental neuroscience, the method's strengths become even more relevant for (very) young individuals who suffer from neurological, behavioral, and/or cognitive impairment. Although a number of studies have been conducted with a clinical perspective, fNIRS cannot yet be considered as a truly clinical tool. The first step has been taken in this direction by studies exploring options in populations with well-defined clinical profiles. To foster further progress, here, we review several of these clinical approaches to identify the challenges and perspectives of fNIRS in the field of developmental disorders. We first outline the contributions of fNIRS in selected areas of pediatric clinical research: epilepsy, communicative and language disorders, and attention-deficit/hyperactivity disorder. We provide a scoping review as a framework to allow the highlighting of specific and general challenges of using fNIRS in pediatric research. We also discuss potential solutions and perspectives on the broader use of fNIRS in the clinical setting. This may be of use to future research, targeting clinical applications of fNIRS in children and adolescents.
Collapse
Affiliation(s)
- Anne Gallagher
- CHU Sainte-Justine University Hospital, Université de Montréal, LIONLab, Cerebrum, Department of Psychology, Montréal, Quebec, Canada
| | - Fabrice Wallois
- Université de Picardie Jules Verne, Inserm U1105, GRAMFC, Amiens, France
| | - Hellmuth Obrig
- University Hospital and Faculty of Medicine Leipzig/Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neurology, Clinic for Cognitive Neurology, Leipzig, Germany
| |
Collapse
|
19
|
Dale R, O'sullivan TD, Howard S, Orihuela-Espina F, Dehghani H. System Derived Spatial-Temporal CNN for High-Density fNIRS BCI. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2023; 4:85-95. [PMID: 37228451 PMCID: PMC10204936 DOI: 10.1109/ojemb.2023.3248492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 02/08/2023] [Accepted: 02/20/2023] [Indexed: 09/30/2023] Open
Abstract
An intuitive and generalisable approach to spatial-temporal feature extraction for high-density (HD) functional Near-Infrared Spectroscopy (fNIRS) brain-computer interface (BCI) is proposed, demonstrated here using Frequency-Domain (FD) fNIRS for motor-task classification. Enabled by the HD probe design, layered topographical maps of Oxy/deOxy Haemoglobin changes are used to train a 3D convolutional neural network (CNN), enabling simultaneous extraction of spatial and temporal features. The proposed spatial-temporal CNN is shown to effectively exploit the spatial relationships in HD fNIRS measurements to improve the classification of the functional haemodynamic response, achieving an average F1 score of 0.69 across seven subjects in a mixed subjects training scheme, and improving subject-independent classification as compared to a standard temporal CNN.
Collapse
Affiliation(s)
- Robin Dale
- University of BirminghamB152TTBirminghamU.K.
| | | | | | | | | |
Collapse
|
20
|
Bonilauri A, Sangiuliano Intra F, Baglio F, Baselli G. Impact of Anatomical Variability on Sensitivity Profile in fNIRS-MRI Integration. SENSORS (BASEL, SWITZERLAND) 2023; 23:2089. [PMID: 36850685 PMCID: PMC9962997 DOI: 10.3390/s23042089] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 02/06/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
Functional near-infrared spectroscopy (fNIRS) is an important non-invasive technique used to monitor cortical activity. However, a varying sensitivity of surface channels vs. cortical structures may suggest integrating the fNIRS with the subject-specific anatomy (SSA) obtained from routine MRI. Actual processing tools permit the computation of the SSA forward problem (i.e., cortex to channel sensitivity) and next, a regularized solution of the inverse problem to map the fNIRS signals onto the cortex. The focus of this study is on the analysis of the forward problem to quantify the effect of inter-subject variability. Thirteen young adults (six males, seven females, age 29.3 ± 4.3) underwent both an MRI scan and a motor grasping task with a continuous wave fNIRS system of 102 measurement channels with optodes placed according to a 10/5 system. The fNIRS sensitivity profile was estimated using Monte Carlo simulations on each SSA and on three major atlases (i.e., Colin27, ICBM152 and FSAverage) for comparison. In each SSA, the average sensitivity curves were obtained by aligning the 102 channels and segmenting them by depth quartiles. The first quartile (depth < 11.8 (0.7) mm, median (IQR)) covered 0.391 (0.087)% of the total sensitivity profile, while the second one (depth < 13.6 (0.7) mm) covered 0.292 (0.009)%, hence indicating that about 70% of the signal was from the gyri. The sensitivity bell-shape was broad in the source-detector direction (20.953 (5.379) mm FWHM, first depth quartile) and steeper in the transversal one (6.082 (2.086) mm). The sensitivity of channels vs. different cortical areas based on SSA were analyzed finding high dispersions among subjects and large differences with atlas-based evaluations. Moreover, the inverse cortical mapping for the grasping task showed differences between SSA and atlas based solutions. In conclusion, integration with MRI SSA can significantly improve fNIRS interpretation.
Collapse
Affiliation(s)
- Augusto Bonilauri
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy
| | | | - Francesca Baglio
- IRCCS Fondazione Don Carlo Gnocchi ONLUS, CADITER, 20148 Milan, Italy
| | - Giuseppe Baselli
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy
| |
Collapse
|
21
|
Parker TC, Zhang X, Noah JA, Tiede M, Scassellati B, Kelley M, McPartland JC, Hirsch J. Neural and visual processing of social gaze cueing in typical and ASD adults. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.01.30.23284243. [PMID: 36778502 PMCID: PMC9915835 DOI: 10.1101/2023.01.30.23284243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Atypical eye gaze in joint attention is a clinical characteristic of autism spectrum disorder (ASD). Despite this documented symptom, neural processing of joint attention tasks in real-life social interactions is not understood. To address this knowledge gap, functional-near infrared spectroscopy (fNIRS) and eye-tracking data were acquired simultaneously as ASD and typically developed (TD) individuals engaged in a gaze-directed joint attention task with a live human and robot partner. We test the hypothesis that face processing deficits in ASD are greater for interactive faces than for simulated (robot) faces. Consistent with prior findings, neural responses during human gaze cueing modulated by face visual dwell time resulted in increased activity of ventral frontal regions in ASD and dorsal parietal systems in TD participants. Hypoactivity of the right dorsal parietal area during live human gaze cueing was correlated with autism spectrum symptom severity: Brief Observations of Symptoms of Autism (BOSA) scores (r = âˆ'0.86). Contrarily, neural activity in response to robot gaze cueing modulated by visual acquisition factors activated dorsal parietal systems in ASD, and this neural activity was not related to autism symptom severity (r = 0.06). These results are consistent with the hypothesis that altered encoding of incoming facial information to the dorsal parietal cortex is specific to live human faces in ASD. These findings open new directions for understanding joint attention difficulties in ASD by providing a connection between superior parietal lobule activity and live interaction with human faces. Lay Summary Little is known about why it is so difficult for autistic individuals to make eye contact with other people. We find that in a live face-to-face viewing task with a robot, the brains of autistic participants were similar to typical participants but not when the partner was a live human. Findings suggest that difficulties in real-life social situations for autistic individuals may be specific to difficulties with live social interaction rather than general face gaze.
Collapse
|
22
|
Scholkmann F, Vollenweider FX. Psychedelics and fNIRS neuroimaging: exploring new opportunities. NEUROPHOTONICS 2023; 10:013506. [PMID: 36474478 PMCID: PMC9717437 DOI: 10.1117/1.nph.10.1.013506] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 11/14/2022] [Indexed: 06/17/2023]
Abstract
In this Outlook paper, we explain to the optical neuroimaging community as well as the psychedelic research community the great potential of using optical neuroimaging with functional near-infrared spectroscopy (fNIRS) to further explore the changes in brain activity induced by psychedelics. We explain why we believe now is the time to exploit the momentum of the current resurgence of research on the effects of psychedelics and the momentum of the increasing progress and popularity of the fNIRS technique to establish fNIRS in psychedelic research. With this article, we hope to contribute to this development.
Collapse
Affiliation(s)
- Felix Scholkmann
- University Hospital Zurich, University of Zurich, Biomedical Optics Research Laboratory, Department of Neonatology, Zurich, Switzerland
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
| | - Franz X. Vollenweider
- University Hospital of Psychiatry, University of Zurich, Neuropsychopharmacology and Brain Imaging, Department of Psychiatry, Psychotherapy and Psychosomatics, Zurich, Switzerland
| |
Collapse
|
23
|
Blaney G, Fernandez C, Sassaroli A, Fantini S. Dual-slope imaging of cerebral hemodynamics with frequency-domain near-infrared spectroscopy. NEUROPHOTONICS 2023; 10:013508. [PMID: 36601543 PMCID: PMC9807277 DOI: 10.1117/1.nph.10.1.013508] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 12/08/2022] [Indexed: 06/17/2023]
Abstract
Significance This work targets the contamination of optical signals by superficial hemodynamics, which is one of the chief hurdles in non-invasive optical measurements of the human brain. Aim To identify optimal source-detector distances for dual-slope (DS) measurements in frequency-domain (FD) near-infrared spectroscopy (NIRS) and demonstrate preferential sensitivity of DS imaging to deeper tissue (brain) versus superficial tissue (scalp). Approach Theoretical studies (in-silico) based on diffusion theory in two-layered and in homogeneous scattering media. In-vivo demonstrations of DS imaging of the human brain during visual stimulation and during systemic blood pressure oscillations. Results The mean distance (between the two source-detector distances needed for DS) is the key factor for depth sensitivity. In-vivo imaging of the human occipital lobe with FD NIRS and a mean distance of 31 mm indicated: (1) greater hemodynamic response to visual stimulation from FD phase versus intensity, and from DS versus single-distance (SD); (2) hemodynamics from FD phase and DS mainly driven by blood flow, and hemodynamics from SD intensity mainly driven by blood volume. Conclusions DS imaging with FD NIRS may suppress confounding contributions from superficial hemodynamics without relying on data at short source-detector distances. This capability can have significant implications for non-invasive optical measurements of the human brain.
Collapse
Affiliation(s)
- Giles Blaney
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - Cristianne Fernandez
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - Angelo Sassaroli
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - Sergio Fantini
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| |
Collapse
|
24
|
Li R, Hosseini H, Saggar M, Balters SC, Reiss AL. Current opinions on the present and future use of functional near-infrared spectroscopy in psychiatry. NEUROPHOTONICS 2023; 10:013505. [PMID: 36777700 PMCID: PMC9904322 DOI: 10.1117/1.nph.10.1.013505] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Accepted: 01/13/2023] [Indexed: 05/19/2023]
Abstract
Functional near-infrared spectroscopy (fNIRS) is an optical imaging technique for assessing human brain activity by noninvasively measuring the fluctuation of cerebral oxygenated- and deoxygenated-hemoglobin concentrations associated with neuronal activity. Owing to its superior mobility, low cost, and good tolerance for motion, the past few decades have witnessed a rapid increase in the research and clinical use of fNIRS in a variety of psychiatric disorders. In this perspective article, we first briefly summarize the state-of-the-art concerning fNIRS research in psychiatry. In particular, we highlight the diverse applications of fNIRS in psychiatric research, the advanced development of fNIRS instruments, and novel fNIRS study designs for exploring brain activity associated with psychiatric disorders. We then discuss some of the open challenges and share our perspectives on the future of fNIRS in psychiatric research and clinical practice. We conclude that fNIRS holds promise for becoming a useful tool in clinical psychiatric settings with respect to developing closed-loop systems and improving individualized treatments and diagnostics.
Collapse
Affiliation(s)
- Rihui Li
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Hadi Hosseini
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Manish Saggar
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Stephanie Christina Balters
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
| | - Allan L. Reiss
- Stanford University, Center for Interdisciplinary Brain Sciences Research, Department of Psychiatry and Behavioral Sciences, Stanford, California, United States
- Stanford University, Department of Radiology and Pediatrics, Stanford, California, United States
- Stanford University, Department of Pediatrics, Stanford, California, United States
- Address all correspondence to Allan L. Reiss,
| |
Collapse
|
25
|
Hirsch J, Zhang X, Noah JA, Dravida S, Naples A, Tiede M, Wolf JM, McPartland JC. Neural correlates of eye contact and social function in autism spectrum disorder. PLoS One 2022; 17:e0265798. [PMID: 36350848 PMCID: PMC9645655 DOI: 10.1371/journal.pone.0265798] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 10/06/2022] [Indexed: 11/11/2022] Open
Abstract
Reluctance to make eye contact during natural interactions is a central diagnostic criterion for autism spectrum disorder (ASD). However, the underlying neural correlates for eye contacts in ASD are unknown, and diagnostic biomarkers are active areas of investigation. Here, neuroimaging, eye-tracking, and pupillometry data were acquired simultaneously using two-person functional near-infrared spectroscopy (fNIRS) during live "in-person" eye-to-eye contact and eye-gaze at a video face for typically-developed (TD) and participants with ASD to identify the neural correlates of live eye-to-eye contact in both groups. Comparisons between ASD and TD showed decreased right dorsal-parietal activity and increased right ventral temporal-parietal activity for ASD during live eye-to-eye contact (p≤0.05, FDR-corrected) and reduced cross-brain coherence consistent with atypical neural systems for live eye contact. Hypoactivity of right dorsal-parietal regions during eye contact in ASD was further associated with gold standard measures of social performance by the correlation of neural responses and individual measures of: ADOS-2, Autism Diagnostic Observation Schedule, 2nd Edition (r = -0.76, -0.92 and -0.77); and SRS-2, Social Responsiveness Scale, Second Edition (r = -0.58). The findings indicate that as categorized social ability decreases, neural responses to real eye-contact in the right dorsal parietal region also decrease consistent with a neural correlate for social characteristics in ASD.
Collapse
Affiliation(s)
- Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States of America
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, United States of America
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, United States of America
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
- Haskins Laboratories, New Haven, CT, United States of America
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
| | - Swethasri Dravida
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States of America
| | - Adam Naples
- Yale Child Study Center, New Haven, CT, United States of America
| | - Mark Tiede
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Haskins Laboratories, New Haven, CT, United States of America
| | - Julie M. Wolf
- Yale Child Study Center, New Haven, CT, United States of America
| | | |
Collapse
|
26
|
Cai Z, Pellegrino G, Lina J, Benali H, Grova C. Hierarchical Bayesian modeling of the relationship between task-related hemodynamic responses and cortical excitability. Hum Brain Mapp 2022; 44:876-900. [PMID: 36250709 PMCID: PMC9875942 DOI: 10.1002/hbm.26107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Revised: 09/10/2022] [Accepted: 09/18/2022] [Indexed: 01/28/2023] Open
Abstract
Investigating the relationship between task-related hemodynamic responses and cortical excitability is challenging because it requires simultaneous measurement of hemodynamic responses while applying noninvasive brain stimulation. Moreover, cortical excitability and task-related hemodynamic responses are both associated with inter-/intra-subject variability. To reliably assess such a relationship, we applied hierarchical Bayesian modeling. This study involved 16 healthy subjects who underwent simultaneous Paired Associative Stimulation (PAS10, PAS25, Sham) while monitoring brain activity using functional Near-Infrared Spectroscopy (fNIRS), targeting the primary motor cortex (M1). Cortical excitability was measured by Motor Evoked Potentials (MEPs), and the motor task-related hemodynamic responses were measured using fNIRS 3D reconstructions. We constructed three models to investigate: (1) PAS effects on the M1 excitability, (2) PAS effects on fNIRS hemodynamic responses to a finger tapping task, and (3) the correlation between PAS effects on M1 excitability and PAS effects on task-related hemodynamic responses. Significant increase in cortical excitability was found following PAS25, whereas a small reduction of the cortical excitability was shown after PAS10 and a subtle increase occurred after sham. Both HbO and HbR absolute amplitudes increased after PAS25 and decreased after PAS10. The probability of the positive correlation between modulation of cortical excitability and hemodynamic activity was 0.77 for HbO and 0.79 for HbR. We demonstrated that PAS stimulation modulates task-related cortical hemodynamic responses in addition to M1 excitability. Moreover, the positive correlation between PAS modulations of excitability and hemodynamics brought insight into understanding the fundamental properties of cortical function and cortical excitability.
Collapse
Affiliation(s)
- Zhengchen Cai
- Multimodal Functional Imaging Lab, Department of PhysicsConcordia UniversityMontréalQuébecCanada,PERFORM CentreConcordia UniversityMontréalQuébecCanada
| | - Giovanni Pellegrino
- Epilepsy Program, Schulich School of Medicine and DentistryWestern UniversityLondonOntarioCanada,Multimodal Functional Imaging Lab, Biomedical Engineering DepartmentMcGill UniversityMontréalQuébecCanada
| | - Jean‐Marc Lina
- Département de Génie ElectriqueÉcole de Technologie SupérieureMontréalQuébecCanada,Centre De Recherches En MathématiquesMontréalQuébecCanada
| | - Habib Benali
- PERFORM CentreConcordia UniversityMontréalQuébecCanada,Centre De Recherches En MathématiquesMontréalQuébecCanada,Electrical and Computer Engineering Department, Concordia UniversityMontréalCanada
| | - Christophe Grova
- Multimodal Functional Imaging Lab, Department of PhysicsConcordia UniversityMontréalQuébecCanada,PERFORM CentreConcordia UniversityMontréalQuébecCanada,Multimodal Functional Imaging Lab, Biomedical Engineering DepartmentMcGill UniversityMontréalQuébecCanada,Centre De Recherches En MathématiquesMontréalQuébecCanada
| |
Collapse
|
27
|
Liu D, Zhang Y, Zhang P, Li T, Li Z, Zhang L, Gao F. Deep-learning informed Kalman filtering for priori-free and real-time hemodynamics extraction in functional near-infrared spectroscopy. BIOMEDICAL OPTICS EXPRESS 2022; 13:4787-4801. [PMID: 36187239 PMCID: PMC9484432 DOI: 10.1364/boe.467943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 08/04/2022] [Accepted: 08/05/2022] [Indexed: 06/16/2023]
Abstract
Separation of the physiological interferences and the neural hemodynamics has been a vitally important task in the realistic implementation of functional near-infrared spectroscopy (fNIRS). Although many efforts have been devoted, the established solutions to this issue additionally rely on priori information on the interferences and activation responses, such as time-frequency characteristics and spatial patterns, etc., also hindering the realization of real-time. To tackle the adversity, we herein propose a novel priori-free scheme for real-time physiological interference suppression. This method combines the robustness of deep-leaning-based interference characterization and adaptivity of Kalman filtering: a long short-term memory (LSTM) network is trained with the time-courses of the absorption perturbation baseline for interferences profiling, and successively, a Kalman filtering process is applied with reference to the noise prediction for real-time activation extraction. The proposed method is validated using both simulated dynamic data and in-vivo experiments, showing the comprehensively improved performance and promisingly appended superiority achieved in the purely data-driven way.
Collapse
Affiliation(s)
- Dongyuan Liu
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Yao Zhang
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Pengrui Zhang
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Tieni Li
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Zhiyong Li
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Limin Zhang
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| | - Feng Gao
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
- Tianjin Key laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, China
| |
Collapse
|
28
|
Burgess PW, Crum J, Pinti P, Aichelburg C, Oliver D, Lind F, Power S, Swingler E, Hakim U, Merla A, Gilbert S, Tachtsidis I, Hamilton A. Prefrontal cortical activation associated with prospective memory while walking around a real-world street environment. Neuroimage 2022; 258:119392. [PMID: 35714887 PMCID: PMC10509823 DOI: 10.1016/j.neuroimage.2022.119392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 05/24/2022] [Accepted: 06/13/2022] [Indexed: 10/18/2022] Open
Abstract
Rostral PFC (area 10) activation is common during prospective memory (PM) tasks. But it is not clear what mental processes these activations index. Three candidate explanations from cognitive neuroscience theory are: (i) monitoring of the environment; (ii) spontaneous intention retrieval; (iii) a combination of the two. These explanations make different predictions about the temporal and spatial patterns of activation that would be seen in rostral PFC in naturalistic settings. Accordingly, we plotted functional events in PFC using portable fNIRS while people were carrying out a PM task outside the lab and responding to cues when they were encountered, to decide between these explanations. Nineteen people were asked to walk around a street in London, U.K. and perform various tasks while also remembering to respond to prospective memory (PM) cues when they detected them. The prospective memory cues could be either social (involving greeting a person) or non-social (interacting with a parking meter) in nature. There were also a number of contrast conditions which allowed us to determine activation specifically related to the prospective memory components of the tasks. We found that maintaining both social and non-social intentions was associated with widespread activation within medial and right hemisphere rostral prefrontal cortex (BA 10), in agreement with numerous previous lab-based fMRI studies of prospective memory. In addition, increased activation was found within lateral prefrontal cortex (BA 45 and 46) when people were maintaining a social intention compared to a non-social one. The data were then subjected to a GLM-based method for automatic identification of functional events (AIDE), and the position of the participants at the time of the activation events were located on a map of the physical space. The results showed that the spatial and temporal distribution of these events was not random, but aggregated around areas in which the participants appeared to retrieve their future intentions (i.e., where they saw intentional cues), as well as where they executed them. Functional events were detected most frequently in BA 10 during the PM conditions compared to other regions and tasks. Mobile fNIRS can be used to measure higher cognitive functions of the prefrontal cortex in "real world" situations outside the laboratory in freely ambulant individuals. The addition of a "brain-first" approach to the data permits the experimenter to determine not only when haemodynamic changes occur, but also where the participant was when it happened. This can be extremely valuable when trying to link brain and cognition.
Collapse
Affiliation(s)
- Paul W Burgess
- Institute of Cognitive Neuroscience, University College London, UK.
| | - James Crum
- Institute of Cognitive Neuroscience, University College London, UK
| | - Paola Pinti
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| | | | - Dominic Oliver
- Institute of Cognitive Neuroscience, University College London, UK
| | - Frida Lind
- Institute of Cognitive Neuroscience, University College London, UK
| | - Sarah Power
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| | | | - Uzair Hakim
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| | - Arcangelo Merla
- Infrared Imaging Lab, Institute for Advanced Biomedical Technology (ITAB), Department of Neuroscience, Imaging and Clinical Sciences, University of Chieti-Pescara, Italy
| | - Sam Gilbert
- Institute of Cognitive Neuroscience, University College London, UK
| | - Ilias Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| | - Antonia Hamilton
- Institute of Cognitive Neuroscience, University College London, UK
| |
Collapse
|
29
|
Jackson ES, Dravida S, Zhang X, Noah JA, Gracco V, Hirsch J. Activation in Right Dorsolateral Prefrontal Cortex Underlies Stuttering Anticipation. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:469-494. [PMID: 37216062 PMCID: PMC10158639 DOI: 10.1162/nol_a_00073] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 05/16/2022] [Indexed: 05/24/2023]
Abstract
People who stutter learn to anticipate many of their overt stuttering events. Despite the critical role of anticipation, particularly how responses to anticipation shape stuttering behaviors, the neural bases associated with anticipation are unknown. We used a novel approach to identify anticipated and unanticipated words, which were produced by 22 adult stutterers in a delayed-response task while hemodynamic activity was measured using functional near infrared spectroscopy (fNIRS). Twenty-two control participants were included such that each individualized set of anticipated and unanticipated words was produced by one stutterer and one control participant. We conducted an analysis on the right dorsolateral prefrontal cortex (R-DLPFC) based on converging lines of evidence from the stuttering and cognitive control literatures. We also assessed connectivity between the R-DLPFC and right supramarginal gyrus (R-SMG), two key nodes of the frontoparietal network (FPN), to assess the role of cognitive control, and particularly error-likelihood monitoring, in stuttering anticipation. All analyses focused on the five-second anticipation phase preceding the go signal to produce speech. The results indicate that anticipated words are associated with elevated activation in the R-DLPFC, and that compared to non-stutterers, stutterers exhibit greater activity in the R-DLPFC, irrespective of anticipation. Further, anticipated words are associated with reduced connectivity between the R-DLPFC and R-SMG. These findings highlight the potential roles of the R-DLPFC and the greater FPN as a neural substrate of stuttering anticipation. The results also support previous accounts of error-likelihood monitoring and action-stopping in stuttering anticipation. Overall, this work offers numerous directions for future research with clinical implications for targeted neuromodulation.
Collapse
Affiliation(s)
- Eric S. Jackson
- Department of Communicative Sciences and Disorders, New York University, New York, USA
| | - Swethasri Dravida
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Xian Zhang
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - J. Adam Noah
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Vincent Gracco
- Haskins Laboratories, New Haven, CT, USA
- McGill University, Montreal, Canada
| | - Joy Hirsch
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Department of Neuroscience, Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, USA
- Department of Medical Physics and Biomedical Engineering, University College London, London, UK
| |
Collapse
|
30
|
Ayaz H, Baker WB, Blaney G, Boas DA, Bortfeld H, Brady K, Brake J, Brigadoi S, Buckley EM, Carp SA, Cooper RJ, Cowdrick KR, Culver JP, Dan I, Dehghani H, Devor A, Durduran T, Eggebrecht AT, Emberson LL, Fang Q, Fantini S, Franceschini MA, Fischer JB, Gervain J, Hirsch J, Hong KS, Horstmeyer R, Kainerstorfer JM, Ko TS, Licht DJ, Liebert A, Luke R, Lynch JM, Mesquida J, Mesquita RC, Naseer N, Novi SL, Orihuela-Espina F, O’Sullivan TD, Peterka DS, Pifferi A, Pollonini L, Sassaroli A, Sato JR, Scholkmann F, Spinelli L, Srinivasan VJ, St. Lawrence K, Tachtsidis I, Tong Y, Torricelli A, Urner T, Wabnitz H, Wolf M, Wolf U, Xu S, Yang C, Yodh AG, Yücel MA, Zhou W. Optical imaging and spectroscopy for the study of the human brain: status report. NEUROPHOTONICS 2022; 9:S24001. [PMID: 36052058 PMCID: PMC9424749 DOI: 10.1117/1.nph.9.s2.s24001] [Citation(s) in RCA: 47] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.
Collapse
Affiliation(s)
- Hasan Ayaz
- Drexel University, School of Biomedical Engineering, Science, and Health Systems, Philadelphia, Pennsylvania, United States
- Drexel University, College of Arts and Sciences, Department of Psychological and Brain Sciences, Philadelphia, Pennsylvania, United States
| | - Wesley B. Baker
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, United States
| | - Giles Blaney
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - David A. Boas
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Heather Bortfeld
- University of California, Merced, Departments of Psychological Sciences and Cognitive and Information Sciences, Merced, California, United States
| | - Kenneth Brady
- Lurie Children’s Hospital, Northwestern University Feinberg School of Medicine, Department of Anesthesiology, Chicago, Illinois, United States
| | - Joshua Brake
- Harvey Mudd College, Department of Engineering, Claremont, California, United States
| | - Sabrina Brigadoi
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
| | - Erin M. Buckley
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
- Emory University School of Medicine, Department of Pediatrics, Atlanta, Georgia, United States
| | - Stefan A. Carp
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Robert J. Cooper
- University College London, Department of Medical Physics and Bioengineering, DOT-HUB, London, United Kingdom
| | - Kyle R. Cowdrick
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Joseph P. Culver
- Washington University School of Medicine, Department of Radiology, St. Louis, Missouri, United States
| | - Ippeita Dan
- Chuo University, Faculty of Science and Engineering, Tokyo, Japan
| | - Hamid Dehghani
- University of Birmingham, School of Computer Science, Birmingham, United Kingdom
| | - Anna Devor
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Turgut Durduran
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
- Institució Catalana de Recerca I Estudis Avançats (ICREA), Barcelona, Spain
| | - Adam T. Eggebrecht
- Washington University in St. Louis, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States
| | - Lauren L. Emberson
- University of British Columbia, Department of Psychology, Vancouver, British Columbia, Canada
| | - Qianqian Fang
- Northeastern University, Department of Bioengineering, Boston, Massachusetts, United States
| | - Sergio Fantini
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - Maria Angela Franceschini
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Jonas B. Fischer
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Judit Gervain
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
- Université Paris Cité, CNRS, Integrative Neuroscience and Cognition Center, Paris, France
| | - Joy Hirsch
- Yale School of Medicine, Department of Psychiatry, Neuroscience, and Comparative Medicine, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Keum-Shik Hong
- Pusan National University, School of Mechanical Engineering, Busan, Republic of Korea
- Qingdao University, School of Automation, Institute for Future, Qingdao, China
| | - Roarke Horstmeyer
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
- Duke University, Department of Electrical and Computer Engineering, Durham, North Carolina, United States
- Duke University, Department of Physics, Durham, North Carolina, United States
| | - Jana M. Kainerstorfer
- Carnegie Mellon University, Department of Biomedical Engineering, Pittsburgh, Pennsylvania, United States
- Carnegie Mellon University, Neuroscience Institute, Pittsburgh, Pennsylvania, United States
| | - Tiffany S. Ko
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Daniel J. Licht
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
| | - Adam Liebert
- Polish Academy of Sciences, Nalecz Institute of Biocybernetics and Biomedical Engineering, Warsaw, Poland
| | - Robert Luke
- Macquarie University, Department of Linguistics, Sydney, New South Wales, Australia
- Macquarie University Hearing, Australia Hearing Hub, Sydney, New South Wales, Australia
| | - Jennifer M. Lynch
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Jaume Mesquida
- Parc Taulí Hospital Universitari, Critical Care Department, Sabadell, Spain
| | - Rickson C. Mesquita
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology, Campinas, São Paulo, Brazil
| | - Noman Naseer
- Air University, Department of Mechatronics and Biomedical Engineering, Islamabad, Pakistan
| | - Sergio L. Novi
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Western University, Department of Physiology and Pharmacology, London, Ontario, Canada
| | | | - Thomas D. O’Sullivan
- University of Notre Dame, Department of Electrical Engineering, Notre Dame, Indiana, United States
| | - Darcy S. Peterka
- Columbia University, Zuckerman Mind Brain Behaviour Institute, New York, United States
| | | | - Luca Pollonini
- University of Houston, Department of Engineering Technology, Houston, Texas, United States
| | - Angelo Sassaroli
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - João Ricardo Sato
- Federal University of ABC, Center of Mathematics, Computing and Cognition, São Bernardo do Campo, São Paulo, Brazil
| | - Felix Scholkmann
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Lorenzo Spinelli
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Vivek J. Srinivasan
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- NYU Langone Health, Department of Ophthalmology, New York, New York, United States
- NYU Langone Health, Department of Radiology, New York, New York, United States
| | - Keith St. Lawrence
- Lawson Health Research Institute, Imaging Program, London, Ontario, Canada
- Western University, Department of Medical Biophysics, London, Ontario, Canada
| | - Ilias Tachtsidis
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Yunjie Tong
- Purdue University, Weldon School of Biomedical Engineering, West Lafayette, Indiana, United States
| | - Alessandro Torricelli
- Politecnico di Milano, Dipartimento di Fisica, Milan, Italy
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Tara Urner
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Heidrun Wabnitz
- Physikalisch-Technische Bundesanstalt (PTB), Berlin, Germany
| | - Martin Wolf
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Ursula Wolf
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
| | - Shiqi Xu
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
| | - Changhuei Yang
- California Institute of Technology, Department of Electrical Engineering, Pasadena, California, United States
| | - Arjun G. Yodh
- University of Pennsylvania, Department of Physics and Astronomy, Philadelphia, Pennsylvania, United States
| | - Meryem A. Yücel
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Wenjun Zhou
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- China Jiliang University, College of Optical and Electronic Technology, Hangzhou, Zhejiang, China
| |
Collapse
|
31
|
Khan AF, Zhang F, Shou G, Yuan H, Ding L. Transient brain-wide coactivations and structured transitions revealed in hemodynamic imaging data. Neuroimage 2022; 260:119460. [PMID: 35868615 PMCID: PMC9472706 DOI: 10.1016/j.neuroimage.2022.119460] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 06/28/2022] [Accepted: 07/08/2022] [Indexed: 11/17/2022] Open
Abstract
Brain-wide patterns in resting human brains, as either structured functional connectivity (FC) or recurring brain states, have been widely studied in the neuroimaging literature. In particular, resting-state FCs estimated over windowed timeframe neuroimaging data from sub-minutes to minutes using correlation or blind source separation techniques have reported many brain-wide patterns of significant behavioral and disease correlates. The present pilot study utilized a novel whole-head cap-based high-density diffuse optical tomography (DOT) technology, together with data-driven analysis methods, to investigate recurring transient brain-wide patterns in spontaneous fluctuations of hemodynamic signals at the resolution of single timeframes from thirteen healthy adults in resting conditions. Our results report that a small number, i.e., six, of brain-wide coactivation patterns (CAPs) describe major spatiotemporal dynamics of spontaneous hemodynamic signals recorded by DOT. These CAPs represent recurring brain states, showing spatial topographies of hemispheric symmetry, and exhibit highly anticorrelated pairs. Moreover, a structured transition pattern among the six brain states is identified, where two CAPs with anterior-posterior spatial patterns are significantly involved in transitions among all brain states. Our results further elucidate two brain states of global positive and negative patterns, indicating transient neuronal coactivations and co-deactivations, respectively, over the entire cortex. We demonstrate that these two brain states are responsible for the generation of a subset of peaks and troughs in global signals (GS), supporting the recent reports on neuronal relevance of hemodynamic GS. Collectively, our results suggest that transient neuronal events (i.e., CAPs), global brain activity, and brain-wide structured transitions co-exist in humans and these phenomena are closely related, which extend the observations of similar neuronal events recently reported in animal hemodynamic data. Future studies on the quantitative relationship among these transient events and their relationships to windowed FCs along with larger sample size are needed to understand their changes with behaviors and diseased conditions.
Collapse
Affiliation(s)
- Ali Fahim Khan
- Stephenson School of Biomedical Engineering, University of Oklahoma, 110 W. Boyd St. DEH room 150, Norman, OK 73019, USA
| | - Fan Zhang
- Stephenson School of Biomedical Engineering, University of Oklahoma, 110 W. Boyd St. DEH room 150, Norman, OK 73019, USA
| | - Guofa Shou
- Stephenson School of Biomedical Engineering, University of Oklahoma, 110 W. Boyd St. DEH room 150, Norman, OK 73019, USA
| | - Han Yuan
- Stephenson School of Biomedical Engineering, University of Oklahoma, 110 W. Boyd St. DEH room 150, Norman, OK 73019, USA; Institute for Biomedical Engineering, Science, and Technology, University of Oklahoma, Norman, USA
| | - Lei Ding
- Stephenson School of Biomedical Engineering, University of Oklahoma, 110 W. Boyd St. DEH room 150, Norman, OK 73019, USA; Institute for Biomedical Engineering, Science, and Technology, University of Oklahoma, Norman, USA.
| |
Collapse
|
32
|
Crum J, Zhang X, Noah A, Hamilton A, Tachtsidis I, Burgess PW, Hirsch J. An Approach to Neuroimaging Interpersonal Interactions in Mental Health Interventions. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2022; 7:669-679. [PMID: 35144035 PMCID: PMC9271588 DOI: 10.1016/j.bpsc.2022.01.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Revised: 12/31/2021] [Accepted: 01/25/2022] [Indexed: 11/20/2022]
Abstract
BACKGROUND Conventional paradigms in clinical neuroscience tend to be constrained in terms of ecological validity, raising several challenges to studying the mechanisms mediating treatments and outcomes in clinical settings. Addressing these issues requires real-world neuroimaging techniques that are capable of continuously collecting data during free-flowing interpersonal interactions and that allow for experimental designs that are representative of the clinical situations in which they occur. METHODS In this work, we developed a paradigm that fractionates the major components of human-to-human verbal interactions occurring in clinical situations and used functional near-infrared spectroscopy to assess the brain systems underlying clinician-client discourse (N = 30). RESULTS Cross-brain neural coupling between people was significantly greater during clinical interactions compared with everyday life verbal communication, particularly between the prefrontal cortex (e.g., inferior frontal gyrus) and inferior parietal lobule (e.g., supramarginal gyrus). The clinical tasks revealed extensive increases in activity across the prefrontal cortex, especially in the rostral prefrontal cortex (area 10), during periods in which participants were required to silently reason about the dysfunctional cognitions of the other person. CONCLUSIONS This work demonstrates a novel experimental approach to investigating the neural underpinnings of interpersonal interactions that typically occur in clinical settings, and its findings support the idea that particular prefrontal systems might be critical to cultivating mental health.
Collapse
Affiliation(s)
- James Crum
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom.
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut
| | - Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut
| | - Antonia Hamilton
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Ilias Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Paul W Burgess
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Joy Hirsch
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom; Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut; Department of Neuroscience, Yale School of Medicine, New Haven, Connecticut; Department of Comparative Medicine, Yale School of Medicine, New Haven, Connecticut
| |
Collapse
|
33
|
Cai Z, Machado A, Chowdhury RA, Spilkin A, Vincent T, Aydin Ü, Pellegrino G, Lina JM, Grova C. Diffuse optical reconstructions of functional near infrared spectroscopy data using maximum entropy on the mean. Sci Rep 2022; 12:2316. [PMID: 35145148 PMCID: PMC8831678 DOI: 10.1038/s41598-022-06082-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Accepted: 01/24/2022] [Indexed: 02/07/2023] Open
Abstract
Functional near-infrared spectroscopy (fNIRS) measures the hemoglobin concentration changes associated with neuronal activity. Diffuse optical tomography (DOT) consists of reconstructing the optical density changes measured from scalp channels to the oxy-/deoxy-hemoglobin concentration changes within the cortical regions. In the present study, we adapted a nonlinear source localization method developed and validated in the context of Electro- and Magneto-Encephalography (EEG/MEG): the Maximum Entropy on the Mean (MEM), to solve the inverse problem of DOT reconstruction. We first introduced depth weighting strategy within the MEM framework for DOT reconstruction to avoid biasing the reconstruction results of DOT towards superficial regions. We also proposed a new initialization of the MEM model improving the temporal accuracy of the original MEM framework. To evaluate MEM performance and compare with widely used depth weighted Minimum Norm Estimate (MNE) inverse solution, we applied a realistic simulation scheme which contained 4000 simulations generated by 250 different seeds at different locations and 4 spatial extents ranging from 3 to 40\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {cm}^2$$\end{document}cm2 along the cortical surface. Our results showed that overall MEM provided more accurate DOT reconstructions than MNE. Moreover, we found that MEM was remained particularly robust in low signal-to-noise ratio (SNR) conditions. The proposed method was further illustrated by comparing to functional Magnetic Resonance Imaging (fMRI) activation maps, on real data involving finger tapping tasks with two different montages. The results showed that MEM provided more accurate HbO and HbR reconstructions in spatial agreement with the main fMRI cluster, when compared to MNE.
Collapse
Affiliation(s)
- Zhengchen Cai
- Department of Physics and PERFORM Centre, Concordia University, Montreal, Canada.
| | - Alexis Machado
- Multimodal Functional Imaging Lab, Biomedical Engineering Department, McGill University, Montreal, Canada
| | - Rasheda Arman Chowdhury
- Multimodal Functional Imaging Lab, Biomedical Engineering Department, McGill University, Montreal, Canada
| | - Amanda Spilkin
- Department of Physics and PERFORM Centre, Concordia University, Montreal, Canada
| | - Thomas Vincent
- Department of Physics and PERFORM Centre, Concordia University, Montreal, Canada.,Neurology and Neurosurgery Department, Montreal Neurological Institute, McGill University, Montreal, Canada.,Centre de médecine préventive et d'activité physique, Montréal Heart Institute, Montréal, Canada
| | - Ümit Aydin
- Department of Physics and PERFORM Centre, Concordia University, Montreal, Canada.,MRC Social, Genetic and Developmental Psychiatry Centre, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Giovanni Pellegrino
- Neurology and Neurosurgery Department, Montreal Neurological Institute, McGill University, Montreal, Canada
| | - Jean-Marc Lina
- École de technologie supérieure de l'Université du Québec, Montréal, Canada.,Centre de Recherches Mathématiques, Université de Montréal, Montréal, Canada
| | - Christophe Grova
- Department of Physics and PERFORM Centre, Concordia University, Montreal, Canada.,Multimodal Functional Imaging Lab, Biomedical Engineering Department, McGill University, Montreal, Canada.,Neurology and Neurosurgery Department, Montreal Neurological Institute, McGill University, Montreal, Canada.,Centre de Recherches Mathématiques, Université de Montréal, Montréal, Canada
| |
Collapse
|
34
|
Kim HK, Zhao Y, Raghuram A, Veeraraghavan A, Robinson J, Hielscher AH. Ultrafast and Ultrahigh-Resolution Diffuse Optical Tomography for Brain Imaging with Sensitivity Equation based Noniterative Sparse Optical Reconstruction (SENSOR). JOURNAL OF QUANTITATIVE SPECTROSCOPY & RADIATIVE TRANSFER 2021; 276:107939. [PMID: 34966190 PMCID: PMC8713562 DOI: 10.1016/j.jqsrt.2021.107939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
We introduce a novel image reconstruction method for time-resolved diffuse optical tomography (DOT) that yields submillimeter resolution in less than a second. This opens the door to high-resolution real-time DOT in imaging of the brain activity. We call this approach the sensitivity equation based noniterative sparse optical reconstruction (SENSOR) method. The high spatial resolution is achieved by implementing an asymptotic l 0-norm operator that guarantees to obtain sparsest representation of reconstructed targets. The high computational speed is achieved by employing the nontruncated sensitivity equation based noniterative inverse formulation combined with reduced sensing matrix and parallel computing. We tested the new method with numerical and experimental data. The results demonstrate that the SENSOR algorithm can achieve 1 mm3 spatial-resolution optical tomographic imaging at depth of ∼60 mean free paths (MFPs) in 20∼30 milliseconds on an Intel Core i9 processor.
Collapse
Affiliation(s)
- Hyun Keol Kim
- Department of Radiology, Columbia University Irvine Medical Center, New York, NY 10032
- Department of Biomedical Engineering, New York University – Tandon School of Engineering, New York, NY 10010
| | - Yongyi Zhao
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005
| | - Ankit Raghuram
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005
| | - Ashok Veeraraghavan
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005
| | - Jacob Robinson
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005
| | - Andreas H. Hielscher
- Department of Biomedical Engineering, New York University – Tandon School of Engineering, New York, NY 10010
| |
Collapse
|
35
|
Cai Z, Uji M, Aydin Ü, Pellegrino G, Spilkin A, Delaire É, Abdallah C, Lina J, Grova C. Evaluation of a personalized functional near infra-red optical tomography workflow using maximum entropy on the mean. Hum Brain Mapp 2021; 42:4823-4843. [PMID: 34342073 PMCID: PMC8449120 DOI: 10.1002/hbm.25566] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 05/25/2021] [Accepted: 06/11/2021] [Indexed: 11/20/2022] Open
Abstract
In the present study, we proposed and evaluated a workflow of personalized near infra-red optical tomography (NIROT) using functional near-infrared spectroscopy (fNIRS) for spatiotemporal imaging of cortical hemodynamic fluctuations. The proposed workflow from fNIRS data acquisition to local 3D reconstruction consists of: (a) the personalized optimal montage maximizing fNIRS channel sensitivity to a predefined targeted brain region; (b) the optimized fNIRS data acquisition involving installation of optodes and digitalization of their positions using a neuronavigation system; and (c) the 3D local reconstruction using maximum entropy on the mean (MEM) to accurately estimate the location and spatial extent of fNIRS hemodynamic fluctuations along the cortical surface. The workflow was evaluated on finger-tapping fNIRS data acquired from 10 healthy subjects for whom we estimated the reconstructed NIROT spatiotemporal images and compared with functional magnetic resonance imaging (fMRI) results from the same individuals. Using the fMRI activation maps as our reference, we quantitatively compared the performance of two NIROT approaches, the MEM framework and the conventional minimum norm estimation (MNE) method. Quantitative comparisons were performed at both single subject and group-level. Overall, our results suggested that MEM provided better spatial accuracy than MNE, while both methods offered similar temporal accuracy when reconstructing oxygenated (HbO) and deoxygenated hemoglobin (HbR) concentration changes evoked by finger-tapping. Our proposed complete workflow was made available in the brainstorm fNIRS processing plugin-NIRSTORM, thus providing the opportunity for other researchers to further apply it to other tasks and on larger populations.
Collapse
Affiliation(s)
- Zhengchen Cai
- Multimodal Functional Imaging Lab, Department of Physics and PERFORM CentreConcordia UniversityMontréalQuébecCanada
| | - Makoto Uji
- Multimodal Functional Imaging Lab, Department of Physics and PERFORM CentreConcordia UniversityMontréalQuébecCanada
| | - Ümit Aydin
- Multimodal Functional Imaging Lab, Department of Physics and PERFORM CentreConcordia UniversityMontréalQuébecCanada
- Social, Genetic and Developmental Psychiatry CentreInstitute of Psychiatry, Psychology and Neuroscience, King's College LondonLondonUK
| | - Giovanni Pellegrino
- Neurology and Neurosurgery Department, Montreal Neurological InstituteMcGill UniversityMontréalQuébecCanada
- Multimodal Functional Imaging Lab, Biomedical Engineering DepartmentMcGill UniversityMontréalQuébecCanada
| | - Amanda Spilkin
- Multimodal Functional Imaging Lab, Department of Physics and PERFORM CentreConcordia UniversityMontréalQuébecCanada
| | - Édouard Delaire
- Multimodal Functional Imaging Lab, Department of Physics and PERFORM CentreConcordia UniversityMontréalQuébecCanada
| | - Chifaou Abdallah
- Neurology and Neurosurgery Department, Montreal Neurological InstituteMcGill UniversityMontréalQuébecCanada
- Multimodal Functional Imaging Lab, Biomedical Engineering DepartmentMcGill UniversityMontréalQuébecCanada
| | - Jean‐Marc Lina
- Département de Génie ElectriqueÉcole de Technologie SupérieureMontréalQuébecCanada
- Centre De Recherches En MathématiquesMontréalQuébecCanada
| | - Christophe Grova
- Multimodal Functional Imaging Lab, Department of Physics and PERFORM CentreConcordia UniversityMontréalQuébecCanada
- Neurology and Neurosurgery Department, Montreal Neurological InstituteMcGill UniversityMontréalQuébecCanada
- Multimodal Functional Imaging Lab, Biomedical Engineering DepartmentMcGill UniversityMontréalQuébecCanada
- Centre De Recherches En MathématiquesMontréalQuébecCanada
| |
Collapse
|
36
|
Defenderfer J, Forbes S, Wijeakumar S, Hedrick M, Plyler P, Buss AT. Frontotemporal activation differs between perception of simulated cochlear implant speech and speech in background noise: An image-based fNIRS study. Neuroimage 2021; 240:118385. [PMID: 34256138 PMCID: PMC8503862 DOI: 10.1016/j.neuroimage.2021.118385] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 06/10/2021] [Accepted: 07/09/2021] [Indexed: 10/27/2022] Open
Abstract
In this study we used functional near-infrared spectroscopy (fNIRS) to investigate neural responses in normal-hearing adults as a function of speech recognition accuracy, intelligibility of the speech stimulus, and the manner in which speech is distorted. Participants listened to sentences and reported aloud what they heard. Speech quality was distorted artificially by vocoding (simulated cochlear implant speech) or naturally by adding background noise. Each type of distortion included high and low-intelligibility conditions. Sentences in quiet were used as baseline comparison. fNIRS data were analyzed using a newly developed image reconstruction approach. First, elevated cortical responses in the middle temporal gyrus (MTG) and middle frontal gyrus (MFG) were associated with speech recognition during the low-intelligibility conditions. Second, activation in the MTG was associated with recognition of vocoded speech with low intelligibility, whereas MFG activity was largely driven by recognition of speech in background noise, suggesting that the cortical response varies as a function of distortion type. Lastly, an accuracy effect in the MFG demonstrated significantly higher activation during correct perception relative to incorrect perception of speech. These results suggest that normal-hearing adults (i.e., untrained listeners of vocoded stimuli) do not exploit the same attentional mechanisms of the frontal cortex used to resolve naturally degraded speech and may instead rely on segmental and phonetic analyses in the temporal lobe to discriminate vocoded speech.
Collapse
Affiliation(s)
- Jessica Defenderfer
- Speech and Hearing Science, University of Tennessee Health Science Center, Knoxville, TN, United States.
| | - Samuel Forbes
- Psychology, University of East Anglia, Norwich, England.
| | | | - Mark Hedrick
- Speech and Hearing Science, University of Tennessee Health Science Center, Knoxville, TN, United States.
| | - Patrick Plyler
- Speech and Hearing Science, University of Tennessee Health Science Center, Knoxville, TN, United States.
| | - Aaron T Buss
- Psychology, University of Tennessee, Knoxville, TN, United States.
| |
Collapse
|
37
|
Fan W, Dehghani H, Eggebrecht AT. Investigation of effect of modulation frequency on high-density diffuse optical tomography image quality. NEUROPHOTONICS 2021; 8:045002. [PMID: 34849379 PMCID: PMC8612746 DOI: 10.1117/1.nph.8.4.045002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Accepted: 11/04/2021] [Indexed: 05/16/2023]
Abstract
Significance: By incorporating multiple overlapping functional near-infrared spectroscopy (fNIRS) measurements, high-density diffuse optical tomography (HD-DOT) images human brain function with fidelity comparable to functional magnetic resonance imaging (fMRI). Previous work has shown that frequency domain high-density diffuse optical tomography (FD-HD-DOT) may further improve image quality over more traditional continuous wave (CW) HD-DOT. Aim: The effects of modulation frequency on image quality as obtainable with FD-HD-DOT is investigated through simulations with a realistic noise model of functional activations in human head models, arising from 11 source modulation frequencies between CW and 1000 MHz. Approach: Simulations were performed using five representative head models with an HD regular grid of 158 light sources and 166 detectors and an empirically derived noise model. Functional reconstructions were quantitatively assessed with multiple image quality metrics including the localization error (LE), success rate, full width at half maximum, and full volume at half maximum (FVHM). All metrics were evaluated against CW-based models. Results: Compared to CW, localization accuracy is improved by >40% throughout brain depths of 13 to 25 mm below the surface with 300 to 500 MHz modulation frequencies. Additionally, the reliable field of view in brain tissue is enlarged by 35% to 48% within an optimal frequency of 300 MHz after considering realistic noise, depending on the dynamic range of the system. Conclusions: These results point to the tremendous opportunities in further development of high bandwidth FD-HD-DOT system hardware for applications in human brain mapping.
Collapse
Affiliation(s)
- Weihao Fan
- Washington University, Department of Physics, St. Louis, Missouri, United States
| | - Hamid Dehghani
- University of Birmingham, School of Computer Science, Birmingham, United Kingdom
| | - Adam T. Eggebrecht
- Washington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States
- Washington University, Department of Biomedical Engineering, St. Louis, Missouri, United States
| |
Collapse
|
38
|
Liu D, Zhang P, Zhang Y, Bai L, Gao F. Suppressing physiological interferences and physical noises in functional diffuse optical tomography via tandem inversion filtering and LSTM classification. OPTICS EXPRESS 2021; 29:29275-29291. [PMID: 34615040 DOI: 10.1364/oe.433917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Accepted: 08/13/2021] [Indexed: 06/13/2023]
Abstract
For performance enhancement of functional diffuse optical tomography (fDOT), we propose a tandem method that takes advantage of the inversion filtering and the long short term memory (LSTM) classification to simultaneously suppress the physiological interferences and physical noises in fDOT. In the former phase, the absorption perturbation maps over the scalp-skull (SS) and cerebral-cortex (CC) layers are firstly pre-reconstructed using a two-layer topography scheme. Then, the recovered SS-map is inversed into measurement space by the forward calculation to estimate the intensity changes associated with the physiological interferences. Finally, the raw measurements are adaptively filtered with reference to the estimated intensity changes for accomplishing the model-based full three-dimension (3D) reconstruction. In the later phase, for further removing the randomly distributed physical noises, mainly instrumental noise, a LSTM network based fusion strategy is applied, where a pixel-wise binary mask of "activated" or "inactive" state is generated by performing LSTM classification and then fused with the 3D reconstruction. The results of the simulative investigation and in-vivo experiment show the proposed tandem scheme achieves improved performance in fDOT using a cost-effective and physically explicable way. Thus, the proposed method can be promisingly applied in real-time neuroimaging to acquire cortical neural activation information with improved reliability, quantification and resolution.
Collapse
|
39
|
Ono Y, Zhang X, Noah JA, Dravida S, Hirsch J. Bidirectional Connectivity Between Broca's Area and Wernicke's Area During Interactive Verbal Communication. Brain Connect 2021; 12:210-222. [PMID: 34128394 DOI: 10.1089/brain.2020.0790] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Aim: This investigation aims to advance the understanding of neural dynamics that underlies live and natural interactions during spoken dialogue between two individuals. Introduction: The underlying hypothesis is that functional connectivity between canonical speech areas in the human brain will be modulated by social interaction. Methods: Granger causality was applied to compare directional connectivity across Broca's and Wernicke's areas during verbal conditions consisting of interactive and noninteractive communication. Thirty-three pairs of healthy adult participants alternately talked and listened to each other while performing an object naming and description task that was either interactive or not during hyperscanning with functional near-infrared spectroscopy (fNIRS). In the noninteractive condition, the speaker named and described a picture-object without reference to the partner's description. In the interactive condition, the speaker performed the same task but included an interactive response about the preceding comments of the partner. Causality measures of hemodynamic responses from Broca's and Wernicke's areas were compared between real, surrogate, and shuffled trials within dyads. Results: The interactive communication was characterized by bidirectional connectivity between Wernicke's and Broca's areas of the listener's brain. Whereas this connectivity was unidirectional in the speaker's brain. In the case of the noninteractive condition, both speaker's and listener's brains showed unidirectional top-down (Broca's area to Wernicke's area) connectivity. Conclusion: Together, directional connectivity as determined by Granger analysis reveals bidirectional flow of neuronal information during dynamic two-person verbal interaction for processes that are active during listening (reception) and not during talking (production). Findings are consistent with prior contrast findings (general linear model) showing neural modulation of the receptive language system associated with Wernicke's area during a two-person live interaction. Impact statement The neural dynamics that underlies real-life social interactions is an emergent topic of interest. Dynamically coupled cross-brain neural mechanisms between interacting partners during verbal dialogue have been shown within Wernicke's area. However, it is not known how within-brain long-range neural mechanisms operate during these live social functions. Using Granger causality analysis, we show bidirectional neural activity between Broca's and Wernicke's areas during interactive dialogue compared with a noninteractive control task showing only unidirectional activity. Findings are consistent with an Interactive Brain Model where long-range neural mechanisms process interactive processes associated with rapid and spontaneous spoken social cues.
Collapse
Affiliation(s)
- Yumie Ono
- Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, Kawasaki, Kanagawa, Japan.,Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut, USA
| | - Xian Zhang
- Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut, USA
| | - J Adam Noah
- Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut, USA
| | - Swethasri Dravida
- Interdepartmental Program for Neuroscience, Yale School of Medicine, New Haven, Connecticut, USA.,Medical Student Training Program, Yale School of Medicine, New Haven, Connecticut, USA
| | - Joy Hirsch
- Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut, USA.,Interdepartmental Program for Neuroscience, Yale School of Medicine, New Haven, Connecticut, USA.,Department of Neuroscience, Yale School of Medicine, New Haven, Connecticut, USA.,Department of Comparative Medicine, Yale School of Medicine, New Haven, Connecticut, USA.,Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| |
Collapse
|
40
|
Dybvik H, Steinert M. Real-World fNIRS Brain Activity Measurements during Ashtanga Vinyasa Yoga. Brain Sci 2021; 11:742. [PMID: 34204979 PMCID: PMC8229690 DOI: 10.3390/brainsci11060742] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 05/27/2021] [Accepted: 05/31/2021] [Indexed: 11/21/2022] Open
Abstract
Functional near-infrared spectroscopy (fNIRS) is often praised for its portability and robustness towards motion artifacts. While an increasing body of fNIRS research in real-world environments is emerging, most fNIRS studies are still conducted in laboratories, and do not incorporate larger movements performed by participants. This study extends fNIRS applications in real-world environments by conducting a single-subject observational study of a yoga practice with considerable movement (Ashtanga Vinyasa Yoga) in a participant's natural environment (their apartment). The results show differences in cognitive load (prefrontal cortex activation) when comparing technically complex postures to relatively simple ones, but also some contrasts with surprisingly little difference. This study explores the boundaries of real-world cognitive load measurements, and contributes to the empirical knowledge base of using fNIRS in realistic settings. To the best of our knowledge, this is the first demonstration of fNIRS brain imaging recorded during any moving yoga practice. Future work with fNIRS should take advantage of this by accomplishing studies with considerable real-world movement.
Collapse
Affiliation(s)
- Henrikke Dybvik
- TrollLABS, Department of Mechanical and Industrial Engineering, Norwegian University of Science and Technology (NTNU), 7491 Trondheim, Norway;
| | | |
Collapse
|
41
|
Khan AF, Zhang F, Yuan H, Ding L. Brain-wide functional diffuse optical tomography of resting state networks. J Neural Eng 2021; 18. [PMID: 33946052 DOI: 10.1088/1741-2552/abfdf9] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2020] [Accepted: 05/04/2021] [Indexed: 02/07/2023]
Abstract
Objective.Diffuse optical tomography (DOT) has the potential in reconstructing resting state networks (RSNs) in human brains with high spatio-temporal resolutions and multiple contrasts. While several RSNs have been reported and successfully reconstructed using DOT, its full potential in recovering a collective set of distributed brain-wide networks with the number of RSNs close to those reported using functional magnetic resonance imaging (fMRI) has not been demonstrated.Approach.The present study developed a novel brain-wide DOT (BW-DOT) framework that integrates a cap-based whole-head optode placement system with multiple computational approaches, i.e. finite-element modeling, inverse source reconstruction, data-driven pattern recognition, and statistical correlation tomography, to reconstruct RSNs in dual contrasts of oxygenated (HbO) and deoxygenated hemoglobins (HbR).Main results.Our results from the proposed framework revealed a comprehensive set of RSNs and their subnetworks, which collectively cover almost the entire neocortical surface of the human brain, both at the group level and individual participants. The spatial patterns of these DOT RSNs suggest statistically significant similarities to fMRI RSN templates. Our results also reported the networks involving the medial prefrontal cortex and precuneus that had been missed in previous DOT studies. Furthermore, RSNs obtained from HbO and HbR suggest similarity in terms of both the number of RSN types reconstructed and their corresponding spatial patterns, while HbR RSNs show statistically more similarity to fMRI RSN templates and HbO RSNs indicate more bilateral patterns over two hemispheres. In addition, the BW-DOT framework allowed consistent reconstructions of RSNs across individuals and across recording sessions, indicating its high robustness and reproducibility, respectively.Significance.Our present results suggest the feasibility of using the BW-DOT, as a neuroimaging tool, in simultaneously mapping multiple RSNs and its potential values in studying RSNs, particularly in patient populations under diverse conditions and needs, due to its advantages in accessibility over fMRI.
Collapse
Affiliation(s)
- Ali F Khan
- Stephenson School of Biomedical Engineering, University of Oklahoma, Norman, OK, United States of America
| | - Fan Zhang
- Stephenson School of Biomedical Engineering, University of Oklahoma, Norman, OK, United States of America
| | - Han Yuan
- Stephenson School of Biomedical Engineering, University of Oklahoma, Norman, OK, United States of America.,Institute for Biomedical Engineering, Science, and Technology, University of Oklahoma, Norman, OK, United States of America
| | - Lei Ding
- Stephenson School of Biomedical Engineering, University of Oklahoma, Norman, OK, United States of America.,Institute for Biomedical Engineering, Science, and Technology, University of Oklahoma, Norman, OK, United States of America
| |
Collapse
|
42
|
Vidal-Rosas EE, Zhao H, Nixon-Hill RW, Smith G, Dunne L, Powell S, Cooper RJ, Everdell NL. Evaluating a new generation of wearable high-density diffuse optical tomography technology via retinotopic mapping of the adult visual cortex. NEUROPHOTONICS 2021; 8:025002. [PMID: 33842667 PMCID: PMC8033536 DOI: 10.1117/1.nph.8.2.025002] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Accepted: 03/17/2021] [Indexed: 05/06/2023]
Abstract
Significance: High-density diffuse optical tomography (HD-DOT) has been shown to approach the resolution and localization accuracy of blood oxygen level dependent-functional magnetic resonance imaging in the adult brain by exploiting densely spaced, overlapping samples of the probed tissue volume, but the technique has to date required large and cumbersome optical fiber arrays. Aim: To evaluate a wearable HD-DOT system that provides a comparable sampling density to large, fiber-based HD-DOT systems, but with vastly improved ergonomics. Approach: We investigated the performance of this system by replicating a series of classic visual stimulation paradigms, carried out in one highly sampled participant during 15 sessions to assess imaging performance and repeatability. Results: Hemodynamic response functions and cortical activation maps replicate the results obtained with larger fiber-based systems. Our results demonstrate focal activations in both oxyhemoglobin and deoxyhemoglobin with a high degree of repeatability observed across all sessions. A comparison with a simulated low-density array explicitly demonstrates the improvements in spatial localization, resolution, repeatability, and image contrast that can be obtained with this high-density technology. Conclusions: The system offers the possibility for minimally constrained, spatially resolved functional imaging of the human brain in almost any environment and holds particular promise in enabling neuroscience applications outside of the laboratory setting. It also opens up new opportunities to investigate populations unsuited to traditional imaging technologies.
Collapse
Affiliation(s)
- Ernesto E. Vidal-Rosas
- University College London, Diffuse Optical Tomography of the Human Brain Research Group, Biomedical Optics Research Laboratory, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
- Address all correspondence to Ernesto E. Vidal-Rosas,
| | - Hubin Zhao
- University College London, Diffuse Optical Tomography of the Human Brain Research Group, Biomedical Optics Research Laboratory, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
- University of Glasgow, James Watt School of Engineering, Glasgow, United Kingdom
| | - Reuben W. Nixon-Hill
- Imperial College London, Department of Mathematics, London, United Kingdom
- Gowerlabs Ltd., London, United Kingdom
| | | | | | - Samuel Powell
- Gowerlabs Ltd., London, United Kingdom
- Nottingham University, Department of Electrical and Electronic Engineering, Nottingham, United Kingdom
| | - Robert J. Cooper
- University College London, Diffuse Optical Tomography of the Human Brain Research Group, Biomedical Optics Research Laboratory, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Nicholas L. Everdell
- University College London, Diffuse Optical Tomography of the Human Brain Research Group, Biomedical Optics Research Laboratory, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
- Gowerlabs Ltd., London, United Kingdom
| |
Collapse
|
43
|
Huang C, Mazdeyasna S, Mohtasebi M, Saatman KE, Cheng Q, Yu G, Chen L. Speckle contrast diffuse correlation tomography of cerebral blood flow in perinatal disease model of neonatal piglets. JOURNAL OF BIOPHOTONICS 2021; 14:e202000366. [PMID: 33295142 PMCID: PMC8833087 DOI: 10.1002/jbio.202000366] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Revised: 12/05/2020] [Accepted: 12/06/2020] [Indexed: 05/11/2023]
Abstract
We adapted and tested an innovative noncontact speckle contrast diffuse correlation tomography (scDCT) system for 3D imaging of cerebral blood flow (CBF) variations in perinatal disease models utilizing neonatal piglets, which closely resemble human neonates. CBF variations were concurrently measured by the scDCT and an established diffuse correlation spectroscopy (DCS) during global ischemia, intraventricular hemorrhage, and asphyxia; significant correlations were observed. Moreover, CBF variations associated reasonably with vital pathophysiological changes. In contrast to DCS measurements of mixed signals from local scalp, skull and brain, scDCT generates 3D images of CBF distributions at prescribed depths within the head, thus enabling specific determination of regional cerebral ischemia. With further optimization and validation in animals and human neonates, scDCT has the potential to be a noninvasive imaging tool for both basic neuroscience research in laboratories and clinical applications in neonatal intensive care units.
Collapse
Affiliation(s)
- Chong Huang
- Department of Biomedical Engineering, University of Kentucky, Lexington, Kentucky
| | - Siavash Mazdeyasna
- Department of Biomedical Engineering, University of Kentucky, Lexington, Kentucky
| | - Mehrana Mohtasebi
- Department of Biomedical Engineering, University of Kentucky, Lexington, Kentucky
| | - Kathryn E. Saatman
- Department of Physiology, Spinal Cord and Brain Injury Research Center, University of Kentucky, Lexington, Kentucky
| | - Qiang Cheng
- Division of Biomedical Informatics, Department of Internal Medicine, University of Kentucky, Lexington, Kentucky
| | - Guoqiang Yu
- Department of Biomedical Engineering, University of Kentucky, Lexington, Kentucky
| | - Lei Chen
- Department of Physiology, Spinal Cord and Brain Injury Research Center, University of Kentucky, Lexington, Kentucky
| |
Collapse
|
44
|
Forbes SH, Wijeakumar S, Eggebrecht AT, Magnotta VA, Spencer JP. Processing pipeline for image reconstructed fNIRS analysis using both MRI templates and individual anatomy. NEUROPHOTONICS 2021; 8:025010. [PMID: 35106319 PMCID: PMC8786393 DOI: 10.1117/1.nph.8.2.025010] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 05/18/2021] [Indexed: 05/29/2023]
Abstract
Significance: Image reconstruction of fNIRS data is a useful technique for transforming channel-based fNIRS into a volumetric representation and managing spatial variance based on optode location. We present an innovative integrated pipeline for image reconstruction of fNIRS data using either MRI templates or individual anatomy. Aim: We demonstrate a pipeline with accompanying code to allow users to clean and prepare optode location information, prepare and standardize individual anatomical images, create the light model, run the 3D image reconstruction, and analyze data in group space. Approach: We synthesize a combination of new and existing software packages to create a complete pipeline, from raw data to analysis. Results: This pipeline has been tested using both templates and individual anatomy, and on data from different fNIRS data collection systems. We show high temporal correlations between channel-based and image-based fNIRS data. In addition, we demonstrate the reliability of this pipeline with a sample dataset that included 74 children as part of a longitudinal study taking place in Scotland. We demonstrate good correspondence between data in channel space and image reconstructed data. Conclusions: The pipeline presented here makes a unique contribution by integrating multiple tools to assemble a complete pipeline for image reconstruction in fNIRS. We highlight further issues that may be of interest to future software developers in the field.
Collapse
Affiliation(s)
- Samuel H. Forbes
- University of East Anglia, School of Psychology, Lawrence Stenhouse Building, Norwich, United Kingdom
| | | | - Adam T. Eggebrecht
- Washington University, Mallinckrodt Institute of Radiology, St Louis, Missouri, United States
| | | | - John P. Spencer
- University of East Anglia, School of Psychology, Lawrence Stenhouse Building, Norwich, United Kingdom
| |
Collapse
|
45
|
White BR, Padawer-Curry JA, Ko T, Baker W, Breimann J, Cohen AS, Licht DJ, Yodh AG. Wavelength censoring for spectroscopy in optical functional neuroimaging. Phys Med Biol 2021; 66:065026. [PMID: 33326946 DOI: 10.1088/1361-6560/abd418] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Optical neuromonitoring provides insight into neurovascular physiology and brain structure and function. These methods rely on spectroscopy to relate light absorption changes to variation of concentrations of physiologic chromophores such as oxy- and deoxyhemoglobin. In clinical or preclinical practice, data quality can vary significantly across wavelengths. In such situations, standard spectroscopic methods may perform poorly, resulting in data loss and limiting field-of-view. To address this issue, and thereby improve the robustness of optical neuromonitoring, we develop, in this manuscript, novel methods to perform spectroscopy even when data quality exhibits wavelength-dependent spatial variation. We sought to understand the impact of spatial, wavelength-based censoring on the physiologic accuracy and utility of hemoglobin spectroscopy. The principles of our analysis are quite general, but to make the methodology tangible we focused on optical intrinsic signal imaging of resting-state functional connectivity in mice. Starting with spectroscopy using four sources, all possible subset spectroscopy matrices were assessed theoretically, using simulated data, and using experimental data. These results were compared against the use of the full spectroscopy matrix to determine which subsets yielded robust results. Our results demonstrated that accurate calculation of changes in hemoglobin concentrations and the resulting functional connectivity network maps was possible even with censoring of some wavelengths. Additionally, we found that the use of changes in total hemoglobin (rather than oxy- or deoxyhemoglobin) yielded results more robust to experimental noise and allowed for the preservation of more data. This new and rigorous image processing method should improve the fidelity of clinical and preclinical functional neuroimaging studies.
Collapse
Affiliation(s)
- Brian R White
- Division of Pediatric Cardiology, Department of Pediatrics, The Children's Hospital of Philadelphia and The Perelman School of Medicine at the University of Pennsylvania, 3401 Civic Center Blvd., Pediatric Cardiology-8NW, Philadelphia, PA 19104, United States of America
| | - Jonah A Padawer-Curry
- Division of Neurology, Department of Pediatrics, The Children's Hospital of Philadelphia and The Perelman School of Medicine at the University of Pennsylvania, United States of America
| | - Tiffany Ko
- Division of Neurology, Department of Pediatrics, The Children's Hospital of Philadelphia and The Perelman School of Medicine at the University of Pennsylvania, United States of America
| | - Wesley Baker
- Division of Neurology, Department of Pediatrics, The Children's Hospital of Philadelphia and The Perelman School of Medicine at the University of Pennsylvania, United States of America
| | - Jake Breimann
- Division of Neurology, Department of Pediatrics, The Children's Hospital of Philadelphia and The Perelman School of Medicine at the University of Pennsylvania, United States of America
| | - Akiva S Cohen
- Department of Anesthesiology and Critical Care Medicine, The Children's Hospital of Philadelphia. 3615 Civic Center Blvd., Abramson Research Center, Room 816-H, Philadelphia, PA 19104, United States of America
| | - Daniel J Licht
- Division of Neurology, Department of Pediatrics, The Children's Hospital of Philadelphia and The Perelman School of Medicine at the University of Pennsylvania, United States of America
| | - Arjun G Yodh
- Department of Physics and Astronomy, University of Pennsylvania, Philadelphia, PA 19104, United States of America
| |
Collapse
|
46
|
Hernandez-Martin E, Gonzalez-Mora JL. Diffuse optical tomography in the human brain: A briefly review from the neurophysiology to its applications. BRAIN SCIENCE ADVANCES 2021. [DOI: 10.26599/bsa.2020.9050014] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
The present work describes the use of noninvasive diffuse optical tomography (DOT) technology to measure hemodynamic changes, providing relevant information which helps to understand the basis of neurophysiology in the human brain. Advantages such as portability, direct measurements of hemoglobin state, temporal resolution, non‐restricted movements as occurs in magnetic resonance imaging (MRI) devices mean that DOT technology can be used in research and clinical fields. In this review we covered the neurophysiology, physical principles underlying optical imaging during tissue‐light interactions, and technology commonly used during the construction of a DOT device including the source‐detector requirements to improve the image quality. DOT provides 3D cerebral activation images due to complex mathematical models which describe the light propagation inside the tissue head. Moreover, we describe briefly the use of Bayesian methods for raw DOT data filtering as an alternative to linear filters widely used in signal processing, avoiding common problems such as the filter selection or a false interpretation of the results which is sometimes due to the interference of background physiological noise with neural activity.
Collapse
Affiliation(s)
- Estefania Hernandez-Martin
- Department of Basic Medical Science, Faculty of Health Science, Medicine Section, Universidad de La Laguna, 38071, Spain
| | - José Luis Gonzalez-Mora
- Department of Basic Medical Science, Faculty of Health Science, Medicine Section, Universidad de La Laguna, 38071, Spain
| |
Collapse
|
47
|
Facial and neural mechanisms during interactive disclosure of biographical information. Neuroimage 2021; 226:117572. [PMID: 33221448 PMCID: PMC7612862 DOI: 10.1016/j.neuroimage.2020.117572] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Revised: 09/30/2020] [Accepted: 11/10/2020] [Indexed: 01/07/2023] Open
Abstract
Pairs of participants mutually communicated (or not) biographical information to each other. By combining simultaneous eye-tracking, face-tracking and functional near-infrared spectroscopy, we examined how this mutual sharing of information modulates social signalling and brain activity. When biographical information was disclosed, participants directed more eye gaze to the face of the partner and presented more facial displays. We also found that spontaneous production and observation of facial displays was associated with activity in the left SMG and right dlPFC/IFG, respectively. Moreover, mutual information-sharing increased activity in bilateral TPJ and left dlPFC, as well as cross-brain synchrony between right TPJ and left dlPFC. This suggests that a complex long-range mechanism is recruited during information-sharing. These multimodal findings support the second-person neuroscience hypothesis, which postulates that communicative interactions activate additional neurocognitive mechanisms to those engaged in non-interactive situations. They further advance our understanding of which neurocognitive mechanisms underlie communicative interactions.
Collapse
|
48
|
Kovacsova Z, Bale G, Mitra S, Lange F, Tachtsidis I. Absolute quantification of cerebral tissue oxygen saturation with multidistance broadband NIRS in newborn brain. BIOMEDICAL OPTICS EXPRESS 2021; 12:907-925. [PMID: 33680549 PMCID: PMC7901317 DOI: 10.1364/boe.412088] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Revised: 11/27/2020] [Accepted: 11/27/2020] [Indexed: 05/23/2023]
Abstract
Tissue oximetry with near-infrared spectroscopy (NIRS) is a technique for the measurement of absolute tissue oxygen saturation (StO2). Offering a real-time and non-invasive assessment of brain oxygenation and haemodynamics, StO2 has potential to be used for the assessment of newborn brain injury. Multiple algorithms have been developed to measure StO2, however, issues with low measurement accuracy or extracranial tissue signal contamination remain. In this work, we present a novel algorithm to recover StO2 in the neonate, broadband multidistance oximetry (BRUNO), based on a measurement of the gradient of attenuation against distance measured with broadband NIRS. The performance of the algorithm was compared to two other published algorithms, broadband fitting (BF) and spatially resolved spectroscopy (SRS). The median error when recovering StO2 in light transport simulations on a neonatal head mesh was 0.4% with BRUNO, 4.2% with BF and 9.5% with SRS. BRUNO was more sensitive to brain tissue oxygenation changes, shown in layered head model simulations. Comparison of algorithm performance during full oxygenation-deoxygenation cycles in a homogeneous dynamic blood phantom showed significant differences in the dynamic range of the algorithms; BRUNO recovered StO2 over 0-100%, BF over 0-90% and SRS over 39-80%. Recovering StO2 from data collected in a neonate treated at the neonatal intensive care showed different baseline values; mean StO2 was 64.9% with BRUNO, 67.2% with BF and 73.2% with SRS. These findings highlight the effect of StO2 algorithm selection on oxygenation recovery; applying BRUNO in the clinical care setting could reveal further insight into complex haemodynamic processes occurring during neonatal brain injury.
Collapse
Affiliation(s)
- Zuzana Kovacsova
- Department of Medical Physics & Biomedical Engineering, University College London, London, WC1E 6BT, UK
| | - Gemma Bale
- Department of Medical Physics & Biomedical Engineering, University College London, London, WC1E 6BT, UK
- Department of Engineering, University of Cambridge, Cambridge, CB2 1PZ, UK
- Department of Physics, University of Cambridge, Cambridge, CB3 0HE, UK
| | - Subhabrata Mitra
- Institute for Women’s Health, University College London and Neonatal Unit, University College London Hospitals Trust, London, NW1 2BU, UK
| | - Frédéric Lange
- Department of Medical Physics & Biomedical Engineering, University College London, London, WC1E 6BT, UK
| | - Ilias Tachtsidis
- Department of Medical Physics & Biomedical Engineering, University College London, London, WC1E 6BT, UK
| |
Collapse
|
49
|
Kelley MS, Noah JA, Zhang X, Scassellati B, Hirsch J. Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot. Front Robot AI 2021; 7:599581. [PMID: 33585574 PMCID: PMC7879449 DOI: 10.3389/frobt.2020.599581] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Accepted: 12/07/2020] [Indexed: 01/17/2023] Open
Abstract
Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with eyes that blink and move right and left. Eye-contact was confirmed by eye-tracking for both conditions. Increased neural activity was observed in human social systems including the right temporal parietal junction and the dorsolateral prefrontal cortex during human-human eye contact but not human-robot eye-contact. This suggests that the type of human-robot eye-contact used here is not sufficient to engage the right temporoparietal junction in the human. This study establishes a foundation for future research into human-robot eye-contact to determine how elements of robot design and behavior impact human social processing within this type of interaction and may offer a method for capturing difficult to quantify components of human-robot interaction, such as social engagement.
Collapse
Affiliation(s)
- Megan S. Kelley
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Brian Scassellati
- Social Robotics Laboratory, Department of Computer Science, Yale University, New Haven, CT, United States
| | - Joy Hirsch
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
- Departments of Neuroscience and Comparative Medicine, Yale School of Medicine, New Haven, CT, United States
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| |
Collapse
|
50
|
Hirsch J, Tiede M, Zhang X, Noah JA, Salama-Manteau A, Biriotti M. Interpersonal Agreement and Disagreement During Face-to-Face Dialogue: An fNIRS Investigation. Front Hum Neurosci 2021; 14:606397. [PMID: 33584223 PMCID: PMC7874076 DOI: 10.3389/fnhum.2020.606397] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Accepted: 12/15/2020] [Indexed: 01/03/2023] Open
Abstract
Although the neural systems that underlie spoken language are well-known, how they adapt to evolving social cues during natural conversations remains an unanswered question. In this work we investigate the neural correlates of face-to-face conversations between two individuals using functional near infrared spectroscopy (fNIRS) and acoustical analyses of concurrent audio recordings. Nineteen pairs of healthy adults engaged in live discussions on two controversial topics where their opinions were either in agreement or disagreement. Participants were matched according to their a priori opinions on these topics as assessed by questionnaire. Acoustic measures of the recorded speech including the fundamental frequency range, median fundamental frequency, syllable rate, and acoustic energy were elevated during disagreement relative to agreement. Consistent with both the a priori opinion ratings and the acoustic findings, neural activity associated with long-range functional networks, rather than the canonical language areas, was also differentiated by the two conditions. Specifically, the frontoparietal system including bilateral dorsolateral prefrontal cortex, left supramarginal gyrus, angular gyrus, and superior temporal gyrus showed increased activity while talking during disagreement. In contrast, talking during agreement was characterized by increased activity in a social and attention network including right supramarginal gyrus, bilateral frontal eye-fields, and left frontopolar regions. Further, these social and visual attention networks were more synchronous across brains during agreement than disagreement. Rather than localized modulation of the canonical language system, these findings are most consistent with a model of distributed and adaptive language-related processes including cross-brain neural coupling that serves dynamic verbal exchanges.
Collapse
Affiliation(s)
- Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States.,Department of Neuroscience, Yale School of Medicine, New Haven, CT, United States.,Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, United States.,Haskins Laboratories, New Haven, CT, United States.,Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Mark Tiede
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States.,Haskins Laboratories, New Haven, CT, United States
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - J Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Alexandre Salama-Manteau
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Maurice Biriotti
- Faculty of Arts and Humanities, University College London, London, United Kingdom
| |
Collapse
|