1
|
Burgess PW, Crum J, Pinti P, Aichelburg C, Oliver D, Lind F, Power S, Swingler E, Hakim U, Merla A, Gilbert S, Tachtsidis I, Hamilton A. Prefrontal cortical activation associated with prospective memory while walking around a real-world street environment. Neuroimage 2022; 258:119392. [PMID: 35714887 PMCID: PMC10509823 DOI: 10.1016/j.neuroimage.2022.119392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 05/24/2022] [Accepted: 06/13/2022] [Indexed: 10/18/2022] Open
Abstract
Rostral PFC (area 10) activation is common during prospective memory (PM) tasks. But it is not clear what mental processes these activations index. Three candidate explanations from cognitive neuroscience theory are: (i) monitoring of the environment; (ii) spontaneous intention retrieval; (iii) a combination of the two. These explanations make different predictions about the temporal and spatial patterns of activation that would be seen in rostral PFC in naturalistic settings. Accordingly, we plotted functional events in PFC using portable fNIRS while people were carrying out a PM task outside the lab and responding to cues when they were encountered, to decide between these explanations. Nineteen people were asked to walk around a street in London, U.K. and perform various tasks while also remembering to respond to prospective memory (PM) cues when they detected them. The prospective memory cues could be either social (involving greeting a person) or non-social (interacting with a parking meter) in nature. There were also a number of contrast conditions which allowed us to determine activation specifically related to the prospective memory components of the tasks. We found that maintaining both social and non-social intentions was associated with widespread activation within medial and right hemisphere rostral prefrontal cortex (BA 10), in agreement with numerous previous lab-based fMRI studies of prospective memory. In addition, increased activation was found within lateral prefrontal cortex (BA 45 and 46) when people were maintaining a social intention compared to a non-social one. The data were then subjected to a GLM-based method for automatic identification of functional events (AIDE), and the position of the participants at the time of the activation events were located on a map of the physical space. The results showed that the spatial and temporal distribution of these events was not random, but aggregated around areas in which the participants appeared to retrieve their future intentions (i.e., where they saw intentional cues), as well as where they executed them. Functional events were detected most frequently in BA 10 during the PM conditions compared to other regions and tasks. Mobile fNIRS can be used to measure higher cognitive functions of the prefrontal cortex in "real world" situations outside the laboratory in freely ambulant individuals. The addition of a "brain-first" approach to the data permits the experimenter to determine not only when haemodynamic changes occur, but also where the participant was when it happened. This can be extremely valuable when trying to link brain and cognition.
Collapse
Affiliation(s)
- Paul W Burgess
- Institute of Cognitive Neuroscience, University College London, UK.
| | - James Crum
- Institute of Cognitive Neuroscience, University College London, UK
| | - Paola Pinti
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| | | | - Dominic Oliver
- Institute of Cognitive Neuroscience, University College London, UK
| | - Frida Lind
- Institute of Cognitive Neuroscience, University College London, UK
| | - Sarah Power
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| | | | - Uzair Hakim
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| | - Arcangelo Merla
- Infrared Imaging Lab, Institute for Advanced Biomedical Technology (ITAB), Department of Neuroscience, Imaging and Clinical Sciences, University of Chieti-Pescara, Italy
| | - Sam Gilbert
- Institute of Cognitive Neuroscience, University College London, UK
| | - Ilias Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| | - Antonia Hamilton
- Institute of Cognitive Neuroscience, University College London, UK
| |
Collapse
|
2
|
The presence of adjacent others facilitates interpersonal neural synchronization in the left prefrontal cortex during a simple addition task. Sci Rep 2022; 12:12662. [PMID: 35879339 PMCID: PMC9314338 DOI: 10.1038/s41598-022-16936-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Accepted: 07/18/2022] [Indexed: 11/08/2022] Open
Abstract
The hyperscanning technique, that is, simultaneous measurement of neural signals in more than one person, is a powerful research tool for understanding humans' social interactions. In recent years, many studies have investigated interpersonal neural synchronization during various types of communication processes. However, there has been little focus on the impact of the presence of others without explicit social interaction, despite the mere presence of others having been suggested as influencing behavior. In this study, we clarify whether neural signals during a self-paced, repeated, addition task are synchronized when another individual is adjacent without direct interaction. Twenty pairs of participants were measured using a hyperscanning approach with near-infrared spectroscopy. The results show that interpersonal neural synchronization of the task-related signal in the left forehead region was enhanced under the condition of being adjacent to another participant. By contrast, a significant decrease in neural synchronization in the center of the forehead region, where increased neural synchronization is often reported in explicit communication, was observed. Thus, the results indicate that the adjacency of others modulates interpersonal neural synchronization in the task-related signal, and the effect on cognitive processing is different from that of explicit social interaction.
Collapse
|
3
|
Keshmiri S. Conditional Entropy: A Potential Digital Marker for Stress. ENTROPY (BASEL, SWITZERLAND) 2021; 23:286. [PMID: 33652891 PMCID: PMC7996836 DOI: 10.3390/e23030286] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Revised: 02/20/2021] [Accepted: 02/23/2021] [Indexed: 12/12/2022]
Abstract
Recent decades have witnessed a substantial progress in the utilization of brain activity for the identification of stress digital markers. In particular, the success of entropic measures for this purpose is very appealing, considering (1) their suitability for capturing both linear and non-linear characteristics of brain activity recordings and (2) their direct association with the brain signal variability. These findings rely on external stimuli to induce the brain stress response. On the other hand, research suggests that the use of different types of experimentally induced psychological and physical stressors could potentially yield differential impacts on the brain response to stress and therefore should be dissociated from more general patterns. The present study takes a step toward addressing this issue by introducing conditional entropy (CE) as a potential electroencephalography (EEG)-based resting-state digital marker of stress. For this purpose, we use the resting-state multi-channel EEG recordings of 20 individuals whose responses to stress-related questionnaires show significantly higher and lower level of stress. Through the application of representational similarity analysis (RSA) and K-nearest-neighbor (KNN) classification, we verify the potential that the use of CE can offer to the solution concept of finding an effective digital marker for stress.
Collapse
Affiliation(s)
- Soheil Keshmiri
- Advanced Telecommunications Research Institute International (ATR), Kyoto 619-0237, Japan
| |
Collapse
|
4
|
Keles HO, Cengiz C, Demiral I, Ozmen MM, Omurtag A. High density optical neuroimaging predicts surgeons's subjective experience and skill levels. PLoS One 2021; 16:e0247117. [PMID: 33600502 PMCID: PMC7891714 DOI: 10.1371/journal.pone.0247117] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Accepted: 02/01/2021] [Indexed: 01/04/2023] Open
Abstract
Measuring cognitive load is important for surgical education and patient safety. Traditional approaches of measuring cognitive load of surgeons utilise behavioural metrics to measure performance and surveys and questionnaires to collect reports of subjective experience. These have disadvantages such as sporadic data, occasionally intrusive methodologies, subjective or misleading self-reporting. In addition, traditional approaches use subjective metrics that cannot distinguish between skill levels. Functional neuroimaging data was collected using a high density, wireless NIRS device from sixteen surgeons (11 attending surgeons and 5 surgery resident) and 17 students while they performed two laparoscopic tasks (Peg transfer and String pass). Participant’s subjective mental load was assessed using the NASA-TLX survey. Machine learning approaches were used for predicting the subjective experience and skill levels. The Prefrontal cortex (PFC) activations were greater in students who reported higher-than-median task load, as measured by the NASA-TLX survey. However in the case of attending surgeons the opposite tendency was observed, namely higher activations in the lower v higher task loaded subjects. We found that response was greater in the left PFC of students particularly near the dorso- and ventrolateral areas. We quantified the ability of PFC activation to predict the differences in skill and task load using machine learning while focussing on the effects of NIRS channel separation distance on the results. Our results showed that the classification of skill level and subjective task load could be predicted based on PFC activation with an accuracy of nearly 90%. Our finding shows that there is sufficient information available in the optical signals to make accurate predictions about the surgeons’ subjective experiences and skill levels. The high accuracy of results is encouraging and suggest the integration of the strategy developed in this study as a promising approach to design automated, more accurate and objective evaluation methods.
Collapse
Affiliation(s)
- Hasan Onur Keles
- Department of Biomedical Engineering, Ankara University, Ankara, Turkey
- * E-mail:
| | - Canberk Cengiz
- Department of Electroneurophysiology, Istinye University, Istanbul, Turkey
| | - Irem Demiral
- Department of OB&GYN, 29 May State Hospital, Ankara, Turkey
| | | | - Ahmet Omurtag
- Department of Engineering, Nottingham Trent University, Nottingham, United Kingdom
| |
Collapse
|
5
|
Noah JA, Zhang X, Dravida S, DiCocco C, Suzuki T, Aslin RN, Tachtsidis I, Hirsch J. Comparison of short-channel separation and spatial domain filtering for removal of non-neural components in functional near-infrared spectroscopy signals. NEUROPHOTONICS 2021; 8:015004. [PMID: 33598505 PMCID: PMC7881368 DOI: 10.1117/1.nph.8.1.015004] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Accepted: 01/19/2021] [Indexed: 05/03/2023]
Abstract
Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. Aim: We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. Approach: We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels. For short-channel temporal regression, we compare non-neural signal removal using first and combined first and second PCs from a broad distribution of short channels to limited distribution on the forehead. Results: Temporal regression of non-neural information from broadly distributed short channels did not differ from forehead-only distribution. Spatial PC filtering provides results similar to short-channel separation using the temporal domain. Utilizing both first and second PCs from short channels removes additional non-neural information. Conclusions: We conclude that short-channel information in the temporal domain and spatial domain regression filtering methods remove similar non-neural components represented in scalp hemodynamics from fNIRS signals and that either technique is sufficient to remove non-neural components.
Collapse
Affiliation(s)
- J. Adam Noah
- Yale School of Medicine, Department of Psychiatry, Brain Function Laboratory, New Haven, Connecticut, United States
| | - Xian Zhang
- Yale School of Medicine, Department of Psychiatry, Brain Function Laboratory, New Haven, Connecticut, United States
| | - Swethasri Dravida
- Yale School of Medicine, Interdepartmental Neuroscience Program New Haven, Connecticut, United States
| | - Courtney DiCocco
- Yale School of Medicine, Brain Function Laboratory, New Haven, Connecticut, United States
| | - Tatsuya Suzuki
- Meiji University, Graduate School of Science and Technology, Electrical Engineering Program, Kawasaki, Japan
- Meiji University, School of Science and Technology, Department of Electronics and Bioinformatics, Kawasaki, Japan
| | - Richard N. Aslin
- Haskins Laboratories, New Haven, Connecticut, United States
- Yale University, Department of Psychology, New Haven, Connecticut, United States
| | - Ilias Tachtsidis
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Joy Hirsch
- Yale School of Medicine, Department of Psychiatry, Brain Function Laboratory, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
- Yale School of Medicine, Department of Neuroscience, New Haven, Connecticut, United States
- Yale School of Medicine, Department of Comparative Medicine, New Haven, Connecticut, United States
- Address all correspondence to Joy Hirsch,
| |
Collapse
|
6
|
Keshmiri S. Entropy and the Brain: An Overview. ENTROPY (BASEL, SWITZERLAND) 2020; 22:E917. [PMID: 33286686 PMCID: PMC7597158 DOI: 10.3390/e22090917] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 07/25/2020] [Accepted: 08/19/2020] [Indexed: 12/17/2022]
Abstract
Entropy is a powerful tool for quantification of the brain function and its information processing capacity. This is evident in its broad domain of applications that range from functional interactivity between the brain regions to quantification of the state of consciousness. A number of previous reviews summarized the use of entropic measures in neuroscience. However, these studies either focused on the overall use of nonlinear analytical methodologies for quantification of the brain activity or their contents pertained to a particular area of neuroscientific research. The present study aims at complementing these previous reviews in two ways. First, by covering the literature that specifically makes use of entropy for studying the brain function. Second, by highlighting the three fields of research in which the use of entropy has yielded highly promising results: the (altered) state of consciousness, the ageing brain, and the quantification of the brain networks' information processing. In so doing, the present overview identifies that the use of entropic measures for the study of consciousness and its (altered) states led the field to substantially advance the previous findings. Moreover, it realizes that the use of these measures for the study of the ageing brain resulted in significant insights on various ways that the process of ageing may affect the dynamics and information processing capacity of the brain. It further reveals that their utilization for analysis of the brain regional interactivity formed a bridge between the previous two research areas, thereby providing further evidence in support of their results. It concludes by highlighting some potential considerations that may help future research to refine the use of entropic measures for the study of brain complexity and its function. The present study helps realize that (despite their seemingly differing lines of inquiry) the study of consciousness, the ageing brain, and the brain networks' information processing are highly interrelated. Specifically, it identifies that the complexity, as quantified by entropy, is a fundamental property of conscious experience, which also plays a vital role in the brain's capacity for adaptation and therefore whose loss by ageing constitutes a basis for diseases and disorders. Interestingly, these two perspectives neatly come together through the association of entropy and the brain capacity for information processing.
Collapse
Affiliation(s)
- Soheil Keshmiri
- The Thomas N. Sato BioMEC-X Laboratories, Advanced Telecommunications Research Institute International (ATR), Kyoto 619-0237, Japan
| |
Collapse
|
7
|
Ghouse A, Nardelli M, Valenza G. fNIRS Complexity Analysis for the Assessment of Motor Imagery and Mental Arithmetic Tasks. ENTROPY (BASEL, SWITZERLAND) 2020; 22:E761. [PMID: 33286533 PMCID: PMC7517316 DOI: 10.3390/e22070761] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 07/07/2020] [Accepted: 07/08/2020] [Indexed: 12/18/2022]
Abstract
Conventional methods for analyzing functional near-infrared spectroscopy (fNIRS) signals primarily focus on characterizing linear dynamics of the underlying metabolic processes. Nevertheless, linear analysis may underrepresent the true physiological processes that fully characterizes the complex and nonlinear metabolic activity sustaining brain function. Although there have been recent attempts to characterize nonlinearities in fNIRS signals in various experimental protocols, to our knowledge there has yet to be a study that evaluates the utility of complex characterizations of fNIRS in comparison to standard methods, such as the mean value of hemoglobin. Thus, the aim of this study was to investigate the entropy of hemoglobin concentration time series obtained from fNIRS signals and perform a comparitive analysis with standard mean hemoglobin analysis of functional activation. Publicly available data from 29 subjects performing motor imagery and mental arithmetics tasks were exploited for the purpose of this study. The experimental results show that entropy analysis on fNIRS signals may potentially uncover meaningful activation areas that enrich and complement the set identified through a traditional linear analysis.
Collapse
Affiliation(s)
- Ameer Ghouse
- Bioengineering and Robotics Research Center E Piaggio, Università di Pisa, 56123 Pisa, Italy; (M.N.); (G.V.)
- Department of Information Engineering, Università di Pisa, 56123 Pisa, Italy
| | - Mimma Nardelli
- Bioengineering and Robotics Research Center E Piaggio, Università di Pisa, 56123 Pisa, Italy; (M.N.); (G.V.)
- Department of Information Engineering, Università di Pisa, 56123 Pisa, Italy
| | - Gaetano Valenza
- Bioengineering and Robotics Research Center E Piaggio, Università di Pisa, 56123 Pisa, Italy; (M.N.); (G.V.)
- Department of Information Engineering, Università di Pisa, 56123 Pisa, Italy
| |
Collapse
|
8
|
Keshmiri S, Sumioka H, Yamazaki R, Shiomi M, Ishiguro H. Information Content of Prefrontal Cortex Activity Quantifies the Difficulty of Narrated Stories. Sci Rep 2019; 9:17959. [PMID: 31784577 PMCID: PMC6884437 DOI: 10.1038/s41598-019-54280-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2019] [Accepted: 11/11/2019] [Indexed: 12/14/2022] Open
Abstract
The ability to realize the individuals' impressions during the verbal communication allows social robots to significantly facilitate their social interactions in such areas as child education and elderly care. However, such impressions are highly subjective and internalized and therefore cannot be easily comprehended through behavioural observations. Although brain-machine interface suggests the utility of the brain information in human-robot interaction, previous studies did not consider its potential for estimating the internal impressions during verbal communication. In this article, we introduce a novel approach to estimation of the individuals' perceived difficulty of stories using the quantified information content of their prefrontal cortex activity. We demonstrate the robustness of our approach by showing its comparable performance in face-to-face, humanoid, speaker, and video-chat settings. Our results contribute to the field of socially assistive robotics by taking a step toward enabling robots determine their human companions' perceived difficulty of conversations, thereby enabling these media to sustain their communication with humans by adapting to individuals' pace and interest in response to conversational nuances and complexity.
Collapse
Affiliation(s)
- Soheil Keshmiri
- Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan.
| | - Hidenobu Sumioka
- Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan
| | - Ryuji Yamazaki
- Symbiotic Intelligent Systems Research Center, Institute for Open and Transdisciplinary Research Initiatives, Osaka University, Osaka, Japan
| | - Masahiro Shiomi
- Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan
| | - Hiroshi Ishiguro
- Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan
- Graduate School of Engineering Science, Osaka University, Osaka, Japan
| |
Collapse
|