Searchlight analysis: promise, pitfalls, and potential

Electroencephalography Searchlight Decoding Reveals Person- and Place-specific Responses for Semantic Category and Familiarity

Proper names are linguistic expressions referring to unique entities, such as individual people or places. This sets them apart from other words like common nouns, which refer to generic concepts. And yet, despite both being individual entities, one's closest friend and one's favorite city are intuitively associated with very different pieces of knowledge-face, voice, social relationship, autobiographical experiences for the former, and mostly visual and spatial information for the latter. Neuroimaging research has revealed the existence of both domain-general and domain-specific brain correlates of semantic processing of individual entities; however, it remains unclear how such commonalities and similarities operate over a fine-grained temporal scale. In this work, we tackle this question using EEG and multivariate (time-resolved and searchlight) decoding analyses. We look at when and where we can accurately decode the semantic category of a proper name and whether we can find person- or place-specific effects of familiarity, which is a modality-independent dimension and therefore avoids sensorimotor differences inherent among the two categories. Semantic category can be decoded in a time window and with spatial localization typically associated with lexical semantic processing. Regarding familiarity, our results reveal that it is easier to distinguish patterns of familiarity-related evoked activity for people, as opposed to places, in both early and late time windows. Second, we discover that within the early responses, both domain-general (left posterior-lateral) and domain-specific (right fronto-temporal, only for people) neural patterns can be individuated, suggesting the existence of person-specific processes.

Functional Connectivity-Based Searchlight Multivariate Pattern Analysis for Discriminating Schizophrenia Patients and Predicting Clinical Variables

BACKGROUND

Schizophrenia, a multifaceted psychiatric disorder characterized by functional dysconnectivity, poses significant challenges in clinical practice. This study explores the potential of functional connectivity (FC)-based searchlight multivariate pattern analysis (CBS-MVPA) to discriminate between schizophrenia patients and healthy controls while also predicting clinical variables.

STUDY DESIGN

We enrolled 112 schizophrenia patients and 119 demographically matched healthy controls. Resting-state functional magnetic resonance imaging data were collected, and whole-brain FC subnetworks were constructed. Additionally, clinical assessments and cognitive evaluations yielded a dataset comprising 36 clinical variables. Finally, CBS-MVPA was utilized to identify subnetworks capable of effectively distinguishing between the patient and control groups and predicting clinical scores.

STUDY RESULTS

The CBS-MVPA approach identified 63 brain subnetworks exhibiting significantly high classification accuracies, ranging from 62.2% to 75.6%, in distinguishing individuals with schizophrenia from healthy controls. Among them, 5 specific subnetworks centered on the dorsolateral superior frontal gyrus, orbital part of inferior frontal gyrus, superior occipital gyrus, hippocampus, and parahippocampal gyrus showed predictive capabilities for clinical variables within the schizophrenia cohort.

CONCLUSION

This study highlights the potential of CBS-MVPA as a valuable tool for localizing the information related to schizophrenia in terms of brain network abnormalities and capturing the relationship between these abnormalities and clinical variables, and thus, deepens our understanding of the neurological mechanisms of schizophrenia.

Family lexicon: Using language models to encode memories of personally familiar and famous people and places in the brain

Knowledge about personally familiar people and places is extremely rich and varied, involving pieces of semantic information connected in unpredictable ways through past autobiographical memories. In this work, we investigate whether we can capture brain processing of personally familiar people and places using subject-specific memories, after transforming them into vectorial semantic representations using language models. First, we asked participants to provide us with the names of the closest people and places in their lives. Then we collected open-ended answers to a questionnaire, aimed at capturing various facets of declarative knowledge. We collected EEG data from the same participants while they were reading the names and subsequently mentally visualizing their referents. As a control set of stimuli, we also recorded evoked responses to a matched set of famous people and places. We then created original semantic representations for the individual entities using language models. For personally familiar entities, we used the text of the answers to the questionnaire. For famous entities, we employed their Wikipedia page, which reflects shared declarative knowledge about them. Through whole-scalp time-resolved and searchlight encoding analyses, we found that we could capture how the brain processes one's closest people and places using person-specific answers to questionnaires, as well as famous entities. Overall encoding performance was significant in a large time window (200-800ms). Using spatio-temporal EEG searchlight, we found that we could predict brain responses significantly better than chance earlier (200-500ms) in bilateral temporo-parietal electrodes and later (500-700ms) in frontal and posterior central electrodes. We also found that XLM, a contextualized (or large) language model, provided superior encoding scores when compared with a simpler static language model as word2vec. Overall, these results indicate that language models can capture subject-specific semantic representations as they are processed in the human brain, by exploiting small-scale distributional lexical data.

Reading disability is characterized by reduced print-speech convergence

Reading disability (RD) may be characterized by reduced print-speech convergence, which is the extent to which neurocognitive processes for reading and hearing words overlap. We examined how print-speech convergence changes from children (mean age: 11.07+0.48) to adults (mean age: 21.33+1.80) in 86 readers with or without RD. The participants were recruited in elementary schools and associate degree colleges in China (from 2020 to 2021). Three patterns of abnormalities were revealed: (1) persistent reduction of print-speech convergence in the left inferior parietal cortex in both children and adults with RD, suggesting a neural signature of RD; (2) reduction of print-speech convergence in the left inferior frontal gyrus only evident in children but not adults with RD, suggesting a developmental delay; and (3) increased print-speech convergence in adults with RD than typical adults in the bilateral cerebella/fusiform, suggesting compensations. It provides insights into developmental differences in brain functional abnormalities in RD.

A common and specialized neural code for social attention triggered by eye gaze and biological motion

Humans appear to be endowed with the ability to readily share attention with interactive partners through the utilization of social direction cues, such as eye gaze and biological motion (BM). Here, we investigated the specialized brain mechanism underlying this fundamental social attention ability by incorporating different types of social (i.e., BM, gaze) and non-social (arrow) cues and combining functional magnetic resonance imaging (fMRI) with a modified central cueing paradigm. Using multi-voxel pattern analysis (MVPA), we found that although gaze- and BM-mediated attentional orienting could be decoded from neural activity in a wide range of brain areas, only the right anterior and posterior superior temporal sulcus (aSTS and pSTS) could specifically decode attentional orienting triggered by social but not non-social cues. Critically, cross-category MVPA further revealed that social attention could be decoded across BM and gaze cues in the right STS and the right superior temporal gyrus (STG). However, these regions could not decode attentional orienting across social and non-social cues. These findings together provide evidence for the existence of a specialized social attention module in the human brain, with the right STS/STG being the critical neural site dedicated to social attention.

The Role of the Medial Prefrontal Cortex in Spatial Margin of Safety Calculations

Naturalistic observations show that animals pre-empt danger by moving to locations that increase their success in avoiding future threats. To test this in humans, we created a spatial margin of safety (MOS) decision task that quantifies pre-emptive avoidance by measuring the distance subjects place themselves to safety when facing different threats whose attack locations vary in predictability. Behavioral results show that human participants place themselves closer to safe locations when facing threats that attack in spatial locations with more outliers. Using both univariate and multivariate pattern analysis (MVPA) on fMRI data collected during a 2 h session on participants of both sexes, we demonstrate a dissociable role for the vmPFC in MOS-related decision-making. MVPA results revealed that the posterior vmPFC encoded for more unpredictable threats with univariate analyses showing a functional coupling with the amygdala and hippocampus. Conversely, the anterior vmPFC was more active for the more predictable attacks and showed coupling with the striatum. Our findings converge in showing that during pre-emptive danger, the anterior vmPFC may provide a safety signal, possibly via foreseeable outcomes, while the posterior vmPFC drives unpredictable danger signals.

Identifying gray matter alterations in Cushing's disease using machine learning: An interpretable approach

BACKGROUND

Cushing's Disease (CD) is a rare clinical syndrome characterized by excessive secretion of adrenocorticotrophic hormone, leading to significant functional and structural brain alterations as observed in Magnetic Resonance Imaging (MRI). While traditional statistical analysis has been widely employed to investigate these MRI changes in CD, it has lacked the ability to predict individual-level outcomes.

PURPOSE

To address this problem, this paper has proposed an interpretable machine learning (ML) framework, including model-level assessment, feature-level assessment, and biology-level assessment to ensure a comprehensive analysis based on structural MRI of CD.

METHODS

The ML framework has effectively identified the changes in brain regions in the stage of model-level assessment, verified the effectiveness of these altered brain regions to predict CD from normal controls in the stage of feature-level assessment, and carried out a correlation analysis between altered brain regions and clinical symptoms in the stage of biology-level assessment.

RESULTS

The experimental results of this study have demonstrated that the Insula, Fusiform gyrus, Superior frontal gyrus, Precuneus, and the opercular portion of the Inferior frontal gyrus of CD showed significant alterations in brain regions. Furthermore, our study has revealed significant correlations between clinical symptoms and the frontotemporal lobes, insulin, and olfactory cortex, which also have been confirmed by previous studies.

CONCLUSIONS

The ML framework proposed in this study exhibits exceptional potential in uncovering the intricate pathophysiological mechanisms underlying CD, with potential applicability in diagnosing other diseases.

Intergenerational transmission of brain structure and function in humans: a narrative review of designs, methods, and findings

Children often show cognitive and affective traits that are similar to their parents. Although this indicates a transmission of phenotypes from parents to children, little is known about the neural underpinnings of that transmission. Here, we provide a general overview of neuroimaging studies that explore the similarity between parents and children in terms of brain structure and function. We notably discuss the aims, designs, and methods of these so-called intergenerational neuroimaging studies, focusing on two main designs: the parent-child design and the multigenerational design. For each design, we also summarize the major findings, identify the sources of variability between studies, and highlight some limitations and future directions. We argue that the lack of consensus in defining the parent-child transmission of brain structure and function leads to measurement heterogeneity, which is a challenge for future studies. Additionally, multigenerational studies often use measures of family resemblance to estimate the proportion of variance attributed to genetic versus environmental factors, though this estimate is likely inflated given the frequent lack of control for shared environment. Nonetheless, intergenerational neuroimaging studies may still have both clinical and theoretical relevance, not because they currently inform about the etiology of neuromarkers, but rather because they may help identify neuromarkers and test hypotheses about neuromarkers coming from more standard neuroimaging designs.

Mapping the neural mechanism that distinguishes between holistic thinking and analytic thinking

Holistic and analytic thinking are two distinct modes of thinking used to interpret the world with relative preferences varying across cultures. While most research on these thinking styles has focused on behavioral and cognitive aspects, a few studies have utilized functional magnetic resonance imaging (fMRI) to explore the correlations between brain metrics and self-reported scale scores. Other fMRI studies used single holistic and analytic thinking tasks. As a single task may involve processing in spurious low-level regions, we used two different holistic and analytic thinking tasks, namely the frame-line task and the triad task, to seek convergent brain regions to distinguish holistic and analytic thinking using multivariate pattern analysis (MVPA). Results showed that brain regions fundamental to distinguish holistic and analytic thinking include the bilateral frontal lobes, bilateral parietal lobes, bilateral precentral and postcentral gyrus, bilateral supplementary motor areas, bilateral fusiform, bilateral insula, bilateral angular gyrus, left cuneus, and precuneus, left olfactory cortex, cingulate gyrus, right caudate and putamen. Our study maps brain regions that distinguish between holistic and analytic thinking and provides a new approach to explore the neural representation of cultural constructs. We provide initial evidence connecting culture-related brain regions with language function to explain the origins of cultural differences in cognitive styles.

Hydroxyurea maintains working memory function in pediatric sickle cell disease

Sickle cell disease (SCD) decreases the oxygen-carrying capacity of red blood cells. Children with SCD have reduced/restricted cerebral blood flow, resulting in neurocognitive deficits. Hydroxyurea is the standard treatment for SCD; however, whether hydroxyurea influences such effects is unclear. A key area of SCD-associated neurocognitive impairment is working memory, which is implicated in other cognitive and academic skills. The neural correlates of working memory can be tested using n-back tasks. We analyzed functional magnetic resonance imaging (fMRI) data of patients with SCD (20 hydroxyurea-treated patients and 11 controls, aged 7-18 years) while they performed n-back tasks. Blood-oxygenation level-dependent (BOLD) signals were assessed during working memory processing at 2 time points: before hydroxyurea treatment and ~1 year after treatment was initiated. Neurocognitive measures were also assessed at both time points. Our results suggested that working memory was stable in the treated group. We observed a treatment-by-time interaction in the right cuneus and angular gyrus for the 2- >0-back contrast. Searchlight-pattern classification of the 2 time points of the 2-back tasks identified greater changes in the pattern and magnitude of BOLD signals, especially in the posterior regions of the brain, in the control group than in the treated group. In the control group at 1-year follow-up, 2-back BOLD signals increased across time points in several clusters (e.g., right inferior temporal lobe, right angular gyrus). We hypothesize that these changes resulted from increased cognitive effort during working memory processing in the absence of hydroxyurea. In the treated group, 0- to 2-back BOLD signals in the right angular gyrus and left cuneus increased continuously with increasing working memory load, potentially related to a broader dynamic range in response to task difficulty and cognitive effort. These findings suggest that hydroxyurea treatment helps maintain working memory function in SCD.

Functional specialization of medial and lateral orbitofrontal cortex in inferential decision-making

Inferring prospective outcomes and updating behavior are prerequisites for making flexible decisions in the changing world. These abilities are highly associated with the functions of the orbitofrontal cortex (OFC) in humans and animals. The functional specialization of OFC subregions in decision-making has been established in animals. However, the understanding of how human OFC contributes to decision-making remains limited. Therefore, we studied this issue by examining the information representation and functional interactions of human OFC subregions during inference-based decision-making. We found that the medial OFC (mOFC) and lateral OFC (lOFC) collectively represented the inferred outcomes which, however, were context-general coding in the mOFC and context-specific in the lOFC. Furthermore, the mOFC-motor and lOFC-frontoparietal functional connectivity may indicate the motor execution of mOFC and the cognitive control of lOFC during behavioral updating. In conclusion, our findings support the dissociable functional roles of OFC subregions in decision-making.

Revealing Vision-Language Integration in the Brain with Multimodal Networks

We use (multi)modal deep neural networks (DNNs) to probe for sites of multimodal integration in the human brain by predicting stereoen-cephalography (SEEG) recordings taken while human subjects watched movies. We operationalize sites of multimodal integration as regions where a multimodal vision-language model predicts recordings better than unimodal language, unimodal vision, or linearly-integrated language-vision models. Our target DNN models span different architectures (e.g., convolutional networks and transformers) and multimodal training techniques (e.g., cross-attention and contrastive learning). As a key enabling step, we first demonstrate that trained vision and language models systematically outperform their randomly initialized counterparts in their ability to predict SEEG signals. We then compare unimodal and multimodal models against one another. Because our target DNN models often have different architectures, number of parameters, and training sets (possibly obscuring those differences attributable to integration), we carry out a controlled comparison of two models (SLIP and SimCLR), which keep all of these attributes the same aside from input modality. Using this approach, we identify a sizable number of neural sites (on average 141 out of 1090 total sites or 12.94%) and brain regions where multimodal integration seems to occur. Additionally, we find that among the variants of multimodal training techniques we assess, CLIP-style training is the best suited for downstream prediction of the neural activity in these sites.

Contribution of low-level image statistics to EEG decoding of semantic content in multivariate and univariate models with feature optimization

Spatio-temporal patterns of evoked brain activity contain information that can be used to decode and categorize the semantic content of visual stimuli. However, this procedure can be biased by low-level image features independently of the semantic content present in the stimuli, prompting the need to understand the robustness of different models regarding these confounding factors. In this study, we trained machine learning models to distinguish between concepts included in the publicly available THINGS-EEG dataset using electroencephalography (EEG) data acquired during a rapid serial visual presentation paradigm. We investigated the contribution of low-level image features to decoding accuracy in a multivariate model, utilizing broadband data from all EEG channels. Additionally, we explored a univariate model obtained through data-driven feature selection applied to the spatial and frequency domains. While the univariate models exhibited better decoding accuracy, their predictions were less robust to the confounding effect of low-level image statistics. Notably, some of the models maintained their accuracy even after random replacement of the training dataset with semantically unrelated samples that presented similar low-level content. In conclusion, our findings suggest that model optimization impacts sensitivity to confounding factors, regardless of the resulting classification performance. Therefore, the choice of EEG features for semantic decoding should ideally be informed by criteria beyond classifier performance, such as the neurobiological mechanisms under study.

The neural basis of resting-state fMRI functional connectivity in fronto-limbic circuits revealed by chemogenetic manipulation

Measures of fMRI resting-state functional connectivity (rs-FC) are an essential tool for basic and clinical investigations of fronto-limbic circuits. Understanding the relationship between rs-FC and the underlying patterns of neural activity in these circuits is therefore vital. Here we introduced inhibitory designer receptors exclusively activated by designer drugs (DREADDs) into the amygdala of two male macaques. We evaluated the causal effect of activating the DREADD receptors on rs-FC and neural activity within circuits connecting amygdala and frontal cortex. Activating the inhibitory DREADD increased rs-FC between amygdala and ventrolateral prefrontal cortex. Neurophysiological recordings revealed that the DREADD-induced increase in fMRI rs-FC was associated with increased local field potential coherency in the alpha band (6.5-14.5 Hz) between amygdala and ventrolateral prefrontal cortex. Thus, our multi-modal approach reveals the specific signature of neuronal activity that underlies rs-FC in fronto-limbic circuits.

Functional ultrasound imaging of human brain activity through an acoustically transparent cranial window

Visualization of human brain activity is crucial for understanding normal and aberrant brain function. Currently available neural activity recording methods are highly invasive, have low sensitivity, and cannot be conducted outside of an operating room. Functional ultrasound imaging (fUSI) is an emerging technique that offers sensitive, large-scale, high-resolution neural imaging; however, fUSI cannot be performed through the adult human skull. Here, we used a polymeric skull replacement material to create an acoustic window compatible with fUSI to monitor adult human brain activity in a single individual. Using an in vitro cerebrovascular phantom to mimic brain vasculature and an in vivo rodent cranial defect model, first, we evaluated the fUSI signal intensity and signal-to-noise ratio through polymethyl methacrylate (PMMA) cranial implants of different thicknesses or a titanium mesh implant. We found that rat brain neural activity could be recorded with high sensitivity through a PMMA implant using a dedicated fUSI pulse sequence. We then designed a custom ultrasound-transparent cranial window implant for an adult patient undergoing reconstructive skull surgery after traumatic brain injury. We showed that fUSI could record brain activity in an awake human outside of the operating room. In a video game "connect the dots" task, we demonstrated mapping and decoding of task-modulated cortical activity in this individual. In a guitar-strumming task, we mapped additional task-specific cortical responses. Our proof-of-principle study shows that fUSI can be used as a high-resolution (200 μm) functional imaging modality for measuring adult human brain activity through an acoustically transparent cranial window.

Temporally organized representations of reward and risk in the human brain

The value and uncertainty associated with choice alternatives constitute critical features relevant for decisions. However, the manner in which reward and risk representations are temporally organized in the brain remains elusive. Here we leverage the spatiotemporal precision of intracranial electroencephalography, along with a simple card game designed to elicit the unfolding computation of a set of reward and risk variables, to uncover this temporal organization. Reward outcome representations across wide-spread regions follow a sequential order along the anteroposterior axis of the brain. In contrast, expected value can be decoded from multiple regions at the same time, and error signals in both reward and risk domains reflect a mixture of sequential and parallel encoding. We further highlight the role of the anterior insula in generalizing between reward prediction error and risk prediction error codes. Together our results emphasize the importance of neural dynamics for understanding value-based decisions under uncertainty.

Scene-selectivity in CA1/subicular complex: Multivoxel pattern analysis at 7T

Prior univariate functional magnetic resonance imaging (fMRI) studies in humans suggest that the anteromedial subicular complex of the hippocampus is a hub for scene-based cognition. However, it is possible that univariate approaches were not sufficiently sensitive to detect scene-related activity in other subfields that have been implicated in spatial processing (e.g., CA1). Further, as connectivity-based functional gradients in the hippocampus do not respect classical subfield boundary definitions, category selectivity may be distributed across anatomical subfields. Region-of-interest approaches, therefore, may limit our ability to observe category selectivity across discrete subfield boundaries. To address these issues, we applied searchlight multivariate pattern analysis to 7T fMRI data of healthy adults who undertook a simultaneous visual odd-one-out discrimination task for scene and non-scene (including face) visual stimuli, hypothesising that scene classification would be possible in multiple hippocampal regions within, but not constrained to, anteromedial subicular complex and CA1. Indeed, we found that the scene-selective searchlight map overlapped not only with anteromedial subicular complex (distal subiculum, pre/para subiculum), but also inferior CA1, alongside posteromedial (including retrosplenial) and parahippocampal cortices. Probabilistic overlap maps revealed gradients of scene category selectivity, with the strongest overlap located in the medial hippocampus, converging with searchlight findings. This was contrasted with gradients of face category selectivity, which had stronger overlap in more lateral hippocampus, supporting ideas of parallel processing streams for these two categories. Our work helps to map the scene, in contrast to, face processing networks within, and connected to, the human hippocampus.

Transcriptional correlates of frequency-dependent brain functional activity associated with symptom severity in degenerative cervical myelopathy

BACKGROUND

Neuroimaging techniques provide insights into the brain abnormalities secondary to degenerative cervical myelopathy (DCM) and their association with neurological deficits. However, the neural correlates underlying the discrepancy between symptom severity and the degree of spinal cord compression, as well as the transcriptional correlates of these cortical abnormalities, remain unknown in DCM patients.

METHODS

In this cross-sectional study, which collected resting-state functional MRI (rs-fMRI) images and the Japanese Orthopedic Association (JOA) score, enrolled 104 participants (54 patients and 50 healthy controls). The frequency-dependent amplitude of low-frequency fluctuation (ALFF) was obtained for all participants. We investigated the ALFF differences between mild-symptom DCM patients and severe-symptom DCM patients while carefully matching the degree of compression between these two groups via both univariate comparison and searchlight classification for three frequency bands (e.g., Slow-4, Slow-5, and Full-band). Additionally, we identified genes associated with symptom severity in DCM patients by linking the spatial patterns of gene expression of Allen Human Brain Atlas and brain functional differences between mild symptom and severe symptom groups.

RESULTS

(1) We found that the frequency-specific brain activities within the sensorimotor network (SMN), visual network (VN), and default mode network (DMN) were associated with the varying degrees of functional impairment in DCM patients; (2) the frequency-specific brain activity within the SMN correlated with the functional recovery in patients with DCM; (3) a spatial correlation between the brain-wide expression of genes involved in neuronal migration and the brain functional activities associated with symptom severity was identified in DCM patients.

CONCLUSION

In conclusion, our study bridges gaps between genes, cell classes, biological processes, and brain functional correlates of DCM. While our findings are correlational in nature, they suggest that the neural activities of sensorimotor cortices in DCM are associated with the severity of symptoms and might be associated with neuronal migration within the brain.

BackWards - Unveiling the brain's topographic organization of paraspinal sensory input

Cortical reorganization and its potential pathological significance are being increasingly studied in musculoskeletal disorders such as chronic low back pain (CLBP) patients. However, detailed sensory-topographic maps of the human back are lacking, and a baseline characterization of such representations, reflecting the somatosensory organization of the healthy back, is needed before exploring potential sensory map reorganization. To this end, a novel pneumatic vibrotactile stimulation method was used to stimulate paraspinal sensory afferents, while studying their cortical representations in unprecedented detail. In 41 young healthy participants, vibrotactile stimulations at 20 Hz and 80 Hz were applied bilaterally at nine locations along the thoracolumbar axis while functional magnetic resonance imaging (fMRI) was performed. Model-based whole-brain searchlight representational similarity analysis (RSA) was used to investigate the organizational structure of brain activity patterns evoked by thoracolumbar sensory inputs. A model based on segmental distances best explained the similarity structure of brain activity patterns that were located in different areas of sensorimotor cortices, including the primary somatosensory and motor cortices and parts of the superior parietal cortex, suggesting that these brain areas process sensory input from the back in a "dermatomal" manner. The current findings provide a sound basis for testing the "cortical map reorganization theory" and its pathological relevance in CLBP.

Hydroxyurea maintains working memory function in pediatric sickle cell disease

Pediatric patients with sickle cell disease (SCD) have decreased oxygen-carrying capacity in the blood and reduced or restricted cerebral blood flow resulting in neurocognitive deficits and cerebral infarcts. The standard treatment for children with SCD is hydroxyurea; however, the treatment-related neurocognitive effects are unclear. A key area of impairment in SCD is working memory, which is implicated in other cognitive and academic skills. N-back tasks are commonly used to investigate neural correlates of working memory. We analyzed functional magnetic resonance imaging (fMRI) of patients with SCD while they performed n-back tasks by assessing the blood-oxygenation level-dependent (BOLD) signals during working memory processing. Twenty hydroxyurea-treated and 11 control pediatric patients with SCD (7-18 years old) performed 0-, 1-, and 2-back tasks at 2 time points, once before hydroxyurea treatment (baseline) and ~1 year after treatment (follow-up). Neurocognitive measures (e.g., verbal comprehension, processing speed, full-scale intelligence quotient, etc.) were assessed at both time points. Although no significant changes in behavior performance of n-back tasks and neurocognitive measures were observed in the treated group, we observed a treatment-by-time interaction in the right cuneus and angular gyrus for the 2- > 0-back contrast. Through searchlight-pattern classifications in the treated and control groups to identify changes in brain activation between time points during the 2-back task, we found more brain areas, especially the posterior region, with changes in the pattern and magnitude of BOLD signals in the control group compared to the treated group. In the control group, increases in 2-back BOLD signals were observed in the right crus I cerebellum, right inferior parietal lobe, right inferior temporal lobe, right angular gyrus, left cuneus and left middle frontal gyrus at 1-year follow-up. Moreover, BOLD signals elevated as the working memory load increased from 0- to 1-back but did not increase further from 1- to 2-back in the right inferior temporal lobe, right angular gyrus, and right superior frontal gyrus. These observations may result from increased cognitive effort during working memory processing with no hydroxyurea treatment. In contrast, we found fewer changes in the pattern and magnitude of BOLD signals across time points in the treated group. Furthermore, BOLD signals in the left crus I cerebellum, right angular gyrus, left cuneus and right superior frontal gyrus of the treated group increased continuously with increasing working memory load from 0- to 2-back, potentially related to a broader dynamic range in response to task difficulty and cognitive effort. Collectively, these findings suggest that hydroxyurea treatment helped maintain working memory function in SCD.

A systematic review of neuroimaging approaches to mapping language in individuals

Although researchers often rely on group-level fMRI results to draw conclusions about the neurobiology of language, doing so without accounting for the complexities of individual brains may reduce the validity of our findings. Furthermore, understanding brain organization in individuals is critically important for both basic science and clinical translation. To assess the state of single-subject language localization in the functional neuroimaging literature, we carried out a systematic review of studies published through April 2020. Out of 977 papers identified through our search, 121 met our inclusion criteria for reporting single-subject fMRI results (fMRI studies of language in adults that report task-based single-subject statistics). Of these, 20 papers reported using a single-subject test-retest analysis to assess reliability. Thus, we found that a relatively modest number of papers reporting single-subject results quantified single-subject reliability. These varied substantially in acquisition parameters, task design, and reliability measures, creating significant challenges for making comparisons across studies. Future endeavors to optimize the localization of language networks in individuals will benefit from the standardization and broader reporting of reliability metrics for different tasks and acquisition parameters.

The neural basis of resting-state fMRI functional connectivity in fronto-limbic circuits revealed by chemogenetic manipulation

Measures of fMRI resting-state functional connectivity (rs-FC) are an essential tool for basic and clinical investigations of fronto-limbic circuits. Understanding the relationship between rs-FC and neural activity in these circuits is therefore vital. Here we introduced inhibitory designer receptors exclusively activated by designer drugs (DREADDs) into the macaque amygdala and activated them with a highly selective and potent DREADD agonist, deschloroclozapine. We evaluated the causal effect of activating the DREADD receptors on rs-FC and neural activity within circuits connecting amygdala and frontal cortex. Interestingly, activating the inhibitory DREADD increased rs-FC between amygdala and ventrolateral prefrontal cortex. Neurophysiological recordings revealed that the DREADD-induced increase in fMRI rs-FC was associated with increased local field potential coherency in the alpha band (6.5-14.5Hz) between amygdala and ventrolateral prefrontal cortex. Thus, our multi-disciplinary approach reveals the specific signature of neuronal activity that underlies rs-FC in fronto-limbic circuits.

Grasping with a Twist: Dissociating Action Goals from Motor Actions in Human Frontoparietal Circuits

In daily life, prehension is typically not the end goal of hand-object interactions but a precursor for manipulation. Nevertheless, functional MRI (fMRI) studies investigating manual manipulation have primarily relied on prehension as the end goal of an action. Here, we used slow event-related fMRI to investigate differences in neural activation patterns between prehension in isolation and prehension for object manipulation. Sixteen (seven males and nine females) participants were instructed either to simply grasp the handle of a rotatable dial (isolated prehension) or to grasp and turn it (prehension for object manipulation). We used representational similarity analysis (RSA) to investigate whether the experimental conditions could be discriminated from each other based on differences in task-related brain activation patterns. We also used temporal multivoxel pattern analysis (tMVPA) to examine the evolution of regional activation patterns over time. Importantly, we were able to differentiate isolated prehension and prehension for manipulation from activation patterns in the early visual cortex, the caudal intraparietal sulcus (cIPS), and the superior parietal lobule (SPL). Our findings indicate that object manipulation extends beyond the putative cortical grasping network (anterior intraparietal sulcus, premotor and motor cortices) to include the superior parietal lobule and early visual cortex.SIGNIFICANCE STATEMENT A simple act such as turning an oven dial requires not only that the CNS encode the initial state (starting dial orientation) of the object but also the appropriate posture to grasp it to achieve the desired end state (final dial orientation) and the motor commands to achieve that state. Using advanced temporal neuroimaging analysis techniques, we reveal how such actions unfold over time and how they differ between object manipulation (turning a dial) versus grasping alone. We find that a combination of brain areas implicated in visual processing and sensorimotor integration can distinguish between the complex and simple tasks during planning, with neural patterns that approximate those during the actual execution of the action.

Effects of Experiencing CS-US Pairings on Instructed Fear Reversal

Fear learning allows us to identify and anticipate aversive events and adapt our behavior accordingly. This is often thought to rely on associative learning mechanisms where an initially neutral conditioned stimulus (CS) is repeatedly paired with an aversive unconditioned stimulus (US), eventually leading to the CS also being perceived as aversive and threatening. Importantly, however, humans also show verbal fear learning. Namely, they have the ability to change their responses to stimuli rapidly through verbal instructions about CS-US pairings. Past research on the link between experience-based and verbal fear learning indicated that verbal instructions about a reversal of CS-US pairings can fully override the effects of previously experienced CS-US pairings, as measured through fear ratings, skin conductance, and fear-potentiated startle. However, it remains an open question whether such instructions can also annul learned CS representations in the brain. Here, we used a fear reversal paradigm (female and male participants) in conjunction with representational similarity analysis of fMRI data to test whether verbal instructions fully override the effects of experienced CS-US pairings in fear-related brain regions or not. Previous research suggests that only the right amygdala should show lingering representations of previously experienced threat ("pavlovian trace"). Unexpectedly, we found evidence for the residual effect of prior CS-US experience to be much more widespread than anticipated, in the amygdala but also cortical regions like the dorsal anterior cingulate or dorsolateral prefrontal cortex. This finding shines a new light on the interaction of different fear learning mechanisms, at times with unexpected consequences.SIGNIFICANCE STATEMENT Humans are able to learn about aversive stimuli both from experience (i.e., repeated pairings of conditioned stimulus (CS) and unconditioned stimulus (US; pavlovian conditioning), and from verbal instructions about stimulus pairings. Understanding how experience-based and verbal learning processes interact is key for understanding the cognitive and neural underpinnings of fear learning. We tested whether prior aversive experiences (CS-US pairings) affected subsequent verbal learning, searching for lingering threat signals after verbal instructions reversed a CS from being threatening to being safe. While past research suggested such threat signals can only be found in the amygdala, we found evidence to be much more widespread, including the medial and lateral PFC. This highlights how experience-based and verbal learning processes interact to support adaptive behavior.

Near-field potentials index local neural computations more accurately than population spiking

Local field potentials (LFP) are low-frequency extracellular voltage fluctuations thought to primarily arise from synaptic activity. However, unlike highly localized neuronal spiking, LFP is spatially less specific. LFP measured at one location is not entirely generated there due to far-field contributions that are passively conducted across volumes of neural tissue. We sought to quantify how much information within the locally generated, near-field low-frequency activity (nfLFP) is masked by volume-conducted far-field signals. To do so, we measured laminar neural activity in primary visual cortex (V1) of monkeys viewing sequences of multifeatured stimuli. We compared information content of regular LFP and nfLFP that was mathematically stripped of volume-conducted far-field contributions. Information content was estimated by decoding stimulus properties from neural responses via spatiotemporal multivariate pattern analysis. Volume-conducted information differed from locally generated information in two important ways: (1) for stimulus features relevant to V1 processing (orientation and eye-of-origin), nfLFP contained more information. (2) in contrast, the volume-conducted signal was more informative regarding temporal context (relative stimulus position in a sequence), a signal likely to be coming from elsewhere. Moreover, LFP and nfLFP differed both spectrally as well as spatially, urging caution regarding the interpretations of individual frequency bands and/or laminar patterns of LFP. Most importantly, we found that population spiking of local neurons was less informative than either the LFP or nfLFP, with nfLFP containing most of the relevant information regarding local stimulus processing. These findings suggest that the optimal way to read out local computational processing from neural activity is to decode the local contributions to LFP, with significant information loss hampering both regular LFP and local spiking.

Author’s Contributions

Conceptualization, D.A.T., J.A.W, and A.M.; Data Collection, J.A.W., M.A.C., K.D.; Formal Analysis, D.A.T. and J.A.W.; Data Visualization, D.A.T. and J.A.W.; Original Draft, D.A.T., J.A.W., and A.M.; Revisions and Final Draft, D.A.T., J.A.W., M.A.C., K.D., M.T.W., A.M.B., and A.M.

Competing Interests

The authors declare no conflicts of interest.

Cross-stage neural pattern similarity in the hippocampus predicts false memory derived from post-event inaccurate information

The misinformation effect occurs when people's memory of an event is altered by subsequent inaccurate information. No study has systematically tested theories about the dynamics of human hippocampal representations during the three stages of misinformation-induced false memory. This study replicates behavioral results of the misinformation effect, and investigates the cross-stage pattern similarity in the hippocampus and cortex using functional magnetic resonance imaging. Results show item-specific hippocampal pattern similarity between original-event and post-event stages. During the memory-test stage, hippocampal representations of original information are weakened for true memory, whereas hippocampal representations of misinformation compete with original information to create false memory. When false memory occurs, this conflict is resolved by the lateral prefrontal cortex. Individuals' memory traces of post-event information in the hippocampus predict false memory, whereas original information in the lateral parietal cortex predicts true memory. These findings support the multiple-trace model, and emphasize the reconstructive nature of human memory.

High-throughput sequencing of macaque basolateral amygdala projections reveals dissociable connectional motifs with frontal cortex

The basolateral amygdala (BLA) projects widely across the macaque frontal cortex1-4, and amygdalo-frontal projections are critical for optimal emotional responding5 and decision-making6. Yet, little is known about the single-neuron architecture of these projections: namely, whether single BLA neurons project to multiple parts of the frontal cortex. Here, we use MAPseq7 to determine the projection patterns of over 3000 macaque BLA neurons. We found that one-third of BLA neurons have two or more distinct targets in parts of frontal cortex and of subcortical structures. Further, we reveal non-random structure within these branching patterns such that neurons with four targets are more frequently observed than those with two or three, indicative of widespread networks. Consequently, these multi-target single neurons form distinct networks within medial and ventral frontal cortex consistent with their known functions in regulating mood and decision-making. Additionally, we show that branching patterns of single neurons shape functional networks in the brain as assessed by fMRI-based functional connectivity. These results provide a neuroanatomical basis for the role of the BLA in coordinating brain-wide responses to valent stimuli8 and highlight the importance of high-resolution neuroanatomical data for understanding functional networks in the brain.

Two distinct networks containing position-tolerant representations of actions in the human brain

Humans can recognize others' actions in the social environment. This action recognition ability is rarely hindered by the movement of people in the environment. The neural basis of this position tolerance for observed actions is not fully understood. Here, we aimed to identify brain regions capable of generalizing representations of actions across different positions and investigate the representational content of these regions. In a functional magnetic resonance imaging experiment, participants viewed point-light displays of different human actions. Stimuli were presented in either the upper or the lower visual field. Multivariate pattern analysis and a surface-based searchlight approach were employed to identify brain regions that contain position-tolerant action representation: Classifiers were trained with patterns in response to stimuli presented in one position and were tested with stimuli presented in another position. Results showed above-chance classification in the left and right lateral occipitotemporal cortices, right intraparietal sulcus, and right postcentral gyrus. Further analyses exploring the representational content of these regions showed that responses in the lateral occipitotemporal regions were more related to subjective judgments, while those in the parietal regions were more related to objective measures. These results provide evidence for two networks that contain abstract representations of human actions with distinct representational content.

Neural fatigue by passive induction: repeated stimulus exposure results in cognitive fatigue and altered representations in task-relevant networks

Cognitive fatigue is defined by a reduced capacity to perform mental tasks. Despite its pervasiveness, the underlying neural mechanisms remain elusive. Specifically, it is unclear whether prolonged effort affects performance through alterations in over-worked task-relevant neuronal assemblies. Our paradigm based on repeated passive visual stimulation discerns fatigue effects from the influence of motivation, skill and boredom. We induced performance loss and observed parallel alterations in the neural blueprint of the task, by mirroring behavioral performance with multivariate neuroimaging techniques (MVPA) that afford a subject-specific approach. Crucially, functional areas that responded the most to repeated stimulation were also the most affected. Finally, univariate analysis revealed clusters displaying significant disruption within the extrastriate visual cortex. In sum, here we show that repeated stimulation impacts the implicated brain areas' activity and causes tangible behavioral repercussions, providing evidence that cognitive fatigue can result from local, functional, disruptions in the neural signal induced by protracted recruitment.

Identifying and distinguishing of essential tremor and Parkinson's disease with grouped stability analysis based on searchlight-based MVPA

BACKGROUND

Since both essential tremor (ET) and Parkinson's disease (PD) are movement disorders and share similar clinical symptoms, it is very difficult to recognize the differences in the presentation, course, and treatment of ET and PD, which leads to misdiagnosed commonly.

PURPOSE

Although neuroimaging biomarker of ET and PD has been investigated based on statistical analysis, it is unable to assist the clinical diagnosis of ET and PD and ensure the efficiency of these biomarkers. The aim of the study was to identify the neuroimaging biomarkers of ET and PD based on structural magnetic resonance imaging (MRI). Moreover, the study also distinguished ET from PD via these biomarkers to validate their classification performance.

METHODS

This study has developed and implemented a three-level machine learning framework to identify and distinguish ET and PD. First of all, at the model-level assessment, the searchlight-based machine learning method has been used to identify the group differences of patients (ET/PD) with normal controls (NCs). And then, at the feature-level assessment, the stability of group differences has been tested based on structural brain atlas separately using the permutation test to identify the robust neuroimaging biomarkers. Furthermore, the identified biomarkers of ET and PD have been applied to classify ET from PD based on machine learning techniques. Finally, the identified biomarkers have been compared with the previous findings of the biology-level assessment.

RESULTS

According to the biomarkers identified by machine learning, this study has found widespread alterations of gray matter (GM) for ET and large overlap between ET and PD and achieved superior classification performance (PCA + SVM, accuracy = 100%).

CONCLUSIONS

This study has demonstrated the significance of a machine learning framework to identify and distinguish ET and PD. Future studies using a large data set are needed to confirm the potential clinical application of machine learning techniques to discern between PD and ET.

Machine learning of large-scale multimodal brain imaging data reveals neural correlates of hand preference

Lateralization is a fundamental characteristic of many behaviors and the organization of the brain, and atypical lateralization has been suggested to be linked to various brain-related disorders such as autism and schizophrenia. Right-handedness is one of the most prominent markers of human behavioural lateralization, yet its neurobiological basis remains to be determined. Here, we present a large-scale analysis of handedness, as measured by self-reported direction of hand preference, and its variability related to brain structural and functional organization in the UK Biobank (N = 36,024). A multivariate machine learning approach with multi-modalities of brain imaging data was adopted, to reveal how well brain imaging features could predict individual's handedness (i.e., right-handedness vs. non-right-handedness) and further identify the top brain signatures that contributed to the prediction. Overall, the results showed a good prediction performance, with an area under the receiver operating characteristic curve (AUROC) score of up to 0.72, driven largely by resting-state functional measures. Virtual lesion analysis and large-scale decoding analysis suggested that the brain networks with the highest importance in the prediction showed functional relevance to hand movement and several higher-level cognitive functions including language, arithmetic, and social interaction. Genetic analyses of contributions of common DNA polymorphisms to the imaging-derived handedness prediction score showed a significant heritability (h²=7.55%, p <0.001) that was similar to and slightly higher than that for the behavioural measure itself (h²=6.74%, p <0.001). The genetic correlation between the two was high (r_g=0.71), suggesting that the imaging-derived score could be used as a surrogate in genetic studies where the behavioural measure is not available. This large-scale study using multimodal brain imaging and multivariate machine learning has shed new light on the neural correlates of human handedness.

More complex than you might think: Neural representations of food reward value in obesity

Obesity reached pandemic proportions and weight-loss treatments are mostly ineffective. The level of brain activity in the reward circuitry is proposed to be proportionate to the reward value of food stimuli, and stronger in people with obesity. However, empirical evidence is inconsistent. This may be due to the double-sided nature of high caloric palatable foods: at once highly palatable and high in calories (unhealthy). This study hypothesizes that, viewing high caloric palatable foods, a hedonic attentional focus compared to a health and a neutral attentional focus elicits more activity in reward-related brain regions, mostly in people with obesity. Moreover, caloric content and food palatability can be decoded from multivoxel patterns of activity most accurately in people with obesity and in the corresponding attentional focus. During one fMRI-session, attentional focus (hedonic, health, neutral) was manipulated using a one-back task with individually tailored food stimuli in 32 healthy-weight people and 29 people with obesity. Univariate analyses (p < 0.05, FWE-corrected) showed that brain activity was not different for palatable vs. unpalatable foods, nor for high vs. low caloric foods. Instead, this was higher in the hedonic compared to the health and neutral attentional focus. Multivariate analyses (MVPA) (p < 0.05, FDR-corrected) showed that palatability and caloric content could be decoded above chance level, independently of either BMI or attentional focus. Thus, brain activity to visual food stimuli is neither proportionate to the reward value (palatability and/or caloric content), nor significantly moderated by BMI. Instead, it depends on people's attentional focus, and may reflect motivational salience. Furthermore, food palatability and caloric content are represented as patterns of brain activity, independently of BMI and attentional focus. So, food reward value is reflected in patterns, not levels, of brain activity.

Pattern analysis of neuroimaging data reveals novel insights on threat learning and extinction in humans

Several decades of rodent neurobiology research have identified a network of brain regions that support Pavlovian threat conditioning and extinction, focused predominately on the amygdala, hippocampus, and medial prefrontal cortex (mPFC). Surprisingly, functional magnetic resonance imaging (fMRI) studies have shown inconsistent evidence for these regions while humans undergo threat conditioning and extinction. In this review, we suggest that translational neuroimaging efforts have been hindered by reliance on traditional univariate analysis of fMRI. Whereas univariate analyses average activity across voxels in a given region, multivariate pattern analyses (MVPA) leverage the information present in spatial patterns of activity. MVPA therefore provides a more sensitive analysis tool to translate rodent neurobiology to human neuroimaging. We review human fMRI studies using MVPA that successfully bridge rodent models of amygdala, hippocampus, and mPFC function during Pavlovian learning. We also highlight clinical applications of these information-sensitive multivariate analyses. In sum, we advocate that the field should consider adopting a variety of multivariate approaches to help bridge cutting-edge research on the neuroscience of threat and anxiety.

Local similarity of activity patterns during auditory and visual processing

Neuroimaging studies have shown that brain activity is variable and changes according to stimuli and the environmental context, reflecting brain coding or information representations at different processing levels. However, little is known about activity organization that reflects coding strategies. Here, we explored and compared two different coding approaches, spatial via cross-correlation and intensity-based coding using mutual information. Using two fMRI datasets and different seeds, we searched for the spatial and intensity-based similarities with the seeds in brain activity. Our results showed that, apart from the seed regions, significant regions detected by intensity-based similarity analysis differ completely from those found using cross-correlation. These findings may indicate that information shared through spatial coding differs from that transmitted via non-spatial coding processes. Our results suggest that brain coding is organized in several different ways to optimize information processing.

Functional brain mapping in patients with chronic back pain shows age-related differences

ABSTRACT

Low back pain is the most common pain condition and cause for disability in older adults. Older adults suffering from low back pain are more disabled than their healthy peers, are more predisposed to frailty, and tend to be undertreated. The cause of increased prevalence and severity of this chronic pain condition in older adults is unknown. Here, we draw on accumulating data demonstrating a critical role for brain limbic and sensory circuitries in the emergence and experience of chronic low back pain (CLBP) and the availability of resting-state brain activity data collected at different sites to study how brain activity patterns predictive of CLBP differ between age groups. We apply a data-driven multivariate searchlight analysis to amplitude of low-frequency fluctuation brain maps to classify patients with CLBP with >70% accuracy. We observe that the brain activity pattern including the paracingulate gyrus, insula/secondary somatosensory area, inferior frontal, temporal, and fusiform gyrus predicted CLBP. When separated by age groups, brain patterns predictive of older patients with CLBP showed extensive involvement of limbic brain areas including the ventromedial prefrontal cortex, the nucleus accumbens, and hippocampus, whereas only anterior insula paracingulate and fusiform gyrus predicted CLBP in the younger patients. In addition, we validated the relationships between back pain intensity ratings and CLBP brain activity patterns in an independent data set not included in our initial patterns' identification. Our results are the first to directly address how aging affects the neural signature of CLBP and point to an increased role of limbic brain areas in older patients with CLBP.

Fast construction of interpretable whole-brain decoders

Researchers often seek to decode mental states from brain activity measured with functional MRI. Rigorous decoding requires the use of formal neural prediction models, which are likely to be the most accurate if they use the whole brain. However, the computational burden and lack of interpretability of off-the-shelf statistical methods can make whole-brain decoding challenging. Here, we propose a method to build whole-brain neural decoders that are both interpretable and computationally efficient. We extend the partial least squares algorithm to build a regularized model with variable selection that offers a unique "fit once, tune later" approach: users need to fit the model only once and can choose the best tuning parameters post hoc. We show in real data that our method scales well with increasing data size and yields interpretable predictors. The algorithm is publicly available in multiple languages in the hope that interpretable whole-brain predictors can be implemented more widely in neuroimaging research.

Neural representation of phonological information during Chinese character reading

Previous studies have revealed that phonological processing of Chinese characters elicited activation in the left prefrontal cortex, bilateral parietal cortex, and occipitotemporal regions. However, it is controversial what role the left middle frontal gyrus plays in Chinese character reading, and whether the core regions (e.g., the left superior temporal gyrus and supramarginal gyrus) for phonological processing of alphabetic languages are also involved in Chinese character reading. To address these questions, the present study used both univariate and multivariate analysis (i.e., representational similarity analysis, RSA) to explore neural representations of phonological information during Chinese character reading. Participants were scanned while performing a reading aloud task. Univariate activation analysis revealed a widely distributed network for word reading, including the bilateral inferior frontal gyrus, middle frontal gyrus, lateral temporal cortex, and occipitotemporal cortex. More importantly, RSA showed that the left prefrontal (i.e., the left middle frontal gyrus and left inferior frontal gyrus) and bilateral occipitotemporal areas (i.e., the left inferior and middle temporal gyrus and bilateral fusiform gyrus) represented phonological information of Chinese characters. These results confirmed the importance of the left middle frontal gyrus and regions in ventral pathway in representing phonological information of Chinese characters.

Functional lateralization of the medial temporal lobe in novel associative processing during creativity evaluation

Although hemispheric lateralization of creativity has been a longstanding topic of debate, the underlying neurocognitive mechanism remains poorly understood. Here we designed 2 types of novel stimuli-"novel useful and novel useless," adapted from "familiar useful" designs taken from daily life-to demonstrate how the left and right medial temporal lobe (MTL) respond to novel designs of different usefulness. Taking the "familiar useful" design as a baseline, we found that the right MTL showed increased activation in response to "novel useful" designs, followed by "novel useless" ones, while the left MTL only showed increased activation in response to "novel useful" designs. Calculating an asymmetry index suggests that usefulness processing is predominant in the left MTL, whereas the right MTL is predominantly involved in novelty processing. Moreover, the left parahippocampal gyrus (PHG) showed stronger functional connectivity with the anterior cingulate cortex when responding to "novel useless" designs. In contrast, the right PHG showed stronger connectivity with the amygdala, midbrain, and hippocampus. Critically, multivoxel representational similarity analyses revealed that the left MTL was more effective than the right MTL at distinguishing the usefulness differences in novel stimuli, while representational patterns in the left PHG positively predicted the post-behavior evaluation of "truly creative" products. These findings suggest an apparent dissociation of the left and right MTL in integrating the novelty and usefulness information and novel associative processing during creativity evaluation, respectively. Our results provide novel insights into a longstanding and controversial question in creativity research by demonstrating functional lateralization of the MTL in processing novel associations.

Neural reinstatement reveals divided organization of fear and extinction memories in the human brain

Neurobiological research in rodents has revealed that competing experiences of fear and extinction are stored as distinct memory traces in the brain. This divided organization is adaptive for mitigating overgeneralization of fear to related stimuli that are learned to be safe while also maintaining threat associations for unsafe stimuli. The mechanisms involved in organizing these competing memories in the human brain remain unclear. Here, we used a hybrid form of Pavlovian conditioning with an episodic memory component to identify overlapping multivariate patterns of fMRI activity associated with the formation and retrieval of fear versus extinction. In healthy adults, distinct regions of the medial prefrontal cortex (PFC) and hippocampus showed selective reactivation of fear versus extinction memories based on the temporal context in which these memories were encoded. This dissociation was absent in participants with posttraumatic stress disorder (PTSD) symptoms. The divided neural organization of fear and extinction may support flexible retrieval of context-appropriate emotional memories, while their disorganization may promote overgeneralization and increased fear relapse in affective disorders.

Coordinated multivoxel coding beyond univariate effects is not likely to be observable in fMRI data

Simultaneous recording of activity across brain regions can contain additional information compared to regional recordings done in isolation. In particular, multivariate pattern analysis (MVPA) across voxels has been interpreted as evidence for distributed coding of cognitive or sensorimotor processes beyond what can be gleaned from a collection of univariate effects (UVE) using functional magnetic resonance imaging (fMRI). Here, we argue that regardless of patterns revealed, conventional MVPA is merely a decoding tool with increased sensitivity arising from considering a large number of 'weak classifiers' (i.e., single voxels) in higher dimensions. We propose instead that 'real' multivoxel coding should result in changes in higher-order statistics across voxels between conditions such as second-order multivariate effects (sMVE). Surprisingly, analysis of conditions with robust multivariate effects (MVE) revealed by MVPA failed to show significant sMVE in two species (humans and macaques). Further analysis showed that while both MVE and sMVE can be readily observed in the spiking activity of neuronal populations, the slow and nonlinear hemodynamic coupling and low spatial resolution of fMRI activations make the observation of higher-order statistics between voxels highly unlikely. These results reveal inherent limitations of fMRI signals for studying coordinated coding across voxels. Together, these findings suggest that care should be taken in interpreting significant MVPA results as representing anything beyond a collection of univariate effects.

The unreliable influence of multivariate noise normalization on the reliability of neural dissimilarity

Representational similarity analysis (RSA) is a key element in the multivariate pattern analysis toolkit. The central construct of the method is the representational dissimilarity matrix (RDM), which can be generated for datasets from different modalities (neuroimaging, behavior, and computational models) and directly correlated in order to evaluate their second-order similarity. Given the inherent noisiness of neuroimaging signals it is important to evaluate the reliability of neuroimaging RDMs in order to determine whether these comparisons are meaningful. Recently, multivariate noise normalization (NN_M) has been proposed as a widely applicable method for boosting signal estimates for RSA, regardless of choice of dissimilarity metrics, based on evidence that the analysis improves the within-subject reliability of RDMs (Guggenmos et al. 2018; Walther et al. 2016). We revisited this issue with three fMRI datasets and evaluated the impact of NN_M on within- and between-subject reliability and RSA effect sizes using multiple dissimilarity metrics. We also assessed its impact across regions of interest from the same dataset, its interaction with spatial smoothing, and compared it to GLMdenoise, which has also been proposed as a method that improves signal estimates for RSA (Charest et al. 2018). We found that across these tests the impact of NN_M was highly variable, as also seems to be the case for other analysis choices. Overall, we suggest being conservative before adding steps and complexities to the (pre)processing pipeline for RSA.

A role for visual areas in physics simulations

To engage with the world, we must regularly make predictions about the outcomes of physical scenes. How do we make these predictions? Recent computational evidence points to simulation-the idea that we can introspectively manipulate rich, mental models of the world-as one explanation for how such predictions are accomplished. However, questions about the potential neural mechanisms of simulation remain. We hypothesized that the process of simulating physical events would evoke imagery-like representations in visual areas of those same events. Using functional magnetic resonance imaging, we find that when participants are asked to predict the likely trajectory of a falling ball, motion-sensitive brain regions are activated. We demonstrate that this activity, which occurs even though no motion is being sensed, resembles activity patterns that arise while participants perceive the ball's motion. This finding thus suggests that mental simulations recreate sensory depictions of how a physical scene is likely to unfold.

Uncovering structured responses of neural populations recorded from macaque monkeys with linear support vector machines

When a mammal, such as a macaque monkey, sees a complex natural image, many neurons in its visual cortex respond simultaneously. Here, we provide a protocol for studying the structure of population responses in laminar recordings with a machine learning model, the linear support vector machine. To unravel the role of single neurons in population responses and the structure of noise correlations, we use a multivariate decoding technique on time-averaged responses.

For complete details on the use and execution of this protocol, please refer to Koren et al. (2020a).

•

Linear support vector machine (SVM) is an efficient model for decoding from neural data

•

Permutation test is a rigorous method for testing the significance of results

•

Neural responses along the cortical depth are heterogeneous

•

Decoding weights and noise correlations share a similar structure

A Representational Similarity Analysis of Cognitive Control during Color-Word Stroop

Progress in understanding the neural bases of cognitive control has been supported by the paradigmatic color-word Stroop task, in which a target response (color name) must be selected over a more automatic, yet potentially incongruent, distractor response (word). For this paradigm, models have postulated complementary coding schemes: dorsomedial frontal cortex (DMFC) is proposed to evaluate the demand for control via incongruency-related coding, whereas dorsolateral PFC (DLPFC) is proposed to implement control via goal and target-related coding. Yet, mapping these theorized schemes to measured neural activity within this task has been challenging. Here, we tested for these coding schemes relatively directly, by decomposing an event-related color-word Stroop task via representational similarity analysis. Three neural coding models were fit to the similarity structure of multivoxel patterns of human fMRI activity, acquired from 65 healthy, young-adult males and females. Incongruency coding was predominant in DMFC, whereas both target and incongruency coding were present with indistinguishable strength in DLPFC. In contrast, distractor information was strongly encoded within early visual cortex. Further, these coding schemes were differentially related to behavior: individuals with stronger DLPFC (and lateral posterior parietal cortex) target coding, but weaker DMFC incongruency coding, exhibited less behavioral Stroop interference. These results highlight the utility of the representational similarity analysis framework for investigating neural mechanisms of cognitive control and point to several promising directions to extend the Stroop paradigm.SIGNIFICANCE STATEMENT How the human brain enables cognitive control - the ability to override behavioral habits to pursue internal goals - has been a major focus of neuroscience research. This ability has been frequently investigated by using the Stroop color-word naming task. With the Stroop as a test-bed, many theories have proposed specific neuroanatomical dissociations, in which medial and lateral frontal brain regions underlie cognitive control by encoding distinct types of information. Yet providing a direct confirmation of these claims has been challenging. Here, we demonstrate that representational similarity analysis, which estimates and models the similarity structure of brain activity patterns, can successfully establish the hypothesized functional dissociations within the Stroop task. Representational similarity analysis may provide a useful approach for investigating cognitive control mechanisms.

Reinstatement of Event Details during Episodic Simulation in the Hippocampus

According to the constructive episodic simulation hypothesis, episodic simulation (i.e., imagining specific novel future episodes) draws on some of the same neurocognitive processes that support episodic memory (i.e., recalling specific past episodes). Episodic retrieval supports the ability to simulate future experiences by providing access to episodic details (e.g., the people and locations that comprise memories) that can be recombined in new ways. In the current functional neuroimaging study, we test this hypothesis by examining whether the hippocampus, a region implicated in the reinstatement of episodic information during memory, supports reinstatement of episodic information during simulation. Employing a multivoxel pattern similarity analysis, we interrogated the similarity between hippocampal neural patterns during memory and simulation at the level of individual event details. Our findings indicate that the hippocampus supports the reinstatement of detail-specific information from episodic memory during simulation, with the level of reinstatement contributing to the subjective experience of simulated details.

Unveiling functions of the visual cortex using task-specific deep neural networks

The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.

Characterizing the Network Architecture of Emotion Regulation Neurodevelopment

The ability to regulate emotions is key to goal attainment and well-being. Although much has been discovered about neurodevelopment and the acquisition of emotion regulation, very little of this work has leveraged information encoded in whole-brain networks. Here we employed a network neuroscience framework to parse the neural underpinnings of emotion regulation skill acquisition, while accounting for age, in a sample of children and adolescents (N = 70, 34 female, aged 8-17 years). Focusing on three key network metrics-network differentiation, modularity, and community number differences between active regulation and a passive emotional baseline-we found that the control network, the default mode network, and limbic network were each related to emotion regulation ability while controlling for age. Greater network differentiation in the control and limbic networks was related to better emotion regulation ability. With regards to network community structure (modularity and community number), more communities and more crosstalk between modules (i.e., less modularity) in the control network were associated with better regulatory ability. By contrast, less crosstalk (i.e., greater modularity) between modules in the default mode network was associated with better regulatory ability. Together, these findings highlight whole-brain connectome features that support the acquisition of emotion regulation in youth.

Hand-Selective Visual Regions Represent How to Grasp 3D Tools: Brain Decoding during Real Actions

Most neuroimaging experiments that investigate how tools and their actions are represented in the brain use visual paradigms where tools or hands are displayed as 2D images and no real movements are performed. These studies discovered selective visual responses in occipitotemporal and parietal cortices for viewing pictures of hands or tools, which are assumed to reflect action processing, but this has rarely been directly investigated. Here, we examined the responses of independently visually defined category-selective brain areas when participants grasped 3D tools (N = 20; 9 females). Using real-action fMRI and multivoxel pattern analysis, we found that grasp typicality representations (i.e., whether a tool is grasped appropriately for use) were decodable from hand-selective areas in occipitotemporal and parietal cortices, but not from tool-, object-, or body-selective areas, even if partially overlapping. Importantly, these effects were exclusive for actions with tools, but not for biomechanically matched actions with control nontools. In addition, grasp typicality decoding was significantly higher in hand than tool-selective parietal regions. Notably, grasp typicality representations were automatically evoked even when there was no requirement for tool use and participants were naive to object category (tool vs nontools). Finding a specificity for typical tool grasping in hand-selective, rather than tool-selective, regions challenges the long-standing assumption that activation for viewing tool images reflects sensorimotor processing linked to tool manipulation. Instead, our results show that typicality representations for tool grasping are automatically evoked in visual regions specialized for representing the human hand, the primary tool of the brain for interacting with the world.

Mental travel in the person domain

"Mental travel" is a cognitive concept embodying the human capacity to intentionally disengage from the here and now, and mentally experience the world from different perspectives. We explored how individuals mentally "travel" to the point of view (POV) of other people in varying levels of personal closeness and from these perspectives process these people's social network. Under fMRI, participants were asked to "project" themselves to the POVs of four different people: a close other, a nonclose other, a famous-person, and their own-self, and rate the level of affiliation (closeness) to different individuals in the respective social network. Participants were always faster making judgments from their own POV compared with other POVs (self-projection effect) and for people who were personally closer to their adopted POV (social-distance effect). Brain activity at the medial prefrontal and anterior cingulate cortex in the self-POV was higher, compared with all other conditions. Activity at the right temporoparietal junction and medial parietal cortex was found to distinguish between the personally related (self, close, and nonclose others) and unrelated (famous-person) people. No difference was found between mental travel to the POVs of close and nonclose others. Regardless of POV, the precuneus, anterior cingulate cortex, prefrontal cortex, and temporoparietal junction distinguished between close and distant individuals within the different social networks. Representational similarity analysis implicated the left retrosplenial cortex as crucial for social distance processing across all POVs. These distinctions suggest several constraints regarding our ability to adopt others' POV and process not only ours but also other people's social networks and stress the importance of proximity in social cognition.NEW & NOTEWORTHY Mental-travel, the ability to mentally imagine oneself in a different place and time, is a fundamental cognitive concept. Investigation of mental-travel in the social domain under fMRI revealed that a network of brain regions, largely overlapping the default-mode-network, is responsible for "traveling" to points of view of different others; moreover, this network distinguishes between closer and less-close others, suggesting that mental-travel is a rich dynamical process, encompassing individuals in different proximities and these individuals' social network.