THE HUMAN VISUAL CORTEX

Promoting the Shift From Pixel-Level Correlations to Object Semantics Learning by Rethinking Computer Vision Benchmark Data Sets

In computer vision research, convolutional neural networks (CNNs) have demonstrated remarkable capabilities at extracting patterns from raw pixel data, achieving state-of-the-art recognition accuracy. However, they significantly differ from human visual perception, prioritizing pixel-level correlations and statistical patterns, often overlooking object semantics. To explore this difference, we propose an approach that isolates core visual features crucial for human perception and object recognition: color, texture, and shape. In experiments on three benchmarks-Fruits 360, CIFAR-10, and Fashion MNIST-each visual feature is individually input into a neural network. Results reveal data set-dependent variations in classification accuracy, highlighting that deep learning models tend to learn pixel-level correlations instead of fundamental visual features. To validate this observation, we used various combinations of concatenated visual features as input for a neural network on the CIFAR-10 data set. CNNs excel at learning statistical patterns in images, achieving exceptional performance when training and test data share similar distributions. To substantiate this point, we trained a CNN on CIFAR-10 data set and evaluated its performance on the "dog" class from CIFAR-10 and on an equivalent number of examples from the Stanford Dogs data set. The CNN poor performance on Stanford Dogs images underlines the disparity between deep learning and human visual perception, highlighting the need for models that learn object semantics. Specialized benchmark data sets with controlled variations hold promise for aligning learned representations with human cognition in computer vision research.

Intrinsic functional connectivity mediates the effect of personality traits on depressive symptoms

BACKGROUND

Personality traits have been proposed as risk factors for depressive symptoms. However, the neural mechanism behind these relationships is unclear. This study examined the possible mediating effect of resting-state functional connectivity networks on these relationships.

METHODS

Data from 153 healthy Germans were obtained from the MPI-Leipzig Mind-Brain-Body: Neuroanatomy & Connectivity Protocol database. Network-based statistics were used to identify significant functional connectivity networks that were positively and negatively associated with the personality traits of neuroticism, conscientiousness, and extraversion, with and without demographical covariates. Mediation analyses were performed for each personality trait and depressive symptoms with the significant positive and negative network strengths of the respective personality traits as mediators.

RESULTS

Neuroticism, conscientiousness, and extraversion were significantly correlated with depressive symptoms. Network-based statistics identified patterns of functional connectivity that were significantly associated with neuroticism and conscientiousness. After controlling for demographical covariates, significant conscientiousness-associated and extraversion-associated networks emerged. Mediation analysis concluded that only the neuroticism-positive network mediated the effect of neuroticism on depressive symptoms. When age and sex were controlled, the extraversion-positive network completely mediated the effect of extraversion on depressive symptoms.

CONCLUSIONS

These findings revealed that patterns of intrinsic functional networks predict personality traits and suggest that the relationship between personality traits and depressive symptoms may in part be due to their common patterns of intrinsic functional networks.

Assessing brain neuroplasticity: Surface morphometric analysis of cortical changes induced by Quadrato motor training

Morphological markers for brain plasticity are still lacking and their findings are challenged by the extreme variability of cortical brain surface. Trying to overcome the "correspondence problem," we applied a landmark-free method (the generalized procrustes surface analysis (GPSA)) for investigating the shape variation of cortical surface in a group of 40 healthy volunteers (i.e., the practice group) subjected to daily motor training known as Quadrato motor training (QMT). QMT is a sensorimotor walking meditation that aims at balancing body, cognition, and emotion. More specifically, QMT requires coordination and attention and consists of moving in one of three possible directions on corners of a 50 × 50 cm2. Brain magnetic resonance images (MRIs) of practice group (acquired at baseline, as well as after 6 and 12 weeks of QMT), were 3D reconstructed and here compared with brain MRIs of six more volunteers never practicing the QMT (naïve group). Cortical regions mostly affected by morphological variations were visualized on a 3D average color-scaled brain surface indicating from higher (red) to lower (blue) levels of variation. Cortical regions interested in most of the shape variations were as follows: (1) the supplementary motor cortex; (2) the inferior frontal gyrus (pars opercolaris) and the anterior insula; (3) the visual cortex; (4) the inferior parietal lobule (supramarginal gyrus and angular gyrus). Our results show that surface morphometric analysis (i.e., GPSA) can be applied to assess brain neuroplasticity processes, such as those stimulated by QMT.

A biologically inspired computational model of human ventral temporal cortex

Our minds represent miscellaneous objects in the physical world metaphorically in an abstract and complex high-dimensional object space, which is implemented in a two-dimensional surface of the ventral temporal cortex (VTC) with topologically organized object selectivity. Here we investigated principles guiding the topographical organization of object selectivities in the VTC by constructing a hybrid Self-Organizing Map (SOM) model that harnesses a biologically inspired algorithm of wiring cost minimization and adheres to the constraints of the lateral wiring span of human VTC neurons. In a series of in silico experiments with functional brain neuroimaging and neurophysiological single-unit data from humans and non-human primates, the VTC-SOM predicted the topographical structure of fine-scale category-selective regions (face-, tool-, body-, and place-selective regions) and the boundary in large-scale abstract functional maps (animate vs. inanimate, real-word small-size vs. big-size, central vs. peripheral), with no significant loss in functionality (e.g., categorical selectivity and view-invariant representations). In addition, when the same principle was applied to V1 orientation preferences, a pinwheel-like topology emerged, suggesting the model's broad applicability. In summary, our study illustrates that the simple principle of wiring cost minimization, coupled with the appropriate biological constraint of lateral wiring span, is able to implement the high-dimensional object space in a two-dimensional cortical surface.

Higher-contrast images are better remembered during naturalistic encoding

It is unclear whether memory for images of poorer visibility (as low contrast or small size) will be lower due to weak signals elicited in early visual processing stages, or perhaps better since their processing may entail top-down processes (as effort and attention) associated with deeper encoding. We have recently shown that during naturalistic encoding (free viewing without task-related modulations), for image sizes between 3°-24°, bigger images stimulating more visual system processing resources at early processing stages are better remembered. Similar to size, higher contrast leads to higher activity in early visual processing. Therefore, here we hypothesized that during naturalistic encoding, at critical visibility ranges, higher contrast images will lead to higher signal-to-noise ratio and better signal quality flowing downstream and will thus be better remembered. Indeed, we found that during naturalistic encoding higher contrast images were remembered better than lower contrast ones (~ 15% higher accuracy, ~ 1.58 times better) for images at 7.5-60 RMS contrast range. Although image contrast and size modulate early visual processing very differently, our results further substantiate that at poor visibility ranges, during naturalistic non-instructed visual behavior, physical image dimensions (contributing to image visibility) impact image memory.

Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions

Everyday interactions with common manipulable objects require the integration of conceptual knowledge about objects and actions with real-time sensory information about the position, orientation and volumetric structure of the grasp target. The ability to successfully interact with everyday objects involves analysis of visual form and shape, surface texture, material properties, conceptual attributes such as identity, function and typical context, and visuomotor processing supporting hand transport, grasp form, and object manipulation. Functionally separable brain regions across the dorsal and ventral visual pathways support the processing of these different object properties and, in cohort, are necessary for functional object use. Object-directed grasps display end-state-comfort: they anticipate in form and force the shape and material properties of the grasp target, and how the object will be manipulated after it is grasped. End-state-comfort is the default for everyday interactions with manipulable objects and implies integration of information across the ventral and dorsal visual pathways. We propose a model of how visuomotor and action representations in parietal cortex interact with object representations in ventral and lateral occipito-temporal cortex. One pathway, from the supramarginal gyrus to the middle and inferior temporal gyrus, supports the integration of action-related information, including hand and limb position (supramarginal gyrus) with conceptual attributes and an appreciation of the action goal (middle temporal gyrus). A second pathway, from posterior IPS to the fusiform gyrus and collateral sulcus supports the integration of grasp parameters (IPS) with the surface texture and material properties (e.g., weight distribution) of the grasp target. Reciprocal interactions among these regions are part of a broader network of regions that support everyday functional object interactions.

Human genetics of face recognition: discovery of MCTP2 mutations in humans with face blindness (congenital prosopagnosia)

Face recognition is important for both visual and social cognition. While prosopagnosia or face blindness has been known for seven decades and face-specific neurons for half a century, the molecular genetic mechanism is not clear. Here we report results after 17 years of research with classic genetics and modern genomics. From a large family with 18 congenital prosopagnosia (CP) members with obvious difficulties in face recognition in daily life, we uncovered a fully cosegregating private mutation in the MCTP2 gene which encodes a calcium binding transmembrane protein expressed in the brain. After screening through cohorts of 6589, we found more CPs and their families, allowing detection of more CP associated mutations in MCTP2. Face recognition differences were detected between 14 carriers with the frameshift mutation S80fs in MCTP2 and 19 noncarrying volunteers. Six families including one with 10 members showed the S80fs-CP correlation. Functional magnetic resonance imaging found association of impaired recognition of individual faces by MCTP2 mutant CPs with reduced repetition suppression to repeated facial identities in the right fusiform face area. Our results have revealed genetic predisposition of MCTP2 mutations in CP, 76 years after the initial report of prosopagnosia and 47 years after the report of the first CP. This is the first time a gene required for a higher form of visual social cognition was found in humans.

Polygenic Score for Conscientiousness Is a Protective Factor for Reversion from Mild Cognitive Impairment to Normal Cognition

Spontaneous reversion from mild cognitive impairment (MCI) to normal cognition (NC) is little known. Based on the data of the Genetics of Personality Consortium and MCI participants from Alzheimer's Disease Neuroimaging Initiative, the authors investigate the effect of polygenic scores (PGS) for personality traits on the reversion of MCI to NC and its underlying neurobiology. PGS analysis reveals that PGS for conscientiousness (PGS-C) is a protective factor that supports the reversion from MCI to NC. Gene ontology enrichment analysis and tissue-specific enrichment analysis indicate that the protective effect of PGS-C may be attributed to affecting the glutamatergic synapses of subcortical structures, such as hippocampus, amygdala, nucleus accumbens, and caudate nucleus. The structural covariance network (SCN) analysis suggests that the left whole hippocampus and its subfields, and the left whole amygdala and its subnuclei show significantly stronger covariance with several high-cognition relevant brain regions in the MCI reverters compared to the stable MCI participants, which may help illustrate the underlying neural mechanism of the protective effect of PGS-C.

Who takes the lead in consumer choices within romantic relationships: the evidence from electroencephalography hyperscanning and granger causality analysis

In real-life scenarios, joint consumption is common, particularly influenced by social relationships such as romantic ones. However, how romantic relationships affect consumption decisions and determine dominance remains unclear. This study employs electroencephalography hyperscanning to examine the neural dynamics of couples during joint-consumption decisions. Results show that couples, compared to friends and strangers, prefer healthier foods, while friends have significantly faster reaction times when selecting food. Time-frequency analysis indicates that couples exhibit significantly higher theta power, reflecting deeper emotional and cognitive involvement. Strangers show greater beta1 power, indicating increased cognitive effort and alertness due to unfamiliarity. Friends demonstrate higher alpha2 power when choosing unhealthy foods, suggesting increased cognitive inhibition. Inter-brain phase synchrony analysis reveals that couples display significantly higher inter-brain phase synchrony in the beta1 and theta bands across the frontal-central, parietal, and occipital regions, indicating more coordinated cognitive processing and stronger emotional bonds. Females in couples may be more influenced by emotions during consumption decisions, with detailed sensory information processing, while males exhibit higher cognitive control and spatial integration. Granger-causality analysis shows a pattern of male dominance and female dependence in joint consumption within romantic relationships. This study highlights gender-related neural synchronous patterns during joint consumption among couples, providing insights for further research in consumer decision-making.

Deep Learning and Multimodal Artificial Intelligence in Orthopaedic Surgery

This review article focuses on the applications of deep learning with neural networks and multimodal neural networks in the orthopaedic domain. By providing practical examples of how artificial intelligence (AI) is being applied successfully in orthopaedic surgery, particularly in the realm of imaging data sets and the integration of clinical data, this study aims to provide orthopaedic surgeons with the necessary tools to not only evaluate existing literature but also to consider AI's potential in their own clinical or research pursuits. We first review standard deep neural networks which can analyze numerical clinical variables, then describe convolutional neural networks which can analyze image data, and then introduce multimodal AI models which analyze various types of different data. Then, we contrast these deep learning techniques with related but more limited techniques such as radiomics, describe how to interpret deep learning studies, and how to initiate such studies at your institution. Ultimately, by empowering orthopaedic surgeons with the knowledge and know-how of deep learning, this review aspires to facilitate the translation of research into clinical practice, thereby enhancing the efficacy and precision of real-world orthopaedic care for patients.

The interaction effect of high social support and resilience on functional connectivity using seed-based resting-state assessed by 7-Tesla ultra-high field MRI

Recent resilience research has increasingly emphasized the importance of focusing on investigating the protective factors in mentally healthy populations, complementing the traditional focus on psychopathology. Social support has emerged as a crucial element within the complex interplay of individual and socio-environmental factors that shape resilience. However, the neural underpinnings of the relationship between social support and resilience, particularly in healthy subjects, remain largely unexplored. With advances in neuroimaging techniques, such as ultra-high field MRI at 7T and beyond, researchers can more effectively investigate the neural mechanisms underlying these factors. Thus, our study employed ultra-high field rs-fMRI to explore how social support moderates the relationship between psychological resilience and functional connectivity in a healthy cohort. We hypothesized that enhanced social support would amplify resilience-associated connectivity within neural circuits essential for emotional regulation, cognitive processing, and adaptive problem-solving, signifying a synergistic interaction where strong social networks bolster the neural underpinnings of resilience. (n = 30). Through seed-based functional connectivity analyses and interaction analysis, we aimed to uncover the neural correlates at the interplay of social support and resilience. Our findings indicate that perceived social support significantly (p<0.001) alters functional connectivity in the right and left FP, PCC, and left hippocampus, affirming the pivotal roles of these regions in the brain's resilience network. Moreover, we identified significant moderation effects of social support across various brain regions, each showing unique connectivity patterns. Specifically, the right FP demonstrated a significant interaction effect where high social support levels were linked to increased connectivity with regions involved in socio-cognitive processing, while low social support showed opposite effects. Similar patterns by social support levels were observed in the left FP, with connectivity changes in clusters associated with emotional regulation and cognitive functions. The PCC's connectivity was distinctly influenced by support levels, elucidating its role in emotional and social cognition. Interestingly, the connectivity of the left hippocampus was not significantly impacted by social support levels, indicating a unique pattern within this region. These insights highlight the importance of high social support levels in enhancing the neural foundations of resilience and fostering adaptive neurological responses to environmental challenges.

An integrative, multiscale view on neural theories of consciousness

How is conscious experience related to material brain processes? A variety of theories aiming to answer this age-old question have emerged from the recent surge in consciousness research, and some are now hotly debated. Although most researchers have so far focused on the development and validation of their preferred theory in relative isolation, this article, written by a group of scientists representing different theories, takes an alternative approach. Noting that various theories often try to explain different aspects or mechanistic levels of consciousness, we argue that the theories do not necessarily contradict each other. Instead, several of them may converge on fundamental neuronal mechanisms and be partly compatible and complementary, so that multiple theories can simultaneously contribute to our understanding. Here, we consider unifying, integration-oriented approaches that have so far been largely neglected, seeking to combine valuable elements from various theories.

Abnormal degree centrality as a potential imaging biomarker for ischemic stroke: A resting-state functional magnetic resonance imaging study

OBJECTIVE

To explore degree centrality (DC) abnormalities in ischemic stroke patients and determine whether these abnormalities have potential value in understanding the pathological mechanisms of ischemic stroke patients.

METHODS

Sixteen ischemic stroke patients and 22 healthy controls (HCs) underwent resting state functional magnetic resonance imaging (rs-fMRI) scanning, and the resulting data were subjected to DC analysis. Then we conducted a correlation analysis between DC values and neuropsychological test scores, including Montreal Cognitive Assessment (MoCA) and Mini-Mental State Examination (MMSE). Finally, extracted the abnormal DC values of brain regions and defined them as features for support vector machine (SVM) analysis.

RESULTS

Compared with HCs, ischemic stroke patients showed increased DC in the bilateral supplementary motor area, and median cingulate and paracingulate gyri and decreased DC in the left postcentral gyrus, right calcarine fissure and surrounding cortex, lingual gyrus, and orbital parts of the right superior frontal gyrus and bilateral cuneus. Correlation analyses revealed that DC values in the right lingual gyrus, calcarine fissure and surrounding cortex, and orbital parts of the right superior frontal gyrus were positively correlated with the MMSE scores. The SVM classification of the DC values achieved an area under the curve (AUC) of 0.93, an accuracy of 89.47%.

CONCLUSION

Our research results indicate that ischemic stroke patients exhibit abnormalities in the global connectivity mechanisms and patterns of the brain network. These abnormal changes may provide neuroimaging evidence for stroke-related motor, visual, and cognitive impairments, contribute to a deeper comprehension of the underlying pathophysiological mechanisms implicated in ischemic stroke.

Functional Resilience of the Neural Visual Recognition System Post-Pediatric Occipitotemporal Resection

In the typically developing (TD) brain, neural representations for visual stimulus categories (e.g., faces, objects, and words) emerge in bilateral occipitotemporal cortex (OTC), albeit with weighted asymmetry; in parallel, recognition behavior continues to be refined. A fundamental question is whether two hemispheres are necessary or redundant for the emergence of neural representations and recognition behavior typically distributed across both hemispheres. The rare population of patients undergoing unilateral OTC resection in childhood offers a unique opportunity to evaluate whether neural computations for visual stimulus individuation suffice for recognition with only a single developing OTC. Here, using functional magnetic resonance imaging, we mapped category selectivity (CS) and neural representations for individual stimulus exemplars using repetition suppression (RS) in the non-resected hemisphere of pediatric OTC resection patients (n = 9) and control patients with resection outside of OTC (n = 12), as well as in both hemispheres of TD controls (n = 21). There were no univariate group differences in the magnitude of CS or RS or any multivariate differences (per representational similarity analysis) in neural activation to faces, objects, or words across groups. Notwithstanding their comparable neural profiles, accuracy of OTC resection patients on face and object recognition, but not word recognition, was statistically inferior to that of controls. The comparable neural signature of the OTC resection patients' preserved hemisphere and the other two groups highlights the resilience of the system following damage to the contralateral homologue. Critically, however, a single OTC does not suffice for normal behavior, and, thereby, implicates the necessity for two hemispheres.

The impact of acute asymmetric hearing loss on multisensory integration

Humans have the remarkable ability to integrate information from different senses, which greatly facilitates the detection, localization and identification of events in the environment. About 466 million people worldwide suffer from hearing loss. Yet, the impact of hearing loss on how the senses work together is rarely investigated. Here, we investigate how a common sensory impairment, asymmetric conductive hearing loss (AHL), alters the way our senses interact by examining human orienting behaviour with normal hearing (NH) and acute AHL. This type of hearing loss disrupts auditory localization. We hypothesized that this creates a conflict between auditory and visual spatial estimates and alters how auditory and visual inputs are integrated to facilitate multisensory spatial perception. We analysed the spatial and temporal properties of saccades to auditory, visual and audiovisual stimuli before and after plugging the right ear of participants. Both spatial and temporal aspects of multisensory integration were affected by AHL. Compared with NH, AHL caused participants to make slow, inaccurate and unprecise saccades towards auditory targets. Surprisingly, increased weight on visual input resulted in accurate audiovisual localization with AHL. This came at a cost: saccade latencies for audiovisual targets increased significantly. The larger the auditory localization errors, the less participants were able to benefit from audiovisual integration in terms of saccade latency. Our results indicate that observers immediately change sensory weights to effectively deal with acute AHL and preserve audiovisual accuracy in a way that cannot be fully explained by statistical models of optimal cue integration.

Multi-Semantic Decoding of Visual Perception with Graph Neural Networks

Constructing computational decoding models to account for the cortical representation of semantic information plays a crucial role in understanding visual perception. The human visual system processes interactive relationships among different objects when perceiving the semantic contents of natural visions. However, the existing semantic decoding models commonly regard categories as completely separate and independent visually and semantically and rarely consider the relationships from prior information. In this work, a novel semantic graph learning model was proposed to decode multiple semantic categories of perceived natural images from brain activity. The proposed model was validated on the functional magnetic resonance imaging data collected from five normal subjects while viewing 2750 natural images comprising 52 semantic categories. The results showed that the Graph Neural Network-based decoding model achieved higher accuracies than other deep neural network models. Moreover, the co-occurrence probability among semantic categories showed a significant correlation with the decoding accuracy. Additionally, the results suggested that semantic content organized in a hierarchical way with higher visual areas was more closely related to the internal visual experience. Together, this study provides a superior computational framework for multi-semantic decoding that supports the visual integration mechanism of semantic processing.

Preliminary Evidence for Global Properties in Human Listeners During Natural Auditory Scene Perception

Theories of auditory and visual scene analysis suggest the perception of scenes relies on the identification and segregation of objects within it, resembling a detail-oriented processing style. However, a more global process may occur while analyzing scenes, which has been evidenced in the visual domain. It is our understanding that a similar line of research has not been explored in the auditory domain; therefore, we evaluated the contributions of high-level global and low-level acoustic information to auditory scene perception. An additional aim was to increase the field's ecological validity by using and making available a new collection of high-quality auditory scenes. Participants rated scenes on 8 global properties (e.g., open vs. enclosed) and an acoustic analysis evaluated which low-level features predicted the ratings. We submitted the acoustic measures and average ratings of the global properties to separate exploratory factor analyses (EFAs). The EFA of the acoustic measures revealed a seven-factor structure explaining 57% of the variance in the data, while the EFA of the global property measures revealed a two-factor structure explaining 64% of the variance in the data. Regression analyses revealed each global property was predicted by at least one acoustic variable (R2 = 0.33-0.87). These findings were extended using deep neural network models where we examined correlations between human ratings of global properties and deep embeddings of two computational models: an object-based model and a scene-based model. The results support that participants' ratings are more strongly explained by a global analysis of the scene setting, though the relationship between scene perception and auditory perception is multifaceted, with differing correlation patterns evident between the two models. Taken together, our results provide evidence for the ability to perceive auditory scenes from a global perspective. Some of the acoustic measures predicted ratings of global scene perception, suggesting representations of auditory objects may be transformed through many stages of processing in the ventral auditory stream, similar to what has been proposed in the ventral visual stream. These findings and the open availability of our scene collection will make future studies on perception, attention, and memory for natural auditory scenes possible.

How three-dimensional sketching environments affect spatial thinking: A functional magnetic resonance imaging study of virtual reality

Designers rely on sketching to visualize and refine their initial ideas, and virtual reality (VR) tools now facilitate sketching in immersive 3D environments. However, little research has been conducted on the differences in the visual and spatial processes involved in 3D versus 2D sketching and their effects on cognition. This study investigated potential differences in spatial and visual functions related to the use of 3D versus 2D sketching media by analyzing functional magnetic resonance imaging (fMRI) data. We recruited 20 healthy, right-handed students from the Department of Horticulture and Landscape Architecture with at least three years of experience in freehand landscape drawing. Using an Oculus Quest VR headset controller and a 12.9-inch iPad Pro with an Apple Pencil, we tested participants individually with 3D and 2D sketching, respectively. When comparing 2D and 3D sketches, our fMRI results revealed significant differences in the activation of several brain regions, including the right middle temporal gyrus, both sides of the parietal lobe, and the left middle occipital gyrus. We also compared different sketching conditions, such as lines, geometrical objects (cube), and naturalistic objects (perspective view of a tree), and found significant differences in the spatial and visual recognition of brain areas that support visual recognition, composition, and spatial perception. This finding suggests that 3D sketching environments, such as VR, may activate more visual-spatial functions during sketching compared to 2D environments. The result highlights the potential of immersive sketching environments for design-related processes and spatial thinking.

Whole-brain structural connectome asymmetry in autism

Autism spectrum disorder is a common neurodevelopmental condition that manifests as a disruption in sensory and social skills. Although it has been shown that the brain morphology of individuals with autism is asymmetric, how this differentially affects the structural connectome organization of each hemisphere remains under-investigated. We studied whole-brain structural connectivity-based brain asymmetry in individuals with autism using diffusion magnetic resonance imaging obtained from the Autism Brain Imaging Data Exchange initiative. By leveraging dimensionality reduction techniques, we constructed low-dimensional representations of structural connectivity and calculated their asymmetry index. Comparing the asymmetry index between individuals with autism and neurotypical controls, we found atypical structural connectome asymmetry in the sensory and default-mode regions, particularly showing weaker asymmetry towards the right hemisphere in autism. Network communication provided topological underpinnings by demonstrating that the inferior temporal cortex and limbic and frontoparietal regions showed reduced global network communication efficiency and decreased send-receive network navigation in the inferior temporal and lateral visual cortices in individuals with autism. Finally, supervised machine learning revealed that structural connectome asymmetry could be used as a measure for predicting communication-related autistic symptoms and nonverbal intelligence. Our findings provide insights into macroscale structural connectome alterations in autism and their topological underpinnings.

Brain-like illusion produced by Skye's Oblique Grating in deep neural networks

The analogy between the brain and deep neural networks (DNNs) has sparked interest in neuroscience. Although DNNs have limitations, they remain valuable for modeling specific brain characteristics. This study used Skye's Oblique Grating illusion to assess DNNs' relevance to brain neural networks. We collected data on human perceptual responses to a series of visual illusions. This data was then used to assess how DNN responses to these illusions paralleled or differed from human behavior. We performed two analyses:(1) We trained DNNs to perform horizontal vs. non-horizontal classification on images with bars tilted different degrees (non-illusory images) and tested them on images with horizontal bars with different illusory strengths measured by human behavior (illusory images), finding that DNNs showed human-like illusions; (2) We performed representational similarity analysis to assess whether illusory representation existed in different layers within DNNs, finding that DNNs showed illusion-like responses to illusory images. The representational similarity between real tilted images and illusory images was calculated, which showed the highest values in the early layers and decreased layer-by-layer. Our findings suggest that DNNs could serve as potential models for explaining the mechanism of visual illusions in human brain, particularly those that may originate in early visual areas like the primary visual cortex (V1). While promising, further research is necessary to understand the nuanced differences between DNNs and human visual pathways.

Increased Resting-State Functional Connectivity in Patients With Autoimmune Addison Disease

CONTEXT

Individuals with autoimmune Addison disease (AAD) take replacement medication for the lack of adrenal-derived glucocorticoid (GC) and mineralocorticoid hormones from diagnosis. The brain is highly sensitive to these hormones, but the consequence of having AAD for brain health has not been widely addressed.

OBJECTIVE

The present study compared resting-state functional connectivity (rs-fc) of the brain between individuals with AAD and healthy controls.

METHODS

Fifty-seven patients with AAD (33 female) and 69 healthy controls (39 female), aged 19 to 43 years were scanned with 3-T magnetic resonance imaging (MRI).

RESULTS

Independent component and subsequent dual regression analyses revealed that individuals with AAD had stronger rs-fc compared to controls in 3 networks: the bilateral orbitofrontal cortex (OFC), the left medial visual and left posterior default mode network. A higher GC replacement dose was associated with stronger rs-fc in a small part of the left OFC in patients. We did not find any clear associations between rs-fc and executive functions or mental fatigue.

CONCLUSION

Our results suggest that having AAD affects the baseline functional organization of the brain and that current treatment strategies of AAD may be one risk factor.

Parafoveal vision reveals qualitative differences between fusiform face area and parahippocampal place area

The center-periphery visual field axis guides early visual system organization with enhanced resources devoted to central vision leading to reduced peripheral performance relative to that of central vision (i.e., behavioral eccentricity effect) for many visual functions. The center-periphery organization extends to high-order visual cortex where, for example, the well-studied face-sensitive fusiform face area (FFA) shows sensitivity to central vision and the place-sensitive parahippocampal place area (PPA) shows sensitivity to peripheral vision. As we have recently found that face perception is more sensitive to eccentricity than place perception, here we examined whether these behavioral findings reflect differences in FFA's and PPA's sensitivities to eccentricity. We assumed FFA would show higher sensitivity to eccentricity than PPA would, but that both regions' modulation by eccentricity would be invariant to the viewed category. We parametrically investigated (fMRI, n = 32) how FFA's and PPA's activations are modulated by eccentricity (≤8°) and category (upright/inverted faces/houses) while keeping stimulus size constant. As expected, FFA showed an overall higher sensitivity to eccentricity than PPA. However, both regions' activation modulations by eccentricity were dependent on the viewed category. In FFA, a reduction of activation with growing eccentricity ("BOLD eccentricity effect") was found (with different amplitudes) for all categories. In PPA however, qualitatively different BOLD eccentricity effect modulations were found (e.g., at 8° mild BOLD eccentricity effect for houses but a reverse BOLD eccentricity effect for faces and no modulation for inverted faces). Our results emphasize that peripheral vision investigations are critical to further our understanding of visual processing.

Decoding auditory deprivation: resting-state fMRI insights into deafness and brain plasticity

Deafness, as a profound manifestation of sensory deprivation, prompts a cascade of intricate cerebral adaptations. In this study, involving 35 deaf individuals and 35 hearing controls, we utilized resting-state functional magnetic resonance imaging (rs-fMRI) to delve into the depths of functional connectivity nuances distinguishing deaf individuals from their hearing counterparts. Leading our analytical approach was the application of multi-voxel pattern analysis (fc-MVPA). This advanced method provided a refined perspective, revealing amplified neural connectivity within the deaf population. Notably, regions such as the left postcentral somatosensory association cortex, the anterior and posterior corridors of the left superior temporal gyrus (STG), and the left mid-temporal lobe were identified as hotspots of heightened connectivity. Further, fc-MVPA shed light on intricate interaction effects, which became more pronounced when examining variables such as the duration of auditory deprivation and the extent of sign language exposure. These interactions were particularly evident in the premotor and left frontal mid-orbital regions. Complementing this, seed-based connectivity assessments illuminated pronounced coupling dynamics within the left STG spectrum. Concurrently, local correlation (LCOR) value analysis in the deaf group revealed significant shifts in the right superior STG and bilateral precuneus. In addition, amplitude of low-frequency fluctuation (ALFF) evaluations indicated modulations in the bilateral mid cingulum and left superior mid frontal gyrus. This comprehensive, fc-MVPA-driven exploration uncovers the multifaceted functional adaptations resulting from deafness, highlighting the profound plasticity of the human brain and its potential implications for targeted rehabilitative strategies.

Identifying cortical structure markers of resilience to adversity in young people using surface-based morphometry

Previous research on the neurobiological bases of resilience in youth has largely used categorical definitions of resilience and voxel-based morphometry methods that assess gray matter volume. However, it is important to consider brain structure more broadly as different cortical properties have distinct developmental trajectories. To address these limitations, we used surface-based morphometry and data-driven, continuous resilience scores to examine associations between resilience and cortical structure. Structural MRI data from 286 youths (Mage = 13.6 years, 51% female) who took part in the European multi-site FemNAT-CD study were pre-processed and analyzed using surface-based morphometry. Continuous resilience scores were derived for each participant based on adversity exposure and levels of psychopathology using the residual regression method. Vertex-wise analyses assessed for correlations between resilience scores and cortical thickness, surface area, gyrification and volume. Resilience scores were positively associated with right lateral occipital surface area and right superior frontal gyrification and negatively correlated with left inferior temporal surface area. Moreover, sex-by-resilience interactions were observed for gyrification in frontal and temporal regions. Our findings extend previous research by revealing that resilience is related to surface area and gyrification in frontal, occipital and temporal regions that are implicated in emotion regulation and face or object recognition.

Task learning is subserved by a domain-general brain network

One of the most important human faculties is the ability to acquire not just new memories but the capacity to perform entirely new tasks. However, little is known about the brain mechanisms underlying the learning of novel tasks. Specifically, it is unclear to what extent learning of different tasks depends on domain-general and/or domain-specific brain mechanisms. Here human subjects (n = 45) learned to perform 6 new tasks while undergoing functional MRI. The different tasks required the engagement of perceptual, motor, and various cognitive processes related to attention, expectation, speed-accuracy tradeoff, and metacognition. We found that a bilateral frontoparietal network was more active during the initial compared with the later stages of task learning, and that this effect was stronger for task variants requiring more new learning. Critically, the same frontoparietal network was engaged by all 6 tasks, demonstrating its domain generality. Finally, although task learning decreased the overall activity in the frontoparietal network, it increased the connectivity strength between the different nodes of that network. These results demonstrate the existence of a domain-general brain network whose activity and connectivity reflect learning for a variety of new tasks, and thus may underlie the human capacity for acquiring new abilities.

Downstream network transformations dissociate neural activity from causal functional contributions

Neuroscientists rely on distributed spatio-temporal patterns of neural activity to understand how neural units contribute to cognitive functions and behavior. However, the extent to which neural activity reliably indicates a unit's causal contribution to the behavior is not well understood. To address this issue, we provide a systematic multi-site perturbation framework that captures time-varying causal contributions of elements to a collectively produced outcome. Applying our framework to intuitive toy examples and artificial neural networks revealed that recorded activity patterns of neural elements may not be generally informative of their causal contribution due to activity transformations within a network. Overall, our findings emphasize the limitations of inferring causal mechanisms from neural activities and offer a rigorous lesioning framework for elucidating causal neural contributions.

Functional decoding and meta-analytic connectivity modeling in thyroid-associated ophthalmopathy

Background

Thyroid-associated ophthalmopathy (TAO) is an orbital disease closely related to thyroid disease with a long-lasting duration that can be blinding and disabling. Recently, structural and functional neuroimaging studies have been performed in TAO patients, but studies have reported inconsistent results. This quantitative meta-analysis was conducted to identify convergent patterns of abnormal brain function among different studies in TAO.

Methods

We searched PubMed, EMBASE, Cochrane, and Web of Science, performed reference tracking, and retrieved 15 eligible studies. Peak coordinates were extracted from these studies and subsequently tested for convergence using activation likelihood estimation (ALE).

Results

Compared to healthy subjects, resting-state brain activity in the whole brain of TAO patients was significantly increased in the left superior frontal gyrus (SFG) and decreased in the left cuneus/precuneus. Functional decoding analysis of the BrainMap database revealed that these regions are predominantly associated with cognitive and emotional impairment. In this study, task-related meta-analytic connectivity modeling (MACM) analysis was used to describe the connectivity and function of the two seed regions. Significant coactivation of these regions was found primarily in the bilateral superior parietal lobule, medial frontal gyrus, left fusiform gyrus, left cingulate gyrus, supplementary motor area and thalamus.

Conclusion

Our findings underscore the role of the SFG and the cuneus/precuneus in the pathophysiology of TAO, highlighting the crucial impact of working memory deficits.

Accelerated Brain Atrophy, Microstructural Decline and Connectopathy in Age-Related Macular Degeneration

Age-related macular degeneration (AMD) has recently been linked to cognitive impairment. We hypothesized that AMD modifies the brain aging trajectory, and we conducted a longitudinal diffusion MRI study on 40 participants (20 with AMD and 20 controls) to reveal the location, extent, and dynamics of AMD-related brain changes. Voxel-based analyses at the first visit identified reduced volume in AMD participants in the cuneate gyrus, associated with vision, and the temporal and bilateral cingulate gyrus, linked to higher cognition and memory. The second visit occurred 2 years after the first and revealed that AMD participants had reduced cingulate and superior frontal gyrus volumes, as well as lower fractional anisotropy (FA) for the bilateral occipital lobe, including the visual and the superior frontal cortex. We detected faster rates of volume and FA reduction in AMD participants in the left temporal cortex. We identified inter-lingual and lingual-cerebellar connections as important differentiators in AMD participants. Bundle analyses revealed that the lingual gyrus had a lower streamline length in the AMD participants at the first visit, indicating a connection between retinal and brain health. FA differences in select inter-lingual and lingual cerebellar bundles at the second visit showed downstream effects of vision loss. Our analyses revealed widespread changes in AMD participants, beyond brain networks directly involved in vision processing.

Regularity and variability of functional brain connectivity characteristics between gyri and sulci under naturalistic stimulus

The human cerebral cortex is folded into two fundamentally anatomical units: gyri and sulci. Previous studies have demonstrated the genetical, structural, and functional differences between gyri and sulci, providing a unique perspective for revealing the relationship among brain function, cognition, and behavior. While previous studies mainly focus on the functional differences between gyri and sulci under resting or task-evoked state, such characteristics under naturalistic stimulus (NS) which reflects real-world dynamic environments are largely unknown. To address this question, this study systematically investigates spatio-temporal functional connectivity (FC) characteristics between gyri and sulci under NS using a spatio-temporal graph convolutional network model. Based on the public Human Connectome Project dataset of 174 subjects with four different runs of both movie-watching NS and resting state 7T functional MRI data, we successfully identify unique FC features under NS, which are mainly involved in visual, auditory, emotional and cognitive control, and achieve high discriminative accuracy 93.06 % to resting state. Moreover, gyral regions as well as gyro-gyral connections consistently participate more as functional information exchange hubs than sulcal ones among these networks. This study provides novel insights into the functional brain mechanism under NS and lays a solid foundation for accurately mapping the brain anatomy-function relationship.

The brain dynamics of visuospatial perspective-taking captured by intracranial EEG

Visuospatial perspective-taking (VPT) is the ability to imagine a scene from a position different from the one used in self-perspective judgments (SPJ). We typically use VPT to understand how others see the environment. VPT requires overcoming the self-perspective, and impairments in this process are implicated in various brain disorders, such as schizophrenia and autism. However, the underlying brain areas of VPT are not well distinguished from SPJ-related ones and from domain-general responses to both perspectives. In addition, hierarchical processing theory suggests that domain-specific processes emerge over time from domain-general ones. It mainly focuses on the sensory system, but outside of it, support for this hypothesis is lacking. Therefore, we aimed to spatiotemporally distinguish brain responses domain-specific to VPT from the specific ones to self-perspective, and domain-general responses to both perspectives. In particular, we intended to test whether VPT- and SPJ specific responses begin later than the general ones. We recorded intracranial EEG data from 30 patients with epilepsy who performed a task requiring laterality judgments during VPT and SPJ, and analyzed the spatiotemporal features of responses in the broad gamma band (50-150 Hz). We found VPT-specific processing in a more extensive brain network than SPJ-specific processing. Their dynamics were similar, but both differed from the general responses, which began earlier and lasted longer. Our results anatomically distinguish VPT-specific from SPJ-specific processing. Furthermore, we temporally differentiate between domain-specific and domain-general processes both inside and outside the sensory system, which serves as a novel example of hierarchical processing.

Effects of spatial frequency cross-adaptation on the visual number sense

When observing a simple visual scene such as an array of dots, observers can easily and automatically extract their number. How does our visual system accomplish this? We investigate the role of specific spatial frequencies to the encoding of number through cross-adaptation. In two experiments, observers were peripherally adapted to six randomly generated sinusoidal gratings varying from relatively low-spatial frequency (M = 0.44 c/deg) to relatively high-spatial frequency (M = 5.88 c/deg). Subsequently, observers judged which side of the screen had a higher number of dots. We found a strong number-adaptation effect to low-spatial frequency gratings (i.e., participants significantly underestimated the number of dots on the adapted side) but a significantly reduced adaptation effect for high-spatial frequency gratings. Various control conditions demonstrate that these effects are not due to a generic response bias for the adapted side, nor moderated by dot size or spacing effects. In a third experiment, we observed no cross-adaptation for centrally presented gratings. Our results show that observers' peripheral number perception can be adapted even with stimuli lacking any numeric or segmented object information and that low spatial frequencies adapt peripheral number perception more than high ones. Together, our results are consistent with recent number perception models that suggest a key role for spatial frequency in the extraction of number from the visual signal (e.g., Paul, Ackooij, Ten Cate, & Harvey, 2022), but additionally suggest that some spatial frequencies - especially in the low range and in the periphery - may be weighted more by the visual system when estimating number. We argue that the cross-adaptation paradigm is also a useful methodology for discovering the primitives of visual number encoding.

Predictive processing of scenes and objects

Real-world visual input consists of rich scenes that are meaningfully composed of multiple objects which interact in complex, but predictable, ways. Despite this complexity, we recognize scenes, and objects within these scenes, from a brief glance at an image. In this review, we synthesize recent behavioral and neural findings that elucidate the mechanisms underlying this impressive ability. First, we review evidence that visual object and scene processing is partly implemented in parallel, allowing for a rapid initial gist of both objects and scenes concurrently. Next, we discuss recent evidence for bidirectional interactions between object and scene processing, with scene information modulating the visual processing of objects, and object information modulating the visual processing of scenes. Finally, we review evidence that objects also combine with each other to form object constellations, modulating the processing of individual objects within the object pathway. Altogether, these findings can be understood by conceptualizing object and scene perception as the outcome of a joint probabilistic inference, in which "best guesses" about objects act as priors for scene perception and vice versa, in order to concurrently optimize visual inference of objects and scenes.

Temporal differences and commonalities between hand and tool neural processing

Object recognition is a complex cognitive process that relies on how the brain organizes object-related information. While spatial principles have been extensively studied, less studied temporal dynamics may also offer valuable insights into this process, particularly when neural processing overlaps for different categories, as it is the case of the categories of hands and tools. Here we focus on the differences and/or similarities between the time-courses of hand and tool processing under electroencephalography (EEG). Using multivariate pattern analysis, we compared, for different time points, classification accuracy for images of hands or tools when compared to images of animals. We show that for particular time intervals (~ 136-156 ms and ~ 252-328 ms), classification accuracy for hands and for tools differs. Furthermore, we show that classifiers trained to differentiate between tools and animals generalize their learning to classification of hand stimuli between ~ 260-320 ms and ~ 376-500 ms after stimulus onset. Classifiers trained to distinguish between hands and animals, on the other hand, were able to extend their learning to the classification of tools at ~ 150 ms. These findings suggest variations in semantic features and domain-specific differences between the two categories, with later-stage similarities potentially related to shared action processing for hands and tools.

Distinct Patterns of Connectivity between Brain Regions Underlie the Intra-Modal and Cross-Modal Value-Driven Modulations of the Visual Cortex

Past reward associations may be signaled from different sensory modalities; however, it remains unclear how different types of reward-associated stimuli modulate sensory perception. In this human fMRI study (female and male participants), a visual target was simultaneously presented with either an intra- (visual) or a cross-modal (auditory) cue that was previously associated with rewards. We hypothesized that, depending on the sensory modality of the cues, distinct neural mechanisms underlie the value-driven modulation of visual processing. Using a multivariate approach, we confirmed that reward-associated cues enhanced the target representation in early visual areas and identified the brain valuation regions. Then, using an effective connectivity analysis, we tested three possible patterns of connectivity that could underlie the modulation of the visual cortex: a direct pathway from the frontal valuation areas to the visual areas, a mediated pathway through the attention-related areas, and a mediated pathway that additionally involved sensory association areas. We found evidence for the third model demonstrating that the reward-related information in both sensory modalities is communicated across the valuation and attention-related brain regions. Additionally, the superior temporal areas were recruited when reward was cued cross-modally. The strongest dissociation between the intra- and cross-modal reward-driven effects was observed at the level of the feedforward and feedback connections of the visual cortex estimated from the winning model. These results suggest that, in the presence of previously rewarded stimuli from different sensory modalities, a combination of domain-general and domain-specific mechanisms are recruited across the brain to adjust the visual perception.SIGNIFICANCE STATEMENT Reward has a profound effect on perception, but it is not known whether shared or disparate mechanisms underlie the reward-driven effects across sensory modalities. In this human fMRI study, we examined the reward-driven modulation of the visual cortex by visual (intra-modal) and auditory (cross-modal) reward-associated cues. Using a model-based approach to identify the most plausible pattern of inter-regional effective connectivity, we found that higher-order areas involved in the valuation and attentional processing were recruited by both types of rewards. However, the pattern of connectivity between these areas and the early visual cortex was distinct between the intra- and cross-modal rewards. This evidence suggests that, to effectively adapt to the environment, reward signals may recruit both domain-general and domain-specific mechanisms.

Can we manipulate brain connectivity? A systematic review of cortico-cortical paired associative stimulation effects

OBJECTIVE

Cortico-cortical paired associative stimulation (ccPAS) is a form of dual-site transcranial magnetic stimulation (TMS) entailing a series of single-TMS pulses paired at specific interstimulus intervals (ISI) delivered to distant cortical areas. The goal of this article is to systematically review its efficacy in inducing plasticity in humans focusing on stimulation parameters and hypotheses of underlying neurophysiology.

METHODS

A systematic review of the literature from 2009-2023 was undertaken to identify all articles utilizing ccPAS to study brain plasticity and connectivity. Six electronic databases were searched and included.

RESULTS

32 studies were identified. The studies targeted connections within the same hemisphere or between hemispheres. 28 ccPAS studies were in healthy participants, 1 study in schizophrenia, and 1 in Alzheimer's disease (AD) patients. 2 additional studies used cortico-cortical repetitive paired associative stimulation (cc-rPAS) in generalized anxiety disorder (GAD) patients. Outcome measures include electromyography (EMG), behavioral measures, electroencephalography (EEG), and functional magnetic resonance imaging (fMRI). ccPAS seems to be able to modulate brain connectivity depending on the ISI.

CONCLUSIONS

ccPAS can be used to modulate corticospinal excitability, brain activity, and behavior. Although the stimulation parameters used across studies reviewed in this paper are varied, ccPAS is a promising approach for basic research and potential clinical applications.

SIGNIFICANCE

Recent advances in neuroscience have caused a shift of interest from the study of single areas to a more complex approach focusing on networks of areas that orchestrate brain activity. Consequently, the TMS community is also witnessing a change, with a growing interest in targeting multiple brain areas rather than a single locus, as evidenced by an increasing number of papers using ccPAS. In light of this new enthusiasm for brain connectivity, this review summarizes existing literature and stimulation parameters that have proven effective in changing electrophysiological, behavioral, or neuroimaging-derived measures.

White matter modifications of corpus callosum in bipolar disorder: A DTI tractography review

BACKGROUND

The recent widespread use of diffusion tensor imaging (DTI) tractography allowed researchers to investigate the diffusivity modifications and neuroanatomical changes of white matter (WM) fascicles in major psychiatric disorders, including bipolar disorder (BD). In BD, corpus callosum (CC) seems to have a crucial role in explaining the pathophysiology and cognitive impairment of this psychiatric disorder. This review aims to provide an overview on the latest results emerging from studies that investigated neuroanatomical changes of CC in BD using DTI tractography.

METHODS

Bibliographic research was conducted on PubMed, Scopus and Web of Science datasets until March 2022. Ten studies fulfilled our inclusion criteria.

RESULTS

From the reviewed DTI tractography studies a significant decrease of fractional anisotropy emerged in the genu, body and splenium of CC of BD patients compared to controls. This finding is coupled with reduction of fiber density and modification in fiber tract length. Finally, an increase of radial and mean diffusivity in forceps minor and in the entire CC was also reported.

LIMITATIONS

Small sample size, heterogeneity in terms of methodological (diffusion gradient) and clinical (lifetime comorbidity, BD status, pharmacological treatments) characteristics.

CONCLUSIONS

Overall, these findings suggest the presence of structural modifications in CC in BD patients, which may in turn explain the cognitive impairments often observed in this psychiatric disorder, especially in executive processing, motor control and visual memory. Finally, structural modifications may suggest an impairment in the amount of functional information and a morphological impact within those brain regions connected by CC.

The multi-angle extended three-dimensional activities (META) stimulus set: A tool for studying event cognition

To study complex human activity and how it is perceived and remembered, it is valuable to have large-scale, well-characterized stimuli that are representative of such activity. We present the Multi-angle Extended Three-dimensional Activities (META) stimulus set, a structured and highly instrumented set of extended event sequences performed in naturalistic settings. Performances were captured with two color cameras and a Kinect v2 camera with color and depth sensors, allowing the extraction of three-dimensional skeletal joint positions. We tracked the positions and identities of objects for all chapters using a mixture of manual coding and an automated tracking pipeline, and hand-annotated the timings of high-level actions. We also performed an online experiment to collect normative event boundaries for all chapters at a coarse and fine grain of segmentation, which allowed us to quantify event durations and agreement across participants. We share these materials publicly to advance new discoveries in the study of complex naturalistic activity.

Aberrant Intrinsic Brain Network Functional Connectivity During a Face-Matching Task in Women Diagnosed With Premenstrual Dysphoric Disorder

BACKGROUND

Premenstrual dysphoric disorder (PMDD) is characterized by affective, cognitive, and physical symptoms, suggesting alterations at the brain network level. Women with PMDD demonstrate aberrant discrimination of facial emotions during the luteal phase of the menstrual cycle and altered reactivity to emotional stimuli. However, previous studies assessing emotional task-related brain reactivity using region-of-interest or whole-brain analysis have reported conflicting findings. Therefore, we utilized both region-of-interest task-reactivity and seed-voxel functional connectivity (FC) approaches to test for differences in the default mode network, salience network, and central executive network between women with PMDD and control participants during an emotional-processing task that yields an optimal setup for investigating brain network changes in PMDD.

METHODS

Twenty-four women with PMDD and 27 control participants were classified according to the Daily Record of Severity of Problems. Participants underwent functional magnetic resonance imaging scans while completing the emotional face-matching task during the midfollicular and late-luteal phases of their menstrual cycle.

RESULTS

No significant between-group differences in brain reactivity were found using region-of-interest analysis. In the FC analysis, a main effect of diagnosis was found showing decreased default mode network connectivity, increased salience network connectivity, and decreased central executive network connectivity in women with PMDD compared with control participants. A significant interaction between menstrual cycle phase and diagnosis was found in the central executive network for right posterior parietal cortex and left inferior lateral occipital cortex connectivity. A post hoc analysis revealed stronger FC during the midfollicular than the late-luteal phase of PMDD.

CONCLUSIONS

Aberrant FC in the 3 brain networks involved in PMDD may indicate vulnerability to experience affective and cognitive symptoms of the disorder.

Influence of colour vision on attention to, and impression of, complex aesthetic images

Humans exhibit colour vision variations due to genetic polymorphisms, with trichromacy being the most common, while some people are classified as dichromats. Whether genetic differences in colour vision affect the way of viewing complex images remains unknown. Here, we investigated how people with different colour vision focused their gaze on aesthetic paintings by eye-tracking while freely viewing digital rendering of paintings and assessed individual impressions through a decomposition analysis of adjective ratings for the images. Gaze-concentrated areas among trichromats were more highly correlated than those among dichromats. However, compared with the brief dichromatic experience with the simulated images, there was little effect of innate colour vision differences on impressions. These results indicate that chromatic information is instructive as a cue for guiding attention, whereas the impression of each person is generated according to their own sensory experience and normalized through one's own colour space.

A large-scale fMRI dataset for the visual processing of naturalistic scenes

One ultimate goal of visual neuroscience is to understand how the brain processes visual stimuli encountered in the natural environment. Achieving this goal requires records of brain responses under massive amounts of naturalistic stimuli. Although the scientific community has put a lot of effort into collecting large-scale functional magnetic resonance imaging (fMRI) data under naturalistic stimuli, more naturalistic fMRI datasets are still urgently needed. We present here the Natural Object Dataset (NOD), a large-scale fMRI dataset containing responses to 57,120 naturalistic images from 30 participants. NOD strives for a balance between sampling variation between individuals and sampling variation between stimuli. This enables NOD to be utilized not only for determining whether an observation is generalizable across many individuals, but also for testing whether a response pattern is generalized to a variety of naturalistic stimuli. We anticipate that the NOD together with existing naturalistic neuroimaging datasets will serve as a new impetus for our understanding of the visual processing of naturalistic stimuli.

Spoken language processing activates the primary visual cortex

Primary visual cortex (V1) is generally thought of as a low-level sensory area that primarily processes basic visual features. Although there is evidence for multisensory effects on its activity, these are typically found for the processing of simple sounds and their properties, for example spatially or temporally-congruent simple sounds. However, in congenitally blind individuals, V1 is involved in language processing, with no evidence of major changes in anatomical connectivity that could explain this seemingly drastic functional change. This is at odds with current accounts of neural plasticity, which emphasize the role of connectivity and conserved function in determining a neural tissue's role even after atypical early experiences. To reconcile what appears to be unprecedented functional reorganization with known accounts of plasticity limitations, we tested whether V1's multisensory roles include responses to spoken language in sighted individuals. Using fMRI, we found that V1 in normally sighted individuals was indeed activated by comprehensible spoken sentences as compared to an incomprehensible reversed speech control condition, and more strongly so in the left compared to the right hemisphere. Activation in V1 for language was also significant and comparable for abstract and concrete words, suggesting it was not driven by visual imagery. Last, this activation did not stem from increased attention to the auditory onset of words, nor was it correlated with attentional arousal ratings, making general attention accounts an unlikely explanation. Together these findings suggest that V1 responds to spoken language even in sighted individuals, reflecting the binding of multisensory high-level signals, potentially to predict visual input. This capability might be the basis for the strong V1 language activation observed in people born blind, re-affirming the notion that plasticity is guided by pre-existing connectivity and abilities in the typically developed brain.

Objects sharpen visual scene representations: evidence from MEG decoding

Real-world scenes consist of objects, defined by local information, and scene background, defined by global information. Although objects and scenes are processed in separate pathways in visual cortex, their processing interacts. Specifically, previous studies have shown that scene context makes blurry objects look sharper, an effect that can be observed as a sharpening of object representations in visual cortex from around 300 ms after stimulus onset. Here, we use MEG to show that objects can also sharpen scene representations, with the same temporal profile. Photographs of indoor (closed) and outdoor (open) scenes were blurred such that they were difficult to categorize on their own but easily disambiguated by the inclusion of an object. Classifiers were trained to distinguish MEG response patterns to intact indoor and outdoor scenes, presented in an independent run, and tested on degraded scenes in the main experiment. Results revealed better decoding of scenes with objects than scenes alone and objects alone from 300 ms after stimulus onset. This effect was strongest over left posterior sensors. These findings show that the influence of objects on scene representations occurs at similar latencies as the influence of scenes on object representations, in line with a common predictive processing mechanism.

Daily Cannabidiol Administration for 10 Weeks Modulates Hippocampal and Amygdalar Resting-State Functional Connectivity in Cannabis Users: A Functional Magnetic Resonance Imaging Open-Label Clinical Trial

Introduction: Cannabis use is associated with brain functional changes in regions implicated in prominent neuroscientific theories of addiction. Emerging evidence suggests that cannabidiol (CBD) is neuroprotective and may reverse structural brain changes associated with prolonged heavy cannabis use. In this study, we examine how an ∼10-week exposure of CBD in cannabis users affected resting-state functional connectivity in brain regions functionally altered by cannabis use. Materials and Methods: Eighteen people who use cannabis took part in a ∼10 weeks open-label pragmatic trial of self-administered daily 200 mg CBD in capsules. They were not required to change their cannabis exposure patterns. Participants were assessed at baseline and post-CBD exposure with structural magnetic resonance imaging (MRI) and a functional MRI resting-state task (eyes closed). Seed-based connectivity analyses were run to examine changes in the functional connectivity of a priori regions-the hippocampus and the amygdala. We explored if connectivity changes were associated with cannabinoid exposure (i.e., cumulative cannabis dosage over trial, and plasma CBD concentrations and Δ9-tetrahydrocannabinol (THC) plasma metabolites postexposure), and mental health (i.e., severity of anxiety, depression, and positive psychotic symptom scores), accounting for cigarette exposure in the past month, alcohol standard drinks in the past month and cumulative CBD dose during the trial. Results: Functional connectivity significantly decreased pre-to-post the CBD trial between the anterior hippocampus and precentral gyrus, with a strong effect size (d=1.73). Functional connectivity increased between the amygdala and the lingual gyrus pre-to-post the CBD trial, with a strong effect size (d=1.19). There were no correlations with cannabinoids or mental health symptom scores. Discussion: Prolonged CBD exposure may restore/reduce functional connectivity differences reported in cannabis users. These new findings warrant replication in a larger sample, using robust methodologies-double-blind and placebo-controlled-and in the most vulnerable people who use cannabis, including those with more severe forms of Cannabis Use Disorder and experiencing worse mental health outcomes (e.g., psychosis, depression).

Different levels of visuospatial abilities linked to differential brain correlates underlying visual mental segmentation processes in autism

The neural underpinnings of enhanced locally oriented visual processing that are specific to autistics with a Wechsler's Block Design (BD) peak are largely unknown. Here, we investigated the brain correlates underlying visual segmentation associated with the well-established autistic superior visuospatial abilities in distinct subgroups using functional magnetic resonance imaging. This study included 31 male autistic adults (15 with (AUTp) and 16 without (AUTnp) a BD peak) and 28 male adults with typical development (TYP). Participants completed a computerized adapted BD task with models having low and high perceptual cohesiveness (PC). Despite similar behavioral performances, AUTp and AUTnp showed generally higher occipital activation compared with TYP participants. Compared with both AUTnp and TYP participants, the AUTp group showed enhanced task-related functional connectivity within posterior visuoperceptual regions and decreased functional connectivity between frontal and occipital-temporal regions. A diminished modulation in frontal and parietal regions in response to increased PC was also found in AUTp participants, suggesting heavier reliance on low-level processing of global figures. This study demonstrates that enhanced visual functioning is specific to a cognitive phenotypic subgroup of autistics with superior visuospatial abilities and reinforces the need to address autistic heterogeneity by good cognitive characterization of samples in future studies.

The perceptual categorization of multidimensional stimuli is hierarchically organized

As we interact with our surroundings, we encounter the same or similar objects from different perspectives and are compelled to generalize. For example, despite their variety we recognize dog barks as a distinct sound class. While we have some understanding of generalization along a single stimulus dimension (frequency, color), natural stimuli are identifiable by a combination of dimensions. Measuring their interaction is essential to understand perception. Using a 2-dimension discrimination task for mice and frequency or amplitude modulated sounds, we tested untrained generalization across pairs of auditory dimensions in an automatized behavioral paradigm. We uncovered a perceptual hierarchy over the tested dimensions that was dominated by the sound's spectral composition. Stimuli are thus not perceived as a whole, but as a combination of their features, each of which weights differently on the identification of the stimulus according to an established hierarchy, possibly paralleling their differential shaping of neuronal tuning.

When Neural Activity Fails to Reveal Causal Contributions

Neuroscientists rely on distributed spatio-temporal patterns of neural activity to understand how neural units contribute to cognitive functions and behavior. However, the extent to which neural activity reliably indicates a unit's causal contribution to the behavior is not well understood. To address this issue, we provide a systematic multi-site perturbation framework that captures time-varying causal contributions of elements to a collectively produced outcome. Applying our framework to intuitive toy examples and artificial neuronal networks revealed that recorded activity patterns of neural elements may not be generally informative of their causal contribution due to activity transformations within a network. Overall, our findings emphasize the limitations of inferring causal mechanisms from neural activities and offer a rigorous lesioning framework for elucidating causal neural contributions.

Variational relevance evaluation of individual fMRI data enables deconstruction of task-dependent neural dynamics

In neuroimaging research, univariate analysis has always been used to localize "representations" at the microscale, whereas network approaches have been applied to characterize transregional "operations". How are representations and operations linked through dynamic interactions? We developed the variational relevance evaluation (VRE) method to analyze individual task fMRI data, which selects informative voxels during model training to localize the "representation", and quantifies the dynamic contributions of single voxels across the whole-brain to different cognitive functions to characterize the "operation". Using 15 individual fMRI data files for higher visual area localizers, we evaluated the characterization of selected voxel positions of VRE and revealed different object-selective regions functioning in similar dynamics. Using another 15 individual fMRI data files for memory retrieval after offline learning, we found similar task-related regions working in different neural dynamics for tasks with diverse familiarities. VRE demonstrates a promising horizon in individual fMRI research.

Visuo-haptic object perception for robots: an overview

The object perception capabilities of humans are impressive, and this becomes even more evident when trying to develop solutions with a similar proficiency in autonomous robots. While there have been notable advancements in the technologies for artificial vision and touch, the effective integration of these two sensory modalities in robotic applications still needs to be improved, and several open challenges exist. Taking inspiration from how humans combine visual and haptic perception to perceive object properties and drive the execution of manual tasks, this article summarises the current state of the art of visuo-haptic object perception in robots. Firstly, the biological basis of human multimodal object perception is outlined. Then, the latest advances in sensing technologies and data collection strategies for robots are discussed. Next, an overview of the main computational techniques is presented, highlighting the main challenges of multimodal machine learning and presenting a few representative articles in the areas of robotic object recognition, peripersonal space representation and manipulation. Finally, informed by the latest advancements and open challenges, this article outlines promising new research directions.