The lateral occipital complex and its role in object recognition

HD-tDCS to the lateral occipital complex improves haptic object recognition

High-definition transcranial direct current stimulation (HD-tDCS) is a non-invasive brain stimulation technique that has been shown to be safe and effective in modulating neuronal activity. The present study investigates the effect of anodal HD-tDCS on haptic object perception and memory through stimulation of the lateral occipital complex (LOC), a structure that has been shown to be involved in both visual and haptic object recognition. In this single-blind, sham-controlled, between-subjects study, blindfolded healthy, sighted participants used their right (dominant) hand to perform haptic discrimination and recognition tasks with 3D-printed, novel objects called "Greebles" while receiving 20 min of 2 milliamp (mA) anodal stimulation (or sham) to the left or right LOC. Compared to sham, those who received left LOC stimulation (contralateral to the hand used) showed an improvement in haptic object recognition but not discrimination-a finding that was evident from the start of the behavioral tasks. A second experiment showed that this effect was not observed with right LOC stimulation (ipsilateral to the hand used). These results suggest that HD-tDCS to the left LOC can improve recognition of objects perceived via touch. Overall, this work sheds light on the LOC as a multimodal structure that plays a key role in object recognition in both the visual and haptic modalities.

Modeling short visual events through the BOLD moments video fMRI dataset and metadata

Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1000 short (3 s) naturalistic video clips of visual events across ten human subjects. We use the videos' extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.

Laminar dissociation of feedforward and feedback in high-level ventral visual cortex during imagery and perception

Visual imagery and perception share neural machinery but rely on different information flow. While perception is driven by the integration of sensory feedforward and internally generated feedback information, imagery relies on feedback only. This suggests that although imagery and perception may activate overlapping brain regions, they do so in informationally distinctive ways. Using lamina-resolved MRI at 7 T, we measured the neural activity during imagery and perception of faces and scenes in high-level ventral visual cortex at the mesoscale of laminar organization that distinguishes feedforward from feedback signals. We found distinctive laminar profiles for imagery and perception of scenes and faces in the parahippocampal place area and the fusiform face area, respectively. Our findings provide insight into the neural basis of the phenomenology of visual imagery versus perception and shed new light into the mesoscale organization of feedforward and feedback information flow in high-level ventral visual cortex.

Neural correlates of approach-avoidance behavior in healthy subjects: Effects of low-frequency repetitive transcranial magnetic stimulation (rTMS) over the right dorsolateral prefrontal cortex

The dorsolateral prefrontal cortex (dlPFC) is implicated in top-down regulation of emotion, but the detailed network mechanisms require further elucidation. To investigate network-level functions of the dlPFC in emotion regulation, this study measured changes in task-based activation, resting-state and task-based functional connectivity (FC) patterns following suppression of dlPFC excitability by 1-Hz repetitive transcranial magnetic stimulation (rTMS). In a sham-controlled within-subject design, 1-Hz active or sham rTMS was applied to the right dlPFC of 19 healthy volunteers during two separate counterbalanced sessions. Following active and sham rTMS, functional magnetic resonance imaging (fMRI) was conducted in the resting state (rs-fMRI) and during approach-avoidance task responses to pictures with positive and negative emotional content (task-based fMRI). Activation and generalized psychophysiological interaction analyses were performed on task-based fMRI, and seed-based FC analysis was applied to rs-fMRI data. Task-based fMRI revealed greater and more lateralized activation in the right hemisphere during negative picture responses compared to positive picture responses. After active rTMS, greater activation was observed in the left middle prefrontal cortex compared to sham rTMS. Further, rTMS reduced response times and error rates in approach to positive pictures compared to negative pictures. Significant FC changes due to rTMS were observed predominantly in the frontoparietal network (FPN) and visual network (VN) during the task, and in the default mode network (DMN) and VN at rest. Suppression of right dlPFC activity by 1-Hz rTMS alters large-scale neural networks and modulates emotion, supporting potential applications for the treatment of mood disorders.

Impaired contour object perception in psychosis

Contour integration, the process of joining spatially separated elements into a single unified line, has consistently been found to be impaired in schizophrenia. Recent work suggests that this deficit could be associated with psychotic symptomatology, rather than a specific diagnosis such as schizophrenia. Examining a transdiagnostic sample of participants with psychotic psychopathology, we obtained quantitative indices of contour perception in a psychophysical behavioral task. We found impaired contour discrimination performance among people with psychotic psychopathology (PwPP, n = 62) compared to healthy controls (n = 34) and biological relatives of PwPP (n = 44). Participants with schizophrenia (n = 31) showed impaired task performance compared to participants with bipolar disorder (n = 18). We also measured responses during an analogous task using ultra-high field (7T) functional MRI and found higher responses in the lateral occipital cortex of PwPP compared to controls. Using task-based functional connectivity analyses, we observed abnormal connectivity between visual brain areas during contour perception among PwPP. These connectivity differences only emerged when participants had to distinguish the contour object from background distractors, suggesting that a failure to suppress noise elements relative to contour elements may underlie impaired contour processing in PwPP. Our results are consistent with impaired contour integration in psychotic psychopathology, and especially schizophrenia, that is related to cognitive dysfunction, and may be linked to impaired functional connectivity across visual regions.

Contribution of the lateral occipital and parahippocampal cortices to pattern separation of objects and contexts

Contextual features are integral to episodic memories; yet, we know little about context effects on pattern separation, a hippocampal function promoting orthogonalization of overlapping memory representations. Recent studies suggested that various extrahippocampal brain regions support pattern separation; however, the specific role of the parahippocampal cortex-a region involved in context representation-in pattern separation has not yet been studied. Here, we investigated the contribution of the parahippocampal cortex (specifically, the parahippocampal place area) to context reinstatement effects on mnemonic discrimination, using functional magnetic resonance imaging. During scanning, participants saw object images on unique context scenes, followed by a recognition task involving the repetitions of encoded objects or visually similar lures on either their original context or a lure context. Context reinstatement at retrieval improved item recognition but hindered mnemonic discrimination. Crucially, our region of interest analyses of the parahippocampal place area and an object-selective visual area, the lateral occipital cortex indicated that while during successful mnemonic decisions parahippocampal place area activity decreased for old contexts compared to lure contexts irrespective of object novelty, lateral occipital cortex activity differentiated between old and lure objects exclusively. These results imply that pattern separation of contextual and item-specific memory features may be differentially aided by scene and object-selective cortical areas.

Task-related brain activation associated with violence in patients with schizophrenia: A meta-analysis

This study investigates specific changes in brain function during cognitive and emotional tasks in patients with schizophrenia and a history of violence (VSCZ) compared with non-violent patients with schizophrenia and healthy controls. A comprehensive literature search was conducted at the Web of Science, Medline, and PubMed. Ten studies met the inclusion criteria. In which, eight studies compared brain activation between patients with VSCZ and non-violent patients with schizophrenia, and the former exhibited increased activation at the middle occipital gyrus and rectus compared with the latter. Seven studies compared brain activation between patients with VSCZ and controls, and the former exhibited increased activation at the anterior cingulate cortex, cerebellum VI region, lingual gyrus and fusiform. Subgroup analysis in five studies performing emotional tasks revealed that patients with VSCZ showed increased activation at the middle occipital gyrus compared with non-violent patients with schizophrenia. Our findings suggest that abnormal emotion perception and regulation significantly contribute to the increased risk of violence in patients with schizophrenia. Notably, the middle occipital gyrus and rectus emerge as key neurophysiological correlates associated with this phenomenon.

Neural representations of perspectival shapes and attentional effects: Evidence from fMRI and MEG

Does the human brain represent perspectival shapes, i.e., viewpoint-dependent object shapes, especially in relatively higher-level visual areas such as the lateral occipital cortex? What is the temporal profile of the appearance and disappearance of neural representations of perspectival shapes? And how does attention influence these neural representations? To answer these questions, we employed functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and multivariate decoding techniques to investigate spatiotemporal neural representations of perspectival shapes. Participants viewed rotated objects along with the corresponding objective shapes and perspectival shapes (i.e., rotated round, round, and oval) while we measured their brain activities. Our results revealed that shape classifiers trained on the basic shapes (i.e., round and oval) consistently identified neural representations in the lateral occipital cortex corresponding to the perspectival shapes of the viewed objects regardless of attentional manipulations. Additionally, this classification tendency toward the perspectival shapes emerged approximately 200 ms after stimulus presentation. Moreover, attention influenced the spatial dimension as the regions showing the perspectival shape classification tendency propagated from the occipital lobe to the temporal lobe. As for the temporal dimension, attention led to a more robust and enduring classification tendency towards perspectival shapes. In summary, our study outlines a spatiotemporal neural profile for perspectival shapes that suggests a greater degree of perspectival representation than is often acknowledged.

Visual Cortical Thickness Increases with Prolonged Artificial Vision Restoration

The Argus II retinal prosthesis restores visual perception to late blind patients. It has been shown that structural changes occur in the brain due to late-onset blindness, including cortical thinning in visual regions of the brain. Following vision restoration, it is not yet known whether these visual regions are reinvigorated and regain a normal cortical thickness or retain the diminished thickness from blindness. We evaluated the cortical thicknesses of ten Argus II Retinal Prostheses patients, ten blind patients, and thirteen sighted participants. The Argus II patients on average had a thicker left Cuneus Cortex and Lateral Occipital Cortex relative to the blind patients. The duration of the Argus II use (time since implant in active users) significantly partially correlated with thicker visual cortical regions in the left hemisphere. Furthermore, in the two case studies (scanned before and after implantation), the patient with longer device use (44.5 months) had an increase in the cortical thickness of visual regions, whereas the shorter-using patient did not (6.5 months). Finally, a third case, scanned at three time points post-implantation, showed an increase in cortical thickness in the Lateral Occipital Cortex between 43.5 and 57 months, which was maintained even after 3 years of disuse (106 months). Overall, the Argus II patients' cortical thickness was on average significantly rejuvenated in two higher visual regions and, patients using the implant for a longer duration had thicker visual regions. This research raises the possibility of structural plasticity reversing visual cortical atrophy in late-blind patients with prolonged vision restoration.

An extremely fast neural mechanism to detect emotional visual stimuli: A two-experiment study

Defining the brain mechanisms underlying initial emotional evaluation is a key but unexplored clue to understanding affective processing. Event-related potentials (ERPs), especially suited for investigating this issue, were recorded in two experiments (n = 36 and n = 35). We presented emotionally negative (spiders) and neutral (wheels) silhouettes homogenized regarding their visual parameters. In Experiment 1, stimuli appeared at fixation or in the periphery (200 trials per condition and location), the former eliciting a N40 (39 milliseconds) and a P80 (or C1: 80 milliseconds) component, and the latter only a P80. In Experiment 2, stimuli were presented only at fixation (500 trials per condition). Again, an N40 (45 milliseconds) was observed, followed by a P100 (or P1: 105 milliseconds). Analyses revealed significantly greater N40-C1P1 peak-to-peak amplitudes for spiders in both experiments, and ANCOVAs showed that these effects were not explained by C1P1 alone, but that processes underlying N40 significantly contributed. Source analyses pointed to V1 as an N40 focus (more clearly in Experiment 2). Sources for C1P1 included V1 (P80) and V2/LOC (P80 and P100). These results and their timing point to low-order structures (such as visual thalamic nuclei or superior colliculi) or the visual cortex itself, as candidates for initial evaluation structures.

The large-scale organization of shape processing in the ventral and dorsal pathways is dissociable from attention

The two visual pathways model posits that visual information is processed through two distinct cortical systems: The ventral pathway promotes visual recognition, while the dorsal pathway supports visuomotor control. Recent evidence suggests the dorsal pathway is also involved in shape processing and may contribute to object perception, but it remains unclear whether this sensitivity is independent of attentional mechanisms that were localized to overlapping cortical regions. To address this question, we conducted two fMRI experiments that utilized different parametric scrambling manipulations in which human participants viewed novel objects in different levels of scrambling and were instructed to attend to either the object or to another aspect of the image (e.g. color of the background). Univariate and multivariate analyses revealed that the large-scale organization of shape selectivity along the dorsal and ventral pathways was preserved regardless of the focus of attention. Attention did modulate shape sensitivity, but these effects were similar across the two pathways. These findings support the idea that shape processing is at least partially dissociable from attentional processes and relies on a distributed set of cortical regions across the visual pathways.

Neuronal tuning and population representations of shape and category in human visual cortex

Object recognition and categorization are essential cognitive processes which engage considerable neural resources in the human ventral visual stream. However, the tuning properties of human ventral stream neurons for object shape and category are virtually unknown. We performed large-scale recordings of spiking activity in human Lateral Occipital Complex in response to stimuli in which the shape dimension was dissociated from the category dimension. Consistent with studies in nonhuman primates, the neuronal representations were primarily shape-based, although we also observed category-like encoding for images of animals. Surprisingly, linear decoders could reliably classify stimulus category even in data sets that were entirely shape-based. In addition, many recording sites showed an interaction between shape and category tuning. These results represent a detailed study on shape and category coding at the neuronal level in the human ventral visual stream, furnishing essential evidence that reconciles human imaging and macaque single-cell studies.

Modulation of the neuronal response in human primary visual cortex by re-entrant projections during retinal input processing as manifest in the visual evoked potential

Initial deflections in the visual evoked potential (VEP) reflect the neuronal process of extracting features from the retinal input; a process not modulated by re-entrant projections. Later deflections in the VEP reflect the neuronal process of combining features into an object, a process referred to as 'object closure' and modulated by re-entrant projections. Our earlier work indicated that the VEP reflects independent neuronal responses processing temporal - and spatial luminance contrast and that these responses arise from an interaction between forward and re-entrant input. In this earlier work, changing the temporal luminance contrast property of a stimulus altered its spatial luminance contrast property. We recorded the VEP in 12 volunteers viewing image pairs of a windmill, regular dartboard or an RMS dartboard rotated by either Π/4, Π/2, 3Π/4 or Π radians with respect to each other. The windmill and regular dartboard had identical white to black ratio, while the two dartboards identical contrast edges per unit area. Rotation varied temporal luminance contrast of a stimulus without affecting its spatial luminance contrast. N75, P100, N135 and P240 amplitude and latency were compared and a source localisation and temporal frequency analysis performed. P100 amplitude signals a neuronal response processing temporal luminance contrast that is modulated by re-entrant projections with fast axonal conduction velocities. N135 and P240 signal the neuronal response processing spatial luminance contrast and is modulated by re-entrant projections with slow axonal conduction velocities. The dorsal stream is interconnected by fast axonal conduction velocities, the ventral stream by slow axonal conduction velocities.

Investigating the neural effects of typicality and predictability for face and object stimuli

The brain calibrates itself based on the past stimulus diet, which makes frequently observed stimuli appear as typical (as opposed to uncommon stimuli, which appear as distinctive). Based on predictive processing theory, the brain should be more "prepared" for typical exemplars, because these contain information that has been encountered frequently, allowing it to economically represent items of that category. Thus, one could ask whether predictability and typicality of visual stimuli interact, or rather act in an additive manner. We adapted the design by Egner and colleagues (2010), who used cues to induce expectations about stimulus category (face vs. chair) occurrence during an orthogonal inversion detection task. We measured BOLD responses with fMRI in 35 participants. First, distinctive stimuli always elicited stronger responses than typical ones in all ROIs, and our whole-brain directional contrasts for the effects of typicality and distinctiveness converge with previous findings. Second and importantly, we could not replicate the interaction between category and predictability reported by Egner et al. (2010), which casts doubt on whether cueing designs are ideal to elicit reliable predictability effects. Third, likely as a consequence of the lack of predictability effects, we found no interaction between predictability and typicality in any of the four tested regions (bilateral fusiform face areas, lateral occipital complexes) when considering both categories, nor in the whole brain. We discuss the issue of replicability in neuroscience and sketch an agenda for how future studies might address the same question.

Movement trajectories as a window into the dynamics of emerging neural representations

The rapid transformation of sensory inputs into meaningful neural representations is critical to adaptive human behaviour. While non-invasive neuroimaging methods are the de-facto method for investigating neural representations, they remain expensive, not widely available, time-consuming, and restrictive. Here we show that movement trajectories can be used to measure emerging neural representations with fine temporal resolution. By combining online computer mouse-tracking and publicly available neuroimaging data via representational similarity analysis (RSA), we show that movement trajectories track the unfolding of stimulus- and category-wise neural representations along key dimensions of the human visual system. We demonstrate that time-resolved representational structures derived from movement trajectories overlap with those derived from M/EEG (albeit delayed) and those derived from fMRI in functionally-relevant brain areas. Our findings highlight the richness of movement trajectories and the power of the RSA framework to reveal and compare their information content, opening new avenues to better understand human perception.

Utilizing maternal prenatal cognition as a predictor of newborn brain measures of intellectual development

Identifying reliable indicators of cognitive functioning prior to age five has been challenging. Prior studies have shown that maternal cognition, as indexed by intellectual quotient (IQ) and years of education, predict child intelligence at school age. We examined whether maternal full scale IQ, education, and inhibitory control (index of executive function) are associated with newborn brain measures and toddler language outcomes to assess potential indicators of early cognition. We hypothesized that maternal indices of cognition would be associated with brain areas implicated in intelligence in school-age children and adults in the newborn period. Thirty-seven pregnant women and their newborns underwent an MRI scan. T2-weighted images and surface-based morphometric analysis were used to compute local brain volumes in newborn infants. Maternal cognition indices were associated with local brain volumes for infants in the anterior and posterior cingulate, occipital lobe, and pre/postcentral gyrus - regions associated with IQ, executive function, or sensori-motor functions in children and adults. Maternal education and executive function, but not maternal intelligence, were associated with toddler language scores at 12 and 24 months. Newborn brain volumes did not predict language scores. Overall, the pre/postcentral gyrus and occipital lobe may be unique indicators of early intellectual development in the newborn period. Given that maternal executive function as measured by inhibitory control has robust associations with the newborn brain and is objective, brief, and easy to administer, it may be a useful predictor of early developmental and cognitive capacity for young children.

FMRI correlates of autobiographical memory: Comparing silent retrieval with narrated retrieval

FMRI studies of autobiographical memory (AM) retrieval typically ask subjects to retrieve memories silently to avoid speech-related motion artifacts. Recently, some fMRI studies have started to use overt (spoken) retrieval to probe moment-to-moment retrieved content. However, the extent to which the overt retrieval method alters fMRI activations during retrieval is unknown. Here we examined this question by eliciting unrehearsed AMs during fMRI scanning either overtly or silently, in the same subjects, in different runs. Differences between retrieval modality (silent vs. narrated) included greater activation for silent retrieval in the anterior hippocampus, left angular gyrus, PCC, and superior PFC, and greater activation for narrated retrieval in speech production regions, posterior hippocampus, and the DLPFC. To probe temporal dynamics, we divided each retrieval period into an initial search phase and a later elaboration phase. The activations during the search and elaboration phases were broadly similar regardless of modality, and these activations were in line with previous fMRI studies of AM temporal dynamics employing silent retrieval. For both retrieval modalities, search activated the hippocampus, mPFC, ACC, and PCC, and elaboration activated the left DLPFC and middle temporal gyri. To examine content-specific reactivation during retrieval, the timecourse of narrated memory content was transcribed and modeled. We observed dynamic activation associated with object content in the lateral occipital complex, and activation associated with scene content in the retrosplenial cortex. The current findings show that both silent and narrated AMs activate a broadly similar memory network, with some key differences, and add to current knowledge regarding the content-specific dynamics of AM retrieval. However, these observed differences between retrieval modality suggest that studies using overt retrieval should carefully consider this method's possible effects on cognitive and neural processing.

Trans-Synaptic Degeneration in the Visual Pathway in Patients With Myelin Oligodendrocyte Glycoprotein Antibody-Associated Disease

BACKGROUND AND OBJECTIVES

We aimed to assess the presence of retinal neurodegeneration independent of optic neuritis (ON) in myelin oligodendrocyte glycoprotein antibody-associated disease (MOGAD) and to investigate the development of trans-synaptic anterograde degeneration in these patients after ON.

METHODS

Cross-sectional, retrospective study of 34 adult patients with MOGAD and 23 healthy controls (HC). Clinical, optical coherence tomography (OCT), and MRI data were collected. Peripapillary retinal nerve fiber layer (pRNFL) and ganglion cell inner plexiform layer (GCIPL) were obtained using Heidelberg Spectralis. FreeSurfer7 was used to obtain the lateral geniculate nucleus (LGN), occipital volume fractions (to total estimated intracranial volume), and occipital cortical thickness. For the anterior visual pathway, the analysis was conducted using eyes, classified based on the history of ON (Eye-ON and Eye-NON) and compared with Eye-HC. The analysis of OCT and brain volumetric measures was conducted comparing MOGAD-ON, MOGAD-NON, and HC groups. The analysis of covariance with a Bonferroni-adjusted post hoc test was used to test differences between groups and linear regression analysis to evaluate OCT/MRI associations; age and sex were considered as covariates.

RESULTS

24 (70.5%) patients had a prior ON. Median pRNFL and GCIPL thickness (um) was significantly reduced in Eye-ON vs EyeNON and HC (pRNFL: 69.4 (17.3), 89.6 (13.7), 98.2 (11.7), p < 0.001; GCIPL: 55.8 (8.7), 67.39 (8.7), 72.6 (4.5), p < 0.001). pRNFL and GCIPL thickness had a negative correlation with the number of ON episodes (p = 0.025 and p = 0.031, respectively). LGN volume fraction was significantly lower in patients with MOGAD-ON than in HC (0.33 (0.05) vs 0.39 (0.04), p = 0.002). The occipital cortical thickness was lower in MOGAD-ON compared with MOGAD-NON and HC (p = 0.010). In patients with MOGAD-ON, pRNFL correlated with LGN volume (p = 0.006), occipital thickness (p = 0.002), and the medial occipital cortex (p = 0.002), but not the lateral occipital lobe.

DISCUSSION

Compared with HC, MOGAD-ON exhibits reduced retinal thickness, primarily influenced by the presence and the number of prior ON episodes. Moreover, MOGAD-ON demonstrates significant atrophy in the retinal, subcortical, and cortical regions of the visual pathway, distinguishing them from MOGAD-NON and HC. These findings suggest that in patients with MOGAD neurodegeneration is tightly correlated with damage to the involved pathway.

Visual perception of highly memorable images is mediated by a distributed network of ventral visual regions that enable a late memorability response

Behavioral and neuroscience studies in humans and primates have shown that memorability is an intrinsic property of an image that predicts its strength of encoding into and retrieval from memory. While previous work has independently probed when or where this memorability effect may occur in the human brain, a description of its spatiotemporal dynamics is missing. Here, we used representational similarity analysis (RSA) to combine functional magnetic resonance imaging (fMRI) with source-estimated magnetoencephalography (MEG) to simultaneously measure when and where the human cortex is sensitive to differences in image memorability. Results reveal that visual perception of High Memorable images, compared to Low Memorable images, recruits a set of regions of interest (ROIs) distributed throughout the ventral visual cortex: a late memorability response (from around 300 ms) in early visual cortex (EVC), inferior temporal cortex, lateral occipital cortex, fusiform gyrus, and banks of the superior temporal sulcus. Image memorability magnitude results are represented after high-level feature processing in visual regions and reflected in classical memory regions in the medial temporal lobe (MTL). Our results present, to our knowledge, the first unified spatiotemporal account of visual memorability effect across the human cortex, further supporting the levels-of-processing theory of perception and memory.

Explainable artificial intelligence (xAI) in neuromarketing/consumer neuroscience: an fMRI study on brand perception

Introduction

The research in consumer neuroscience has identified computational methods, particularly artificial intelligence (AI) and machine learning, as a significant frontier for advancement. Previously, we utilized functional magnetic resonance imaging (fMRI) and artificial neural networks (ANNs) to model brain processes related to brand preferences in a paradigm exempted from motor actions. In the current study, we revisit this data, introducing recent advancements in explainable artificial intelligence (xAI) to gain insights into this domain. By integrating fMRI data analysis, machine learning, and xAI, our study aims to search for functional brain networks that support brand perception and, ultimately, search for brain networks that disentangle between preferred and indifferent brands, focusing on the early processing stages.

Methods

We applied independent component analysis (ICA) to overcome the expected fMRI data's high dimensionality, which raises hurdles in AI applications. We extracted pertinent features from the returned ICs. An ANN is then trained on this data, followed by pruning and retraining processes. We then apply explanation techniques, based on path-weights and Shapley values, to make the network more transparent, explainable, and interpretable, and to obtain insights into the underlying brain processes.

Results

The fully connected ANN model obtained an accuracy of 54.6%, which dropped to 50.4% after pruning. However, the retraining process allowed it to surpass the fully connected network, achieving an accuracy of 55.9%. The path-weights and Shapley-based analysis concludes that, regarding brand perception, the expected initial participation of the primary visual system is followed. Other brain areas participate in early processing and discriminate between preferred and indifferent brands, such as the cuneal and the lateral occipital cortices.

Discussion

The most important finding is that a split between processing brands|preferred from brands|indifferent may occur during early processing stages, still in the visual system. However, we found no evidence of a "decision pipeline" that would yield if a brand is preferred or indifferent. The results suggest the existence of a "tagging"-like process in parallel flows in the extrastriate. Network training dynamics aggregate specific processes within the hidden nodes by analyzing the model's hidden layer. This yielded that some nodes contribute to both global brand appraisal and specific brand category classification, shedding light on the neural substrates of decision-making in response to brand stimuli.

The neural basis of naturalistic semantic and social cognition

Decoding social environments and engaging meaningfully with other people are critical aspects of human cognition. Multiple cognitive systems, including social and semantic cognition, work alongside each other to support these processes. This study investigated shared processing between social and semantic systems using neuroimaging data collected during movie-viewing, which captures the multimodal environment in which social knowledge is exchanged. Semantic and social content from movie events (event-level) and movie transcripts (word-level) were used in parametric modulation analyses to test (1) the degree to which semantic and social information is processed within each respective network and (2) engagement of the same cross-network regions or the same domain-general hub located within the semantic network during semantic and social processing. Semantic word and event-level content engaged the same fronto-temporo-parietal network and a portion of the semantic hub in the anterior temporal lobe (ATL). Social word and event-level content engaged the supplementary motor area and right angular gyrus within the social network, but only social words engaged the domain-general semantic hub in left ATL. There was evidence of shared processing between the social and semantic systems in the dorsolateral portion of right ATL which was engaged by word and event-level semantic and social content. Overlap between the semantic and social word and event results was highly variable within and across participants, with the most consistent loci of overlap occurring in left inferior frontal, bilateral precentral and supramarginal gyri for social and semantic words and in bilateral superior temporal gyrus extending from ATL posteriorly into supramarginal gyri for social and semantic events. These results indicate a complex pattern of shared and distinct regions for social and semantic cognition during naturalistic processing. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on October 11, 2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/ACWQY .

Naturalistic Object Representations Depend on Distance and Size Cues

Egocentric distance and real-world size are important cues for object perception and action. Nevertheless, most studies of human vision rely on two-dimensional pictorial stimuli that convey ambiguous distance and size information. Here, we use fMRI to test whether pictures are represented differently in the human brain from real, tangible objects that convey unambiguous distance and size cues. Participants directly viewed stimuli in two display formats (real objects and matched printed pictures of those objects) presented at different egocentric distances (near and far). We measured the effects of format and distance on fMRI response amplitudes and response patterns. We found that fMRI response amplitudes in the lateral occipital and posterior parietal cortices were stronger overall for real objects than for pictures. In these areas and many others, including regions involved in action guidance, responses to real objects were stronger for near vs. far stimuli, whereas distance had little effect on responses to pictures-suggesting that distance determines relevance to action for real objects, but not for pictures. Although stimulus distance especially influenced response patterns in dorsal areas that operate in the service of visually guided action, distance also modulated representations in ventral cortex, where object responses are thought to remain invariant across contextual changes. We observed object size representations for both stimulus formats in ventral cortex but predominantly only for real objects in dorsal cortex. Together, these results demonstrate that whether brain responses reflect physical object characteristics depends on whether the experimental stimuli convey unambiguous information about those characteristics.

Significance Statement

Classic frameworks of vision attribute perception of inherent object characteristics, such as size, to the ventral visual pathway, and processing of spatial characteristics relevant to action, such as distance, to the dorsal visual pathway. However, these frameworks are based on studies that used projected images of objects whose actual size and distance from the observer were ambiguous. Here, we find that when object size and distance information in the stimulus is less ambiguous, these characteristics are widely represented in both visual pathways. Our results provide valuable new insights into the brain representations of objects and their various physical attributes in the context of naturalistic vision.

High-level aftereffects reveal the role of statistical features in visual shape encoding

Visual shape perception is central to many everyday tasks, from object recognition to grasping and handling tools.1,2,3,4,5,6,7,8,9,10 Yet how shape is encoded in the visual system remains poorly understood. Here, we probed shape representations using visual aftereffects-perceptual distortions that occur following extended exposure to a stimulus.11,12,13,14,15,16,17 Such effects are thought to be caused by adaptation in neural populations that encode both simple, low-level stimulus characteristics17,18,19,20 and more abstract, high-level object features.21,22,23 To tease these two contributions apart, we used machine-learning methods to synthesize novel shapes in a multidimensional shape space, derived from a large database of natural shapes.24 Stimuli were carefully selected such that low-level and high-level adaptation models made distinct predictions about the shapes that observers would perceive following adaptation. We found that adaptation along vector trajectories in the high-level shape space predicted shape aftereffects better than simple low-level processes. Our findings reveal the central role of high-level statistical features in the visual representation of shape. The findings also hint that human vision is attuned to the distribution of shapes experienced in the natural environment.

A multimodal submillimeter MRI atlas of the human cerebellum

The human cerebellum is engaged in a broad array of tasks related to motor coordination, cognition, language, attention, memory, and emotional regulation. A detailed cerebellar atlas can facilitate the investigation of the structural and functional organization of the cerebellum. However, existing cerebellar atlases are typically limited to a single imaging modality with insufficient characterization of tissue properties. Here, we introduce a multifaceted cerebellar atlas based on high-resolution multimodal MRI, facilitating the understanding of the neurodevelopment and neurodegeneration of the cerebellum based on cortical morphology, tissue microstructure, and intra-cerebellar and cerebello-cerebral connectivity.

Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks

Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide multi-faceted neurocomputational evidence that blurry visual experiences may be critical for conferring robustness to biological visual systems.

Cortical thickness moderates intraindividual variability in prefrontal cortex activation patterns of older adults during walking

OBJECTIVE

Increased intraindividual variability (IIV) in behavioral and cognitive performance is a risk factor for adverse outcomes but research concerning hemodynamic signal IIV is limited. Cortical thinning occurs during aging and is associated with cognitive decline. Dual-task walking (DTW) performance in older adults has been related to cognition and neural integrity. We examined the hypothesis that reduced cortical thickness would be associated with greater increases in IIV in prefrontal cortex oxygenated hemoglobin (HbO2) from single tasks to DTW in healthy older adults while adjusting for behavioral performance.

METHOD

Participants were 55 healthy community-dwelling older adults (mean age = 74.84, standard deviation (SD) = 4.97). Structural MRI was used to quantify cortical thickness. Functional near-infrared spectroscopy (fNIRS) was used to assess changes in prefrontal cortex HbO2 during walking. HbO2 IIV was operationalized as the SD of HbO2 observations assessed during the first 30 seconds of each task. Linear mixed models were used to examine the moderation effect of cortical thickness throughout the cortex on HbO2 IIV across task conditions.

RESULTS

Analyses revealed that thinner cortex in several regions was associated with greater increases in HbO2 IIV from the single tasks to DTW (ps < .02).

CONCLUSIONS

Consistent with neural inefficiency, reduced cortical thickness in the PFC and throughout the cerebral cortex was associated with increases in HbO2 IIV from the single tasks to DTW without behavioral benefit. Reduced cortical thickness and greater IIV of prefrontal cortex HbO2 during DTW may be further investigated as risk factors for developing mobility impairments in aging.

Learning beyond sensations: How dreams organize neuronal representations

Semantic representations in higher sensory cortices form the basis for robust, yet flexible behavior. These representations are acquired over the course of development in an unsupervised fashion and continuously maintained over an organism's lifespan. Predictive processing theories propose that these representations emerge from predicting or reconstructing sensory inputs. However, brains are known to generate virtual experiences, such as during imagination and dreaming, that go beyond previously experienced inputs. Here, we suggest that virtual experiences may be just as relevant as actual sensory inputs in shaping cortical representations. In particular, we discuss two complementary learning principles that organize representations through the generation of virtual experiences. First, "adversarial dreaming" proposes that creative dreams support a cortical implementation of adversarial learning in which feedback and feedforward pathways engage in a productive game of trying to fool each other. Second, "contrastive dreaming" proposes that the invariance of neuronal representations to irrelevant factors of variation is acquired by trying to map similar virtual experiences together via a contrastive learning process. These principles are compatible with known cortical structure and dynamics and the phenomenology of sleep thus providing promising directions to explain cortical learning beyond the classical predictive processing paradigm.

Abnormal functional neurocircuitry underpinning emotional processing in fibromyalgia

Fibromyalgia, a condition characterized by chronic pain, is frequently accompanied by emotional disturbances. Here we aimed to study brain activation and functional connectivity (FC) during processing of emotional stimuli in fibromyalgia. Thirty female patients with fibromyalgia and 31 female healthy controls (HC) were included. Psychometric tests were administered to measure alexithymia, affective state, and severity of depressive and anxiety symptoms. Next, participants performed an emotion processing and regulation task during functional magnetic resonance imaging (fMRI). We performed a 2 × 2 ANCOVA to analyze main effects and interactions of the stimuli valence (positive or negative) and group (fibromyalgia or HC) on brain activation. Generalized psychophysiological interaction analysis was used to assess task-dependent FC of brain regions previously associated with emotion processing and fibromyalgia (i.e., hippocampus, amygdala, anterior insula, and pregenual anterior cingulate cortex [pACC]). The left superior lateral occipital cortex showed more activation in fibromyalgia during emotion processing than in HC, irrespective of valence. Moreover, we found an interaction effect (valence x group) in the FC between the left pACC and the precentral and postcentral cortex, and central operculum, and premotor cortex. These results suggest abnormal brain activation and connectivity underlying emotion processing in fibromyalgia, which could help explain the high prevalence of psychopathological symptoms in this condition.

Cognitive stimulation as a mechanism linking socioeconomic status and neural function supporting working memory: a longitudinal fMRI study

Childhood experiences of low socioeconomic status are associated with alterations in neural function in the frontoparietal network and ventral visual stream, which may drive differences in working memory. However, the specific features of low socioeconomic status environments that contribute to these disparities remain poorly understood. Here, we examined experiences of cognitive deprivation (i.e. decreased variety and complexity of experience), as opposed to experiences of threat (i.e. violence exposure), as a potential mechanism through which family income contributes to alterations in neural activation during working memory. As part of a longitudinal study, 148 youth between aged 10 and 13 years completed a visuospatial working memory fMRI task. Early childhood low income, chronicity of low income in early childhood, and current income-to-needs were associated with task-related activation in the ventral visual stream and frontoparietal network. The association of family income with decreased activation in the lateral occipital cortex and intraparietal sulcus during working memory was mediated by experiences of cognitive deprivation. Surprisingly, however, family income and deprivation were not significantly related to working memory performance, and only deprivation was associated with academic achievement in this sample. Taken together, these findings suggest that early life low income and associated cognitive deprivation are important factors in neural function supporting working memory.

Explorations of using a convolutional neural network to understand brain activations during movie watching

Neuroimaging studies increasingly use naturalistic stimuli like video clips to trigger complex brain activations, but the complexity of such stimuli makes it difficult to assign specific functions to the resulting brain activations, particularly for higher-level content like social interactions. To address this challenge, researchers have turned to deep neural networks, e.g., convolutional neural networks (CNNs). CNNs have shown success in image recognition due to their different levels of features enabling high performance. In this study, we used pre-trained VGG-16, a popular CNN model, to analyze video data and extract hierarchical features from low-level shallow layers to high-level deeper layers, linking these activations to different levels of activation of the human brain. We hypothesized that activations in different layers of VGG-16 would be associated with different levels of brain activation and visual processing hierarchy in the brain. We were also curious about which brain regions would be associated with deeper convolutional layers in VGG-16. The study analyzed a functional MRI (fMRI) dataset where participants watched the cartoon movie Partly Cloudy. Frames of the videos were fed into VGG-16, and activation maps from different kernels and layers were extracted. Time series of the average activation patterns for each kernel were created and fed into a voxel-wise model to study brain activations. Results showed that lower convolutional layers (1st convolutional layer) were mostly associated with lower visual regions, but some kernels (6, 19, 24, 42, 55, and 58) surprisingly showed associations with activations in the posterior cingulate cortex, part of the default mode network. Deeper convolutional layers were associated with more anterior and lateral portions of the visual cortex (e.g., the lateral occipital complex) and the supramarginal gyrus. Analyzing activation features associated with different brain regions showed the promise and limitations of using CNNs to link video content to brain functions.

It's all in the timing: Delayed feedback in autism may weaken predictive mechanisms during contour integration

Humans rely on predictive mechanisms during visual processing to efficiently resolve incomplete or ambiguous sensory signals. While initial low-level sensory data are conveyed by feedforward connections, feedback connections are believed to shape sensory processing through conveyance of statistical predictions based on prior exposure to stimulus configurations. Individuals with autism spectrum disorder (ASD) show biases in stimulus processing toward parts rather than wholes, suggesting their sensory processing may be less shaped by statistical predictions acquired through prior exposure to global stimulus properties. Investigations of illusory contour (IC) processing in neurotypical (NT) adults have established a well-tested marker of contour integration characterized by a robust modulation of the visually evoked potential (VEP) - the IC-effect - that occurs over lateral occipital scalp during the timeframe of the N1 component. Converging evidence strongly supports the notion that this IC-effect indexes a signal with significant feedback contributions. Using high-density VEPs, we compared the IC-effect in 6-17-year-old children with ASD (n=32) or NT development (n=53). Both groups of children generated an IC-effect that was equivalent in amplitude. However, the IC-effect notably onset 21ms later in ASD, even though timing of initial VEP afference was identical across groups. This suggests that feedforward information predominated during perceptual processing for 15% longer in ASD compared to NT children. This delay in the feedback dependent IC-effect, in the context of known developmental differences between feedforward and feedback fibers, suggests a potential pathophysiological mechanism of visual processing in ASD, whereby ongoing stimulus processing is less shaped by statistical prediction mechanisms.

In vivo tau is associated with change in memory and processing speed, but not reasoning, in cognitively unimpaired older adults

The relationship between tau deposition and cognitive decline in cognitively healthy older adults is still unclear. The tau PET tracer 18F-MK-6240 has shown favorable imaging characteristics to identify early tau deposition in aging. We evaluated the relationship between in vivo tau levels (18F-MK-6240) and retrospective cognitive change over 5 years in episodic memory, processing speed, and reasoning. For tau quantification, a set of regions of interest (ROIs) was selected a priori based on previous literature: (1) total-ROI comprising selected areas, (2) medial temporal lobe-ROI, and (3) lateral temporal lobe-ROI and cingulate/parietal lobe-ROI. Higher tau burden in most ROIs was associated with a steeper decline in memory and speed. There were no associations between tau and reasoning change. The novelty of this finding is that tau burden may affect not only episodic memory, a well-established finding but also processing speed. Our finding reinforces the notion that early tau deposition in areas related to Alzheimer's disease is associated with cognitive decline in cognitively unimpaired individuals, even in a sample with low amyloid-β pathology.

Feasibility study of functional near-infrared spectroscopy in the ventral visual pathway for real-life applications

Significance

fNIRS-based neuroenhancement depends on the feasible detection of hemodynamic responses in target brain regions. Using the lateral occipital complex (LOC) and the fusiform face area (FFA) in the ventral visual pathway as neurofeedback targets boosts performance in visual recognition. However, the feasibility of utilizing fNIRS to detect LOC and FFA activity in adults remains to be validated as the depth of these regions may exceed the detection limit of fNIRS.

Aim

This study aims to investigate the feasibility of using fNIRS to measure hemodynamic responses in the ventral visual pathway, specifically in the LOC and FFA, in adults.

Approach

We recorded the hemodynamic activities of the LOC and FFA regions in 35 subjects using a portable eight-channel fNIRS instrument. A standard one-back object and face recognition task was employed to elicit selective brain responses in the LOC and FFA regions. The placement of fNIRS optodes for LOC and FFA detection was guided by our group's transcranial brain atlas (TBA).

Results

Our findings revealed selective activation of the LOC target channel (CH2) in response to objects, whereas the FFA target channel (CH7) did not exhibit selective activation in response to faces.

Conclusions

Our findings indicate that, although fNIRS detection has limitations in capturing FFA activity, the LOC region emerges as a viable target for fNIRS-based detection. Furthermore, our results advocate for the adoption of the TBA-based method for setting the LOC target channel, offering a promising solution for optrode placement. This feasibility study stands as the inaugural validation of fNIRS for detecting cortical activity in the ventral visual pathway, underscoring its ecological validity. We suggest that our findings establish a pivotal technical groundwork for prospective real-life applications of fNIRS-based research.

Personal familiarity of faces, animals, objects, and scenes: Distinct perceptual and overlapping conceptual representations

While face, object, and scene recognition are often studied at a basic categorization level (e.g. "a face", "a car", "a kitchen"), we frequently recognise individual items of these categories as unique entities (e.g. "my mother", "my car", "my kitchen"). This recognition of individual identity is essential to appropriate behaviour in our world. However, relatively little is known about how we recognise individually familiar visual stimuli. Using event-related brain potentials, the present study examined whether and to what extent the underlying neural representations of personally familiar items are similar or different across different categories. In three experiments, we examined the recognition of personally highly familiar faces, animals, indoor scenes, and objects. We observed relatively distinct familiarity effects in an early time window (200-400 ms), with a clearly right-lateralized occipito-temporal scalp distribution for human faces and more bilateral and posterior distributions for other stimulus categories, presumably reflecting access to at least partly discrete visual long-term representations. In contrast, we found clearly overlapping familiarity effects in a later time window (starting 400 to 500 ms after stimulus onset), again with a mainly right occipito-temporal scalp distribution, for all stimulus categories. These later effects appear to reflect the sustained activation of conceptual properties relevant to any potential interaction. We conclude that familiarity for items from the various visual stimulus categories tested here is represented differently at the perceptual level, while relatively overlapping conceptual mechanisms allow for the preparation of impending potential interaction with the environment.

Opposing brain signatures of sleep in task-based and resting-state conditions

Sleep and depression have a complex, bidirectional relationship, with sleep-associated alterations in brain dynamics and structure impacting a range of symptoms and cognitive abilities. Previous work describing these relationships has provided an incomplete picture by investigating only one or two types of sleep measures, depression, or neuroimaging modalities in parallel. We analyze the correlations between brainwide neural signatures of sleep, cognition, and depression in task and resting-state data from over 30,000 individuals from the UK Biobank and Human Connectome Project. Neural signatures of insomnia and depression are negatively correlated with those of sleep duration measured by accelerometer in the task condition but positively correlated in the resting-state condition. Our results show that resting-state neural signatures of insomnia and depression resemble that of rested wakefulness. This is further supported by our finding of hypoconnectivity in task but hyperconnectivity in resting-state data in association with insomnia and depression. These observations dispute conventional assumptions about the neurofunctional manifestations of hyper- and hypo-somnia, and may explain inconsistent findings in the literature.

Organization of sensorimotor activity in anterior cruciate ligament reconstructed individuals: an fMRI conjunction analysis

Introduction

Anterior cruciate ligament reconstruction (ACLR) is characterized by persistent involved limb functional deficits that persist for years despite rehabilitation. Previous research provides evidence of both peripheral and central nervous system adaptations following ACLR. However, no study has compared functional organization of the brain for involved limb motor control relative to the uninvolved limb and healthy controls. The purpose of this study was to examine sensorimotor cortex and cerebellar functional activity overlap and non-overlap during a knee motor control task between groups (ACLR and control), and to determine cortical organization of involved and uninvolved limb movement between groups.

Methods

Eighteen participants with left knee ACLR and 18 control participants performed a knee flexion/extension motor control task during functional magnetic resonance imaging (fMRI). A conjunction analysis was conducted to determine the degree of overlap in brain activity for involved and uninvolved limb knee motor control between groups.

Results

The ACLR group had a statistically higher mean percent signal change in the sensorimotor cortex for the involved > uninvolved contrast compared to the control group. Brain activity between groups statistically overlapped in sensorimotor regions of the cortex and cerebellum for both group contrasts: involved > uninvolved and uninvolved > involved. Relative to the control group, the ACLR group uniquely activated superior parietal regions (precuneus, lateral occipital cortex) for involved limb motor control. Additionally, for involved limb motor control, the ACLR group displayed a medial and superior shift in peak voxel location in frontal regions; for parietal regions, the ACLR group had a more posterior and superior peak voxel location relative to the control group.

Conclusion

ACLR may result in unique activation of the sensorimotor cortex via a cortically driven sensory integration strategy to maintain involved limb motor control. The ACLR group's unique brain activity was independent of strength, self-reported knee function, and time from surgery.

Changes in fear-associated learning task brain activation over the COVID-19 pandemic period: a preliminary longitudinal analysis

Background

The COVID-19 pandemic has had profound impacts on people worldwide. Previous studies have shown that fear learning, extinction, recall, and contextual information processing involve the activation of emotion and sensory brain systems, which can be modified. However, it remains unclear whether brain functions associated with these processes have been altered over the pandemic period.

Methods

We compared pre- and peri-pandemic brain activation during a fear-associated learning task (FALT) using previously collected data. The participants were divided into two groups: the pandemic group (n = 16), who completed a baseline FALT before the pandemic and repeated the task during the pandemic, and the non-pandemic group (n = 77), who completed both sessions before the pandemic began.

Results

Compared with the non-pandemic group, the pandemic group exhibited significant decreases in brain activation from baseline to follow-up assessments, including activation in the brainstem during early fear learning, the posterior thalamus/hippocampus during late extinction, and the occipital pole during late recall phases for contextual processing. Furthermore, activations associated with retrieving safety cues were reduced in the posterior cingulate, premotor, and calcarine cortices during the early recall phase, and activations associated with retrieving dangerous cues decreased in the occipital pole during the late recall phase. Additionally, correlations between decreased activation and elevated posttraumatic stress symptoms were observed.

Conclusion

These findings suggest that activations associated with processing low arousal contextual information, safety cues, and extinguished fear cues decreased during the pandemic. These changes in brain activation may have contributed to the increase in mental health disturbances observed during this time.

Minor Changes Change Memories: Functional Magnetic Resonance Imaging and Behavioral Reflections of Episodic Prediction Errors

Episodic memories can be modified, a process that is potentially driven by mnemonic prediction errors. In the present study, we used modified cues to induce prediction errors of different episodic relevance. Participants encoded episodes in the form of short toy stories and then returned for an fMRI session on the subsequent day. Here, participants were presented either original episodes or slightly modified versions thereof. Modifications consisted of replacing a single object within the episode and either challenged the gist of an episode (gist modifications) or left it intact (surface modifications). On the next day, participants completed a post-fMRI memory test that probed memories for originally encoded episodes. Both types of modifications triggered brain activation in regions we previously found to be involved in the processing of content-based mnemonic prediction errors (i.e., the exchange of an object). Specifically, these were ventrolateral pFC, intraparietal cortex, and lateral occipitotemporal cortex. In addition, gist modifications triggered pronounced brain responses, whereas those for surface modification were only significant in the right inferior frontal sulcus. Processing of gist modifications also involved the posterior temporal cortex and the precuneus. Interestingly, our findings confirmed the posterior hippocampal role of detail processing in episodic memory, as evidenced by increased posterior hippocampal activity for surface modifications compared with gist modifications. In the post-fMRI memory test, previous experience with surface modified, but not gist-modified episodes, increased erroneous acceptance of the same modified versions as originally encoded. Whereas surface-level prediction errors might increase uncertainty and facilitate confusion of alternative episode representations, gist-level prediction errors seem to trigger the clear distinction of independent episodes.

Memorability of line drawings of scenes: the role of contour properties

Why are some images more likely to be remembered than others? Previous work focused on the influence of global, low-level visual features as well as image content on memorability. To better understand the role of local, shape-based contours, we here investigate the memorability of photographs and line drawings of scenes. We find that the memorability of photographs and line drawings of the same scenes is correlated. We quantitatively measure the role of contour properties and their spatial relationships for scene memorability using a Random Forest analysis. To determine whether this relationship is merely correlational or if manipulating these contour properties causes images to be remembered better or worse, we split each line drawing into two half-images, one with high and the other with low predicted memorability according to the trained Random Forest model. In a new memorability experiment, we find that the half-images predicted to be more memorable were indeed remembered better, confirming a causal role of shape-based contour features, and, in particular, T junctions in scene memorability. We performed a categorization experiment on half-images to test for differential access to scene content. We found that half-images predicted to be more memorable were categorized more accurately. However, categorization accuracy for individual images was not correlated with their memorability. These results demonstrate that we can measure the contributions of individual contour properties to scene memorability and verify their causal involvement with targeted image manipulations, thereby bridging the gap between low-level features and scene semantics in our understanding of memorability.

Conscious expectancy rather than associative strength elicits brain activity during single-cue fear conditioning

The neurocognitive processes underlying Pavlovian conditioning in humans are still largely debated. The conventional view is that conditioned responses (CRs) emerge automatically as a function of the contingencies between a conditioned stimulus (CS) and an unconditioned stimulus (US). As such, the associative strength model asserts that the frequency or amplitude of CRs reflects the strength of the CS-US associations. Alternatively, the expectation model asserts that the presentation of the CS triggers conscious expectancy of the US, which is responsible for the production of CRs. The present study tested the hypothesis that there are dissociable brain networks related to the expectancy and associative strength theories using a single-cue fear conditioning paradigm with a pseudo-random intermittent reinforcement schedule during functional magnetic resonance imaging. Participants' (n = 21) trial-by-trial expectations of receiving shock displayed a significant linear effect consistent with the expectation model. We also found a positive linear relationship between the expectancy model and activity in frontoparietal brain areas including the dorsolateral prefrontal cortex (PFC) and dorsomedial PFC. While an exploratory analysis found a linear relationship consistent with the associated strength model in the insula and early visual cortex, our primary results are consistent with the view that conscious expectancy contributes to CRs.

Human brain responses are modulated when exposed to optimized natural images or synthetically generated images

Understanding how human brains interpret and process information is important. Here, we investigated the selectivity and inter-individual differences in human brain responses to images via functional MRI. In our first experiment, we found that images predicted to achieve maximal activations using a group level encoding model evoke higher responses than images predicted to achieve average activations, and the activation gain is positively associated with the encoding model accuracy. Furthermore, anterior temporal lobe face area (aTLfaces) and fusiform body area 1 had higher activation in response to maximal synthetic images compared to maximal natural images. In our second experiment, we found that synthetic images derived using a personalized encoding model elicited higher responses compared to synthetic images from group-level or other subjects' encoding models. The finding of aTLfaces favoring synthetic images than natural images was also replicated. Our results indicate the possibility of using data-driven and generative approaches to modulate macro-scale brain region responses and probe inter-individual differences in and functional specialization of the human visual system.

Meditation attenuates default-mode activity: A pilot study using ultra-high field 7 Tesla MRI

OBJECTIVES

Mapping the neurobiology of meditation has been bolstered by functional MRI (fMRI) research, with advancements in ultra-high field 7 Tesla fMRI further enhancing signal quality and neuroanatomical resolution. Here, we utilize 7 Tesla fMRI to examine the neural substrates of meditation and replicate existing widespread findings, after accounting for relevant physiological confounds.

METHODS

In this feasibility study, we scanned 10 beginner meditators (N = 10) while they either attended to breathing (focused attention meditation) or engaged in restful thinking (non-focused rest). We also measured and adjusted the fMRI signal for key physiological differences between meditation and rest. Finally, we explored changes in state mindfulness, state anxiety and focused attention attributes for up to 2 weeks following the single fMRI meditation session.

RESULTS

Group-level task fMRI analyses revealed significant reductions in activity during meditation relative to rest in default-mode network hubs, i.e., antero-medial prefrontal and posterior cingulate cortices, precuneus, as well as visual and thalamic regions. These findings survived stringent statistical corrections for fluctuations in physiological responses which demonstrated significant differences (p < 0.05/n, Bonferroni controlled) between meditation and rest. Compared to baseline, State Mindfulness Scale (SMS) scores were significantly elevated (F(3,9) = 8.16, p < 0.05/n, Bonferroni controlled) following the fMRI meditation session, and were closely maintained at 2-week follow up.

CONCLUSIONS

This pilot study establishes the feasibility and utility of investigating focused attention meditation using ultra-high field (7 Tesla) fMRI, by supporting widespread evidence that focused attention meditation attenuates default-mode activity responsible for self-referential processing. Future functional neuroimaging studies of meditation should control for physiological confounds and include behavioural assessments.

Neural networks underlying visual illusions: An activation likelihood estimation meta-analysis

Visual illusions have long been used to study visual perception and contextual integration. Neuroimaging studies employ illusions to identify the brain regions involved in visual perception and how they interact. We conducted an Activation Likelihood Estimation (ALE) meta-analysis and meta-analytic connectivity modeling on fMRI studies using static and motion illusions to reveal the neural signatures of illusory processing and to investigate the degree to which different areas are commonly recruited in perceptual inference. The resulting networks encompass ventral and dorsal regions, including the inferior and middle occipital cortices bilaterally in both types of illusions. The static and motion illusion networks selectively included the right posterior parietal cortex and the ventral premotor cortex respectively. Overall, these results describe a network of areas crucially involved in perceptual inference relying on feed-back and feed-forward interactions between areas of the ventral and dorsal visual pathways. The same network is proposed to be involved in hallucinogenic symptoms characteristic of schizophrenia and other disorders, with crucial implications in the use of illusions as biomarkers.

Extreme image transformations affect humans and machines differently

Some recent artificial neural networks (ANNs) claim to model aspects of primate neural and human performance data. Their success in object recognition is, however, dependent on exploiting low-level features for solving visual tasks in a way that humans do not. As a result, out-of-distribution or adversarial input is often challenging for ANNs. Humans instead learn abstract patterns and are mostly unaffected by many extreme image distortions. We introduce a set of novel image transforms inspired by neurophysiological findings and evaluate humans and ANNs on an object recognition task. We show that machines perform better than humans for certain transforms and struggle to perform at par with humans on others that are easy for humans. We quantify the differences in accuracy for humans and machines and find a ranking of difficulty for our transforms for human data. We also suggest how certain characteristics of human visual processing can be adapted to improve the performance of ANNs for our difficult-for-machines transforms.

Effects of noise and noise reduction on audiovisual speech perception in cochlear implant users: An ERP study

OBJECTIVE

Hearing with a cochlear implant (CI) is difficult in noisy environments, but the use of noise reduction algorithms, specifically ForwardFocus, can improve speech intelligibility. The current event-related potentials (ERP) study examined the electrophysiological correlates of this perceptual improvement.

METHODS

Ten bimodal CI users performed a syllable-identification task in auditory and audiovisual conditions, with syllables presented from the front and stationary noise presented from the sides. Brainstorm was used for spatio-temporal evaluation of ERPs.

RESULTS

CI users revealed an audiovisual benefit as reflected by shorter response times and greater activation in temporal and occipital regions at P2 latency. However, in auditory and audiovisual conditions, background noise hampered speech processing, leading to longer response times and delayed auditory-cortex-activation at N1 latency. Nevertheless, activating ForwardFocus resulted in shorter response times, reduced listening effort and enhanced superior-frontal-cortex-activation at P2 latency, particularly in audiovisual conditions.

CONCLUSIONS

ForwardFocus enhances speech intelligibility in audiovisual speech conditions by potentially allowing the reallocation of attentional resources to relevant auditory speech cues.

SIGNIFICANCE

This study shows for CI users that background noise and ForwardFocus differentially affect spatio-temporal cortical response patterns, both in auditory and audiovisual speech conditions.

Modulation of associations between education years and cortical volume in Alzheimer's disease vulnerable brain regions by Aβ deposition and APOE ε4 carrier status in cognitively normal older adults

Background

Education years, as a measure of cognitive reserve, have been shown to affect the progression of Alzheimer's disease (AD), both pathologically and clinically. However, inconsistent results have been reported regarding the association between years of education and intermediate structural changes in AD-vulnerable brain regions, particularly when AD risk factors were not considered during the preclinical phase.

Objective

This study aimed to examine how Aβ deposition and APOE ε4 carrier status moderate the relationship between years of education and cortical volume in AD-vulnerable regions among cognitively normal older adults.

Methods

A total of 121 participants underwent structural MRI, [18F] flutemetamol PET-CT imaging, and neuropsychological battery assessment. Multiple regression analysis was conducted to examine the interaction between years of education and the effects of potential modifiers on cortical volume. The associations between cortical volume and neuropsychological performance were further explored in subgroups categorized based on AD risk factors.

Results

The cortical volume of the left lateral occipital cortex and bilateral fusiform gyrus demonstrated a significant differential association with years of education, depending on the presence of Aβ deposition and APOE ε4 carrier status. Furthermore, a significant relationship between the cortical volume of the bilateral fusiform gyrus and AD-nonspecific cognitive function was predominantly observed in individuals without AD risk factors.

Conclusion

AD risk factors exerted varying influences on the association between years of education and cortical volume during the preclinical phase. Further investigations into the long-term implications of these findings would enhance our understanding of cognitive reserves in the preclinical stages of AD.

Perception and Memory in the Ventral Visual Stream and Medial Temporal Lobe

Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.

The effect of context congruency on fMRI repetition suppression for objects

The recognition of objects is strongly facilitated when they are presented in the context of other objects (Biederman, 1972). Such contexts facilitate perception and induce expectations of context-congruent objects (Trapp and Bar, 2015). The neural mechanisms underlying these facilitatory effects of context on object processing, however, are not yet fully understood. In the present study, we investigate how context-induced expectations affect subsequent object processing. We used functional magnetic resonance imaging and measured repetition suppression as a proxy for prediction error processing. Participants viewed pairs of alternating or repeated object images which were preceded by context-congruent, context-incongruent or neutral cues. We found a stronger repetition suppression in congruent as compared to incongruent or neutral cues in the object sensitive lateral occipital cortex. Interestingly, this stronger effect was driven by enhanced responses to alternating stimulus pairs in the congruent contexts, rather than by suppressed responses to repeated stimulus pairs, which emphasizes the contribution of surprise-related response enhancement for the context modulation on RS when expectations are violated. In addition, in the congruent condition, we discovered significant functional connectivity between object-responsive and frontal cortical regions, as well as between object-responsive regions and the fusiform gyrus. Our findings indicate that prediction errors, reflected in enhanced brain responses to violated contextual expectations, underlie the facilitating effect of context during object perception.

Repeated Transcranial Photobiomodulation with Light-Emitting Diodes Improves Psychomotor Vigilance and EEG Networks of the Human Brain

Transcranial photobiomodulation (tPBM) has been suggested as a non-invasive neuromodulation tool. The repetitive administration of light-emitting diode (LED)-based tPBM for several weeks significantly improves human cognition. To understand the electrophysiological effects of LED-tPBM on the human brain, we investigated alterations by repeated tPBM in vigilance performance and brain networks using electroencephalography (EEG) in healthy participants. Active and sham LED-based tPBM were administered to the right forehead of young participants twice a week for four weeks. The participants performed a psychomotor vigilance task (PVT) during each tPBM/sham experiment. A 64-electrode EEG system recorded electrophysiological signals from each participant during the first and last visits in a 4-week study. Topographical maps of the EEG power enhanced by tPBM were statistically compared for the repeated tPBM effect. A new data processing framework combining the group's singular value decomposition (gSVD) with eLORETA was implemented to identify EEG brain networks. The reaction time of the PVT in the tPBM-treated group was significantly improved over four weeks compared to that in the sham group. We observed acute increases in EEG delta and alpha powers during a 10 min LED-tPBM while the participants performed the PVT task. We also found that the theta, beta, and gamma EEG powers significantly increased overall after four weeks of LED-tPBM. Combining gSVD with eLORETA enabled us to identify EEG brain networks and the corresponding network power changes by repeated 4-week tPBM. This study clearly demonstrated that a 4-week prefrontal LED-tPBM can neuromodulate several key EEG networks, implying a possible causal effect between modulated brain networks and improved psychomotor vigilance outcomes.

The locus of recognition memory signals in human cortex depends on the complexity of the memory representations

According to a "Swiss Army Knife" model of the brain, cognitive functions such as episodic memory and face perception map onto distinct neural substrates. In contrast, representational accounts propose that each brain region is best explained not by which specialized function it performs, but by the type of information it represents with its neural firing. In a functional magnetic resonance imaging study, we asked whether the neural signals supporting recognition memory fall mandatorily within the medial temporal lobes (MTL), traditionally thought the seat of declarative memory, or whether these signals shift within cortex according to the content of the memory. Participants studied objects and scenes that were unique conjunctions of pre-defined visual features. Next, we tested recognition memory in a task that required mnemonic discrimination of both simple features and complex conjunctions. Feature memory signals were strongest in posterior visual regions, declining with anterior progression toward the MTL, while conjunction memory signals followed the opposite pattern. Moreover, feature memory signals correlated with feature memory discrimination performance most strongly in posterior visual regions, whereas conjunction memory signals correlated with conjunction memory discrimination most strongly in anterior sites. Thus, recognition memory signals shifted with changes in memory content, in line with representational accounts.