Mid-fusiform activation during object discrimination reflects the process of differentiating structural descriptions

Prediction of image interpretation cognitive ability under different mental workloads: a task-state fMRI study

Visual imaging experts play an important role in multiple fields, and studies have shown that the combination of functional magnetic resonance imaging and machine learning techniques can predict cognitive abilities, which provides a possible method for selecting individuals with excellent image interpretation skills. We recorded behavioral data and neural activity of 64 participants during image interpretation tasks under different workloads. Based on the comprehensive image interpretation ability, participants were divided into two groups. general linear model analysis showed that during image interpretation tasks, the high-ability group exhibited higher activation in middle frontal gyrus (MFG), fusiform gyrus, inferior occipital gyrus, superior parietal gyrus, inferior parietal gyrus, and insula compared to the low-ability group. The radial basis function Support Vector Machine (SVM) algorithm shows the most excellent performance in predicting participants' image interpretation abilities (Pearson correlation coefficient = 0.54, R2 = 0.31, MSE = 0.039, RMSE = 0.002). Variable importance analysis indicated that the activation features of the fusiform gyrus and MFG played an important role in predicting this ability. Our study revealed the neural basis related to image interpretation ability when exposed to different mental workloads. Additionally, our results demonstrated the efficacy of machine learning algorithms in extracting neural activation features to predict such ability.

Automatic Processing of Numerosity in Human Neocortex Evidenced by Occipital and Parietal Neuromagnetic Responses

Humans and other animal species are endowed with the ability to sense, represent, and mentally manipulate the number of items in a set without needing to count them. One central hypothesis is that this ability relies on an automated functional system dedicated to numerosity, the perception of the discrete numerical magnitude of a set of items. This system has classically been associated with intraparietal regions, however accumulating evidence in favor of an early visual number sense calls into question the functional role of parietal regions in numerosity processing. Targeting specifically numerosity among other visual features in the earliest stages of processing requires high temporal and spatial resolution. We used frequency-tagged magnetoencephalography to investigate the early automatic processing of numerical magnitudes and measured the steady-state brain responses specifically evoked by numerical and other visual changes in the visual scene. The neuromagnetic responses showed implicit discrimination of numerosity, total occupied area, and convex hull. The source reconstruction corresponding to the implicit discrimination responses showed common and separate sources along the ventral and dorsal visual pathways. Occipital sources attested the perceptual salience of numerosity similarly to both other implicitly discriminable visual features. Crucially, we found parietal responses uniquely associated with numerosity discrimination, showing automatic processing of numerosity in the parietal cortex, even when not relevant to the task. Taken together, these results provide further insights into the functional roles of parietal and occipital regions in numerosity encoding along the visual hierarchy.

Typical and atypical neurodevelopment for face specialization: an FMRI study

Individuals with autism spectrum disorder (ASD) and their relatives process faces differently from typically developed (TD) individuals. In an fMRI face-viewing task, TD and undiagnosed sibling (SIB) children (5-18 years) showed face specialization in the right amygdala and ventromedial prefrontal cortex, with left fusiform and right amygdala face specialization increasing with age in TD subjects. SIBs showed extensive antero-medial temporal lobe activation for faces that was not present in any other group, suggesting a potential compensatory mechanism. In ASD, face specialization was minimal but increased with age in the right fusiform and decreased with age in the left amygdala, suggesting atypical development of a frontal-amygdala-fusiform system which is strongly linked to detecting salience and processing facial information.

Structural Similarity Exerts Opposing Effects on Perceptual Differentiation and Categorization: An fMRI Study

We manipulated the degree of structural similarity between objects that had to be matched either according to whether they represented the same object (perceptual matching) or belonged to the same category (conceptual matching). Behaviorally, performance improved as a linear function of increased structural similarity during conceptual matching but deteriorated as a linear function of increased structural similarity during perceptual matching. These effects were mirrored in fMRI recordings where activation in several ventral posterior areas exhibited a similar interaction between match type and structural similarity. Our findings provide direct support for the notion that structural similarity exerts opposing effects on classification depending on whether objects are to be perceptually differentiated or categorized—a notion that has been based on rather circumstantial evidence. In particular, the finding that structural similarity plays a major role in categorization of instances according to taxonomy challenges the view that the organization of superordinate categories is not driven by shared structural features.

Right fusiform response patterns reflect visual object identity rather than semantic similarity

We previously reported the neuropsychological consequences of a lesion confined to the middle and posterior part of the right fusiform gyrus (case JA) causing a partial loss of knowledge of visual attributes of concrete entities in the absence of category-selectivity (animate versus inanimate). We interpreted this in the context of a two-step model that distinguishes structural description knowledge from associative-semantic processing and implicated the lesioned area in the former process. To test this hypothesis in the intact brain, multi-voxel pattern analysis was used in a series of event-related fMRI studies in a total of 46 healthy subjects. We predicted that activity patterns in this region would be determined by the identity of rather than the conceptual similarity between concrete entities. In a prior behavioral experiment features were generated for each entity by more than 1000 subjects. Based on a hierarchical clustering analysis the entities were organised into 3 semantic clusters (musical instruments, vehicles, tools). Entities were presented as words or pictures. With foveal presentation of pictures, cosine similarity between fMRI response patterns in right fusiform cortex appeared to reflect both the identity of and the semantic similarity between the entities. No such effects were found for words in this region. The effect of object identity was invariant for location, scaling, orientation axis and color (grayscale versus color). It also persisted for different exemplars referring to a same concrete entity. The apparent semantic similarity effect however was not invariant. This study provides further support for a neurobiological distinction between structural description knowledge and processing of semantic relationships and confirms the role of right mid-posterior fusiform cortex in the former process, in accordance with previous lesion evidence.

Perceptual and category processing of the Uncanny Valley hypothesis' dimension of human likeness: some methodological issues

Mori's Uncanny Valley Hypothesis^1,2 proposes that the perception of humanlike characters such as robots and, by extension, avatars (computer-generated characters) can evoke negative or positive affect (valence) depending on the object's degree of visual and behavioral realism along a dimension of human likeness (DHL) (Figure 1). But studies of affective valence of subjective responses to variously realistic non-human characters have produced inconsistent findings ^{3, 4, 5, 6}. One of a number of reasons for this is that human likeness is not perceived as the hypothesis assumes. While the DHL can be defined following Mori's description as a smooth linear change in the degree of physical humanlike similarity, subjective perception of objects along the DHL can be understood in terms of the psychological effects of categorical perception (CP) ⁷. Further behavioral and neuroimaging investigations of category processing and CP along the DHL and of the potential influence of the dimension's underlying category structure on affective experience are needed. This protocol therefore focuses on the DHL and allows examination of CP. Based on the protocol presented in the video as an example, issues surrounding the methodology in the protocol and the use in "uncanny" research of stimuli drawn from morph continua to represent the DHL are discussed in the article that accompanies the video. The use of neuroimaging and morph stimuli to represent the DHL in order to disentangle brain regions neurally responsive to physical human-like similarity from those responsive to category change and category processing is briefly illustrated.

Can you catch a liar? How negative emotions affect brain responses when lying or telling the truth

The capacity to deceive others is a complex mental skill that requires the ability to suppress truthful information. The polygraph is widely used in countries such as the USA to detect deception. However, little is known about the effects of emotional processes (such as the fear of being found guilty despite being innocent) on the physiological responses that are used to detect lies. The aim of this study was to investigate the time course and neural correlates of untruthful behavior by analyzing electrocortical indexes in response to visually presented neutral and affective questions. Affective questions included sexual, shameful or disgusting topics. A total of 296 questions that were inherently true or false were presented to 25 subjects while ERPs were recorded from 128 scalp sites. Subjects were asked to lie on half of the questions and to answer truthfully on the remaining half. Behavioral and ERP responses indicated an increased need for executive control functions, namely working memory, inhibition and task switching processes, during deceptive responses. Deceptive responses also elicited a more negative N400 over the prefrontal areas and a smaller late positivity (LP 550–750 ms) over the prefrontal and frontal areas. However, a reduction in LP amplitude was also elicited by truthful affective responses. The failure to observe a difference in LP responses across conditions likely results from emotional interference. A swLORETA inverse solution was computed on the N400 amplitude (300–400 ms) for the dishonest – honest contrast. These results showed the activation of the superior, medial, middle and inferior frontal gyri (BA9, 11, 47) and the anterior cingulate cortex during deceptive responses. Our results conclude that the N400 amplitude is a reliable neural marker of deception.

Process and domain specificity in regions engaged for face processing: an fMRI study of perceptual differentiation

The degree to which face-specific brain regions are specialized for different kinds of perceptual processing is debated. This study parametrically varied demands on featural, first-order configural, or second-order configural processing of faces and houses in a perceptual matching task to determine the extent to which the process of perceptual differentiation was selective for faces regardless of processing type (domain-specific account), specialized for specific types of perceptual processing regardless of category (process-specific account), engaged in category-optimized processing (i.e., configural face processing or featural house processing), or reflected generalized perceptual differentiation (i.e., differentiation that crosses category and processing type boundaries). ROIs were identified in a separate localizer run or with a similarity regressor in the face-matching runs. The predominant principle accounting for fMRI signal modulation in most regions was generalized perceptual differentiation. Nearly all regions showed perceptual differentiation for both faces and houses for more than one processing type, even if the region was identified as face-preferential in the localizer run. Consistent with process specificity, some regions showed perceptual differentiation for first-order processing of faces and houses (right fusiform face area and occipito-temporal cortex and right lateral occipital complex), but not for featural or second-order processing. Somewhat consistent with domain specificity, the right inferior frontal gyrus showed perceptual differentiation only for faces in the featural matching task. The present findings demonstrate that the majority of regions involved in perceptual differentiation of faces are also involved in differentiation of other visually homogenous categories.

Contributions of low and high spatial frequency processing to impaired object recognition circuitry in schizophrenia

Patients with schizophrenia exhibit cognitive and sensory impairment, and object recognition deficits have been linked to sensory deficits. The "frame and fill" model of object recognition posits that low spatial frequency (LSF) information rapidly reaches the prefrontal cortex (PFC) and creates a general shape of an object that feeds back to the ventral temporal cortex to assist object recognition. Visual dysfunction findings in schizophrenia suggest a preferential loss of LSF information. This study used functional magnetic resonance imaging (fMRI) and resting state functional connectivity (RSFC) to investigate the contribution of visual deficits to impaired object "framing" circuitry in schizophrenia. Participants were shown object stimuli that were intact or contained only LSF or high spatial frequency (HSF) information. For controls, fMRI revealed preferential activation to LSF information in precuneus, superior temporal, and medial and dorsolateral PFC areas, whereas patients showed a preference for HSF information or no preference. RSFC revealed a lack of connectivity between early visual areas and PFC for patients. These results demonstrate impaired processing of LSF information during object recognition in schizophrenia, with patients instead displaying increased processing of HSF information. This is consistent with findings of a preference for local over global visual information in schizophrenia.

Functional evaluation of hidden figures object analysis in children with autistic disorder

Functional magnetic resonance imaging (fMRI) during performance of a hidden figures task (HFT) was used to compare differences in brain function in children diagnosed with autism disorder (AD) compared to children with attention-deficit/hyperactivity disorder (ADHD) and typical controls (TC). Overall greater functional MRI activity was observed in the two control groups compared to children with AD. Laterality differences were also evident, with AD subjects preferentially showing activity in the right medial temporal region while controls tended to activate the left medial temporal cortex. Reduced fMRI activity was observed in the parietal, ventral-temporal and hippocampal regions in the AD group, suggesting differences in the way that children with AD process the HFT.

Action relationships concatenate representations of separate objects in the ventral visual system

Objects in the real world are encountered in contexts where they interact together. Though it is known that neurons in the ventral visual stream mediate the recognition of individual objects, we have minimal knowledge of how multiple objects are processed at a neural level. We examined the neural response to pairs of objects using functional magnetic resonance imaging (fMRI). Objects positioned to interact together activated bilateral lateral occipital complex (LOC) and fusiform gyrus. This occurred irrespective of whether the objects were attended. In LOC, the effect of positioning objects for action was found regardless of whether the objects formed a familiar or unfamiliar action pair. In the fusiform gyrus activation was found when objects formed a familiar action pair. No changes were apparent in visuomotor (premotor and parietal) regions which might reflect a motor-based response to objects. These results show that ventral-stream regions respond to the interaction between objects, as well as to the sensory and functional properties of individual objects.

Relationship between regional atrophy rates and cognitive decline in mild cognitive impairment

We investigated the relationship between regional atrophy rates and 2-year cognitive decline in a large cohort of patients with mild cognitive impairment (MCI; n = 103) and healthy controls (n = 90). Longitudinal magnetic resonance image (MRI) scans were analyzed using high-throughput image analysis procedures. Atrophy rates were derived by calculating percent cortical volume loss between baseline and 24 month scans. Stepwise regressions were performed to investigate the contribution of atrophy rates to language, memory, and executive functioning decline, controlling for age, gender, baseline performances, and disease progression. In MCI, left temporal lobe atrophy rates were associated with naming decline, whereas bilateral temporal, left frontal, and left anterior cingulate atrophy rates were associated with semantic fluency decline. Left entorhinal atrophy rate was associated with memory decline and bilateral frontal atrophy rates were associated with executive function decline. These data provide evidence that regional atrophy rates in MCI contribute to domain-specific cognitive decline, which appears to be partially independent of disease progression. MRI measures of regional atrophy can provide valuable information for understanding the neural basis of cognitive impairment in MCI.