Representational Similarity of Body Parts in Human Occipitotemporal Cortex

Contrastive learning explains the emergence and function of visual category-selective regions

Modular and distributed coding theories of category selectivity along the human ventral visual stream have long existed in tension. Here, we present a reconciling framework-contrastive coding-based on a series of analyses relating category selectivity within biological and artificial neural networks. We discover that, in models trained with contrastive self-supervised objectives over a rich natural image diet, category-selective tuning naturally emerges for faces, bodies, scenes, and words. Further, lesions of these model units lead to selective, dissociable recognition deficits, highlighting their distinct functional roles in information processing. Finally, these pre-identified units can predict neural responses in all corresponding face-, scene-, body-, and word-selective regions of human visual cortex, under a highly constrained sparse positive encoding procedure. The success of this single model indicates that brain-like functional specialization can emerge without category-specific learning pressures, as the system learns to untangle rich image content. Contrastive coding, therefore, provides a unifying account of object category emergence and representation in the human brain.

Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain

Human pose, defined as the spatial relationships between body parts, carries instrumental information supporting the understanding of motion and action of a person. A substantial body of previous work has identified cortical areas responsive to images of bodies and different body parts. However, the neural basis underlying the visual perception of body part relationships has received less attention. To broaden our understanding of body perception, we analyzed high-resolution fMRI responses to a wide range of poses from over 4,000 complex natural scenes. Using ground-truth annotations and an application of three-dimensional (3D) pose reconstruction algorithms, we compared similarity patterns of cortical activity with similarity patterns built from human pose models with different levels of depth availability and viewpoint dependency. Targeting the challenge of explaining variance in complex natural image responses with interpretable models, we achieved statistically significant correlations between pose models and cortical activity patterns (though performance levels are substantially lower than the noise ceiling). We found that the 3D view-independent pose model, compared with two-dimensional models, better captures the activation from distinct cortical areas, including the right posterior superior temporal sulcus (pSTS). These areas, together with other pose-selective regions in the LOTC, form a broader, distributed cortical network with greater view-tolerance in more anterior patches. We interpret these findings in light of the computational complexity of natural body images, the wide range of visual tasks supported by pose structures, and possible shared principles for view-invariant processing between articulated objects and ordinary, rigid objects.

The neural representation of body part concepts

Neuropsychological and neuroimaging studies provide evidence for a degree of category-related organization of conceptual knowledge in the brain. Some of this evidence indicates that body part concepts are distinctly represented from other categories; yet, the neural correlates and mechanisms underlying these dissociations are unclear. We expand on the limited prior data by measuring functional magnetic resonance imaging responses induced by body part words and performing a series of analyses investigating the cortical representation of this semantic category. Across voxel-level contrasts, pattern classification, representational similarity analysis, and vertex-wise encoding analyses, we find converging evidence that the posterior middle temporal gyrus, the supramarginal gyrus, and the ventral premotor cortex in the left hemisphere play important roles in the preferential representation of this category compared to other concrete objects.

Did you skip leg day? The neural mechanisms of muscle perception for body parts

While the neural mechanisms underpinning the perception of muscularity are poorly understood, recent progress has been made using the psychophysical technique of visual adaptation. Prolonged visual exposure to high (low) muscularity bodies causes subsequently viewed bodies to appear less (more) muscular, revealing a recalibration of the neural populations encoding muscularity. Here, we use visual adaptation to further elucidate the tuning properties of the neural processes underpinning muscle perception for the upper and lower halves of the body. Participants manipulated the apparent muscularity of upper and lower bodies until they appeared 'normal', prior to and following exposure to a series of top/bottom halves of bodies that were either high or low in muscularity. In Experiment 1, participants were adapted to isolated own-gender body halves from one of four conditions; increased (muscularity) upper (body half), increased lower, decreased upper, or decreased lower. Despite the presence of muscle aftereffects when the body halves the participants viewed and manipulated were congruent, there was only weak evidence of muscle aftereffect transfer between the upper and lower halves of the body. Aftereffects were significantly weaker when body halves were incongruent, implying minimal overlap in the neural mechanisms encoding muscularity for body half. Experiment 2 examined the generalisability of Experiment 1's findings in a more ecologically valid context using whole-body stimuli, producing a similar pattern of results as Experiment 1, but with no evidence of cross-adaptation. Taken together, the findings are most consistent with muscle-encoding neural populations that are body-half selective. As visual adaptation has been implicated in cases of body size and shape misperception, the present study furthers our current understanding of how these perceptual inaccuracies, particularly those involving muscularity, are developed, maintained, and may potentially be treated.

A Body Map Beyond Perceptual Experience

The human body is perhaps the most ubiquitous and salient visual stimulus that we encounter in our daily lives. Given the prevalence of images of human bodies in natural scene statistics, it is no surprise that our mental representations of the body are thought to strongly originate from visual experience. Yet, little is still known about high-level cognitive representations of the body. Here, we retrieved a body map from natural language, taking this as a window into high-level cognitive processes. We first extracted a matrix of distances between body parts from natural language data and employed this matrix to extrapolate a body map. To test the effectiveness of this high-level body map, we then conducted a series of experiments in which participants were asked to classify the distance between pairs of body parts, presented either as words or images. We found that the high-level body map was systematically activated when participants were making these distance judgments. Crucially, the linguistic map explained participants' performance over and above the visual body map, indicating that the former cannot be simply conceived as a by-product of perceptual experience. These findings, therefore, establish the existence of a behaviorally relevant, high-level representation of the human body.

Parallel cognitive maps for multiple knowledge structures in the hippocampal formation

The hippocampal-entorhinal system uses cognitive maps to represent spatial knowledge and other types of relational information. However, objects can often be characterized by different types of relations simultaneously. How does the hippocampal formation handle the embedding of stimuli in multiple relational structures that differ vastly in their mode and timescale of acquisition? Does the hippocampal formation integrate different stimulus dimensions into one conjunctive map or is each dimension represented in a parallel map? Here, we reanalyzed human functional magnetic resonance imaging data from Garvert et al. (2017) that had previously revealed a map in the hippocampal formation coding for a newly learnt transition structure. Using functional magnetic resonance imaging adaptation analysis, we found that the degree of representational similarity in the bilateral hippocampus also decreased as a function of the semantic distance between presented objects. Importantly, while both map-like structures localized to the hippocampal formation, the semantic map was located in more posterior regions of the hippocampal formation than the transition structure and thus anatomically distinct. This finding supports the idea that the hippocampal-entorhinal system forms parallel cognitive maps that reflect the embedding of objects in diverse relational structures.

Low frequency oscillations during hand laterality judgment task with and without personal perspectives: a preliminary study

Sense of personal perspective is crucial for understanding in attentional mechanisms of the perception in "self" or "other's" body. In a hand laterality judgment (HLJ) task, perception of perspective can be assessed by arranging angular orientations and depths of images. A total of 11 healthy, right-handed participants (8 females, mean age: 38.36 years, education: 14 years) were included in the study. The purpose of this study was to investigate behavioural and cortical responses in low-frequency cortical rhythms during a HLJ task. A total of 80-visual hand stimuli were presented through the experiment. Hand visuals were categorized in the way of side (right vs. left) and perspective (1st vs. 3rd personal perspective). Both behavioural outcomes and brain oscillatory characteristics (i.e., frequency and amplitude) of the Electroencephalography were analysed. All reaction time and incorrect answers for 3rd person perspective were higher than the ones for 1st person perspective. Location effect was statistically significant in event-related theta responses confirming the dominant activity of theta frequency in spatial memory tasks on parietal and occipital areas. In addition, we found there were increasing in delta power and phase in hand visuals with 1st person perspective and increasing theta phase in hand visuals with 3rd person perspective (p < 0.05). Accordingly, a clear dissociation in the perception of perspectives in low-frequency bands was revealed. These different cortical strategy in the perception of hand visual with and without perspectives may be interpreted as delta activity may be related in self-body perception, whereas theta activity may be related in allocentric perception.

Alterations of interhemispheric functional homotopic connectivity and corpus callosum microstructure in bulimia nervosa

Background

Accumulating evidence indicates maladaptive neural information interactions between different brain regions underlie bulimia nervosa (BN). However, little is known about the alterations in interhemispheric communication of BN, which is facilitated by the corpus callosum (CC), the major commissural fiber connecting the two hemispheres. To shed light on the interhemispheric communications in BN, the present study aims to explore alterations of interhemispheric homotopic functional connectivity and the CC microstructure in BN.

Methods

Based on magnetic resonance imaging (MRI) data collected from 42 BN patients and 38 healthy controls (HCs), the group differences of voxel-mirrored homotopic connectivity (VMHC) index and CC white matter microstructure were compared. Then brain regions with significant group differences in VMHC were selected as seeds for subsequent functional connectivity (FC) analysis. Seed-based fiber tracking and correlation analysis were used to analyze the relationship between VMHC and CC changes. And correlation analysis was used to reveal the correlation between abnormal imaging variables and the clinical features of BN.

Results

Compared with HCs, the BN group showed decreased fractional anisotropy (FA) in middle part of CC (CCMid) and increased VMHC in bilateral orbitofrontal cortex (OFC) and middle temporal gyrus (MTG) [false discovery rate (FDR) correction with a corrected threshold of P<0.05]. Subsequent FC analyses indicated increased FC between left OFC and right OFC, bilateral MTG, left middle occipital gyrus and right precuneus (PCUN); between right OFC and left cerebellum crus II and right PCUN; and between left MTG and right inferior temporal gyrus, right cerebellum lobule VI and right medial superior frontal gyrus (FDR correction with a corrected threshold of P<0.05). The VMHC values of OFC and MTG showed no correlations with FA values of the CCMid and the white fibers between the bilateral OFC and MTG were not through the CCMid. In addition, several regions with abnormal FC had a potential correlation trend with abnormal eating behaviors in BN patients (P<0.05, uncorrected).

Conclusions

Aberrant interhemispheric homotopic functional connectivity and CC microstructure were observed in BN, and they may be independent of each other. Regions with aberrant interhemispheric homotopic functional connectivity showed hyperconnectivity with regions related to reward processing, body shape perception, and self-reference.

Perceptual aftereffects of adiposity transfer from hands to whole bodies

Adaptation aftereffects for features such as identity and gender have been shown to transfer between faces and bodies, and faces and body parts, i.e. hands. However, no studies have investigated transfer of adaptation aftereffects between whole bodies and body parts. The present study investigated whether visual adaptation aftereffects transfer between hands and whole bodies in the context of adiposity judgements (i.e. how thin or fat a body is). On each trial, participants had to decide whether the body they saw was thinner or fatter than average. Participants performed the task before and after exposure to a thin/fat hand. Consistent with body adaptation studies, after exposure to a slim hand participants judged subsequently presented bodies to be fatter than after adaptation to a fat hand. These results suggest that there may be links between visual representations of body adiposity for whole bodies and body parts.

Effects of the social context on the neurophysiological correlates of observed error monitoring

Monitoring the motor performance of others, including the correctness of their actions, is crucial for the human behavior. However, while performance (and error) monitoring of the own actions has been studied extensively at the neurophysiological level, the corresponding studies on monitoring of others' errors are scarce, especially for ecological actions. Moreover, the role of the context of the observed action has not been sufficiently explored. To fill this gap, the present study investigated electroencephalographic (EEG) indices of error monitoring during observation of images of interrupted reach-to-grasp actions in social (an object held in another person's hand) and non-social (an object placed on a table) contexts. Analysis in time- and time-frequency domain showed that, at the level of conscious error awareness, there were no effects of the social context (observed error positivity was present for erroneous actions in both contexts). However, the effects of the context were present at the level of hand image processing: observing erroneous actions in the non-social context was related to larger occipito-temporal N1 and theta activity, while in the social context this pattern was reversed, i.e., larger N1 and theta activity were present for the correct actions. These results suggest that, in case of easily predictable ecological actions, action correctness is processed as early as at the level of hand image perception, since the hand posture conveys information about the action (e.g., motor intention). The social context of actions might make the correct actions more salient, possibly through the saliency of the correctly achieved common goal.

Understanding Human Object Vision: A Picture Is Worth a Thousand Representations

Objects are the core meaningful elements in our visual environment. Classic theories of object vision focus upon object recognition and are elegant and simple. Some of their proposals still stand, yet the simplicity is gone. Recent evolutions in behavioral paradigms, neuroscientific methods, and computational modeling have allowed vision scientists to uncover the complexity of the multidimensional representational space that underlies object vision. We review these findings and propose that the key to understanding this complexity is to relate object vision to the full repertoire of behavioral goals that underlie human behavior, running far beyond object recognition. There might be no such thing as core object recognition, and if it exists, then its importance is more limited than traditionally thought.

Action Observation Network Activity Related to Object-Directed and Socially-Directed Actions in Adolescents

The human action observation network (AON) encompasses brain areas consistently engaged when we observe other's actions. Although the core nodes of the AON are present from childhood, it is not known to what extent they are sensitive to different action features during development. Because social cognitive abilities continue to mature during adolescence, the AON response to socially-oriented actions, but not to object-related actions, may differ in adolescents and adults. To test this hypothesis, we scanned with functional magnetic resonance imaging (fMRI) male and female typically-developing teenagers (n = 28; 13 females) and adults (n = 25; 14 females) while they passively watched videos of manual actions varying along two dimensions: sociality (i.e., directed toward another person or not) and transitivity (i.e., involving an object or not). We found that action observation recruited the same fronto-parietal and occipito-temporal regions in adults and adolescents. The modulation of voxel-wise activity according to the social or transitive nature of the action was similar in both groups of participants. Multivariate pattern analysis, however, revealed that decoding accuracies in intraparietal sulcus (IPS)/superior parietal lobe (SPL) for both sociality and transitivity were lower for adolescents compared with adults. In addition, in the lateral occipital temporal cortex (LOTC), generalization of decoding across the orthogonal dimension was lower for sociality only in adolescents. These findings indicate that the representation of the content of others' actions, and in particular their social dimension, in the adolescent AON is still not as robust as in adults.SIGNIFICANCE STATEMENT The activity of the action observation network (AON) in the human brain is modulated according to the purpose of the observed action, in particular the extent to which it involves interaction with an object or with another person. How this conceptual representation of actions is implemented during development is largely unknown. Here, using multivoxel pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data, we discovered that, while the action observation network is in place in adolescence, the fine-grain organization of its posterior regions is less robust than in adults to decode the abstract social dimensions of an action. This finding highlights the late maturation of social processing in the human brain.

The CABB dataset: A multimodal corpus of communicative interactions for behavioural and neural analyses

We present a dataset of behavioural and fMRI observations acquired in the context of humans involved in multimodal referential communication. The dataset contains audio/video and motion-tracking recordings of face-to-face, task-based communicative interactions in Dutch, as well as behavioural and neural correlates of participants' representations of dialogue referents. Seventy-one pairs of unacquainted participants performed two interleaved interactional tasks in which they described and located 16 novel geometrical objects (i.e., Fribbles) yielding spontaneous interactions of about one hour. We share high-quality video (from three cameras), audio (from head-mounted microphones), and motion-tracking (Kinect) data, as well as speech transcripts of the interactions. Before and after engaging in the face-to-face communicative interactions, participants' individual representations of the 16 Fribbles were estimated. Behaviourally, participants provided a written description (one to three words) for each Fribble and positioned them along 29 independent conceptual dimensions (e.g., rounded, human, audible). Neurally, fMRI signal evoked by each Fribble was measured during a one-back working-memory task. To enable functional hyperalignment across participants, the dataset also includes fMRI measurements obtained during visual presentation of eight animated movies (35 min total). We present analyses for the various types of data demonstrating their quality and consistency with earlier research. Besides high-resolution multimodal interactional data, this dataset includes different correlates of communicative referents, obtained before and after face-to-face dialogue, allowing for novel investigations into the relation between communicative behaviours and the representational space shared by communicators. This unique combination of data can be used for research in neuroscience, psychology, linguistics, and beyond.

More Than the Face: Representations of Bodies in the Inferior Temporal Cortex

Visual representations of bodies, in addition to those of faces, contribute to the recognition of con- and heterospecifics, to action recognition, and to nonverbal communication. Despite its importance, the neural basis of the visual analysis of bodies has been less studied than that of faces. In this article, I review what is known about the neural processing of bodies, focusing on the macaque temporal visual cortex. Early single-unit recording work suggested that the temporal visual cortex contains representations of body parts and bodies, with the dorsal bank of the superior temporal sulcus representing bodily actions. Subsequent functional magnetic resonance imaging studies in both humans and monkeys showed several temporal cortical regions that are strongly activated by bodies. Single-unit recordings in the macaque body patches suggest that these represent mainly body shape features. More anterior patches show a greater viewpoint-tolerant selectivity for body features, which may reflect a processing principle shared with other object categories, including faces. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Pattern differentiation and tuning shift in human sensory cortex underlie long-term threat memory

The amygdala-prefrontal-cortex circuit has long occupied the center of the threat system,¹ but new evidence has rapidly amassed to implicate threat processing outside this canonical circuit.^2-4 Through nonhuman research, the sensory cortex has emerged as a critical substrate for long-term threat memory,^5-9 underpinned by sensory cortical pattern separation/completion^10,11 and tuning shift.^12,13 In humans, research has begun to associate the human sensory cortex with long-term threat memory,^14,15 but the lack of mechanistic insights obscures a direct linkage. Toward that end, we assessed human olfactory threat conditioning and long-term (9 days) threat memory, combining affective appraisal, olfactory psychophysics, and functional magnetic resonance imaging (fMRI) over a linear odor-morphing continuum (five levels of binary mixtures of the conditioned stimuli/CS+ and CS- odors). Affective ratings and olfactory perceptual discrimination confirmed (explicit) affective and perceptual learning and memory via conditioning. fMRI representational similarity analysis (RSA) and voxel-based tuning analysis further revealed associative plasticity in the human olfactory (piriform) cortex, including immediate and lasting pattern differentiation between CS and neighboring non-CS and a late onset, lasting tuning shift toward the CS. The two plastic processes were especially salient and lasting in anxious individuals, among whom they were further correlated. These findings thus support an evolutionarily conserved sensory cortical system of long-term threat representation, which can underpin threat perception and memory. Importantly, hyperfunctioning of this sensory mnemonic system of threat in anxiety further implicates a hitherto underappreciated sensory mechanism of anxiety.

Features and Extra-Striate Body Area Representations of Diagnostic Body Parts in Anger and Fear Perception

Social species perceive emotion via extracting diagnostic features of body movements. Although extensive studies have contributed to knowledge on how the entire body is used as context for decoding bodily expression, we know little about whether specific body parts (e.g., arms and legs) transmit enough information for body understanding. In this study, we performed behavioral experiments using the Bubbles paradigm on static body images to directly explore diagnostic body parts for categorizing angry, fearful and neutral expressions. Results showed that subjects recognized emotional bodies through diagnostic features from the torso with arms. We then conducted a follow-up functional magnetic resonance imaging (fMRI) experiment on body part images to examine whether diagnostic parts modulated body-related brain activity and corresponding neural representations. We found greater activations of the extra-striate body area (EBA) in response to both anger and fear than neutral for the torso and arms. Representational similarity analysis showed that neural patterns of the EBA distinguished different bodily expressions. Furthermore, the torso with arms and whole body had higher similarities in EBA representations relative to the legs and whole body, and to the head and whole body. Taken together, these results indicate that diagnostic body parts (i.e., torso with arms) can communicate bodily expression in a detectable manner.

One object, two networks? Assessing the relationship between the face and body-selective regions in the primate visual system

Faces and bodies are often treated as distinct categories that are processed separately by face- and body-selective brain regions in the primate visual system. These regions occupy distinct regions of visual cortex and are often thought to constitute independent functional networks. Yet faces and bodies are part of the same object and their presence inevitably covary in naturalistic settings. Here, we re-evaluate both the evidence supporting the independent processing of faces and bodies and the organizational principles that have been invoked to explain this distinction. We outline four hypotheses ranging from completely separate networks to a single network supporting the perception of whole people or animals. The current evidence, especially in humans, is compatible with all of these hypotheses, making it presently unclear how the representation of faces and bodies is organized in the cortex.

Two 'what' pathways for action and object recognition

The ventral visual stream is conceived as a pathway for object recognition. However, we also recognize the actions an object can be involved in. Here, we show that action recognition critically depends on a pathway in lateral occipitotemporal cortex, partially overlapping and topographically aligned with object representations that are precursors for action recognition. By contrast, object features that are more relevant for object recognition, such as color and texture, are typically found in ventral occipitotemporal cortex. We argue that occipitotemporal cortex contains similarly organized lateral and ventral 'what' pathways for action and object recognition, respectively. This account explains a number of observed phenomena, such as the duplication of object domains and the specific representational profiles in lateral and ventral cortex.

"Mind the thumb": Judging hand laterality is anchored on the thumb position

People can decide whether the image of a hand represents a left or a right one. The laterality judgment mainly implies mentally imaging own hand movement (motor simulation) if the stimulus represents a palm, or analysing visual cues, as hand asymmetry, if the stimulus reproduces a dorsum. Here, by capitalizing on evidence underscoring the key role of thumb-palm complex in motor dexterity of human hand, we hypothesise that activation of motor or visual processes when judging hand laterality is due to the different relevance of palm-thumb and dorsum-thumb combinations to hand action. To test this thumb-anchored strategy, in a laterality judgment experiment, we concurrently manipulated the thumb position (flexed or extended) with respect to palm and dorsum, and the human likeness of the hand shape (influencing the salience of the thumb with respect to the hand shape). The main results demonstrated that viewing the flexed thumb from palm or dorsum elicited motor simulation, while viewing the extended thumb activated motor simulation when combined with palm but not dorsum. The present data highlight the pivotal role of the thumb in hand laterality judgments, consistent with its key role in human in-hand manipulation.

The extrastriate body area is involved in reciprocal imitation of hand gestures, vocalizations, and facial expressions: A univariate and multivariate fMRI study

The extrastriate body area (EBA) in the lateral occipito-temporal cortex has an important role in reciprocal interaction, as it detects congruence between self and other's hand actions. However, it is unclear whether the EBA can detect congruence regardless of the type of action. In the present study, we examined the neural substrate underlying congruence detection of three types of actions: hand gestures, vocalizations, and facial expressions. A univariate analysis revealed a congruency effect, especially for imitating action, for all three types of actions in the EBA. A multi-voxel pattern analysis classifier in the EBA was able to distinguish between initiating interaction from responding to interaction in all experiments. Correspondingly, the congruency effect in the EBA revealed by univariate analysis was stronger for responding to than for initiating interaction. These findings suggest that the EBA might contribute to detect congruence regardless of the body part used (i.e. face or hand) and the type of action (i.e. gestural or vocal). Moreover, initiating and responding to interaction might be processed differently within the EBA. This study highlights the role of the EBA in comparing between self and other's actions beyond hand actions.Running head: Function of EBA in reciprocal imitation.

Weighted RSA: An Improved Framework on the Perception of Audio-visual Affective Speech in Left Insula and Superior Temporal Gyrus

Being able to accurately perceive the emotion expressed by the facial or verbal expression from others is critical to successful social interaction. However, only few studies examined the multimodal interactions on speech emotion, and there is no consistence in studies on the speech emotion perception. It remains unclear, how the speech emotion of different valence is perceived on the multimodal stimuli by our human brain. In this paper, we conducted a functional magnetic resonance imaging (fMRI) study with an event-related design, using dynamic facial expressions and emotional speech stimuli to express different emotions, in order to explore the perception mechanism of speech emotion in audio-visual modality. The representational similarity analysis (RSA), whole-brain searchlight analysis, and conjunction analysis of emotion were used to interpret the representation of speech emotion in different aspects. Significantly, a weighted RSA approach was creatively proposed to evaluate the contribution of each candidate model to the best fitted model and provided a supplement to RSA. The results of weighted RSA indicated that the fitted models were superior to all candidate models and the weights could be used to explain the representation of ROIs. The bilateral amygdala has been shown to be associated with the processing of both positive and negative emotions except neutral emotion. It is indicated that the left posterior insula and the left anterior superior temporal gyrus (STG) play important roles in the perception of multimodal speech emotion.

Visual adaptation selective for individual limbs reveals hierarchical human body representation

The spatial relationships between body parts are a rich source of information for person perception, with even simple pairs of parts providing highly valuable information. Computation of these relationships would benefit from a hierarchical representation, where body parts are represented individually. We hypothesized that the human visual system makes use of such representations. To test this hypothesis, we used adaptation to determine whether observers were sensitive to changes in the length of one body part relative to another. Observers viewed forearm/upper arm pairs where the forearm had been either lengthened or shortened, judging the perceived length of the forearm. Observers then adapted to a variety of different stimuli (e.g., arms, objects, etc.) in different orientations and visual field locations. We found that following adaptation to distorted limbs, but not non-limb objects, observers experienced a shift in perceived forearm length. Furthermore, this effect partially transferred across different orientations and visual field locations. Taken together, these results suggest the effect arises in high level mechanisms specialized for specific body parts, providing evidence for a representation of bodies based on parts and their relationships.

Expert Tool Users Show Increased Differentiation between Visual Representations of Hands and Tools

The idea that when we use a tool we incorporate it into the neural representation of our body (embodiment) has been a major inspiration for philosophy, science, and engineering. While theoretically appealing, there is little direct evidence for tool embodiment at the neural level. Using functional magnetic resonance imaging (fMRI) in male and female human subjects, we investigated whether expert tool users (London litter pickers: n = 7) represent their expert tool more like a hand (neural embodiment) or less like a hand (neural differentiation), as compared with a group of tool novices (n = 12). During fMRI scans, participants viewed first-person videos depicting grasps performed by either a hand, litter picker, or a non-expert grasping tool. Using representational similarity analysis (RSA), differences in the representational structure of hands and tools were measured within occipitotemporal cortex (OTC). Contrary to the neural embodiment theory, we find that the experts group represent their own tool less like a hand (not more) relative to novices. Using a case-study approach, we further replicated this effect, independently, in five of the seven individual expert litter pickers, as compared with the novices. An exploratory analysis in left parietal cortex, a region implicated in visuomotor representations of hands and tools, also indicated that experts do not visually represent their tool more similar to hands, compared with novices. Together, our findings suggest that extensive tool use leads to an increased neural differentiation between visual representations of hands and tools. This evidence provides an important alternative framework to the prominent tool embodiment theory.SIGNIFICANCE STATEMENT It is commonly thought that tool use leads to the assimilation of the tool into the neural representation of the body, a process referred to as embodiment. Here, we demonstrate that expert tool users (London litter pickers) neurally represent their own tool less like a hand (not more), compared with novices. Our findings advance our current understanding for how experience shapes functional organization in high-order visual cortex. Further, this evidence provides an alternative framework to the prominent tool embodiment theory, suggesting instead that experience with tools leads to more distinct, separable hand and tool representations.

Individualizing Representational Similarity Analysis

Representational similarity analysis (RSA) is a popular multivariate analysis technique in cognitive neuroscience that uses functional neuroimaging to investigate the informational content encoded in brain activity. As RSA is increasingly being used to investigate more clinically-geared questions, the focus of such translational studies turns toward the importance of individual differences and their optimization within the experimental design. In this perspective, we focus on two design aspects: applying individual vs. averaged behavioral dissimilarity matrices to multiple participants' neuroimaging data and ensuring the congruency between tasks when measuring behavioral and neural representational spaces. Incorporating these methods permits the detection of individual differences in representational spaces and yields a better-defined transfer of information from representational spaces onto multivoxel patterns. Such design adaptations are prerequisites for optimal translation of RSA to the field of precision psychiatry.

'Not only faces': specialized visual representation of human hands revealed by adaptation

Classical neurophysiological studies demonstrated that the monkey brain is equipped with neurons selectively representing the visual shape of the primate hand. Neuroimaging in humans provided data suggesting that a similar representation can be found in humans. Here, we investigated the selectivity of hand representation in humans by means of the visual adaptation technique. Results showed that participants' judgement of human-likeness of a visual probe representing a human hand was specifically reduced by a visual adaptation procedure when using a human hand adaptor but not when using an anthropoid robotic hand or a non-primate animal paw adaptor. Instead, human-likeness of the anthropoid robotic hand was affected by both human and robotic adaptors. No effect was found when using a non-primate animal paw as adaptor or probe. These results support the existence of specific neural mechanisms encoding human hand in the human's visual system.

Spontaneously emerging patterns in human visual cortex and their functional connectivity are linked to the patterns evoked by visual stimuli

The function of spontaneous brain activity is an important issue in neuroscience. Here we test the hypothesis that patterns of spontaneous activity code representational patterns evoked by stimuli. We compared in human visual cortex multivertex patterns of spontaneous activity to patterns evoked by ecological visual stimuli (faces, bodies, scenes) and low-level visual features (e.g., phase-scrambled faces). Specifically, we identified regions that preferred particular stimulus categories during localizer scans (e.g., extrastriate body area for bodies), measured multivertex patterns for each category during event-related task scans, and then correlated over vertices these stimulus-evoked patterns to the pattern measured on each frame of resting-state scans. The mean correlation coefficient was essentially zero for all regions/stimulus categories, indicating that resting multivertex patterns were not biased toward particular stimulus-evoked patterns. However, the spread of correlation coefficients between stimulus-evoked and resting patterns, positive and negative, was significantly greater for the preferred stimulus category of an ROI. The relationship between spontaneous and stimulus-evoked multivertex patterns also governed the temporal correlation or functional connectivity of patterns of spontaneous activity between individual regions (pattern-based functional connectivity). Resting multivertex patterns related to an object category fluctuated preferentially between ROIs preferring the same category, and fluctuations of the pattern for a category (e.g., body) within its preferred ROIs were largely uncorrelated with fluctuations of the pattern for a disparate category (e.g., scene) within its preferred ROIs. These results support the proposal that spontaneous multivertex activity patterns are linked to stimulus-evoked patterns, consistent with a representational function for spontaneous activity.NEW & NOTEWORTHY Spontaneous brain activity was once thought to reflect only noise, but evidence of strong spatiotemporal regularities has motivated a search for functional explanations. Here we show that the spatial pattern of spontaneous activity in human high-level and early visual cortex is related to the spatial patterns evoked by stimuli. Moreover, these patterns partly govern spontaneous spatiotemporal interactions between regions, so-called functional connectivity. These results support the hypothesis that spontaneous activity serves a representational function.

Brain Activation During Visually Guided Finger Movements

Computer interaction via visually guided hand movements often employs either abstract cursor-based feedback or virtual hand (VH) representations of varying degrees of realism. The effect of changing this visual feedback in virtual reality settings is currently unknown. In this study, 19 healthy right-handed adults performed index finger movements (“action”) and observed movements (“observation”) with four different types of visual feedback: a simple circular cursor (CU), a point light (PL) pattern indicating finger joint positions, a shadow cartoon hand (SH) and a realistic VH. Finger movements were recorded using a data glove, and eye-tracking was recorded optically. We measured brain activity using functional magnetic resonance imaging (fMRI). Both action and observation conditions showed stronger fMRI signal responses in the occipitotemporal cortex compared to baseline. The action conditions additionally elicited elevated bilateral activations in motor, somatosensory, parietal, and cerebellar regions. For both conditions, feedback of a hand with a moving finger (SH, VH) led to higher activations than CU or PL feedback, specifically in early visual regions and the occipitotemporal cortex. Our results show the stronger recruitment of a network of cortical regions during visually guided finger movements with human hand feedback when compared to a visually incomplete hand and abstract feedback. This information could have implications for the design of visually guided tasks involving human body parts in both research and application or training-related paradigms.

Computation-Based Feature Representation of Body Expressions in the Human Brain

Humans and other primate species are experts at recognizing body expressions. To understand the underlying perceptual mechanisms, we computed postural and kinematic features from affective whole-body movement videos and related them to brain processes. Using representational similarity and multivoxel pattern analyses, we showed systematic relations between computation-based body features and brain activity. Our results revealed that postural rather than kinematic features reflect the affective category of the body movements. The feature limb contraction showed a central contribution in fearful body expression perception, differentially represented in action observation, motor preparation, and affect coding regions, including the amygdala. The posterior superior temporal sulcus differentiated fearful from other affective categories using limb contraction rather than kinematics. The extrastriate body area and fusiform body area also showed greater tuning to postural features. The discovery of midlevel body feature encoding in the brain moves affective neuroscience beyond research on high-level emotion representations and provides insights in the perceptual features that possibly drive automatic emotion perception.

Sociality and interaction envelope organize visual action representations

Humans observe a wide range of actions in their surroundings. How is the visual cortex organized to process this diverse input? Using functional neuroimaging, we measured brain responses while participants viewed short videos of everyday actions, then probed the structure in these responses using voxel-wise encoding modeling. Responses are well fit by feature spaces that capture the body parts involved in an action and the action’s targets (i.e. whether the action was directed at an object, another person, the actor, and space). Clustering analyses reveal five large-scale networks that summarize the voxel tuning: one related to social aspects of an action, and four related to the scale of the interaction envelope, ranging from fine-scale manipulations directed at objects, to large-scale whole-body movements directed at distant locations. We propose that these networks reveal the major representational joints in how actions are processed by visual regions of the brain.

How is action perception organized in the brain? Here, the authors report evidence for five networks tuned to actions’ social content and the scale of their effect on the world and propose that sociality and interaction envelope are organizing dimensions of visual action representation.

Is an artificial limb embodied as a hand? Brain decoding in prosthetic limb users

The potential ability of the human brain to represent an artificial limb as a body part (embodiment) has been inspiring engineers, clinicians, and scientists as a means to optimise human-machine interfaces. Using functional MRI (fMRI), we studied whether neural embodiment actually occurs in prosthesis users' occipitotemporal cortex (OTC). Compared with controls, different prostheses types were visually represented more similarly to each other, relative to hands and tools, indicating the emergence of a dissociated prosthesis categorisation. Greater daily life prosthesis usage correlated positively with greater prosthesis categorisation. Moreover, when comparing prosthesis users' representation of their own prosthesis to controls' representation of a similar looking prosthesis, prosthesis users represented their own prosthesis more dissimilarly to hands, challenging current views of visual prosthesis embodiment. Our results reveal a use-dependent neural correlate for wearable technology adoption, demonstrating adaptive use-related plasticity within the OTC. Because these neural correlates were independent of the prostheses' appearance and control, our findings offer new opportunities for prosthesis design by lifting restrictions imposed by the embodiment theory for artificial limbs.

Visual Body Part Representation in the Lateral Occipitotemporal Cortex in Children/Adolescents and Adults

The lateral occipitotemporal cortex (LOTC) that responds to human bodies and body parts has been implicated in social development and neurodevelopmental disorders like autism spectrum disorder (ASD). Neuroimaging studies using a representational similarity analysis (RSA) revealed that body representation in the LOTC of typically developing (TD) adults is categorized into 3 clusters: action effector body parts, noneffector body parts, and face parts. However, its organization of younger people (i.e., children and adolescents) and its association with individual traits remain unclear. In this functional MRI study, TD adults and children/adolescents observed photographs of hands, feet, arms, legs, chests, waists, upper/lower faces, the whole body, and chairs. The univariate analysis showed that fewer child/adolescent participants showed left LOTC activation in response to whole-body images (relative to those of chairs) than adult participants. Contrastingly, the RSA on both age groups revealed a comparable body representation with 3 clusters of body parts in the bilateral LOTC. Hence, this result indicates that, although response to whole-body images can differ, LOTC body part representations for children/ adolescents and adults are highly similar. Furthermore, sensory atypicality is associated with spatial LOTC organization, suggesting the importance of this region for understanding individual difference, which is frequently observed in ASD.

Hemispheric Organization for Visual Object Recognition: A Theoretical Account and Empirical Evidence

Despite the similarity in structure, the hemispheres of the human brain have somewhat different functions. A traditional view of hemispheric organization asserts that there are independent and largely lateralized domain-specific regions in ventral occipitotemporal (VOTC), specialized for the recognition of distinct classes of objects. Here, we offer an alternative account of the organization of the hemispheres, with a specific focus on face and word recognition. This alternative account relies on three computational principles: distributed representations and knowledge, cooperation and competition between representations, and topography and proximity. The crux is that visual recognition results from a network of regions with graded functional specialization that is distributed across both hemispheres. Specifically, the claim is that face recognition, which is acquired relatively early in life, is processed by VOTC regions in both hemispheres. Once literacy is acquired, word recognition, which is co-lateralized with language areas, primarily engages the left VOTC and, consequently, face recognition is primarily, albeit not exclusively, mediated by the right VOTC. We review psychological and neural evidence from a range of studies conducted with normal and brain-damaged adults and children and consider findings which challenge this account. Last, we offer suggestions for future investigations whose findings may further refine this account.

Object responses are highly malleable, rather than invariant, with changes in object appearance

Theoretical frameworks of human vision argue that object responses remain stable, or 'invariant', despite changes in viewing conditions that can alter object appearance but not identity. Here, in a major departure from previous approaches that have relied on two-dimensional (2-D) images to study object processing, we demonstrate that changes in an object's appearance, but not its identity, can lead to striking shifts in behavioral responses to objects. We used inverse multidimensional scaling (MDS) to measure the extent to which arrangements of objects in a sorting task were similar or different when the stimuli were displayed as scaled 2-D images, three-dimensional (3-D) augmented reality (AR) projections, or real-world solids. We were especially interested in whether sorting behavior in each display format was based on conceptual (e.g., typical location) versus physical object characteristics. We found that 2-D images of objects were arranged according to conceptual (typical location), but not physical, properties. AR projections, conversely, were arranged primarily according to physical properties such as real-world size, elongation and weight, but not conceptual properties. Real-world solid objects, unlike both 2-D and 3-D images, were arranged using multidimensional criteria that incorporated both conceptual and physical object characteristics. Our results suggest that object responses can be strikingly malleable, rather than invariant, with changes in the visual characteristics of the stimulus. The findings raise important questions about limits of invariance in object processing, and underscore the importance of studying responses to richer stimuli that more closely resemble those we encounter in real-world environments.

Collective memory shapes the organization of individual memories in the medial prefrontal cortex

It has long been hypothesized that individual recollection fits collective memory. To look for a collective schema, we analysed the content of 30 years of media coverage of World War II on French national television. We recorded human brain activity using functional magnetic resonance imaging as participants recalled World War II displays at the Caen Memorial Museum following an initial tour. We focused on the medial prefrontal cortex, a key region for social cognition and memory schemas. The organization of individual memories captured using the distribution of the functional magnetic resonance imaging signal in the dorsal part of the medial prefrontal cortex was more accurately predicted by the structure of the collective schema than by various control models of contextual or semantic memory. Collective memory, which exists outside and beyond individuals, can also organize individual memories and constitutes a common mental model that connects people's memories across time and space.

Individual face- and house-related eye movement patterns distinctively activate FFA and PPA

We investigated if the fusiform face area (FFA) and the parahippocampal place area (PPA) contain a representation of fixation sequences that are typically used when looking at faces or houses. Here, we instructed observers to follow a dot presented on a uniform background. The dot’s movements represented gaze paths acquired separately from observers looking at face or house pictures. Even when gaze dispersion differences were controlled, face- and house-associated gaze patterns could be discriminated by fMRI multivariate pattern analysis in FFA and PPA, more so for the current observer’s own gazes than for another observer’s gaze. The discrimination of the observer’s own gaze patterns was not observed in early visual areas (V1 – V4) or superior parietal lobule and frontal eye fields. These findings indicate a link between perception and action—the complex gaze patterns that are used to explore faces and houses—in the FFA and PPA.

The fusiform face area and parahippocampal place area respond to face and scene stimuli respectively. Here, the authors show using fMRI that these brain areas are also preferentially activated by eye movements associated with looking at faces and scenes even when no images are shown.

A Guide to Representational Similarity Analysis for Social Neuroscience

Representational similarity analysis (RSA) is a computational technique that uses pairwise comparisons of stimuli to reveal their representation in higher-order space. In the context of neuroimaging, mass-univariate analyses and other multivariate analyses can provide information on what and where information is represented but have limitations in their ability to address how information is represented. Social neuroscience is a field that can particularly benefit from incorporating RSA techniques to explore hypotheses regarding the representation of multidimensional data, how representations can predict behavior, how representations differ between groups and how multimodal data can be compared to inform theories. The goal of this paper is to provide a practical as well as theoretical guide to implementing RSA in social neuroscience studies.

The Effects of Attentional Focus on Brain Function During a Gross Motor Task

CONTEXT

Although the beneficial effects of using an external focus of attention are well documented in attainment and performance of movement execution, neural mechanisms underlying external focus' benefits are mostly unknown.

OBJECTIVE

To assess brain function during a lower-extremity gross motor movement while manipulating an internal and external focus of attention.

DESIGN

Cross-over study.

SETTING

Neuroimaging center Participants: A total of 10 healthy subjects (5 males and 5 females) Intervention: Participants completed external and internal focus of attention unilateral left 45° knee extension/flexion movements at a rate of 1.2 Hz laying supine in a magnetic resonance imaging scanner for 4 blocks of 30 seconds interspersed with 30-second rest blocks. During the internal condition, participants were instructed to "squeeze their quadriceps." During the external condition, participants were instructed to "focus on a target" positioned above their tibia.

MAIN OUTCOME MEASURES

T1 brain structural imaging was performed for registration of the functional data. For each condition, 3T functional magnetic resonance imaging blood oxygenation level dependent data representing 90 whole-brain volumes were acquired.

RESULTS

During the external relative to internal condition, increased activation was detected in the right occipital pole, cuneal cortex, anterior portion of the lingual gyrus, and intracalcarine cortex (Zmax = 4.5-6.2, P < .001). During the internal relative to external condition, increased activation was detected in the left primary motor cortex, left supplementary motor cortex, and cerebellum (Zmax = 3.4-3.5, P < .001).

CONCLUSIONS

Current results suggest that an external focus directed toward a visual target produces more brain activity in regions associated with vision and ventral streaming pathways, whereas an internal focus manipulated through instruction increases activation in brain regions that are responsible for motor control. Results from this study serve as baseline information for future prevention and rehabilitation investigations of how manipulating focus of attention can constructively affect neuroplasticity during training and rehabilitation.

Abnormal structural brain network and hemisphere-specific changes in bulimia nervosa

Bulimia nervosa (BN) is characterized by episodic binge eating and purging behaviors. Disrupted neural processes of self-regulation, taste-rewarding, and body image has been associated with the pathogenesis of BN. However, the structural basis for these behavioral and functional deficits remains largely unknown. We employed diffusion tensor imaging and graph theory approaches (including the nodal properties and network-based statistics (NBS)) to characterize the whole-brain structural network of 48 BN and 44 healthy women. For nodal measures of strength, local efficiency, and betweenness centrality, BN patients displayed abnormal increases in multiple left-lateralized nodes within the mesocorticolimbic reward circuitry (including the orbitofrontal cortex, anterior cingulate, insular, medial temporal, and subcortical areas), lateral temporal-occipital cortex, and precuneus, while reduced global efficiency was observed in the right-lateralized nodes within the dorsolateral prefrontal cortex, mesocorticolimbic circuitry, somatosensory and visuospatial system. Several mesocorticolimbic nodes significantly correlated with BN symptoms. At a network level, we found increased left-lateralized connections primarily within the orbitofrontal cortex and its connections to mesocorticolimbic and lateral temporal-occipital areas, but reduced right-lateralized connections across the inferior frontal gyrus and insula, as well as their connections to the lateral temporal cortex. This study revealed BN-related changes in white-matter connections across the prefrontal control, mesocorticolimbic reward, somatosensory and visuospatial systems. The hemispheric-specific change could be an important aspect of the pathophysiology of BN. By characterizing whole-brain structural network changes of BN, our study provides novel evidence for understanding the behavioral and functional deficits of the disorder.

Comparison of brain activity between motor imagery and mental rotation of the hand tasks: a functional magnetic resonance imaging study

Motor imagery (MI) has been considered effective in learning and practicing movements in many fields. However, when evaluating the effectiveness of this technique, the examiner has no way of assessing the participant’s motor imagery process. As an alternative, we have been exploring a mental body-part rotation task, in which the examiner can estimate the participant’s motivation and ability to sustain attention through the scored results. In this study, we aimed to investigate the possible application of a mental rotation (MRot) task and used fMRI to compare the brain activity during the MRot task with that during an MI task in healthy volunteers. Increased blood oxygenation level-dependent signals were observed bilaterally in the premotor areas and supplementary motor area during performance of both MI and MRot tasks. Our findings suggest that MRot could be an alternative to MI.

Distinct roles of temporal and frontoparietal cortex in representing actions across vision and language

Both temporal and frontoparietal brain areas are associated with the representation of knowledge about the world, in particular about actions. However, what these brain regions represent and precisely how they differ remains unknown. Here, we reveal distinct functional profiles of lateral temporal and frontoparietal cortex using fMRI-based MVPA. Frontoparietal areas encode representations of observed actions and corresponding written sentences in an overlapping way, but these representations do not generalize across stimulus type. By contrast, only left lateral posterior temporal cortex (LPTC) encodes action representations that generalize across observed action scenes and written descriptions. The representational organization of stimulus-general action information in LPTC can be predicted from models that describe basic agent-patient relations (object- and person-directedness) and the general semantic similarity between actions. Our results suggest that LPTC encodes general, conceptual aspects of actions whereas frontoparietal representations appear to be tied to specific stimulus types.

Temporal and frontoparietal brain areas both encode representations of actions, but whether they do so in different ways is unclear. Here, the authors show that only lateral posterior temporal cortex (LPTC) encodes representations that generalize across directly observed action scenes and written descriptions.

Repetitive Transcranial Magnetic Stimulation Over the Left Posterior Middle Temporal Gyrus Reduces Wrist Velocity During Emblematic Hand Gesture Imitation

Results from neuropsychological studies, and neuroimaging and behavioural experiments with healthy individuals, suggest that the imitation of meaningful and meaningless actions may be reliant on different processing routes. The left posterior middle temporal gyrus (pMTG) is one area that might be important for the recognition and imitation of meaningful actions. We studied the role of the left pMTG in imitation using repetitive transcranial magnetic stimulation (rTMS) and two-person motion-tracking. Participants imitated meaningless and emblematic meaningful hand and finger gestures performed by a confederate actor whilst both individuals were motion-tracked. rTMS was applied during action observation (before imitation) over the left pMTG or a vertex control site. Since meaningless action imitation has been previously associated with a greater wrist velocity and longer correction period at the end of the movement, we hypothesised that stimulation over the left pMTG would increase wrist velocity and extend the correction period of meaningful actions (i.e., due to interference with action recognition). We also hypothesised that imitator accuracy (actor-imitator correspondence) would be reduced following stimulation over the left pMTG. Contrary to our hypothesis, we found that stimulation over the pMTG, but not the vertex, during action observation reduced wrist velocity when participants later imitated meaningful, but not meaningless, hand gestures. These results provide causal evidence for a role of the left pMTG in the imitation of meaningful gestures, and may also be in keeping with proposals that left posterior temporal regions play a role in the production of postural components of gesture.

The influence of vision, touch, and proprioception on body representation of the lower limbs

Numerous studies have shown that the representation of the hand is distorted. When participants are asked to localize unseen points on the hand (e.g. the knuckle), it is perceived to be wider and shorter than its physical dimensions. Similar distortions occur when people are asked to judge the distance between two tactile points on the hand; estimates made in the longitudinal direction are perceived as significantly shorter than those made in the transverse direction. Yet, when asked to visually compare the shape and size of one's own hand to a template hand, individuals are accurate at estimating the size of their own hands. Thus, it seems that body representations are, at least in part, a function of the most prominent underlying sensory modality used to perceive the body part. Yet, it remains unknown if the representations of other body parts are similarly distorted. The lower limbs, for example, are structurally and functionally very different from the hands, yet their representation(s) are seldom studied. What does the body representation for the leg look like? And is leg representation dependent on which sense is probed when making judgments about its shape and size? In the current study, we investigated what the representation of the leg looks like in visually-, tactually-, and proprioceptively-guided tasks. Results revealed that the leg, like the hand, is distorted in a highly systematic manner. Distortions seem to rely, at least partly, on sensory input. This is the first study, to our knowledge, to systematically investigate leg representation in healthy individuals.

Linear Representation of Emotions in Whole Persons by Combining Facial and Bodily Expressions in the Extrastriate Body Area

Our human brain can rapidly and effortlessly perceive a person’s emotional state by integrating the isolated emotional faces and bodies into a whole. Behavioral studies have suggested that the human brain encodes whole persons in a holistic rather than part-based manner. Neuroimaging studies have also shown that body-selective areas prefer whole persons to the sum of their parts. The body-selective areas played a crucial role in representing the relationships between emotions expressed by different parts. However, it remains unclear in which regions the perception of whole persons is represented by a combination of faces and bodies, and to what extent the combination can be influenced by the whole person’s emotions. In the present study, functional magnetic resonance imaging data were collected when participants performed an emotion distinction task. Multi-voxel pattern analysis was conducted to examine how the whole person-evoked responses were associated with the face- and body-evoked responses in several specific brain areas. We found that in the extrastriate body area (EBA), the whole person patterns were most closely correlated with weighted sums of face and body patterns, using different weights for happy expressions but equal weights for angry and fearful ones. These results were unique for the EBA. Our findings tentatively support the idea that the whole person patterns are represented in a part-based manner in the EBA, and modulated by emotions. These data will further our understanding of the neural mechanism underlying perceiving emotional persons.

Theta synchronization over occipito-temporal cortices during visual perception of body parts

Categorical clustering in the visual system is thought to have evolved as a function of intrinsic (intra-areal) and extrinsic (interareal) connectivity and experience. In the visual system, the extrastriate body area (EBA), an occipito-temporal region, responds to full body and body part images under the organizational principle of their functional/semantic meaning. Although frequency-specific modulations of neural activity associated with perceptive and cognitive functions are increasingly attracting the interest of neurophysiologists and cognitive neuroscientists, perceiving single body parts with different functional meaning and full body images induces time-frequency modulations over occipito-temporal electrodes are yet to be described. Here, we studied this issue by measuring EEG in participants who passively observed fingers, hands, arms and faceless full body images with four control plant stimuli, each bearing hierarchical analogy with the body stimuli. We confirmed that occipito-temporal electrodes (compatible with the location of EBA) show a larger event-related potential (ERP, N190) for body-related images. Furthermore, we identified a body part-specific (i.e. selective for hands and arms) theta event-related synchronization increase under the same electrodes. This frequency modulation associated with the perception of body effectors over occipito-temporal cortices is in line with recent findings of categorical organization of neural responses to human effectors in the visual system.

On the partnership between neural representations of object categories and visual features in the ventral visual pathway

A dominant view in the cognitive neuroscience of object vision is that regions of the ventral visual pathway exhibit some degree of category selectivity. However, recent findings obtained with multivariate pattern analyses (MVPA) suggest that apparent category selectivity in these regions is dependent on more basic visual features of stimuli. In which case a rethinking of the function and organization of the ventral pathway may be in order. We suggest that addressing this issue of functional specificity requires clear coding hypotheses, about object category and visual features, which make contrasting predictions about neuroimaging results in ventral pathway regions. One way to differentiate between categorical and featural coding hypotheses is to test for residual categorical effects: effects of category selectivity that cannot be accounted for by visual features of stimuli. A strong method for testing these effects, we argue, is to make object category and target visual features orthogonal in stimulus design. Recent studies that adopt this approach support a feature-based categorical coding hypothesis according to which regions of the ventral stream do indeed code for object category, but in a format at least partially based on the visual features of stimuli.

Engagement of the left extrastriate body area during body-part metaphor comprehension

Grounded cognition explanations of metaphor comprehension predict activation of sensorimotor cortices relevant to the metaphor's source domain. We tested this prediction for body-part metaphors using functional magnetic resonance imaging while participants heard sentences containing metaphorical or literal references to body parts, and comparable control sentences. Localizer scans identified body-part-specific motor, somatosensory and visual cortical regions. Both subject- and item-wise analyses showed that, relative to control sentences, metaphorical but not literal sentences evoked limb metaphor-specific activity in the left extrastriate body area (EBA), paralleling the EBA's known visual limb-selectivity. The EBA focus exhibited resting-state functional connectivity with ipsilateral semantic processing regions. In some of these regions, the strength of resting-state connectivity correlated with individual preference for verbal processing. Effective connectivity analyses showed that, during metaphor comprehension, activity in some semantic regions drove that in the EBA. These results provide converging evidence for grounding of metaphor processing in domain-specific sensorimotor cortical activity.