Ventral aspect of the visual form pathway is not critical for the perception of biological motion

Positive and negative facial valence perception are modulated differently by eccentricity in the parafovea: Replication from KDEF to NimStim

While perceiving the emotional state of others may be crucial for our behavior even when this information is present outside of central vision, emotion perception studies typically focus on central visual field. We have recently investigated emotional valence (pleasantness) perception across the parafovea (≤ 4°) and found that for briefly presented (200 ms) emotional face images (from the established KDEF image-set), positive (happy) valence was the least affected by eccentricity (distance from the central visual field) and negative (fearful) valence the most. Furthermore, we found that performance at 2° predicted performance at 4°. Here we tested (n = 37) whether these effects replicate with face stimuli of different identities from a different well-established image-set (NimStim). All our prior findings replicated and eccentricity-based modulation magnitude was smaller with NimStim (~ 16.6% accuracy reduction at 4°) than with KDEF stimuli (~ 27.3% reduction). Our current investigations support our earlier findings that for briefly presented parafoveal stimuli, positive and negative valence perception are differently affected by eccentricity and may be dissociated. Furthermore, our results highlight the importance of investigating emotions beyond central vision and demonstrate commonalities and differences across different image sets in the parafovea, emphasizing the contribution of replication studies to substantiate our knowledge about perceptual mechanisms.

Disentangling Object Category Representations Driven by Dynamic and Static Visual Input

Humans can label and categorize objects in a visual scene with high accuracy and speed, a capacity well characterized with studies using static images. However, motion is another cue that could be used by the visual system to classify objects. To determine how motion-defined object category information is processed by the brain in the absence of luminance-defined form information, we created a novel stimulus set of "object kinematograms" to isolate motion-defined signals from other sources of visual information. Object kinematograms were generated by extracting motion information from videos of 6 object categories and applying the motion to limited-lifetime random dot patterns. Using functional magnetic resonance imaging (fMRI) (n = 15, 40% women), we investigated whether category information from the object kinematograms could be decoded within the occipitotemporal and parietal cortex and evaluated whether the information overlapped with category responses to static images from the original videos. We decoded object category for both stimulus formats in all higher-order regions of interest (ROIs). More posterior occipitotemporal and ventral regions showed higher accuracy in the static condition, while more anterior occipitotemporal and dorsal regions showed higher accuracy in the dynamic condition. Further, decoding across the two stimulus formats was possible in all regions. These results demonstrate that motion cues can elicit widespread and robust category responses on par with those elicited by static luminance cues, even in ventral regions of visual cortex that have traditionally been associated with primarily image-defined form processing.SIGNIFICANCE STATEMENT Much research on visual object recognition has focused on recognizing objects in static images. However, motion is a rich source of information that humans might also use to categorize objects. Here, we present the first study to compare neural representations of several animate and inanimate objects when category information is presented in two formats: static cues or isolated dynamic motion cues. Our study shows that, while higher-order brain regions differentially process object categories depending on format, they also contain robust, abstract category representations that generalize across format. These results expand our previous understanding of motion-derived animate and inanimate object category processing and provide useful tools for future research on object category processing driven by multiple sources of visual information.

A neural model for vector decomposition and relative-motion perception

The perception of motion not only depends on the detection of motion signals but also on choosing and applying reference-frames according to which motion is interpreted. Here we propose a neural model that implements the common-fate principle for reference-frame selection. The model starts with a retinotopic layer of directionally-tuned motion detectors. The Gestalt common-fate principle is applied to the activities of these detectors to implement in two neural populations the direction and the magnitude (speed) of the reference-frame. The output activities of retinotopic motion-detectors are decomposed using the direction of the reference-frame. The direction and magnitude of the reference-frame are then applied to these decomposed motion-vectors to generate activities that reflect relative-motion perception, i.e., the perception of motion with respect to the prevailing reference-frame. We simulated this model for classical relative motion stimuli, viz., the three-dot, rotating-wheel, and point-walker (biological motion) paradigms and found the model performance to be close to theoretical vector decomposition values. In the three-dot paradigm, the model made the prediction of perceived curved-trajectories for the target dot when its horizontal velocity was slower or faster than the flanking dots. We tested this prediction in two psychophysical experiments and found a good qualitative and quantitative agreement between the model and the data. Our results show that a simple neural network using solely motion information can account for the perception of group and relative motion.

Graph lesion-deficit mapping of fluid intelligence

Fluid intelligence is arguably the defining feature of human cognition. Yet the nature of its relationship with the brain remains a contentious topic. Influential proposals drawing primarily on functional imaging data have implicated 'multiple demand' frontoparietal and more widely distributed cortical networks, but extant lesion-deficit studies with greater causal power are almost all small, methodologically constrained, and inconclusive. The task demands large samples of patients, comprehensive investigation of performance, fine-grained anatomical mapping, and robust lesion-deficit inference, yet to be brought to bear on it. We assessed 165 healthy controls and 227 frontal or non-frontal patients with unilateral brain lesions on the best-established test of fluid intelligence, Raven's Advanced Progressive Matrices, employing an array of lesion-deficit inferential models responsive to the potentially distributed nature of fluid intelligence. Non-parametric Bayesian stochastic block models were used to reveal the community structure of lesion deficit networks, disentangling functional from confounding pathological distributed effects. Impaired performance was confined to patients with frontal lesions [F(2,387) = 18.491; P < 0.001; frontal worse than non-frontal and healthy participants P < 0.01, P <0.001], more marked on the right than left [F(4,385) = 12.237; P < 0.001; right worse than left and healthy participants P < 0.01, P < 0.001]. Patients with non-frontal lesions were indistinguishable from controls and showed no modulation by laterality. Neither the presence nor the extent of multiple demand network involvement affected performance. Both conventional network-based statistics and non-parametric Bayesian stochastic block modelling heavily implicated the right frontal lobe. Crucially, this localization was confirmed on explicitly disentangling functional from pathology-driven effects within a layered stochastic block model, prominently highlighting a right frontal network involving middle and inferior frontal gyrus, pre- and post-central gyri, with a weak contribution from right superior parietal lobule. Similar results were obtained with standard lesion-deficit analyses. Our study represents the first large-scale investigation of the distributed neural substrates of fluid intelligence in the focally injured brain. Combining novel graph-based lesion-deficit mapping with detailed investigation of cognitive performance in a large sample of patients provides crucial information about the neural basis of intelligence. Our findings indicate that a set of predominantly right frontal regions, rather than a more widely distributed network, is critical to the high-level functions involved in fluid intelligence. Further they suggest that Raven's Advanced Progressive Matrices is a useful clinical index of fluid intelligence and a sensitive marker of right frontal lobe dysfunction.

Positive and negative facial valence perception are modulated differently by eccentricity in the parafovea

Understanding whether people around us are in a good, bad or neutral mood can be critical to our behavior, both when looking directly at them or when they are in our peripheral visual field. However, facial expressions of emotions are often investigated at central visual field or at locations right or left of fixation. Here we assumed that perception of facial emotional valence (the emotion's pleasantness) changes with distance from central visual field (eccentricity) and that different emotions may be influenced differently by eccentricity. Participants (n = 58) judged the valence of emotional faces across the parafovea (≤ 4°, positive (happy), negative (fearful), or neutral)) while their eyes were being tracked. As expected, performance decreased with eccentricity. Positive valence perception was least affected by eccentricity (accuracy reduction of 10-19% at 4°) and negative the most (accuracy reduction of 35-38% at 4°), and this was not a result of speed-accuracy trade-off or response biases. Within-valence (but not across-valence) performance was associated across eccentricities suggesting perception of different valences is supported by different mechanisms. While our results may not generalize to all positive and negative emotions, they indicate that beyond-foveal investigations can reveal additional characteristics of the mechanisms that underlie facial expression processing and perception.

"Descriptive Risk-Averse Bayesian Decision-Making," a Model for Complex Biological Motion Perception in the Human Dorsal Pathway

Biological motion perception is integral not only to survival but also to the social life of human beings. Identifying the underlying mechanisms and their associated neurobiological substrates has been a matter of investigation and debate for some time. Although, in general, it is believed that the integration of local motion and dynamic form cues in the brain empowers the visual system to perceive/recognize biological motion stimuli, some recent studies have indicated the importance of dynamic form cues in such a process. Inspired by the previous neurophysiologically plausible biological motion perception models, a new descriptive risk-averse Bayesian simulation model, capable of discerning a ball's direction from a set of complex biological motion soccer kick stimuli, is proposed. The model represents only the dorsal pathway as a motion information processing section of the visual system according to the two-stream theory. The stimuli used have been obtained from a previous psychophysical study on athletes in our lab. Furthermore, the acquired psychophysical data from that study have been used to re-enact human behavior using our simulation model. By adjusting the model parameters, the psychometric function of athlete subjects has been mimicked. A correlation analysis between human and simulation data shows a significant and robust correlation between angular thresholds and slopes of the psychometric functions of both groups. Although it is established that the visual system optimally integrates all available information in the decision-making process, the results conform to the speculations favoring motion cue importance over dynamic form by testing the limits in which biological motion perception only depends on motion information processing.

Impaired social perception from eyes and face visual cues: evidence from prefrontal cortex damage

Despite the key role that decoding of social-perceptual cues from faces plays in interpersonal communication, it is only recently that the potential of prefrontal cortex damage to disrupt this ability has been recognized. In fact, few studies to date had assessed whether the ability to identify the state of mind of others from the whole or part of the face is disrupted after prefrontal cortex damage and whether these two abilities are associated and share overlapped neural systems. In the present study, 30 patients with focal prefrontal lesions and 30 matched control subjects were assessed on their ability to recognize six basic emotions from facial expressions of the whole face and to identify states of mind of others from photographs of only the eyes using the "Reading the Mind in the Eyes Task". Results showed that frontal patients were significantly impaired compared with control subjects on both tasks. Moreover, regression analyses showed that these two abilities are associated and reciprocally predictive of one another. Finally, using voxel-based lesion analysis; we identified a partially common bilaterally distributed prefrontal network in the decoding of both emotional cues from both the whole face and eyes centered within the dorsomedial and ventral regions with extension to the lateral frontal pole.

Visual experience dependent plasticity in humans

While sensitive periods in brain development have often been studied by investigating the recovery of visual functions after a congenital phase of visual deprivation in non-human animals, research in humans who had recovered sight after a transient phase of congenital blindness is still scarce. Here, we discuss the hypothesis put forward based on non-human primate work which states that the effects of experience increase downstream the visual processing hierarchy. Recent results from behavioral and neuroscience studies in sight recovery individuals are discussed in the context of research findings from permanently congenitally blind humans as well as from prospective studies in infants and children.

Biological Action Identification Does Not Require Early Visual Input for Development

Visual input during the first years of life is vital for the development of numerous visual functions. While normal development of global motion perception seems to require visual input during an early sensitive period, the detection of biological motion (BM) does not seem to do so. A more complex form of BM processing is the identification of human actions. Here, we tested whether identification rather than detection of BM is experience dependent. A group of human participants who had been treated for congenital cataracts (CC; of up to 18 years in duration, CC group) had to identify ten actions performed by human line figures. In addition, they performed a coherent motion (CM) detection task, which required identifying the direction of CM amid the movement of random dots. As controls, developmental cataract (DC) reversal individuals (DC group) who had undergone the same surgical treatment as CC group were included. Moreover, normally sighted controls were tested both with vision blurred to match the visual acuity (VA) of CC individuals [vision matched (VM) group] and with full sight [sighted control (SC) group]. The CC group identified biological actions with an extraordinary high accuracy (on average ∼85% correct) and was indistinguishable from the VM control group. By contrast, CM processing impairments of the CC group persisted even after controlling for VA. These results in the same individuals demonstrate an impressive resilience of BM processing to aberrant early visual experience and at the same time a sensitive period for the development of CM processing.

Altered large-scale organization of shape processing in visual agnosia

Recent findings suggest that both dorsal and ventral visual pathways process shape information. Nevertheless, a lesion to the ventral pathway alone can result in visual agnosia, an impairment in shape perception. Here, we explored the neural basis of shape processing in a patient with visual agnosia following a circumscribed right hemisphere ventral lesion and evaluated longitudinal changes in the neural profile of shape representations. The results revealed a reduction of shape sensitivity slopes along the patient's right ventral pathway and a similar reduction in the contralesional left ventral pathway. Remarkably, posterior parts of the dorsal pathway bilaterally also evinced a reduction in shape sensitivity. These findings were similar over a two-year interval, revealing that a focal cortical lesion can lead to persistent large-scale alterations of the two visual pathways. These alterations are consistent with the view that a distributed network of regions contributes to shape perception.

What Does Dorsal Cortex Contribute to Perception?

According to the influential "Two Visual Pathways" hypothesis, the cortical visual system is segregated into two pathways, with the ventral, occipitotemporal pathway subserving object perception, and the dorsal, occipitoparietal pathway subserving the visuomotor control of action. However, growing evidence suggests that the dorsal pathway also plays a functional role in object perception. In the current article, we present evidence that the dorsal pathway contributes uniquely to the perception of a range of visuospatial attributes that are not redundant with representations in ventral cortex. We describe how dorsal cortex is recruited automatically during perception, even when no explicit visuomotor response is required. Importantly, we propose that dorsal cortex may selectively process visual attributes that can inform the perception of potential actions on objects and environments, and we consider plausible developmental and cognitive mechanisms that might give rise to these representations. As such, we consider whether naturalistic stimuli, such as real-world solid objects, might engage dorsal cortex more so than simplified or artificial stimuli such as images that do not afford action, and how the use of suboptimal stimuli might limit our understanding of the functional contribution of dorsal cortex to visual perception.

Investigating face and house discrimination at foveal to parafoveal locations reveals category-specific characteristics

Since perceptual and neural face sensitivity is associated with a foveal bias, and neural place sensitivity is associated with a peripheral bias (integration over space), we hypothesized that face perception ability will decline more with eccentricity than place perception ability. We also wanted to examine whether face perception ability would show a left visual field (LeVF) bias due to earlier reports suggesting right hemisphere dominance for faces, or would show an upper or lower visual field bias. Participants performed foveal and parafoveal face and house discrimination tasks for upright or inverted stimuli (≤4°) while their eye movements were monitored. Low-level visual tasks were also measured. The eccentricity-related accuracy reductions were evident for all categories. Through detailed analyses we found (i) a robust face inversion effect across the parafovea, while for houses an opposite effect was found, (ii) higher eccentricity-related sensitivity for face performance than for house performance (via inverted vs. upright within-category eccentricity-driven reductions), (iii) within-category but not across-category performance associations across eccentricities, and (iv) no hemifield biases. Our central to parafoveal investigations suggest that high-level vision processing may be reflected in behavioural performance.

Differential sustained and transient temporal processing across visual streams

How do high-level visual regions process the temporal aspects of our visual experience? While the temporal sensitivity of early visual cortex has been studied with fMRI in humans, temporal processing in high-level visual cortex is largely unknown. By modeling neural responses with millisecond precision in separate sustained and transient channels, and introducing a flexible encoding framework that captures differences in neural temporal integration time windows and response nonlinearities, we predict fMRI responses across visual cortex for stimuli ranging from 33 ms to 20 s. Using this innovative approach, we discovered that lateral category-selective regions respond to visual transients associated with stimulus onsets and offsets but not sustained visual information. Thus, lateral category-selective regions compute moment-to-moment visual transitions, but not stable features of the visual input. In contrast, ventral category-selective regions process both sustained and transient components of the visual input. Our model revealed that sustained channel responses to prolonged stimuli exhibit adaptation, whereas transient channel responses to stimulus offsets are surprisingly larger than for stimulus onsets. This large offset transient response may reflect a memory trace of the stimulus when it is no longer visible, whereas the onset transient response may reflect rapid processing of new items. Together, these findings reveal previously unconsidered, fundamental temporal mechanisms that distinguish visual streams in the human brain. Importantly, our results underscore the promise of modeling brain responses with millisecond precision to understand the underlying neural computations.

How does the brain encode the timing of our visual experience? Using functional magnetic resonance imaging (fMRI) and a generative temporal model with millisecond resolution, we discovered that visual regions in the lateral and ventral processing streams fundamentally differ in their temporal processing of the visual input. Regions in lateral temporal cortex process visual transients associated with the beginning and ending of the stimulus, but not its stable aspects. That is, lateral regions appear to compute moment-to-moment changes in the visual input. In contrast, regions in ventral temporal cortex process both stable and transient components of the visual input, even as the response to the former exhibits adaptation. Surprisingly, the model predicts that in ventral regions responses to stimulus endings are larger than beginnings. We suggest that ending responses may reflect a memory trace of the stimulus, when it is no longer visible, and the beginning responses may reflect processing of new inputs. Together, these findings (i) reveal a fundamental temporal mechanism that distinguishes visual streams and (ii) highlight both the importance and utility of modeling brain responses with millisecond precision to understand the temporal dynamics of neural computations in the human brain.

Structural and effective brain connectivity underlying biological motion detection

The perception of actions underwrites a wide range of socio-cognitive functions. Previous neuroimaging and lesion studies identified several components of the brain network for visual biological motion (BM) processing, but interactions among these components and their relationship to behavior remain little understood. Here, using a recently developed integrative analysis of structural and effective connectivity derived from high angular resolution diffusion imaging (HARDI) and functional magnetic resonance imaging (fMRI), we assess the cerebro-cerebellar network for processing of camouflaged point-light BM. Dynamic causal modeling (DCM) informed by probabilistic tractography indicates that the right superior temporal sulcus (STS) serves as an integrator within the temporal module. However, the STS does not appear to be a "gatekeeper" in the functional integration of the occipito-temporal and frontal regions: The fusiform gyrus (FFG) and middle temporal cortex (MTC) are also connected to the right inferior frontal gyrus (IFG) and insula, indicating multiple parallel pathways. BM-specific loops of effective connectivity are seen between the left lateral cerebellar lobule Crus I and right STS, as well as between the left Crus I and right insula. The prevalence of a structural pathway between the FFG and STS is associated with better BM detection. Moreover, a canonical variate analysis shows that the visual sensitivity to BM is best predicted by BM-specific effective connectivity from the FFG to STS and from the IFG, insula, and STS to the early visual cortex. Overall, the study characterizes the architecture of the cerebro-cerebellar network for BM processing and offers prospects for assessing the social brain.

Cognitive estimation: Performance of patients with focal frontal and posterior lesions

The Cognitive Estimation Test (CET) is a widely used test to investigate estimation abilities requiring complex processes such as reasoning, the development and application of appropriate strategies, response plausibility checking as well as general knowledge and numeracy (e.g., Shallice and Evans, 1978; MacPherson et al., 2014). Thus far, it remains unknown whether the CET is both sensitive and specific to frontal lobe dysfunction. Neuroimaging techniques may not represent a useful methodology for answering this question since the complex processes involved are likely to be associated with a large network of brain regions, some of which are not functionally necessary to successfully carry out the CET. Instead, neuropsychological studies may represent a more promising investigation tool for identifying the brain areas necessary for CET performance. We recently developed two new versions of the CET (CET-A and CET-B; MacPherson et al., 2014). We investigated the overall performance and conducted an error analysis on CET-A in patients with focal, unilateral, frontal (n = 38) or posterior (n = 22) lesions and healthy controls (n = 39). We found that frontal patients' performance was impaired compared to healthy controls on CET. We also found that frontal patients generated significantly poorer estimates than posterior patients on CET-A. This could not be explained by impairments in fluid intelligence. The error analyses suggested that for CET-A, extreme and very extreme responses are impaired following frontal lobe damage. However, only very extreme responses are significantly more impaired following frontal lobe than posterior damage and so represent a measure restricted to frontal "executive" impairment, in addition to overall CET performance.

Attraction of posture and motion-trajectory elements of conspecific biological motion in medaka fish

Visual recognition of conspecifics is necessary for a wide range of social behaviours in many animals. Medaka (Japanese rice fish), a commonly used model organism, are known to be attracted by the biological motion of conspecifics. However, biological motion is a composite of both body-shape motion and entire-field motion trajectory (i.e., posture or motion-trajectory elements, respectively), and it has not been revealed which element mediates the attractiveness. Here, we show that either posture or motion-trajectory elements alone can attract medaka. We decomposed biological motion of the medaka into the two elements and synthesized visual stimuli that contain both, either, or none of the two elements. We found that medaka were attracted by visual stimuli that contain at least one of the two elements. In the context of other known static visual information regarding the medaka, the potential multiplicity of information regarding conspecific recognition has further accumulated. Our strategy of decomposing biological motion into these partial elements is applicable to other animals, and further studies using this technique will enhance the basic understanding of visual recognition of conspecifics.

The contribution of facial dynamics to subtle expression recognition in typical viewers and developmental visual agnosia

Facial expressions are inherently dynamic cues that develop and change over time, unfolding their affective signal. Although facial dynamics are assumed important for emotion recognition, testing often involves intense and stereotypical expressions and little is known about the role of temporal information in the recognition of subtle, non-stereotypical expressions. In Experiment 1 we demonstrate that facial dynamics are critical for recognizing subtle and non-stereotypical facial expressions, but not for recognizing intense and stereotypical displays of emotion. In Experiment 2 we further examined whether the facilitative effect of motion can lead to improved emotion recognition in LG, an individual with developmental visual agnosia and prosopagnosia, who has poor emotion recognition when tested with static facial expressions. LG's emotion recognition improved when subtle, non-stereotypical faces were dynamic rather than static. However, compared to controls, his relative gain from temporal information was diminished. Furthermore, LG's eye-tracking data demonstrated atypical visual scanning of the dynamic faces, consisting of longer fixations and lower fixation rates for the dynamic-subtle facial expressions, comparing to the dynamic-intense facial expressions. We suggest that deciphering subtle dynamic expressions strongly relies on integrating broad facial regions across time, rather than focusing on local emotional cues, skills which are impaired in developmental visual agnosia.

Heritable aspects of biological motion perception and its covariation with autistic traits

The ability to detect biological motion (BM) and decipher the meaning therein is essential to human survival and social interaction. However, at the individual level, we are not equally equipped with this ability. In particular, impaired BM perception and abnormal neural responses to BM have been observed in autism spectrum disorder (ASD), a highly heritable neurodevelopmental disorder characterized by devastating social deficits. Here, we examined the underlying sources of individual differences in two abilities fundamental to BM perception (i.e., the abilities to process local kinematic and global configurational information of BM) and explored whether BM perception shares a common genetic origin with autistic traits. Using the classical twin method, we found reliable genetic influences on BM perception and revealed a clear dissociation between its two components-whereas genes account for about 50% of the individual variation in local BM processing, global BM processing is largely shaped by environment. Critically, participants' sensitivity to local BM cues was negatively correlated with their autistic traits through the dimension of social communication, with the covariation largely mediated by shared genetic effects. These findings demonstrate that the ability to process BM, especially with regard to its inherent kinetics, is heritable. They also advance our understanding of the sources of the linkage between autistic symptoms and BM perception deficits, opening up the possibility of treating the ability to process local BM information as a distinct hallmark of social cognition.

Three-Dimensional Representations of Objects in Dorsal Cortex are Dissociable from Those in Ventral Cortex

An established conceptualization of visual cortical function is one in which ventral regions mediate object perception while dorsal regions support spatial information processing and visually guided action. This division has been contested by evidence showing that dorsal regions are also engaged in the representation of object shape, even when actions are not required. The critical question is whether these dorsal, object-based representations are dissociable from ventral representations, and whether they play a functional role in object recognition. We examined the neural and behavioral profile of patients with impairments in object recognition following ventral cortex damage. In a functional magnetic resonanace imaging experiment, the blood oxygen level-dependent response in the ventral, but not dorsal, cortex of the patients evinced less sensitivity to object 3D structure compared with that of healthy controls. Consistently, in psychophysics experiments, the patients exhibited significant impairments in object perception, but still revealed residual sensitivity to object-based structural information. Together, these findings suggest that, although in the intact system there is considerable crosstalk between dorsal and ventral cortices, object representations in dorsal cortex can be computed independently from those in ventral cortex. While dorsal representations alone are unable to support normal object perception, they can, nevertheless, support a coarse description of object structural information.

Natural Translating Locomotion Modulates Cortical Activity at Action Observation

The present study verified if the translational component of locomotion modulated cortical activity recorded at action observation. Previous studies focusing on visual processing of biological motion mainly presented point light walker that were fixed on a spot, thus removing the net translation toward a goal that yet remains a critical feature of locomotor behavior. We hypothesized that if biological motion recognition relies on the transformation of seeing in doing and its expected sensory consequences, a significant effect of translation compared to centered displays on sensorimotor cortical activity is expected. To this aim, we explored whether EEG activity in the theta (4–8 Hz), alpha (8–12 Hz), beta 1 (14–20 Hz) and beta 2 (20–32 Hz) frequency bands exhibited selectivity as participants viewed four types of stimuli: a centered walker, a centered scrambled, a translating walker and a translating scrambled. We found higher theta synchronizations for observed stimulus with familiar shape. Higher power decreases in the beta 1 and beta 2 bands, indicating a stronger motor resonance was elicited by translating compared to centered stimuli. Finally, beta bands modulation in Superior Parietal areas showed that the translational component of locomotion induced greater motor resonance than human shape. Using a Multinomial Logistic Regression classifier we found that Dorsal-Parietal and Inferior-Frontal regions of interest (ROIs), constituting the core of action-observation system, were the only areas capable to discriminate all the four conditions, as reflected by beta activities. Our findings suggest that the embodiment elicited by an observed scenario is strongly mediated by horizontal body displacement.

Action recognition is sensitive to the identity of the actor

Recognizing who is carrying out an action is essential for successful human interaction. The cognitive mechanisms underlying this ability are little understood and have been subject of discussions in embodied approaches to action recognition. Here we examine one solution, that visual action recognition processes are at least partly sensitive to the actor's identity. We investigated the dependency between identity information and action related processes by testing the sensitivity of neural action recognition processes to clothing and facial identity information with a behavioral adaptation paradigm. Our results show that action adaptation effects are in fact modulated by both clothing information and the actor's facial identity. The finding demonstrates that neural processes underlying action recognition are sensitive to identity information (including facial identity) and thereby not exclusively tuned to actions. We suggest that such response properties are useful to help humans in knowing who carried out an action.

Developmental visual perception deficits with no indications of prosopagnosia in a child with abnormal eye movements

Visual categories are associated with eccentricity biases in high-order visual cortex: Faces and reading with foveally-biased regions, while common objects and space with mid- and peripherally-biased regions. As face perception and reading are among the most challenging human visual skills, and are often regarded as the peak achievements of a distributed neural network supporting common objects perception, it is unclear why objects, which also rely on foveal vision to be processed, are associated with mid-peripheral rather than with a foveal bias. Here, we studied BN, a 9 y.o. boy who has normal basic-level vision, abnormal (limited) oculomotor pursuit and saccades, and shows developmental object and contour integration deficits but with no indication of prosopagnosia. Although we cannot infer causation from the data presented here, we suggest that normal pursuit and saccades could be critical for the development of contour integration and object perception. While faces and perhaps reading, when fixated upon, take up a small portion of central visual field and require only small eye movements to be properly processed, common objects typically prevail in mid-peripheral visual field and rely on longer-distance voluntary eye movements as saccades to be brought to fixation. While retinal information feeds into early visual cortex in an eccentricity orderly manner, we hypothesize that propagation of non-foveal information to mid and high-order visual cortex critically relies on circuitry involving eye movements. Limited or atypical eye movements, as in the case of BN, may hinder normal information flow to mid-eccentricity biased high-order visual cortex, adversely affecting its development and consequently inducing visual perceptual deficits predominantly for categories associated with these regions.

Visual motion serves but is not under the purview of the dorsal pathway

Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual motion tasks critically depend on the structural integrity of regions outside the dorsal pathway. Here, based on numerous studies, I propose that visual motion signals are swiftly transmitted via multiple non-hierarchical routes to primary motion-dedicated processing regions (MT/V5 and MST) that are not part of the dorsal pathway, and then propagated to a multiplicity of brain areas according to task demands, reaching these regions earlier than the dorsal/ventral hierarchical flow. This not only places MT/V5 at the same or even earlier visual processing stage as that of V1, but can also elucidate many findings with implications to visual awareness. While the integrity of the non-hierarchical motion pathway is necessary for all visual motion perception, it is insufficient on its own, and the transfer of visual motion signals to additional brain areas is crucial to allow the different motion perception tasks (e.g. optic flow, visuo-vestibular balance, movement observation, dynamic form detection and perception, and even reading). I argue that this lateral visual motion pathway can be distinguished from the dorsal pathway not only based on faster response latencies and distinct anatomical connections, but also based on its full field representation. I also distinguish between this primary lateral visual motion pathway sensitive to all motion in the visual field, and a much less investigated optic flow sensitive medial processing pathway (from V1 to V6 and V6A) that appears to be part of the dorsal pathway. Multiple additional predictions are provided that allow testing this proposal and distinguishing between the visual pathways.

Face-selective regions differ in their ability to classify facial expressions

Recognition of facial expressions is crucial for effective social interactions. Yet, the extent to which the various face-selective regions in the human brain classify different facial expressions remains unclear. We used functional magnetic resonance imaging (fMRI) and support vector machine pattern classification analysis to determine how well face-selective brain regions are able to decode different categories of facial expression. Subjects participated in a slow event-related fMRI experiment in which they were shown 32 face pictures, portraying four different expressions: neutral, fearful, angry, and happy and belonging to eight different identities. Our results showed that only the amygdala and the posterior superior temporal sulcus (STS) were able to accurately discriminate between these expressions, albeit in different ways: the amygdala discriminated fearful faces from non-fearful faces, whereas STS discriminated neutral from emotional (fearful, angry and happy) faces. In contrast to these findings on the classification of emotional expression, only the fusiform face area (FFA) and anterior inferior temporal cortex (aIT) could discriminate among the various facial identities. Further, the amygdala and STS were better than FFA and aIT at classifying expression, while FFA and aIT were better than the amygdala and STS at classifying identity. Taken together, our findings indicate that the decoding of facial emotion and facial identity occurs in different neural substrates: the amygdala and STS for the former and FFA and aIT for the latter.

TMS reveals flexible use of form and motion cues in biological motion perception

The perception of human movement is a key component of daily social interactions. Although extrastriate area MT+/V5 is closely associated with motion processing, its role in the processing of sparse 'biological motion' displays is still unclear. We developed two closed matched psychophysical tasks to assess simple coherent motion perception and biological motion perception, and measured changes in performance caused by application of TMS over MT+/V5. Performance of the simple motion discrimination task was significantly depressed by TMS stimulation, and highly correlated within observers in TMS conditions, but there was no significant decrement in performance of the biological motion task, despite low intra-observer correlations across TMS conditions. We conclude that extrastriate area MT+/V5 is an obligatory waypoint in the neural processing of simple coherent motion, but is not obligatory for the processing of biological motion. Results are consistent with a dual neural processing route for biological motion processing.

A comparison of form processing involved in the perception of biological and nonbiological movements

Although there is evidence for specialization in the human brain for processing biological motion per se, few studies have directly examined the specialization of form processing in biological motion perception. The current study was designed to systematically compare form processing in perception of biological (human walkers) to nonbiological (rotating squares) stimuli. Dynamic form-based stimuli were constructed with conflicting form cues (position and orientation), such that the objects were perceived to be moving ambiguously in two directions at once. In Experiment 1, we used the classification image technique to examine how local form cues are integrated across space and time in a bottom-up manner. By comparing with a Bayesian observer model that embodies generic principles of form analysis (e.g., template matching) and integrates form information according to cue reliability, we found that human observers employ domain-general processes to recognize both human actions and nonbiological object movements. Experiments 2 and 3 found differential top-down effects of spatial context on perception of biological and nonbiological forms. When a background does not involve social information, observers are biased to perceive foreground object movements in the direction opposite to surrounding motion. However, when a background involves social cues, such as a crowd of similar objects, perception is biased toward the same direction as the crowd for biological walking stimuli, but not for rotating nonbiological stimuli. The model provided an accurate account of top-down modulations by adjusting the prior probabilities associated with the internal templates, demonstrating the power and flexibility of the Bayesian approach for visual form perception.

A new technique for generating disordered point-light animations for the study of biological motion perception

Studies of biological motion perception often use stimuli depicting human actions portrayed via point-light (PL) displays. Typically, counterpart, or control, stimuli for PL biological motion are created by spatially scrambling motion trajectories of individual PL dots. Depending on the purpose of the study, however, this procedure may be inappropriate as a foil for genuine PL animations, because spatial scrambling not only disrupts coherent motion activity but also eliminates pair-wise motion relationships among dots and, unless corrected, alters the spatial spread of PL dot motions. We introduce a new technique for producing perturbed PL animations, called pair-wise shuffled motion, that preserves the elementary features of biological motion in spatial and motion energy domains and only disrupts the specific sense of global, coherent perception of biological motion. First we describe the procedure for creating pair-wise shuffled motion sequences. Next we compare unperturbed PL animations to pair-wise shuffled motion, to spatially scrambled motion, and to spatially constrained scrambled motion in terms of spatial distributions of the dots, spatiotemporal amplitude spectra derived from Fourier analysis of those sequences, and space-time motion energy associated with those perturbed animations. We then show that the results from those analyses generalize to a large family of PL animations, including the widely used PL walker. Finally we present results from a two-interval forced-choice biological-motion discrimination experiment comparing the robustness of scrambled and pair-wise shuffled motions as foil stimuli. Results from these comparisons suggest that pair-wise shuffled motion offers advantages as a foil stimulus compared to foils using the conventional scrambling technique. Pair-wise shuffled motion provides an additional, effective control display for evaluating PL biological motion perception in future psychophysical, computational, and imaging studies that focus on mechanisms of processing spatiotemporal information signifying biological motion within PL displays.

Perception of biological motion from size-invariant body representations

The visual recognition of action is one of the socially most important and computationally demanding capacities of the human visual system. It combines visual shape recognition with complex non-rigid motion perception. Action presented as a point-light animation is a striking visual experience for anyone who sees it for the first time. Information about the shape and posture of the human body is sparse in point-light animations, but it is essential for action recognition. In the posturo-temporal filter model of biological motion perception posture information is picked up by visual neurons tuned to the form of the human body before body motion is calculated. We tested whether point-light stimuli are processed through posture recognition of the human body form by using a typical feature of form recognition, namely size invariance. We constructed a point-light stimulus that can only be perceived through a size-invariant mechanism. This stimulus changes rapidly in size from one image to the next. It thus disrupts continuity of early visuo-spatial properties but maintains continuity of the body posture representation. Despite this massive manipulation at the visuo-spatial level, size-changing point-light figures are spontaneously recognized by naive observers, and support discrimination of human body motion.