Spatial and temporal frequency selectivity of neurons in the middle temporal visual area of new world monkeys (Callithrix jacchus)

A phase-shifting anterior-posterior network organizes global phase relations

Prior research has identified a variety of task-dependent networks that form through inter-regional phase-locking of oscillatory activity that are neural correlates of specific behaviors. Despite ample knowledge of task-specific functional networks, general rules governing global phase relations have not been investigated. To discover such general rules, we focused on phase modularity, measured as the degree to which global phase relations in EEG comprised distinct synchronized clusters interacting with one another at large phase lags. Synchronized clusters were detected with a standard community-detection algorithm, and the degree of phase modularity was quantified by the index q. Notably, we found that the mechanism controlling phase modularity is remarkably simple. A network comprising anterior-posterior long-distance connectivity coherently shifted phase relations from low-angles (|Δθ| < π/4) in low-modularity states (bottom 5% in q) to high-angles (|Δθ| > 3π/4) in high-modularity states (top 5% in q), accounting for fluctuations in phase modularity. This anterior-posterior network may play a fundamental functional role as (1) it controls phase modularity across a broad range of frequencies (3-50 Hz examined) in different behavioral conditions (resting with the eyes closed or watching a silent nature video) and (2) neural interactions (measured as power correlations) in beta-to-gamma bands were consistently elevated in high-modularity states. These results may motivate future investigations into the functional roles of phase modularity as well as the anterior-posterior network that controls it.

Competing Visual Cues Revealed by Electroencephalography: Sensitivity to Motion Speed and Direction

Motion speed and direction are two fundamental cues for the mammalian visual system. Neurons in various places of the neocortex show tuning properties in term of firing frequency to both speed and direction. The present study applied a 32-channel electroencephalograph (EEG) system to 13 human subjects while they were observing a single object moving with different speeds in various directions from the center of view to the periphery on a computer monitor. Depending on the experimental condition, the subjects were either required to fix their gaze at the center of the monitor while the object was moving or to track the movement with their gaze; eye-tracking glasses were used to ensure that they followed instructions. In each trial, motion speed and direction varied randomly and independently, forming two competing visual features. EEG signal classification was performed for each cue separately (e.g., 11 speed values or 11 directions), regardless of variations in the other cue. Under the eye-fixed condition, multiple subjects showed distinct preferences to motion direction over speed; however, two outliers showed superb sensitivity to speed. Under the eye-tracking condition, in which the EEG signals presumably contained ocular movement signals, all subjects showed predominantly better classification for motion direction. There was a trend that speed and direction were encoded by different electrode sites. Since EEG is a noninvasive and portable approach suitable for brain-computer interfaces (BCIs), this study provides insights on fundamental knowledge of the visual system as well as BCI applications based on visual stimulation.

Ocular following responses of the marmoset monkey are dependent on postsaccadic delay, spatiotemporal frequency, and saccade direction

Ocular following is a short-latency, reflexive eye movement that tracks wide-field visual motion. It has been studied extensively in humans and macaques and is an appealing behavior for studying sensory-motor transformations in the brain because of its rapidity and rigidity. We explored ocular following in the marmoset, an emerging model in neuroscience because their lissencephalic brain allows direct access to most cortical areas for imaging and electrophysiological recordings. In three experiments, we tested ocular following responses in three adult marmosets. First, we varied the delay between saccade end and stimulus motion onset, from 10 to 300 ms. As in other species, tracking had shorter onset latencies and higher eye speeds with shorter postsaccadic delays. Second, using sine-wave grating stimuli, we explored the dependence of eye speed on spatiotemporal frequency. The highest eye speed was evoked at ∼16 Hz and ∼0.16 cycles per degree (cpd); however, the highest gain was elicited at ∼1.6 Hz and ∼1.2 cpd. The highest eye speed for each spatial frequency was observed at a different temporal frequency, but this interdependence was not consistent with complete speed tuning of the ocular following response. Finally, we found the highest eye speeds when saccade and stimulus motion directions were identical, although latencies were unaffected by direction difference. Our results showed qualitatively similar ocular following in marmosets, humans, and macaques, despite over an order of magnitude variation in body and eye size across species. This characterization will help future studies examining the neural basis of sensory-motor transformations.NEW & NOTEWORTHY Previous ocular following studies focused on humans and macaques. We examined the properties of ocular following responses in marmosets in three experiments, in which postsaccadic delay, spatial-temporal frequency of stimuli, and congruence of saccade and motion directions were manipulated. We have demonstrated short-latency ocular following in marmosets and discuss the similarities across three species that vary markedly in eye and head size. Our findings will help future studies examining the neural mechanism of sensory-motor transformations.

Mechanisms of speed encoding in the human middle temporal cortex measured by 7T fMRI

Perception of dynamic scenes in our environment results from the evaluation of visual features such as the fundamental spatial and temporal frequency components of a moving object. The ratio between these two components represents the object's speed of motion. The human middle temporal cortex hMT+ has a crucial biological role in the direct encoding of object speed. However, the link between hMT+ speed encoding and the spatiotemporal frequency components of a moving object is still under explored. Here, we recorded high resolution 7T blood oxygen level-dependent BOLD responses to different visual motion stimuli as a function of their fundamental spatial and temporal frequency components. We fitted each hMT+ BOLD response with a 2D Gaussian model allowing for two different speed encoding mechanisms: (1) distinct and independent selectivity for the spatial and temporal frequencies of the visual motion stimuli; (2) pure tuning for the speed of motion. We show that both mechanisms occur but in different neuronal groups within hMT+, with the largest subregion of the complex showing separable tuning for the spatial and temporal frequency of the visual stimuli. Both mechanisms were highly reproducible within participants, reconciling single cell recordings from MT in animals that have showed both encoding mechanisms. Our findings confirm that a more complex process is involved in the perception of speed than initially thought and suggest that hMT+ plays a primary role in the evaluation of the spatial features of the moving visual input.

Functional Segregation within the Dorsal Frontoparietal Network: A Multimodal Dynamic Causal Modeling Study

Discrimination and integration of motion direction requires the interplay of multiple brain areas. Theoretical accounts of perception suggest that stimulus-related (i.e., exogenous) and decision-related (i.e., endogenous) factors affect distributed neuronal processing at different levels of the visual hierarchy. To test these predictions, we measured brain activity of healthy participants during a motion discrimination task, using electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). We independently modeled the impact of exogenous factors (task demand) and endogenous factors (perceptual decision-making) on the activity of the motion discrimination network and applied Dynamic Causal Modeling (DCM) to both modalities. DCM for event-related potentials (DCM-ERP) revealed that task demand impacted the reciprocal connections between the primary visual cortex (V1) and medial temporal areas (V5). With practice, higher visual areas were increasingly involved, as revealed by DCM-fMRI. Perceptual decision-making modulated higher levels (e.g., V5-to-Frontal Eye Fields, FEF), in a manner predictive of performance. Our data suggest that lower levels of the visual network support early, feature-based selection of responses, especially when learning strategies have not been implemented. In contrast, perceptual decision-making operates at higher levels of the visual hierarchy by integrating sensory information with the internal state of the subject.

Spatiotemporal dynamics of maximal and minimal EEG spectral power

Oscillatory neural activities are prevalent in the brain with their phase realignment contributing to the coordination of neural communication. Phase realignments may have especially strong (or weak) impact when neural activities are strongly synchronized (or desynchronized) within the interacting populations. We report that the spatiotemporal dynamics of strong regional synchronization measured as maximal EEG spectral power-referred to as activation-and strong regional desynchronization measured as minimal EEG spectral power-referred to as suppression-are characterized by the spatial segregation of small-scale and large-scale networks. Specifically, small-scale spectral-power activations and suppressions involving only 2-7% (1-4 of 60) of EEG scalp sites were prolonged (relative to stochastic dynamics) and consistently co-localized in a frequency specific manner. For example, the small-scale networks for θ, α, β1, and β2 bands (4-30 Hz) consistently included frontal sites when the eyes were closed, whereas the small-scale network for γ band (31-55 Hz) consistently clustered in medial-central-posterior sites whether the eyes were open or closed. Large-scale activations and suppressions involving over 17-30% (10-18 of 60) of EEG sites were also prolonged and generally clustered in regions complementary to where small-scale activations and suppressions clustered. In contrast, intermediate-scale activations and suppressions (involving 7-17% of EEG sites) tended to follow stochastic dynamics and were less consistently localized. These results suggest that strong synchronizations and desynchronizations tend to occur in small-scale and large-scale networks that are spatially segregated and frequency specific. These synchronization networks may broadly segregate the relatively independent and highly cooperative oscillatory processes while phase realignments fine-tune the network configurations based on behavioral demands.

Probabilistic, entropy-maximizing control of large-scale neural synchronization

Oscillatory neural activity is dynamically controlled to coordinate perceptual, attentional and cognitive processes. On the macroscopic scale, this control is reflected in the U-shaped deviations of EEG spectral-power dynamics from stochastic dynamics, characterized by disproportionately elevated occurrences of the lowest and highest ranges of power. To understand the mechanisms that generate these low- and high-power states, we fit a simple mathematical model of synchronization of oscillatory activity to human EEG data. The results consistently indicated that the majority (~95%) of synchronization dynamics is controlled by slowly adjusting the probability of synchronization while maintaining maximum entropy within the timescale of a few seconds. This strategy appears to be universal as the results generalized across oscillation frequencies, EEG current sources, and participants (N = 52) whether they rested with their eyes closed, rested with their eyes open in a darkened room, or viewed a silent nature video. Given that precisely coordinated behavior requires tightly controlled oscillatory dynamics, the current results suggest that the large-scale spatial synchronization of oscillatory activity is controlled by the relatively slow, entropy-maximizing adjustments of synchronization probability (demonstrated here) in combination with temporally precise phase adjustments (e.g., phase resetting generated by sensorimotor interactions). Interestingly, we observed a modest but consistent spatial pattern of deviations from the maximum-entropy rule, potentially suggesting that the mid-central-posterior region serves as an "entropy dump" to facilitate the temporally precise control of spectral-power dynamics in the surrounding regions.

Visual response characteristics of neurons in the second visual area of marmosets

The physiological characteristics of the marmoset second visual area (V2) are poorly understood compared with those of the primary visual area (V1). In this study, we observed the physiological response characteristics of V2 neurons in four healthy adult marmosets using intracortical tungsten microelectrodes. We recorded 110 neurons in area V2, with receptive fields located between 8° and 15° eccentricity. Most (88.2%) of these neurons were orientation selective, with half-bandwidths typically ranging between 10° and 30°. A significant proportion of neurons (28.2%) with direction selectivity had a direction index greater than 0.5. The vast majority of V2 neurons had separable spatial frequency and temporal frequency curves and, according to this criterion, they were not speed selective. The basic functional response characteristics of neurons in area V2 resemble those found in area V1. Our findings show that area V2 together with V1 are important in primate visual processing, especially in locating objects in space and in detecting an object’s direction of motion. The methods used in this study were approved by the Monash University Animal Ethics Committee, Australia (MARP 2009-2011) in 2009.

Rhythm Violation Enhances Auditory-Evoked Responses to the Extent of Overriding Sensory Adaptation in Passive Listening

Sensory systems utilize temporal structure in the environment to build expectations about the timing of forthcoming events. We investigated the effects of rhythm-based temporal expectation on auditory responses measured with EEG recorded from the frontocentral sites implicated in auditory processing. By manipulating temporal expectation and the interonset interval (IOI) of tones, we examined how neural responses adapted to auditory rhythm and reacted to stimuli that violated the rhythm. Participants passively listened to the tones while watching a silent nature video. In Experiment 1 (n = 22), in the long-IOI block, tones were frequently presented (80%) with 1.7-sec IOI and infrequently presented (20%) with 1.2-sec IOI, generating unexpectedly early tones that violated temporal expectation. Conversely, in the short-IOI block, tones were frequently presented with 1.2-sec IOI and infrequently presented with 1.7-sec IOI, generating late tones. We analyzed the tone-evoked N1-P2 amplitude of ERPs and intertrial phase clustering in the theta-alpha band. The results provided evidence of strong delay-dependent adaptation effects (short-term, sensitive to IOI), weak cumulative adaptation effects (long-term, driven by tone repetition over time), and robust temporal-expectation violation effects over and above the adaptation effects. Experiment 2 (n = 22) repeated Experiment 1 with shorter IOIs of 1.2 and 0.7 sec. Overall, we found evidence of strong delay-dependent adaptation effects, weak cumulative adaptation effects (which may most efficiently accumulate at the tone presentation rate of ∼1 Hz), and robust temporal-expectation violation effects that substantially boost auditory responses to the extent of overriding the delay-dependent adaptation effects likely through mechanisms involved in exogenous attention.

Spectral-power associations reflect amplitude modulation and within-frequency interactions on the sub-second timescale and cross-frequency interactions on the seconds timescale

We investigated the global structure of intrinsic cross-frequency dynamics by systematically examining power-based temporal associations among a broad range of oscillation frequencies both within and across EEG-based current sources (sites). We focused on power-based associations that could reveal unique timescale dependence independently of interacting frequencies. Large spectral-power fluctuations across all sites occurred at two characteristic timescales, sub-second and seconds, yielding distinct patterns of cross-frequency associations. On the fast sub-second timescale, within-site (local) associations were consistently between pairs of β—γ frequencies differing by a constant Δf (particularly Δf ~ 10 Hz at posterior sites and Δf ~ 16 Hz at lateral sites) suggesting that higher-frequency oscillations are organized into Δf amplitude-modulated packets, whereas cross-site (long-distance) associations were all within-frequency (particularly in the >30 Hz and 6–12 Hz ranges, suggestive of feedforward and feedback interactions). On the slower seconds timescale, within-site (local) associations were characterized by a broad range of frequencies selectively associated with ~10 Hz at posterior sites and associations among higher (>20 Hz) frequencies at lateral sites, whereas cross-site (long-distance) associations were characterized by a broad range of frequencies at posterior sites selectively associated with ~10 Hz at other sites, associations among higher (>20 Hz) frequencies among lateral and anterior sites, and prevalent associations at ~10 Hz. Regardless of timescale, within-site (local) cross-frequency associations were weak at anterior sites indicative of frequency-specific operations. Overall, these results suggest that the fast sub-second-timescale coordination of spectral power is limited to local amplitude modulation and insulated within-frequency long-distance interactions (likely feedforward and feedback interactions), while characteristic patterns of cross-frequency interactions emerge on the slower seconds timescale. The results also suggest that the occipital α oscillations play a role in organizing higher-frequency oscillations into ~10 Hz amplitude-modulated packets to communicate with other regions. Functional implications of these timescale-dependent cross-frequency associations await future investigations.

Short-latency ocular-following responses: Weighted nonlinear summation predicts the outcome of a competition between two sine wave gratings moving in opposite directions

We recorded horizontal ocular-following responses to pairs of superimposed vertical sine wave gratings moving in opposite directions in human subjects. This configuration elicits a nonlinear interaction: when the relative contrast of the gratings is changed, the response transitions abruptly between the responses elicited by either grating alone. We explore this interaction in pairs of gratings that differ in spatial and temporal frequency and show that all cases can be described as a weighted sum of the responses to each grating presented alone, where the weights are a nonlinear function of stimulus contrast: a nonlinear weighed summation model. The weights depended on the spatial and temporal frequency of the component grating. In many cases the dominant component was not the one that produced the strongest response when presented alone, implying that the neuronal circuits assigning weights precede the stages at which motor responses to visual motion are generated. When the stimulus area was reduced, the relationship between spatial frequency and weight shifted to higher frequencies. This finding may reflect a contribution from surround suppression. The nonlinear interaction is strongest when the two components have similar spatial frequencies, suggesting that the nonlinearity may reflect interactions within single spatial frequency channels. This framework can be extended to stimuli composed of more than two components: our model was able to predict the responses to stimuli composed of three gratings. That this relatively simple model successfully captures the ocular-following responses over a wide range of spatial/temporal frequency and contrast parameters suggests that these interactions reflect a simple mechanism.

Neural, functional, and aesthetic impacts of spatially heterogeneous flicker: A potential role of natural flicker

Spatially heterogeneous flicker, characterized by probabilistic and locally independent luminance modulations, abounds in nature. It is generated by flames, water surfaces, rustling leaves, and so on, and it is pleasant to the senses. It affords spatiotemporal multistability that allows sensory activation conforming to the biases of the visual system, thereby generating the perception of spontaneous motion and likely facilitating the calibration of motion detectors. One may thus hypothesize that spatially heterogeneous flicker might potentially provide restoring stimuli to the visual system that engage fluent (requiring minimal top-down control) and self-calibrating processes. Here, we present some converging behavioral and electrophysiological evidence consistent with this idea. Spatially heterogeneous (multistable) flicker (relative to controls matched in temporal statistics) reduced posterior EEG (electroencephalography) beta power implicated in long-range neural interactions that impose top-down influences on sensory processing. Further, the degree of spatiotemporal multistability, the amount of posterior beta-power reduction, and the aesthetic responses to flicker were closely associated. These results are consistent with the idea that the pleasantness of natural flicker may derive from its spatiotemporal multistability that affords fluent and self-calibrating visual processing.

Spatial Frequency Tuning and Transfer of Perceptual Learning for Motion Coherence Reflects the Tuning Properties of Global Motion Processing

Perceptual learning is typically highly specific to the stimuli and task used during training. However, recently, it has been shown that training on global motion can transfer to untrained tasks, reflecting the generalising properties of mechanisms at this level of processing. We investigated (i) if feedback was required for learning in a motion coherence task, (ii) the transfer across the spatial frequency of training on a global motion coherence task and (iii) the transfer of this training to a measure of contrast sensitivity. For our first experiment, two groups, with and without feedback, trained for ten days on a broadband motion coherence task. Results indicated that feedback was a requirement for robust learning. For the second experiment, training consisted of five days of direction discrimination using one of three motion coherence stimuli (where individual elements were comprised of either broadband Gaussian blobs or low- or high-frequency random-dot Gabor patches), with trial-by-trial auditory feedback. A pre- and post-training assessment was conducted for each of the three types of global motion coherence conditions and high and low spatial frequency contrast sensitivity (both without feedback). Our training paradigm was successful at eliciting improvement in the trained tasks over the five days. Post-training assessments found evidence of transfer for the motion coherence task exclusively for the group trained on low spatial frequency elements. For the contrast sensitivity tasks, improved performance was observed for low- and high-frequency stimuli, following motion coherence training with broadband stimuli, and for low-frequency stimuli, following low-frequency training. Our findings are consistent with perceptual learning, which depends on the global stage of motion processing in higher cortical areas, which is broadly tuned for spatial frequency, with a preference for low frequencies.

Weighting neurons by selectivity produces near-optimal population codes

Perception is produced by "reading out" the representation of a sensory stimulus contained in the activity of a population of neurons. To examine experimentally how populations code information, a common approach is to decode a linearly weighted sum of the neurons' spike counts. This approach is popular because of the biological plausibility of weighted, nonlinear integration. For neurons recorded in vivo, weights are highly variable when derived through optimization methods, but it is unclear how the variability affects decoding performance in practice. To address this, we recorded from neurons in the middle temporal area (MT) of anesthetized marmosets (Callithrix jacchus) viewing stimuli comprising a sheet of dots that moved coherently in 1 of 12 different directions. We found that high peak response and direction selectivity both predicted that a neuron would be weighted more highly in an optimized decoding model. Although learned weights differed markedly from weights chosen according to a priori rules based on a neuron's tuning profile, decoding performance was only marginally better for the learned weights. In the models with a priori rules, selectivity is the best predictor of weighting, and defining weights according to a neuron's preferred direction and selectivity improves decoding performance to very near the maximum level possible, as defined by the learned weights. NEW & NOTEWORTHY We examined which aspects of a neuron's tuning account for its contribution to sensory coding. Strongly direction-selective neurons are weighted most highly by optimal decoders trained to discriminate motion direction. Models with predefined decoding weights demonstrate that this weighting scheme causally improved direction representation by a neuronal population. Optimizing decoders (using a generalized linear model or Fisher's linear discriminant) led to only marginally better performance than decoders based purely on a neuron's preferred direction and selectivity.

Auditory motion does not modulate spiking activity in the middle temporal and medial superior temporal visual areas

The integration of multiple sensory modalities is a key aspect of brain function, allowing animals to take advantage of concurrent sources of information to make more accurate perceptual judgments. For many years, multisensory integration in the cerebral cortex was deemed to occur only in high-level "polysensory" association areas. However, more recent studies have suggested that cross-modal stimulation can also influence neural activity in areas traditionally considered to be unimodal. In particular, several human neuroimaging studies have reported that extrastriate areas involved in visual motion perception are also activated by auditory motion, and may integrate audiovisual motion cues. However, the exact nature and extent of the effects of auditory motion on the visual cortex have not been studied at the single neuron level. We recorded the spiking activity of neurons in the middle temporal (MT) and medial superior temporal (MST) areas of anesthetized marmoset monkeys upon presentation of unimodal stimuli (moving auditory or visual patterns), as well as bimodal stimuli (concurrent audiovisual motion). Despite robust, direction selective responses to visual motion, none of the sampled neurons responded to auditory motion stimuli. Moreover, concurrent moving auditory stimuli had no significant effect on the ability of single MT and MST neurons, or populations of simultaneously recorded neurons, to discriminate the direction of motion of visual stimuli (moving random dot patterns with varying levels of motion noise). Our findings do not support the hypothesis that direct interactions between MT, MST and areas low in the hierarchy of auditory areas underlie audiovisual motion integration.

Novel method of extracting motion from natural movies

BACKGROUND

The visual system in primates can be segregated into motion and shape pathways. Interaction occurs at multiple stages along these pathways. Processing of shape-from-motion and biological motion is considered to be a higher-order integration process involving motion and shape information. However, relatively limited types of stimuli have been used in previous studies on these integration processes.

NEW METHOD

We propose a new algorithm to extract object motion information from natural movies and to move random dots in accordance with the information. The object motion information is extracted by estimating the dynamics of local normal vectors of the image intensity projected onto the x-y plane of the movie.

RESULTS

An electrophysiological experiment on two adult common marmoset monkeys (Callithrix jacchus) showed that the natural and random dot movies generated with this new algorithm yielded comparable neural responses in the middle temporal visual area.

COMPARISON WITH EXISTING METHODS

In principle, this algorithm provided random dot motion stimuli containing shape information for arbitrary natural movies. This new method is expected to expand the neurophysiological and psychophysical experimental protocols to elucidate the integration processing of motion and shape information in biological systems.

CONCLUSIONS

The novel algorithm proposed here was effective in extracting object motion information from natural movies and provided new motion stimuli to investigate higher-order motion information processing.

Readers select a comprehension mode independent of pronoun: Evidence from fMRI during narrative comprehension

Perspective is a crucial feature for communicating about events. Yet it is unclear how linguistically encoded perspective relates to cognitive perspective taking. Here, we tested the effect of perspective taking with short literary stories. Participants listened to stories with 1st or 3rd person pronouns referring to the protagonist, while undergoing fMRI. When comparing action events with 1st and 3rd person pronouns, we found no evidence for a neural dissociation depending on the pronoun. A split sample approach based on the self-reported experience of perspective taking revealed 3 comprehension preferences. One group showed a strong 1st person preference, another a strong 3rd person preference, while a third group engaged in 1st and 3rd person perspective taking simultaneously. Comparing brain activations of the groups revealed different neural networks. Our results suggest that comprehension is perspective dependent, but not on the perspective suggested by the text, but on the reader's (situational) preference.

Sensitivity of neurons in the middle temporal area of marmoset monkeys to random dot motion

Neurons in the middle temporal area (MT) of the primate cerebral cortex respond to moving visual stimuli. The sensitivity of MT neurons to motion signals can be characterized by using random-dot stimuli, in which the strength of the motion signal is manipulated by adding different levels of noise (elements that move in random directions). In macaques, this has allowed the calculation of "neurometric" thresholds. We characterized the responses of MT neurons in sufentanil/nitrous oxide-anesthetized marmoset monkeys, a species that has attracted considerable recent interest as an animal model for vision research. We found that MT neurons show a wide range of neurometric thresholds and that the responses of the most sensitive neurons could account for the behavioral performance of macaques and humans. We also investigated factors that contributed to the wide range of observed thresholds. The difference in firing rate between responses to motion in the preferred and null directions was the most effective predictor of neurometric threshold, whereas the direction tuning bandwidth had no correlation with the threshold. We also showed that it is possible to obtain reliable estimates of neurometric thresholds using stimuli that were not highly optimized for each neuron, as is often necessary when recording from large populations of neurons with different receptive field concurrently, as was the case in this study. These results demonstrate that marmoset MT shows an essential physiological similarity to macaque MT and suggest that its neurons are capable of representing motion signals that allow for comparable motion-in-noise judgments.NEW & NOTEWORTHY We report the activity of neurons in marmoset MT in response to random-dot motion stimuli of varying coherence. The information carried by individual MT neurons was comparable to that of the macaque, and the maximum firing rates were a strong predictor of sensitivity. Our study provides key information regarding the neural basis of motion perception in the marmoset, a small primate species that is becoming increasingly popular as an experimental model.

Spectral Signatures of Feedforward and Recurrent Circuitry in Monkey Area MT

Recordings of local field potential (LFP) in the visual cortex can show rhythmic activity at gamma frequencies (30-100 Hz). While the gamma rhythms in the primary visual cortex have been well studied, the structural and functional characteristics of gamma rhythms in extrastriate visual cortex are less clear. Here, we studied the spatial distribution and functional specificity of gamma rhythms in extrastriate middle temporal (MT) area of visual cortex in marmoset monkeys. We found that moving gratings induced narrowband gamma rhythms across cortical layers that were coherent across much of area MT. Moving dot fields instead induced a broadband increase in LFP in middle and upper layers, with weaker narrowband gamma rhythms in deeper layers. The stimulus dependence of LFP response in middle and upper layers of area MT appears to reflect the presence (gratings) or absence (dot fields and other textures) of strongly oriented contours. Our results suggest that gamma rhythms in these layers are propagated from earlier visual cortex, while those in the deeper layers may emerge in area MT.

Correspondence between fMRI and electrophysiology during visual motion processing in human MT

Changes in brain neuronal activity are reflected by hemodynamic responses mapped through Blood Oxygenation Level Dependent (BOLD) functional magnetic resonance imaging (fMRI), a primary tool to measure brain functioning non-invasively. However, the exact relationship between hemodynamics and neuronal function is still a matter of debate. Here, we combine 3T BOLD fMRI and High Frequency Band (HFB) electrocorticography (ECoG) signals to investigate the relationship between neuronal activity and hemodynamic responses in the human Middle Temporal complex (hMT+), a higher order brain area involved in visual motion processing. We modulated the ECoG HFB and fMRI BOLD responses with a visual stimulus moving at different temporal frequencies, and compared measured BOLD responses to estimated BOLD responses that were predicted from the temporal profile of the HFB power change. We show that BOLD responses under an electrode over hMT+ can be well predicted not only be the strength of the neuronal response but also by the temporal profile of the HFB responses recorded by this electrode. Our results point to a linear relationship between BOLD and neuronal activity in hMT+, extending previous findings on primary cortex to higher order cortex.

Separate spatial and temporal frequency tuning to visual motion in human MT+ measured with ECoG

The human middle temporal complex (hMT+) has a crucial biological relevance for the processing and detection of direction and speed of motion in visual stimuli. Here, we characterized how neuronal populations in hMT+ encode the speed of moving visual stimuli. We evaluated human intracranial electrocorticography (ECoG) responses elicited by square-wave dartboard moving stimuli with different spatial and temporal frequency to investigate whether hMT+ neuronal populations encode the stimulus speed directly, or whether they separate motion into its spatial and temporal components. We extracted two components from the ECoG responses: (1) the power in the high-frequency band (HFB: 65-95 Hz) as a measure of the neuronal population spiking activity and (2) a specific spectral component that followed the frequency of the stimulus's contrast reversals (SCR responses). Our results revealed that HFB neuronal population responses to visual motion stimuli exhibit distinct and independent selectivity for spatial and temporal frequencies of the visual stimuli rather than direct speed tuning. The SCR responses did not encode the speed or the spatiotemporal frequency of the visual stimuli. We conclude that the neuronal populations measured in hMT+ are not directly tuned to stimulus speed, but instead encode speed through separate and independent spatial and temporal frequency tuning. Hum Brain Mapp 38:293-307, 2017. © 2016 Wiley Periodicals, Inc.

Differences in spatial and temporal frequency interactions between central and peripheral parts of the feline area 18

The visual system demonstrates significant differences in information processing abilities between the central and peripheral parts of the visual field. Optical imaging based on intrinsic signals was used to investigate the difference in stimulus spatial and temporal frequency interactions related to receptive field eccentricity in the cat area 18. Changing either the spatial or the temporal frequency of grating stimuli had a significant impact on responses in the cortical areas corresponding to the centre of the visual field and more peripheral parts at 10 degrees eccentricity. The cortical region corresponding to the centre of the gaze was tuned to 0.4 cycles per degree (c/deg) for spatial frequency and 2 Hz for temporal frequency. In contrast, the cortical region corresponding to the periphery of the visual field was tuned to a lower spatial frequency of 0.15 c/deg and a higher temporal frequency of 4 Hz. Interestingly, when we simultaneously changed both the spatial frequency and the temporal frequency of the grating stimuli, the responses were significantly different from those estimated with an assumption of independence between the spatial and temporal frequency in the cortical region corresponding to the periphery of the visual field. However, in the cortical area corresponding to the centre of the gaze, spatial frequency showed significant independence from temporal frequency. These properties support the notion of relative specialization of visual information processing for peripheral representations in cortical areas.

Neural plasticity following lesions of the primate occipital lobe: The marmoset as an animal model for studies of blindsight

For nearly a century it has been observed that some residual visually guided behavior can persist after damage to the primary visual cortex (V1) in primates. The age at which damage to V1 occurs leads to different outcomes, with V1 lesions in infancy allowing better preservation of visual faculties in comparison with those incurred in adulthood. While adult V1 lesions may still allow retention of some limited visual abilities, these are subconscious-a characteristic that has led to this form of residual vision being referred to as blindsight. The neural basis of blindsight has been of great interest to the neuroscience community, with particular focus on understanding the contributions of the different subcortical pathways and cortical areas that may underlie this phenomenon. More recently, research has started to address which forms of neural plasticity occur following V1 lesions at different ages, including work using marmoset monkeys. The relatively rapid postnatal development of this species, allied to the lissencephalic brains and well-characterized visual cortex provide significant technical advantages, which allow controlled experiments exploring visual function in the absence of V1. © 2016 Wiley Periodicals, Inc. Develop Neurobiol 77: 314-327, 2017.

Natural motion trajectory enhances the coding of speed in primate extrastriate cortex

The ability to estimate the speed of an object irrespective of size or texture is a crucial function of the visual system. However, previous studies have suggested that the neuronal coding of speed in the middle temporal area (MT, a key cortical area for motion analysis in primates) is ambiguous, with most neurons changing their speed tuning depending on the spatial frequency (SF) of a visual pattern. Here we demonstrate that the ability of MT neurons to encode speed is markedly improved when stimuli follow a trajectory across the visual field, prior to entering their receptive fields. We also show that this effect is much less marked in the primary visual area. These results indicate that MT neurons build up on computations performed at earlier levels of the visual system to provide accurate coding of speed in natural situations, and provide additional evidence that nonlinear pooling underlie motion processing.

The marmoset monkey as a model for visual neuroscience

The common marmoset (Callithrix jacchus) has been valuable as a primate model in biomedical research. Interest in this species has grown recently, in part due to the successful demonstration of transgenic marmosets. Here we examine the prospects of the marmoset model for visual neuroscience research, adopting a comparative framework to place the marmoset within a broader evolutionary context. The marmoset's small brain bears most of the organizational features of other primates, and its smooth surface offers practical advantages over the macaque for areal mapping, laminar electrode penetration, and two-photon and optical imaging. Behaviorally, marmosets are more limited at performing regimented psychophysical tasks, but do readily accept the head restraint that is necessary for accurate eye tracking and neurophysiology, and can perform simple discriminations. Their natural gaze behavior closely resembles that of other primates, with a tendency to focus on objects of social interest including faces. Their immaturity at birth and routine twinning also makes them ideal for the study of postnatal visual development. These experimental factors, together with the theoretical advantages inherent in comparing anatomy, physiology, and behavior across related species, make the marmoset an excellent model for visual neuroscience.

Representation of central and peripheral vision in the primate cerebral cortex: Insights from studies of the marmoset brain

How the visual field is represented by neurons in the cerebral cortex is one of the most basic questions in visual neuroscience. However, research to date has focused heavily on the small part of the visual field within, and immediately surrounding the fovea. Studies on the cortical representation of the full visual field in the primate brain are still scarce. We have been investigating this issue with electrophysiological and anatomical methods, taking advantage of the small and lissencephalic marmoset brain, which allows easy access to the representation of the full visual field in many cortical areas. This review summarizes our main findings to date, and relates the results to a broader question: is the peripheral visual field processed in a similar manner to the central visual field, but with lower spatial acuity? Given the organization of the visual cortex, the issue can be addressed by asking: (1) Is visual information processed in the same way within a single cortical area? and (2) Are different cortical areas specialized for different parts of the visual field? The electrophysiological data from the primary visual cortex indicate that many aspects of spatiotemporal computation are remarkably similar across the visual field, although subtle variations are detectable. Our anatomical and electrophysiological studies of the extrastriate cortex, on the other hand, suggest that visual processing in the far peripheral visual field is likely to involve a distinct network of specialized cortical areas, located in the depths of the calcarine sulcus and interhemispheric fissure.

A simpler primate brain: the visual system of the marmoset monkey

Humans are diurnal primates with high visual acuity at the center of gaze. Although primates share many similarities in the organization of their visual centers with other mammals, and even other species of vertebrates, their visual pathways also show unique features, particularly with respect to the organization of the cerebral cortex. Therefore, in order to understand some aspects of human visual function, we need to study non-human primate brains. Which species is the most appropriate model? Macaque monkeys, the most widely used non-human primates, are not an optimal choice in many practical respects. For example, much of the macaque cerebral cortex is buried within sulci, and is therefore inaccessible to many imaging techniques, and the postnatal development and lifespan of macaques are prohibitively long for many studies of brain maturation, plasticity, and aging. In these and several other respects the marmoset, a small New World monkey, represents a more appropriate choice. Here we review the visual pathways of the marmoset, highlighting recent work that brings these advantages into focus, and identify where additional work needs to be done to link marmoset brain organization to that of macaques and humans. We will argue that the marmoset monkey provides a good subject for studies of a complex visual system, which will likely allow an important bridge linking experiments in animal models to humans.

Spectral characteristics of phase sensitivity and discharge rate of neurons in the ascending tectofugal visual system

Drifting gratings can modulate the activity of visual neurons at the temporal frequency of the stimulus. In order to characterize the temporal frequency modulation in the cat’s ascending tectofugal visual system, we recorded the activity of single neurons in the superior colliculus, the suprageniculate nucleus, and the anterior ectosylvian cortex during visual stimulation with drifting sine-wave gratings. In response to such stimuli, neurons in each structure showed an increase in firing rate and/or oscillatory modulated firing at the temporal frequency of the stimulus (phase sensitivity). To obtain a more complete characterization of the neural responses in spatiotemporal frequency domain, we analyzed the mean firing rate and the strength of the oscillatory modulations measured by the standardized Fourier component of the response at the temporal frequency of the stimulus. We show that the spatiotemporal stimulus parameters that elicit maximal oscillations often differ from those that elicit a maximal discharge rate. Furthermore, the temporal modulation and discharge-rate spectral receptive fields often do not overlap, suggesting that the detection range for visual stimuli provided jointly by modulated and unmodulated response components is larger than the range provided by a one response component.

Changes of spatial and temporal frequency tuning properties of neurons in the middle temporal area of aged rhesus monkeys

Aged humans exhibit severe deficits in visual motion perception and contrast sensitivity under various levels of spatial and temporal modulation. Previous studies indicated that many of these deficits are probably mediated by the neural degradation of the central visual system. To clarify the neuronal response mechanisms underlying the visual degradation during aging, we examined the spatial and temporal frequency tuning properties of neurons from anesthetised and paralysed aged monkeys at the middle temporal area (area MT), which is downstream of the primary visual cortex in the visual processing pathway and thought to be critical for motion perception. We found that the preferred spatial and temporal frequencies, spatial resolution and high temporal frequency cutoff of area MT neurons were reduced in aged monkeys, and were accompanied by the broadened tuning width of spatial frequency, elevated spontaneous activity, and decreased signal-to-noise ratio. These results showed that, for neurons in area MT, aging significantly changed both the spatial and temporal frequency response tuning properties. Such evidence provides new insight into the changes occurring at the electrophysiological level that may be related to the aging-related visual deficits, especially in processing spatial and temporal information.

Representation of the visual field in the primary visual area of the marmoset monkey: magnification factors, point-image size, and proportionality to retinal ganglion cell density

The primary visual area (V1) forms a systematic map of the visual field, in which adjacent cell clusters represent adjacent points of visual space. A precise quantification of this map is key to understanding the anatomical relationships between neurons located in different stations of the visual pathway, as well as the neural bases of visual performance in different regions of the visual field. We used computational methods to quantify the visual topography of V1 in the marmoset (Callithrix jacchus), a small diurnal monkey. The receptive fields of neurons throughout V1 were mapped in two anesthetized animals using electrophysiological recordings. Following histological reconstruction, precise 3D reconstructions of the V1 surface and recording sites were generated. We found that the areal magnification factor (M(A) ) decreases with eccentricity following a function that has the same slope as that observed in larger diurnal primates, including macaque, squirrel, and capuchin monkeys, and humans. However, there was no systematic relationship between M(A) and polar angle. Despite individual variation in the shape of V1, the relationship between M(A) and eccentricity was preserved across cases. Comparison between V1 and the retinal ganglion cell density demonstrated preferential magnification of central space in the cortex. The size of the cortical compartment activated by a punctiform stimulus decreased from the foveal representation towards the peripheral representation. Nonetheless, the relationship between the receptive field sizes of V1 cells and the density of ganglion cells suggested that each V1 cell receives information from a similar number of retinal neurons, throughout the visual field.

Relationship between size summation properties, contrast sensitivity and response latency in the dorsomedial and middle temporal areas of the primate extrastriate cortex

Analysis of the physiological properties of single neurons in visual cortex has demonstrated that both the extent of their receptive fields and the latency of their responses depend on stimulus contrast. Here, we explore the question of whether there are also systematic relationships between these response properties across different cells in a neuronal population. Single unit recordings were obtained from the middle temporal (MT) and dorsomedial (DM) extrastriate areas of anaesthetized marmoset monkeys. For each cell, spatial integration properties (length and width summation, as well as the presence of end- and side-inhibition within 15° of the receptive field centre) were determined using gratings of optimal direction of motion and spatial and temporal frequencies, at 60% contrast. Following this, contrast sensitivity was assessed using gratings of near-optimal length and width. In both areas, we found a relationship between spatial integration and contrast sensitivity properties: cells that summated over smaller areas of the visual field, and cells that displayed response inhibition at larger stimulus sizes, tended to show higher contrast sensitivity. In a sample of MT neurons, we found that cells showing longer latency responses also tended to summate over larger expanses of visual space in comparison with neurons that had shorter latencies. In addition, longer-latency neurons also tended to show less obvious surround inhibition. Interestingly, all of these effects were stronger and more consistent with respect to the selectivity for stimulus width and strength of side-inhibition than for length selectivity and end-inhibition. The results are partially consistent with a hierarchical model whereby more extensive receptive fields require convergence of information from larger pools of “feedforward” afferent neurons to reach near-optimal responses. They also suggest that a common gain normalization mechanism within MT and DM is involved, the spatial extent of which is more evident along the cell’s preferred axis of motion.

Spatiotemporal tuning in mouse primary visual cortex

The neural correlates of visual motion perception have historically been studied in non-human primates. However, the mouse has recently gained popularity as a model for studying vision primarily driven by the hope that the genetic tools available in this species may contribute to our understanding of visual processing in the cortex. A recent calcium-imaging study on the spatiotemporal tuning of mouse striate and extrastriate cortex revealed that neurons in the primary visual cortex (V1) were almost never speed tuned, whereas previous electrophysiological studies in macaques noted around one quarter of V1 neurons appeared to be selective for a particular stimulus speed. We were interested in whether this discrepancy was due to methodological or species differences, so we measured the spatiotemporal tuning of mouse V1 neurons using standard electrophysiological techniques. Using comparable analyses to previous studies of speed tuning, our data showed that speed tuning is rare in mouse V1, which corroborates earlier studies in mouse and points to a species difference in motion processing in early cortex between macaques and other mammals.

Visual motion integration by neurons in the middle temporal area of a New World monkey, the marmoset

The middle temporal area (MT/V5) is an anatomically distinct region of primate visual cortex that is specialized for the processing of image motion. It is generally thought that some neurons in area MT are capable of signalling the motion of complex patterns, but this has only been established in the macaque monkey. We made extracellular recordings from single units in area MT of anaesthetized marmosets, a New World monkey. We show through quantitative analyses that some neurons (35 of 185; 19%) are capable of signalling pattern motion ('pattern cells'). Across several dimensions, the visual response of pattern cells in marmosets is indistinguishable from that of pattern cells in macaques. Other neurons respond to the motion of oriented contours in a pattern ('component cells') or show intermediate properties. In addition, we encountered a subset of neurons (22 of 185; 12%) insensitive to sinusoidal gratings but very responsive to plaids and other two-dimensional patterns and otherwise indistinguishable from pattern cells. We compared the response of each cell class to drifting gratings and dot fields. In pattern cells, directional selectivity was similar for gratings and dot fields; in component cells, directional selectivity was weaker for dot fields than gratings. Pattern cells were more likely to have stronger suppressive surrounds, prefer lower spatial frequencies and prefer higher speeds than component cells. We conclude that pattern motion sensitivity is a feature of some neurons in area MT of both New and Old World monkeys, suggesting that this functional property is an important stage in motion analysis and is likely to be conserved in humans.

Is the medial posterior parietal area V6A a single functional area?

The visuomotor medial posterior parietal area V6A has been recently subdivided into two cytoarchitectonic sectors called V6Ad and V6Av (Luppino et al., 2005). The aim of the present study was to recognize whether these two cortical sectors show different functional profiles. Fourteen hemispheres from eight animals (Macaca fascicularis) were included in this study, for a total of 3828 extracellularly recorded neurons assigned to areas V6Ad or V6Av on cytoarchitectural basis. The sensitivity of recorded neurons to sensory- and motor-related activities was checked with a series of functional tests performed on behaving animals. We found that cells sensitive to visual stimuli were more represented in V6Av and cells sensitive to somatosensory stimuli were more represented in V6Ad. Visual cells directly encoding spatial locations (real-position cells) were present only in V6Av. Cells encoding basic visual and somatic properties as well as different aspects of reaching and grasping activities were present in both sectors of V6A, although with different incidence. Cells that had reach-related activity enhanced by visual feedback and grasping neurons activated by whole-hand prehension were more concentrated in V6Av. Conversely, reaching neurons inhibited by visual feedback and grasping neurons activated by precision grip were more represented in V6Ad. Although V6Av and V6Ad show partly different functional profiles, our data support the idea that V6A is a single functional area involved in the control of reach-to-grasp movements, with the dorsal sector (V6Ad) more involved in the somatomotor control and the ventral sector (V6Av) in the visual control of reaching and grasping actions.

Visual pathways serving motion detection in the mammalian brain

Motion perception is the process through which one gathers information on the dynamic visual world, in terms of the speed and movement direction of its elements. Motion sensation takes place from the retinal light sensitive elements, through the visual thalamus, the primary and higher visual cortices. In the present review we aim to focus on the extrageniculo-extrastriate cortical and subcortical visual structures of the feline and macaque brain and discuss their functional role in visual motion perception. Special attention is paid to the ascending tectofugal system that may serve for detection of the visual environment during self-motion.