Differential architecture of multisynaptic geniculo-cortical pathways to V4 and MT

Computational components of visual predictive coding circuitry

If a full visual percept can be said to be a 'hypothesis', so too can a neural 'prediction' - although the latter addresses one particular component of image content (such as 3-dimensional organisation, the interplay between lighting and surface colour, the future trajectory of moving objects, and so on). And, because processing is hierarchical, predictions generated at one level are conveyed in a backward direction to a lower level, seeking to predict, in fact, the neural activity at that prior stage of processing, and learning from errors signalled in the opposite direction. This is the essence of 'predictive coding', at once an algorithm for information processing and a theoretical basis for the nature of operations performed by the cerebral cortex. Neural models for the implementation of predictive coding invoke specific functional classes of neuron for generating, transmitting and receiving predictions, and for producing reciprocal error signals. Also a third general class, 'precision' neurons, tasked with regulating the magnitude of error signals contingent upon the confidence placed upon the prediction, i.e., the reliability and behavioural utility of the sensory data that it predicts. So, what is the ultimate source of a 'prediction'? The answer is multifactorial: knowledge of the current environmental context and the immediate past, allied to memory and lifetime experience of the way of the world, doubtless fine-tuned by evolutionary history too. There are, in consequence, numerous potential avenues for experimenters seeking to manipulate subjects' expectation, and examine the neural signals elicited by surprising, and less surprising visual stimuli. This review focuses upon the predictive physiology of mouse and monkey visual cortex, summarising and commenting on evidence to date, and placing it in the context of the broader field. It is concluded that predictive coding has a firm grounding in basic neuroscience and that, unsurprisingly, there remains much to learn.

Structural and functional differences of the thalamus between drug-naïve Parkinson's disease motor subtypes

Objective

The thalamus is an integrative hub of motor circuits in Parkinson's disease (PD). This study aimed to investigate the alterations of structure and functional connectivity (FC) of the thalamic subregions in the tremor-dominant (TD) subtype and the postural instability and gait difficulty (PIGD) subtype in PD.

Methods

A total of 59 drug-naïve patients (24 TD and 35 PIGD) and 37 healthy controls were recruited. The volumes of the thalamus and the thalamic subregions were calculated using FreeSurfer. Functional connectivity (FC) analysis of the resting-state functional MRI (rsfMRI) was conducted on the thalamic subregions. Finally, the altered structure and FC were used for correlation analysis with clinical motor scores and for further motor subtypes differentiation.

Results

The volumes of the left posterior parietal thalamus (PPtha) in TD patients were significantly lower than those of PIGD patients. Compared with PIGD patients, TD patients exhibited higher FC between the thalamic subregions, the left middle temporal gyrus (MTG), the right dorsolateral superior frontal gyrus (SFGdl), the left middle occipital gyrus (MOG), and the right superior temporal gyrus (STG). Compared with HCs, TD patients showed higher FC between the thalamic subregions and the right SFGdl, as well as the left MOG. Compared with HCs, PIGD patients showed lower FC between the thalamic subregions and the left MTG. In addition, the altered FC was closely related to clinical symptoms and performed high-discriminative power in differentiating the motor subtypes.

Conclusion

Increased FC between the thalamic subregions and the sensory cortices in TD patients may indicate a better compensatory capacity for impairment of sensory information integration than that in PIGD patients. The altered FC between the thalamus and the MTG was a potential biomarker for the distinction of the PD motor subtypes.

Origin of Multisynaptic Corticospinal Pathway to Forelimb Segments in Macaques and Its Reorganization After Spinal Cord Injury

Removal of the monosynaptic corticospinal pathway (CSP) terminating within the forelimb segments severely impairs manual dexterity. Functional recovery from the monosynaptic CSP lesion can be achieved through the remaining multisynaptic CSP toward the forelimb segments. In the present study, we applied retrograde transsynaptic labeling with rabies virus to a monkey model of spinal cord injury. By injecting the virus into the spinal forelimb segments immediately after the monosynaptic CSP lesion, we showed that the contralateral primary motor cortex (M1), especially its caudal and bank region (so-called “new” M1), was the principal origin of the CSP linking the motor cortex to the spinal forelimb segments disynaptically (disynaptic CSP). This forms a striking contrast to the architecture of the monosynaptic CSP that involves extensively other motor-related areas, together with M1. Next, the rabies injections were made at the recovery period of 3 months after the monosynaptic CSP lesion. The second-order labeled neurons were located in the ipsilateral as well as in the contralateral “new” M1. This indicates that the disynaptic CSP input from the ipsilateral “new” M1 is recruited during the motor recovery from the monosynaptic CSP lesion. Our results suggest that the disynaptic CSP is reorganized to connect the ipsilateral “new” M1 to the forelimb motoneurons for functional compensation after the monosynaptic CSP lesion.

Morphological features of large layer V pyramidal neurons in cortical motor-related areas of macaque monkeys: analysis of basal dendrites

In primates, large layer V pyramidal neurons located in the frontal motor-related areas send a variety of motor commands to the spinal cord, giving rise to the corticospinal tract, for execution of skilled motor behavior. However, little is known about the morphological diversity of such pyramidal neurons among the areas. Here we show that the structure of basal dendrites of the large layer V pyramidal neurons in the dorsal premotor cortex (PMd) is different from those in the other areas, including the primary motor cortex, the supplementary motor area, and the ventral premotor cortex. In the PMd, not only the complexity (arborization) of basal dendrites, i.e., total dendritic length and branching number, was poorly developed, but also the density of dendritic spines was so low, as compared to the other motor-related areas. Regarding the distribution of the three dendritic spine types identified, we found that thin-type (more immature) spines were prominent in the PMd in comparison with stubby- and mushroom-type (more mature) spines, while both thin- and stubby-type spines were in the other areas. The differential morphological features of basal dendrites might reflect distinct patterns of motor information processing within the large layer V pyramidal neurons in individual motor-related areas.

Timing of response onset and offset in macaque V4: stimulus and task dependence

In the primate visual cortex, both the magnitude of the neuronal response and its timing can carry important information about the visual world, but studies typically focus only on response magnitude. Here, we examine the onset and offset latency of the responses of neurons in area V4 of awake, behaving macaques across several experiments in the context of a variety of stimuli and task paradigms. Our results highlight distinct contributions of stimuli and tasks to V4 response latency. We found that response onset latencies are shorter than typically cited (median = 75.5 ms), supporting a role for V4 neurons in rapid object and scene recognition functions. Moreover, onset latencies are longer for smaller stimuli and stimulus outlines, consistent with the hypothesis that longer latencies are associated with higher spatial frequency content. Strikingly, we found that onset latencies showed no significant dependence on stimulus occlusion, unlike in inferotemporal cortex, nor on task demands. Across the V4 population, onset latencies had a broad distribution, reflecting the diversity of feedforward, recurrent, and feedback connections that inform the responses of individual neurons. Response offset latencies, on the other hand, displayed the opposite tendency in their relationship to stimulus and task attributes: they are less influenced by stimulus appearance but are shorter in guided saccade tasks compared with fixation tasks. The observation that response latency is influenced by stimulus- and task-associated factors emphasizes a need to examine response timing alongside firing rate in determining the functional role of area V4.NEW & NOTEWORTHY Onset and offset timing of neuronal responses can provide information about visual environment and neuron's role in visual processing and its anatomical connectivity. In the first comprehensive examination of onset and offset latencies in the intermediate visual cortical area V4, we find neurons respond faster than previously reported, making them ideally suited to contribute to rapid object and scene recognition. While response onset reflects stimulus characteristics, timing of response offset is influenced more by behavioral task.

fMRI representational similarity analysis reveals graded preferences for chromatic and achromatic stimulus contrast across human visual cortex

Human visual cortex is partitioned into different functional areas that, from lower to higher, become increasingly selective and responsive to complex feature dimensions. Here we use a Representational Similarity Analysis (RSA) of fMRI-BOLD signals to make quantitative comparisons across LGN and multiple visual areas of the low-level stimulus information encoded in the patterns of voxel responses. Our stimulus set was picked to target the four functionally distinct subcortical channels that input visual cortex from the LGN: two achromatic sinewave stimuli that favor the responses of the high-temporal magnocellular and high-spatial parvocellular pathways, respectively, and two chromatic stimuli isolating the L/M-cone opponent and S-cone opponent pathways, respectively. Each stimulus type had three spatial extents to sample both foveal and para-central visual field. With the RSA, we compare quantitatively the response specializations for individual stimuli and combinations of stimuli in each area and how these change across visual cortex. First, our results replicate the known response preferences for motion/flicker in the dorsal visual areas. In addition, we identify two distinct gradients along the ventral visual stream. In the early visual areas (V1-V3), the strongest differential representation is for the achromatic high spatial frequency stimuli, suitable for form vision, and a very weak differentiation of chromatic versus achromatic contrast. Emerging in ventral occipital areas (V4, VO1 and VO2), however, is an increasingly strong separation of the responses to chromatic versus achromatic contrast and a decline in the high spatial frequency representation. These gradients provide new insight into how visual information is transformed across the visual cortex.

Layer specificity of inputs from supplementary motor area and dorsal premotor cortex to primary motor cortex in macaque monkeys

The primate frontal lobe processes diverse motor information in parallel through multiple motor-related areas. For example, the supplementary motor area (SMA) is mainly involved in internally-triggered movements, whereas the premotor cortex (PM) is highly responsible for externally-guided movements. The primary motor cortex (M1) deals with both aspects of movements to execute a single motor behavior. To elucidate how the cortical motor system is structured to process a variety of information, the laminar distribution patterns of signals were examined between SMA and M1, or PM and M1 in macaque monkeys by using dual anterograde tract-tracing. Dense terminal labeling was observed in layers 1 and upper 2/3 of M1 after one tracer injection into SMA, another tracer injection into the dorsal division of PM resulted in prominent labeling in the deeper portion of layer 2/3. Weaker labeling was also visible in layer 5 in both cases. On the other hand, inputs from M1 terminated in both the superficial and the deep layers of SMA and PM. The present data indicate that distinct types of motor information are arranged in M1 in a layer-specific fashion to be orchestrated through a microcircuit within M1.

Neuronal correlates of motion-defined shape perception in primate dorsal and ventral streams

Human and non-human primates can readily perceive the shape of objects using visual motion. Classically, shape, and motion are considered to be separately processed via ventral and dorsal cortical pathways, respectively. However, many lines of anatomical and physiological evidence have indicated that these two pathways are likely to be interconnected at some stage. For motion-defined shape perception, these two pathways should interact with each other because the ventral pathway must utilize motion, which the dorsal pathway processes, to extract shape signal. However, it is unknown how interactions between cortical pathways are involved in neural mechanisms underlying motion-defined shape perception. We review evidence from psychophysical, lesion, neuroimaging and physiological research on motion-defined shape perception and then discuss the effects of behavioral demands on neural activity in ventral and dorsal cortical areas. Further, we discuss functions of two candidate sets of levels: early and higher-order cortical areas. The extrastriate area V4 and middle temporal (MT) area, which are reciprocally connected, at the early level are plausible areas for extracting the shape and/or constituent parts of shape from motion cues because neural dynamics are different from those during luminance-defined shape perception. On the other hand, among other higher-order visual areas, the anterior superior temporal sulcus likely contributes to the processing of cue-invariant shape recognition rather than cue-dependent shape processing. We suggest that sharing information about motion and shape between the early visual areas in the dorsal and ventral pathways is dependent on visual cues and behavioral requirements, indicating the interplay between the pathways.

Neural Elements for Predictive Coding

Predictive coding theories of sensory brain function interpret the hierarchical construction of the cerebral cortex as a Bayesian, generative model capable of predicting the sensory data consistent with any given percept. Predictions are fed backward in the hierarchy and reciprocated by prediction error in the forward direction, acting to modify the representation of the outside world at increasing levels of abstraction, and so to optimize the nature of perception over a series of iterations. This accounts for many ‘illusory’ instances of perception where what is seen (heard, etc.) is unduly influenced by what is expected, based on past experience. This simple conception, the hierarchical exchange of prediction and prediction error, confronts a rich cortical microcircuitry that is yet to be fully documented. This article presents the view that, in the current state of theory and practice, it is profitable to begin a two-way exchange: that predictive coding theory can support an understanding of cortical microcircuit function, and prompt particular aspects of future investigation, whilst existing knowledge of microcircuitry can, in return, influence theoretical development. As an example, a neural inference arising from the earliest formulations of predictive coding is that the source populations of forward and backward pathways should be completely separate, given their functional distinction; this aspect of circuitry – that neurons with extrinsically bifurcating axons do not project in both directions – has only recently been confirmed. Here, the computational architecture prescribed by a generalized (free-energy) formulation of predictive coding is combined with the classic ‘canonical microcircuit’ and the laminar architecture of hierarchical extrinsic connectivity to produce a template schematic, that is further examined in the light of (a) updates in the microcircuitry of primate visual cortex, and (b) rapid technical advances made possible by transgenic neural engineering in the mouse. The exercise highlights a number of recurring themes, amongst them the consideration of interneuron diversity as a spur to theoretical development and the potential for specifying a pyramidal neuron’s function by its individual ‘connectome,’ combining its extrinsic projection (forward, backward or subcortical) with evaluation of its intrinsic network (e.g., unidirectional versus bidirectional connections with other pyramidal neurons).

Progressive Thinning of Visual Motion Area in Lower Limb Amputees

Accumulating evidence has indicated that amputation or deafferentation of a limb induces functional or structural reorganization in the visual areas. However, the extent of the visual areas involved after lower limb amputation remains uncertain. In this investigation, we studied 48 adult patients with unilateral lower limb amputation and 48 matched healthy controls using T1-weighted magnetic resonance imaging. Template-based regions of interest analysis was implemented to detect the changes of cortical thickness in the specific visual areas. Compared with normal controls, amputees exhibited significantly lower thickness in the V5/middle temporal (V5/MT+) visual area, as well as a trend of cortical thinning in the V3d. There was no significant difference in the other visual areas between the two groups. In addition, no significant difference of cortical thickness was found between patients with amputation at different levels. Across all amputees, correlation analyses revealed that the cortical thickness of the V5/MT+ was negatively correlated to the time since amputation. In conclusion, our findings indicate that the amputation of unilateral lower limb could induce changes in the motor-related visual cortex and provide an update on the plasticity of the human brain after limb injury.

Feedforward and feedback connections and their relation to the cytox modules of V2 in Cebus monkeys

To study the circuitry related to the ventral stream of visual information processing and its relation to the cytochrome oxidase (CytOx) modules in visual area V2, we injected anterograde and retrograde cholera toxin subunit B (CTb) tracer into nine sites in area V4 in five Cebus apella monkeys. The injection site locations ranged from 2° to 10° eccentricity in the lower visual field representation of V4. Alternate cortical sections, cut tangentially to the pial surface or in the coronal plane, were stained for CTb immunocytochemistry or for CytOx histochemistry or for Nissl. Our results indicate that the V4-projecting cells and terminal-like labeling were located in interstripes and thin CytOx-rich stripes and avoided the CytOx-rich thick stripes in V2. The feedforward projecting cell bodies in V2 were primarily located in the supragranular layers and sparsely located in the infragranular layers, whereas the feedback projections (i.e., the terminal-like labels) were located in the supra- and infragranular layers. V4 injections of CTb resulted in labeling of the thin stripes and interstripes of V2 and provided an efficient method of distinguishing the V2 modules that were related to the ventral stream from the CytOx-rich thick stripes, related to the dorsal stream. In V2, there was a significant heterogeneity in the distribution of projections: feedforward projections were located in CytOx-rich thin stripes and in the CytOx-poor interstripes, whereas the feedback projections were more abundant in the thin stripes than in the interstripes. J. Comp. Neurol. 522:3091–3105, 2014.

Specificity of V1-V2 orientation networks in the primate visual cortex

The computation of texture and shape involves integration of features of various orientations. Orientation networks within V1 tend to involve cells which share similar orientation selectivity. However, emergent properties in V2 require the integration of multiple orientations. We now show that, unlike interactions within V1, V1-V2 orientation interactions are much less synchronized and are not necessarily orientation dependent. We find V1-V2 orientation networks are of two types: a more tightly synchronized, orientation-preserving network and a less synchronized orientation-diverse network. We suggest that such diversity of V1-V2 interactions underlies the spatial and functional integration required for computation of higher order contour and shape in V2.

Interaction between dorsal and ventral processing streams: where, when and how?

The execution of complex visual, auditory, and linguistic behaviors requires a dynamic interplay between spatial ('where/how') and non-spatial ('what') information processed along the dorsal and ventral processing streams. However, while it is acknowledged that there must be some degree of interaction between the two processing networks, how they interact, both anatomically and functionally, is a question which remains little explored. The current review examines the anatomical, temporal, and behavioral evidence regarding three potential models of dual stream interaction: (1) computations along the two pathways proceed independently and in parallel, reintegrating within shared target brain regions; (2) processing along the separate pathways is modulated by the existence of recurrent feedback loops; and (3) information is transferred directly between the two pathways at multiple stages and locations along their trajectories.

Multisynaptic projections from the ventrolateral prefrontal cortex to hand and mouth representations of the monkey primary motor cortex

Different sectors of the prefrontal cortex have distinct neuronal connections with higher-order sensory areas and/or limbic structures and are related to diverse aspects of cognitive functions, such as visual working memory and reward-based decision-making. Recent studies have revealed that the prefrontal cortex (PF), especially the lateral PF, is also involved in motor control. Hence, different sectors of the PF may contribute to motor behaviors with distinct body parts. To test this hypothesis anatomically, we examined the patterns of multisynaptic projections from the PF to regions of the primary motor cortex (MI) that represent the arm, hand, and mouth, using retrograde transsynaptic transport of rabies virus. Four days after rabies injections into the hand or mouth region, particularly dense neuron labeling was observed in the ventrolateral PF, including the convexity part of ventral area 46. After the rabies injections into the mouth region, another dense cluster of labeled neurons was seen in the orbitofrontal cortex (area 13). By contrast, rabies labeling of PF neurons was rather sparse in the arm-injection cases. The present results suggest that the PF-MI multisynaptic projections may be organized such that the MI hand and mouth regions preferentially receive cognitive information for execution of elaborate motor actions.

Multisynaptic inputs from the medial temporal lobe to V4 in macaques

Retrograde transsynaptic transport of rabies virus was employed to undertake the top-down projections from the medial temporal lobe (MTL) to visual area V4 of the occipitotemporal visual pathway in Japanese monkeys (Macaca fuscata). On day 3 after rabies injections into V4, neuronal labeling was observed prominently in the temporal lobe areas that have direct connections with V4, including area TF of the parahippocampal cortex. Furthermore, conspicuous neuron labeling appeared disynaptically in area TH of the parahippocampal cortex, and areas 35 and 36 of the perirhinal cortex. The labeled neurons were located predominantly in deep layers. On day 4 after the rabies injections, labeled neurons were found in the hippocampal formation, along with massive labeling in the parahippocampal and perirhinal cortices. In the hippocampal formation, the densest neuron labeling was seen in layer 5 of the entorhinal cortex, and a small but certain number of neurons were labeled in other regions, such as the subicular complex and CA1 and CA3 of the hippocampus proper. The present results indicate that V4 receives major input from the hippocampus proper via the entorhinal cortex, as well as “short-cut” pathways that bypass the entorhinal cortex. These multisynaptic pathways may define an anatomical basis for hippocampal-cortical interactions involving lower visual areas. The multisynaptic input from the MTL to V4 is likely to provide mnemonic information about object recognition that is accomplished through the occipitotemporal pathway.

Distinct functional organizations for processing different motion signals in V1, V2, and V4 of macaque

Motion perception is qualitatively invariant across different objects and forms, namely, the same motion information can be conveyed by many different physical carriers, and it requires the processing of motion signals consisting of direction, speed, and axis or trajectory of motion defined by a moving object. Compared with the representation of orientation, the cortical processing of these different motion signals within the early ventral visual pathway of the primate remains poorly understood. Using drifting full-field noise stimuli and intrinsic optical imaging, along with cytochrome-oxidase staining, we found that the orientation domains in macaque V1, V2, and V4 that processed orientation signals also served to process motion signals associated with the axis and speed of motion. In contrast, direction domains within the thick stripes of V2 demonstrated preferences that were independent of motion speed. The population responses encoding the orientation and motion axis could be precisely reproduced by a spatiotemporal energy model. Thus, our observation of orientation domains with dual functions in V1, V2, and V4 directly support the notion that the linear representation of the temporal series of retinotopic activations may serve as another motion processing strategy in primate ventral visual pathway, contributing directly to fine form and motion analysis. Our findings further reveal that different types of motion information are differentially processed in parallel and segregated compartments within primate early visual cortices, before these motion features are fully combined in high-tier visual areas.

Segregated pathways carrying frontally derived top-down signals to visual areas MT and V4 in macaques

The bottom-up processing of visual information is strongly influenced by top-down signals, at least part of which is thought to be conveyed from the frontal cortex through the frontal eye field (FEF) and the lateral intraparietal area (LIP). Here we investigated the architecture of multisynaptic pathways from the frontal cortex to the middle temporal area (MT) of the dorsal visual stream and visual area 4 (V4) of the ventral visual stream in macaques. In the first series of experiments, the retrograde trans-synaptic tracer, rabies virus, was injected into MT or V4. Three days after rabies injections, the second-order (disynaptically connected) neuron labeling appeared in the ventral part of area 46 (area 46v), along with the first-order (monosynaptically connected) neuron labeling in FEF and LIP. In the MT-injection case, second-order neurons were also observed in the supplementary eye field (SEF). In the next series of experiments, double injections of two fluorescent dyes, fast blue and diamidino yellow, were made into MT and V4 to examine whether the frontal inputs are mediated by distinct or common neuronal populations. Virtually no double-labeled neurons were observed in FEF or LIP, indicating that separate neuronal populations mediate the frontal inputs to MT and V4. The present results define that the multisynaptic frontal input to V4 arises primarily from area 46v, whereas the input to MT arises from not only area 46v but also SEF, through distinct FEF and LIP neurons. Segregated pathways from the frontal cortex possibly carry the functionally diverse top-down signals to each visual stream.

Equivalent representation of real and illusory contours in macaque V4

The cortical processing of illusory contours provides a unique window for exploring the brain mechanisms underlying visual perception. Previous electrophysiological single-cell recordings demonstrate that a subgroup of cells in macaque V1 and V2 signal the presence of illusory contours, whereas recent human brain imaging studies reveal higher-order visual cortices playing a central role in illusory figure processing. It seems that the processing of illusory contours/figures may engage multiple cortical interactions between hierarchically organized processing stages in the ventral visual pathway of primates. However, it is not yet known in which brain areas illusory contours are represented in the same manner as real contours at both the population and single-cell levels. Here, by combining intrinsic optical imaging in anesthetized rhesus macaques with single-cell recordings in awake ones, we found a complete overlap of orientation domains in visual cortical area V4 for processing real and illusory contours. In contrast, the orientation domains mapped in early visual areas V1 and V2 mainly encoded the local physical stimulus features inducing the subjective perception of global illusory contours. Our results indicate that real and illusory contours are encoded equivalently by the same functional domains in V4, suggesting that V4 is a key cortical locus for integration of local features into global contours.