Laminar and orientation-dependent characteristics of spatial nonlinearities: implications for the computational architecture of visual cortex

Fly Photoreceptors Encode Phase Congruency

More than five decades ago it was postulated that sensory neurons detect and selectively enhance behaviourally relevant features of natural signals. Although we now know that sensory neurons are tuned to efficiently encode natural stimuli, until now it was not clear what statistical features of the stimuli they encode and how. Here we reverse-engineer the neural code of Drosophila photoreceptors and show for the first time that photoreceptors exploit nonlinear dynamics to selectively enhance and encode phase-related features of temporal stimuli, such as local phase congruency, which are invariant to changes in illumination and contrast. We demonstrate that to mitigate for the inherent sensitivity to noise of the local phase congruency measure, the nonlinear coding mechanisms of the fly photoreceptors are tuned to suppress random phase signals, which explains why photoreceptor responses to naturalistic stimuli are significantly different from their responses to white noise stimuli.

Hierarchical Novelty-Familiarity Representation in the Visual System by Modular Predictive Coding

Predictive coding has been previously introduced as a hierarchical coding framework for the visual system. At each level, activity predicted by the higher level is dynamically subtracted from the input, while the difference in activity continuously propagates further. Here we introduce modular predictive coding as a feedforward hierarchy of prediction modules without back-projections from higher to lower levels. Within each level, recurrent dynamics optimally segregates the input into novelty and familiarity components. Although the anatomical feedforward connectivity passes through the novelty-representing neurons, it is nevertheless the familiarity information which is propagated to higher levels. This modularity results in a twofold advantage compared to the original predictive coding scheme: the familiarity-novelty representation forms quickly, and at each level the full representational power is exploited for an optimized readout. As we show, natural images are successfully compressed and can be reconstructed by the familiarity neurons at each level. Missing information on different spatial scales is identified by novelty neurons and complements the familiarity representation. Furthermore, by virtue of the recurrent connectivity within each level, non-classical receptive field properties still emerge. Hence, modular predictive coding is a biologically realistic metaphor for the visual system that dynamically extracts novelty at various scales while propagating the familiarity information.

Multichannel response analysis on 2D projection views for detection of clustered microcalcifications in digital breast tomosynthesis

PURPOSE

To investigate the feasibility of a new two-dimensional (2D) multichannel response (MCR) analysis approach for the detection of clustered microcalcifications (MCs) in digital breast tomosynthesis (DBT).

METHODS

With IRB approval and informed consent, a data set of two-view DBTs from 42 breasts containing biopsy-proven MC clusters was collected in this study. The authors developed a 2D approach for MC detection using projection view (PV) images rather than the reconstructed three-dimensional (3D) DBT volume. Signal-to-noise ratio (SNR) enhancement processing was first applied to each PV to enhance the potential MCs. The locations of MC candidates were then identified with iterative thresholding. The individual MCs were decomposed with Hermite-Gaussian (HG) and Laguerre-Gaussian (LG) basis functions and the channelized Hotelling model was trained to produce the MCRs for each MC on the 2D images. The MCRs from the PVs were fused in 3D by a coincidence counting method that backprojects the MC candidates on the PVs and traces the coincidence of their ray paths in 3D. The 3D MCR was used to differentiate the true MCs from false positives (FPs). Finally a dynamic clustering method was used to identify the potential MC clusters in the DBT volume based on the fact that true MCs of clinical significance appear in clusters. Using two-fold cross validation, the performance of the 3D MCR for classification of true and false MCs was estimated by the area under the receiver operating characteristic (ROC) curve and the overall performance of the MCR approach for detection of clustered MCs was assessed by free response receiver operating characteristic (FROC) analysis.

RESULTS

When the HG basis function was used for MCR analysis, the detection of MC cluster achieved case-based test sensitivities of 80% and 90% at the average FP rates of 0.65 and 1.55 FPs per DBT volume, respectively. With LG basis function, the average FP rates were 0.62 and 1.57 per DBT volume at the same sensitivity levels. The difference in the two sets of basis functions for detection of MCs did not show statistical significance.

CONCLUSIONS

The authors' experimental results indicate that the MCR approach is promising for the detection of MCs on PV images. The HG or LG basis functions are both effective in characterizing the signal response of MCs using the channelized Hotelling model. The coincidence counting method for fusion of the 2D MCR in 3D is an important step for FP reduction. Further study is underway to improve the MCR approach for microcalcification detection in DBT.

Automatic mapping of visual cortex receptive fields: a fast and precise algorithm

An important issue for neurophysiological studies of the visual system is the definition of the region of the visual field that can modify a neuron's activity (i.e., the neuron's receptive field - RF). Usually a trade-off exists between precision and the time required to map a RF. Manual methods (qualitative) are fast but impose a variable degree of imprecision, while quantitative methods are more precise but usually require more time. We describe a rapid quantitative method for mapping visual RFs that is derived from computerized tomography and named back-projection. This method finds the intersection of responsive regions of the visual field based on spike density functions that are generated over time in response to long bars moving in different directions. An algorithm corrects the response profiles for latencies and allows for the conversion of the time domain into a 2D-space domain. The final product is an RF map that shows the distribution of the neuronal activity in visual-spatial coordinates. In addition to mapping the RF, this method also provides functional properties, such as latency, orientation and direction preference indexes. This method exhibits the following beneficial properties: (a) speed; (b) ease of implementation; (c) precise RF localization; (d) sensitivity (this method can map RFs based on few responses); (e) reliability (this method provides consistent information about RF shapes and sizes, which will allow for comparative studies); (f) comprehensiveness (this method can scan for RFs over an extensive area of the visual field); (g) informativeness (it provides functional quantitative data about the RF); and (h) usefulness (this method can map RFs in regions without direct retinal inputs, such as the cortical representations of the optic disc and of retinal lesions, which should allow for studies of functional connectivity, reorganization and neural plasticity). Furthermore, our method allows for precise mapping of RFs in a 30° by 30° area of the visual field for an array of microelectrodes of any size in less than 6 min.

Stability of simple/complex classification with contrast and extraclassical receptive field modulation in macaque V1

A key property of neurons in primary visual cortex (V1) is the distinction between simple and complex cells. Recent reports in cat visual cortex indicate the categorization of simple and complex can change depending on stimulus conditions. We investigated the stability of the simple/complex classification with changes in drive produced by either contrast or modulation by the extraclassical receptive field (eCRF). These two conditions were reported to increase the proportion of simple cells in cat cortex. The ratio of the modulation depth of the response (F1) to the elevation of response (F0) to a drifting grating (F1/F0 ratio) was used as the measure of simple/complex. The majority of V1 complex cells remained classified as complex with decreasing contrast. Near contrast threshold, an equal proportion of simple and complex cells changed their classification. The F1/F0 ratio was stable between optimal and large stimulus areas even for those neurons that showed strong eCRF suppression. There was no discernible overall effect of surrounding spatial context on the F1/F0 ratio. Simple/complex cell classification is relatively stable across a range of stimulus drives, produced by either contrast or eCRF suppression.

Effects of contrast and contrast adaptation on static receptive field features in macaque area V1

The spatiotemporal features of the “static” receptive field (RF), as revealed with flashing bars or spots, determine other RF properties. We examined how some of these static RF features vary with contrast and contrast adaptation in area V1 of the anesthetized macaque monkey. RFs were mapped with light and dark flashing bars presented at three different contrasts, with the low and medium contrasts eliciting approximately 1/3 and 2/3 of the high-contrast response amplitude. The main results are as follows: 1) RF widths decreased when contrast decreased; however, the amount of decrease was less than that expected from an iceberg model and closer to the expectation of a contrast invariance of the RF width. 2) Area tuning experiments with drifting gratings showed an opposite effect of contrast: an increase in preferred stimulus diameter when contrast decreased. This implies that the effect of contrast on preferred stimulus size is not predictable from the static RF. 3) Contrast adaptation attenuated the effect of contrast on RF amplitude but did not significantly modify RF width. 4) RF subregion overlap was only marginally affected by changes in contrast and contrast adaptation; the classification of cells as simple and complex, when established from subregion overlap, appears to be robust with respect to changes in contrast and adaptation state. Previous studies have shown that the spatiotemporal features of the RF depend largely on the stimuli used to map the RF. This study shows that contrast is one elemental feature that contributes to the dynamics of the RF.