Neural Computation of Surface Border Ownership and Relative Surface Depth from Ambiguous Contrast Inputs

Environmental Lighting Conditions, Phenomenal Contrast, and the Conscious Perception of Near and Far

BACKGROUND

Recent evidence in systems neuroscience suggests that lighting conditions affect the whole chain of brain processing, from retina to high-level cortical networks, for perceptual and cognitive function. Here, visual adaptation levels to three different environmental lighting conditions, (1) darkness, (2) daylight, and (3) prolonged exposure to very bright light akin to sunlight, were simulated in lab to investigate the effects of light adaptation levels on classic cases of subjective contrast, assimilation, and contrast-induced relative depth in achromatic, i.e., ON-OFF pathway mediated visual configurations.

METHODS

After adaptation/exposure to a given lighting condition, configurations were shown in grouped and ungrouped conditions in random order to healthy young humans in computer-controlled two-alternative forced-choice procedures that consisted of deciding, as quickly as possible, which of two background patterns in a given configuration of achromatic contrast appeared lighter, or which of two foreground patterns appeared to stand out in front, as if it were nearer to the observer.

RESULTS

We found a statistically significant effect of the adaptation levels on the consciously perceived subjective contrast (F(2,23) = 20.73; p < 0.001) and the relative depth (F(2,23) = 12.67; p < 0.001), a statistically significant interaction between the adaptation levels and the grouping factor (F(2,23) = 4.73; p < 0.05) on subjective contrast, and a statistically significant effect of the grouping factor on the relative depth (F(2,23) = 13.71; p < 0.01).

CONCLUSIONS

Visual adaption to different lighting conditions significantly alters the conscious perception of contrast and assimilation, classically linked to non-linear functional synergies between ON and OFF processing channels in the visual brain, and modulates the repeatedly demonstrated effectiveness of luminance contrast as a depth cue; the physically brighter pattern regions in the configurations are no longer consistently perceived as nearer to a conscious observer under daylight and extreme bright light adapted (rod-saturated) conditions.

Nonsymbolic numerosity in sets with illusory-contours exploits a context-sensitive, but contrast-insensitive, visual boundary formation process

The visual mechanisms underlying approximate numerical representation are still intensely debated because numerosity information is often confounded with continuous sensory cues (e.g., texture density, area, convex hull). However, numerosity is underestimated when a few items are connected by illusory contours (ICs) lines without changing other physical cues, suggesting in turn that numerosity processing may rely on discrete visual input. Yet, in these previous works, ICs were generated by black-on-gray inducers producing an illusory brightness enhancement, which could represent a further continuous sensory confound. To rule out this possibility, we tested participants in a numerical discrimination task in which we manipulated the alignment of 0, 2, or 4 pairs of open/closed inducers and their contrast polarity. In Experiment 1, aligned open inducers had only one polarity (all black or all white) generating ICs lines brighter or darker than the gray background. In Experiment 2, open inducers had always opposite contrast polarity (one black and one white inducer) generating ICs without strong brightness enhancement. In Experiment 3, reverse-contrast inducers were aligned but closed with a line preventing ICs completion. Results showed that underestimation triggered by ICs lines was independent of inducer contrast polarity in both Experiment 1 and Experiment 2, whereas no underestimation was found in Experiment 3. Taken together, these results suggest that mere brightness enhancement is not the primary cause of the numerosity underestimation induced by ICs lines. Rather, a boundary formation mechanism insensitive to contrast polarity may drive the effect, providing further support to the idea that numerosity processing exploits discrete inputs.

Sensorimotor Self-organization via Circular-Reactions

Newborns demonstrate innate abilities in coordinating their sensory and motor systems through reflexes. One notable characteristic is circular reactions consisting of self-generated motor actions that lead to correlated sensory and motor activities. This paper describes a model for goal-directed reaching based on circular reactions and exocentric reference-frames. The model is built using physiologically plausible visual processing modules and arm-control neural networks. The model incorporates map representations with ego- and exo-centric reference frames for sensory inputs, vector representations for motor systems, as well as local associative learning that result from arm explorations. The integration of these modules is simulated and tested in a three-dimensional spatial environment using Unity3D. The results show that, through self-generated activities, the model self-organizes to generate accurate arm movements that are tolerant with respect to various sources of noise.

Color for the perceptual organization of the pictorial plane: Victor Vasarely's legacy to Gestalt psychology

Victor Vasarely's (1906-1997) important legacy to the study of human perception is brought to the forefront and discussed. A large part of his impressive work conveys the appearance of striking three-dimensional shapes and structures in a large-scale pictorial plane. Current perception science explains such effects by invoking brain mechanisms for the processing of monocular (2D) depth cues. Here in this study, we illustrate and explain local effects of 2D color and contrast cues on the perceptual organization in terms of figure-ground assignments, i.e. which local surfaces are likely to be seen as "nearer" or "bigger" in the image plane. Paired configurations are embedded in a larger, structurally ambivalent pictorial context inspired by some of Vasarely's creations. The figure-ground effects these configurations produce reveal a significant correlation between perceptual solutions for "nearer" and "bigger" when other geometric depth cues are missing. In consistency with previous findings on similar, albeit simpler visual displays, a specific color may compete with luminance contrast to resolve the planar ambiguity of a complex pattern context at a critical point in the hierarchical resolution of figure-ground uncertainty. The potential role of color temperature in this process is brought forward here. Vasarely intuitively understood and successfully exploited the subtle context effects accounted for in this paper, well before empirical investigation had set out to study and explain them in terms of information processing by the visual brain.

Seven Properties of Self-Organization in the Human Brain

The principle of self-organization has acquired a fundamental significance in the newly emerging field of computational philosophy. Self-organizing systems have been described in various domains in science and philosophy including physics, neuroscience, biology and medicine, ecology, and sociology. While system architecture and their general purpose may depend on domain-specific concepts and definitions, there are (at least) seven key properties of self-organization clearly identified in brain systems: (1) modular connectivity, (2) unsupervised learning, (3) adaptive ability, (4) functional resiliency, (5) functional plasticity, (6) from-local-to-global functional organization, and (7) dynamic system growth. These are defined here in the light of insight from neurobiology, cognitive neuroscience and Adaptive Resonance Theory (ART), and physics to show that self-organization achieves stability and functional plasticity while minimizing structural system complexity. A specific example informed by empirical research is discussed to illustrate how modularity, adaptive learning, and dynamic network growth enable stable yet plastic somatosensory representation for human grip force control. Implications for the design of “strong” artificial intelligence in robotics are brought forward.

Combining Visual Contrast Information with Sound Can Produce Faster Decisions

Pieron’s and Chocholle’s seminal psychophysical work predicts that human response time to information relative to visual contrast and/or sound frequency decreases when contrast intensity or sound frequency increases. The goal of this study is to bring to the forefront the ability of individuals to use visual contrast intensity and sound frequency in combination for faster perceptual decisions of relative depth (“nearer”) in planar (2D) object configurations based on physical variations in luminance contrast. Computer controlled images with two abstract patterns of varying contrast intensity, one on the left and one on the right, preceded or not by a pure tone of varying frequency, were shown to healthy young humans in controlled experimental sequences. Their task (two-alternative, forced-choice) was to decide as quickly as possible which of two patterns, the left or the right one, in a given image appeared to “stand out as if it were nearer” in terms of apparent (subjective) visual depth. The results showed that the combinations of varying relative visual contrast with sounds of varying frequency exploited here produced an additive effect on choice response times in terms of facilitation, where a stronger visual contrast combined with a higher sound frequency produced shorter forced-choice response times. This new effect is predicted by audio-visual probability summation.

The quantization error in a Self-Organizing Map as a contrast and colour specific indicator of single-pixel change in large random patterns

The quantization error in a fixed-size Self-Organizing Map (SOM) with unsupervised winner-take-all learning has previously been used successfully to detect, in minimal computation time, highly meaningful changes across images in medical time series and in time series of satellite images. Here, the functional properties of the quantization error in SOM are explored further to show that the metric is capable of reliably discriminating between the finest differences in local contrast intensities and contrast signs. While this capability of the QE is akin to functional characteristics of a specific class of retinal ganglion cells (the so-called Y-cells) in the visual systems of the primate and the cat, the sensitivity of the QE surpasses the capacity limits of human visual detection. Here, the quantization error in the SOM is found to reliably signal changes in contrast or colour when contrast information is removed from or added to the image, but not when the amount and relative weight of contrast information is constant and only the local spatial position of contrast elements in the pattern changes. While the RGB Mean reflects coarser changes in colour or contrast well enough, the SOM-QE is shown to outperform the RGB Mean in the detection of single-pixel changes in images with up to five million pixels. This could have important implications in the context of unsupervised image learning and computational building block approaches to large sets of image data (big data), including deep learning blocks, and automatic detection of contrast change at the nanoscale in Transmission or Scanning Electron Micrographs (TEM, SEM), or at the subpixel level in multispectral and hyper-spectral imaging data.

The quantization error in a Self-Organizing Map as a contrast and colour specific indicator of single-pixel change in large random patterns

The quantization error in a fixed-size Self-Organizing Map (SOM) with unsupervised winner-take-all learning has previously been used successfully to detect, in minimal computation time, highly meaningful changes across images in medical time series and in time series of satellite images. Here, the functional properties of the quantization error in SOM are explored further to show that the metric is capable of reliably discriminating between the finest differences in local contrast intensities and contrast signs. While this capability of the QE is akin to functional characteristics of a specific class of retinal ganglion cells (the so-called Y-cells) in the visual systems of the primate and the cat, the sensitivity of the QE surpasses the capacity limits of human visual detection. Here, the quantization error in the SOM is found to reliably signal changes in contrast or colour when contrast information is removed from or added to the image, but not when the amount and relative weight of contrast information is constant and only the local spatial position of contrast elements in the pattern changes. While the RGB Mean reflects coarser changes in colour or contrast well enough, the SOM-QE is shown to outperform the RGB Mean in the detection of single-pixel changes in images with up to five million pixels. This could have important implications in the context of unsupervised image learning and computational building block approaches to large sets of image data (big data), including deep learning blocks, and automatic detection of contrast change at the nanoscale in Transmission or Scanning Electron Micrographs (TEM, SEM), or at the subpixel level in multispectral and hyper-spectral imaging data.

Bilateral Symmetry Strengthens the Perceptual Salience of Figure against Ground

Although symmetry has been discussed in terms of a major law of perceptual organization since the early conceptual efforts of the Gestalt school (Wertheimer, Metzger, Koffka and others), the first quantitative measurements testing for effects of symmetry on processes of Gestalt formation have seen the day only recently. In this study, a psychophysical rating study and a “foreground”-“background” choice response time experiment were run with human observers to test for effects of bilateral symmetry on the perceived strength of figure-ground in triangular Kanizsa configurations. Displays with and without bilateral symmetry, identical physically-specified-to-total contour ratio, and constant local contrast intensity within and across conditions, but variable local contrast polarity and variable orientation in the plane, were presented in a random order to human observers. Configurations with bilateral symmetry produced significantly stronger figure-ground percepts reflected by greater subjective magnitudes and consistently higher percentages of “foreground” judgments accompanied by significantly shorter response times. These effects of symmetry depend neither on the orientation of the axis of symmetry, nor on the contrast polarity of the physical inducers. It is concluded that bilateral symmetry, irrespective of orientation, significantly contributes to the, largely sign-invariant, visual mechanisms of figure-ground segregation that determine the salience of figure-ground in perceptually ambiguous configurations.

Military Object Real-Time Detection Technology Combined with Visual Salience and Psychology

This paper presents a method of military object detection through the combination of human visual salience and visual psychology, so as to achieve rapid and accurate detection of military objects on the vast and complex battlefield. Inspired by the process of human visual information processing, this paper establishes a salient region detection model based on double channel and feature fusion. In this model the pre-attention channel is to process information on the position and contrast of images, and the sub-attention channel is to integrate information on primary visual features first and then merges results of the two channels to determine the salient region. The main theory of Gestalt visual psychology is then used as the constraint condition to integrate the candidate salient regions and to obtain the object figure with overall perception. After that, the efficient sub-window search method is used to detect and filter the object in order to determine the location and range of objects. The experimental results show that, when compared with the existing algorithms, the algorithm proposed in this paper has prominent advantages in precision, effectiveness, and simplicity, which not only significantly reduces the effectiveness of battlefield camouflage and deception but also achieves the rapid and accurate detection of military objects, thus promoting its application prospect.

Towards solving the hard problem of consciousness: The varieties of brain resonances and the conscious experiences that they support

The hard problem of consciousness is the problem of explaining how we experience qualia or phenomenal experiences, such as seeing, hearing, and feeling, and knowing what they are. To solve this problem, a theory of consciousness needs to link brain to mind by modeling how emergent properties of several brain mechanisms interacting together embody detailed properties of individual conscious psychological experiences. This article summarizes evidence that Adaptive Resonance Theory, or ART, accomplishes this goal. ART is a cognitive and neural theory of how advanced brains autonomously learn to attend, recognize, and predict objects and events in a changing world. ART has predicted that "all conscious states are resonant states" as part of its specification of mechanistic links between processes of consciousness, learning, expectation, attention, resonance, and synchrony. It hereby provides functional and mechanistic explanations of data ranging from individual spikes and their synchronization to the dynamics of conscious perceptual, cognitive, and cognitive-emotional experiences. ART has reached sufficient maturity to begin classifying the brain resonances that support conscious experiences of seeing, hearing, feeling, and knowing. Psychological and neurobiological data in both normal individuals and clinical patients are clarified by this classification. This analysis also explains why not all resonances become conscious, and why not all brain dynamics are resonant. The global organization of the brain into computationally complementary cortical processing streams (complementary computing), and the organization of the cerebral cortex into characteristic layers of cells (laminar computing), figure prominently in these explanations of conscious and unconscious processes. Alternative models of consciousness are also discussed.