Targets but not flankers are suppressed in crowding as revealed by EEG frequency tagging

Perception of a visual target can strongly deteriorate in the presence of flanking elements (crowding). For example, adding lines next to a vernier makes vernier offset discrimination difficult. Crowding is often considered a bottleneck of low-level vision, determined by the unavoidable limitations of the early visual system. In accordance with this proposal, neural processing of the flankers should be impaired in crowding as much as that of the target. To test this prediction, we used steady-state visually evoked potentials (ssVEPs) to separate target responses from flanker responses. We presented a vernier target either alone or flanked by lines, which had the same color as the vernier or a different color. Crowding by same-color flankers was stronger than by different-color flankers. Mirroring the behavioral results, ssVEP amplitudes corresponding to the target were higher for different-color flankers than for same-color flankers. Flanker related ssVEPs, however, did not depend on crowding strength. It seems that target, but not flanker processing, is susceptible to crowding. In line with previous results, we suggest that crowding is not caused by low-level interferences but is linked to target-flanker grouping instead.

Does chronic nicotine consumption influence visual backward masking in schizophrenia and schizotypy?

Nicotine consumption is higher for people within the schizophrenia spectrum compared to controls. This observation supports the self-medication hypothesis, that nicotine relieves symptoms in, for example, schizophrenia patients. We tested whether performance in an endophenotype of schizophrenia (visual backward masking, VBM) is modulated by nicotine consumption in i) smoking and non-smoking schizophrenia patients, their first-degree relatives, and age-matched controls, ii) non-smoking and smoking university students, and iii) non-smoking, early and late onset nicotine smokers. Overall, our results confirmed that VBM deficits are an endophenotype of schizophrenia, i.e., deficits were highest in patients, followed by their relatives, students scoring high in Cognitive Disorganisation, and controls. Moreover, we found i) beneficial effects of chronic nicotine consumption on VBM performance, in particular with increasing age, and ii) little impact of clinical status alone or in interaction with nicotine consumption on VBM performance. Given the younger age of undergraduate students (up to 30 years) versus controls and patients (up to 66 years), we propose that age-dependent VBM deficits emerge when schizotypy effects are targeted in populations of a larger age range, but that nicotine consumption might counteract these deficits (supporting the self-medication hypothesis).

Schizophrenia patients and 22q11.2 deletion syndrome adolescents at risk express the same deviant patterns of resting state EEG microstates: A candidate endophenotype of schizophrenia

Schizophrenia is a complex psychiatric disorder and many of the factors contributing to its pathogenesis are poorly understood. In addition, identifying reliable neurophysiological markers would improve diagnosis and early identification of this disease. The 22q11.2 deletion syndrome (22q11DS) is one major risk factor for schizophrenia. Here, we show further evidence that deviant temporal dynamics of EEG microstates are a potential neurophysiological marker by showing that the resting state patterns of 22q11DS are similar to those found in schizophrenia patients. The EEG microstates are recurrent topographic distributions of the ongoing scalp potential fields with temporal stability of around 80 ms that are mapping the fast reconfiguration of resting state networks. Five minutes of high-density EEG recordings was analysed from 27 adult chronic schizophrenia patients, 27 adult controls, 30 adolescents with 22q11DS, and 28 adolescent controls. In both patient groups we found increased class C, but decreased class D presence and high transition probabilities towards the class C microstates. Moreover, these aberrant temporal dynamics in the two patient groups were also expressed by perturbations of the long-range dependency of the EEG microstates. These findings point to a deficient function of the salience and attention resting state networks in schizophrenia and 22q11DS as class C and class D microstates were previously associated with these networks, respectively. These findings elucidate similarities between individuals at risk and schizophrenia patients and support the notion that abnormal temporal patterns of EEG microstates might constitute a marker for developing schizophrenia.

Visual masking & schizophrenia

Visual masking is a frequently used tool in schizophrenia research. Visual masking has a very high sensitivity and specificity and masking paradigms have been proven to be endophenotypes. Whereas masking is a powerful technique to study schizophrenia, the underlying mechanisms are discussed controversially. For example, for more than 25 years, masking deficits of schizophrenia patients were mainly attributed to a deficient magno-cellular system (M-system). Here, we show that there is very little evidence that masking deficits are magno-cellular deficits. We will discuss the magno-cellular and other approaches in detail and highlight their pros and cons.

Crowding, grouping, and gain control in schizophrenia

Visual paradigms are versatile tools to investigate the pathophysiology of schizophrenia. Contextual modulation refers to a class of paradigms where a target is flanked by neighbouring elements, which either deteriorate or facilitate target perception. It is often proposed that contextual modulation is weakened in schizophrenia compared to controls, with facilitating contexts being less facilitating and deteriorating contexts being less deteriorating. However, results are mixed. In addition, facilitating and deteriorating effects are usually determined in different paradigms, making comparisons difficult. Here, we used a crowding paradigm in which both facilitation and deterioration effects can be determined all together. We found a main effect of group, i.e., patients performed worse in all conditions compared to controls. However, when we discounted for this main effect, facilitation and deterioration were well comparable to controls. Our results indicate that contextual modulation can be intact in schizophrenia patients.

Human and machine learning in non-Markovian decision making

Humans can learn under a wide variety of feedback conditions. Reinforcement learning (RL), where a series of rewarded decisions must be made, is a particularly important type of learning. Computational and behavioral studies of RL have focused mainly on Markovian decision processes, where the next state depends on only the current state and action. Little is known about non-Markovian decision making, where the next state depends on more than the current state and action. Learning is non-Markovian, for example, when there is no unique mapping between actions and feedback. We have produced a model based on spiking neurons that can handle these non-Markovian conditions by performing policy gradient descent [1]. Here, we examine the model's performance and compare it with human learning and a Bayes optimal reference, which provides an upper-bound on performance. We find that in all cases, our population of spiking neurons model well-describes human performance.

Crowding, grouping, and object recognition: A matter of appearance

In crowding, the perception of a target strongly deteriorates when neighboring elements are presented. Crowding is usually assumed to have the following characteristics. (a) Crowding is determined only by nearby elements within a restricted region around the target (Bouma's law). (b) Increasing the number of flankers can only deteriorate performance. (c) Target-flanker interference is feature-specific. These characteristics are usually explained by pooling models, which are well in the spirit of classic models of object recognition. In this review, we summarize recent findings showing that crowding is not determined by the above characteristics, thus, challenging most models of crowding. We propose that the spatial configuration across the entire visual field determines crowding. Only when one understands how all elements of a visual scene group with each other, can one determine crowding strength. We put forward the hypothesis that appearance (i.e., how stimuli look) is a good predictor for crowding, because both crowding and appearance reflect the output of recurrent processing rather than interactions during the initial phase of visual processing.

Small effects of smoking on visual spatiotemporal processing

Nicotine is an important stimulant that is involved in modulating many neuronal processes, including those related to vision. Nicotine is also thought to play a key role in schizophrenia: A genetic variation of the cholinergic nicotine receptor gene, alpha-7 subunit (CHRNA7) has been shown to be associated with stronger backward masking deficits in schizophrenic patients. In this study, we tested visual backward masking in healthy smokers and non-smokers to further understand the effects of nicotine on spatiotemporal vision. In the first study, we tested 48 participants, a group of non-smokers (n = 12) and three groups of regular smokers that were either nicotine deprived (n = 12), non-deprived (n = 12) or deprived but were allowed to smoke a cigarette directly before the start of the experiment (n = 12). Performance was similar across groups, except for some small negative effects in nicotine-deprived participants. In the second study, we compared backward masking performance between regular smokers and non-smokers for older (n = 37, 13 smokers) and younger (n = 67, 21 smokers) adults. Older adults performed generally worse than younger adults but there were no significant differences in performance between smokers and non-smokers. Taken together, these findings indicate that nicotine has no long-term negative effects on visual spatiotemporal processing as determined by visual backward masking.

The trail making test as a screening instrument for driving performance in older drivers; a translational research

BACKGROUND

In many countries, primary care physicians determine whether or not older drivers are fit to drive. Little, however, is known regarding the effects of cognitive decline on driving performance and the means to detect it. This study explores to what extent the trail making test (TMT) can provide indications to clinicians about their older patients' on-road driving performance in the context of cognitive decline.

METHODS

This translational study was nested within a cohort study and an exploratory psychophysics study. The target population of interest was constituted of older drivers in the absence of important cognitive or physical disorders. We therefore recruited and tested 404 home-dwelling drivers, aged 70 years or more and in possession of valid drivers' licenses, who volunteered to participate in a driving refresher course. Forty-five drivers also agreed to undergo further testing at our lab. On-road driving performance was evaluated by instructors during a 45 minute validated open-road circuit. Drivers were classified as either being excellent, good, moderate, or poor depending on their score on a standardized evaluation of on-road driving performance.

RESULTS

The area under the receiver operator curve for detecting poorly performing drivers was 0.668 (CI95% 0.558 to 0.778) for the TMT-A, and 0.662 (CI95% 0.542 to 0.783) for the TMT-B. TMT was related to contrast sensitivity, motion direction, orientation discrimination, working memory, verbal fluency, and literacy. Older patients with a TMT-A ≥ 54 seconds or a TMT-B ≥ 150 seconds have a threefold (CI95% 1.3 to 7.0) increased risk of performing poorly during the on-road evaluation. TMT had a sensitivity of 63.6%, a specificity of 64.9%, a positive predictive value of 9.5%, and a negative predictive value of 96.9%.

CONCLUSION

In screening settings, the TMT would have clinicians uselessly consider driving cessation in nine drivers out of ten. Given the important negative impact this could have on older drivers, this study confirms the TMT not to be specific enough for clinicians to justify driving cessation without complementary investigations on driving behaviors.

Why vision is not both hierarchical and feedforward

In classical models of object recognition, first, basic features (e.g., edges and lines) are analyzed by independent filters that mimic the receptive field profiles of V1 neurons. In a feedforward fashion, the outputs of these filters are fed to filters at the next processing stage, pooling information across several filters from the previous level, and so forth at subsequent processing stages. Low-level processing determines high-level processing. Information lost on lower stages is irretrievably lost. Models of this type have proven to be very successful in many fields of vision, but have failed to explain object recognition in general. Here, we present experiments that, first, show that, similar to demonstrations from the Gestaltists, figural aspects determine low-level processing (as much as the other way around). Second, performance on a single element depends on all the other elements in the visual scene. Small changes in the overall configuration can lead to large changes in performance. Third, grouping of elements is key. Only if we know how elements group across the entire visual field, can we determine performance on individual elements, i.e., challenging the classical stereotypical filtering approach, which is at the very heart of most vision models.

Visual crowding illustrates the inadequacy of local vs. global and feedforward vs. feedback distinctions in modeling visual perception

Experimentalists tend to classify models of visual perception as being either local or global, and involving either feedforward or feedback processing. We argue that these distinctions are not as helpful as they might appear, and we illustrate these issues by analyzing models of visual crowding as an example. Recent studies have argued that crowding cannot be explained by purely local processing, but that instead, global factors such as perceptual grouping are crucial. Theories of perceptual grouping, in turn, often invoke feedback connections as a way to account for their global properties. We examined three types of crowding models that are representative of global processing models, and two of which employ feedback processing: a model based on Fourier filtering, a feedback neural network, and a specific feedback neural architecture that explicitly models perceptual grouping. Simulations demonstrate that crucial empirical findings are not accounted for by any of the models. We conclude that empirical investigations that reject a local or feedforward architecture offer almost no constraints for model construction, as there are an uncountable number of global and feedback systems. We propose that the identification of a system as being local or global and feedforward or feedback is less important than the identification of a system's computational details. Only the latter information can provide constraints on model development and promote quantitative explanations of complex phenomena.

Invisibility and interpretation

Invisibility is often thought to occur because of the low-level limitations of the visual system. For example, it is often assumed that backward masking renders a target invisible because the visual system is simply too slow to resolve the target and the mask separately. Here, we propose an alternative explanation in which invisibility is a goal rather than a limitation and occurs naturally when making sense out of the plethora of incoming information. For example, we present evidence that (in)visibility of an element can strongly depend on how it groups with other elements. Changing grouping changes visibility. In addition, we will show that features often just appear to be invisible but are in fact visible in a way the experimenter is not aware of.

Different colors of light lead to different adaptation and activation as determined by high-density EEG

Light adaptation is crucial for coping with the varying levels of ambient light. Using high-density electroencephalography (EEG), we investigated how adaptation to light of different colors affects brain responsiveness. In a within-subject design, sixteen young participants were adapted first to dim white light and then to blue, green, red, or white bright light (one color per session in a randomized order). Immediately after both dim and bright light adaptation, we presented brief light pulses and recorded event-related potentials (ERPs). We analyzed ERP response strengths and brain topographies and determined the underlying sources using electrical source imaging. Between 150 and 261 ms after stimulus onset, the global field power (GFP) was higher after dim than bright light adaptation. This effect was most pronounced with red light and localized in the frontal lobe, the fusiform gyrus, the occipital lobe and the cerebellum. After bright light adaptation, within the first 100 ms after light onset, stronger responses were found than after dim light adaptation for all colors except for red light. Differences between conditions were localized in the frontal lobe, the cingulate gyrus, and the cerebellum. These results indicate that very short-term EEG brain responses are influenced by prior light adaptation and the spectral quality of the light stimulus. We show that the early EEG responses are differently affected by adaptation to different colors of light which may contribute to known differences in performance and reaction times in cognitive tests.

Is there a common factor for vision?

In cognition, common factors play a crucial role. For example, different types of intelligence are highly correlated, pointing to a common factor, which is often called g. One might expect that a similar common factor would also exist for vision. Surprisingly, no one in the field has addressed this issue. Here, we provide the first evidence that there is no common factor for vision. We tested 40 healthy students’ performance in six basic visual paradigms: visual acuity, vernier discrimination,two visual backward masking paradigms, Gabor detection, and bisection discrimination. One might expect that performance levels on these tasks would be highly correlated because some individuals generally have better vision than others due to superior optics,better retinal or cortical processing, or enriched visual experience. However, only four out of 15 correlations were significant, two of which were nontrivial. These results cannot be explained by high intraobserver variability or ceiling effects because test–retest reliability was high and the variance in our student population is commensurate with that from other studies with well sighted populations. Using a variety of tests (e.g., principal components analysis, Bayes theorem, test–retest reliability), we show the robustness of our null results. We suggest that neuroplasticity operates during everyday experience to generate marked individual differences. Our results apply only to the normally sighted population (i.e., restricted range sampling). For the entire population, including those with degenerate vision, we expect different results.

When crowding of crowding leads to uncrowding

In object recognition, features are thought to be processed in a hierarchical fashion from low-level analysis (edges and lines) to complex figural processing (shapes and objects). Here, we show that figural processing determines low-level processing. Vernier offset discrimination strongly deteriorated when we embedded a vernier in a square. This is a classic crowding effect. Surprisingly, crowding almost disappeared when additional squares were added. We propose that figural interactions between the squares precede low-level suppression of the vernier by the single square, contrary to hierarchical models of object recognition.

Association of the Nicotinic Receptor α7 Subunit Gene (CHRNA7) with Schizophrenia and Visual Backward Masking

The nicotinic system is involved in the pathophysiology of schizophrenia. However, very little is known about its genetic basis and how it relates to clinical symptoms and potentially pharmacological intervention. Here, we investigated five single nucleotide polymorphisms (SNPs) [rs3826029] [rs2337506] [rs982574] [rs904952] [rs2337980] of the cholinergic nicotinic receptor gene, alpha 7 subunit (CHRNA7) and their association to schizophrenia. We found an association with rs904952 (p = 0.009) in a German sample of 224 schizophrenic patients and 224 healthy control subjects. The same trend was shown in an independent Georgian sample of 50 schizophrenic patients, 57 first order unaffected relatives, and 51 healthy controls. In addition, visual backward masking (VBM), a sensitive test for early visual information processing, was assessed in the Georgian sample. In line with prior studies, VBM performance deficits were much more pronounced in schizophrenic patients and their unaffected relatives compared to healthy controls (schizophrenic patients: 156 ms; unaffected relatives: 60 ms; healthy controls: 33 ms). VBM was strongly correlated with SNP rs904952 (H[2] = 7.3, p = 0.026). Our results further support the notion that changes in the nicotinic system are involved in schizophrenia and open the avenue for pharmacological intervention.

Long-lasting visual integration of form, motion, and color as revealed by visual masking

When two similar visual stimuli are presented in rapid succession at the same location, they fuse. For example, a red and a green disk are perceived as one single yellow disk. Likewise, verniers with opposite offset directions are perceived as one vernier with an almost aligned vernier offset. In fusion, observers have no conscious access to the individual stimuli. Using transcranial magnetic stimulation (TMS), it has been shown that feature fusion for verniers can be modulated for about 400 ms in that either the first or the second vernier dominates the percept, depending on TMS onset. Here, we use light masks to modulate feature fusion for verniers, motion, and color. Our results are similar to the TMS experiment and show that individual visual features are stored for a substantial amount of time before they are integrated.

Schizophrenia and visual backward masking: a general deficit of target enhancement

The obvious symptoms of schizophrenia are of cognitive and psychopathological nature. However, schizophrenia affects also visual processing which becomes particularly evident when stimuli are presented for short durations and are followed by a masking stimulus. Visual deficits are of great interest because they might be related to the genetic variations underlying the disease (endophenotype concept). Visual masking deficits are usually attributed to specific dysfunctions of the visual system such as a hypo- or hyper-active magnocellular system. Here, we propose that visual deficits are a manifestation of a general deficit related to the enhancement of weak neural signals as occurring in all other sorts of information processing. We summarize previous findings with the shine-through masking paradigm where a shortly presented vernier target is followed by a masking grating. The mask deteriorates visual processing of schizophrenic patients by almost an order of magnitude compared to healthy controls. We propose that these deficits are caused by dysfunctions of attention and the cholinergic system leading to weak neural activity corresponding to the vernier. High density electrophysiological recordings (EEG) show that indeed neural activity is strongly reduced in schizophrenic patients which we attribute to the lack of vernier enhancement. When only the masking grating is presented, EEG responses are roughly comparable between patients and control. Our hypothesis is supported by findings relating visual masking to genetic deviants of the nicotinic α7 receptor (CHRNA7).

Electrophysiological evidence for ventral stream deficits in schizophrenia patients

Schizophrenic patients suffer from many deficits including visual, attentional, and cognitive ones. Visual deficits are of particular interest because they are at the fore-end of information processing and can provide clear examples of interactions between sensory, perceptual, and higher cognitive functions. Visual deficits in schizophrenic patients are often attributed to impairments in the dorsal (where) rather than the ventral (what) stream of visual processing. We used a visual-masking paradigm in which patients and matched controls discriminated small vernier offsets. We analyzed the evoked electroencephalography (EEG) responses and applied distributed electrical source imaging techniques to estimate activity differences between conditions and groups throughout the brain. Compared with controls, patients showed strongly reduced discrimination accuracy, confirming previous work. The behavioral deficits corresponded to pronounced decreases in the evoked EEG response at around 200 ms after stimulus onset. At this latency, patients showed decreased activity for targets in left parietal cortex (dorsal stream), but the decrease was most pronounced in lateral occipital cortex (in the ventral stream). These deficiencies occurred at latencies that reflect object processing and fine shape discriminations. We relate the reduced ventral stream activity to deficient top-down processing of target stimuli and provide a framework for relating the commonly observed dorsal stream deficiencies with the currently observed ventral stream deficiencies.

Self-motion perception training: thresholds improve in the light but not in the dark

We investigated perceptual learning in self-motion perception. Blindfolded participants were displaced leftward or rightward by means of a motion platform and asked to indicate the direction of motion. A total of eleven participants underwent 3,360 practice trials, distributed over twelve (Experiment 1) or 6 days (Experiment 2). We found no improvement in motion discrimination in both experiments. These results are surprising since perceptual learning has been demonstrated for visual, auditory, and somatosensory discrimination. Improvements in the same task were found when visual input was provided (Experiment 3). The multisensory nature of vestibular information is discussed as a possible explanation of the absence of perceptual learning in darkness.