Method to Quickly Map Multifocal Pupillary Response Fields (mPRF) Using Frequency Tagging

We present a method for mapping multifocal Pupillary Response Fields in a short amount of time using a visual stimulus covering 40° of the visual angle divided into nine contiguous sectors simultaneously modulated in luminance at specific, incommensurate, temporal frequencies. We test this multifocal Pupillary Frequency Tagging (mPFT) approach with young healthy participants (N = 36) and show that the spectral power of the sustained pupillary response elicited by 45 s of fixation of this multipartite stimulus reflects the relative contribution of each sector/frequency to the overall pupillary response. We further analyze the phase lag for each temporal frequency as well as several global features related to pupil state. Test/retest performed on a subset of participants indicates good repeatability. We also investigate the existence of structural (RNFL)/functional (mPFT) relationships. We then summarize the results of clinical studies conducted with mPFT on patients with neuropathies and retinopathies and show that the features derived from pupillary signal analyses, the distribution of spectral power in particular, are homologous to disease characteristics and allow for sorting patients from healthy participants with excellent sensitivity and specificity. This method thus appears as a convenient, objective, and fast tool for assessing the integrity of retino-pupillary circuits as well as idiosyncrasies and permits to objectively assess and follow-up retinopathies or neuropathies in a short amount of time.

[Assessment of a pupillometric method for the screening of glaucoma]

BACKGROUND

Glaucoma is a progressive optic neuropathy, remaining asymptomatic for a long time, which makes its early diagnosis difficult. Visual field testing is still the gold standard but is less than ideal. The goal of this study is to assess a pupillometric test, administered passively to the subject for one minute, to measure its sensitivity and specificity in the classification of healthy eyes and glaucomatous eyes, and to evaluate its tolerability compared to visual field testing.

METHODS

Forty-five participants were included in this single-center, interventional, prospective study. They underwent 3 monocular pupillometric tests with light stimulation: 6 pupillary responses were recorded during full-field multifocal stimulation (performed twice) and pupillary hippus cycle study.

RESULTS

Analysis of spectral power and pupillary measurements with full-field multifocal stimulation provides a 0.94 sensitivity and a 0.88 specificity, a virtually perfect discrimination for early stages of glaucoma. Analysis of pupil cycle time provides a 0.92 sensitivity and a 0.88 specificity for early stages. Acceptability of this test by patients is superior to visual field testing.

CONCLUSION

These results show that data from our pupillometric recordings provide a good classification of healthy and glaucomatous eyes and must be confirmed on a larger population.

Jumpy and Jerky: When Peripheral Vision Faces Reverse-Phi

When an annulus in fast apparent motion reverses its contrast over time, the foveal and peripheral percepts are strikingly different. In central vision, the annulus appears to follow the same path as an annulus without flicker, whereas in the periphery, the stimulus seems to randomly jump across the screen. The illusion strength depends on motion speed and reversal rate. Our observations suggest that it results from a balance between conflicting phi and reverse-phi motion, positional uncertainty, and attention. In addition to illustrating the differences between central and peripheral motion processing, this illusion shows that both discrete positional sampling and motion energy combine to generate motion percepts, although with eccentricity dependent weights that are themselves affected by attention.

Cursive Eye-Writing With Smooth-Pursuit Eye-Movement Is Possible in Subjects With Amyotrophic Lateral Sclerosis

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disorder causing a progressive motor weakness of all voluntary muscles, whose progression challenges communication modalities such as handwriting or speech. The current study investigated whether ALS subjects can use Eye-On-Line (EOL), a novel eye-operated communication device allowing, after training, to voluntarily control smooth-pursuit eye-movements (SPEM) so as to eye-write in cursive. To that aim, ALS participants (n = 12) with preserved eye-movements but impaired handwriting were trained during six on-site visits. The primary outcome of the study was the recognition of eye-written digits (0-9) from ALS and healthy control subjects by naïve "readers." Changes in oculomotor performance and the safety of EOL were also evaluated. At the end of the program, 69.4% of the eye-written digits from 11 ALS subjects were recognized by naïve readers, similar to the 67.3% found for eye-written digits from controls participants, with however, large inter-individual differences in both groups of "writers." Training with EOL was associated with a transient fatigue leading one ALS subject to drop out the study at the fifth visit. Otherwise, itching eyes was the most common adverse event (3 subjects). This study shows that, despite the impact of ALS on the motor system, most ALS participants could improve their mastering of eye-movements, so as to produce recognizable eye-written digits, although the eye-traces sometimes needed smoothing to ease digit legibility from both ALS subjects and control participants. The capability to endogenously and voluntarily generate eye-traces using EOL brings a novel way to communicate for disabled individuals, allowing creative personal and emotional expression.

Effects of pupillary responses to luminance and attention on visual spatial discrimination

The optic quality of the eyes is, at least in part, determined by pupil size. Large pupils let more light enter the eyes, but degrade the point spread function, and thus the spatial resolution that can be achieved (Campbell & Gregory, 1960). In natural conditions, the pupil is mainly driven by the luminance (and possibly the color and contrast) at the gazed location, but is also modulated by attention and cognitive factors. Whether changes in eyes' optics related to pupil size modulation by luminance and attention impacts visual processing was assessed in two experiments. In Experiment 1, we measured pupil size using a constantly visible display made of four disks with different luminance levels, with no other task than fixating the disks in succession. The results confirmed that pupil size depends on the luminance of the gazed stimulus. Experiment 2, using similar settings as Experiment 1, used a two-interval forced-choice design to test whether discriminating high spatial frequencies that requires covert attention to parafoveal stimuli is better during the fixation of bright disks that entails a small pupil size, and hence better eyes' optics, as compared to fixating dark disks that entails a large pupil size, and hence poorer eyes' optics. As in Experiment 1, we observed large modulations of pupil size depending on the luminance of the gazed stimulus, but pupil dynamics was more variable, with marked pupil dilation during stimulus encoding, presumably because the demanding spatial frequency discrimination task engaged attention. However, discrimination performance and mean pupil size were not correlated. Despite this lack of correlation, the slopes of pupil dilation during stimulus encoding were correlated to performance, while the slopes of pupil dilation during decision-making were not. We discuss these results regarding the possible functional roles of pupil size modulations.

A novel method of inducing endogenous pupil oscillations to detect patients with unilateral optic neuritis

Purpose

To use and test a new method of inducing endogenously generated pupillary oscillations (POs) in patients with unilateral optic neuritis (ON), to describe a signal analysis approach quantifying pupil activity and to evaluate the extent to which POs permit to discriminate patients from control participants.

Method

Pupil size was recorded with an eye-tracker and converted in real time to modulate the luminance of a stimulus (a 20° disk) presented in front of participants. With this biofeedback setting, an increasing pupil size transforms into a high luminance, entraining a pupil constriction that in turn decreases the stimulus luminance, and so on, resulting in endogenously generated POs. POs were recorded for 30 seconds in the affected eye, in the fellow eye and in binocular conditions with 22 patients having a history of unilateral ON within a period of 5 years, and with 22 control participants. Different signal analysis methods were used to quantify the power and frequency of POs.

Results

On average, pupil size oscillated at around 1 Hz. The amplitude of POs appears not to be a reliable marker of ON. In contrast, the frequency of POs was significantly lower, and was more variable over time, in the patients’ affected eye, as compared to their fellow eye and to the binocular condition. No such differences were found in control participants. Receiver operating characteristic analyses based on the frequency and the variability of POs to classify patients and control participants gave an area under the curve of 0.82, a sensitivity of 82% (95%CI: 60%-95%) and a specificity of 77% (95%CI: 55%-92%).

Conclusions

The new method used to induce POs allowed characterizing the visual afferent pathway defect in ON patients with encouraging accuracy. The method was fast, easy to use, only requiring that participants look ahead, and allows testing many stimulus parameters (e.g. color, stimulus location, size, etc).

Revolution of Alzheimer Precision Neurology. Passageway of Systems Biology and Neurophysiology

The Precision Neurology development process implements systems theory with system biology and neurophysiology in a parallel, bidirectional research path: a combined hypothesis-driven investigation of systems dysfunction within distinct molecular, cellular, and large-scale neural network systems in both animal models as well as through tests for the usefulness of these candidate dynamic systems biomarkers in different diseases and subgroups at different stages of pathophysiological progression. This translational research path is paralleled by an "omics"-based, hypothesis-free, exploratory research pathway, which will collect multimodal data from progressing asymptomatic, preclinical, and clinical neurodegenerative disease (ND) populations, within the wide continuous biological and clinical spectrum of ND, applying high-throughput and high-content technologies combined with powerful computational and statistical modeling tools, aimed at identifying novel dysfunctional systems and predictive marker signatures associated with ND. The goals are to identify common biological denominators or differentiating classifiers across the continuum of ND during detectable stages of pathophysiological progression, characterize systems-based intermediate endophenotypes, validate multi-modal novel diagnostic systems biomarkers, and advance clinical intervention trial designs by utilizing systems-based intermediate endophenotypes and candidate surrogate markers. Achieving these goals is key to the ultimate development of early and effective individualized treatment of ND, such as Alzheimer's disease. The Alzheimer Precision Medicine Initiative (APMI) and cohort program (APMI-CP), as well as the Paris based core of the Sorbonne University Clinical Research Group "Alzheimer Precision Medicine" (GRC-APM) were recently launched to facilitate the passageway from conventional clinical diagnostic and drug development toward breakthrough innovation based on the investigation of the comprehensive biological nature of aging individuals. The APMI movement is gaining momentum to systematically apply both systems neurophysiology and systems biology in exploratory translational neuroscience research on ND.

Continuous Auditory Feedback of Eye Movements: An Exploratory Study toward Improving Oculomotor Control

As eye movements are mostly automatic and overtly generated to attain visual goals, individuals have a poor metacognitive knowledge of their own eye movements. We present an exploratory study on the effects of real-time continuous auditory feedback generated by eye movements. We considered both a tracking task and a production task where smooth pursuit eye movements (SPEM) can be endogenously generated. In particular, we used a visual paradigm which enables to generate and control SPEM in the absence of a moving visual target. We investigated whether real-time auditory feedback of eye movement dynamics might improve learning in both tasks, through a training protocol over 8 days. The results indicate that real-time sonification of eye movements can actually modify the oculomotor behavior, and reinforce intrinsic oculomotor perception. Nevertheless, large inter-individual differences were observed preventing us from reaching a strong conclusion on sensorimotor learning improvements.

Sustained smooth pursuit eye movements with eye-induced reverse-phi motion

The gain and speed of smooth pursuit eye movements quickly drop whenever a moving tracked target disappears behind an occluder. The present study tests to what extent pursuit maintenance after target disappearance depends on the occluder's characteristics. In all experiments, a target moving for 2500 ms, (or 1250 ms) at 13.3°/s (or 26.6°/s), disappears behind an occluder for 700 ms (or 350 ms). Participants are asked to maintain their pursuit eye movements as long as possible after target disappearance. Experiment 1 compares smooth pursuit with four types of occluders and shows that a texture of flickering disks allows maintaining pursuit for long durations. Experiment 2 investigates the capability to maintain pursuit with occluders of varying flickering frequencies (3, 5, 10, 20, and 30 Hz). It is found that after target disappearance, smooth pursuit is maintained for longer durations with flicker at 10 and 20 Hz, relative to other flickering frequencies (3, 5, and 30 Hz). Experiment 3 tests whether disk size and disk density of a flickering occluding texture influence smooth pursuit maintenance. Finally, Experiment 4 tests the influence of the contrast distribution of the flickering disks on pursuit maintenance. Altogether, the results show that individuals can maintain smooth pursuit for long durations after target disappearance behind an occluding texture of disks flickering at temporal frequency above 5 Hz with balanced contrast. It is suggested that eye-induced reverse-phi motion responses in MT/MST neurons provide a positive visual feedback to the pursuit system, allowing generating smooth pursuit in the absence of explicit stimulus motion.

Smooth Pursuit of a Partially Occluded Object

There has long been qualitative evidence that humans can pursue an object defined only by the motion of its parts (eg Steinbach, 1976 Vision Research16 1371 – 1375). We explored this quantitatively using an occluded diamond stimulus (Lorenceau and Shiffrar, 1992 Vision Research32 263 – 275). Four subjects (one naive) tracked a line-figure diamond moving along an elliptical path (0.9 Hz) either clockwise (CW) or counterclockwise (CCW) behind either an X-shaped aperture (CROSS) or two vertical rectangular apertures (BARS), which obscured the corners. Although the stimulus consisted of only four line segments (108 cd m−2), moving within a visible aperture (0.2 cd m−2) behind a foreground (38 cd m−2), it is largely perceived as a coherently moving diamond. The intersaccadic portions of eye-position traces were fitted with sinusoids. All subjects tracked object motion with considerable temporal accuracy. The mean phase lag was 5°/6° (CROSS/BARS) and the mean relative phase between the horizontal and vertical components was +95°/+92° (CW) and −85°/−75° (CCW), which is close to perfect. Furthermore, a \chi2 analysis showed that 56% of BARS trials were consistent with tracking the correct elliptical shape ( p<0.05), although segment motion was purely vertical. These data disprove the main tenet of most models of pursuit: that it is a system that seeks to minimise retinal image motion through negative feedback. Rather, the main drive must be a visual signal which has already integrated spatiotemporal retinal information into an object-motion signal.

OB3D, a new set of 3D objects available for research: a web-based study

Studying object recognition is central to fundamental and clinical research on cognitive functions but suffers from the limitations of the available sets that cannot always be modified and adapted to meet the specific goals of each study. We here present a new set of 3D scans of real objects available on-line as ASCII files, OB3D. These files are lists of dots, each defined by a triplet of spatial coordinates and their normal that allow simple and highly versatile transformations and adaptations. We performed a web-based experiment to evaluate the minimal number of dots required for the denomination and categorization of these objects, thus providing a reference threshold. We further analyze several other variables derived from this data set, such as the correlations with object complexity. This new stimulus set, which was found to activate the Lower Occipital Complex (LOC) in another study, may be of interest for studies of cognitive functions in healthy participants and patients with cognitive impairments, including visual perception, language, memory, etc.

Impaired saccadic eye movement in primary open-angle glaucoma

PURPOSE

Our study aimed at investigating the extent to which saccadic eye movements are disrupted in patients with primary open-angle glaucoma (POAG). This approach followed upon the discovery of differences in the eye-movement behavior of POAG patients during the exploration of complex visual scenes.

METHODS

The eye movements of 8 POAG patients and 4 healthy age-matched controls were recorded. Four of the patients had documented visual field scotoma, and 4 had no identifiable scotoma on visual field testing. The eye movements were monitored as the observers watched static and kinetic targets. The gain, latency, and velocity-peak latency of the saccades recorded were then analyzed.

RESULTS

In POAG patients, with abnormal visual fields, watching a static target, the saccades were delayed and their accuracy was reduced, compared with those of normal observers. In POAG patients, with normal and abnormal visual fields, watching a kinetic target, a task involving precise motion analysis, the latency and accuracy of the saccades were impaired, compared with those of normal observers.

CONCLUSIONS

Our findings suggest that POAG alters saccade programming and execution particularly in the case of moving targets.

Beta, but not gamma, band oscillations index visual form-motion integration

Electrophysiological oscillations in different frequency bands co-occur with perceptual, motor and cognitive processes but their function and respective contributions to these processes need further investigations. Here, we recorded MEG signals and seek for percept related modulations of alpha, beta and gamma band activity during a perceptual form/motion integration task. Participants reported their bound or unbound perception of ambiguously moving displays that could either be seen as a whole square-like shape moving along a Lissajou's figure (bound percept) or as pairs of bars oscillating independently along cardinal axes (unbound percept). We found that beta (15–25 Hz), but not gamma (55–85 Hz) oscillations, index perceptual states at the individual and group level. The gamma band activity found in the occipital lobe, although significantly higher during visual stimulation than during base line, is similar in all perceptual states. Similarly, decreased alpha activity during visual stimulation is not different for the different percepts. Trial-by-trial classification of perceptual reports based on beta band oscillations was significant in most observers, further supporting the view that modulation of beta power reliably index perceptual integration of form/motion stimuli, even at the individual level.

A Bayesian computational model for online character recognition and disability assessment during cursive eye writing

This research involves a novel apparatus, in which the user is presented with an illusion inducing visual stimulus. The user perceives illusory movement that can be followed by the eye, so that smooth pursuit eye movements can be sustained in arbitrary directions. Thus, free-flow trajectories of any shape can be traced. In other words, coupled with an eye-tracking device, this apparatus enables “eye writing,” which appears to be an original object of study. We adapt a previous model of reading and writing to this context. We describe a probabilistic model called the Bayesian Action-Perception for Eye On-Line model (BAP-EOL). It encodes probabilistic knowledge about isolated letter trajectories, their size, high-frequency components of the produced trajectory, and pupil diameter. We show how Bayesian inference, in this single model, can be used to solve several tasks, like letter recognition and novelty detection (i.e., recognizing when a presented character is not part of the learned database). We are interested in the potential use of the eye writing apparatus by motor impaired patients: the final task we solve by Bayesian inference is disability assessment (i.e., measuring and tracking the evolution of motor characteristics of produced trajectories). Preliminary experimental results are presented, which illustrate the method, showing the feasibility of character recognition in the context of eye writing. We then show experimentally how a model of the unknown character can be used to detect trajectories that are likely to be new symbols, and how disability assessment can be performed by opportunistically observing characteristics of fine motor control, as letter are being traced. Experimental analyses also help identify specificities of eye writing, as compared to handwriting, and the resulting technical challenges.

Repetition blindness for natural images of objects with viewpoint changes

When stimuli are repeated in a rapid serial visual presentation (RSVP), observers sometimes fail to report the second occurrence of a target. This phenomenon is referred to as “repetition blindness” (RB). We report an RSVP experiment with photographs in which we manipulated object viewpoints between the first and second occurrences of a target (0°, 45°, or 90° changes), and spatial frequency (SF) content. Natural images were spatially filtered to produce low, medium, or high SF stimuli. RB was observed for all filtering conditions. Surprisingly, for full-spectrum (FS) images, RB increased significantly as the viewpoint reached 90°. For filtered images, a similar pattern of results was found for all conditions except for medium SF stimuli. These findings suggest that object recognition in RSVP are subtended by viewpoint-specific representations for all spatial frequencies except medium ones.

Speeding up the brain: when spatial facilitation translates into latency shortening

Waves of activity following a focal stimulation are reliably observed to spread across the cortical tissue. The origin of these waves remains unclear and the underlying mechanisms and function are still debated. In this study, we ask whether waves of activity modulate the magnetoencephalography (MEG) signals recorded in humans during visual stimulation with Gabor patches sequentially flashed along a vertical path, eliciting a perception of vertical apparent motion. Building upon the functional properties of long-rang horizontal connections, proposed to contribute to spreading activity, we specifically probe the amplitude and latency of MEG responses as a function of Gabor contrast and orientation. The results indicate that in the left hemisphere the response amplitude is enhanced and the half height response latency is shortened for co-aligned Gabor as compared to misaligned Gabor patches at a low but not at a high contrast. Building upon these findings, we develop a biologically plausible computational model that performs a “spike time alignment” of the responses to elongated contours with varying contrast, endowing them with a phase advance relative to misaligned contours.

Magnetoencephalographic signatures of visual form and motion binding

This study investigates neural magneto-encephalographic (MEG) correlates of visual form and motion binding. Steady-state visual evoked fields (SSVEF) were recorded in MEG while observers reported their bound or unbound perception of moving bars arranged in a square shape. By using pairs of oscillating vertical and horizontal bars, "frequency-tagged" at f1 and f2, we identified a region with enhanced sustained power at 2f1+2f2 intermodulation frequency correlated with perceptual reports. Intermodulation power is more important during perceptual form/motion integration than during the perceptual segmentation of the stimulus into individual component motions, indicating that intermodulation frequency power is a neuromarker of form/motion integration. Source reconstruction of cortical activities at the relevant frequencies further reveals well segregated activity in the occipital lobe at the fundamental of the stimulation, f1 and f2, widely spread activity at 2f1 and 2f2 and a focal activity in the medial part of the right precentral sulcus region at the intermodulation component, 2f1+2f2. The present findings indicate that motion tagging provides a powerful way of investigating the processes underlying visual form/motion binding non-invasively in humans.

Phase delays within visual cortex shape the response to steady-state visual stimulation

Although the spatial organization of visual areas can be revealed by functional Magnetic Resonance Imaging (fMRI), the synoptic, non-invasive access to the temporal characteristics of the information flow amongst distributed visual processes remains a technical and methodological challenge. Using frequency-encoded steady-state visual stimulation together with a combination of time-resolved functional magnetic source imaging from magnetoencephalography (MEG) and anatomical magnetic resonance imaging (MRI), this study evidences maps of visuotopic sustained oscillatory neural responses distributed across the visual cortex. Our results further reveal relative phase delays across responding striate and extra-striate visual areas, which thereby shape the chronometry of neural processes amongst these regions. The methodology developed in this study points at further developments in time-resolved analyses of distributed visual processes in the millisecond range, and to new ways of exploring the dynamics of functional processes within the human visual cortex non-invasively.

Pupil dynamics during bistable motion perception

Pupil size not only varies to changes in illumination but is also modulated by several cognitive factors, making it a potentially versatile physiological marker of cortical states. We recorded pupil dynamics while subjects continuously reported their bistable perception of ambiguous moving stimuli, plaids, and partially occluded rotating diamonds. We observed small (about 5% of surface change on average) but reliable pupil dilation around (-300 ms to 1.5 s) the button presses indicating the changes of percepts. We found that 70% of pupil dilation could be accounted for by the motor response. The remaining perceptual component was similar for spontaneously occurring transitions and transitions triggered by physical stimulus manipulations. Moreover, the amplitude of pupil modulation in the spontaneous condition was unrelated to the duration of each perceptual state. It is therefore unlikely that the mechanisms of endogenous perceptual bistability reflect in the pupil. In addition, we measured a clear constriction of the pupil after blinks (about 8% of surface change on average). As pupil changes have the potential to entail retino-cortical activity, their monitoring in studies of visual processing could prove worthwhile.

Shape and motion interactions at perceptual and attentional levels during processing of structure from motion stimuli

This study uses a rapid-serial-visual-presentation (RSVP) paradigm to test the extent to which shape and motion direction can be independently accessed and processed during the perception of structure-from-motion (SFM) stimuli. Subjects reported the number of occurrences of shape or motion direction during RSVP sequences of 3D-SFM stimuli. Overall, performance was better for motion than shape. In the motion task, observers were less accurate when the motion direction was repeated revealing a repetition blindness (RB) effect. In addition, the repetition of shape, although irrelevant to the motion task, resulted in increased performance, without change in RB rate. In contrast, there was no RB at the group level in the shape task and the repetition of the irrelevant motion direction had no effect on the performance. A closer look at the data showed that observers fall in two statistically distinct groups for the shape task. Some observers (N = 6) show a repetition advantage (RA) while the others (N = 5) show a repetition blindness (RB) effect. No behavioral differences between groups could be found for the motion task. The implications of these results for models of SFM processing are discussed in the light of the type/token theory (N. Kanwisher, 2001).

Superposition catastrophe and form-motion binding

Numerous studies indicate that perceiving global object motion results from the integration of local component motions across space and time. Less attention has been paid to the issue of motion selection, necessary to avoid spurious associations of component motions belonging to different objects and to solve the so-called "superposition catastrophe problem" (F. Rosenblatt, 1961). We address this issue using outlines of geometrical shapes moving behind apertures that concealed their vertices such that recovering their global motion requires the selection and integration of some, but not all, component motions. Depending on which local motions are selected for motion integration, these stimuli yield the perception of either expansion/contraction, of global translation, or of segments moving independently. We show that the selection process depends on local and global stimulus parameters, including the local direction of figure's line-endings or the spatial configuration of component motions. In contrast, motion selection depends less on the width-i.e., spatial frequency content-or polarity of the edges. Finally, synchronous temporal modulation of component motions in the gamma range has little effect on motion selection. These results indicate that selecting component motions for motion integration is primarily determined by form constraints. As a consequence, current models assuming that mutually consistent component motions are bounded in a velocity space-lacking spatial organization should be revised to account for the present data. Alternately, interactions between visual areas selectively processing form and motion could be introduced in order to account for the perceptual binding of moving objects.

Directional shifts in the barber pole illusion: Effects of spatial frequency, spatial adaptation, and lateral masking

We report the results of psychophysical experiments with the so-called barber pole stimulus providing new insights on the neuronal processes underlying the analysis of moving features such as terminators or line-endings. In experiment 1, we show that the perceived direction of a barber pole stimulus, induced by line-ending motion, is highly dependent on the spatial frequency and contrast of the grating stimulus: perceived direction is shifted away from the barber pole illusion at high spatial frequency in a contrast dependent way, suggesting that line-ends are not processed at high spatial scales. In subsequent experiments, we use a contrast adaptation paradigm and a masking paradigm in an attempt to assess the spatial structure and location of the receptive fields that process line-endings. We show that the adapting stimulus that weakens most the barber pole illusion is localized within the barber pole stimulus and not at line-endings' locations. Current models of line-endings' motion processing are discussed in the light of these psychophysical results.

Contour interactions between pairs of Gabors engaged in binocular rivalry reveal a map of the association field

A psychophysical study was conducted to investigate contour interactions (the 'association field'). Two Gabor patches were presented to one eye, with random-dot patches in corresponding locations of the other eye so as to produce binocular rivalry. Perceptual alternations of the two rivalry processes were monitored continuously by observers and the two time series were cross-correlated. The Gabors were oriented collinearly, obliquely, or orthogonally, and spatial separation was varied. A parallel condition was also included. Correlation between the rivalry processes strongly depended on separation and relative orientation. Correlations between adjacent collinear Gabors was near-perfect and reduced with spatial separation and as relative orientation departed from collinear. Importantly, variations in cross-correlation did not alter the rivalry processes (average dominance duration, and therefore alternation rate, was constant across conditions). Instead, synchronisation of rivalry oscillations accounts for the correlation variations: rivalry alternations were highly synchronised when contour interactions were strong and were poorly synchronised when contour interactions were weak. The level of synchrony between these two stochastic processes, in depending on separation and relative orientation, effectively reveals a map of the association field. These association fields are not greatly affected by contrast, and can be demonstrated between contours that are presented to separate hemispheres.

Dynamic competition between contour integration and contour segmentation probed with moving stimuli

Line-ends, corners and junctions are important singularities for form analysis, object recognition, depth ordering or motion processing. In this study, we investigate the extent to which processing the motion of line ends depends on the spatial configuration of their immediate surround. To that aim, we used two vertical collinear line segments, translating clockwise or anti-clockwise along a circular path, together with a direction discrimination task. Direction discrimination was measured independently for outer line-ends--at both segments extremities--and inner line-ends--in between collinear segments--using line segments partially occluded by invisible masks such that the direction of either inner or outer line-ends' motion was restricted to a sinusoidal translation along a horizontal axis, and thus irrelevant for the motion task. Under these conditions, access to the direction of inner line-ends is longer and more difficult than it is for outer line-ends. Subsequent experiments show that these effects depend on the degree of collinearity between line segments. Similar experiments were performed after volunteers took a dose of Lorazepam, a benzodiazepine that facilitates the fixation of GABA on GABAA receptors. The results show that the differences between the processing of inner and outer line-ends is reduced, suggesting that the effect of the surround is modulated by inhibitory mechanisms. Using a simple model, we propose that this effect can be explained by a competition between a segmentation process based on surround suppression and contour integration through long-range horizontal connections, at or prior to motion processing stages.

The "silent" surround of V1 receptive fields: theory and experiments

The spiking response of a primary visual cortical cell to a stimulus placed within its receptive field can be up- and down-regulated by the simultaneous presentation of objects or scenes placed in the "silent" regions which surround the receptive field. We here review recent progresses that have been made both at the experimental and theoretical levels in the description of these so-called "Center/Surround" modulations and in the understanding of their neural basis. Without denying the role of a modulatory feedback from higher cortical areas, recent results support the view that some of these phenomena result from the dynamic interplay between feedforward projections and horizontal intracortical connectivity in V1. Uncovering the functional role of the contextual periphery of cortical receptive fields has become an area of active investigation. The detailed comparison of electrophysiological and psychophysical data reveals strong correlations between the integrative behavior of V1 cells and some aspects of "low-level" and "mid-level" conscious perception. These suggest that as early as the V1 stage, the visual system is able to make use of contextual cues to recover local visual scene properties or correct their interpretation. Promising ideas have emerged on the importance of such a strategy for the coding of visual scenes, and the processing of static and moving objects.

Geometry and the visual brain

Receptive fields structure of neurons in primary visual cortex suggests that they process visual stimuli in the frequency domain, in a way similar to the frequency analysis performed in the auditory system. As a consequence, both psychophysicists and electrophysiologists have long probed the visual system using extended sine wave gratings that are well localized in the frequency domain but poorly defined in visual space. Meanwhile, how the brain processes the geometrical properties and the spatial and temporal relationships between stimulus parts has received less attention. Recent progress in visual neuroscience that uncovered long-range horizontal connections between cortical neurons and revealed the complex architecture of primary visual cortex and feedback connectivity led to new insights concerned with the processing of geometrical properties of visual stimuli in V1. This paper presents a short historical perspective of the emergence of new issues related to the cortical architecture and its functional consequences on the processing of geometrical properties.

Crossmodal integration for perception and action

The integration of information from different sensory modalities has many advantages for human observers, including increase of salience, resolution of perceptual ambiguities, and unified perception of objects and surroundings. Several behavioral, electrophysiological and neuroimaging data collected in various tasks, including localization and detection of spatial events, crossmodal perception of object properties and scene analysis are reviewed here. All the results highlight the multiple faces of crossmodal interactions and provide converging evidence that the brain takes advantages of spatial and temporal coincidence between spatial events in the crossmodal binding of spatial features gathered through different modalities. Furthermore, the elaboration of a multimodal percept appears to be based on an adaptive combination of the contribution of each modality, according to the intrinsic reliability of sensory cue, which itself depends on the task at hand and the kind of perceptual cues involved in sensory processing. Computational models based on bayesian sensory estimation provide valuable explanations of the way perceptual system could perform such crossmodal integration. Recent anatomical evidence suggest that crossmodal interactions affect early stages of sensory processing, and could be mediated through a dynamic recurrent network involving backprojections from multimodal areas as well as lateral connections that can modulate the activity of primary sensory cortices, though future behavioral and neurophysiological studies should allow a better understanding of the underlying mechanisms.

Orientation dependent modulation of apparent speed: a model based on the dynamics of feed-forward and horizontal connectivity in V1 cortex

Psychophysical and physiological studies suggest that long-range horizontal connections in primary visual cortex participate in spatial integration and contour processing. Until recently, little attention has been paid to their intrinsic temporal properties. Recent physiological studies indicate, however, that the propagation of activity through long-range horizontal connections is slow, with time scales comparable to the perceptual scales involved in motion processing. Using a simple model of V1 connectivity, we explore some of the implications of this slow dynamics. The model predicts that V1 responses to a stimulus in the receptive field can be modulated by a previous stimulation, a few milliseconds to a few tens of milliseconds before, in the surround. We analyze this phenomenon and its possible consequences on speed perception, as a function of the spatio-temporal configuration of the visual inputs (relative orientation, spatial separation, temporal interval between the elements, sequence speed). We show that the dynamical interactions between feed-forward and horizontal signals in V1 can explain why the perceived speed of fast apparent motion sequences strongly depends on the orientation of their elements relative to the motion axis and can account for the range of speed for which this perceptual effect occurs (Georges, Seriès, Frégnac and Lorenceau, this issue).

Orientation dependent modulation of apparent speed: psychophysical evidence

We report several experiments showing that a Gabor patch moving in apparent motion sequences appears much faster when its orientation is aligned with the motion path than when it is at an angle to it. This effect is very large and peaks at high speeds (64 degrees /s), decreases for higher and lower speeds and disappears at low speeds (4 degrees /s). This speed bias decreases as the angle between the motion axis and the orientation of the Gabor patch increases, but remains high for curvilinear paths, provided that element orientation is kept tangential to the motion trajectory. It is not accounted for by decision strategies relying on the overall length and duration of the motion sequence or the gap size (or spatial jump) between successive frames. We propose a simple explanation, thoroughly developed as a computational model in a companion paper (Seriès, Georges, Lorenceau & Frégnac: "Orientation dependent modulation of apparent speed: a model based on the dynamics of feedforward and horizontal connectivity in V1 cortex", this issue), according to which long-range horizontal connections in V1 elicit differential latency modulations in response to apparent motion sequences, whose read-out at an MT stage results in a perceptual speed bias. The consequences of these findings are discussed.

Perceptual grouping in the Ternus display: evidence for an 'association field' in apparent motion

We present psychophysical experiments designed to reveal the role of facilitative contour interactions (the so-called 'association field') in apparent motion. We use the Ternus display (a trio of horizontally aligned elements oscillating in apparent motion). This display is perceived in 'element' motion when interframe intervals (IFIs) are short, and in 'group' motion when IFIs are long. Using Gabor elements arranged collinearly or in parallel, IFI is varied to find group motion thresholds. Consistent with a role for collinearity in perceptual grouping, thresholds are lower for collinear displays. The collinear vs. parallel comparison is made while manipulating contrast, spatial frequency, eccentricity, phase, orientation jitter and element separation. Results show a clear effect of contrast not observed in lateral masking paradigms or in 'pathfinder' stimuli, with higher contrast promoting within-frame grouping, and evidence of facilitatory interactions among parallel elements (although over a smaller scale). The tendency for collinear displays to group more than parallel displays declined with eccentricity with no clear difference evident at 12 deg. These changes in group motion thresholds indicate changing association strengths among the elements and is accounted for in terms of an association field. Alternative accounts in terms of second-order collector units or visible persistence are considered but are not supported by the data.