Numerosity processing in early visual cortex

While parietal cortex is thought to be critical for representing numerical magnitudes, we recently reported an event-related potential (ERP) study demonstrating selective neural sensitivity to numerosity over midline occipital sites very early in the time course, suggesting the involvement of early visual cortex in numerosity processing. However, which specific brain area underlies such early activation is not known. Here, we tested whether numerosity-sensitive neural signatures arise specifically from the initial stages of visual cortex, aiming to localize the generator of these signals by taking advantage of the distinctive folding pattern of early occipital cortices around the calcarine sulcus, which predicts an inversion of polarity of ERPs arising from these areas when stimuli are presented in the upper versus lower visual field. Dot arrays, including 8-32dots constructed systematically across various numerical and non-numerical visual attributes, were presented randomly in either the upper or lower visual hemifields. Our results show that neural responses at about 90ms post-stimulus were robustly sensitive to numerosity. Moreover, the peculiar pattern of polarity inversion of numerosity-sensitive activity at this stage suggested its generation primarily in V2 and V3. In contrast, numerosity-sensitive ERP activity at occipito-parietal channels later in the time course (210-230ms) did not show polarity inversion, indicating a subsequent processing stage in the dorsal stream. Overall, these results demonstrate that numerosity processing begins in one of the earliest stages of the cortical visual stream.

Attractive Serial Dependence in the Absence of an Explicit Task

Attractive serial dependence refers to an adaptive change in the representation of sensory information, whereby a current stimulus appears to be similar to a previous one. The nature of this phenomenon is controversial, however, as serial dependence could arise from biased perceptual representations or from biased traces of working memory representation at a decisional stage. Here, we demonstrated a neural signature of serial dependence in numerosity perception emerging early in the visual processing stream even in the absence of an explicit task. Furthermore, a psychophysical experiment revealed that numerosity perception is biased by a previously presented stimulus in an attractive way, not by repulsive adaptation. These results suggest that serial dependence is a perceptual phenomenon starting from early levels of visual processing and occurring independently from a decision process, which is consistent with the view that these biases smooth out noise from neural signals to establish perceptual continuity.

Serial dependence in numerosity perception

Our conscious experience of the external world is remarkably stable and seamless, despite the intrinsically discontinuous and noisy nature of sensory information. Serial dependencies in visual perception-reflecting attractive biases making a current stimulus to appear more similar to previous ones-have been recently hypothesized to be involved in perceptual continuity. However, while these effects have been observed across a variety of visual features and at the neural level, several aspects of serial dependence and how it generalizes across visual dimensions is still unknown. Here we explore the behavioral signature of serial dependence in numerosity perception by assessing how the perceived numerosity of dot-array stimuli is biased by a task-irrelevant "inducer" stimulus presented before task-relevant stimuli. First, although prior work suggests that numerosity perception starts in the subcortex, the current study rules out a possible involvement of subcortical processing in serial dependence, confirming that the effect likely starts in the visual cortex. Second, we show that the effect is coarsely spatially localized to the position of the inducer stimulus. Third, we demonstrate that the effect is present even with a stimulus presentation procedure minimizing the involvement of post-perceptual processes, but only when participants actively pay attention to the inducer stimulus. Overall, these results provide a comprehensive characterization of serial dependencies in numerosity perception, demonstrating that attractive biases occur by means of spatially localized attentional modulations of early sensory activity.

Early Numerosity Encoding in Visual Cortex Is Not Sufficient for the Representation of Numerical Magnitude

Recent studies have demonstrated that the numerosity of visually presented dot arrays is represented in low-level visual cortex extremely early in latency. However, whether or not such an early neural signature reflects the perceptual representation of numerosity remains unknown. Alternatively, such a signature may indicate the raw sensory representation of the dot-array stimulus before becoming the perceived representation of numerosity. Here, we addressed this question by using the connectedness illusion, whereby arrays with pairwise connected dots are perceived to be less numerous compared with arrays containing isolated dots. Using EEG and fMRI in two independent experiments, we measured neural responses to dot-array stimuli comprising 16 or 32 dots, either isolated or pairwise connected. The effect of connectedness, which reflects the segmentation of the visual stimulus into perceptual units, was observed in the neural activity after 150 msec post stimulus onset in the EEG experiment and in area V3 in the fMRI experiment using a multivariate pattern analysis. In contrast, earlier neural activity before 100 msec and in area V2 was strictly modulated by numerosity regardless of connectedness, suggesting that this early activity reflects the sensory representation of a dot array before perceptual segmentation. Our findings thus demonstrate that the neural representation for numerosity in early visual cortex is not sufficient for visual number perception and suggest that the perceptual encoding of numerosity occurs at or after the segmentation process that takes place later in area V3.

Adaptation to number operates on perceived rather than physical numerosity

Humans share with many animals a number sense, the ability to estimate rapidly the approximate number of items in a scene. Recent work has shown that like many other perceptual attributes, numerosity is susceptible to adaptation. It is not clear, however, whether adaptation works directly on mechanisms selective to numerosity, or via related mechanisms, such as those tuned to texture density. To disentangle this issue we measured adaptation of numerosity of 10 pairs of connected dots, as connecting dots makes them appear to be less numerous than unconnected dots. Adaptation to a 20-dot pattern (same number of dots as the test) caused robust reduction in apparent numerosity of the connected-dot pattern, but not of the unconnected dot-pattern. This suggests that adaptation to numerosity, at least for relatively sparse dot-pattern, occurs at neural levels encoding perceived numerosity, rather than at lower levels responding to the number of elements in the scene.

Distinct Neural Signatures for Very Small and Very Large Numerosities

Behavioral studies of numerical cognition have shown that perceptual threshold for numerosity discrimination depends on the range of numerical values to be estimated. Discrimination threshold is constant when comparing very small numerosities via the mechanism called subitizing, while it increases as a function of numerosity for numbers beyond that range governed by subitizing. However, when numerosity gets so large that the individual elements start to form a cluttered ensemble, discrimination threshold increases as a function of the square root of numerosity. These behavioral patterns suggest that our sense of number is not based on a unitary mechanism and is rather based on multiple numerosity processing mechanisms depending on the absolute numerosity to be estimated. In this study, we demonstrate neurophysiological evidence for such multiple mechanisms. Participants’ electroencephalogram (EEG) was recorded while they viewed arrays containing either very small (1–4) or very large (100–400) number of dots with systematic variations in non-numerical cues. A linear model that tested the effects of numerical and non-numerical cues on the visual-evoked potentials (VEPs) revealed strong neural sensitivity to numerosity around 160–180 ms over right occipito-parietal sites irrespective of the numerical range presented. In contrast, earlier neural responses (~100 ms) showed markedly distinct patterns across the different numerical ranges tested. These results indicate that differences in behavioral response patterns in numerosity estimation across various numerical ranges may arise from the differences in the first stages of visual analysis. Collectively, the findings provide a firmer ground for the idea that there exists a brain system specifically dedicated for numerosity processing, yet they also suggest that multiple early visual cortical mechanisms converge to that numerosity processing stage later in the visual stream.

Motion-induced compression of perceived numerosity

It has been recently proposed that space, time, and number might share a common representation in the brain. Evidence supporting this idea comes from adaptation studies demonstrating that prolonged exposure to a given stimulus feature distorts the perception of different characteristics. For example, visual motion adaptation affects both perceived position and duration of subsequent stimuli presented in the adapted location. Here, we tested whether motion adaptation also affects perceived numerosity, by testing the effect of adaptation to translating or rotating stimuli moving either at high (20 Hz) or low (5 Hz) speed. Adaptation to fast translational motion yielded a robust reduction in the apparent numerosity of the adapted stimulus (~25%) while adaptation to slow translational or circular motion (either 20 Hz or 5 Hz) yielded a weaker but still significant compression. Control experiments suggested that none of these results could be accounted for in terms of stimulus masking. Taken together, our results are consistent with the extant literature supporting the idea of a generalized magnitude system underlying the representation of numerosity, space and time via common metrics. However, as changes in perceived numerosity co-varied with both adapting motion profile and speed, our evidence also suggests complex and asymmetric interactions between different magnitude representations.

Neural Dynamics of Serial Dependence in Numerosity Perception

Serial dependence—an attractive perceptual bias whereby a current stimulus is perceived to be similar to previously seen ones—is thought to represent the process that facilitates the stability and continuity of visual perception. Recent results demonstrate a neural signature of serial dependence in numerosity perception, emerging very early in the time course during perceptual processing. However, whether such a perceptual signature is retained after the initial processing remains unknown. Here, we address this question by investigating the neural dynamics of serial dependence using a recently developed technique that allowed a reactivation of hidden memory states. Participants performed a numerosity discrimination task during EEG recording, with task-relevant dot array stimuli preceded by a task-irrelevant stimulus inducing serial dependence. Importantly, the neural network storing the representation of the numerosity stimulus was perturbed (or pinged) so that the hidden states of that representation can be explicitly quantified. The results first show that a neural signature of serial dependence emerges early in the brain signals, starting soon after stimulus onset. Critical to the central question, the pings at a later latency could successfully reactivate the biased representation of the initial stimulus carrying the signature of serial dependence. These results provide one of the first pieces of empirical evidence that the biased neural representation of a stimulus initially induced by serial dependence is preserved throughout a relatively long period.

Serial dependence in time and numerosity perception is dimension-specific

The perception of a visual event (e.g., a flock of birds) at the present moment can be biased by a previous perceptual experience (e.g., the perception of an earlier flock). Serial dependence is a perceptual bias whereby a current stimulus appears more similar to a previous one than it actually is. Whereas serial dependence emerges within several visual stimulus dimensions, whether it could simultaneously operate across different dimensions of the same stimulus (e.g., the numerosity and the duration of a visual pattern) remains unclear. Here we address this question by assessing the presence of serial dependence across duration and numerosity, two stimulus dimensions that are often associated and can bias each other. Participants performed either a duration or a numerosity discrimination task, in which they compared a constant reference with a variable test stimulus, varying along the task-relevant dimension (either duration or numerosity). Serial dependence was induced by a task-irrelevant inducer, that is, a stimulus presented before the reference and always varying in both duration and numerosity. The results show systematic serial dependencies only within the task-relevant stimulus dimension, that is, stimulus numerosity affects numerosity perception only, and duration affects duration perception only. Additionally, at least in the numerosity condition, the task-irrelevant dimension of the inducer (duration) had an opposite, repulsive effect. These findings thus show that attractive serial dependence operates in a highly specific fashion and does not transfer across different stimulus dimensions. Instead, the repulsive influence, possibly reflecting perceptual adaptation, can transfer from one dimension to another.

Disentangling feedforward versus feedback processing in numerosity representation

Numerosity is a fundamental aspect of the external environment, needed to guide our behavior in an effective manner. Previous studies show that numerosity processing involves at least two temporal stages (~100 and ~150 msec after stimulus onset) in early visual cortex. One possibility is that the two stages reflect an initial feedforward processing followed by feedback signals from higher-order cortical areas that underlie segmentation of visual inputs into perceptual units that define numerosity. Alternatively, multiple stages of feedforward processing might progressively refine the input leading to the segmented representation. Here, we distinguish these two hypotheses by exploiting the connectedness illusion (i.e., the systematic underestimation of pairwise-connected dots), backward masking (to suppress feedback signals), and serial dependence (i.e., a perceptual bias making a stimulus appear to be more similar to its preceding one). Our results show that a connected dot array biases the numerosity representation of the subsequent dot array based on its illusory perception, irrespective of whether it is visible or suppressed by masking. These findings demonstrate that feedback processing is not strictly necessary for the perceptual segmentation that gives rise to perceived numerosity, and instead suggest that different stages of feedforward activity presumably carrying low and high spatial frequency information are sufficient to create a numerosity representation in early visual areas.

The specious interaction of time and numerosity perception

Magnitude information is essential to create a representation of the external environment and successfully interact with it. Duration and numerosity, for example, can shape our predictions and bias each other (i.e. the greater the number of people queuing, the longer we expect to wait). While these biases suggest the existence of a generalized magnitude system, asymmetric effects (i.e. numerosity affecting duration but not vice versa) challenged this idea. Here, we propose that such asymmetric integration depends on the stimuli used and the neural processing dynamics they entail. Across multiple behavioural experiments employing different stimulus presentation displays (static versus dynamic) and experimental manipulations known to bias numerosity and duration perceptions (i.e. connectedness and multisensory integration), we show that the integration between numerosity and time can be symmetrical if the stimuli entail a similar neural time-course and numerosity unfolds over time. Overall, these findings support the idea of a generalized magnitude system, but also highlight the role of early sensory processing in magnitude representation and integration.

The nature of magnitude integration: Contextual interference versus active magnitude binding

Magnitude dimensions such as duration and numerosity have been shown to systematically interact, biasing each other in a congruent fashion: the more numerous a set of items is, the longer it is perceived to last in time. This integration between dimensions plays an important role in defining how we perceive magnitude. So far, however, the nature of magnitude integration remains unclear. Is magnitude integration a contextual interference, occurring whenever different types of information are concurrently available in the visual field, or does it involve an active “binding” of the different dimensions of the same object? To address these possibilities, we measured the integration bias induced by numerosity on perceived duration, in two cases: with duration and numerosity conveyed by distinct stimuli, or by the same stimulus. We show that a congruent integration effect can be observed only when the two magnitudes belong to the same stimulus. Instead, when the two magnitudes are conveyed by distinct stimuli, we observed an opposite effect. These findings demonstrate for the first time that a congruent integration occurs only between the dimensions of the same stimulus, suggesting the involvement of an active mechanism integrating the different dimensions of the same object in a unified percept.

Decoding of Electroencephalogram Signals Shows No Evidence of a Neural Signature for Subitizing in Sequential Numerosity

Numerosity perception is largely governed by two mechanisms. The first so-called subitizing system allows one to enumerate a small number of items (up to three or four) without error. The second system allows only an approximate estimation of larger numerosities. Here, we investigate the neural bases of the two systems using sequentially presented numerosity. Sequential numerosity (i.e., the number of events presented over time) starts as a subitizable set but may eventually transition into a larger numerosity in the approximate estimation range, thus offering a unique opportunity to investigate the neural signature of that transition point, or subitizing boundary. If sequential numerosity is encoded by two distinct perceptual mechanisms (i.e., for subitizing and approximate estimation), neural representations of the sequentially presented items crossing the subitizing boundary should be sharply distinguishable. In contrast, if sequential numerosity is encoded by a single perceptual mechanism for all numerosities and subitizing is achieved through an external postperceptual mechanism, no such differences in the neural representations should indicate the subitizing boundary. Using the high temporal resolution of the EEG technique incorporating a multivariate decoding analysis, we found results consistent with the latter hypothesis: No sharp representational distinctions were observed between items across the subitizing boundary, which is in contrast with the behavioral pattern of subitizing. The results support a single perceptual mechanism encoding sequential numerosities, whereas subitizing may be supported by a postperceptual attentional mechanism operating at a later processing stage.

Perceptual history biases are predicted by early visual-evoked activity

What we see in the present is affected by what we saw in the recent past. Serial dependence - a bias making a current stimulus to appear more similar to a previous one - has been indeed shown to be ubiquitous in vision. At the neural level, serial dependence is accompanied by a signature of stimulus history (i.e., past stimulus information) emerging from early visual-evoked activity. However, whether this neural signature effectively reflects the behavioural bias is unclear. Here we address this question by assessing the neural (electrophysiological) and behavioural signature of stimulus history in human subjects (both male and female), in the context of numerosity, duration, and size perception. First, our results show that while the behavioural effect is task-dependent, its neural signature also reflects task-irrelevant dimensions of a past stimulus, suggesting a partial dissociation between the mechanisms mediating the encoding of stimulus history and the behavioural bias itself. Second, we show that performing a task is not a necessary condition to observe the neural signature of stimulus history, but that in the presence of an active task such a signature is significantly amplified. Finally, and more importantly, we show that the pattern of brain activity in a relatively early latency window (starting at ∼35-65 ms after stimulus onset) significantly predicts the behavioural effect. Overall, our results thus demonstrate that the encoding of past stimulus information in neural signals does indeed reflect serial dependence, and that serial dependence occurs at a relatively early level of visual processing.SIGNIFICANCE STATEMENT:What we perceive is determined not only by the information reaching our sensory organs, but also by the context in which the information is embedded in. What we saw in the recent past (perceptual history) can indeed modulate the perception of a current stimulus in an attractive way - a bias that is ubiquitous in vision. Here we show that this bias can be predicted by the pattern of brain activity reflecting the encoding of past stimulus information, very early after the onset of a stimulus. This in turn suggests that the integration of past and present sensory information mediating the attractive bias occurs early in the visual processing stream, and likely involves early visual cortices.

The divisive normalization model of visual number sense: model predictions and experimental confirmation

Our intuitive sense of number allows rapid estimation for the number of objects (numerosity) in a scene. How does the continuous nature of neural information processing create a discrete representation of number? A neurocomputational model with divisive normalization explains this process and existing data; however, a successful model should not only explain existing data but also generate novel predictions. Here, we experimentally test novel predictions of this model to evaluate its merit for explaining mechanisms of numerosity perception. We did so by consideration of the coherence illusion: the underestimation of number for arrays containing heterogeneous compared to homogeneous items. First, we established the existence of the coherence illusion for homogeneity manipulations of both area and orientation of items in an array. Second, despite the behavioral similarity, the divisive normalization model predicted that these two illusions should reflect activity in different stages of visual processing. Finally, visual evoked potentials from an electroencephalography experiment confirmed these predictions, showing that area and orientation coherence modulate brain responses at distinct latencies and topographies. These results demonstrate the utility of the divisive normalization model for explaining numerosity perception, according to which numerosity perception is a byproduct of canonical neurocomputations that exist throughout the visual pathway.

Effect of saccade automaticity on perisaccadic space compression

Briefly presented stimuli occurring just before or during a saccadic eye movement are mislocalized, leading to a compression of visual space toward the target of the saccade. In most cases this has been measured in subjects over-trained to perform a stereotyped and unnatural task where saccades are repeatedly driven to the same location, marked by a highly salient abrupt onset. Here, we asked to what extent the pattern of perisaccadic mislocalization depends on this specific context. We addressed this question by studying perisaccadic localization in a set of participants with no prior experience in eye-movement research, measuring localization performance as they practiced the saccade task. Localization was marginally affected by practice over the course of the experiment and it was indistinguishable from the performance of expert observers. The mislocalization also remained similar when the expert observers were tested in a condition leading to less stereotypical saccadic behavior-with no abrupt onset marking the saccade target location. These results indicate that perisaccadic compression is a robust behavior, insensitive to the specific paradigm used to drive saccades and to the level of practice with the saccade task.

The Mechanisms and Neural Signature of Time-averaged Numerosity Perception

The animal brain is endowed with an innate sense of number allowing to intuitively perceive the approximate quantity of items in a scene, or "numerosity." This ability is not limited to items distributed in space, but also to events unfolding in time and to the average numerosity of dynamic scenes. How the brain computes and represents the average numerosity over time, however, remains unclear. Here, we investigate the mechanisms and EEG signature of the perception of average numerosity over time. To do so, we used stimuli composed of a variable number (3-12) of briefly presented dot arrays (50 msec each) and asked participants to judge the average numerosity of the sequence. We first show that the weight of different portions of the stimuli in determining the judgment depends on how many arrays are included in the sequence itself: the longer the sequence, the lower the weight of the latest arrays. Second, we show systematic adaptation effects across stimuli in consecutive trials. Importantly, the EEG results highlight two processing stages whereby the amplitude of occipital ERPs reflects the adaptation effect (∼300 msec after stimulus onset) and the accuracy and precision of average numerosity judgments (∼450-700 msec). These two stages are consistent with processes involved with the representation of perceived average numerosity and with perceptual decision-making, respectively. Overall, our findings provide new evidence showing how the visual system computes the average numerosity of dynamic visual stimuli, and support the existence of a dedicated, relatively low-level perceptual mechanism mediating this process.