Self as a prior: The malleability of Bayesian multisensory integration to social salience

Our everyday perceptual experiences are grounded in the integration of information within and across our senses. Due to this direct behavioural relevance, cross-modal integration retains a certain degree of contextual flexibility, even to social relevance. However, how social relevance modulates cross-modal integration remains unclear. To investigate possible mechanisms, Experiment 1 tested the principles of audio-visual integration for numerosity estimation by deriving a Bayesian optimal observer model with perceptual prior from empirical data to explain perceptual biases. Such perceptual priors may shift towards locations of high salience in the stimulus space. Our results showed that the tendency to over- or underestimate numerosity, expressed in the frequency and strength of fission and fusion illusions, depended on the actual event numerosity. Experiment 2 replicated the effects of social relevance on multisensory integration from Scheller & Sui, 2022 JEP:HPP, using a lower number of events, thereby favouring the opposite illusion through enhanced influences of the prior. In line with the idea that the self acts like a prior, the more frequently observed illusion (more malleable to prior influences) was modulated by self-relevance. Our findings suggest that the self can influence perception by acting like a prior in cue integration, biasing perceptual estimates towards areas of high self-relevance.

Silvia De Marchi (1929) on numerical estimation: A translation and commentary

Vittorio Benussi (1878-1927) is known for numerous studies on optical illusions, visual and haptic perception, spatial and time perception. In Padova, he had a brilliant student who carefully worked on the topic of how people estimate numerosity, Silvia De Marchi (1897-1936). Her writings have never been translated into English before. Here we comment on her work and life, characterized also by the challenges faced by women in academia. The studies on perception of numerosity from her thesis were published as an article in 1929. We provide a translation from Italian, a redrawing of its 23 illustrations and of the graphs. It shows an original experimental approach and an anticipation of what later became known as magnitude estimation.

Emergence of number sense through the integration of multimodal information: developmental learning insights from neural network models

Introduction

Associating multimodal information is essential for human cognitive abilities including mathematical skills. Multimodal learning has also attracted attention in the field of machine learning, and it has been suggested that the acquisition of better latent representation plays an important role in enhancing task performance. This study aimed to explore the impact of multimodal learning on representation, and to understand the relationship between multimodal representation and the development of mathematical skills.

Methods

We employed a multimodal deep neural network as the computational model for multimodal associations in the brain. We compared the representations of numerical information, that is, handwritten digits and images containing a variable number of geometric figures learned through single- and multimodal methods. Next, we evaluated whether these representations were beneficial for downstream arithmetic tasks.

Results

Multimodal training produced better latent representation in terms of clustering quality, which is consistent with previous findings on multimodal learning in deep neural networks. Moreover, the representations learned using multimodal information exhibited superior performance in arithmetic tasks.

Discussion

Our novel findings experimentally demonstrate that changes in acquired latent representations through multimodal association learning are directly related to cognitive functions, including mathematical skills. This supports the possibility that multimodal learning using deep neural network models may offer novel insights into higher cognitive functions.

Humans can sense large numbers of objects in a box by touch alone

Everyday experiences suggest that a container, such as a box of cereal, can convey pertinent information about the nature and quantity of its content. This study investigated how well people can judge large quantities of objects in a container through haptic perception. Stimuli consisted of plastic drinking straws cut to "small" (1.5 cm) or "big" (4.5 cm) pieces contained in plastic food containers. Participants performed both a magnitude estimation of the number of objects and a direct estimation of the proportion of the container perceived to be filled with objects. Overall, participants demonstrated considerable accuracy for both tasks and irrespective of the size of the content. Post-experiment interviews revealed three potential strategies. Participants either focused on the container's contents, the excess space in the container, or the perceived weight of the container (content).

Humans can sense small numbers of objects in a box by touch alone

Everyday experiences suggest that a container, such as a box of chocolate sprinkles, can convey pertinent information about the nature of its content. Despite the familiarity of the experience, we do not know whether people can perceive the number of objects in the container from touch alone and how accurately they can do so. In three experiments, participants handled containers holding between one and five objects and verbally estimated their number. Containers were small cardboard jewelry boxes, and objects were round beads of varying diameter and weight. Any useful visual and auditory cues were precluded. Experiment 1 demonstrated very accurate performance, provided the objects were of sufficient weight. Experiment 2 demonstrated that withholding information about the possible number of objects inside the container does not affect accuracy at a group level but does produce occasional overestimations at an individual level. Experiment 3 demonstrated that removing the weight cue leads to systematic underestimations but does not eliminate people's ability to distinguish between different numbers of objects in the container. This study contributes to a growing picture that container haptics is surprisingly capable.

Phenomenology, Quantity, and Numerosity

There are many situations in which we interact with collections of objects, from a crowd of people to a bowl of blackberries. There is an experience of the quantity of these items, although not a precise number, and we have this impression quickly and effortlessly. It can be described as an expressive property of the whole. In the literature, the study of this sense of numerosity has a long history, which is reviewed here with examples. I argue that numerosity is a direct perceptual experience, and that all experiences of numerosity, not only estimations, are affected by perceptual organisation.

Near-optimal integration of the magnitude information of time and numerosity

Magnitude information is often correlated in the external world, providing complementary information about the environment. As if to reflect this relationship, the perceptions of different magnitudes (e.g. time and numerosity) are known to influence one another. Recent studies suggest that such magnitude interaction is similar to cue integration, such as multisensory integration. Here, we tested whether human observers could integrate the magnitudes of two quantities with distinct physical units (i.e. time and numerosity) as abstract magnitude information. The participants compared the magnitudes of two visual stimuli based on time, numerosity, or both. Consistent with the predictions of the maximum-likelihood estimation model, the participants integrated time and numerosity in a near-optimal manner; the weight of each dimension was proportional to their relative reliability, and the integrated estimate was more reliable than either the time or numerosity estimate. Furthermore, the integration approached a statistical optimum as the temporal discrepancy of the acquisition of each piece of information became smaller. These results suggest that magnitude interaction arises through a similar computational mechanism to cue integration. They are also consistent with the idea that different magnitudes are processed by a generalized magnitude system.

Numerosity Comparison in Three Dimensions in the Case of Low Numerical Values

This study investigated the perception of numbers in humans in 3D stimuli. Recent research has shown that number processing relies on "number sense" for small values, in line with Weber's law. While previous studies have reported 3D numerosity overestimation mainly in higher numerical values, our experiment examined whether this phenomenon occurs at lower numerical values. We also explored whether the Weber ratio follows Weber's law when comparing 2D and 3D stimuli in terms of the number of elements. Observers were presented with pairs of stimuli on a monitor and were asked to identify the stimulus with a larger number of elements. Using the constant method, we calculated the point of subjective equality (PSE), just noticeable difference (JND), and Weber ratios from the collected data. As a result, it was confirmed that the phenomenon of over-estimation of 3D numerical values occurs even when the numerical values are small. Additionally, we observed that the Weber fraction adhered to Weber's law within the measured range. These findings contribute to the existing body of research, supporting the existence of distinct mechanisms for perceiving numerosity and density.

Mario Ponzo (1928) on perception of numerosity: A translation and commentary

Ponzo is a familiar name in psychology because of the illusion that takes his name. He had a long and productive career in Italy, and some of his work was translated for international journals already in his lifetime. However, few of these papers are available in English. We provide a commentary that considers how his name came to be associated with an illusion he did not discover. We explain the content of several papers, some of which are often cited in a wrong context in the literature (i.e., papers on touch mentioned in relation to the Ponzo illusion). More importantly, we discuss his contribution to the study of perceived numerosity, and provide a full translation of his important 1928 paper, including a redrawing of its 28 illustrations.

The more numerous the longer: how the integration between numerosity and time leads to a common neural response

If you are stuck in a traffic jam, the more numerous the queuing cars are, the longer you expect to wait. Time and numerosity are stimulus dimensions often associated in the same percept and whose interaction can lead to misjudgements. At brain level it is unclear to which extent time and numerosity recruit same/different neural populations and how their perceptual integration leads to changes in these populations' responses. Here we used high-spatial-resolution functional magnetic resonance imaging with neural model-based analyses to investigate how the topographic representations of numerosity and time change when these dimensions are varied together on the same visual stimulus in a congruent (the more numerous the items, the longer the display time) or incongruent manner. Compared to baseline conditions, where only one dimension was changed at a time, the variation of both stimulus dimensions led to changes in neural population responses that became more sensitive either to the two features or to one of them. Magnitude integration led also to degradation of topographies and shifts in response preferences. These changes were more pronounced in the comparison between parietal and frontal maps. Our results while pointing to partially distinct representations of time and numerosity show a common neural response to magnitude integration.

Spontaneous supra-modal encoding of number in the infant brain

The core knowledge hypothesis postulates that infants automatically analyze their environment along abstract dimensions, including numbers. According to this view, approximate numbers should be encoded quickly, pre-attentively, and in a supra-modal manner by the infant brain. Here, we directly tested this idea by submitting the neural responses of sleeping 3-month-old infants, measured with high-density electroencephalography (EEG), to decoders designed to disentangle numerical and non-numerical information. The results show the emergence, in approximately 400 ms, of a decodable number representation, independent of physical parameters, that separates auditory sequences of 4 vs. 12 tones and generalizes to visual arrays of 4 vs. 12 objects. Thus, the infant brain contains a number code that transcends sensory modality, sequential or simultaneous presentation, and arousal state.

Numerosity as a visual property: Evidence from two highly evolutionary distant species

Most animals, from humans to invertebrates, possess an ability to estimate numbers. This evolutionary advantage facilitates animals' choice of environments with more food sources, more conspecifics to increase mating success, and/or reduced predation risk among others. However, how the brain processes numerical information remains largely unknown. There are currently two lines of research interested in how numerosity of visual objects is perceived and analyzed in the brain. The first argues that numerosity is an advanced cognitive ability processed in high-order brain areas, while the second proposes that "numbers" are attributes of the visual scene and thus numerosity is processed in the visual sensory system. Recent evidence points to a sensory involvement in estimating magnitudes. In this Perspective, we highlight this evidence in two highly evolutionary distant species: humans and flies. We also discuss the advantages of studying numerical processing in fruit flies in order to dissect the neural circuits involved in and required for numerical processing. Based on experimental manipulation and the fly connectome, we propose a plausible neural network for number sense in invertebrates.

Underestimation of the number of hidden objects

The perceptual representation of our environment does not only involve what we actually can see, but also inferences about what is hidden from our sight. For example, in amodal completion, simple contours or surfaces are filled-in behind occluding objects allowing for a complete representation. This is important for many everyday tasks, such as visual search, foraging, and object handling. Although there is support for completion of simple patterns from behavioral and neurophysiological studies, it is unclear if these mechanisms extend to complex, irregular patterns. Here, we show that the number of hidden objects on partially occluded surfaces is underestimated. Observers did not consider accurately the number of visible objects and the proportion of occlusion to infer the number of hidden objects, although these quantities were perceived accurately and reliably. However, visible objects were not simply ignored: estimations of hidden objects increased when the visible objects formed a line across the occluder and decreased when the visible objects formed a line outside of the occluder. Confidence ratings for numerosity estimation were similar for fully visible and partially occluded surfaces. These results suggest that perceptual inferences about what is hidden in our environment can be very inaccurate und underestimate the complexity of the environment.

Does auditory numerosity and non-numerical magnitude affect visual non-symbolic numerical representation?

In the present study, we investigated the effects of auditory numerosity and magnitude (loudness) on visual numerosity processing. Participants compared numerosities of two sequential dot arrays. The second dot array was paired with a tone array that was independent of visual comparison. The numerosity (One-tone vs. Multiple-tone) and the non-numerical magnitude of tones (loudness) were manipulated in Experiments 1 and 2, respectively. In Experiment 1, participants' inverse efficiency score (IES), that is, the quotient between response time and accuracy, was significantly smaller in the One-tone and Multiple-tone conditions than that in the No-tone condition, and linear trend analyses showed that the IES decreased with the number of tones. In Experiment 2, the IES in the Loud-tone condition was significantly smaller than that in the No-tone condition, and the IES decreased as the loudness of the tones increased. In Experiment 3, both auditory numerosity and magnitude were manipulated. For soft tones, the IES was smaller in the Multiple-tone condition than in the One-tone condition, whereas no significant difference was found between two conditions in loud tones. In sum, these findings suggest that the visual numerical representation can be spontaneously affected by the numerosity and non-numerical magnitude of stimuli from another modality.

Visual adaptation reveals multichannel coding for numerosity

Visual numerosity is represented automatically and rapidly, but much remains unknown about the computations underlying this perceptual experience. For example, it is unclear whether numerosity is represented with an opponent channel or multichannel coding system. Within an opponent channel system, all numerical values are represented via the relative activity of two pools of neurons (i.e., one pool with a preference for small numerical values and one pool with a preference for large numerical values). However, within a multichannel coding system, all numerical values are represented directly, with separate pools of neurons for each (discriminable) numerical value. Using an adaptation paradigm, we assessed whether the visual perception of number is better characterized by an opponent channel or multichannel system. Critically, these systems make distinct predictions regarding the pattern of aftereffects exhibited when an observer is adapted to an intermediate numerical value. Opponent channel coding predicts no aftereffects because both pools of neurons adapt equally. By contrast, multichannel coding predicts repulsive aftereffects, wherein numerical values smaller than the adapter are underestimated and those larger than the adapter are overestimated. Consistent with multichannel coding, visual adaptation to an intermediate value (50 dots) yielded repulsive aftereffects, such that participants underestimated stimuli ranging from 10-50 dots, but overestimated stimuli ranging from 50-250 dots. These findings provide novel evidence that the visual perception of number is supported by a multichannel, not opponent channel, coding system, and raise important questions regarding the contributions of different cortical regions, such as the ventral and lateral intraparietal areas, to the representation of number.

What the Solitaire illusion tells us about perception of numerosity

In four experiments we investigated the Solitaire illusion. In this illusion, most observers see as more numerous a set of dots that forms a single central group, compared to dots on the outside of that group. We confirmed and extended the effect to configurations with much higher numerosity than the original and of various colours. Contrary to prediction, separating the two groups, so that they are presented side by side, reduced but did not abolish or reverse the illusion. In this illusion, therefore, neither total size of the region (area), not average distance of the elements has the expected effect. In Experiments 3 and 4 we eliminated the regularity of the pattern, by sampling 50% (Exp 3) or only a 10% (Exp 4) of the elements. These produces quasi-random configurations. For these configurations the bias for the inner groups was still present, and it was only eliminated when the groups were shown as separate. However, the effect never reversed (no bias for the outer group, despite its larger area). We conclude that the Solitaire illusion is evidence of a strong bias in favour of centrally located elements, a bias that can overcome other factors.

An insect brain organizes numbers on a left-to-right mental number line

The ability to judge numbers exists in various vertebrate species but also in honey bees, thus raising the question of the phylogenetic origins of numerosity systems. Here, we studied if bees, like humans, organize numbers spatially from left to right according to their magnitude. As the cultural vs. biological origins of this mental number line (MNL) are a subject of debate, our study provides an important perspective for this discussion. We show that bees order numbers from left to right according to their magnitude and that the location of a number on that line varies with the reference number previously trained. Thus, the MNL is a biological numeric representation that is common to the nervous system with distant evolutionary origins.

The “mental number line” (MNL) is a form of spatial numeric representation that associates small and large numbers with the left and right spaces, respectively. This spatio-numeric organization can be found in adult humans and has been related to cultural factors such as writing and reading habits. Yet, both human newborns and birds order numbers consistently with an MNL, thus raising the question of whether culture is a main explanation for MNL. Here, we explored the numeric sense of honey bees and show that after being trained to associate numbers with a sucrose reward, they order numbers not previously experienced from left to right according to their magnitude. Importantly, the location of a number on that scale varies with the reference number previously trained and does not depend on low-level cues present on numeric stimuli. We provide a series of neural explanations for this effect based on the extensive knowledge accumulated on the neural underpinnings of visual processing in honey bees and conclude that the MNL is a form of numeric representation that is evolutionarily conserved across nervous systems endowed with a sense of number, irrespective of their neural complexity.

Electrophysiological Evidence for A Number-Action Mapping in Infancy

In the last decades, a growing body of literature has focused on the link between number and action. Many studies conducted on adult participants have provided evidence for a bidirectional influence between numerosity processing and grasping or reaching actions. However, it is not yet clear whether this link is functional in early infancy. Here, we used the event-related potential (ERP) technique to record electrical activity of the brain in response to number-hand pairings. We implemented a cueing paradigm where 3- to 4-month-old infants observed images showing either congruency (e.g., a large numerosity primed by a large hand opening) or incongruency (e.g., a large numerosity primed by a small hand opening). Infants' brain activity was modulated by the congruency of the pairings: amplitudes recorded over frontal and parietal-occipital scalp positions differed for congruent versus incongruent pairings. These findings suggest that the association between number and hand action processing is already functional early in life.

Number neurons in the nidopallium of young domestic chicks

Numerosity, that is, the number of items in a set, is a significant aspect in the perception of the environment. Behavioral and in silico experiments suggest that number sense belongs to a core knowledge system and can be present already at birth. However, neurons sensitive to the number of visual items have been so far described only in the brain of adult animals. Therefore, it remained unknown to what extent their selectivity would depend on visual learning and experience. We found number neurons in the caudal nidopallium (a higher associative area functionally similar to the mammalian prefrontal cortex) of very young, numerically naïve domestic chicks. This result suggests that numerosity perception is possibly an inborn feature of the vertebrate brain.

Numerical cognition is ubiquitous in the animal kingdom. Domestic chicks are a widely used developmental model for studying numerical cognition. Soon after hatching, chicks can perform sophisticated numerical tasks. Nevertheless, the neural basis of their numerical abilities has remained unknown. Here, we describe number neurons in the caudal nidopallium (functionally equivalent to the mammalian prefrontal cortex) of young domestic chicks. Number neurons that we found in young chicks showed remarkable similarities to those in the prefrontal cortex and caudal nidopallium of adult animals. Thus, our results suggest that numerosity perception based on number neurons might be an inborn feature of the vertebrate brain.

The Idiosyncrasy Principle: A New Look at Qualia

In the study of consciousness, qualia, the individual subjective experience, is neglected. It remains impenetrable because the objective perspective used for scientific investigations misses its subjective nature. In 1974, Thomas Nagel suggested that studying qualia requires an “objective phenomenology method” whose goal would be to describe the subjective character of experiences in an independent manner. We introduce a corresponding theoretical and experimental framework based on the “idiosyncrasy principle.” Accordingly, subjectivity depends on the idiosyncratic composition of physical properties to qualia. This allows conceptualizing an idiosyncratic transfer function between the world and its representation. The main challenge in delineating such a transfer function is to come up with an objective measure for another person’s perspective. Numerosity, as opposed to other perceived contents of the physical world, allows reporting subjective experience in an objective manner. On the basis of this unique attribute of numerosity, we suggest a tentative neurocognitive research plan aimed at delineating such idiosyncratic transfer functions, permitting one person to adopt the perspective of another and linking qualia to its mechanism.

The role of neural tuning in quantity perception

Perception of quantities, such as numerosity, timing, and size, is essential for behavior and cognition. Accumulating evidence demonstrates neurons processing quantities are tuned, that is, have a preferred quantity amount, not only for numerosity, but also other quantity dimensions and sensory modalities. We argue that quantity-tuned neurons are fundamental to understanding quantity perception. We illustrate how the properties of quantity-tuned neurons can underlie a range of perceptual phenomena. Furthermore, quantity-tuned neurons are organized in distinct but overlapping topographic maps. We suggest that this overlap in tuning provides the neural basis for perceptual interactions between different quantities, without the need for a common neural representational code.

Increased Functional Connectivity of the Intraparietal Sulcus Underlies the Attenuation of Numerosity Estimations for Self-Generated Words

Previous studies have shown that self-generated stimuli in auditory, visual, and somatosensory domains are attenuated, producing decreased behavioral and neural responses compared with the same stimuli that are externally generated. Yet, whether such attenuation also occurs for higher-level cognitive functions beyond sensorimotor processing remains unknown. In this study, we assessed whether cognitive functions such as numerosity estimations are subject to attenuation in 56 healthy participants (32 women). We designed a task allowing the controlled comparison of numerosity estimations for self-generated (active condition) and externally generated (passive condition) words. Our behavioral results showed a larger underestimation of self-generated compared with externally generated words, suggesting that numerosity estimations for self-generated words are attenuated. Moreover, the linear relationship between the reported and actual number of words was stronger for self-generated words, although the ability to track errors about numerosity estimations was similar across conditions. Neuroimaging results revealed that numerosity underestimation involved increased functional connectivity between the right intraparietal sulcus and an extended network (bilateral supplementary motor area, left inferior parietal lobule, and left superior temporal gyrus) when estimating the number of self-generated versus externally generated words. We interpret our results in light of two models of attenuation and discuss their perceptual versus cognitive origins.SIGNIFICANCE STATEMENT We perceive sensory events as less intense when they are self-generated compared with when they are externally generated. This phenomenon, called attenuation, enables us to distinguish sensory events from self and external origins. Here, we designed a novel fMRI paradigm to assess whether cognitive processes such as numerosity estimations are also subject to attenuation. When asking participants to estimate the number of words they had generated or passively heard, we found bigger underestimation in the former case, providing behavioral evidence of attenuation. Attenuation was associated with increased functional connectivity of the intraparietal sulcus, a region involved in numerosity processing. Together, our results indicate that the attenuation of self-generated stimuli is not limited to sensory consequences but is also impact cognitive processes such as numerosity estimations.

Laminar processing of numerosity supports a canonical cortical microcircuit in human parietal cortex

As neural signals travel through the visual hierarchy, spatial precision decreases and specificity for stimulus features increases.^1-4 A similar hierarchy has been found for laminar processing in V1, where information from the thalamus predominantly targets the central layers, while spatial precision decreases and feature specificity increases toward superficial and deeper layers.^5-17 This laminar processing scheme is proposed to represent a canonical cortical microcircuit that is similar across the cortex.^11,18-21 Here, we go beyond early visual cortex and investigate whether processing of numerosity (the set size of a group of items) across cortical depth in the parietal association cortex follows this hypothesis. Numerosity processing is implicated in many tasks such as multiple object tracking,²² mathematics,^23-25 decision making,²⁶ and dividing attention.²⁷ Neurons in the parietal association cortex are tuned to numerosity, with both a preferred numerosity tuning and tuning width (i.e., specificity).^28-30 We quantified preferred numerosity responses across cortical depth in the parietal association cortex with ultra-high field fMRI and population receptive field-based numerosity modeling.^1,28,31 We find that numerosity responses sharpen, i.e., become increasingly specific, moving away from the central layers. This suggests that the laminar processing scheme for numerosity processing in the parietal cortex is similar to primary visual cortex, providing support for the canonical cortical microcircuit hypothesis beyond primary visual cortex.

The effect of scene articulation on transparent layer constancy

In this article, we examine the influence of scene articulation on transparent layer constancy. We argue that the term articulation may be understood as an aspect of the more general concept naturalness of a stimulus that relates to the degree of enrichment compared with a minimal stimulus and to the extent to which a stimulus contains regularities that are typically found in natural scenes. We conducted two matching experiments, in which we used strongly reduced scenes and operationalized articulation by the number of background reflectances (numerosity). The results of the first experiment show that higher numerosity actually leads to an increase in transparent layer constancy when reflectances are randomly drawn from a fixed population. However, this advantage disappears if the spatial mean and the variation of the subset colors are controlled as in our second experiment. Furthermore, our results suggest that the mechanism underlying transparent layer constancy leads to a rather stable compromise between two matching criteria, namely, proximal identity and constant filter properties according to our perceptual model. For filters with an additive component, which appear more or less hazy, we observed improved recovered filter properties and correspondingly higher degrees of transparent layer constancy, suggesting an additional mechanism in this type of filter.

Decoding location-specific and location-invariant stages of numerosity processing in subitizing

Extracting the number of objects in perceived scenes is a fundamental cognitive ability. Number processing is proposed to rely on two consecutive stages: an early object location map that captures individuated objects in a location‐specific way and a subsequent location‐invariant representation that captures numerosity at an abstract level. However, it is unclear whether this framework applies to small numerosities that can be individuated at once (“subitized”). Here, we reanalyzed data from two electroencephalography (EEG) experiments using multivariate pattern decoding to identify location‐specific and location‐invariant stages of numerosity processing in the subitizing range. In these experiments, one to three targets were presented in the left or right hemifield, which allowed for decoding target numerosity within each hemifield separately (location specific) or across hemifields (location invariant). Experiment 1 indicated the presence of a location‐specific stage (180–200 ms after stimulus), followed by a location‐invariant stage (300 ms after stimulus). A time‐by‐channel searchlight analysis revealed that the early location‐specific stage is most evident at occipital channels, whereas the late location‐invariant stage is most evident at parietal channels. Experiment 2 showed that both location‐specific and location‐invariant components are engaged only during tasks that explicitly require numerosity processing, ruling out automatic, and passive recording of numerosity. These results suggest that numerosity coding in subitizing is strongly grounded on an attention‐based, location‐specific stage. This stage overlaps with the subsequent activation of a location‐invariant stage, where a full representation of numerosity is finalized. Taken together, our findings provide clear evidence for a temporal and spatial segregation of location‐specific and location‐invariant numerosity coding of small object numerosities.

Numerosities and Other Magnitudes in the Brains: A Comparative View

The ability to represent, discriminate, and perform arithmetic operations on discrete quantities (numerosities) has been documented in a variety of species of different taxonomic groups, both vertebrates and invertebrates. We do not know, however, to what extent similarity in behavioral data corresponds to basic similarity in underlying neural mechanisms. Here, we review evidence for magnitude representation, both discrete (countable) and continuous, following the sensory input path from primary sensory systems to associative pallial territories in the vertebrate brains. We also speculate on possible underlying mechanisms in invertebrate brains and on the role played by modeling with artificial neural networks. This may provide a general overview on the nervous system involvement in approximating quantity in different animal species, and a general theoretical framework to future comparative studies on the neurobiology of number cognition.

The Number Sense Represents (Rational) Numbers

On a now orthodox view, humans and many other animals possess a "number sense," or approximate number system (ANS), that represents number. Recently, this orthodox view has been subject to numerous critiques that question whether the ANS genuinely represents number. We distinguish three lines of critique-the arguments from congruency, confounds, and imprecision-and show that none succeed. We then provide positive reasons to think that the ANS genuinely represents numbers, and not just non-numerical confounds or exotic substitutes for number, such as "numerosities" or "quanticals," as critics propose. In so doing, we raise a neglected question: numbers of what kind? Proponents of the orthodox view have been remarkably coy on this issue. But this is unsatisfactory since the predictions of the orthodox view, including the situations in which the ANS is expected to succeed or fail, turn on the kind(s) of number being represented. In response, we propose that the ANS represents not only natural numbers (e.g. 7), but also non-natural rational numbers (e.g. 3.5). It does not represent irrational numbers (e.g. √2), however, and thereby fails to represent the real numbers more generally. This distances our proposal from existing conjectures, refines our understanding of the ANS, and paves the way for future research.

Automatic Processing of Numerosity in Human Neocortex Evidenced by Occipital and Parietal Neuromagnetic Responses

Humans and other animal species are endowed with the ability to sense, represent, and mentally manipulate the number of items in a set without needing to count them. One central hypothesis is that this ability relies on an automated functional system dedicated to numerosity, the perception of the discrete numerical magnitude of a set of items. This system has classically been associated with intraparietal regions, however accumulating evidence in favor of an early visual number sense calls into question the functional role of parietal regions in numerosity processing. Targeting specifically numerosity among other visual features in the earliest stages of processing requires high temporal and spatial resolution. We used frequency-tagged magnetoencephalography to investigate the early automatic processing of numerical magnitudes and measured the steady-state brain responses specifically evoked by numerical and other visual changes in the visual scene. The neuromagnetic responses showed implicit discrimination of numerosity, total occupied area, and convex hull. The source reconstruction corresponding to the implicit discrimination responses showed common and separate sources along the ventral and dorsal visual pathways. Occipital sources attested the perceptual salience of numerosity similarly to both other implicitly discriminable visual features. Crucially, we found parietal responses uniquely associated with numerosity discrimination, showing automatic processing of numerosity in the parietal cortex, even when not relevant to the task. Taken together, these results provide further insights into the functional roles of parietal and occipital regions in numerosity encoding along the visual hierarchy.

Representation of visual numerosity information during working memory in humans: An fMRI decoding study

Both animal and human studies on numerosity have shown the importance of the parietal cortex for numerosity processing. However, most studies have focused on the perceptual processing of numerosity. Still, it is unclear how and where numerosity information is coded when this information is retained during a working memory delay phase. Such temporal storage could be realized by the same structures as perceptual processes, or be transformed to a more abstract representation, potentially involving prefrontal regions. FMRI decoding studies allow the identification of brain areas that exhibit multi‐voxel activation patterns specific to the content of working memory. Here, we used an assumption‐free searchlight‐decoding approach to test where numerosity‐specific codes can be found during a 12 s retention period. Participants (n = 24) performed a retro‐cue delayed match‐to‐sample task, in which numerosity information was presented as visual dot arrays. We found mnemonic numerosity‐specific activation in the right lateral portion of the intraparietal sulcus; an area well‐known for perceptual processing of numerosity. The applied retro‐cue design dissociated working memory delay activity from perceptual processes and showed that the intraparietal sulcus also maintained working memory representation independent of perception.

A Network of Topographic Maps in Human Association Cortex Hierarchically Transforms Visual Timing-Selective Responses

Accurately timing sub-second sensory events is crucial when perceiving our dynamic world. This ability allows complex human behaviors that require timing-dependent multisensory integration and action planning. Such behaviors include perception and performance of speech, music, driving, and many sports. How are responses to sensory event timing processed for multisensory integration and action planning? We measured responses to viewing systematically changing visual event timing using ultra-high-field fMRI. We analyzed these responses with neural population response models selective for event duration and frequency, following behavioral, computational, and macaque action planning results and comparisons to alternative models. We found systematic local changes in timing preferences (recently described in supplementary motor area) in an extensive network of topographic timing maps, mirroring sensory cortices and other quantity processing networks. These timing maps were partially left lateralized and widely spread, from occipital visual areas through parietal multisensory areas to frontal action planning areas. Responses to event duration and frequency were closely linked. As in sensory cortical maps, response precision varied systematically with timing preferences, and timing selectivity systematically varied between maps. Progressing from posterior to anterior maps, responses to multiple events were increasingly integrated, response selectivity narrowed, and responses focused increasingly on the middle of the presented timing range. These timing maps largely overlap with numerosity and visual field map networks. In both visual timing map and visual field map networks, selective responses and topographic map organization may facilitate hierarchical transformations by allowing neural populations to interact over minimal distances.

•

Many brain areas show neural responses to specific ranges of visual event timing

•

Timing preferences change gradually in these areas, forming topographic timing maps

•

Neural response properties hierarchically transform from visual to premotor areas

•

Timing, numerosity, and visual field map networks are distinct but largely overlap

Parametric Representation of Tactile Numerosity in Working Memory

Estimated numerosity perception is processed in an approximate number system (ANS) that resembles the perception of a continuous magnitude. The ANS consists of a right lateralized frontoparietal network comprising the lateral prefrontal cortex (LPFC) and the intraparietal sulcus. Although the ANS has been extensively investigated, only a few studies have focused on the mental representation of retained numerosity estimates. Specifically, the underlying mechanisms of estimated numerosity working memory (WM) is unclear. Besides numerosities, as another form of abstract quantity, vibrotactile WM studies provide initial evidence that the right LPFC takes a central role in maintaining magnitudes. In the present fMRI multivariate pattern analysis study, we designed a delayed match-to-numerosity paradigm to test what brain regions retain approximate numerosity memoranda. In line with parametric WM results, our study found numerosity-specific WM representations in the right LPFC as well as in the supplementary motor area and the left premotor cortex extending into the superior frontal gyrus, thus bridging the gap in abstract quantity WM literature.

The interplay between non-symbolic number and its continuous visual properties revisited: Effects of mixing trials of different types

In the last few years, the existence of a pure number sense has been challenged. Recent studies suggest that numerosity processing is influenced not only by the number of elements in a display but also by continuous magnitudes, such as the size of the elements. The aim of our study was to replicate and extend the findings by Gebuis and Reynvoet, who systematically manipulated different continuous magnitudes either congruently or incongruently with discrete numerosity. We were particularly interested in finding the same pattern of congruency effects and assess its stability and robustness as this pattern indicates a complex influence of continuous magnitudes on numerosity judgements. We did so by showing stimuli of different conditions either in separate blocks or mixed together while participants solved a dot comparison task. Our results are in line with the notion that discrete number and continuous magnitudes are integrated in numerosity judgements by means of a weighing process. Moreover, our findings suggest that this integration is modified by the mode of presentation (blocked vs. mixed).

Counteracting estimation bias and social influence to improve the wisdom of crowds

Aggregating multiple non-expert opinions into a collective estimate can improve accuracy across many contexts. However, two sources of error can diminish collective wisdom: individual estimation biases and information sharing between individuals. Here, we measure individual biases and social influence rules in multiple experiments involving hundreds of individuals performing a classic numerosity estimation task. We first investigate how existing aggregation methods, such as calculating the arithmetic mean or the median, are influenced by these sources of error. We show that the mean tends to overestimate, and the median underestimate, the true value for a wide range of numerosities. Quantifying estimation bias, and mapping individual bias to collective bias, allows us to develop and validate three new aggregation measures that effectively counter sources of collective estimation error. In addition, we present results from a further experiment that quantifies the social influence rules that individuals employ when incorporating personal estimates with social information. We show that the corrected mean is remarkably robust to social influence, retaining high accuracy in the presence or absence of social influence, across numerosities and across different methods for averaging social information. Using knowledge of estimation biases and social influence rules may therefore be an inexpensive and general strategy to improve the wisdom of crowds.

An Insect's Sense of Number

Recent studies revealed numerosity judgments in bees, which include the concept of zero, subtraction and addition, and matching symbols to numbers. Despite their distant origins, bees and vertebrates share similarities in their numeric competences, thus suggesting that numerosity is evolutionary conserved and can be implemented in miniature brains without neocortex.

Environmentally induced changes to brain morphology predict cognitive performance

The relationship between the size and structure of a species' brain and its cognitive capacity has long interested scientists. Generally, this work relates interspecific variation in brain anatomy with performance on a variety of cognitive tasks. However, brains are known to show considerable short-term plasticity in response to a range of social, ecological and environmental factors. Despite this, we have a remarkably poor understanding of how this impacts on an animal's cognitive performance. Here, we non-invasively manipulated the relative size of brain regions associated with processing visual and chemical information in fish (the optic tectum and olfactory bulbs, respectively). We then tested performance in a cognitive task in which information from the two sensory modalities was in conflict. Although the fish could effectively use both visual and chemical information if presented in isolation, when they received cues from both modalities simultaneously, those with a relatively better developed optic tectum showed a greater reliance on visual information, while individuals with relatively better developed olfactory bulbs showed a greater reliance on chemical information. These results suggest that short-term changes in brain structure, possibly resulting from an attempt to minimize the costs of developing unnecessary but energetically expensive brain regions, may have marked effects on cognitive performance.This article is part of the theme issue 'Causes and consequences of individual differences in cognitive abilities'.

Evidence for a Mixed Timing and Counting Strategy in Mice Performing a Mechner Counting Task

Numerosity, or the ability to understand and distinguish between discrete quantities, was first formalized for study in animals by Mechner (1958a). Rats had to press one lever (the counting lever) n times to arm food release from pressing a second lever (the reward lever). The only cue that n presses had been made to the counting lever was the animal's representation of how many times it had pressed it. In the years that have passed since, many researchers have modified the task in meaningful ways to attempt to tease apart timing-based and count-based strategies. Strong evidence has amassed that the two are fundamentally different and separable skills but, to date, no study has effectively examined the differential contributions of the two strategies in Mechner's original task. By examining performance mid-trial and correlating it with whole-trial performance, we were able to identify patterns of correlation consistent with counting and timing strategies. Due to the independent nature of these correlation patterns, this technique was uniquely able to provide evidence for strategies that combined both timing and counting components. The results show that most mice demonstrated this combined strategy. This provides direct evidence that mice can and do use numerosity to complete Mechner's original task. A rational agent with fallible estimates of both counts made and time elapsed in making them should use both estimates when deciding when to switch to the second lever.

Honeybees use absolute rather than relative numerosity in number discrimination

Various vertebrate species use relative numerosity judgements in comparative assessments of quantities for which they use larger/smaller relationships rather than absolute number. The numerical ability of honeybees shares basic properties with that of vertebrates but their use of absolute or relative numerosity has not been explored. We trained free-flying bees to choose variable images containing three dots; one group ('larger') was trained to discriminate 3 from 2, while another group ('smaller') was trained to discriminate 3 from 4. In both cases, numbers were kept constant but stimulus characteristics and position were varied from trial to trial. Bees were then tested with novel stimuli displaying the previously trained numerosity (3) versus a novel numerosity (4 for 'larger' and 2 for 'smaller'). Both groups preferred the three-item stimulus, consistent with absolute numerosity. They also exhibited ratio-dependent discrimination of numbers, a property shared by vertebrates, as performance after 2 versus 3 was better than after 3 versus 4 training. Thus, bees differ from vertebrates in their use of absolute rather than of relative numerosity but they also have some numeric properties in common.

Elephants have a nose for quantity

Animals often face situations that require making decisions based on quantity. Many species, including humans, rely on an ability to differentiate between more and less to make judgments about social relationships, territories, and food. Habitat-related choices require animals to decide between areas with greater and lesser quantities of food while also weighing relative risk of danger based on group size and predation risk. Such decisions can have a significant impact on survival for an animal and its social group. Many species have demonstrated a capacity for differentiating between two quantities of food and choosing the greater of the two, but they have done so based on information provided primarily in the visual domain. Using an object-choice task, we demonstrate that elephants are able to discriminate between two distinct quantities using their olfactory sense alone. We presented the elephants with choices between two containers of sunflower seeds. The relationship between the amount of seeds within the two containers was represented by 11 different ratios. Overall, the elephants chose the larger quantity of food by smelling for it. The elephants' performance was better when the relative difference between the quantities increased and worse when the ratio between the quantities of food increased, but was not affected by the overall quantity of food presented. These results are consistent with the performance of animals tested in the visual domain. This work has implications for the design of future, cross-phylogenetic cognitive comparisons that ought to account for differences in how animals sense their world.

Response-irrelevant number, duration, and extent information triggers the SQARC effect: Evidence from an implicit paradigm

Spatial-Numerical Association of Response Codes (SNARC) and Spatial-Quantity Association of Response Codes (SQARC) effects are evident when people produce faster left-sided responses to smaller numbers, sizes, and durations and faster right-sided responses to larger numbers, sizes, and durations. SQARC effects have typically been demonstrated in paradigms where the explicit processing of quantity information is required for successful task completion. The current study tested whether the implicit presentation of task-irrelevant magnitude information could trigger a SQARC effect as has been demonstrated previously when task-irrelevant information triggers a SNARC effect. In Experiment 1, participants (n = 20) made orientation judgements for triangles varying in numerosity and physical extent. In Experiment 2, participants (n = 20) made orientation judgements for triangles varying in numerosity and for a triangle preceded by a delay of varying duration. SNARC effects were observed for the numerosity conditions of Experiments 1 and 2 replicating Mitchell et al. SQARC effects were also demonstrated for physical extent and for duration. These findings demonstrate that SQARC effects can be implicitly triggered by the presentation of the task-irrelevant magnitude.

A MEG Study on the Processing of Time and Quantity: Parietal Overlap but Functional Divergence

A common magnitude system for the processing of time and numerosity, supported by areas in the posterior parietal cortex, has been proposed by some authors. The present study aims to investigate possible intersections between the neural processing of non-numerical (time) and numerical magnitudes in the posterior parietal lobe. Using Magnetoencephalography for the comparison of brain source activations during the processing of duration and numerosity contrasts, we demonstrate parietal overlap as well as dissociations between these two dimensions. Within the parietal cortex, the main areas of overlap were bilateral precuneus, bilateral intraparietal sulci, and right supramarginal gyrus. Interestingly, however, these regions did not equivalently correlated with the behavior for the two dimensions: left and right precuneus together with the right supramarginal gyrus accounted functionally for durational judgments, whereas numerosity judgments were accounted by the activation pattern in the right intraparietal sulcus. Present results, indeed, demonstrate an overlap between the neural substrates for processing duration and quantity. However, the functional relevance of parietal overlapping areas for each dimension is not the same. In fact, our data indicates that the same parietal sites rule differently non-numerical and numerical dimensions, as parts of broader networks.

Comparative Judgment of Familiar Objects Is Modulated by Their Size

Perceptual decisions such as that we have more strawberries than apples left in our fruit basket seem to be made effortlessly. However, it is not examined yet whether such decisions are also biased by the size of the objects, just like numerosity comparisons with meaningless dot arrays. We presented two homogeneous sets of larger and smaller fruits (e.g., three apples and four strawberries), and participants had to indicate which set was more numerous. Although accuracy was nearly perfect, a strong congruency effect was found in reaction times, showing it is more difficult to compare the numerosities of sets of 2 apples and 3 strawberries than the opposite, that is, 3 apples and 2 strawberries. Because the stimuli were selected to simulate everyday conditions as much as possible, the present results suggest that most likely also comparative numerosity judgment in daily life is biased by nonnumerical cues such as size of the objects.

Using Hierarchical Linear Models to Examine Approximate Number System Acuity: The Role of Trial-Level and Participant-Level Characteristics

The ability to intuitively and quickly compare the number of items in collections without counting is thought to rely on the Approximate Number System (ANS). To assess individual differences in the precision of peoples' ANS representations, researchers often use non-symbolic number comparison tasks in which participants quickly choose the numerically larger of two arrays of dots. However, some researchers debate whether this task actually measures the ability to discriminate approximate numbers or instead measures the ability to discriminate other continuous magnitude dimensions that are often confounded with number (e.g., the total surface area of the dots or the convex hull of the dot arrays). In this study, we used hierarchical linear models (HLMs) to predict 132 adults' accuracy on each trial of a non-symbolic number comparison task from a comprehensive set of trial-level characteristics (including numerosity ratio, surface area, convex hull, and temporal and spatial variations in presentation format) and participant-level controls (including cognitive abilities such as visual-short term memory, working memory, and math ability) in order to gain a more nuanced understanding of how individuals complete this task. Our results indicate that certain trial-level characteristics of the dot arrays contribute to our ability to compare numerosities, yet numerosity ratio, the critical marker of the ANS, remains a highly significant predictor of accuracy above and beyond trial-level characteristics and across individuals with varying levels of math ability and domain-general cognitive abilities.

Word deafness with preserved number word perception

We describe the performance of an aphasic individual, K.A., who showed a selective impairment affecting his ability to perceive spoken language, while largely sparing his ability to perceive written language and to produce spoken language. His spoken perception impairment left him unable to distinguish words or nonwords that differed on a single phoneme and he was no better than chance at auditory lexical decision or single spoken word and single picture matching with phonological foils. Strikingly, despite this profound impairment, K.A. showed a selective sparing in his ability to perceive number words, which he was able to repeat and comprehend largely without error. This case adds to a growing literature demonstrating modality-specific dissociations between number word and non-number word processing. Because of the locus of K.A.'s speech perception deficit for non-number words, we argue that this distinction between number word and non-number word processing arises at a sublexical level of representations in speech perception, in a parallel fashion to what has previously been argued for in the organization of the sublexical level of representation for speech production.

Neurons in the Hippocampus of Crows Lack Responses to Non-spatial Abstract Categories

Lesion studies suggest a role of the avian hippocampus in spatial and episodic memory. However, whether the avian hippocampus is also involved in processing categorical information and non-spatial working memory contents remains unknown. To address this question, we trained two crows in a delayed-match-to-sample test to assess and briefly memorize the number of items in dot displays, i.e., their numerosity. We recorded neuronal activity in hippocampus while crows solved this task. Hardly any hippocampal neurons responded to the category 'numerosity,' during neither sample presentation, nor during the memory delay. This was in striking contrast to previous recordings in the telencephalic association area 'nidopallium caudolaterale' (NCL) of the same crows, in which we previously reported an abundance of numerosity-selective and working memory-selective neurons. Our data suggest that categorical information is not processed in the avian hippocampus.

The deep history of the number words

We have previously shown that the 'low limit' number words (from one to five) have exceptionally slow rates of lexical replacement when measured across the Indo-European (IE) languages. Here, we replicate this finding within the Bantu and Austronesian language families, and with new data for the IE languages. Number words can remain stable for 10 000 to over 100 000 years, or around 3.5-20 times longer than average rates of lexical replacement among the Swadesh list of 'fundamental vocabulary' items. Ordinal evidence suggests that number words also have slow rates of lexical replacement in the Pama-Nyungan language family of Australia. We offer three hypotheses to explain these slow rates of replacement: (i) that the abstract linguistic-symbolic processing of 'number' links to evolutionarily conserved brain regions associated with numerosity; (ii) that number words are unambiguous and therefore have lower 'mutation rates'; and (iii) that the number words occupy a region of the phonetic space that is relatively full and therefore resist change because alternatives are unlikely to be as 'good' as the original word.This article is part of a discussion meeting issue 'The origins of numerical abilities'.

Psychophysical evidence for the number sense

It is now clear that most animals, including humans, possess an ability to rapidly estimate number. Some have questioned whether this ability arises from dedicated numerosity mechanisms, or is derived indirectly from judgements of density or other attributes. We describe a series of psychophysical experiments, largely using adaptation techniques, which demonstrate clearly the existence of a number sense in humans. The number sense is truly general, extending over space, time and sensory modality, and is closely linked with action. We further show that when multiple cues are present, numerosity emerges as the natural dimension for discrimination. However, when element density increases past a certain level, the elements become too crowded to parse, and the scene is perceived as a texture rather than array of elements. The two different regimes are psychophysically discriminable in that they follow distinct psychophysical laws, and show different dependencies on eccentricity, luminance levels and effects of perceptual grouping. The distinction is important, as the ability to discriminate numerosity, but not texture, correlates with formal maths skills.

This article is part of the discussion meeting issue ‘The origins of numerical abilities’.

Analog mental representation

Over the past 50 years, philosophers and psychologists have perennially argued for the existence of analog mental representations of one type or another. This study critically reviews a number of these arguments as they pertain to three different types of mental representation: perceptual representations, imagery representations, and numerosity representations. Along the way, careful consideration is given to the meaning of "analog" presupposed by these arguments for analog mental representation, and to open avenues for future research. This article is categorized under: Philosophy > Foundations of Cognitive Science Philosophy > Representation Philosophy > Psychological Capacities.

Repulsive Serial Effects in Visual Numerosity Judgments

We investigated how the approximate perceived numerosity of ensembles of visual elements is modulated by the numerosity of previously viewed ensembles depending on whether the first ensemble is held in visual working memory or not. We show that the numerosity of the previously seen ensemble has a repulsive effect, that is, a stimulus with high numerosity induces an underestimation of the following one and vice versa. This repulsive effect is present regardless of whether the first stimulus is memorized or not. While subtle changes of the experimental paradigm can have major consequences for the nature of interstimulus dependencies in perception, generally speaking the fact that we found such effects in a visual numerosity estimation task confirms that the process by which human observers produce estimates of the number of elements bears analogies to the processes that lead to the perception of visual dimensions such as orientation.

Bidirectional examination of the interaction between time and numerosity corroborates that numerosity influences time estimation but not vice versa

There has been great interest in the idea that time, number, and space share a common magnitude system. However, only a handful of studies examined bidirectional interaction between time and number and the results varied depending on the specifics of the methods and stimulus properties of each study. The present study investigated bidirectional interaction between time and number using estimation tasks. We used duration (Experiment 1) and numerosity (Experiment 2) estimation tasks to investigate the effect of numerosity-on-duration and duration-on-numerosity estimation. The results from the two experiments demonstrated that numerosity influences duration processing but not vice versa; that is, there was unidirectional interaction between numerosity and time. The duration of stimulus presentation was overestimated for stimuli larger in (task-irrelevant) numerosity. Possible mechanisms underlying the unidirectional interaction between time and number are discussed.