Numerosity tuning in human association cortices and local image contrast representations in early visual cortex

The calculating brain

The human brain possesses neural networks and mechanisms enabling the representation of numbers, basic arithmetic operations, and mathematical reasoning. Without the ability to represent numerical quantity and perform calculations, our scientifically and technically advanced culture would not exist. However, the origins of numerical abilities are grounded in an intuitive understanding of quantity deeply rooted in biology. Nevertheless, more advanced symbolic arithmetic skills require a cultural background with formal mathematical education. In the past two decades, cognitive neuroscience has seen significant progress in understanding the workings of the calculating brain through various methods and model systems. This review begins by exploring the mental and neuronal representations of nonsymbolic numerical quantity and then progresses to symbolic representations acquired in childhood. During arithmetic operations (addition, subtraction, multiplication, and division), these representations are processed and transformed according to arithmetic rules and principles, leveraging different mental strategies and types of arithmetic knowledge that can be dissociated in the brain. Although it was once believed that number processing and calculation originated from the language faculty, it is now evident that mathematical and linguistic abilities are primarily processed independently in the brain. Understanding how the healthy brain processes numerical information is crucial for gaining insights into debilitating numerical disorders, including acquired conditions like acalculia and learning-related calculation disorders such as developmental dyscalculia.

The neural link between stimulus duration and spatial location in the human visual hierarchy

Integrating spatial and temporal information is essential for our sensory experience. While psychophysical evidence suggests spatial dependencies in duration perception, few studies have directly tested the neural link between temporal and spatial processing. Using ultra-high-field functional MRI and neuronal-based modeling, we investigated how and where the processing and the representation of a visual stimulus duration is linked to that of its spatial location. Our results show a transition in duration coding: from monotonic and spatially-dependent in early visual cortex to unimodal and spatially-invariant in frontal cortex. Along the dorsal visual stream, particularly in the intraparietal sulcus (IPS), neuronal populations show common selective responses to both spatial and temporal information. In the IPS, spatial and temporal topographic organizations are also linked, although duration maps are smaller, less clustered, and more variable across participants. These findings help identify the mechanisms underlying human perception of visual duration and characterize the functional link between time and space processing, highlighting the importance of their interactions in shaping brain responses.

Symbolic and non-symbolic representations of numerical zero in the human brain

Representing the quantity zero as a symbolic concept is considered a unique achievement of abstract human thought.1,2 To conceptualize zero, one must abstract away from the (absence of) sensory evidence to construct a representation of numerical absence: creating "something" out of "nothing."2,3,4 Previous investigations of the neural representation of natural numbers reveal distinct numerosity-selective neural populations that overlap in their tuning curves with adjacent numerosities.5,6 Importantly, a component of this neural code is thought to be invariant across non-symbolic and symbolic numerical formats.7,8,9,10,11 Although behavioral evidence indicates that zero occupies a place at the beginning of this mental number line,12,13,14 in humans zero is also associated with unique behavioral and developmental profiles compared to natural numbers,4,15,16,17 suggestive of a distinct neural basis for zero. We characterized the neural representation of zero in the human brain by employing two qualitatively different numerical tasks18,19 in concert with magnetoencephalography (MEG) recordings. We assay both neural representations of non-symbolic numerosities (dot patterns), including zero (empty sets), and symbolic numerals, including symbolic zero. Our results reveal that neural representations of zero are situated along a graded neural number line shared with other natural numbers. Notably, symbolic representations of zero generalized to predict non-symbolic empty sets. We go on to localize abstract representations of numerical zero to posterior association cortex, extending the purview of parietal cortex in human numerical cognition to encompass representations of zero.10,20.

Liver-specific Mettl14 deletion induces nuclear heterotypia and dysregulates RNA export machinery

Modification of RNA with N6-methyladenosine (m6A) has gained attention in recent years as a general mechanism of gene regulation. In the liver, m6A, along with its associated machinery, has been studied as a potential biomarker of disease and cancer, with impacts on metabolism, cell cycle regulation, and pro-cancer state signaling. However these observational data have yet to be causally examined in vivo. For example, neither perturbation of the key m6A writers Mettl3 and Mettl14, nor the m6A readers Ythdf1 and Ythdf2 have been thoroughly mechanistically characterized in vivo as they have been in vitro. To understand the functions of these machineries, we developed mouse models and found that deleting Mettl14 led to progressive liver injury characterized by nuclear heterotypia, with changes in mRNA splicing, processing and export leading to increases in mRNA surveillance and recycling.

Electrophysiological correlates of temporal numerosity adaptation

Introduction

Much research has revealed the human visual system is capable to estimate numerical quantities, rapidly and reliably, in both the spatial and the temporal domain. This ability is highly susceptible to short-term plastic phenomena related to previous exposure to visual numerical information (i.e., adaptation). However, while determinants of spatial numerosity adaptation have been widely investigated, little is known about the neural underpinnings of short-term plastic phenomena related to the encoding of temporal numerical information. In the present study we investigated the electrophysiological correlates of temporal numerosity adaptation.

Methods

Participants were asked to estimate the numerosity of a test sequence of flashes after being exposed to either a high or low numerous adapting sequence. Behavioral results confirmed the expected underestimation of test stimulus when this was preceded by a high numerous sequence as compared to when preceded by a low numerous sequence.

Results

Electrophysiological data revealed that this behavior was tightly linked to the amplitude of the steady-state visual evoked (ssVEP) response elicited by the test stimulus. When preceded by a high numerous sequence, the test stimulus elicited larger ssVEP responses as compared to when preceded by a low numerous sequence with this pattern being robustly correlated with behavior. Finally, topographical maps showed that this difference was mostly evident across two antero-posterior distributed clusters of electrodes and correlated with changes in functional connectivity.

Discussion

Taken together, our results suggest that visual plastic phenomena related to the encoding of temporal numerosity information reflect changes in rhythmic evoked activity that are likely related to long range communications between distinct brain regions.

Observers Efficiently Extract the Minimal and Maximal Element in Perceptual Magnitude Sets: Evidence for a Bipartite Format

The mind represents abstract magnitude information, including time, space, and number, but in what format is this information stored? We show support for the bipartite format of perceptual magnitudes, in which the measured value on a dimension is scaled to the dynamic range of the input, leading to a privileged status for values at the lowest and highest end of the range. In six experiments with college undergraduates, we show that observers are faster and more accurate to find the endpoints (i.e., the minimum and maximum) than any of the inner values, even as the number of items increases beyond visual short-term memory limits. Our results show that length, size, and number are represented in a dynamic format that allows for comparison-free sorting, with endpoints represented with an immediately accessible status, consistent with the bipartite model of perceptual magnitudes. We discuss the implications for theories of visual search and ensemble perception.

Cortical quantity representations of visual numerosity and timing overlap increasingly into superior cortices but remain distinct

Many sensory brain areas are organized as topographic maps where neural response preferences change gradually across the cortical surface. Within association cortices, 7-Tesla fMRI and neural model-based analyses have also revealed many topographic maps for quantities like numerosity and event timing, often in similar locations. Numerical and temporal quantity estimations also show behavioral similarities and even interactions. For example, the duration of high-numerosity displays is perceived as longer than that of low-numerosity displays. Such interactions are often ascribed to a generalized magnitude system with shared neural responses across quantities. Anterior quantity responses are more closely linked to behavior. Here, we investigate whether common quantity representations hierarchically emerge by asking whether numerosity and timing maps become increasingly closely related in their overlap, response preferences, and topography. While the earliest quantity maps do not overlap, more superior maps overlap increasingly. In these overlapping areas, some intraparietal maps have consistently correlated numerosity and timing preferences, and some maps have consistent angles between the topographic progressions of numerosity and timing preferences. However, neither of these relationships increases hierarchically like the amount of overlap does. Therefore, responses to different quantities are initially derived separately, then progressively brought together, without generally becoming a common representation. Bringing together distinct responses to different quantities may underlie behavioral interactions and allow shared access to comparison and action planning systems.

Human brain representations of internally generated outcomes of approximate calculation revealed by ultra-high-field brain imaging

Much of human culture's advanced technology owes its existence to the ability to mentally manipulate quantities. Neuroscience has described the brain regions overall recruited by numerical tasks and the neuronal codes representing individual quantities during perceptual tasks. Nevertheless, it remains unknown how quantity representations are combined or transformed during mental computations and how specific quantities are coded in the brain when generated as the result of internal computations rather than evoked by a stimulus. Here, we imaged the brains of adult human subjects at 7 Tesla during an approximate calculation task designed to disentangle in- and outputs of the computation from the operation itself. While physically presented sample numerosities were distinguished in activity patterns along the dorsal visual pathway and within frontal and occipito-temporal regions, a representation of the internally generated result was most prominently detected in higher order regions such as angular gyrus and lateral prefrontal cortex. Behavioral precision in the task was related to cross-decoding performance between sample and result representations in medial IPS regions. This suggests the transformation of sample into result may be carried out within dorsal stream sensory-motor integration regions, and resulting outputs maintained for task purposes in higher-level regions in a format possibly detached from sensory-evoked inputs.

Emergence of number sense through the integration of multimodal information: developmental learning insights from neural network models

Introduction

Associating multimodal information is essential for human cognitive abilities including mathematical skills. Multimodal learning has also attracted attention in the field of machine learning, and it has been suggested that the acquisition of better latent representation plays an important role in enhancing task performance. This study aimed to explore the impact of multimodal learning on representation, and to understand the relationship between multimodal representation and the development of mathematical skills.

Methods

We employed a multimodal deep neural network as the computational model for multimodal associations in the brain. We compared the representations of numerical information, that is, handwritten digits and images containing a variable number of geometric figures learned through single- and multimodal methods. Next, we evaluated whether these representations were beneficial for downstream arithmetic tasks.

Results

Multimodal training produced better latent representation in terms of clustering quality, which is consistent with previous findings on multimodal learning in deep neural networks. Moreover, the representations learned using multimodal information exhibited superior performance in arithmetic tasks.

Discussion

Our novel findings experimentally demonstrate that changes in acquired latent representations through multimodal association learning are directly related to cognitive functions, including mathematical skills. This supports the possibility that multimodal learning using deep neural network models may offer novel insights into higher cognitive functions.

Effects of spatial frequency cross-adaptation on the visual number sense

When observing a simple visual scene such as an array of dots, observers can easily and automatically extract their number. How does our visual system accomplish this? We investigate the role of specific spatial frequencies to the encoding of number through cross-adaptation. In two experiments, observers were peripherally adapted to six randomly generated sinusoidal gratings varying from relatively low-spatial frequency (M = 0.44 c/deg) to relatively high-spatial frequency (M = 5.88 c/deg). Subsequently, observers judged which side of the screen had a higher number of dots. We found a strong number-adaptation effect to low-spatial frequency gratings (i.e., participants significantly underestimated the number of dots on the adapted side) but a significantly reduced adaptation effect for high-spatial frequency gratings. Various control conditions demonstrate that these effects are not due to a generic response bias for the adapted side, nor moderated by dot size or spacing effects. In a third experiment, we observed no cross-adaptation for centrally presented gratings. Our results show that observers' peripheral number perception can be adapted even with stimuli lacking any numeric or segmented object information and that low spatial frequencies adapt peripheral number perception more than high ones. Together, our results are consistent with recent number perception models that suggest a key role for spatial frequency in the extraction of number from the visual signal (e.g., Paul, Ackooij, Ten Cate, & Harvey, 2022), but additionally suggest that some spatial frequencies - especially in the low range and in the periphery - may be weighted more by the visual system when estimating number. We argue that the cross-adaptation paradigm is also a useful methodology for discovering the primitives of visual number encoding.

Numerosity depends on normalized contrast energy: Review and square-root law model

The perceived numerosity of many randomly-located items of fixed contrast depends on the integrated contrast energy (CE) of the display. We show here that a model based on √(CE), normalized by contrast amplitude, can fit numerosity judgment data in various tasks and over a wide range of numerosities. The model shows that judged numerosity increases linearly with √(N), where N is the number of displayed items above the subitization range, and can explain: 1) the general underestimation in absolute judgement of numerosity; 2) the contrast independence (constancy) of numerosity judgment in segregated displays, i.e., judged numerosities are not affected by item contrast; 2) a contrast-dependent illusion where the numerosity of higher-contrast items is further underestimated when intermingled with lower-contrast items; and 3) both the threshold and sensitivity of numerosity discrimination between displays of N and M items. The nearly perfect fit of numerosity judgment data by a square-root law over a wide range of numerosities, including the range typically described by Weber's law, but excluding subitization, suggests that normalized contrast energy might be the prevailing sensory code underlying numerosity perception.

Fundamental units of numerosity estimation

Humans can approximately enumerate a large number of objects at a single glance. While several mechanisms have been proposed to account for this ability, the fundamental units over which they operate remain unclear. Previous studies have argued that estimation mechanisms act only on topologically distinct units or on units formed by spatial grouping cues such as proximity and connectivity, but not on units grouped by similarity. Over four experiments, we tested this claim by systematically assessing and demonstrating that similarity grouping leads to underestimation, just as spatial grouping does. Ungrouped objects with the same low-level properties as grouped objects did not cause underestimation. Further, the underestimation caused by spatial and similarity grouping was additive, suggesting that these grouping processes operate independently. These findings argue against the proposal that estimation mechanisms operate solely on topological units. Instead, we conclude that estimation processes act on representations constructed after Gestalt grouping principles, whether similarity based or spatial, have organised incoming visual input.

The role of non-numerical information in the perception of temporal numerosity

Numerosity perception refers to the ability to make rapid but approximate estimates of the quantity of elements in a set (spatial numerosity) or presented sequentially (temporal numerosity). Whether numerosity is directly perceived or indirectly recomputed from non-numerical features is a highly debated issue. In the spatial domain, area and density have been suggested as the main parameters through which numerosity would be recomputed. In the temporal domain, stimuli duration and temporal frequency could be similarly exploited to retrieve numerosity. By adapting a psychophysical technique previously exploited in the spatial domain, we investigated whether temporal visual numerosity is directly perceived. Adult participants observed sequences of visual impulses sampled from a stimulus space spanning several levels of temporal frequency and duration (and hence numerosity), and then reproduced the sequence as accurately as possible via a series of keypresses. Crucially, participants were not asked to reproduce any particular property (such as number of impulses) but were free to choose any available cue (such as total duration, or temporal frequency). The results indicate that while the overall sequence duration was barely considered, numerosity and temporal frequency were both spontaneously used as the main cues to reproduce the sequences, with a slight but significant dominance of numerosity. Overall, the results are in line with previous literature suggesting that numerosity is directly encoded, even for temporal sequences, but a non-numerical feature (temporal frequency) is also used in reproducing sequences.

Numerosity Comparison in Three Dimensions in the Case of Low Numerical Values

This study investigated the perception of numbers in humans in 3D stimuli. Recent research has shown that number processing relies on "number sense" for small values, in line with Weber's law. While previous studies have reported 3D numerosity overestimation mainly in higher numerical values, our experiment examined whether this phenomenon occurs at lower numerical values. We also explored whether the Weber ratio follows Weber's law when comparing 2D and 3D stimuli in terms of the number of elements. Observers were presented with pairs of stimuli on a monitor and were asked to identify the stimulus with a larger number of elements. Using the constant method, we calculated the point of subjective equality (PSE), just noticeable difference (JND), and Weber ratios from the collected data. As a result, it was confirmed that the phenomenon of over-estimation of 3D numerical values occurs even when the numerical values are small. Additionally, we observed that the Weber fraction adhered to Weber's law within the measured range. These findings contribute to the existing body of research, supporting the existence of distinct mechanisms for perceiving numerosity and density.

Dyslexia: Causes and Concomitant Impairments

In recent decades, theories have been presented to explain the nature of dyslexia, but the causes of dyslexia remained unclear. Although the investigation of the causes of dyslexia presupposes a clear understanding of the concept of cause, such an understanding is missing. The present paper proposes the absence of at least one necessary condition or the absence of all sufficient conditions as causes for impaired reading. The causes of impaired reading include: an incorrect fixation location, too short a fixation time, the attempt to recognize too many letters simultaneously, too large saccade amplitudes, and too short verbal reaction times. It is assumed that a longer required fixation time in dyslexic readers results from a functional impairment of areas V1, V2, and V3 that require more time to complete temporal summation. These areas and areas that receive input from them, such as the fusiform gyrus, are assumed to be impaired in their ability to simultaneously process a string of letters. When these impairments are compensated by a new reading strategy, reading ability improves immediately.

Numerosity as a visual property: Evidence from two highly evolutionary distant species

Most animals, from humans to invertebrates, possess an ability to estimate numbers. This evolutionary advantage facilitates animals' choice of environments with more food sources, more conspecifics to increase mating success, and/or reduced predation risk among others. However, how the brain processes numerical information remains largely unknown. There are currently two lines of research interested in how numerosity of visual objects is perceived and analyzed in the brain. The first argues that numerosity is an advanced cognitive ability processed in high-order brain areas, while the second proposes that "numbers" are attributes of the visual scene and thus numerosity is processed in the visual sensory system. Recent evidence points to a sensory involvement in estimating magnitudes. In this Perspective, we highlight this evidence in two highly evolutionary distant species: humans and flies. We also discuss the advantages of studying numerical processing in fruit flies in order to dissect the neural circuits involved in and required for numerical processing. Based on experimental manipulation and the fly connectome, we propose a plausible neural network for number sense in invertebrates.

Visual numerosity perception shows no advantage in real-world scenes compared to artificial displays

While the human visual system is sensitive to numerosity, the mechanisms that allow perception to extract and represent the number of objects in a scene remains unknown. Prominent theoretical approaches posit that numerosity perception emerges from passive experience with visual scenes throughout development, and that unsupervised deep neural network models mirror all characteristic behavioral features observed in participants. Here, we derive and test a novel prediction: if the visual number sense emerges from exposure to real-world scenes, then the closer a stimulus aligns with the natural statistics of the real world, the better number perception should be. But - in contrast to this prediction - we observe no such advantage (and sometimes even a notable impairment) in number perception for natural scenes compared to artificial dot displays in college-aged adults. These findings are not accounted for by the difficulty in object identification, visual clutter, the parsability of objects from the rest of the scene, or increased occlusion. This pattern of results represents a fundamental challenge to recent models of numerosity perception based in experiential learning of statistical regularities, and instead suggests that the visual number sense is attuned to abstract number of objects, independent of their underlying correlation with non-numeric features. We discuss our results in the context of recent proposals that suggest that object complexity and entropy may play a role in number perception.

Assessing the ecological validity of numerosity-selective neuronal populations with real-world natural scenes

Animals and humans are able to quickly and effortlessly estimate the number of items in a set: their numerosity. Numerosity perception is thought to be critical to behavior, from feeding to escaping predators to human mathematical cognition. Virtually, all scientific studies on numerosity mechanisms use well controlled but artificial stimuli to isolate the numerosity dimension from other physical quantities. Here, we probed the ecological validity of these artificial stimuli and evaluate whether an important component in numerosity processing, the numerosity-selective neural populations, also respond to numerosity of items in real-world natural scenes. Using 7T MRI and natural images from a wide range of categories, we provide evidence that the numerosity-tuned neuronal populations show numerosity-selective responses when viewing images from a real-world natural scene. Our findings strengthen the role of numerosity-selective neurons in numerosity perception and provide an important link to their function in numerosity perception in real-world settings.

The malleable impact of non-numeric features in visual number perception

Non-numeric stimulus features frequently influence observers' number judgments: when judging the number of items in a display, we will often (mis)perceive the set with a larger cumulative surface area as more numerous. These "congruency effects" are often used as evidence for how vision extracts numeric information and have been invoked in arguments surrounding whether non-numeric cues (e.g., cumulative area, density, etc.) are combined for number perception. We test whether congruency effects for one such cue - cumulative area - provide evidence that it is necessarily used and integrated in number perception, or if its influence on number is malleable. In Experiment 1, we replicate and extend prior work showing that the presence of feedback eliminates congruency effects between number and cumulative area, suggesting that the role of cumulative area in number perception is malleable rather than obligatory. In Experiment 2, we test whether this malleable influence is because of use of prior experiences about how number naturalistically correlates with cumulative area, or the result of response competition, with number and cumulative area actively competing for the same behavioral decision. We preserve cumulative area as a visual cue but eliminate response competition with number by replacing one side of the dot array with its corresponding Hindu-Arabic numeral. Independent of the presence or absence of feedback, we do not observe congruency effects in Experiment 2. These experiments suggest that cumulative area is not necessarily integrated in number perception nor a reflection of a rational use of naturalistic correlations, but rather congruency effects between cumulative area and number emerge as a consequence of response competition. Our findings help to elucidate the mechanism through which non-numeric cues and number interact, and provide an explanation for why congruency effects are only sometimes observed across studies.

Attention drives human numerosity-selective responses

Numerosity, the set size of a group of items, helps guide behavior and decisions. Previous studies have shown that neural populations respond selectively to numerosities. How numerosity is extracted from the visual scene is a longstanding debate, often contrasting low-level visual with high-level cognitive processes. Here, we investigate how attention influences numerosity-selective responses. The stimuli consisted of black and white dots within the same display. Participants' attention was focused on either black or white dots, while we systematically changed the numerosity of black, white, and total dots. Using 7 T fMRI, we show that the numerosity-tuned neural populations respond only when attention is focused on their preferred numerosity, irrespective of the unattended or total numerosities. Without attention, responses to preferred numerosity are suppressed. Unlike traditional effects of attention in the visual cortex, where attention enhances already existing responses, these results suggest that attention is required to drive numerosity-selective responses.

Auditory timing-tuned neural responses in the human auditory cortices

Perception of sub-second auditory event timing supports multisensory integration, and speech and music perception and production. Neural populations tuned for the timing (duration and rate) of visual events were recently described in several human extrastriate visual areas. Here we ask whether the brain also contains neural populations tuned for auditory event timing, and whether these are shared with visual timing. Using 7T fMRI, we measured responses to white noise bursts of changing duration and rate. We analyzed these responses using neural response models describing different parametric relationships between event timing and neural response amplitude. This revealed auditory timing-tuned responses in the primary auditory cortex, and auditory association areas of the belt, parabelt and premotor cortex. While these areas also showed tonotopic tuning for auditory pitch, pitch and timing preferences were not consistently correlated. Auditory timing-tuned response functions differed between these areas, though without clear hierarchical integration of responses. The similarity of auditory and visual timing tuned responses, together with the lack of overlap between the areas showing these responses for each modality, suggests modality-specific responses to event timing are computed similarly but from different sensory inputs, and then transformed differently to suit the needs of each modality.