Neuronal foundations of human numerical representations

Mapping and modeling the semantic space of math concepts

Mathematics is an underexplored domain of human cognition. While many studies have focused on subsets of math concepts such as numbers, fractions, or geometric shapes, few have ventured beyond these elementary domains. Here, we attempted to map out the full space of math concepts and to answer two specific questions: can distributed semantic models, such a GloVe, provide a satisfactory fit to human semantic judgements in mathematics? And how does this fit vary with education? We first analyzed all of the French and English Wikipedia pages with math contents, and used a semi-automatic procedure to extract the 1000 most frequent math terms in both languages. In a second step, we collected extensive behavioral judgements of familiarity and semantic similarity between them. About half of the variance in human similarity judgements was explained by vector embeddings that attempt to capture latent semantic structures based on cooccurence statistics. Participants' self-reported level of education modulated familiarity and similarity, allowing us to create a partial hierarchy among high-level math concepts. Our results converge onto the proposal of a map of math space, organized as a database of math terms with information about their frequency, familiarity, grade of acquisition, and entanglement with other concepts.

Neurocognitive Assessment of Mathematics-Related Capacities in Neurosurgical Patients

A precise neuropsychological assessment is of the utmost importance for neurosurgical patients undergoing the surgical excision of cerebral lesions. The assessment of mathematical abilities is usually limited to arithmetical operations while other fundamental visuo-spatial aspects closely linked to mathematics proficiency, such as the perception of numerical quantities and geometrical reasoning, are completely neglected. We evaluated these abilities with two objective and reproducible psychophysical tests, measuring numerosity perception and non-symbolic geometry, respectively. We tested sixteen neuro-oncological patients before the operation and six after the operation with classical neuropsychological tests and with two psychophysical tests. The scores of the classical neuropsychological tests were very heterogeneous, possibly due to the distinct location and histology of the tumors that might have spared (or not) brain areas subserving these abilities or allowed for plastic reorganization. Performance in the two non-symbolic tests reflected, on average, the presumed functional role of the lesioned areas, with participants with parietal and frontal lesions performing worse on these tests than patients with occipital and temporal lesions. Single-case analyses not only revealed some interesting exceptions to the group-level results (e.g., patients with parietal lesions performing well in the numerosity test), but also indicated that performance in the two tests was independent of non-verbal reasoning and visuo-spatial working memory. Our results highlight the importance of assessing non-symbolic numerical and geometrical abilities to complement typical neuropsychological batteries. However, they also suggest an avoidance of reliance on an excessively rigid localizationist approach when evaluating the neuropsychological profile of oncological patients.

Intuitive mapping between nonsymbolic quantity and observed action across development

Adults' concurrent processing of numerical and action information yields bidirectional interference effects consistent with a cognitive link between these two systems of representation. This link is in place early in life: infants create expectations of congruency across numerical and action-related stimuli (i.e., a small [large] hand aperture associated with a smaller [larger] numerosity). Although these studies point to a developmental continuity of this mapping, little is known about the later development and thus how experience shapes such relationships. We explored how number-action intuitions develop across early and later childhood using the same methodology as in adults. We asked 3-, 6-, and 8-year-old children, as well as adults, to relate the magnitude of an observed action (a static hand shape, open vs. closed, in Experiment 1; a dynamic hand movement, opening vs. closing, in Experiment 2) to either a small or large nonsymbolic quantity (numerosity in Experiment 1 and numerosity and/or object size in Experiment 2). From 6 years of age, children started performing in a systematic congruent way in some conditions, but only 8-year-olds (added in Experiment 2) and adults performed reliably above chance in this task. We provide initial evidence that early intuitions guiding infants' mapping between magnitude across nonsymbolic number and observed action are used in an explicit way only from late childhood, with a mapping between action and size possibly being the most intuitive. An initial coarse mapping between number and action is likely modulated with extensive experience with grasping and related actions directed to both arrays and individual objects.

Questions About Quantifiers: Symbolic and Nonsymbolic Quantity Processing by the Brain

One approach to understanding how the human cognitive system stores and operates with quantifiers such as "some," "many," and "all" is to investigate their interaction with the cognitive mechanisms for estimating and comparing quantities from perceptual input (i.e., nonsymbolic quantities). While a potential link between quantifier processing and nonsymbolic quantity processing has been considered in the past, it has never been discussed extensively. Simultaneously, there is a long line of research within the field of numerical cognition on the relationship between processing exact number symbols (such as "3" or "three") and nonsymbolic quantity. This accumulated knowledge can potentially be harvested for research on quantifiers since quantifiers and number symbols are two different ways of referring to quantity information symbolically. The goal of the present review is to survey the research on the relationship between quantifiers and nonsymbolic quantity processing mechanisms and provide a set of research directions and specific questions for the investigation of quantifier processing.

Electrophysiological Evidence for A Number-Action Mapping in Infancy

In the last decades, a growing body of literature has focused on the link between number and action. Many studies conducted on adult participants have provided evidence for a bidirectional influence between numerosity processing and grasping or reaching actions. However, it is not yet clear whether this link is functional in early infancy. Here, we used the event-related potential (ERP) technique to record electrical activity of the brain in response to number-hand pairings. We implemented a cueing paradigm where 3- to 4-month-old infants observed images showing either congruency (e.g., a large numerosity primed by a large hand opening) or incongruency (e.g., a large numerosity primed by a small hand opening). Infants' brain activity was modulated by the congruency of the pairings: amplitudes recorded over frontal and parietal-occipital scalp positions differed for congruent versus incongruent pairings. These findings suggest that the association between number and hand action processing is already functional early in life.

The link between number and action in human infants

Humans' inborn ability to represent and manipulate numerical quantities is supported by the parietal cortex, which is also involved in a variety of spatial and motor abilities. While the behavioral links between numerical and spatial information have been extensively studied, little is known about the connection between number and action. Some studies in adults have shown a series of interference effects when simultaneously processing numerical and action information. We investigated the origins of this link by testing forty infants (7- to 9-month-old) in one of two experimental conditions: one group was habituated to congruent number-hand pairings, where the larger the number, the more open the hand-shape associated; the second group was habituated to incongruent number-hand pairings, where the larger the number, the more close the hand-shape associated. In test trials, both groups of infants were presented with congruent and incongruent pairings. We found that only infants habituated to congruency showed a significantly higher looking time to the test trial depicting incongruent pairings. These findings show for the first time that infants spontaneously associate magnitude-related changes across the dimensions of number and action-related information, thus offering support to the existence of an early, preverbal number-action link in the human mind.

Reduced 2D form coherence and 3D structure from motion sensitivity in developmental dyscalculia

Developmental dyscalculia (DD) is a specific learning disability affecting the development of numerical and arithmetical skills. The origin of DD is typically attributed to the suboptimal functioning of key regions within the dorsal visual stream (parietal cortex) which support numerical cognition. While DD individuals are often impaired in visual numerosity perception, the extent to which they also show a wider range of visual dysfunctions is poorly documented. In the current study we measured sensitivity to global motion (translational and flow), 2D static form (Glass patterns) and 3D structure from motion in adults with DD and control subjects. While sensitivity to global motion was comparable across groups, thresholds for static form and structure from motion were higher in the DD compared to the control group, irrespective of associated reading impairments. Glass pattern sensitivity predicted numerical abilities, and this relation could not be explained by recently reported differences in visual crowding. Since global form sensitivity has often been considered an index of ventral stream function, our findings could indicate a cortical dysfunction extending beyond the dorsal visual stream. Alternatively, they would fit with a role of parietal cortex in form perception under challenging conditions requiring multiple element integration.

Groupitizing modifies neural coding of numerosity

Numerical estimation of arrays of objects is faster and more accurate when items can be clustered into groups, a phenomenon termed “groupitizing.” Grouping can facilitate segregation into subitizable “chunks,” each easily estimated, then summed. The current study investigates whether spatial grouping of arrays drives specific neural responses during numerical estimation, reflecting strategies such as exact calculation and fact retrieval. Fourteen adults were scanned with fMRI while estimating either the numerosity or shape of arrays of items, either randomly distributed or spatially grouped. Numerosity estimation of both classes of stimuli elicited common activation of a right lateralized frontoparietal network. Grouped stimuli additionally recruited regions in the left hemisphere and bilaterally in the angular gyrus. Multivariate pattern analysis showed that classifiers trained with the pattern of neural activations read out from parietal regions, but not from the primary visual areas, can decode different numerosities both within and across spatial arrangements. The behavioral numerical acuity correlated with the decoding performance of the parietal but not with occipital regions. Overall, this experiment suggests that the estimation of grouped stimuli relies on the approximate number system for numerosity estimation, but additionally recruits regions involved in calculation.

The pupil responds spontaneously to perceived numerosity

Although luminance is the main determinant of pupil size, the amplitude of the pupillary light response is also modulated by stimulus appearance and attention. Here we ask whether perceived numerosity modulates the pupillary light response. Participants passively observed arrays of black or white dots of matched physical luminance but different physical or illusory numerosity. In half the patterns, pairs of dots were connected by lines to create dumbbell-like shapes, inducing an illusory underestimation of perceived numerosity; in the other half, connectors were either displaced or removed. Constriction to white arrays and dilation to black were stronger for patterns with higher perceived numerosity, either physical or illusory, with the strength of the pupillary light response scaling with the perceived numerosity of the arrays. Our results show that even without an explicit task, numerosity modulates a simple automatic reflex, suggesting that numerosity is a spontaneously encoded visual feature.

Processing symbolic magnitude information conveyed by number words and by scalar adjectives

Humans not only process and compare magnitude information such as size, duration, and number perceptually, but they also communicate about these properties using language. In this respect, a relevant class of lexical items are so-called scalar adjectives like “big,” “long,” “loud,” and so on which refer to magnitude information. It has been proposed that humans use an amodal and abstract representation format shared by different dimensions, called the generalised magnitude system (GMS). In this paper, we test the hypothesis that scalar adjectives are symbolic references to GMS representations, and, therefore, GMS gets involved in processing their meaning. Previously, a parallel hypothesis on the relation between number symbols and GMS representations has been tested with the size congruity paradigm. The results of these experiments showed interference between the processing of number symbols and the processing of physical (font-) size. In the first three experiments of the present study (total N = 150), we used the size congruity paradigm and the same/different task to look at the potential interaction between physical size magnitude and numerical magnitude expressed by number words. In the subsequent three experiments (total N = 149), we looked at a parallel potential interaction between physical size magnitude and scalar adjective meaning. In the size congruity paradigm, we observed interference between the processing of the numerical value of number words and the meaning of scalar adjectives, on the one hand, and physical (font-) size, on the other hand, when participants had to judge the number words or the adjectives (while ignoring physical size). No interference was obtained for the reverse situation, i.e., when participants judged the physical font size (while ignoring numerical value or meaning). The results of the same/different task for both number words and scalar adjectives strongly suggested that the interference that was observed in the size congruity paradigm was likely due to a response conflict at the decision stage of processing rather than due to the recruitment of GMS representations. Taken together, it can be concluded that the size congruity paradigm does not provide evidence in support the hypothesis that GMS representations are used in the processing of number words or scalar adjectives. Nonetheless, the hypothesis we put forward about scalar adjectives is still is a promising potential line of research. We make a number of suggestions for how this hypothesis can be explored in future studies.

The neural basis of counting sequences

Sequence processing is critical for complex behavior, and counting sequences hold a unique place underlying human numerical development. Despite this, the neural bases of counting sequences remain unstudied. We hypothesized that counting sequences in adults would involve representations in sensory, order, magnitude, and linguistic codes that implicate regions in auditory, supplementary motor, posterior parietal, and inferior frontal areas, respectively. In an fMRI scanner, participants heard four-number sequences in a 2 × 2 × 2 design. The sequences were adjacent or not (e.g., 5, 6, 7, 8 vs. 5, 6, 7, 9), ordered or not (e.g., 5, 6, 7, 8 vs. 8, 5, 7, 6), and were spoken by a voice of consistent or variable identity. Then, neural substrates of counting sequences were identified by testing for the effect of consecutiveness (ordered nonadjacent versus ordered adjacent, e.g., 5, 6, 7, 9 > 5, 6, 7, 8) in the hypothesized brain regions. Violations to consecutiveness elicited brain activity in the right inferior frontal gyrus (IFG) and the supplementary motor area (SMA). In contrast, no such activation was observed in the auditory cortex, despite violations in voice identity recruiting strong activity in that region. Also, no activation was observed in the inferior parietal lobule, despite a robust effect of orderedness observed in that brain region. These findings indicate that listening to counting sequences do not automatically elicit sensory or magnitude codes but suggest that the precise increments in the sequence are tracked by the mechanism for processing ordered associations in the SMA and by the mechanism for binding individual lexical items into a cohesive whole in the IFG.

Representation of visual numerosity information during working memory in humans: An fMRI decoding study

Both animal and human studies on numerosity have shown the importance of the parietal cortex for numerosity processing. However, most studies have focused on the perceptual processing of numerosity. Still, it is unclear how and where numerosity information is coded when this information is retained during a working memory delay phase. Such temporal storage could be realized by the same structures as perceptual processes, or be transformed to a more abstract representation, potentially involving prefrontal regions. FMRI decoding studies allow the identification of brain areas that exhibit multi‐voxel activation patterns specific to the content of working memory. Here, we used an assumption‐free searchlight‐decoding approach to test where numerosity‐specific codes can be found during a 12 s retention period. Participants (n = 24) performed a retro‐cue delayed match‐to‐sample task, in which numerosity information was presented as visual dot arrays. We found mnemonic numerosity‐specific activation in the right lateral portion of the intraparietal sulcus; an area well‐known for perceptual processing of numerosity. The applied retro‐cue design dissociated working memory delay activity from perceptual processes and showed that the intraparietal sulcus also maintained working memory representation independent of perception.

Frequency-based Dissociation of Symbolic and Nonsymbolic Numerical Processing during Numerical Comparison

Recent evidence suggests that during numerical calculation, symbolic and nonsymbolic processing are functionally distinct operations. Nevertheless, both roughly recruit the same brain areas (spatially overlapping networks in the parietal cortex) and happen at the same time (roughly 250 msec poststimulus onset). We tested the hypothesis that symbolic and nonsymbolic processing are segregated by means of functionally relevant networks in different frequency ranges: high gamma (above 50 Hz) for symbolic processing and lower beta (12–17 Hz) for nonsymbolic processing. EEG signals were quantified as participants compared either symbolic numbers or nonsymbolic quantities. Larger EEG gamma-band power was observed for more difficult symbolic comparisons (ratio of 0.8 between the two numbers) than for easier comparisons (ratio of 0.2) over frontocentral regions. Similarly, beta-band power was larger for more difficult nonsymbolic comparisons than for easier ones over parietal areas. These results confirm the existence of a functional dissociation in EEG oscillatory dynamics during numerical processing that is compatible with the notion of distinct linguistic processing of symbolic numbers and approximation of nonsymbolic numerical information.

Learning disabilities: Developmental dyscalculia

Developmental dyscalculia (DD) is a developmental learning disability that manifests as a persistent difficulty in comprehending even the most basic numeric and arithmetic concepts, despite normal intelligence and schooling opportunities. Given the predominant use of numbers in modern society, this condition can pose major challenges in the sufferer's everyday life, both in personal and professional development. Since, to date, we still lack a universally recognized and psychometrically driven definition of DD, its diagnosis has been applied to a wide variety of cognitive profiles. In this chapter, we review the behavioral and neural characterization of DD as well as the different neurocognitive and etiologic accounts of this neurodevelopmental disorder. We underline the multicomponential nature of this heterogeneous disability: different aspects of mathematical competence can be affected by both the suboptimal recruitment of general cognitive functions supporting mathematical cognition (such as attention, memory, and cognitive control) and specific deficits in mastering numeric concepts and operations. Accordingly, both intervention paradigms focused on core numeric abilities and more comprehensive protocols targeting multiple neurocognitive systems have provided evidence for effective positive outcomes.

Attentional amplification of neural codes for number independent of other quantities along the dorsal visual stream

Humans and other animals base important decisions on estimates of number, and intraparietal cortex is thought to provide a crucial substrate of this ability. However, it remains debated whether an independent neuronal processing mechanism underlies this ‘number sense’, or whether number is instead judged indirectly on the basis of other quantitative features. We performed high-resolution 7 Tesla fMRI while adult human volunteers attended either to the numerosity or an orthogonal dimension (average item size) of visual dot arrays. Along the dorsal visual stream, numerosity explained a significant amount of variance in activation patterns, above and beyond non-numerical dimensions. Its representation was selectively amplified and progressively enhanced across the hierarchy when task relevant. Our results reveal a sensory extraction mechanism yielding information on numerosity separable from other dimensions already at early visual stages and suggest that later regions along the dorsal stream are most important for explicit manipulation of numerical quantity.

Numbers and the ability to count and calculate are an essential part of human culture. They are part of everyday life, featuring in calendars, computers or the weekly shop, but also in some of humanity’s biggest achievements: without them the pyramids or space travel would not exist. A precursor of sophisticated mathematical skill could reside in a simpler mental ability: the capacity to assess numerical quantities at a glance. This ‘number sense’ appears in humans in early childhood and it is also present in other animals, but it is still poorly understood.

Brain imaging techniques have identified the parts of the brain that are active when perceiving numbers or making calculations. As techniques have advanced, it has become possible to resolve fine differences in brain activity that occur when people switch their attention between different visual tasks. But how exactly does the human brain process visual information to make sense of numbers? One theory suggests that humans use visual cues, such as the size of a group of objects or how densely packed objects are, to estimate numbers. On the other hand, it is also possible that humans can sense number directly, without reference to other properties of the group being observed.

Castaldi et al. presented twenty adult volunteers with groups of dots and asked them to focus either on the number of dots or on the size of the dots during a brain scan. This approach allowed the separation of brain signals specific to number from signals corresponding to other visual cues, such as size or density of the group. The experiment revealed that brain activity changed depending on the number of dots displayed. The signal related to number became stronger when people focused on the number of dots, while signals related to other properties of the group remained unchanged. Moreover, brain signals for number were observed at the very early stages of visual processing, in the parts of the brain that receive input from the eyes first.

These results suggest that the human visual system perceives number directly, and not by processing information about the size or density of a group of objects. This finding provides insights into how human brains encode numbers, which could be important to understand disorders where number sense can be impaired leading to difficulties learning math and operating with numbers.

The neuro-cognitive representations of symbols: the case of concrete words

We live our lives surrounded by symbols (e.g., road signs, logos, but especially words and numbers), and throughout our life we use them to evoke, communicate and reflect upon ideas and things that are not currently present to our senses. Symbols are represented in our brains at different levels of complexity: at the first and most simple level, as physical entities, in the corresponding primary and secondary sensory cortices. The crucial property of symbols, however, is that, despite the simplicity of their surface forms, they have the power of evoking higher order multifaceted representations that are implemented in distributed neural networks spanning a large portion of the cortex. The rich internal states that reflect our knowledge of the meaning of symbols are what we call semantic representations. In this review paper, we summarize our current knowledge of both the cognitive and neural substrates of semantic representations, focusing on concrete words (i.e., nouns or verbs referring to concrete objects and actions), which, together with numbers, are the most-studied and well defined classes of symbols. Following a systematic descriptive approach, we will organize this literature review around two key questions: what is the content of semantic representations? And, how are semantic representations implemented in the brain, in terms of localization and dynamics? While highlighting the main current opposing perspectives on these topics, we propose that a fruitful way to make substantial progress in this domain would be to adopt a geometrical view of semantic representations as points in high dimensional space, and to operationally partition the space of concrete word meaning into motor-perceptual and conceptual dimensions. By giving concrete examples of the kinds of research that can be done within this perspective, we illustrate how we believe this framework will foster theoretical speculations as well as empirical research.

Effects of adaptation on numerosity decoding in the human brain

Psychophysical studies have shown that numerosity is a sensory attribute susceptible to adaptation. Neuroimaging studies have reported that, at least for relatively low numbers, numerosity can be accurately discriminated in the intra-parietal sulcus. Here we developed a novel rapid adaptation paradigm where adapting and test stimuli are separated by pauses sufficient to dissociate their BOLD activity. We used multivariate pattern recognition to classify brain activity evoked by non-symbolic numbers over a wide range (20-80), both before and after psychophysical adaptation to the highest numerosity. Adaptation caused underestimation of all lower numerosities, and decreased slightly the average BOLD responses in V1 and IPS. Using support vector machine, we showed that the BOLD response of IPS, but not in V1, classified numerosity well, both when tested before and after adaptation. However, there was no transfer from training pre-adaptation responses to testing post-adaptation, and vice versa, indicating that adaptation changes the neuronal representation of the numerosity. Interestingly, decoding was more accurate after adaptation, and the amount of improvement correlated with the amount of perceptual underestimation of numerosity across subjects. These results suggest that numerosity adaptation acts directly on IPS, rather than indirectly via other low-level stimulus parameters analysis, and that adaptation improves the capacity to discriminate numerosity.

The Symbol Grounding Problem Revisited: A Thorough Evaluation of the ANS Mapping Account and the Proposal of an Alternative Account Based on Symbol-Symbol Associations

Recently, a lot of studies in the domain of numerical cognition have been published demonstrating a robust association between numerical symbol processing and individual differences in mathematics achievement. Because numerical symbols are so important for mathematics achievement, many researchers want to provide an answer on the ‘symbol grounding problem,’ i.e., how does a symbol acquires its numerical meaning? The most popular account, the approximate number system (ANS) mapping account, assumes that a symbol acquires its numerical meaning by being mapped on a non-verbal and ANS. Here, we critically evaluate four arguments that are supposed to support this account, i.e., (1) there is an evolutionary system for approximate number processing, (2) non-symbolic and symbolic number processing show the same behavioral effects, (3) non-symbolic and symbolic numbers activate the same brain regions which are also involved in more advanced calculation and (4) non-symbolic comparison is related to the performance on symbolic mathematics achievement tasks. Based on this evaluation, we conclude that all of these arguments and consequently also the mapping account are questionable. Next we explored less popular alternative, where small numerical symbols are initially mapped on a precise representation and then, in combination with increasing knowledge of the counting list result in an independent and exact symbolic system based on order relations between symbols. We evaluate this account by reviewing evidence on order judgment tasks following the same four arguments. Although further research is necessary, the available evidence so far suggests that this symbol–symbol association account should be considered as a worthy alternative of how symbols acquire their meaning.