1
|
Luo J, Yokoi I, Dumoulin SO, Takemura H. Bistable perception of symbolic numbers. J Vis 2024; 24:12. [PMID: 39287596 PMCID: PMC11421664 DOI: 10.1167/jov.24.9.12] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2024] [Accepted: 08/03/2024] [Indexed: 09/19/2024] Open
Abstract
Numerals, that is, semantic expressions of numbers, enable us to have an exact representation of the amount of things. Visual processing of numerals plays an indispensable role in the recognition and interpretation of numbers. Here, we investigate how visual information from numerals is processed to achieve semantic understanding. We first found that partial occlusion of some digital numerals introduces bistable interpretations. Next, by using the visual adaptation method, we investigated the origin of this bistability in human participants. We showed that adaptation to digital and normal Arabic numerals, as well as homologous shapes, but not Chinese numerals, biases the interpretation of a partially occluded digital numeral. We suggest that this bistable interpretation is driven by intermediate shape processing stages of vision, that is, by features more complex than local visual orientations, but more basic than the abstract concepts of numerals.
Collapse
Affiliation(s)
- Junxiang Luo
- Division of Sensory and Cognitive Brain Mapping, Department of System Neuroscience, National Institute for Physiological Sciences, Okazaki, Japan
| | - Isao Yokoi
- Division of Sensory and Cognitive Brain Mapping, Department of System Neuroscience, National Institute for Physiological Sciences, Okazaki, Japan
- Technical Division, National Institute for Physiological Sciences, Okazaki, Japan
| | - Serge O Dumoulin
- Spinoza Centre for Neuroimaging, Amsterdam, the Netherlands
- Computational Cognitive Neuroscience and Neuroimaging, Netherlands Institute for Neuroscience, Amsterdam, the Netherlands
- Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
- Experimental Psychology, Utrecht University, Utrecht, the Netherlands
| | - Hiromasa Takemura
- Division of Sensory and Cognitive Brain Mapping, Department of System Neuroscience, National Institute for Physiological Sciences, Okazaki, Japan
- The Graduate Institute for Advanced Studies, SOKENDAI, Hayama, Japan
- Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology, Suita, Japan
| |
Collapse
|
2
|
Park Y, Zhang Y, Chang H, Menon V. Short-term number sense training recapitulates long-term neurodevelopmental changes from childhood to adolescence. Dev Sci 2024; 27:e13524. [PMID: 38695515 PMCID: PMC11343340 DOI: 10.1111/desc.13524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 04/09/2024] [Accepted: 04/11/2024] [Indexed: 05/08/2024]
Abstract
Number sense is fundamental to the development of numerical problem-solving skills. In early childhood, children establish associations between non-symbolic (e.g., a set of dots) and symbolic (e.g., Arabic numerals) representations of quantity. The developmental estrangement theory proposes that the relationship between non-symbolic and symbolic representations of quantity evolves with age, with increased dissociation across development. Consistent with this theory, recent research suggests that cross-format neural representational similarity (NRS) between non-symbolic and symbolic quantities is correlated with arithmetic fluency in children but not in adolescents. However, it is not known if short-term training (STT) can induce similar changes as long-term development. In this study, children aged 7-10 years underwent a theoretically motivated 4-week number sense training. Using multivariate neural pattern analysis, we investigated whether short-term learning could modify the relation between cross-format NRS and arithmetic skills. Our results revealed a significant correlation between cross-format NRS and arithmetic fluency in distributed brain regions, including the parietal and prefrontal cortices, prior to training. However, this association was no longer observed after training, and multivariate predictive models confirmed these findings. Our findings provide evidence that intensive STT during early childhood can promote behavioral improvements and neural plasticity that resemble and recapitulate long-term neurodevelopmental changes that occur from childhood to adolescence. More generally, our study contributes to our understanding of the malleability of number sense and highlights the potential for targeted interventions to shape neurodevelopmental trajectories in early childhood. RESEARCH HIGHLIGHTS: We tested the hypothesis that short-term number sense training induces the dissociation of symbolic numbers from non-symbolic representations of quantity in children. We leveraged a theoretically motivated intervention and multivariate pattern analysis to determine training-induced neurocognitive changes in the relation between number sense and arithmetic problem-solving skills. Neural representational similarity between non-symbolic and symbolic quantity representations was correlated with arithmetic skills before training but not after training. Short-term training recapitulates long-term neurodevelopmental changes associated with numerical problem-solving from childhood to adolescence.
Collapse
Affiliation(s)
- Yunji Park
- Department of Psychiatry & Behavioral Sciences, Stanford University School of Medicine, Stanford, California, USA
| | - Yuan Zhang
- Department of Psychiatry & Behavioral Sciences, Stanford University School of Medicine, Stanford, California, USA
| | - Hyesang Chang
- Department of Psychiatry & Behavioral Sciences, Stanford University School of Medicine, Stanford, California, USA
| | - Vinod Menon
- Department of Psychiatry & Behavioral Sciences, Stanford University School of Medicine, Stanford, California, USA
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, California, USA
- Stanford Neuroscience Institute, Stanford, California, USA
- Symbolic Systems Program, Stanford University, Stanford, California, USA
| |
Collapse
|
3
|
Yeo DJ, Pollack C, Conrad BN, Price GR. Functional and representational differences between bilateral inferior temporal numeral areas. Cortex 2024; 171:113-135. [PMID: 37992508 DOI: 10.1016/j.cortex.2023.08.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 12/15/2022] [Accepted: 08/09/2023] [Indexed: 11/24/2023]
Abstract
The processing of numerals as visual objects is supported by an "Inferior Temporal Numeral Area" (ITNA) in the bilateral inferior temporal gyri (ITG). Extant findings suggest some degree of hemispheric asymmetry in how the bilateral ITNAs process numerals. Pollack and Price (2019) reported such a hemispheric asymmetry by which a region in the left ITG was sensitive to digits during a visual search for a digit among letters, and a homologous region in the right ITG that showed greater digit sensitivity in individuals with higher calculation skills. However, the ITG regions were localized with separate analyses without directly contrasting their digit sensitivities and relation to calculation skills. So, the extent of and reasons for these functional asymmetries remain unclear. Here we probe whether the functional and representational properties of the ITNAs are asymmetric by applying both univariate and multivariate region-of-interest analyses to Pollack and Price's (2019) data. Contrary to the implications of the original findings, digit sensitivity did not differ between ITNAs, and digit sensitivity in both left and right ITNAs was associated with calculation skills. Representational similarity analyses revealed that the overall representational geometries of digits in the ITNAs were also correlated, albeit weakly, but the representational contents of the ITNAs were largely inconclusive. Nonetheless, we found a right lateralization in engagement in alphanumeric categorization, and that the right ITNA showed greater discriminability between digits and letters. Greater right lateralization of digit sensitivity and digit discriminability in the left ITNA were also related to higher calculation skills. Our findings thus suggest that the ITNAs may not be functionally identical and should be directly contrasted in future work. Our study also highlights the importance of within-individual comparisons for understanding hemispheric asymmetries, and analyses of individual differences and multivariate features to uncover effects that would otherwise be obscured by averages.
Collapse
Affiliation(s)
- Darren J Yeo
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, Nashville, TN, USA; Division of Psychology, School of Social Sciences, Nanyang Technological University, Singapore
| | - Courtney Pollack
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, Nashville, TN, USA
| | - Benjamin N Conrad
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, Nashville, TN, USA
| | - Gavin R Price
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, Nashville, TN, USA; Department of Psychology, University of Exeter, Exeter, United Kingdom.
| |
Collapse
|
4
|
Klein E, Knops A. The two-network framework of number processing: a step towards a better understanding of the neural origins of developmental dyscalculia. J Neural Transm (Vienna) 2023; 130:253-268. [PMID: 36662281 PMCID: PMC10033479 DOI: 10.1007/s00702-022-02580-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Accepted: 12/23/2022] [Indexed: 01/21/2023]
Abstract
Developmental dyscalculia is a specific learning disorder that persists over lifetime and can have an enormous impact on personal, health-related, and professional aspects of life. Despite its central importance, the origin both at the cognitive and neural level is not yet well understood. Several classification schemas of dyscalculia have been proposed, sometimes together with an associated deficit at the neural level. However, these explanations are (a) not providing an exhaustive framework that is at levels with the observed complexity of developmental dyscalculia at the behavioral level and (b) are largely mono-causal approaches focusing on gray matter deficits. We suggest that number processing is instead the result of context-dependent interaction of two anatomically largely separate, distributed but overlapping networks that function/cooperate in a closely integrated fashion. The proposed two-network framework (TNF) is the result of a series of studies in adults on the neural correlates underlying magnitude processing and arithmetic fact retrieval, which comprised neurofunctional imaging of various numerical tasks, the application of probabilistic fiber tracking to obtain well-defined connections, and the validation and modification of these results using disconnectome mapping in acute stroke patients. Emerged from data in adults, it represents the endpoint of the acquisition and use of mathematical competencies in adults. Yet, we argue that its main characteristics should already emerge earlier during development. Based on this TNF, we develop a classification schema of phenomenological subtypes and their underlying neural origin that we evaluate against existing propositions and the available empirical data.
Collapse
Affiliation(s)
- Elise Klein
- LaPsyDÉ, UMR CNRS 8240, Université Paris Cité, La Sorbonne, 46 Rue Saint-Jacques, 75005, Paris, France.
- Leibniz-Institut Fuer Wissensmedien Tuebingen, Tuebingen, Germany.
| | - André Knops
- LaPsyDÉ, UMR CNRS 8240, Université Paris Cité, La Sorbonne, 46 Rue Saint-Jacques, 75005, Paris, France
| |
Collapse
|
5
|
Lee J, Jung M, Lustig N, Lee J. Neural representations of the perception of handwritten digits and visual objects from a convolutional neural network compared to humans. Hum Brain Mapp 2023; 44:2018-2038. [PMID: 36637109 PMCID: PMC9980894 DOI: 10.1002/hbm.26189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 12/04/2022] [Accepted: 12/12/2022] [Indexed: 01/14/2023] Open
Abstract
We investigated neural representations for visual perception of 10 handwritten digits and six visual objects from a convolutional neural network (CNN) and humans using functional magnetic resonance imaging (fMRI). Once our CNN model was fine-tuned using a pre-trained VGG16 model to recognize the visual stimuli from the digit and object categories, representational similarity analysis (RSA) was conducted using neural activations from fMRI and feature representations from the CNN model across all 16 classes. The encoded neural representation of the CNN model exhibited the hierarchical topography mapping of the human visual system. The feature representations in the lower convolutional (Conv) layers showed greater similarity with the neural representations in the early visual areas and parietal cortices, including the posterior cingulate cortex. The feature representations in the higher Conv layers were encoded in the higher-order visual areas, including the ventral/medial/dorsal stream and middle temporal complex. The neural representations in the classification layers were observed mainly in the ventral stream visual cortex (including the inferior temporal cortex), superior parietal cortex, and prefrontal cortex. There was a surprising similarity between the neural representations from the CNN model and the neural representations for human visual perception in the context of the perception of digits versus objects, particularly in the primary visual and associated areas. This study also illustrates the uniqueness of human visual perception. Unlike the CNN model, the neural representation of digits and objects for humans is more widely distributed across the whole brain, including the frontal and temporal areas.
Collapse
Affiliation(s)
- Juhyeon Lee
- Department of Brain and Cognitive EngineeringKorea UniversitySeoulRepublic of Korea
| | - Minyoung Jung
- Department of Brain and Cognitive EngineeringKorea UniversitySeoulRepublic of Korea
| | - Niv Lustig
- Department of Brain and Cognitive EngineeringKorea UniversitySeoulRepublic of Korea
| | - Jong‐Hwan Lee
- Department of Brain and Cognitive EngineeringKorea UniversitySeoulRepublic of Korea
| |
Collapse
|
6
|
Conrad BN, Pollack C, Yeo DJ, Price GR. Structural and functional connectivity of the inferior temporal numeral area. Cereb Cortex 2022; 33:6152-6170. [PMID: 36587366 PMCID: PMC10183753 DOI: 10.1093/cercor/bhac492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 11/14/2022] [Accepted: 11/17/2022] [Indexed: 01/02/2023] Open
Abstract
A growing body of evidence suggests that in adults, there is a spatially consistent "inferior temporal numeral area" (ITNA) in the occipitotemporal cortex that appears to preferentially process Arabic digits relative to non-numerical symbols and objects. However, very little is known about why the ITNA is spatially segregated from regions that process other orthographic stimuli such as letters, and why it is spatially consistent across individuals. In the present study, we used diffusion-weighted imaging and functional magnetic resonance imaging to contrast structural and functional connectivity between left and right hemisphere ITNAs and a left hemisphere letter-preferring region. We found that the left ITNA had stronger structural and functional connectivity than the letter region to inferior parietal regions involved in numerical magnitude representation and arithmetic. Between hemispheres, the left ITNA showed stronger structural connectivity with the left inferior frontal gyrus (Broca's area), while the right ITNA showed stronger structural connectivity to the ipsilateral inferior parietal cortex and stronger functional coupling with the bilateral IPS. Based on their relative connectivity, our results suggest that the left ITNA may be more readily involved in mapping digits to verbal number representations, while the right ITNA may support the mapping of digits to quantity representations.
Collapse
Affiliation(s)
- Benjamin N Conrad
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, 230 Appleton Place, Nashville, TN, 37203, USA
| | - Courtney Pollack
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, 230 Appleton Place, Nashville, TN, 37203, USA
| | - Darren J Yeo
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, 230 Appleton Place, Nashville, TN, 37203, USA.,Division of Psychology, School of Social Sciences, Nanyang Technological University, 48 Nanyang Avenue, Singapore, 639818
| | - Gavin R Price
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, 230 Appleton Place, Nashville, TN, 37203, USA.,Department of Psychology, University of Exeter, Washington Singer Building Perry Road, Exeter, EX4 4QG, United Kingdom
| |
Collapse
|
7
|
Amalric M, Cantlon JF. Common Neural Functions during Children's Learning from Naturalistic and Controlled Mathematics Paradigms. J Cogn Neurosci 2022; 34:1164-1182. [PMID: 35303098 DOI: 10.1162/jocn_a_01848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Two major goals of human neuroscience are to understand how the brain functions in the real world and to measure neural processes under conditions that are ecologically valid. A critical step toward these goals is understanding how brain activity during naturalistic tasks that mimic the real world relates to brain activity in more traditional laboratory tasks. In this study, we used intersubject correlations to locate reliable stimulus-driven cerebral processes among children and adults in a naturalistic video lesson and a laboratory forced-choice task that shared the same arithmetic concept. We show that relative to a control condition with grammatical content, naturalistic and laboratory arithmetic tasks evoked overlapping activation within brain regions previously associated with math semantics. The regions of specific functional overlap between the naturalistic mathematics lesson and laboratory mathematics task included bilateral intraparietal cortex, which confirms that this region processes mathematical content independently of differences in task mode. These findings suggest that regions of the intraparietal cortex process mathematical content when children are learning about mathematics in a naturalistic setting.
Collapse
|
8
|
Kanjlia S, Feigenson L, Bedny M. Neural basis of approximate number in congenital blindness. Cortex 2021; 142:342-356. [PMID: 34352637 DOI: 10.1016/j.cortex.2021.06.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2020] [Revised: 01/06/2021] [Accepted: 06/01/2021] [Indexed: 01/29/2023]
Abstract
Although humans are unique among animals in their ability to manipulate symbolic numbers, we share with other species an approximate number sense that allows us to estimate and compare the number of objects or events in a set, such as the number of apples in a tree. Our ability to discriminate the numerosity of two sets decreases as the ratio between them becomes smaller (e.g., 8 vs 16 items is harder to discriminate than 8 vs 32 items). The intraparietal sulcus (IPS) plays a key role in this numerical approximation. Neuronal populations within the IPS code for numerosity, with stimuli of different numerosities eliciting discriminable spatial patterns of activity. The developmental origins of these IPS number representations are not known. Here, we tested the hypothesis that representations of number in the IPS require visual experience with object sets, by working with individuals blind from birth. While undergoing fMRI, congenitally blind (n = 17) and blindfolded sighted (n = 25) participants judged which of two sequences of beeps was more numerous. In both sighted and blind individuals, patterns of activity in the IPS discriminated among different numerosities (4, 8, 16 vs 32), with better discrimination in the IPS of the blind group. In both groups, decoding performance decreased as the ratio between numerosities decreased (e.g., 8 vs 16 was less discriminable than 8 vs 32). These findings suggest that number representations in the IPS either have innate precursors, or that auditory or tactile experience with sets is sufficient for typical development.
Collapse
Affiliation(s)
- Shipra Kanjlia
- Department of Psychology, Carnegie Mellon University, USA; Department of Psychological and Brain Sciences, Johns Hopkins University, USA.
| | - Lisa Feigenson
- Department of Psychological and Brain Sciences, Johns Hopkins University, USA
| | - Marina Bedny
- Department of Psychological and Brain Sciences, Johns Hopkins University, USA
| |
Collapse
|