1
|
Wang J, Du X, Yao S, Li L, Tanigawa H, Zhang X, Roe AW. Mesoscale organization of ventral and dorsal visual pathways in macaque monkey revealed by 7T fMRI. Prog Neurobiol 2024; 234:102584. [PMID: 38309458 DOI: 10.1016/j.pneurobio.2024.102584] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 01/26/2024] [Accepted: 01/29/2024] [Indexed: 02/05/2024]
Abstract
In human and nonhuman primate brains, columnar (mesoscale) organization has been demonstrated to underlie both lower and higher order aspects of visual information processing. Previous studies have focused on identifying functional preferences of mesoscale domains in specific areas; but there has been little understanding of how mesoscale domains may cooperatively respond to single visual stimuli across dorsal and ventral pathways. Here, we have developed ultrahigh-field 7 T fMRI methods to enable simultaneous mapping, in individual macaque monkeys, of response in both dorsal and ventral pathways to single simple color and motion stimuli. We provide the first evidence that anatomical V2 cytochrome oxidase-stained stripes are well aligned with fMRI maps of V2 stripes, settling a long-standing controversy. In the ventral pathway, a systematic array of paired color and luminance processing domains across V4 was revealed, suggesting a novel organization for surface information processing. In the dorsal pathway, in addition to high quality motion direction maps of MT, MST and V3A, alternating color and motion direction domains in V3 are revealed. As well, submillimeter motion domains were observed in peripheral LIPd and LIPv. In sum, our study provides a novel global snapshot of how mesoscale networks in the ventral and dorsal visual pathways form the organizational basis of visual objection recognition and vision for action.
Collapse
Affiliation(s)
- Jianbao Wang
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China; MOE Frontier Science Center for Brain Science and Brain-machine Integration, Zhejiang University, Hangzhou, China
| | - Xiao Du
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China
| | - Songping Yao
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China; Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, China
| | - Lihui Li
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China; Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, China
| | - Hisashi Tanigawa
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China; MOE Frontier Science Center for Brain Science and Brain-machine Integration, Zhejiang University, Hangzhou, China
| | - Xiaotong Zhang
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China; Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, China; MOE Frontier Science Center for Brain Science and Brain-machine Integration, Zhejiang University, Hangzhou, China; College of Electrical Engineering, Zhejiang University, Hangzhou, China.
| | - Anna Wang Roe
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou, China; Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, China; MOE Frontier Science Center for Brain Science and Brain-machine Integration, Zhejiang University, Hangzhou, China.
| |
Collapse
|
2
|
Haenelt D, Trampel R, Nasr S, Polimeni JR, Tootell RBH, Sereno MI, Pine KJ, Edwards LJ, Helbling S, Weiskopf N. High-resolution quantitative and functional MRI indicate lower myelination of thin and thick stripes in human secondary visual cortex. eLife 2023; 12:e78756. [PMID: 36888685 PMCID: PMC9995117 DOI: 10.7554/elife.78756] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Accepted: 02/08/2023] [Indexed: 03/09/2023] Open
Abstract
The characterization of cortical myelination is essential for the study of structure-function relationships in the human brain. However, knowledge about cortical myelination is largely based on post-mortem histology, which generally renders direct comparison to function impossible. The repeating pattern of pale-thin-pale-thick stripes of cytochrome oxidase (CO) activity in the primate secondary visual cortex (V2) is a prominent columnar system, in which histology also indicates different myelination of thin/thick versus pale stripes. We used quantitative magnetic resonance imaging (qMRI) in conjunction with functional magnetic resonance imaging (fMRI) at ultra-high field strength (7 T) to localize and study myelination of stripes in four human participants at sub-millimeter resolution in vivo. Thin and thick stripes were functionally localized by exploiting their sensitivity to color and binocular disparity, respectively. Resulting functional activation maps showed robust stripe patterns in V2 which enabled further comparison of quantitative relaxation parameters between stripe types. Thereby, we found lower longitudinal relaxation rates (R1) of thin and thick stripes compared to surrounding gray matter in the order of 1-2%, indicating higher myelination of pale stripes. No consistent differences were found for effective transverse relaxation rates (R2*). The study demonstrates the feasibility to investigate structure-function relationships in living humans within one cortical area at the level of columnar systems using qMRI.
Collapse
Affiliation(s)
- Daniel Haenelt
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- International Max Planck Research School on Neuroscience of Communication: Function, Structure, and PlasticityLeipzigGermany
| | - Robert Trampel
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Shahin Nasr
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General HospitalCharlestownUnited States
- Department of Radiology, Harvard Medical SchoolBostonUnited States
| | - Jonathan R Polimeni
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General HospitalCharlestownUnited States
- Department of Radiology, Harvard Medical SchoolBostonUnited States
- Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of TechnologyCambridgeUnited States
| | - Roger BH Tootell
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General HospitalCharlestownUnited States
- Department of Radiology, Harvard Medical SchoolBostonUnited States
| | - Martin I Sereno
- Department of Psychology, College of Sciences, San Diego State UniversitySan DiegoUnited States
| | - Kerrin J Pine
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Luke J Edwards
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Saskia Helbling
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Poeppel Lab, Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurt am MainGermany
| | - Nikolaus Weiskopf
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Felix Bloch Institute for Solid State Physics, Faculty of Physics and Earth Sciences, Leipzig UniversityLeipzigGermany
| |
Collapse
|
3
|
Zhang Y, Schriver KE, Hu JM, Roe AW. Spatial frequency representation in V2 and V4 of macaque monkey. eLife 2023; 12:81794. [PMID: 36607323 PMCID: PMC9848390 DOI: 10.7554/elife.81794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 01/05/2023] [Indexed: 01/07/2023] Open
Abstract
Spatial frequency (SF) is an important attribute in the visual scene and is a defining feature of visual processing channels. However, there remain many unsolved questions about how extrastriate areas in primate visual cortex code this fundamental information. Here, using intrinsic signal optical imaging in visual areas of V2 and V4 of macaque monkeys, we quantify the relationship between SF maps and (1) visual topography and (2) color and orientation maps. We find that in orientation regions, low to high SF is mapped orthogonally to orientation; in color regions, which are reported to contain orthogonal axes of color and lightness, low SFs tend to be represented more frequently than high SFs. This supports a population-based SF fluctuation related to the 'color/orientation' organizations. We propose a generalized hypercolumn model across cortical areas, comprised of two orthogonal parameters with additional parameters.
Collapse
Affiliation(s)
- Ying Zhang
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang UniversityHangzhouChina
- Key Laboratory of Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang UniversityHangzhouChina
| | - Kenneth E Schriver
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang UniversityHangzhouChina
- Key Laboratory of Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang UniversityHangzhouChina
- MOE Frontier Science Center for Brain Science and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang UniversityHangzhouChina
| | - Jia Ming Hu
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang UniversityHangzhouChina
- Key Laboratory of Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang UniversityHangzhouChina
- MOE Frontier Science Center for Brain Science and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang UniversityHangzhouChina
| | - Anna Wang Roe
- Department of Neurosurgery of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang UniversityHangzhouChina
- Key Laboratory of Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang UniversityHangzhouChina
- MOE Frontier Science Center for Brain Science and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang UniversityHangzhouChina
| |
Collapse
|
4
|
Kennedy B, Bex P, Hunter DG, Nasr S. Two fine-scale channels for encoding motion and stereopsis within the human magnocellular stream. Prog Neurobiol 2023; 220:102374. [PMID: 36403864 PMCID: PMC9832588 DOI: 10.1016/j.pneurobio.2022.102374] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Revised: 10/16/2022] [Accepted: 11/15/2022] [Indexed: 11/18/2022]
Abstract
In humans and non-human primates (NHPs), motion and stereopsis are processed within fine-scale cortical sites, including V2 thick stripes and their extensions into areas V3 and V3A that are believed to be under the influence of magnocellular stream. However, in both species, the relative functional organization (overlapping vs. none overlapping) of these sites remains unclear. Using high-resolution functional MRI (fMRI), we found evidence for two minimally-overlapping channels within human extrastriate areas that contribute to processing motion and stereopsis. Across multiple experiments that included different stimuli (random dots, gratings, and natural scenes), the functional selectivity of these channels for motion vs. stereopsis remained consistent. Furthermore, an analysis of resting-state functional connectivity revealed stronger functional connectivity within the two channels rather than between them. This finding provides a new perspective toward the mesoscale organization of the magnocellular stream within the human extrastriate visual cortex, beyond our previous understanding based on animal models.
Collapse
Affiliation(s)
- B Kennedy
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States
| | - P Bex
- Department of Psychology, Northeastern University, Boston, MA, United States
| | - D G Hunter
- Department of Ophthalmology, Harvard Medical School, Boston, MA, United States; Department of Ophthalmology, Boston's Children Hospital, Boston, MA, United States
| | - S Nasr
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States; Department of Radiology, Harvard Medical School, Boston, MA, United States.
| |
Collapse
|
5
|
Tootell RBH, Nasiriavanaki Z, Babadi B, Greve DN, Nasr S, Holt DJ. Interdigitated Columnar Representation of Personal Space and Visual Space in Human Parietal Cortex. J Neurosci 2022; 42:9011-9029. [PMID: 36198501 PMCID: PMC9732835 DOI: 10.1523/jneurosci.0516-22.2022] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 09/20/2022] [Accepted: 09/30/2022] [Indexed: 01/05/2023] Open
Abstract
Personal space (PS) is the space around the body that people prefer to maintain between themselves and unfamiliar others. Intrusion into personal space evokes discomfort and an urge to move away. Physiologic studies in nonhuman primates suggest that defensive responses to intruding stimuli involve the parietal cortex. We hypothesized that the spatial encoding of interpersonal distance is initially transformed from purely sensory to more egocentric mapping within human parietal cortex. This hypothesis was tested using 7 Tesla (7T) fMRI at high spatial resolution (1.1 mm isotropic), in seven subjects (four females, three males). In response to visual stimuli presented at a range of virtual distances, we found two categories of distance encoding in two corresponding radially-extending columns of activity within parietal cortex. One set of columns (P columns) responded selectively to moving and stationary face images presented at virtual distances that were nearer (but not farther) than each subject's behaviorally-defined personal space boundary. In most P columns, BOLD response amplitudes increased monotonically and nonlinearly with increasing virtual face proximity. In the remaining P columns, BOLD responses decreased with increasing proximity. A second set of parietal columns (D columns) responded selectively to disparity-based distance cues (near or far) in random dot stimuli, similar to disparity-selective columns described previously in occipital cortex. Critically, in parietal cortex, P columns were topographically interdigitated (nonoverlapping) with D columns. These results suggest that visual spatial information is transformed from visual to body-centered (or person-centered) dimensions in multiple local sites within human parietal cortex.SIGNIFICANCE STATEMENT Recent COVID-related social distancing practices highlight the need to better understand brain mechanisms which regulate "personal space" (PS), which is defined by the closest interpersonal distance that is comfortable for an individual. Using high spatial resolution brain imaging, we tested whether a map of external space is transformed from purely visual (3D-based) information to a more egocentric map (related to personal space) in human parietal cortex. We confirmed this transformation and further showed that it was mediated by two mutually segregated sets of columns: one which encoded interpersonal distance and another that encoded visual distance. These results suggest that the cortical transformation of sensory-centered to person-centered encoding of space near the body involves short-range communication across interdigitated columns within parietal cortex.
Collapse
Affiliation(s)
- Roger B H Tootell
- Harvard Medical School, Boston, Massachusetts 02115
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Brigham Hospital, Boston, Massachusetts 02129
- Department of Radiology, Massachusetts General Hospital, Charlestown, Massachusetts 02129
| | - Zahra Nasiriavanaki
- Department of Psychiatry, Massachusetts General Hospital, Charlestown, Massachusetts 02129
- Harvard Medical School, Boston, Massachusetts 02115
| | - Baktash Babadi
- Department of Psychiatry, Massachusetts General Hospital, Charlestown, Massachusetts 02129
- Harvard Medical School, Boston, Massachusetts 02115
| | - Douglas N Greve
- Harvard Medical School, Boston, Massachusetts 02115
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Brigham Hospital, Boston, Massachusetts 02129
- Department of Radiology, Massachusetts General Hospital, Charlestown, Massachusetts 02129
| | - Shahin Nasr
- Harvard Medical School, Boston, Massachusetts 02115
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Brigham Hospital, Boston, Massachusetts 02129
- Department of Radiology, Massachusetts General Hospital, Charlestown, Massachusetts 02129
| | - Daphne J Holt
- Department of Psychiatry, Massachusetts General Hospital, Charlestown, Massachusetts 02129
- Harvard Medical School, Boston, Massachusetts 02115
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Brigham Hospital, Boston, Massachusetts 02129
| |
Collapse
|
6
|
Functionally specific and sparse domain-based micro-networks in monkey V1 and V2. Curr Biol 2022; 32:2797-2809.e3. [PMID: 35623347 DOI: 10.1016/j.cub.2022.04.095] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 04/05/2022] [Accepted: 04/28/2022] [Indexed: 11/23/2022]
Abstract
The cerebral cortices of human and nonhuman primate brains are characterized by submillimeter functional domains. However, little is known about the connections of single functional domains. Here, in macaque monkey visual cortex, we have developed a targeted focal electrical stimulation method, coupled with functional optical imaging, to map cortical networks with submillimeter precision in vivo. We find that single functional domains are a part of highly specific and sparse intra-areal and inter-areal micro-networks. Across color-related and orientation-related functionalities, these micro-networks exhibit parallel connection patterns, suggesting a common domain-based architecture. Moreover, these micro-networks shift topographically at a submillimeter scale, suggesting that they serve as a fundamental unit for cortical information processing. Our findings establish a domain-based connectional architecture in the primate brain and present new constraints for cortical map representation.
Collapse
|
7
|
Function-specific projections from V2 to V4 in macaques. Brain Struct Funct 2022; 227:1317-1330. [PMID: 34978607 DOI: 10.1007/s00429-021-02440-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Accepted: 12/08/2021] [Indexed: 11/02/2022]
Abstract
Previous studies have revealed modular projections from area V2 to area V4 in macaques. Specifically, V2 neurons in cytochrome oxidase (CO)-rich thin and CO-sparse pale stripes project to distinct regions in V4. However, how these modular projections relate to the functional subcompartments of V4 remains unclear. In this study, we injected retrograde fluorescent tracers into V4 regions with different functional properties (color, orientation, and direction) that were identified with intrinsic signal optical imaging (ISOI). We examined the labeled neurons in area V2 and their locations with respect to the CO patterns. Covariation was observed between the functional properties of the V4 injection sites and the numbers of labeled neurons in particular CO stripes. This covariation indicates that the color domains in V4 mainly received inputs from thin stripes in V2, whereas V4 orientation domains received inputs from pale stripes. Although motion-sensitive domains are present in both V2 and V4, our results did not reveal a functional specific feedforward projection between them. These results confirmed previous findings of modular projections from V2 to V4 and provided functional specificity for these anatomical projections. Together, these findings indicate that color and form remain separate in ventral mid-level visual processing.
Collapse
|
8
|
Meikle SJ, Wong YT. Neurophysiological considerations for visual implants. Brain Struct Funct 2021; 227:1523-1543. [PMID: 34773502 DOI: 10.1007/s00429-021-02417-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Accepted: 10/17/2021] [Indexed: 11/26/2022]
Abstract
Neural implants have the potential to restore visual capabilities in blind individuals by electrically stimulating the neurons of the visual system. This stimulation can produce visual percepts known as phosphenes. The ideal location of electrical stimulation for achieving vision restoration is widely debated and dependent on the physiological properties of the targeted tissue. Here, the neurophysiology of several potential target structures within the visual system will be explored regarding their benefits and downfalls in producing phosphenes. These regions will include the lateral geniculate nucleus, primary visual cortex, visual area 2, visual area 3, visual area 4 and the middle temporal area. Based on the existing engineering limitations of neural prostheses, we anticipate that electrical stimulation of any singular brain region will be incapable of achieving high-resolution naturalistic perception including color, texture, shape and motion. As improvements in visual acuity facilitate improvements in quality of life, emulating naturalistic vision should be one of the ultimate goals of visual prostheses. To achieve this goal, we propose that multiple brain areas will need to be targeted in unison enabling different aspects of vision to be recreated.
Collapse
Affiliation(s)
- Sabrina J Meikle
- Department of Electrical and Computer Systems Engineering, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia
- Department of Physiology and Biomedicine Discovery Institute, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia
- Monash Vision Group, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia
| | - Yan T Wong
- Department of Electrical and Computer Systems Engineering, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia.
- Department of Physiology and Biomedicine Discovery Institute, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia.
- Monash Vision Group, Monash University, 14 Alliance Lane, Clayton, Vic, 3800, Australia.
| |
Collapse
|
9
|
Li S, Yao S, Zhou Q, Takahata T. The Expression Patterns of Cytochrome Oxidase and Immediate-Early Genes Show Absence of Ocular Dominance Columns in the Striate Cortex of Squirrel Monkeys Following Monocular Inactivation. Front Neuroanat 2021; 15:751810. [PMID: 34720891 PMCID: PMC8548382 DOI: 10.3389/fnana.2021.751810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 09/21/2021] [Indexed: 11/13/2022] Open
Abstract
Because at least some squirrel monkeys lack ocular dominance columns (ODCs) in the striate cortex (V1) that are detectable by cytochrome oxidase (CO) histochemistry, the functional importance of ODCs on stereoscopic 3-D vision has been questioned. However, conventional CO histochemistry or trans-synaptic tracer study has limited capacity to reveal cortical functional architecture, whereas the expression of immediate-early genes (IEGs), c-FOS and ZIF268, is more directly responsive to neuronal activity of cortical neurons to demonstrate ocular dominance (OD)-related domains in V1 following monocular inactivation. Thus, we wondered whether IEG expression would reveal ODCs in the squirrel monkey V1. In this study, we first examined CO histochemistry in V1 of five squirrel monkeys that were subjected to monocular enucleation or tetrodotoxin (TTX) treatment to address whether there is substantial cross-individual variation as reported previously. Then, we examined the IEG expression of the same V1 tissue to address whether OD-related domains are revealed. As a result, staining patterns of CO histochemistry were relatively homogeneous throughout layer 4 of V1. IEG expression was also moderate and homogeneous throughout layer 4 of V1 in all cases. On the other hand, the IEG expression was patchy in accordance with CO blobs outside layer 4, particularly in infragranular layers, although they may not directly represent OD clusters. Squirrel monkeys remain an exceptional species among anthropoid primates with regard to OD organization, and thus are potentially good subjects to study the development and function of ODCs.
Collapse
Affiliation(s)
- Shuiyu Li
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China.,Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou, China
| | - Songping Yao
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China.,Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou, China
| | - Qiuying Zhou
- Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou, China.,Department of Neurology of the Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Toru Takahata
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China.,Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou, China.,Department of Neurology of the Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| |
Collapse
|
10
|
Vannuscorps G, Galaburda A, Caramazza A. Shape-centered representations of bounded regions of space mediate the perception of objects. Cogn Neuropsychol 2021; 39:1-50. [PMID: 34427539 DOI: 10.1080/02643294.2021.1960495] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
We report the study of a woman who perceives 2D bounded regions of space ("shapes") defined by sharp edges of medium to high contrast as if they were rotated by 90, 180 degrees around their centre, mirrored across their own axes, or both. In contrast, her perception of 3D, strongly blurred or very low contrast shapes, and of stimuli emerging from a collection of shapes, is intact. This suggests that a stage in the process of constructing the conscious visual representation of a scene consists of representing mutually exclusive bounded regions extracted from the initial retinotopic space in "shape-centered" frames of reference. The selectivity of the disorder to shapes originally biased toward the parvocellular subcortical pathway, and the absence of any other type of error, additionally invite new hypotheses about the operations involved in computing these "intermediate shape-centered representations" and in mapping them onto higher frames for perception and action.
Collapse
Affiliation(s)
- Gilles Vannuscorps
- Department of Psychology, Harvard University, Cambridge, MA, USA.,Institute of Psychological Sciences, Université catholique de Louvain, Louvain-la-Neuve, Belgium.,Institute of Neuroscience, Université catholique de Louvain, Louvain-la-Neuve, Belgium.,Louvain Bionics, Université catholique de Louvain, Louvain-la-Neuve, Belgium
| | - Albert Galaburda
- Department of Neurology, Harvard Medical School and Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Alfonso Caramazza
- Department of Psychology, Harvard University, Cambridge, MA, USA.,Center for Mind/Brain Sciences (CIMeC), Università degli Studi di Trento, Rovereto, Italy
| |
Collapse
|
11
|
Alvarez I, Hurley SA, Parker AJ, Bridge H. Human primary visual cortex shows larger population receptive fields for binocular disparity-defined stimuli. Brain Struct Funct 2021; 226:2819-2838. [PMID: 34347164 PMCID: PMC8541985 DOI: 10.1007/s00429-021-02351-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2021] [Accepted: 07/22/2021] [Indexed: 11/26/2022]
Abstract
The visual perception of 3D depth is underpinned by the brain's ability to combine signals from the left and right eyes to produce a neural representation of binocular disparity for perception and behaviour. Electrophysiological studies of binocular disparity over the past 2 decades have investigated the computational role of neurons in area V1 for binocular combination, while more recent neuroimaging investigations have focused on identifying specific roles for different extrastriate visual areas in depth perception. Here we investigate the population receptive field properties of neural responses to binocular information in striate and extrastriate cortical visual areas using ultra-high field fMRI. We measured BOLD fMRI responses while participants viewed retinotopic mapping stimuli defined by different visual properties: contrast, luminance, motion, correlated and anti-correlated stereoscopic disparity. By fitting each condition with a population receptive field model, we compared quantitatively the size of the population receptive field for disparity-specific stimulation. We found larger population receptive fields for disparity compared with contrast and luminance in area V1, the first stage of binocular combination, which likely reflects the binocular integration zone, an interpretation supported by modelling of the binocular energy model. A similar pattern was found in region LOC, where it may reflect the role of disparity as a cue for 3D shape. These findings provide insight into the binocular receptive field properties underlying processing for human stereoscopic vision.
Collapse
Affiliation(s)
- Ivan Alvarez
- Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, OX3 9DU, UK
| | - Samuel A Hurley
- Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, OX3 9DU, UK
- Department of Radiology, University of Wisconsin, Madison, WI, 53705, USA
| | - Andrew J Parker
- Department of Physiology, Anatomy and Genetics, University of Oxford, Oxford, OX1 3PT, UK
- Institut für Biologie, Otto-von-Guericke Universität, 39120, Magdeburg, Germany
| | - Holly Bridge
- Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, OX3 9DU, UK.
| |
Collapse
|
12
|
Liu Y, Hu J, Yao S, Zhou Q, Li H, Takahata T. Multiple Visuotopically Organized Subdivisions of the Lateral Pulvinar/Central Lateral Inferior Pulvinar Project into Thin and Thick Stripe Compartments of V2 in Macaques. Cereb Cortex 2021; 31:3788-3803. [PMID: 33772553 DOI: 10.1093/cercor/bhab049] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Revised: 01/30/2021] [Accepted: 02/13/2021] [Indexed: 11/13/2022] Open
Abstract
The lateral and central lateral inferior pulvinar (PL/PIcl) of primates has been implicated in playing an important role in visual processing, but its physiological and anatomical characteristics remain to be elucidated. It has been suggested that there are two complete visuotopic maps in the PL/PIcl, each of which sends afferents into V2 and V4 in primates. Given that functionally distinct thin and thick stripes of V2 both receive inputs from the PL/PIcl, this raises the possibility of a presence of parallel segregated pathways within the PL/PIcl. To address this question, we selectively injected three types of retrograde tracers (CTB-488, CTB-555, and BDA) into thin or thick stripes in V2 and examined labeling in the PL/PIcl in macaques. As a result, we found that every cluster of retrograde labeling in the PL/PIcl included all three types of signals next to each other, suggesting that thin stripe- and thick stripe-projecting compartments are not segregated into domains. Unexpectedly, we found at least five topographically organized retrograde labeling clusters in the PL/PIcl, indicating the presence of more than two V2-projecting maps. Our results suggest that the PL/PIcl exhibits greater compartmentalization than previously thought. They may be functionally similar but participate in multiple cortico-pulvinar-cortical loops.
Collapse
Affiliation(s)
- Ye Liu
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou 310029, P. R. China
| | - Jiaming Hu
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou 310029, P. R. China
| | - Songping Yao
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou 310029, P. R. China.,Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University,Hangzhou 310029, P. R. China
| | - Qiuying Zhou
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou 310029, P. R. China
| | - Hangqi Li
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou 310029, P. R. China.,Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University,Hangzhou 310029, P. R. China
| | - Toru Takahata
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou 310029, P. R. China.,Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University,Hangzhou 310029, P. R. China
| |
Collapse
|
13
|
Mocanu VM, Shmuel A. Optical Imaging-Based Guidance of Viral Microinjections and Insertion of a Laminar Electrophysiology Probe Into a Predetermined Barrel in Mouse Area S1BF. Front Neural Circuits 2021; 15:541676. [PMID: 34054436 PMCID: PMC8158817 DOI: 10.3389/fncir.2021.541676] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2020] [Accepted: 03/31/2021] [Indexed: 12/04/2022] Open
Abstract
Wide-field Optical Imaging of Intrinsic Signals (OI-IS; Grinvald et al., 1986) is a method for imaging functional brain hemodynamic responses, mainly used to image activity from the surface of the cerebral cortex. It localizes small functional modules – such as cortical columns – with great spatial resolution and spatial specificity relative to the site of increases in neuronal activity. OI-IS is capable of imaging responses either through an intact or thinned skull or following a craniotomy. Therefore, it is minimally invasive, which makes it ideal for survival experiments. Here we describe OI-IS-based methods for guiding microinjections of optogenetics viral vectors in proximity to small functional modules (S1 barrels) of the cerebral cortex and for guiding the insertion of electrodes for electrophysiological recording into such modules. We validate our proposed methods by tissue processing of the cerebral barrel field area, revealing the track of the electrode in a predetermined barrel. In addition, we demonstrate the use of optical imaging to visualize the spatial extent of the optogenetics photostimulation, making it possible to estimate one of the two variables that conjointly determine which region of the brain is stimulated. Lastly, we demonstrate the use of OI-IS at high-magnification for imaging the upper recording contacts of a laminar probe, making it possible to estimate the insertion depth of all contacts relative to the surface of the cortex. These methods support the precise positioning of microinjections and recording electrodes, thus overcoming the variability in the spatial position of fine-scale functional modules.
Collapse
Affiliation(s)
- Victor M Mocanu
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, QC, Canada.,Department of Neurology and Neurosurgery, McGill University, Montreal, QC, Canada
| | - Amir Shmuel
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, QC, Canada.,Department of Neurology and Neurosurgery, McGill University, Montreal, QC, Canada.,Department of Physiology, McGill University, Montreal, QC, Canada.,Department of Biomedical Engineering, McGill University, Montreal, QC, Canada
| |
Collapse
|
14
|
Federer F, Ta'afua S, Merlin S, Hassanpour MS, Angelucci A. Stream-specific feedback inputs to the primate primary visual cortex. Nat Commun 2021; 12:228. [PMID: 33431862 PMCID: PMC7801467 DOI: 10.1038/s41467-020-20505-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2020] [Accepted: 12/03/2020] [Indexed: 11/16/2022] Open
Abstract
The sensory neocortex consists of hierarchically-organized areas reciprocally connected via feedforward and feedback circuits. Feedforward connections shape the receptive field properties of neurons in higher areas within parallel streams specialized in processing specific stimulus attributes. Feedback connections have been implicated in top-down modulations, such as attention, prediction and sensory context. However, their computational role remains unknown, partly because we lack knowledge about rules of feedback connectivity to constrain models of feedback function. For example, it is unknown whether feedback connections maintain stream-specific segregation, or integrate information across parallel streams. Using viral-mediated labeling of feedback connections arising from specific cytochrome-oxidase stripes of macaque visual area V2, here we show that feedback to the primary visual cortex (V1) is organized into parallel streams resembling the reciprocal feedforward pathways. This suggests that functionally-specialized V2 feedback channels modulate V1 responses to specific stimulus attributes, an organizational principle potentially extending to feedback pathways in other sensory systems.
Collapse
Affiliation(s)
- Frederick Federer
- Department of Ophthalmology and Visual Science Moran Eye Institute, University of Utah, 65 Mario Capecchi Drive, Salt Lake City, UT, 84132, USA
| | - Seminare Ta'afua
- Department of Ophthalmology and Visual Science Moran Eye Institute, University of Utah, 65 Mario Capecchi Drive, Salt Lake City, UT, 84132, USA
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, 84132, USA
| | - Sam Merlin
- Department of Ophthalmology and Visual Science Moran Eye Institute, University of Utah, 65 Mario Capecchi Drive, Salt Lake City, UT, 84132, USA
- Medical Science, School of Science, Western Sydney University, Campbelltown, Sydney, NSW, 2560, Australia
| | - Mahlega S Hassanpour
- Department of Ophthalmology and Visual Science Moran Eye Institute, University of Utah, 65 Mario Capecchi Drive, Salt Lake City, UT, 84132, USA
| | - Alessandra Angelucci
- Department of Ophthalmology and Visual Science Moran Eye Institute, University of Utah, 65 Mario Capecchi Drive, Salt Lake City, UT, 84132, USA.
| |
Collapse
|
15
|
Navarro KT, Sanchez MJ, Engel SA, Olman CA, Weldon KB. Depth-dependent functional MRI responses to chromatic and achromatic stimuli throughout V1 and V2. Neuroimage 2020; 226:117520. [PMID: 33137474 PMCID: PMC7958868 DOI: 10.1016/j.neuroimage.2020.117520] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 10/21/2020] [Accepted: 10/26/2020] [Indexed: 11/13/2022] Open
Abstract
In the primate visual system, form (shape, location) and color information are processed in separate but interacting pathways. Recent access to high-resolution neuroimaging has facilitated the exploration of the structure of these pathways at the mesoscopic level in the human visual cortex. We used 7T fMRI to observe selective activation of the primary visual cortex to chromatic versus achromatic stimuli in five participants across two scanning sessions. Achromatic checkerboards with low spatial frequency and high temporal frequency targeted the color-insensitive magnocellular pathway. Chromatic checkerboards with higher spatial frequency and low temporal frequency targeted the color-selective parvocellular pathway. This work resulted in three main findings. First, responses driven by chromatic stimuli had a laminar profile biased towards superficial layers of V1, as compared to responses driven by achromatic stimuli. Second, we found stronger preference for chromatic stimuli in parafoveal V1 compared with peripheral V1. Finally, we found alternating, stimulus-selective bands stemming from the V1 border into V2 and V3. Similar alternating patterns have been previously found in both NHP and human extrastriate cortex. Together, our findings confirm the utility of fMRI for revealing details of mesoscopic neural architecture in human cortex.
Collapse
Affiliation(s)
- Karen T Navarro
- Department of Psychology, University of Minnesota, 75 E River Rd, Minneapolis, MN 55455, United States.
| | - Marisa J Sanchez
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, 2450 Riverside Ave f275, Minneapolis, MN 55454, United States
| | - Stephen A Engel
- Department of Psychology, University of Minnesota, 75 E River Rd, Minneapolis, MN 55455, United States
| | - Cheryl A Olman
- Department of Psychology, University of Minnesota, 75 E River Rd, Minneapolis, MN 55455, United States; Center for Magnetic Resonance Research, University of Minnesota, 2021 6th St SE, Minneapolis, MN 55455, United States
| | - Kimberly B Weldon
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, 2450 Riverside Ave f275, Minneapolis, MN 55454, United States; Center for Magnetic Resonance Research, University of Minnesota, 2021 6th St SE, Minneapolis, MN 55455, United States
| |
Collapse
|
16
|
Srinath R, Emonds A, Wang Q, Lempel AA, Dunn-Weiss E, Connor CE, Nielsen KJ. Early Emergence of Solid Shape Coding in Natural and Deep Network Vision. Curr Biol 2020; 31:51-65.e5. [PMID: 33096039 DOI: 10.1016/j.cub.2020.09.076] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2020] [Revised: 08/24/2020] [Accepted: 09/25/2020] [Indexed: 10/23/2022]
Abstract
Area V4 is the first object-specific processing stage in the ventral visual pathway, just as area MT is the first motion-specific processing stage in the dorsal pathway. For almost 50 years, coding of object shape in V4 has been studied and conceived in terms of flat pattern processing, given its early position in the transformation of 2D visual images. Here, however, in awake monkey recording experiments, we found that roughly half of V4 neurons are more tuned and responsive to solid, 3D shape-in-depth, as conveyed by shading, specularity, reflection, refraction, or disparity cues in images. Using 2-photon functional microscopy, we found that flat- and solid-preferring neurons were segregated into separate modules across the surface of area V4. These findings should impact early shape-processing theories and models, which have focused on 2D pattern processing. In fact, our analyses of early object processing in AlexNet, a standard visual deep network, revealed a similar distribution of sensitivities to flat and solid shape in layer 3. Early processing of solid shape, in parallel with flat shape, could represent a computational advantage discovered by both primate brain evolution and deep-network training.
Collapse
Affiliation(s)
- Ramanujan Srinath
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD 21218, USA; Solomon H. Snyder Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
| | - Alexandriya Emonds
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD 21218, USA; Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
| | - Qingyang Wang
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD 21218, USA; Solomon H. Snyder Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
| | - Augusto A Lempel
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD 21218, USA; Solomon H. Snyder Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
| | - Erika Dunn-Weiss
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD 21218, USA; Solomon H. Snyder Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
| | - Charles E Connor
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD 21218, USA; Solomon H. Snyder Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA.
| | - Kristina J Nielsen
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD 21218, USA; Solomon H. Snyder Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA.
| |
Collapse
|
17
|
Liu Y, Li M, Zhang X, Lu Y, Gong H, Yin J, Chen Z, Qian L, Yang Y, Andolina IM, Shipp S, Mcloughlin N, Tang S, Wang W. Hierarchical Representation for Chromatic Processing across Macaque V1, V2, and V4. Neuron 2020; 108:538-550.e5. [PMID: 32853551 DOI: 10.1016/j.neuron.2020.07.037] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2019] [Revised: 05/09/2020] [Accepted: 07/28/2020] [Indexed: 11/26/2022]
Abstract
The perception of color is an internal label for the inferred spectral reflectance of visible surfaces. To study how spectral representation is transformed through modular subsystems of successive cortical areas, we undertook simultaneous optical imaging of intrinsic signals in macaque V1, V2, and V4, supplemented by higher-resolution electrophysiology and two-photon imaging in awake macaques. We find a progressive evolution in the scale and precision of chromotopic maps, expressed by a uniform blob-like architecture of hue responses within each area. Two-photon imaging reveals enhanced hue-specific cell clustering in V2 compared with V1. A phenomenon of endspectral (red and blue) responses that is clear in V1, recedes in V2, and is virtually absent in V4. The increase in mid- and extra-spectral hue representations through V2 and V4 reflects the nature of hierarchical processing as higher areas read out locations in chromatic space from progressive integration of signals relayed by V1.
Collapse
Affiliation(s)
- Ye Liu
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Ming Li
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Xian Zhang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China; Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Yiliang Lu
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China
| | - Hongliang Gong
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jiapeng Yin
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China
| | - Zheyuan Chen
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China
| | - Liling Qian
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China
| | - Yupeng Yang
- Chinese Academy of Sciences Key Laboratory of Brain Function and Diseases, School of Life Sciences, University of Science and Technology of China, Hefei 230027, China
| | - Ian Max Andolina
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China
| | - Stewart Shipp
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China
| | - Niall Mcloughlin
- Division of Pharmacy and Optometry, Faculty of Biology, Medicine, and Health Science, University of Manchester, Manchester M13 9PL, UK
| | - Shiming Tang
- Peking University School of Life Sciences and Peking-Tsinghua Center for Life Sciences, Beijing 100871, China; IDG/McGovern Institute for Brain Research at Peking University, Beijing 100871, China.
| | - Wei Wang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology, State Key Laboratory of Neuroscience, Chinese Academy of Sciences, Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 200031, China; University of Chinese Academy of Sciences, Beijing 100049, China.
| |
Collapse
|
18
|
Hu JM, Qian MZ, Tanigawa H, Song XM, Roe AW. Focal Electrical Stimulation of Cortical Functional Networks. Cereb Cortex 2020; 30:5532-5543. [PMID: 32483588 DOI: 10.1093/cercor/bhaa136] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 03/30/2020] [Accepted: 04/27/2020] [Indexed: 01/11/2023] Open
Abstract
Abstract
Traditional electrical stimulation of brain tissue typically affects relatively large volumes of tissue spanning multiple millimeters. This low spatial resolution stimulation results in nonspecific functional effects. In addition, a primary shortcoming of these designs was the failure to take advantage of inherent functional organization in the cerebral cortex. Here, we describe a new method to electrically stimulate the brain which achieves selective targeting of single feature-specific domains in visual cortex. We provide evidence that this paradigm achieves mesoscale, functional network-specificity, and intensity dependence in a way that mimics visual stimulation. Application of this approach to known feature domains (such as color, orientation, motion, and depth) in visual cortex may lead to important functional improvements in the specificity and sophistication of brain stimulation methods and has implications for visual cortical prosthetic design.
Collapse
Affiliation(s)
- Jia Ming Hu
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China
| | - Mei Zhen Qian
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China
| | - Hisashi Tanigawa
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China
| | - Xue Mei Song
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China
| | - Anna Wang Roe
- Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, School of Medicine, Zhejiang University, Hangzhou 310029, China
- Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, Hangzhou 310029, China
- Division of Neuroscience, Oregon National Primate Research Center, Oregon Health and Science University, Beaverton, OR 97006 USA
| |
Collapse
|
19
|
Vanni S, Hokkanen H, Werner F, Angelucci A. Anatomy and Physiology of Macaque Visual Cortical Areas V1, V2, and V5/MT: Bases for Biologically Realistic Models. Cereb Cortex 2020; 30:3483-3517. [PMID: 31897474 PMCID: PMC7233004 DOI: 10.1093/cercor/bhz322] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2019] [Revised: 12/02/2019] [Indexed: 12/22/2022] Open
Abstract
The cerebral cortex of primates encompasses multiple anatomically and physiologically distinct areas processing visual information. Areas V1, V2, and V5/MT are conserved across mammals and are central for visual behavior. To facilitate the generation of biologically accurate computational models of primate early visual processing, here we provide an overview of over 350 published studies of these three areas in the genus Macaca, whose visual system provides the closest model for human vision. The literature reports 14 anatomical connection types from the lateral geniculate nucleus of the thalamus to V1 having distinct layers of origin or termination, and 194 connection types between V1, V2, and V5, forming multiple parallel and interacting visual processing streams. Moreover, within V1, there are reports of 286 and 120 types of intrinsic excitatory and inhibitory connections, respectively. Physiologically, tuning of neuronal responses to 11 types of visual stimulus parameters has been consistently reported. Overall, the optimal spatial frequency (SF) of constituent neurons decreases with cortical hierarchy. Moreover, V5 neurons are distinct from neurons in other areas for their higher direction selectivity, higher contrast sensitivity, higher temporal frequency tuning, and wider SF bandwidth. We also discuss currently unavailable data that could be useful for biologically accurate models.
Collapse
Affiliation(s)
- Simo Vanni
- HUS Neurocenter, Department of Neurology, Helsinki University Hospital, 00290 Helsinki, Finland
- Department of Neurosciences, University of Helsinki, 00100 Helsinki, Finland
| | - Henri Hokkanen
- HUS Neurocenter, Department of Neurology, Helsinki University Hospital, 00290 Helsinki, Finland
- Department of Neurosciences, University of Helsinki, 00100 Helsinki, Finland
| | - Francesca Werner
- HUS Neurocenter, Department of Neurology, Helsinki University Hospital, 00290 Helsinki, Finland
- Department of Neurosciences, University of Helsinki, 00100 Helsinki, Finland
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy
| | - Alessandra Angelucci
- Department of Ophthalmology and Visual Sciences, Moran Eye Institute, University of Utah, Salt Lake City, UT 84132, USA
| |
Collapse
|
20
|
Asymmetries in Global Perception Are Represented in Near- versus Far-Preferring Clusters in Human Visual Cortex. J Neurosci 2019; 40:355-368. [PMID: 31744860 PMCID: PMC6948936 DOI: 10.1523/jneurosci.2124-19.2019] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2019] [Revised: 11/04/2019] [Accepted: 11/05/2019] [Indexed: 11/23/2022] Open
Abstract
Human perception is more “global” when stimuli are viewed within the lower (rather than the upper) visual field. This phenomenon is typically considered as a 2-D phenomenon, likely due to differential neural processing within dorsal versus ventral cortical areas that represent lower versus upper visual fields, respectively. Here we test a novel hypothesis that this vertical asymmetry in global processing is a 3-D phenomenon associated with (1) higher ecological relevance of low-spatial frequency (SF) components in encoding near (compared with far) visual objects and (2) the fact that near objects are more frequently found in lower rather than upper visual fields. Using high-resolution fMRI, collected within an ultra-high-field (7 T) scanner, we found that the extent of vertical asymmetry in global visual processing in human subjects (n = 10) was correlated with the fMRI response evoked by disparity-varying stimuli in human cortical area V3A. We also found that near-preferring clusters in V3A, located within stereoselective cortical columns, responded more selectively than far-preferring clusters, to low-SF features. These findings support the hypothesis that vertical asymmetry in global processing is a 3-D (not a 2-D) phenomenon, associated with the function of the stereoselective columns within visual cortex, especially those located within visual area V3A. SIGNIFICANCE STATEMENT Here we test and confirm a new hypothesis: fine-scale neural mechanisms underlying the vertical asymmetry in global visual processing. According to this hypothesis, the asymmetry in global visual processing is a 3-D (rather than a 2-D) phenomenon, reflected in the function of fine-scale cortical structures (clusters and columns) underlying depth perception. Our findings highlight the importance of considering these structures, as regions of interest, in clarifying the neural mechanisms underlying visual perception. The results also highlight the importance of statistics of natural scenes in shaping human visual perception.
Collapse
|
21
|
La Chioma A, Bonhoeffer T, Hübener M. Area-Specific Mapping of Binocular Disparity across Mouse Visual Cortex. Curr Biol 2019; 29:2954-2960.e5. [DOI: 10.1016/j.cub.2019.07.037] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2019] [Revised: 07/05/2019] [Accepted: 07/11/2019] [Indexed: 10/26/2022]
|
22
|
Morphological Cell Types Projecting from V1 Layer 4B to V2 Thick and Thin Stripes. J Neurosci 2019; 39:7501-7512. [PMID: 31358652 DOI: 10.1523/jneurosci.1096-19.2019] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2019] [Revised: 07/16/2019] [Accepted: 07/19/2019] [Indexed: 11/21/2022] Open
Abstract
In macaque visual cortex, different cytochrome oxidase stripes of area V2 receive segregated projections from layers (L)2/3 and 4B of the primary visual cortex (V1), and project to dorsal or ventral stream extrastriate areas. Parallel V1-to-V2 pathways suggest functionally specialized circuits, but it is unknown whether these circuits arise from distinct cell types. V1 L4B includes two morphological types of excitatory projection neurons: pyramids, which carry mixed magnocellular (M) and parvocellular (P) information to downstream areas, and spiny stellates, which carry only M information. Previous studies have shown that, overall, V2 receives ∼80% of its L4B inputs from pyramids, thus receiving mixed M and P signals. However, it is unknown how pyramids and stellates distribute their outputs to the different V2 stripes, and whether different stripes receive inputs from morphologically distinct neuron types. Using viral-mediated labeling of V2-projecting L4B neurons in male macaques, we show that thick stripes receive a greater contribution of L4B inputs from M-dominated spiny stellates compared with thin stripes. Both stripe types, however, receive a much larger contribution from spiny stellates than previously shown for V2 overall, indicating that a larger amount of M information than previously thought flows into both the dorsal and ventral streams via the V2 thick and thin stripes, respectively. Moreover, we identify four types of V2-projecting L4B cells differing in size and complexity. Three such cell types project to both thin and thick stripes, but one type, the giant spiny-stellate neuron, resembling L4B neurons projecting to motion-sensitive area MT, was only found to project to thick stripes.SIGNIFICANCE STATEMENT Area V1 partitions visual information into functionally specialized parallel pathways which terminate into distinct stripes of area V2. We asked whether V1 inputs to different V2 stripes arise from morphologically different cell types. V1 layer (L)4B has two cell types: pyramids, which carry both magnocellular (M) and parvocellular (P) visual signals, and spiny stellates, which carry only M signals. We find that V2 thick stripes, which project to areas processing object motion, receive a larger fraction of L4B input from M-dominated stellates compared with thin stripes, which project to areas processing object attributes. We also identify four morphological types of V2-projecting L4B neurons, suggestive of four functionally specialized cell types.
Collapse
|
23
|
Roe AW. Columnar connectome: toward a mathematics of brain function. Netw Neurosci 2019; 3:779-791. [PMID: 31410379 PMCID: PMC6663318 DOI: 10.1162/netn_a_00088] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2018] [Accepted: 04/14/2019] [Indexed: 01/09/2023] Open
Abstract
Understanding brain networks is important for many fields, including neuroscience, psychology, medicine, and artificial intelligence. To address this fundamental need, there are multiple ongoing connectome projects in the United States, Europe, and Asia producing brain connection maps with resolutions at macro- and microscales. However, still lacking is a mesoscale connectome. This viewpoint (1) explains the need for a mesoscale connectome in the primate brain (the columnar connectome), (2) presents a new method for acquiring such data rapidly on a large scale, and (3) proposes how one might use such data to achieve a mathematics of brain function.
Collapse
Affiliation(s)
- Anna Wang Roe
- Institute of Interdisciplinary Neuroscience and Technology, Zhejiang University, Hangzhou, China
| |
Collapse
|
24
|
Armendariz M, Ban H, Welchman AE, Vanduffel W. Areal differences in depth cue integration between monkey and human. PLoS Biol 2019; 17:e2006405. [PMID: 30925163 PMCID: PMC6457573 DOI: 10.1371/journal.pbio.2006405] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2018] [Revised: 04/10/2019] [Accepted: 03/12/2019] [Indexed: 11/22/2022] Open
Abstract
Electrophysiological evidence suggested primarily the involvement of the middle temporal (MT) area in depth cue integration in macaques, as opposed to human imaging data pinpointing area V3B/kinetic occipital area (V3B/KO). To clarify this conundrum, we decoded monkey functional MRI (fMRI) responses evoked by stimuli signaling near or far depths defined by binocular disparity, relative motion, and their combination, and we compared results with those from an identical experiment previously performed in humans. Responses in macaque area MT are more discriminable when two cues concurrently signal depth, and information provided by one cue is diagnostic of depth indicated by the other. This suggests that monkey area MT computes fusion of disparity and motion depth signals, exactly as shown for human area V3B/KO. Hence, these data reconcile previously reported discrepancies between depth processing in human and monkey by showing the involvement of the dorsal stream in depth cue integration using the same technique, despite the engagement of different regions. In everyday life, we interact with a three-dimensional world that we perceive via our two-dimensional retinas. Our brain can reconstruct the third dimension from these flat retinal images using multiple sources of visual information, or cues. The horizontal displacement of the two retinal images, known as binocular disparity, and the relative motion between different objects are two important depth cues. However, to make the most of the information provided by each cue, our brains must efficiently integrate across them. To examine this process, we used neuroimaging in monkeys to record brain responses evoked by stimuli signaling depths defined by either binocular disparity or relative motion in isolation, and also when the two cues are combined congruently or incongruently. We found that cortical area MT in monkeys is involved in the fusion of these two particular depth cues, in contrast to previous human imaging data that pinpoint a more posterior cortical area, V3B/KO. Our findings support the existence of depth cue integration mechanisms in primates; however, this fusion appears to be computed in slightly different areas in humans and monkeys.
Collapse
Affiliation(s)
- Marcelo Armendariz
- Laboratory of Neuro- and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, Belgium
| | - Hiroshi Ban
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Osaka, Japan
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
| | - Andrew E. Welchman
- Department of Psychology, University of Cambridge, Cambridge, United Kingdom
- * E-mail: (WV); (AW)
| | - Wim Vanduffel
- Laboratory of Neuro- and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, Belgium
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, United States of America
- Department of Radiology, Harvard Medical School, Boston, Massachusetts, United States of America
- Leuven Brain Institute, Leuven, Belgium
- * E-mail: (WV); (AW)
| |
Collapse
|
25
|
Reply to Doi et al.: Functional architecture matters in the formation of perception. Proc Natl Acad Sci U S A 2018; 115:E6969-E6971. [PMID: 29980648 DOI: 10.1073/pnas.1808415115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
|
26
|
Wojtczak-Kwaśniewska M, Przekoracka-Krawczyk A, Van der Lubbe RHJ. The engagement of cortical areas preceding exogenous vergence eye movements. PLoS One 2018; 13:e0198405. [PMID: 29883483 PMCID: PMC5993318 DOI: 10.1371/journal.pone.0198405] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2018] [Accepted: 05/20/2018] [Indexed: 12/02/2022] Open
Abstract
Source analyses on event related potentials (ERPs) derived from the electroencephalogram (EEG) were performed to examine the respective roles of cortical areas preceding exogenously triggered saccades, combined convergences, and combined divergences. All eye movements were triggered by the offset of a central fixation light emitting diode (LED) and the onset of a lateral LED at various depths in an otherwise fully darkened room. Our analyses revealed that three source pairs, two located in the frontal lobe–the frontal eye fields (FEF) and an anterior frontal area–, and one located within the occipital cortex, can account for 99.2% of the observed ERPs. Overall, the comparison between source activities revealed the largest activity in the occipital cortex, while no difference in activity between FEF and the anterior frontal area was obtained. For all sources, increased activity was observed for combined vergences, especially combined convergences, relative to saccades. Behavioral results revealed that onset latencies were longest for combined convergences, intermediate for combined divergences, and the shortest for saccades. Together, these findings fit within a perspective in which both occipital and frontal areas play an important role in retinal disparity detection. In the case of saccades and combined divergences stimulus-locked activity was larger than response-locked activity, while no difference between stimulus- and response-locked activity was observed for combined convergences. These findings seem to imply that the electrophysiological activity preceding exogenous eye movements consists of a sensory-related part that is under cortical control, while subcortical structures may be held responsible for final execution.
Collapse
Affiliation(s)
- Monika Wojtczak-Kwaśniewska
- Laboratory of Vision Science and Optometry, Faculty of Physics, Adam Mickiewicz University, Poznań, Poland.,Vision and Neuroscience Laboratory, NanoBioMedical Centre, Adam Mickiewicz University, Poznań, Poland
| | - Anna Przekoracka-Krawczyk
- Laboratory of Vision Science and Optometry, Faculty of Physics, Adam Mickiewicz University, Poznań, Poland.,Vision and Neuroscience Laboratory, NanoBioMedical Centre, Adam Mickiewicz University, Poznań, Poland
| | - Rob H J Van der Lubbe
- Laboratory of Vision Science and Optometry, Faculty of Physics, Adam Mickiewicz University, Poznań, Poland.,Cognitive Psychology and Ergonomics, University of Twente, Enschede, The Netherlands
| |
Collapse
|
27
|
Li X, Zhu Q, Janssens T, Arsenault JT, Vanduffel W. In Vivo Identification of Thick, Thin, and Pale Stripes of Macaque Area V2 Using Submillimeter Resolution (f)MRI at 3 T. Cereb Cortex 2017; 29:544-560. [DOI: 10.1093/cercor/bhx337] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2017] [Accepted: 11/29/2017] [Indexed: 11/14/2022] Open
Affiliation(s)
- Xiaolian Li
- Laboratory of Neuro- and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, Belgium
| | - Qi Zhu
- Laboratory of Neuro- and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, Belgium
| | - Thomas Janssens
- Laboratory of Neuro- and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, Belgium
- Current address: Siemens Healthcare Belgium, Beersel, Belgium
| | - John T Arsenault
- Laboratory of Neuro- and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, Belgium
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
| | - Wim Vanduffel
- Laboratory of Neuro- and Psychophysiology, Department of Neurosciences, KU Leuven Medical School, Leuven, Belgium
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
- Department of Radiology, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
28
|
Chen G, Lu HD, Tanigawa H, Roe AW. Solving visual correspondence between the two eyes via domain-based population encoding in nonhuman primates. Proc Natl Acad Sci U S A 2017; 114:13024-13029. [PMID: 29180437 PMCID: PMC5724244 DOI: 10.1073/pnas.1614452114] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Stereoscopic vision depends on correct matching of corresponding features between the two eyes. It is unclear where the brain solves this binocular correspondence problem. Although our visual system is able to make correct global matches, there are many possible false matches between any two images. Here, we use optical imaging data of binocular disparity response in the visual cortex of awake and anesthetized monkeys to demonstrate that the second visual cortical area (V2) is the first cortical stage that correctly discards false matches and robustly encodes correct matches. Our findings indicate that a key transformation for achieving depth perception lies in early stages of extrastriate visual cortex and is achieved by population coding.
Collapse
Affiliation(s)
- Gang Chen
- Interdisciplinary Institute of Neuroscience and Technology, Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou 310029, China;
- College of Biomedical Engineering and Instrument Science, Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, China
- School of Medicine, Zhejiang University, Hangzhou 310058, China
- College of Biomedical Engineering and Instrument Science, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou 310027, China
- Department of Psychology, Vanderbilt University, Nashville, TN 37203
| | - Haidong D Lu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Hisashi Tanigawa
- Interdisciplinary Institute of Neuroscience and Technology, Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou 310029, China
- Department of Physiology, Niigata University, School of Medicine, Chuo-ku, Niigata 951-8510, Japan
| | - Anna W Roe
- Interdisciplinary Institute of Neuroscience and Technology, Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou 310029, China
- College of Biomedical Engineering and Instrument Science, Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, China
- School of Medicine, Zhejiang University, Hangzhou 310058, China
- College of Biomedical Engineering and Instrument Science, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou 310027, China
- Department of Psychology, Vanderbilt University, Nashville, TN 37203
- Division of Neuroscience, Oregon National Primate Research Center, Oregon Health & Science University, Beaverton, OR 97006
| |
Collapse
|
29
|
Dorman R, van Ee R. 50 Years of Stereoblindness: Reconciliation of a Continuum of Disparity Detectors With Blindness for Disparity in Near or Far Depth. Iperception 2017; 8:2041669517738542. [PMID: 29201340 PMCID: PMC5697597 DOI: 10.1177/2041669517738542] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
Whitman Richards (1932–2016) discovered some 50 years ago that about 30% of observers from the normal population exhibit stereoblindness: the disability to process binocular disparities in either far or near depth. We review the literature on stereoblindness entailing two insights. First, contemporary scholars in stereopsis undervalue the comprehension that disparity processing studies require precise assessments of observers’ stereoblindness. We argue that this frequently leads to suboptimal interpretations. Second, there is still an open conundrum: How can the established finding that disparity is processed by a continuum of detectors be reconciled with the disability of many observers to process a whole class of far or near disparities? We propose, based upon integration of literature, that an asymmetry between far and near disparity detection at birth—being present for a variety of reasons—can suppress the typical formation of binocular correlation during the critical period for the development of stereopsis early in life, thereby disabling a whole class of far or near disparities.
Collapse
Affiliation(s)
- Reinder Dorman
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Science, University of Amsterdam, The Netherlands; Donders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, The Netherlands
| | - Raymond van Ee
- Donders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, The Netherlands; Department of Brain and Cognition, University of Leuven, Belgium; Department of Brain, Behavior and Cognition, Philips Research, Eindhoven, The Netherlands
| |
Collapse
|
30
|
Bridge H. Effects of cortical damage on binocular depth perception. Philos Trans R Soc Lond B Biol Sci 2017; 371:rstb.2015.0254. [PMID: 27269597 PMCID: PMC4901448 DOI: 10.1098/rstb.2015.0254] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/10/2015] [Indexed: 12/20/2022] Open
Abstract
Stereoscopic depth perception requires considerable neural computation, including the initial correspondence of the two retinal images, comparison across the local regions of the visual field and integration with other cues to depth. The most common cause for loss of stereoscopic vision is amblyopia, in which one eye has failed to form an adequate input to the visual cortex, usually due to strabismus (deviating eye) or anisometropia. However, the significant cortical processing required to produce the percept of depth means that, even when the retinal input is intact from both eyes, brain damage or dysfunction can interfere with stereoscopic vision. In this review, I examine the evidence for impairment of binocular vision and depth perception that can result from insults to the brain, including both discrete damage, temporal lobectomy and more systemic diseases such as posterior cortical atrophy. This article is part of the themed issue ‘Vision in our three-dimensional world’.
Collapse
Affiliation(s)
- Holly Bridge
- FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK
| |
Collapse
|
31
|
Bosking WH, Beauchamp MS, Yoshor D. Electrical Stimulation of Visual Cortex: Relevance for the Development of Visual Cortical Prosthetics. Annu Rev Vis Sci 2017; 3:141-166. [PMID: 28753382 PMCID: PMC6916716 DOI: 10.1146/annurev-vision-111815-114525] [Citation(s) in RCA: 53] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Electrical stimulation of the cerebral cortex is a powerful tool for exploring cortical function. Stimulation of early visual cortical areas is easily detected by subjects and produces simple visual percepts known as phosphenes. A device implanted in visual cortex that generates patterns of phosphenes could be used as a substitute for natural vision in blind patients. We review the possibilities and limitations of such a device, termed a visual cortical prosthetic. Currently, we can predict the location and size of phosphenes produced by stimulation of single electrodes. A functional prosthetic, however, must produce spatial temporal patterns of activity that will result in the perception of complex visual objects. Although stimulation of later visual cortical areas alone usually does not lead to a visual percept, it can alter visual perception and the performance of visual behaviors, and training subjects to use signals injected into these areas may be possible.
Collapse
Affiliation(s)
- William H Bosking
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas 77030; , ,
| | - Michael S Beauchamp
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas 77030; , ,
| | - Daniel Yoshor
- Department of Neurosurgery, Baylor College of Medicine, Houston, Texas 77030; , ,
| |
Collapse
|
32
|
Decision-Related Activity in Macaque V2 for Fine Disparity Discrimination Is Not Compatible with Optimal Linear Readout. J Neurosci 2017; 37:715-725. [PMID: 28100751 DOI: 10.1523/jneurosci.2445-16.2016] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2016] [Revised: 11/20/2016] [Accepted: 11/29/2016] [Indexed: 11/21/2022] Open
Abstract
Fine judgments of stereoscopic depth rely mainly on relative judgments of depth (relative binocular disparity) between objects, rather than judgments of the distance to where the eyes are fixating (absolute disparity). In macaques, visual area V2 is the earliest site in the visual processing hierarchy for which neurons selective for relative disparity have been observed (Thomas et al., 2002). Here, we found that, in macaques trained to perform a fine disparity discrimination task, disparity-selective neurons in V2 were highly selective for the task, and their activity correlated with the animals' perceptual decisions (unexplained by the stimulus). This may partially explain similar correlations reported in downstream areas. Although compatible with a perceptual role of these neurons for the task, the interpretation of such decision-related activity is complicated by the effects of interneuronal "noise" correlations between sensory neurons. Recent work has developed simple predictions to differentiate decoding schemes (Pitkow et al., 2015) without needing measures of noise correlations, and found that data from early sensory areas were compatible with optimal linear readout of populations with information-limiting correlations. In contrast, our data here deviated significantly from these predictions. We additionally tested this prediction for previously reported results of decision-related activity in V2 for a related task, coarse disparity discrimination (Nienborg and Cumming, 2006), thought to rely on absolute disparity. Although these data followed the predicted pattern, they violated the prediction quantitatively. This suggests that optimal linear decoding of sensory signals is not generally a good predictor of behavior in simple perceptual tasks. SIGNIFICANCE STATEMENT Activity in sensory neurons that correlates with an animal's decision is widely believed to provide insights into how the brain uses information from sensory neurons. Recent theoretical work developed simple predictions to differentiate decoding schemes, and found support for optimal linear readout of early sensory populations with information-limiting correlations. Here, we observed decision-related activity for neurons in visual area V2 of macaques performing fine disparity discrimination, as yet the earliest site for this task. These findings, and previously reported results from V2 in a different task, deviated from the predictions for optimal linear readout of a population with information-limiting correlations. Our results suggest that optimal linear decoding of early sensory information is not a general decoding strategy used by the brain.
Collapse
|
33
|
Columnar Segregation of Magnocellular and Parvocellular Streams in Human Extrastriate Cortex. J Neurosci 2017; 37:8014-8032. [PMID: 28724749 PMCID: PMC5559769 DOI: 10.1523/jneurosci.0690-17.2017] [Citation(s) in RCA: 49] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2017] [Revised: 07/05/2017] [Accepted: 07/09/2017] [Indexed: 11/21/2022] Open
Abstract
Magnocellular versus parvocellular (M-P) streams are fundamental to the organization of macaque visual cortex. Segregated, paired M-P streams extend from retina through LGN into V1. The M stream extends further into area V5/MT, and parts of V2. However, elsewhere in visual cortex, it remains unclear whether M-P-derived information (1) becomes intermixed or (2) remains segregated in M-P-dominated columns and neurons. Here we tested whether M-P streams exist in extrastriate cortical columns, in 8 human subjects (4 female). We acquired high-resolution fMRI at high field (7T), testing for M- and P-influenced columns within each of four cortical areas (V2, V3, V3A, and V4), based on known functional distinctions in M-P streams in macaque: (1) color versus luminance, (2) binocular disparity, (3) luminance contrast sensitivity, (4) peak spatial frequency, and (5) color/spatial interactions. Additional measurements of resting state activity (eyes closed) tested for segregated functional connections between these columns. We found M- and P-like functions and connections within and between segregated cortical columns in V2, V3, and (in most experiments) area V4. Area V3A was dominated by the M stream, without significant influence from the P stream. These results suggest that M-P streams exist, and extend through, specific columns in early/middle stages of human extrastriate cortex.SIGNIFICANCE STATEMENT The magnocellular and parvocellular (M-P) streams are fundamental components of primate visual cortical organization. These streams segregate both anatomical and functional properties in parallel, from retina through primary visual cortex. However, in most higher-order cortical sites, it is unknown whether such M-P streams exist and/or what form those streams would take. Moreover, it is unknown whether M-P streams exist in human cortex. Here, fMRI evidence measured at high field (7T) and high resolution revealed segregated M-P streams in four areas of human extrastriate cortex. These results suggest that M-P information is processed in segregated parallel channels throughout much of human visual cortex; the M-P streams are more than a convenient sorting property in earlier stages of the visual system.
Collapse
|
34
|
Dumoulin SO, Harvey BM, Fracasso A, Zuiderbaan W, Luijten PR, Wandell BA, Petridou N. In vivo evidence of functional and anatomical stripe-based subdivisions in human V2 and V3. Sci Rep 2017; 7:733. [PMID: 28389654 PMCID: PMC5428808 DOI: 10.1038/s41598-017-00634-6] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2016] [Accepted: 03/08/2017] [Indexed: 11/15/2022] Open
Abstract
Visual cortex contains a hierarchy of visual areas. The earliest cortical area (V1) contains neurons responding to colour, form and motion. Later areas specialize on processing of specific features. The second visual area (V2) in non-human primates contains a stripe-based anatomical organization, initially defined using cytochrome-oxidase staining of post-mortem tissue. Neurons in these stripes have been proposed to serve distinct functional specializations, e.g. processing of color, form and motion. These stripes represent an intermediate stage in visual hierarchy and serve a key role in the increasing functional specialization of visual areas. Using sub-millimeter high-field functional and anatomical MRI (7T), we provide in vivo evidence for stripe-based subdivisions in humans. Using functional MRI, we contrasted responses elicited by stimuli alternating at slow and fast temporal frequencies. We revealed stripe-based subdivisions in V2 ending at the V1/V2 border. The human stripes reach into V3. Using anatomical MRI optimized for myelin contrast within gray matter, we also observe a stripe pattern. Stripe subdivisions preferentially responding to fast temporal frequencies are more myelinated. As such, functional and anatomical measures provide independent and converging evidence for functional organization into striped-based subdivisions in human V2 and V3.
Collapse
Affiliation(s)
- Serge O Dumoulin
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands.
- Spinoza Centre for Neuroimaging, Amsterdam, Netherlands.
| | - Ben M Harvey
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
| | - Alessio Fracasso
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
- Spinoza Centre for Neuroimaging, Amsterdam, Netherlands
- Department of Radiology, University Medical Centre, Utrecht, Netherlands
| | - Wietske Zuiderbaan
- Department of Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
| | - Peter R Luijten
- Department of Radiology, University Medical Centre, Utrecht, Netherlands
| | - Brian A Wandell
- Department of Psychology, Stanford University, California, USA
| | - Natalia Petridou
- Department of Radiology, University Medical Centre, Utrecht, Netherlands
- Brain Center Rudolf Magnus, University Medical Centre Utrecht, Utrecht, Netherlands
| |
Collapse
|
35
|
Affiliation(s)
- Andrew E. Welchman
- Department of Psychology, University of Cambridge, Cambridge CB2 3EB, United Kingdom;
| |
Collapse
|
36
|
Nasr S, Tootell RBH. Visual field biases for near and far stimuli in disparity selective columns in human visual cortex. Neuroimage 2016; 168:358-365. [PMID: 27622398 DOI: 10.1016/j.neuroimage.2016.09.012] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2016] [Revised: 08/27/2016] [Accepted: 09/06/2016] [Indexed: 10/21/2022] Open
Abstract
When visual objects are located in the lower visual field, human observers perceive objects to be nearer than their real physical location. Conversely, objects in the upper visual field are viewed farther than their physical location. This bias may be linked to the statistics of natural scenes, and perhaps the ecological relevance of objects in the upper and lower visual fields (Previc, 1990; Yang and Purves, 2003). However, the neural mechanisms underlying such perceptual distortions have remained unknown. To test for underlying brain mechanisms, we presented visual stimuli at different perceptual distances, while measuring high-resolution fMRI in human subjects. First, we localized disparity-selective thick stripes and thick-type columns in secondary and third visual cortical areas, respectively. Consistent with the perceptual bias, we found that the thick stripe/columns that represent the lower visual field also responded more selectively to near rather than far visual stimuli. Conversely, thick stripe/columns that represent the upper visual field show a complementary bias, i.e. selectively higher activity to far rather than near stimuli. Thus, the statistics of natural scenes may play a significant role in the organization of near- and far-selective neurons within V2 thick stripes and V3 thick-type columns.
Collapse
Affiliation(s)
- Shahin Nasr
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA; Department of Radiology, Harvard Medical School, Boston, MA, USA.
| | - Roger B H Tootell
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA; Department of Radiology, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
37
|
Brain activation difference evoked by different binocular disparities of stereograms: An fMRI study. Phys Med 2016; 32:1308-1313. [PMID: 27453205 DOI: 10.1016/j.ejmp.2016.07.007] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/05/2016] [Revised: 04/02/2016] [Accepted: 07/14/2016] [Indexed: 11/22/2022] Open
Abstract
The binocular disparity of two retina images is a main cue of stereoscopic vision. However, the global dependency between brain response and binocular disparity still remains unclear. Here, we used functional Magnetic Resonance Imaging (fMRI) to identify stereopsis-related brain regions with a modified Random Dot Stereogram (RDS) and plotted the activation variation curves under different disparity size. In order to eliminate the confounding shape difference between the stereogram and the plane, commonly seen in RDS, we modified the RDS to a checkerboard version. We found that V3A, V7 and MT+/V5 in dorsal visual stream were activated in stereoscopic experiment, while little activation was found in ventral visual regions. According to the activation trends, 13 subjects were divided into three groups: 5 subjects with turning points (a shift from increased to decreased activation), 5 subjects without turning points and 3 subjects with activation unrelated to disparity. We inferred that the dorsal visual stream primarily processes spatial depth information, rather than shape information.
Collapse
|
38
|
Takahata T. What Does Cytochrome Oxidase Histochemistry Represent in the Visual Cortex? Front Neuroanat 2016; 10:79. [PMID: 27489537 PMCID: PMC4951485 DOI: 10.3389/fnana.2016.00079] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2016] [Accepted: 07/06/2016] [Indexed: 11/13/2022] Open
Affiliation(s)
- Toru Takahata
- Laboratory of Comparative Molecular Neuroanatomy, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University Hangzhou, China
| |
Collapse
|
39
|
Interdigitated Color- and Disparity-Selective Columns within Human Visual Cortical Areas V2 and V3. J Neurosci 2016; 36:1841-57. [PMID: 26865609 DOI: 10.1523/jneurosci.3518-15.2016] [Citation(s) in RCA: 100] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED In nonhuman primates (NHPs), secondary visual cortex (V2) is composed of repeating columnar stripes, which are evident in histological variations of cytochrome oxidase (CO) levels. Distinctive "thin" and "thick" stripes of dark CO staining reportedly respond selectively to stimulus variations in color and binocular disparity, respectively. Here, we first tested whether similar color-selective or disparity-selective stripes exist in human V2. If so, available evidence predicts that such stripes should (1) radiate "outward" from the V1-V2 border, (2) interdigitate, (3) differ from each other in both thickness and length, (4) be spaced ∼3.5-4 mm apart (center-to-center), and, perhaps, (5) have segregated functional connections. Second, we tested whether analogous segregated columns exist in a "next-higher" tier area, V3. To answer these questions, we used high-resolution fMRI (1 × 1 × 1 mm(3)) at high field (7 T), presenting color-selective or disparity-selective stimuli, plus extensive signal averaging across multiple scan sessions and cortical surface-based analysis. All hypotheses were confirmed. V2 stripes and V3 columns were reliably localized in all subjects. The two stripe/column types were largely interdigitated (e.g., nonoverlapping) in both V2 and V3. Color-selective stripes differed from disparity-selective stripes in both width (thickness) and length. Analysis of resting-state functional connections (eyes closed) showed a stronger correlation between functionally alike (compared with functionally unlike) stripes/columns in V2 and V3. These results revealed a fine-scale segregation of color-selective or disparity-selective streams within human areas V2 and V3. Together with prior evidence from NHPs, this suggests that two parallel processing streams extend from visual subcortical regions through V1, V2, and V3. SIGNIFICANCE STATEMENT In current textbooks and reviews, diagrams of cortical visual processing highlight two distinct neural-processing streams within the first and second cortical areas in monkeys. Two major streams consist of segregated cortical columns that are selectively activated by either color or ocular interactions. Because such cortical columns are so small, they were not revealed previously by conventional imaging techniques in humans. Here we demonstrate that such segregated columnar systems exist in humans. We find that, in humans, color versus binocular disparity columns extend one full area further, into the third visual area. Our approach can be extended to reveal and study additional types of columns in human cortex, perhaps including columns underlying more cognitive functions.
Collapse
|
40
|
Adaptive Neuromorphic Circuit for Stereoscopic Disparity Using Ocular Dominance Map. NEUROSCIENCE JOURNAL 2016; 2016:8751874. [PMID: 27243029 PMCID: PMC4868909 DOI: 10.1155/2016/8751874] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/20/2015] [Revised: 02/27/2016] [Accepted: 03/13/2016] [Indexed: 11/18/2022]
Abstract
Stereopsis or depth perception is a critical aspect of information processing in the brain and is computed from the positional shift or disparity between the images seen by the two eyes. Various algorithms and their hardware implementation that compute disparity in real time have been proposed; however, most of them compute disparity through complex mathematical calculations that are difficult to realize in hardware and are biologically unrealistic. The brain presumably uses simpler methods to extract depth information from the environment and hence newer methodologies that could perform stereopsis with brain like elegance need to be explored. This paper proposes an innovative aVLSI design that leverages the columnar organization of ocular dominance in the brain and uses time-staggered Winner Take All (ts-WTA) to adaptively create disparity tuned cells. Physiological findings support the presence of disparity cells in the visual cortex and show that these cells surface as a result of binocular stimulation received after birth. Therefore, creating in hardware cells that can learn different disparities with experience not only is novel but also is biologically more realistic. These disparity cells, when allowed to interact diffusively on a larger scale, can be used to adaptively create stable topological disparity maps in silicon.
Collapse
|
41
|
Moutoussis K. The physiology and psychophysics of the color-form relationship: a review. Front Psychol 2015; 6:1407. [PMID: 26578989 PMCID: PMC4630562 DOI: 10.3389/fpsyg.2015.01407] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2014] [Accepted: 09/03/2015] [Indexed: 11/13/2022] Open
Abstract
The relationship between color and form has been a long standing issue in visual science. A picture of functional segregation and topographic clustering emerges from anatomical and electrophysiological studies in animals, as well as by brain imaging studies in human. However, one of the many roles of chromatic information is to support form perception, and in some cases it can do so in a way superior to achromatic (luminance) information. This occurs both at an early, contour-detection stage, as well as in late, higher stages involving spatial integration and the perception of global shapes. Pure chromatic contrast can also support several visual illusions related to form-perception. On the other hand, form seems a necessary prerequisite for the computation and assignment of color across space, and there are several respects in which the color of an object can be influenced by its form. Evidently, color and form are mutually dependent. Electrophysiological studies have revealed neurons in the visual brain able to signal contours determined by pure chromatic contrast, the spatial tuning of which is similar to that of neurons carrying luminance information. It seems that, especially at an early stage, form is processed by several, independent systems that interact with each other, each one having different tuning characteristics in color space. At later processing stages, mechanisms able to combine information coming from different sources emerge. A clear interaction between color and form is manifested by the fact that color-form contingencies can be observed in various perceptual phenomena such as adaptation aftereffects and illusions. Such an interaction suggests a possible early binding between these two attributes, something that has been verified by both electrophysiological and fMRI studies.
Collapse
Affiliation(s)
- Konstantinos Moutoussis
- Department of History and Philosophy of Science, National and Kapodistrian University of Athens Athens, Greece
| |
Collapse
|
42
|
Roe AW, Ts'o DY. Specificity of V1-V2 orientation networks in the primate visual cortex. Cortex 2015; 72:168-178. [PMID: 26314798 DOI: 10.1016/j.cortex.2015.07.007] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2015] [Revised: 07/07/2015] [Accepted: 07/07/2015] [Indexed: 10/23/2022]
Abstract
The computation of texture and shape involves integration of features of various orientations. Orientation networks within V1 tend to involve cells which share similar orientation selectivity. However, emergent properties in V2 require the integration of multiple orientations. We now show that, unlike interactions within V1, V1-V2 orientation interactions are much less synchronized and are not necessarily orientation dependent. We find V1-V2 orientation networks are of two types: a more tightly synchronized, orientation-preserving network and a less synchronized orientation-diverse network. We suggest that such diversity of V1-V2 interactions underlies the spatial and functional integration required for computation of higher order contour and shape in V2.
Collapse
Affiliation(s)
- Anna W Roe
- Department of Psychology, Vanderbilt University, Nashville, USA; Zhejiang University Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University, Hangzhou 310027, China.
| | - Daniel Y Ts'o
- Department of Neurosurgery, SUNY-Upstate Medical University, Syracuse, NY, USA.
| |
Collapse
|
43
|
Barendregt M, Harvey BM, Rokers B, Dumoulin SO. Transformation from a retinal to a cyclopean representation in human visual cortex. Curr Biol 2015; 25:1982-7. [PMID: 26144967 DOI: 10.1016/j.cub.2015.06.003] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2015] [Revised: 05/13/2015] [Accepted: 06/01/2015] [Indexed: 11/28/2022]
Abstract
We experience our visual world as seen from a single viewpoint, even though our two eyes receive slightly different images. One role of the visual system is to combine the two retinal images into a single representation of the visual field, sometimes called the cyclopean image [1]. Conventional terminology, i.e. retinotopy, implies that the topographic organization of visual areas is maintained throughout visual cortex [2]. However, following the hypothesis that a transformation occurs from a representation of the two retinal images (retinotopy) to a representation of a single cyclopean image (cyclopotopy), we set out to identify the stage in visual processing at which this transformation occurs in the human brain. Using binocular stimuli, population receptive field mapping (pRF), and ultra-high-field (7 T) fMRI, we find that responses in striate cortex (V1) best reflect stimulus position in the two retinal images. In extrastriate cortex (from V2 to LO), on the other hand, responses better reflect stimulus position in the cyclopean image. These results pinpoint the location of the transformation from a retinal to a cyclopean representation and contribute to an understanding of the transition from sensory to perceptual stimulus space in the human brain.
Collapse
Affiliation(s)
- Martijn Barendregt
- Experimental Psychology, Helmholtz Institute, Utrecht University, 3584 CS Utrecht, the Netherlands; Department of Psychology, University of Wisconsin-Madison, 1202 West Johnson Street, Madison, WI 53706, USA
| | - Ben M Harvey
- Experimental Psychology, Helmholtz Institute, Utrecht University, 3584 CS Utrecht, the Netherlands; Faculty of Psychology and Education Sciences, University of Coimbra, 3001-802 Coimbra, Portugal
| | - Bas Rokers
- Experimental Psychology, Helmholtz Institute, Utrecht University, 3584 CS Utrecht, the Netherlands; Department of Psychology, University of Wisconsin-Madison, 1202 West Johnson Street, Madison, WI 53706, USA.
| | - Serge O Dumoulin
- Experimental Psychology, Helmholtz Institute, Utrecht University, 3584 CS Utrecht, the Netherlands
| |
Collapse
|
44
|
Sprague WW, Cooper EA, Tošić I, Banks MS. Stereopsis is adaptive for the natural environment. SCIENCE ADVANCES 2015; 1:e1400254. [PMID: 26207262 PMCID: PMC4507831 DOI: 10.1126/sciadv.1400254] [Citation(s) in RCA: 66] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2014] [Accepted: 04/14/2015] [Indexed: 05/16/2023]
Abstract
Humans and many animals have forward-facing eyes providing different views of the environment. Precise depth estimates can be derived from the resulting binocular disparities, but determining which parts of the two retinal images correspond to one another is computationally challenging. To aid the computation, the visual system focuses the search on a small range of disparities. We asked whether the disparities encountered in the natural environment match that range. We did this by simultaneously measuring binocular eye position and three-dimensional scene geometry during natural tasks. The natural distribution of disparities is indeed matched to the smaller range of correspondence search. Furthermore, the distribution explains the perception of some ambiguous stereograms. Finally, disparity preferences of macaque cortical neurons are consistent with the natural distribution.
Collapse
Affiliation(s)
- William W. Sprague
- Vision Science Graduate Group, University of California, Berkeley, Berkeley, CA 94720, USA
- School of Optometry, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Emily A. Cooper
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Ivana Tošić
- Ricoh Innovations Corp., Menlo Park, CA 94025, USA
| | - Martin S. Banks
- Vision Science Graduate Group, University of California, Berkeley, Berkeley, CA 94720, USA
- School of Optometry, University of California, Berkeley, Berkeley, CA 94720, USA
| |
Collapse
|
45
|
7 tesla FMRI reveals systematic functional organization for binocular disparity in dorsal visual cortex. J Neurosci 2015; 35:3056-72. [PMID: 25698743 DOI: 10.1523/jneurosci.3047-14.2015] [Citation(s) in RCA: 69] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
The binocular disparity between the views of the world registered by the left and right eyes provides a powerful signal about the depth structure of the environment. Despite increasing knowledge of the cortical areas that process disparity from animal models, comparatively little is known about the local architecture of stereoscopic processing in the human brain. Here, we take advantage of the high spatial specificity and image contrast offered by 7 tesla fMRI to test for systematic organization of disparity representations in the human brain. Participants viewed random dot stereogram stimuli depicting different depth positions while we recorded fMRI responses from dorsomedial visual cortex. We repeated measurements across three separate imaging sessions. Using a series of computational modeling approaches, we report three main advances in understanding disparity organization in the human brain. First, we show that disparity preferences are clustered and that this organization persists across imaging sessions, particularly in area V3A. Second, we observe differences between the local distribution of voxel responses in early and dorsomedial visual areas, suggesting different cortical organization. Third, using modeling of voxel responses, we show that higher dorsal areas (V3A, V3B/KO) have properties that are characteristic of human depth judgments: a simple model that uses tuning parameters estimated from fMRI data captures known variations in human psychophysical performance. Together, these findings indicate that human dorsal visual cortex contains selective cortical structures for disparity that may support the neural computations that underlie depth perception.
Collapse
|
46
|
Peng Q, Shi BE. Neural population models for perception of motion in depth. Vision Res 2014; 101:11-31. [DOI: 10.1016/j.visres.2014.04.014] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2013] [Revised: 04/28/2014] [Accepted: 04/29/2014] [Indexed: 11/27/2022]
|
47
|
Abstract
One of the grand challenges in neuroscience is to comprehend neural computation in the association cortices, the parts of the cortex that have shown the largest expansion and differentiation during mammalian evolution and that are thought to contribute profoundly to the emergence of advanced cognition in humans. In this Review, we use grid cells in the medial entorhinal cortex as a gateway to understand network computation at a stage of cortical processing in which firing patterns are shaped not primarily by incoming sensory signals but to a large extent by the intrinsic properties of the local circuit.
Collapse
|
48
|
Felleman DJ, Lim H, Xiao Y, Wang Y, Eriksson A, Parajuli A. The Representation of Orientation in Macaque V2: Four Stripes Not Three. Cereb Cortex 2014; 25:2354-69. [PMID: 24614951 DOI: 10.1093/cercor/bhu033] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Area V2 of macaque monkeys is traditionally thought to consist of 3 distinct functional compartments with characteristic cortical connections and functional properties. Orientation selectivity is one property that has frequently been used to distinguish V2 stripes, however, this receptive field property has been found in a high percentage of neurons across V2 compartments. Using quantitative intrinsic cortical imaging, we derived maps of preferred orientation, orientation selectivity, and orientation gradient in thin stripes, thick stripes, and interstripes in area V2. Orientation-selective responses were found in each V2 stripe, but the magnitude and organization of orientation selectivity differed significantly from stripe to stripe. Remarkably, the 2 pale stripes flanking each cytochrome oxidase dense stripe differed significantly in their representation of orientation resulting in their distinction as type-I and type-II interstripes. V2 orientation maps are characterized by clockwise and anticlockwise "orientation pinwheels", but unlike V1, they are not homogeneously distributed across V2. Furthermore, V2 stripes contain large-scale sequences of preferred orientation. These analyses demonstrate that V2 consists of 4 distinct functional compartments; thick stripes and type-II interstripes, which are strongly orientation selective and thin stripes and type-I interstripes, which are significantly less selective for orientation and exhibit larger orientation gradient magnitudes.
Collapse
Affiliation(s)
- Daniel J Felleman
- Department of Neurobiology and Anatomy, University of Texas Medical School-Houston, Houston, TX 77030, USA
| | - Heejin Lim
- Department of Neurobiology and Anatomy, University of Texas Medical School-Houston, Houston, TX 77030, USA Department of Computer Science, Prairie View A&M University, Prairie View, TX, USA
| | - Youping Xiao
- Department of Neurobiology and Anatomy, University of Texas Medical School-Houston, Houston, TX 77030, USA Departments of Ophthalmology, Physiology and Pharmacology, and the SUNY Eye Institute, State University of New York Downstate Medical Center, Brooklyn, NY, USA
| | - Yi Wang
- Department of Neurobiology and Anatomy, University of Texas Medical School-Houston, Houston, TX 77030, USA State Key Laboratory of Brain and Cognitive Sciences, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China
| | - Anastasia Eriksson
- Department of Neurobiology and Anatomy, University of Texas Medical School-Houston, Houston, TX 77030, USA
| | - Arun Parajuli
- Department of Neurobiology and Anatomy, University of Texas Medical School-Houston, Houston, TX 77030, USA
| |
Collapse
|
49
|
Functional Imaging of Cerebral Oxygenation with Intrinsic Optical Contrast and Phosphorescent Probes. NEUROMETHODS 2014. [DOI: 10.1007/978-1-62703-785-3_14] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
50
|
Ruiz O, Lustig BR, Nassi JJ, Cetin A, Reynolds JH, Albright TD, Callaway EM, Stoner GR, Roe AW. Optogenetics through windows on the brain in the nonhuman primate. J Neurophysiol 2013; 110:1455-67. [PMID: 23761700 DOI: 10.1152/jn.00153.2013] [Citation(s) in RCA: 88] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Optogenetics combines optics and genetics to control neuronal activity with cell-type specificity and millisecond temporal precision. Its use in model organisms such as rodents, Drosophila, and Caenorhabditis elegans is now well-established. However, application of this technology in nonhuman primates (NHPs) has been slow to develop. One key challenge has been the delivery of viruses and light to the brain through the thick dura mater of NHPs, which can only be penetrated with large-diameter devices that damage the brain. The opacity of the NHP dura prevents visualization of the underlying cortex, limiting the spatial precision of virus injections, electrophysiological recordings, and photostimulation. Here, we describe a new optogenetics approach in which the native dura is replaced with an optically transparent artificial dura. This artificial dura can be penetrated with fine glass micropipettes, enabling precisely targeted injections of virus into brain tissue with minimal damage to cortex. The expression of optogenetic agents can be monitored visually over time. Most critically, this optical window permits targeted, noninvasive photostimulation and concomitant measurements of neuronal activity via intrinsic signal imaging and electrophysiological recordings. We present results from both anesthetized-paralyzed (optical imaging) and awake-behaving NHPs (electrophysiology). The improvements over current methods made possible by the artificial dura should enable the widespread use of optogenetic tools in NHP research, a key step toward the development of therapies for neuropsychiatric and neurological diseases in humans.
Collapse
Affiliation(s)
- Octavio Ruiz
- Vision Center Laboratory, Salk Institute for Biological Studies, La Jolla, California
| | | | | | | | | | | | | | | | | |
Collapse
|