1
|
Kang EYC, Chong YJ, Chen KJ, Chou HD, Liu L, Hwang YS, Lai CC, Wu WC. A comparative study of stereopsis in term and preterm children with and without retinopathy of prematurity. Graefes Arch Clin Exp Ophthalmol 2024; 262:2685-2694. [PMID: 38507045 DOI: 10.1007/s00417-024-06402-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 01/14/2024] [Accepted: 02/02/2024] [Indexed: 03/22/2024] Open
Abstract
PURPOSE To evaluate stereopsis in term-born, preterm, and preterm children with and without retinopathy of prematurity (ROP) and its treatment. METHODS The cross-sectional study included 322 children between 3 and 11 years of age born term or preterm, with or without ROP, and with or without treatment for ROP. The ROP treatments were laser therapy, intravitreal injection (IVI) of anti-vascular endothelial growth factor, or their combination. Stereoacuity was measured using the Titmus Stereo Test, and the results among various age groups were analyzed. RESULTS Stereopsis was found to improve with increasing age at testing (P < 0.001) across the entire study population. The term group exhibited significantly better stereoacuity than the preterm group (P < 0.001). At 3-5 years and 6-8 years, the preterm children without ROP exhibited significantly better stereoacuity than did those with ROP (P < 0.001 and P = 0.02, respectively); however, at 9-11 years, both groups exhibited similar stereoacuity (P = 0.34). The stereoacuity in the children with untreated ROP was similar to that of the children with treated ROP in all age groups (P > 0.05). No significant differences in stereopsis were identified between children with ROP treated with laser versus with IVI (P > 0.05). From multivariate analysis, younger age at testing (P = 0.001) and younger gestational age (P < 0.001) were associated with poorer stereopsis. CONCLUSIONS Stereopsis development gradually improved with age in all groups. The children born preterm exhibited poorer stereoacuity than those born term. Children with ROP treated with laser photocoagulation versus IVI may exhibit similar levels of stereoacuity. Younger age at testing and gestational age were independent risk factors for poorer stereoacuity.
Collapse
Affiliation(s)
- Eugene Yu-Chuan Kang
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
- Graduate Institute of Clinical Medical Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Ying-Jiun Chong
- Department of Ophthalmology, Penang General Hospital, Pulau Pinang, Malaysia
| | - Kuan-Jen Chen
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Hung-Da Chou
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Laura Liu
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Yih-Shiou Hwang
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
- Department of Ophthalmology, Jen-Ai Hospital Dali Branch, Taichung, Taiwan
| | - Chi-Chun Lai
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
- Department of Ophthalmology, Keelung Chang Gung Memorial Hospital, Keelung, Taiwan
| | - Wei-Chi Wu
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan, Taiwan.
- College of Medicine, Chang Gung University, Taoyuan, Taiwan.
| |
Collapse
|
2
|
Broseghini A, Stasek M, Lõoke M, Guérineau C, Marinelli L, Mongillo P. Pictorial depth cues elicit the perception of tridimensionality in dogs. Anim Cogn 2024; 27:49. [PMID: 39037605 PMCID: PMC11263462 DOI: 10.1007/s10071-024-01887-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 06/27/2024] [Accepted: 06/29/2024] [Indexed: 07/23/2024]
Abstract
The perception of tridimensionality is elicited by binocular disparity, motion parallax, and monocular or pictorial cues. The perception of tridimensionality arising from pictorial cues has been investigated in several non-human animal species. Although dogs can use and discriminate bidimensional images, to date there is no evidence of dogs' ability to perceive tridimensionality in pictures and/or through pictorial cues. The aim of the present study was to assess the perception of tridimensionality in dogs elicited by two pictorial cues: linear perspective and shading. Thirty-two dogs were presented with a tridimensional stimulus (i.e., a ball) rolling onto a planar surface until eventually falling into a hole (control condition) or until reaching and rolling over an illusory hole (test condition). The illusory hole corresponded to the bidimensional pictorial representation of the real hole, in which the pictorial cues of shading and linear perspective created the impression of tridimensionality. In a violation of expectation paradigm, dogs showed a longer looking time at the scene in which the unexpected situation of a ball rolling over an illusory hole occurred. The surprise reaction observed in the test condition suggests that the pictorial cues of shading and linear perspective in the bidimensional image of the hole were able to elicit the perception of tridimensionality in dogs.
Collapse
Affiliation(s)
- Anna Broseghini
- Department of Comparative Biomedicine and Food Science, Università degli Studi di Padova, Viale dell'Università 16, Legnaro, PD, 35020, Italy
| | - Markus Stasek
- Department of Comparative Biomedicine and Food Science, Università degli Studi di Padova, Viale dell'Università 16, Legnaro, PD, 35020, Italy
| | - Miina Lõoke
- Department of Comparative Biomedicine and Food Science, Università degli Studi di Padova, Viale dell'Università 16, Legnaro, PD, 35020, Italy
| | - Cécile Guérineau
- Department of Comparative Biomedicine and Food Science, Università degli Studi di Padova, Viale dell'Università 16, Legnaro, PD, 35020, Italy
| | - Lieta Marinelli
- Department of Comparative Biomedicine and Food Science, Università degli Studi di Padova, Viale dell'Università 16, Legnaro, PD, 35020, Italy.
| | - Paolo Mongillo
- Department of Comparative Biomedicine and Food Science, Università degli Studi di Padova, Viale dell'Università 16, Legnaro, PD, 35020, Italy
| |
Collapse
|
3
|
Porcar Plana CA, Campos Mollo E, Boronat Seguí F, Lledó Riquelme MD, Marfil Regero D, Silvestre Beneito C, Peris Martínez C. Study of stereopsis using a depth sensation detection platform equipped with computer vision technology (DALE3D). JOURNAL OF OPTOMETRY 2024; 17:100491. [PMID: 38218113 PMCID: PMC10797542 DOI: 10.1016/j.optom.2023.100491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 07/10/2023] [Accepted: 08/14/2023] [Indexed: 01/15/2024]
Abstract
BACKGROUND AND OBJECTIVES The invention described herein is a prototype based on computer vision technology that measures depth perception and is intended for the early examination of stereopsis. MATERIALS AND METHODS The prototype (software and hardware) is a depth perception measurement system that consists on: (a) a screen showing stereoscopic models with a guide point that the subject must point to; (b) a camera capturing the distance between the screen and the subject's finger; and (c) a unit for recording, processing and storing the captured measurements. For test validation, the reproducibility and reliability of the platform were calculated by comparing results with standard stereoscopic tests. A demographic study of depth perception by subgroup analysis is shown. Subjective comparison of the different tests was carried out by means of a satisfaction survey. RESULTS We included 94 subjects, 25 children and 69 adults, with a mean age of 34.2 ± 18.9 years; 36.2 % were men and 63.8 % were women. The DALE3D platform obtained good repeatability with an interclass correlation coefficient (ICC) between 0.94 and 0.87, and coefficient of variation (CV) between 0.1 and 0.26. Threshold determining optimal and suboptimal results was calculated for Randot and DALE3D test. Spearman's correlation coefficient, between thresholds was not statistically significant (p value > 0.05). The test was considered more visually appealing and easier to use by the participants (90 % maximum score). CONCLUSIONS The DALE3D platform is a potentially useful tool for measuring depth perception with optimal reproducibility rates. Its innovative design makes it a more intuitive tool for children than current stereoscopic tests. Nevertheless, further studies will be needed to assess whether the depth perception measured by the DALE3D platform is a sufficiently reliable parameter to assess stereopsis.
Collapse
Affiliation(s)
| | - Ezequiel Campos Mollo
- Hospital Virgen de los Lirios, Ophthalmology Department, Polígono Carmanxell S/N 03804, Alcoy Alicante, Spain
| | - Fernando Boronat Seguí
- Escuela Superior Politécnica de Gandía, Universidad Politécnica de Valencia, C/ Paraninfo 1, Edificio F, 46730 Gandia, Valencia, Spain
| | | | - Daniel Marfil Regero
- Escuela Superior Politécnica de Gandía, Universidad Politécnica de Valencia, C/ Paraninfo 1, Edificio F, 46730 Gandia, Valencia, Spain
| | - Clara Silvestre Beneito
- Hospital Virgen de los Lirios, Optometry, Polígono Carmanxell S/N 03804, Alcoy Alicante, Spain
| | - Cristina Peris Martínez
- FISABIO - Medical Ophthalmology (FOM), Avenida Pío Baroja, 12, 46015 Valencia Valencia, Spain; Departamento de Cirugía (Oftalmología), Facultad de Medicina, Av Blasco Ibáñez15, 46010 Valencia, Spain
| |
Collapse
|
4
|
Olianezhad F, Jin J, Najafian S, Pons C, Mazade R, Kremkow J, Alonso JM. Binocular receptive-field construction in the primary visual cortex. Curr Biol 2024; 34:2474-2486.e5. [PMID: 38772362 DOI: 10.1016/j.cub.2024.04.058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 04/03/2024] [Accepted: 04/25/2024] [Indexed: 05/23/2024]
Abstract
ON and OFF thalamic afferents from the two eyes converge in the primary visual cortex to form binocular receptive fields. The receptive fields need to be diverse to sample our visual world but also similar across eyes to achieve binocular fusion. It is currently unknown how the cortex balances these competing needs between receptive-field diversity and similarity. Our results demonstrate that receptive fields in the cat visual cortex are binocularly matched with exquisite precision for retinotopy, orientation/direction preference, orientation/direction selectivity, response latency, and ON-OFF polarity/structure. Specifically, the average binocular mismatches in retinotopy and ON-OFF structure are tightly restricted to 1/20 and 1/5 of the average receptive-field size but are still large enough to generate all types of binocular disparity tuning. Based on these results, we conclude that cortical receptive fields are binocularly matched with the high precision needed to facilitate binocular fusion while allowing restricted mismatches to process visual depth.
Collapse
Affiliation(s)
- Farzaneh Olianezhad
- Department of Biological and Visual Sciences, SUNY Optometry, New York, NY 10036, USA
| | - Jianzhong Jin
- Department of Biological and Visual Sciences, SUNY Optometry, New York, NY 10036, USA
| | - Sohrab Najafian
- Department of Biological and Visual Sciences, SUNY Optometry, New York, NY 10036, USA; Department of Neurobiology, Harvard Medical School, Boston, MA 02115, USA
| | - Carmen Pons
- Department of Biological and Visual Sciences, SUNY Optometry, New York, NY 10036, USA; Neurological Surgery, University of Chicago Medicine, Chicago, IL 60637, USA
| | - Reece Mazade
- Department of Biological and Visual Sciences, SUNY Optometry, New York, NY 10036, USA; Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA 30332, USA
| | - Jens Kremkow
- Department of Biological and Visual Sciences, SUNY Optometry, New York, NY 10036, USA; Neuroscience Research Center, Charité - Universitätsmedizin, 10117 Berlin, Germany; Bernstein Center for Computational Neuroscience Berlin, 10115 Berlin, Germany
| | - Jose-Manuel Alonso
- Department of Biological and Visual Sciences, SUNY Optometry, New York, NY 10036, USA.
| |
Collapse
|
5
|
Deng H, Gao Y, Mo L, Mo C. Concurrent attention to hetero-depth surfaces in 3-D visual space is governed by theta rhythm. Psychophysiology 2024; 61:e14494. [PMID: 38041416 DOI: 10.1111/psyp.14494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Revised: 10/30/2023] [Accepted: 11/08/2023] [Indexed: 12/03/2023]
Abstract
When simultaneously confronted with multiple attentional targets, visual system employs a time-multiplexing approach in which each target alternates for prioritized access, a mechanism broadly known as rhythmic attentional sampling. For the past decade, rhythmic attentional sampling has received mounting support from converging behavioral and neural findings. However, so compelling are these findings that a critical test ground has been long overshadowed, namely the 3-D visual space where attention is complicated by extraction of the spatial layout of surfaces extending beyond 2-D planes. It remains unknown how attentional deployment to multiple targets is accomplished in the 3-D space. Here, we provided a time-resolved portrait of the behavioral and neural dynamics when participants concurrently attended to two surfaces defined by motion-depth conjunctions. To characterize the moment-to-moment attentional modulation effects, we measured perceptual sensitivity to the hetero-depth surface motions on a fine temporal scale and reconstructed their neural representations using a time-resolved multivariate inverted encoding model. We found that the perceptual sensitivity to the two surface motions rhythmically fluctuated over time at ~4 Hz, with one's enhancement closely tracked by the other's diminishment. Moreover, the behavioral pattern was coupled with an ongoing periodic alternation in strength between the two surface motion representations in the same frequency. Together, our findings provide the first converging evidence of an attentional "pendulum" that rhythmically traverses different stereoscopic depth planes and are indicative of a ubiquitous attentional time multiplexor based on theta rhythm in the 3-D visual space.
Collapse
Affiliation(s)
- Hongyu Deng
- School of Psychology, Center for Studies of Psychological Application, South China Normal University, Guangzhou, P.R. China
| | - Yuan Gao
- School of Psychology, Center for Studies of Psychological Application, South China Normal University, Guangzhou, P.R. China
| | - Lei Mo
- School of Psychology, Center for Studies of Psychological Application, South China Normal University, Guangzhou, P.R. China
| | - Ce Mo
- Department of Psychology, Sun-Yat-Sen University, Guangzhou, P.R. China
| |
Collapse
|
6
|
McMullin MA, Kumar R, Higgins NC, Gygi B, Elhilali M, Snyder JS. Preliminary Evidence for Global Properties in Human Listeners During Natural Auditory Scene Perception. Open Mind (Camb) 2024; 8:333-365. [PMID: 38571530 PMCID: PMC10990578 DOI: 10.1162/opmi_a_00131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 02/10/2024] [Indexed: 04/05/2024] Open
Abstract
Theories of auditory and visual scene analysis suggest the perception of scenes relies on the identification and segregation of objects within it, resembling a detail-oriented processing style. However, a more global process may occur while analyzing scenes, which has been evidenced in the visual domain. It is our understanding that a similar line of research has not been explored in the auditory domain; therefore, we evaluated the contributions of high-level global and low-level acoustic information to auditory scene perception. An additional aim was to increase the field's ecological validity by using and making available a new collection of high-quality auditory scenes. Participants rated scenes on 8 global properties (e.g., open vs. enclosed) and an acoustic analysis evaluated which low-level features predicted the ratings. We submitted the acoustic measures and average ratings of the global properties to separate exploratory factor analyses (EFAs). The EFA of the acoustic measures revealed a seven-factor structure explaining 57% of the variance in the data, while the EFA of the global property measures revealed a two-factor structure explaining 64% of the variance in the data. Regression analyses revealed each global property was predicted by at least one acoustic variable (R2 = 0.33-0.87). These findings were extended using deep neural network models where we examined correlations between human ratings of global properties and deep embeddings of two computational models: an object-based model and a scene-based model. The results support that participants' ratings are more strongly explained by a global analysis of the scene setting, though the relationship between scene perception and auditory perception is multifaceted, with differing correlation patterns evident between the two models. Taken together, our results provide evidence for the ability to perceive auditory scenes from a global perspective. Some of the acoustic measures predicted ratings of global scene perception, suggesting representations of auditory objects may be transformed through many stages of processing in the ventral auditory stream, similar to what has been proposed in the ventral visual stream. These findings and the open availability of our scene collection will make future studies on perception, attention, and memory for natural auditory scenes possible.
Collapse
Affiliation(s)
| | - Rohit Kumar
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Nathan C. Higgins
- Department of Communication Sciences & Disorders, University of South Florida, Tampa, FL, USA
| | - Brian Gygi
- East Bay Institute for Research and Education, Martinez, CA, USA
| | - Mounya Elhilali
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Joel S. Snyder
- Department of Psychology, University of Nevada, Las Vegas, Las Vegas, NV, USA
| |
Collapse
|
7
|
Kemp AD. Effect of binocular visual cue availability on fruit and insect grasping performance in two cheirogaleids: Implications for primate origins hypotheses. J Hum Evol 2024; 188:103456. [PMID: 38325119 DOI: 10.1016/j.jhevol.2023.103456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 10/10/2023] [Accepted: 10/10/2023] [Indexed: 02/09/2024]
Abstract
Forward-facing eyes with parallel optic axes, which provide a wide field of binocular vision and precise depth perception, are among the diagnostic features of crown primates; however, the adaptive significance of this feature remains contentious. Two of the most prominent primate-origins hypotheses propose that either foraging for fruit or nocturnal predation on insects created selective pressures that led to the evolution of diagnostic primate traits, including a wide binocular field. To determine whether either of these hypotheses provides a viable explanation for the evolution of primates' derived eye orientation, the importance of binocular depth cues for the two tasks invoked by these hypotheses was evaluated experimentally in Microcebus murinus and Cheirogaleus medius, cheirogaleids' considered reasonable living analogs of the earliest euprimates. Performance in grasping insects and fruit was evaluated when the animals made use of their full binocular visual field and when their binocular visual field was restricted using a helmet-mounted blinder. Restriction of the binocular field had no effect on fruit grasping performance; however, restriction of the binocular field resulted in a significant deficit in insect predation performance. Differences in behavioral variables also suggest that insect predation is a more visually demanding task than fruit foraging. These results support the role of insect predation, but not fruit foraging, in contributing to the selective pressures that led to the evolution of parallel optic axes and a wide binocular field in crown primates.
Collapse
Affiliation(s)
- Addison D Kemp
- Department of Integrative Anatomical Sciences, Keck School of Medicine, University of Southern California, 403 Bishop Memorial Teaching Building, 133 San Pablo St, Los Angeles, CA, 90033-9112, USA.
| |
Collapse
|
8
|
Manning TS, Alexander E, Cumming BG, DeAngelis GC, Huang X, Cooper EA. Transformations of sensory information in the brain suggest changing criteria for optimality. PLoS Comput Biol 2024; 20:e1011783. [PMID: 38206969 PMCID: PMC10807827 DOI: 10.1371/journal.pcbi.1011783] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 01/24/2024] [Accepted: 12/22/2023] [Indexed: 01/13/2024] Open
Abstract
Neurons throughout the brain modulate their firing rate lawfully in response to sensory input. Theories of neural computation posit that these modulations reflect the outcome of a constrained optimization in which neurons aim to robustly and efficiently represent sensory information. Our understanding of how this optimization varies across different areas in the brain, however, is still in its infancy. Here, we show that neural sensory responses transform along the dorsal stream of the visual system in a manner consistent with a transition from optimizing for information preservation towards optimizing for perceptual discrimination. Focusing on the representation of binocular disparities-the slight differences in the retinal images of the two eyes-we re-analyze measurements characterizing neuronal tuning curves in brain areas V1, V2, and MT (middle temporal) in the macaque monkey. We compare these to measurements of the statistics of binocular disparity typically encountered during natural behaviors using a Fisher Information framework. The differences in tuning curve characteristics across areas are consistent with a shift in optimization goals: V1 and V2 population-level responses are more consistent with maximizing the information encoded about naturally occurring binocular disparities, while MT responses shift towards maximizing the ability to support disparity discrimination. We find that a change towards tuning curves preferring larger disparities is a key driver of this shift. These results provide new insight into previously-identified differences between disparity-selective areas of cortex and suggest these differences play an important role in supporting visually-guided behavior. Our findings emphasize the need to consider not just information preservation and neural resources, but also relevance to behavior, when assessing the optimality of neural codes.
Collapse
Affiliation(s)
- Tyler S. Manning
- Herbert Wertheim School of Optometry & Vision Science, University of California, Berkeley
| | - Emma Alexander
- Department of Computer Science, Northwestern University, Illinois, United States of America
| | - Bruce G. Cumming
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health, Maryland, United States of America
| | - Gregory C. DeAngelis
- Department of Brain and Cognitive Sciences, University of Rochester, New York, United States of America
| | - Xin Huang
- Department of Neuroscience, University of Wisconsin, Madison
| | - Emily A. Cooper
- Herbert Wertheim School of Optometry & Vision Science, University of California, Berkeley
- Helen Wills Neuroscience Institute, University of California, Berkeley
| |
Collapse
|
9
|
Uejima T, Mancinelli E, Niebur E, Etienne-Cummings R. The influence of stereopsis on visual saliency in a proto-object based model of selective attention. Vision Res 2023; 212:108304. [PMID: 37542763 PMCID: PMC10592191 DOI: 10.1016/j.visres.2023.108304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Revised: 07/18/2023] [Accepted: 07/18/2023] [Indexed: 08/07/2023]
Abstract
Some animals including humans use stereoscopic vision which reconstructs spatial information about the environment from the disparity between images captured by eyes in two separate adjacent locations. Like other sensory information, such stereoscopic information is expected to influence attentional selection. We develop a biologically plausible model of binocular vision to study its effect on bottom-up visual attention, i.e., visual saliency. In our model, the scene is organized in terms of proto-objects on which attention acts, rather than on unbound sets of elementary features. We show that taking into account the stereoscopic information improves the performance of the model in the prediction of human eye movements with statistically significant differences.
Collapse
Affiliation(s)
- Takeshi Uejima
- The Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA.
| | - Elena Mancinelli
- The Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
| | - Ernst Niebur
- The Solomon Snyder Department of Neuroscience and the Zanvyl Krieger Mind/Brain Institute, The Johns Hopkins University, Baltimore, MD, USA
| | - Ralph Etienne-Cummings
- The Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
10
|
Fu J, Tanabe S, Cang J. Widespread and Multifaceted Binocular Integration in the Mouse Primary Visual Cortex. J Neurosci 2023; 43:6495-6507. [PMID: 37604691 PMCID: PMC10513071 DOI: 10.1523/jneurosci.0925-23.2023] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 07/21/2023] [Accepted: 08/15/2023] [Indexed: 08/23/2023] Open
Abstract
The brain combines two-dimensional images received from the two eyes to form a percept of three-dimensional surroundings. This process of binocular integration in the primary visual cortex (V1) serves as a useful model for studying how neural circuits generate emergent properties from multiple input signals. Here, we perform a thorough characterization of binocular integration using electrophysiological recordings in the V1 of awake adult male and female mice by systematically varying the orientation and phase disparity of monocular and binocular stimuli. We reveal widespread binocular integration in mouse V1 and demonstrate that the three commonly studied binocular properties-ocular dominance, interocular matching, and disparity selectivity-are independent of each other. For individual neurons, the responses to monocular stimulation can predict the average amplitude of binocular response but not its selectivity. Finally, the extensive and independent binocular integration of monocular inputs is seen across cortical layers in both regular-spiking and fast-spiking neurons, regardless of stimulus design. Our data indicate that the current model of simple feedforward convergence is inadequate to account for binocular integration in mouse V1, thus suggesting an indispensable role played by intracortical circuits in binocular computation.SIGNIFICANCE STATEMENT Binocular integration is an important step of visual processing that takes place in the visual cortex. Studying the process by which V1 neurons become selective for certain binocular disparities is informative about how neural circuits integrate multiple information streams at a more general level. Here, we systematically characterize binocular integration in mice. Our data demonstrate more widespread and complex binocular integration in mouse V1 than previously reported. Binocular responses cannot be explained by a simple convergence of monocular responses, contrary to the prevailing model of binocular integration. These findings thus indicate that intracortical circuits must be involved in the exquisite computation of binocular disparity, which would endow brain circuits with the plasticity needed for binocular development and processing.
Collapse
Affiliation(s)
- Jieming Fu
- Neuroscience Graduate Program
- Department of Biology
| | - Seiji Tanabe
- Department of Psychology, University of Virginia, Charlottesville, Virginia 22904
| | - Jianhua Cang
- Department of Biology
- Department of Psychology, University of Virginia, Charlottesville, Virginia 22904
| |
Collapse
|
11
|
Rosenberg A, Thompson LW, Doudlah R, Chang TY. Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates. Annu Rev Vis Sci 2023; 9:337-359. [PMID: 36944312 DOI: 10.1146/annurev-vision-111022-123857] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/23/2023]
Abstract
The visual system must reconstruct the dynamic, three-dimensional (3D) world from ambiguous two-dimensional (2D) retinal images. In this review, we synthesize current literature on how the visual system of nonhuman primates performs this transformation through multiple channels within the classically defined dorsal (where) and ventral (what) pathways. Each of these channels is specialized for processing different 3D features (e.g., the shape, orientation, or motion of objects, or the larger scene structure). Despite the common goal of 3D reconstruction, neurocomputational differences between the channels impose distinct information-limiting constraints on perception. Convergent evidence further points to the little-studied area V3A as a potential branchpoint from which multiple 3D-fugal processing channels diverge. We speculate that the expansion of V3A in humans may have supported the emergence of advanced 3D spatial reasoning skills. Lastly, we discuss future directions for exploring 3D information transmission across brain areas and experimental approaches that can further advance the understanding of 3D vision.
Collapse
Affiliation(s)
- Ari Rosenberg
- Department of Neuroscience, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, USA;
| | - Lowell W Thompson
- Department of Neuroscience, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, USA;
| | - Raymond Doudlah
- Department of Neuroscience, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, USA;
| | - Ting-Yu Chang
- School of Medicine, National Defense Medical Center, Taipei, Taiwan
| |
Collapse
|
12
|
Ishikawa K, Hasegawa N, Yokoyama A, Sakaki Y, Akagi H, Kawata A, Mani H, Asaka T. Effects of the Loss of Binocular and Motion Parallax on Static Postural Stability. SENSORS (BASEL, SWITZERLAND) 2023; 23:4139. [PMID: 37112477 PMCID: PMC10146252 DOI: 10.3390/s23084139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Revised: 04/15/2023] [Accepted: 04/18/2023] [Indexed: 06/19/2023]
Abstract
Depth information is important for postural stability and is generated by two visual systems: binocular and motion parallax. The effect of each type of parallax on postural stability remains unclear. We investigated the effects of binocular and motion parallax loss on static postural stability using a virtual reality (VR) system with a head-mounted display (HMD). A total of 24 healthy young adults were asked to stand still on a foam surface fixed on a force plate. They wore an HMD and faced a visual background in the VR system under four visual test conditions: normal vision (Control), absence of motion parallax (Non-MP)/binocular parallax (Non-BP), and absence of both motion and binocular parallax (Non-P). The sway area and velocity in the anteroposterior and mediolateral directions of the center-of-pressure displacements were measured. All postural stability measurements were significantly higher under the Non-MP and Non-P conditions than those under the Control and Non-BP conditions, with no significant differences in the postural stability measurements between the Control and Non-BP conditions. In conclusion, motion parallax has a more prominent effect on static postural stability than binocular parallax, which clarifies the underlying mechanisms of postural instability and informs the development of rehabilitation methods for people with visual impairments.
Collapse
Affiliation(s)
- Keita Ishikawa
- Graduate School of Health Sciences, Hokkaido University, Sapporo 060-0812, Japan; (K.I.); (A.Y.); (Y.S.); (H.A.); (A.K.)
| | - Naoya Hasegawa
- Department of Rehabilitation Sciences, Faculty of Health Sciences, Hokkaido University, Sapporo 060-0812, Japan;
| | - Ayane Yokoyama
- Graduate School of Health Sciences, Hokkaido University, Sapporo 060-0812, Japan; (K.I.); (A.Y.); (Y.S.); (H.A.); (A.K.)
| | - Yusuke Sakaki
- Graduate School of Health Sciences, Hokkaido University, Sapporo 060-0812, Japan; (K.I.); (A.Y.); (Y.S.); (H.A.); (A.K.)
| | - Hiromasa Akagi
- Graduate School of Health Sciences, Hokkaido University, Sapporo 060-0812, Japan; (K.I.); (A.Y.); (Y.S.); (H.A.); (A.K.)
| | - Ami Kawata
- Graduate School of Health Sciences, Hokkaido University, Sapporo 060-0812, Japan; (K.I.); (A.Y.); (Y.S.); (H.A.); (A.K.)
| | - Hiroki Mani
- Faculty of Welfare and Health Science, Oita University, Oita 870-1124, Japan;
| | - Tadayoshi Asaka
- Department of Rehabilitation Sciences, Faculty of Health Sciences, Hokkaido University, Sapporo 060-0812, Japan;
| |
Collapse
|
13
|
Manning TS, Alexander E, Cumming BG, DeAngelis GC, Huang X, Cooper EA. Transformations of sensory information in the brain reflect a changing definition of optimality. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.24.534044. [PMID: 36993305 PMCID: PMC10055346 DOI: 10.1101/2023.03.24.534044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
Abstract
Neurons throughout the brain modulate their firing rate lawfully in response to changes in sensory input. Theories of neural computation posit that these modulations reflect the outcome of a constrained optimization: neurons aim to efficiently and robustly represent sensory information under resource limitations. Our understanding of how this optimization varies across the brain, however, is still in its infancy. Here, we show that neural responses transform along the dorsal stream of the visual system in a manner consistent with a transition from optimizing for information preservation to optimizing for perceptual discrimination. Focusing on binocular disparity - the slight differences in how objects project to the two eyes - we re-analyze measurements from neurons characterizing tuning curves in macaque monkey brain regions V1, V2, and MT, and compare these to measurements of the natural visual statistics of binocular disparity. The changes in tuning curve characteristics are computationally consistent with a shift in optimization goals from maximizing the information encoded about naturally occurring binocular disparities to maximizing the ability to support fine disparity discrimination. We find that a change towards tuning curves preferring larger disparities is a key driver of this shift. These results provide new insight into previously-identified differences between disparity-selective regions of cortex and suggest these differences play an important role in supporting visually-guided behavior. Our findings support a key re-framing of optimal coding in regions of the brain that contain sensory information, emphasizing the need to consider not just information preservation and neural resources, but also relevance to behavior.
Collapse
Affiliation(s)
- Tyler S Manning
- Herbert Wertheim School of Optometry & Vision Science, University of California, Berkeley
| | | | - Bruce G Cumming
- Laboratory of Sensorimotor Research, National Eye Institute, National Institutes of Health
| | | | - Xin Huang
- Department of Neuroscience, University of Wisconsin, Madison
| | - Emily A Cooper
- Herbert Wertheim School of Optometry & Vision Science, University of California, Berkeley
- Helen Wills Neuroscience Institute, University of California, Berkeley
| |
Collapse
|
14
|
Sinha S, DeYoung V, Nehru A, Brewer-Deluce D, Wainman BC. Determinants of Learning Anatomy in an Immersive Virtual Reality Environment - A Scoping Review. MEDICAL SCIENCE EDUCATOR 2023; 33:287-297. [PMID: 36573211 PMCID: PMC9774061 DOI: 10.1007/s40670-022-01701-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 11/28/2022] [Indexed: 06/17/2023]
Abstract
UNLABELLED Given the decline of cadavers as anatomy teaching tools, immersive virtual reality (VR) technology has gained popularity as a potential alternative. To better understand how to maximize the educational potential of VR, this scoping review aimed to identify potential determinants of learning anatomy in an immersive VR environment. A literature search yielded 4523 studies, 25 of which were included after screening. Six common factors were derived from secondary outcomes in these papers: cognitive load, cybersickness, student perceptions, stereopsis, spatial understanding, and interactivity. Further objective research investigating the impact of these factors on anatomy examination performance is required. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s40670-022-01701-y.
Collapse
Affiliation(s)
- Sakshi Sinha
- Education Program in Anatomy, Faculty of Health Sciences, McMaster University, 1280 Main St. W. HSC 1R1, Hamilton, ON L8S 4L8 Canada
| | - Veronica DeYoung
- Education Program in Anatomy, Faculty of Health Sciences, McMaster University, 1280 Main St. W. HSC 1R1, Hamilton, ON L8S 4L8 Canada
| | - Amit Nehru
- Education Program in Anatomy, Faculty of Health Sciences, McMaster University, 1280 Main St. W. HSC 1R1, Hamilton, ON L8S 4L8 Canada
| | - Danielle Brewer-Deluce
- School of Kinesiology, Faculty of Health Sciences, Western University, London, ON Canada
| | - Bruce C. Wainman
- Education Program in Anatomy, Faculty of Health Sciences, McMaster University, 1280 Main St. W. HSC 1R1, Hamilton, ON L8S 4L8 Canada
- Department of Pathology and Molecular Medicine, Faculty of Health Sciences, McMaster University, Hamilton, ON Canada
| |
Collapse
|
15
|
Read JCA. Stereopsis without correspondence. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210449. [PMID: 36511401 PMCID: PMC9745876 DOI: 10.1098/rstb.2021.0449] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Stereopsis has traditionally been considered a complex visual ability, restricted to large-brained animals. The discovery in the 1980s that insects, too, have stereopsis, therefore, challenged theories of stereopsis. How can such simple brains see in three dimensions? A likely answer is that insect stereopsis has evolved to produce simple behaviour, such as orienting towards the closer of two objects or triggering a strike when prey comes within range. Scientific thinking about stereopsis has been unduly anthropomorphic, for example assuming that stereopsis must require binocular fusion or a solution of the stereo correspondence problem. In fact, useful behaviour can be produced with very basic stereoscopic algorithms which make no attempt to achieve fusion or correspondence, or to produce even a coarse map of depth across the visual field. This may explain why some aspects of insect stereopsis seem poorly designed from an engineering point of view: for example, paying no attention to whether interocular contrast or velocities match. Such algorithms demonstrably work well enough in practice for their species, and may prove useful in particular autonomous applications. This article is part of a discussion meeting issue 'New approaches to 3D vision'.
Collapse
Affiliation(s)
- Jenny C. A. Read
- Biosciences Institute, Newcastle University, Newcastle upon Tyne, Tyne and Wear UNE2 4HH, UK
| |
Collapse
|
16
|
Slavi N, Balasubramanian R, Lee MA, Liapin M, Oaks-Leaf R, Peregrin J, Potenski A, Troy CM, Ross ME, Herrera E, Kosmidis S, John SWM, Mason CA. CyclinD2-mediated regulation of neurogenic output from the retinal ciliary margin is perturbed in albinism. Neuron 2023; 111:49-64.e5. [PMID: 36351424 PMCID: PMC9822872 DOI: 10.1016/j.neuron.2022.10.025] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 09/28/2022] [Accepted: 10/10/2022] [Indexed: 11/09/2022]
Abstract
In albinism, aberrations in the ipsi-/contralateral retinal ganglion cell (RGC) ratio compromise the functional integrity of the binocular circuit. Here, we focus on the mouse ciliary margin zone (CMZ), a neurogenic niche at the embryonic peripheral retina, to investigate developmental processes regulating RGC neurogenesis and identity acquisition. We found that the mouse ventral CMZ generates predominantly ipsilaterally projecting RGCs, but this output is altered in the albino visual system because of CyclinD2 downregulation and disturbed timing of the cell cycle. Consequently, albino as well as CyclinD2-deficient pigmented mice exhibit diminished ipsilateral retinogeniculate projection and poor depth perception. In albino mice, pharmacological stimulation of calcium channels, known to upregulate CyclinD2 in other cell types, augmented CyclinD2-dependent neurogenesis of ipsilateral RGCs and improved stereopsis. Together, these results implicate CMZ neurogenesis and its regulators as critical for the formation and function of the mammalian binocular circuit.
Collapse
Affiliation(s)
- Nefeli Slavi
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA.
| | - Revathi Balasubramanian
- Department of Ophthalmology, College of Physicians and Surgeons, Columbia University, New York, NY, USA
| | - Melissa Ann Lee
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
| | - Michael Liapin
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
| | - Rachel Oaks-Leaf
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
| | - John Peregrin
- Department of Ophthalmology, College of Physicians and Surgeons, Columbia University, New York, NY, USA
| | - Anna Potenski
- Department of Molecular Pharmacology and Therapeutics, Columbia University, College of Physicians and Surgeons, New York, NY, USA
| | - Carol Marie Troy
- Department of Pathology and Cell Biology, College of Physicians and Surgeons, Columbia University, New York, NY, USA; Department of Neurology, College of Physicians and Surgeons, Columbia University, New York, NY, USA; The Taub Institute for Research on Alzheimer's Disease and the Aging Brain, College of Physicians and Surgeons, Columbia University, New York, NY, USA
| | - Margaret Elizabeth Ross
- Center for Neurogenetics, Feil Family Brain & Mind Research Institute, Weill Cornell Medical College, New York, NY, USA
| | - Eloisa Herrera
- Instituto de Neurociencias (CSIC-UMH), Av. Ramón y Cajal s/n, San Juan de Alicante, Spain
| | - Stylianos Kosmidis
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA; Howard Hughes Medical Institute, Columbia University, New York, NY, USA
| | - Simon William Maxwell John
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA; Department of Ophthalmology, College of Physicians and Surgeons, Columbia University, New York, NY, USA
| | - Carol Ann Mason
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA; Department of Neuroscience, College of Physicians and Surgeons, Columbia University, New York, NY, USA; Department of Pathology and Cell Biology, College of Physicians and Surgeons, Columbia University, New York, NY, USA; Department of Ophthalmology, College of Physicians and Surgeons, Columbia University, New York, NY, USA.
| |
Collapse
|
17
|
Cang J, Fu J, Tanabe S. Neural circuits for binocular vision: Ocular dominance, interocular matching, and disparity selectivity. Front Neural Circuits 2023; 17:1084027. [PMID: 36874946 PMCID: PMC9975354 DOI: 10.3389/fncir.2023.1084027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Accepted: 01/26/2023] [Indexed: 02/17/2023] Open
Abstract
The brain creates a single visual percept of the world with inputs from two eyes. This means that downstream structures must integrate information from the two eyes coherently. Not only does the brain meet this challenge effortlessly, it also uses small differences between the two eyes' inputs, i.e., binocular disparity, to construct depth information in a perceptual process called stereopsis. Recent studies have advanced our understanding of the neural circuits underlying stereoscopic vision and its development. Here, we review these advances in the context of three binocular properties that have been most commonly studied for visual cortical neurons: ocular dominance of response magnitude, interocular matching of orientation preference, and response selectivity for binocular disparity. By focusing mostly on mouse studies, as well as recent studies using ferrets and tree shrews, we highlight unresolved controversies and significant knowledge gaps regarding the neural circuits underlying binocular vision. We note that in most ocular dominance studies, only monocular stimulations are used, which could lead to a mischaracterization of binocularity. On the other hand, much remains unknown regarding the circuit basis of interocular matching and disparity selectivity and its development. We conclude by outlining opportunities for future studies on the neural circuits and functional development of binocular integration in the early visual system.
Collapse
Affiliation(s)
- Jianhua Cang
- Department of Biology, University of Virginia, Charlottesville, VA, United States.,Department of Psychology, University of Virginia, Charlottesville, VA, United States
| | - Jieming Fu
- Department of Biology, University of Virginia, Charlottesville, VA, United States.,Neuroscience Graduate Program, University of Virginia, Charlottesville, VA, United States
| | - Seiji Tanabe
- Department of Psychology, University of Virginia, Charlottesville, VA, United States
| |
Collapse
|
18
|
Tanabe S, Fu J, Cang J. Strong tuning for stereoscopic depth indicates orientation-specific recurrent circuitry in tree shrew V1. Curr Biol 2022; 32:5274-5284.e6. [PMID: 36417902 PMCID: PMC9772061 DOI: 10.1016/j.cub.2022.10.063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Revised: 09/23/2022] [Accepted: 10/27/2022] [Indexed: 11/23/2022]
Abstract
Neurons in the primary visual cortex (V1) are tuned to specific disparities between the two retinal images, which form the neural substrate for stereoscopic vision. We show that V1 neurons in tree shrews, but not in mice, display highly selective responses to narrow ranges of disparity in random-dot stereograms. Surprisingly, V1 neurons in both species show similarly strong tuning to gratings of varying interocular phase differences. This stimulus-dependent dissociation of disparity tuning can be explained by a network model that combines both feedforward and recurrent connections. The features of the model connections are supported by cortical organizations specific to each species. We validate this model by identifying putative inhibitory neurons and confirming their predicted disparity tuning in both species. Together, our studies establish a foundation for using tree shrews in studying binocular vision and raise an exciting possibility of how cortical columns could be uniquely important in computing stereoscopic depth.
Collapse
Affiliation(s)
- Seiji Tanabe
- Department of Psychology, University of Virginia, Charlottesville, VA 22904, USA.
| | - Jieming Fu
- Department of Biology, University of Virginia, Charlottesville, VA 22904, USA; Neuroscience Graduate Program, University of Virginia, Charlottesville, VA 22904, USA
| | - Jianhua Cang
- Department of Psychology, University of Virginia, Charlottesville, VA 22904, USA; Department of Biology, University of Virginia, Charlottesville, VA 22904, USA.
| |
Collapse
|
19
|
French RL, DeAngelis GC. Scene-relative object motion biases depth percepts. Sci Rep 2022; 12:18480. [PMID: 36323845 PMCID: PMC9630409 DOI: 10.1038/s41598-022-23219-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2022] [Accepted: 10/27/2022] [Indexed: 11/07/2022] Open
Abstract
An important function of the visual system is to represent 3D scene structure from a sequence of 2D images projected onto the retinae. During observer translation, the relative image motion of stationary objects at different distances (motion parallax) provides potent depth information. However, if an object moves relative to the scene, this complicates the computation of depth from motion parallax since there will be an additional component of image motion related to scene-relative object motion. To correctly compute depth from motion parallax, only the component of image motion caused by self-motion should be used by the brain. Previous experimental and theoretical work on perception of depth from motion parallax has assumed that objects are stationary in the world. Thus, it is unknown whether perceived depth based on motion parallax is biased by object motion relative to the scene. Naïve human subjects viewed a virtual 3D scene consisting of a ground plane and stationary background objects, while lateral self-motion was simulated by optic flow. A target object could be either stationary or moving laterally at different velocities, and subjects were asked to judge the depth of the object relative to the plane of fixation. Subjects showed a far bias when object and observer moved in the same direction, and a near bias when object and observer moved in opposite directions. This pattern of biases is expected if subjects confound image motion due to self-motion with that due to scene-relative object motion. These biases were large when the object was viewed monocularly, and were greatly reduced, but not eliminated, when binocular disparity cues were provided. Our findings establish that scene-relative object motion can confound perceptual judgements of depth during self-motion.
Collapse
Affiliation(s)
- Ranran L. French
- grid.16416.340000 0004 1936 9174Department of Brain and Cognitive Sciences, Center for Visual Science, University of Rochester, Rochester, USA
| | - Gregory C. DeAngelis
- grid.16416.340000 0004 1936 9174Department of Brain and Cognitive Sciences, Center for Visual Science, University of Rochester, Rochester, USA
| |
Collapse
|
20
|
Neural Research on Depth Perception and Stereoscopic Visual Fatigue in Virtual Reality. Brain Sci 2022; 12:brainsci12091231. [PMID: 36138967 PMCID: PMC9497221 DOI: 10.3390/brainsci12091231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 09/04/2022] [Accepted: 09/07/2022] [Indexed: 11/29/2022] Open
Abstract
Virtual reality (VR) technology provides highly immersive depth perception experiences; nevertheless, stereoscopic visual fatigue (SVF) has become an important factor currently hindering the development of VR applications. However, there is scant research on the underlying neural mechanism of SVF, especially those induced by VR displays, which need further research. In this paper, a Go/NoGo paradigm based on disparity variations is proposed to induce SVF associated with depth perception, and the underlying neural mechanism of SVF in a VR environment was investigated. The effects of disparity variations as well as SVF on the temporal characteristics of visual evoked potentials (VEPs) were explored. Point-by-point permutation statistical with repeated measures ANOVA results revealed that the amplitudes and latencies of the posterior VEP component P2 were modulated by disparities, and posterior P2 amplitudes were modulated differently by SVF in different depth perception situations. Cortical source localization analysis was performed to explore the original cortex areas related to certain fatigue levels and disparities, and the results showed that posterior P2 generated from the precuneus could represent depth perception in binocular vision, and therefore could be performed to distinguish SVF induced by disparity variations. Our findings could help to extend an understanding of the neural mechanisms underlying depth perception and SVF as well as providing beneficial information for improving the visual experience in VR applications.
Collapse
|
21
|
Gietzelt C, Datta R, Busshoff J, Bruns T, Wahba R, Hedergott A. The influence of stereoscopic vision on surgical performance in minimal invasive surgery—a substudy of the IDOSP-Study (Influence of 3D- vs. 4 K-Display Systems on Surgical Performance in minimal invasive surgery). Langenbecks Arch Surg 2022; 407:3069-3078. [DOI: 10.1007/s00423-022-02608-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 07/09/2022] [Indexed: 10/17/2022]
Abstract
Abstract
Purpose
This study is a secondary analysis of the IDOSP trial published in the Annals of Surgery 2020. The aim of this study was to examine the influence of stereo acuity on surgical performance in a laparoscopic training parkour with 3D- versus 4 K-2D-display technique.
Methods
The surgical performance of medical students (MS), non-board-certified surgeons (NBC), and board-certified surgeons (BC) was compared using 3D- versus 4 K-2D-display technique at a training parkour in a randomized cross-over trial. Stereo acuity was tested by TNO and Titmus Stereo tests.
Results
Eighty-nine participants were included in this sub-trial. The median stereo acuity for all participants, measured with the Titmus test, was 25 s arc, with TNO test 30 s arc. Higher quality stereo vision, measured with the Titmus test, correlated significantly with a reduced parkour time (r = 0.26, p = 0.02) and error (r = 0.21, p = 0.048) with the 3D screen. The TNO test did not correlate significantly with parkour performance. There was no statistically significant correlation between parkour time nor error and stereo acuity using the 4 K system (p > 0.457 respectively). Higher age showed a significant correlation with lower stereo acuity measured with TNO (r = 0.21, p = 0.014), but not with the Titmus test (r = − 0.7, p = 0.39). Seven percent of the group “NBC and BC” showed reduced stereo acuity > 120 s arc with the Titmus test and 3% with the TNO test.
Conclusion
High-quality stereo vision is of utmost importance for surgical skills using a 3D-display system. This was most obvious for MS and for tasks that place particularly high demands on hand–eye coordination. The Titmus test was more precise than the TNO test to predict the benefit of a 3D monitor system. Experience and fine motor skills could partly compensate for a poorer stereo acuity.
Trial registration
This trial was registered at clinicaltrials.gov (trial number: NCT03445429, registered February 26, 2018).
Collapse
|
22
|
Maier A, Cox MA, Westerberg JA, Dougherty K. Binocular Integration in the Primate Primary Visual Cortex. Annu Rev Vis Sci 2022; 8:345-360. [PMID: 35676095 DOI: 10.1146/annurev-vision-100720-112922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
binocular vision, binocular fusion, binocular combination, LGN, V1.
Collapse
Affiliation(s)
- A Maier
- Department of Psychological Sciences, Vanderbilt University, Nashville, Tennessee 37240;
| | - M A Cox
- Center for Visual Science, Rochester University, Rochester, New York 14642
| | - J A Westerberg
- Department of Psychological Sciences, Vanderbilt University, Nashville, Tennessee 37240;
| | - K Dougherty
- Neuroscience Institute, Princeton University, Princeton, New Jersey 08544
| |
Collapse
|
23
|
Tang Z, Liu X, Huo H, Tang M, Liu T, Wu Z, Qiao X, Chen D, An R, Dong Y, Fan L, Wang J, Du X, Fan Y. The role of low-frequency oscillations in three-dimensional perception with depth cues in virtual reality. Neuroimage 2022; 257:119328. [PMID: 35605766 DOI: 10.1016/j.neuroimage.2022.119328] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Revised: 05/15/2022] [Accepted: 05/19/2022] [Indexed: 10/18/2022] Open
Abstract
Currently, vision-related neuroscience studies are undergoing a trend from simplified image stimuli toward more naturalistic stimuli. Virtual reality (VR), as an emerging technology for visual immersion, provides more depth cues for three-dimensional (3D) presentation than two-dimensional (2D) image. It is still unclear whether the depth cues used to create 3D visual perception modulate specific cortical activation. Here, we constructed two visual stimuli presented by stereoscopic vision in VR and graphical projection with 2D image, respectively, and used electroencephalography to examine neural oscillations and their functional connectivity during 3D perception. We find that neural oscillations are specific to delta and theta bands in stereoscopic vision and the functional connectivity in the both bands increase in cortical areas related to visual pathways. These findings indicate that low-frequency oscillations play an important role in 3D perception with depth cues.
Collapse
Affiliation(s)
- Zhili Tang
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Xiaoyu Liu
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100083, China.
| | - Hongqiang Huo
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Min Tang
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Tao Liu
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Zhixin Wu
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Xiaofeng Qiao
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Duo Chen
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Ran An
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Ying Dong
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Linyuan Fan
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Jinghui Wang
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Xin Du
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China
| | - Yubo Fan
- Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education; Beijing Advanced Innovation Center for Biomedical Engineering; School of Biological Science and Medical Engineering, Beihang University, Beijing, 100083, China; School of Medical Science and Engineering Medicine, Beihang University, Beijing 100083, China; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100083, China.
| |
Collapse
|
24
|
A nasal visual field advantage in interocular competition. Sci Rep 2022; 12:4616. [PMID: 35301373 PMCID: PMC8931001 DOI: 10.1038/s41598-022-08473-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Accepted: 03/07/2022] [Indexed: 12/05/2022] Open
Abstract
When our eyes are confronted with discrepant images (yielding incompatible retinal inputs) interocular competition (IOC) is instigated. During IOC, one image temporarily dominates perception, while the other is suppressed. Many factors affecting IOC have been extensively examined. One factor that received surprisingly little attention, however, is the stimulus’ visual hemifield (VHF) of origin. This is remarkable, as the VHF location of stimuli is known to affect visual performance in various contexts. Prompted by exploratory analyses, we examined five independent datasets of breaking continuous flash suppression experiments, to establish the VHF’s role in IOC. We found that targets presented in nasal VHF locations broke through suppression much faster than targets in temporal VHF locations. Furthermore, we found that the magnitude of this nasal advantage depended on how strongly the targets were suppressed: the nasal advantage was larger for the recessive eye than for the dominant eye, and was larger in observers with a greater dominance imbalance between the eyes. Our findings suggest that the nasal advantage reported here originates in processing stages where IOC is resolved. Finally, we propose that a nasal advantage in IOC serves an adaptive role in human vision, as it can aid perception of partially occluded objects.
Collapse
|
25
|
Lin CH, Lin HC, Chen CY, Lih CC. Variations in intraocular pressure and visual parameters before and after using mobile virtual reality glasses and their effects on the eyes. Sci Rep 2022; 12:3176. [PMID: 35210496 PMCID: PMC8873506 DOI: 10.1038/s41598-022-07090-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Accepted: 02/11/2022] [Indexed: 11/11/2022] Open
Abstract
We examined the effects of using mobile devices with immersive virtual reality for a short period on the physiological parameters of both eyes. The average age of the 50 participants (23 men and 27 women) was 17.72 ± 1.48 years, and refractive error ranged from 0 D to − 5.00 D. All the participants wore + 3.00 D glasses and underwent a 5-min relaxation adjustment through the atomization method. The participants wore immersive virtual reality (VR) glasses to watch a movie on a roller coaster for 10 min. Their relevant physiological parameters of the eyes were measured both before and after using VR glasses. Compared with before VR use, no significant difference (P > 0.05) was observed in the near-horizontal vergence and refractive error but a significant difference (P < 0.05) was observed in the amplitude of accommodation, intraocular pressure, divergence/convergence, and stereopsis after VR use. The corneal elastic coefficient was > 0.2 MPa, and we used Friedenwald’s eye rigidity relationship to obtain the K value (0.065–0.09). Approximately 10% of the participants experienced cybersickness symptoms such as nausea and dizziness. The use of VR to watch three-dimensional movies reduced intraocular pressure, which may help prevent or treat glaucoma. Moreover, the binocular convergence was higher when viewing near-field objects in VR than in the real world. Therefore, individuals with convergence excess may experience symptoms. Binocular parallax is the most likely cause of cybersickness symptoms. Thus, mobile VR devices with higher quality and comfort are necessary.
Collapse
Affiliation(s)
- Ching-Huang Lin
- Department of Electronic Engineering, National Yunlin University of Science and Technology, Yunlin, Taiwan, 640
| | - Hsien-Chang Lin
- Graduate School of Engineering Science and Technology, National Yunlin University of Science and Technology, Yunlin, Taiwan, 640
| | - Chien-Yu Chen
- Graduate Institute of Color and Illumination Technology, National Taiwan University of Science and Technology, Taipei, Taiwan, 106
| | - Chong-Chung Lih
- Department of Optometry, Jenteh Junior College of Medicine, Nursing and Management, Miaoli, Taiwan, 35664.
| |
Collapse
|
26
|
Ba F, Sang TT, He W, Fatehi J, Mostofi E, Zheng B. Stereopsis and Eye Movement Abnormalities in Parkinson’s Disease and Their Clinical Implications. Front Aging Neurosci 2022; 14:783773. [PMID: 35211005 PMCID: PMC8861359 DOI: 10.3389/fnagi.2022.783773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Accepted: 01/10/2022] [Indexed: 12/01/2022] Open
Abstract
Background Parkinson’s disease (PD) is not exclusively a motor disorder. Among non-motor features, patients with PD possess sensory visual dysfunctions. Depth perception and oculomotor deficits can significantly impact patients’ motor performance. Stereopsis and eye behavioral study using 3D stimuli may help determine their implications in disease status. Objective The objective of this study is to investigate stereopsis and eye movement abnormalities in PD with reliable tools and their correlation with indicators of PD severity. We hypothesize that patients with PD exhibit different eye behaviors and that these differences may correlate to the severity of motor symptoms and cognitive status. Methods Control and PD participants were first evaluated for visual acuity, visual field, contrast acuity, and stereo perception with 2D and Titmus stereotests, followed by the assessment with a 3D active shutter system. Eye movement behaviors were assessed by a Tobii X2-60 eye tracker. Results Screening visual tests did not reveal any differences between the PD and control groups. With the 3D active shutter system, the PD group demonstrated significantly worse stereopsis. The preserved cognitive function was correlated to a more intact stereo function. Patients with PD had longer visual response times, with a higher number of fixations and bigger saccade amplitude, suggesting fixation stabilization difficulties. Such changes showed a positive correlation with the severity of motor symptoms and a negative correlation with normal cognitive status. Conclusion We assessed stereopsis with a 3D active shutter system and oculomotor behaviors with the Tobii eye tracker. Patients with PD exhibit poorer stereopsis and impaired oculomotor behaviors during response time. These deficits were correlated with PD motor and cognitive status. The visual parameters may potentially serve as the clinical biomarkers for PD.
Collapse
Affiliation(s)
- Fang Ba
- Division of Neurology, Department of Medicine, University of Alberta, Edmonton, AB, Canada
- *Correspondence: Fang Ba,
| | - Tina T. Sang
- Faculty of Science, University of Alberta, Edmonton, AB, Canada
| | - Wenjing He
- Surgical Simulation Research Lab, Department of Surgery, University of Alberta, Edmonton, AB, Canada
| | - Jaleh Fatehi
- Division of Neurology, Department of Medicine, University of Alberta, Edmonton, AB, Canada
| | - Emanuel Mostofi
- Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Bin Zheng
- Surgical Simulation Research Lab, Department of Surgery, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
27
|
Lankow BS, Usrey WM. Contextual Modulation of Feedforward Inputs to Primary Visual Cortex. Front Syst Neurosci 2022; 16:818633. [PMID: 35177969 PMCID: PMC8843851 DOI: 10.3389/fnsys.2022.818633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Accepted: 01/04/2022] [Indexed: 11/25/2022] Open
Abstract
Throughout the brain, parallel processing streams compose the building blocks of complex neural functions. One of the most salient models for studying the functional specialization of parallel visual streams in the primate brain is the lateral geniculate nucleus (LGN) of the dorsal thalamus, through which the parvocellular and magnocellular channels, On-center and Off-center channels, and ipsilateral and contralateral eye channels are maintained and provide the foundation for cortical processing. We examined three aspects of neural processing in these streams: (1) the relationship between extraclassical surround suppression, a widespread visual computation thought to represent a canonical neural computation, and the parallel channels of the LGN; (2) the magnitude of binocular interaction in the parallel streams; and (3) the magnitude of suppression elicited by perceptual competition (binocular rivalry) in each stream. Our results show that surround suppression is almost exclusive to Off channel cells; further, we found evidence for two different components of monocular surround suppression—an early-stage suppression exhibited by all magnocellular cells, and a late-stage suppression exhibited only by Off cells in both the parvocellular and magnocellular pathways. This finding indicates that stream-specific circuits contribute to surround suppression in the primate LGN and suggests a distinct role for suppression in the Off channel to the cortex. We also examined the responses of LGN neurons in alert macaque monkeys to determine whether neurons that supply the cortex with visual information are influenced by stimulation of both eyes. Our results demonstrate that LGN neurons are not influenced by stimulation of the non-dominant eye. This was the case when dichoptic stimuli were presented to classical receptive fields of neurons, extraclassical receptive fields of neurons, and when stimuli were appropriate to produce the perception of binocular rivalry.
Collapse
|
28
|
Linton P. V1 as an egocentric cognitive map. Neurosci Conscious 2021; 2021:niab017. [PMID: 34532068 PMCID: PMC8439394 DOI: 10.1093/nc/niab017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 05/21/2021] [Accepted: 06/08/2021] [Indexed: 01/20/2023] Open
Abstract
We typically distinguish between V1 as an egocentric perceptual map and the hippocampus as an allocentric cognitive map. In this article, we argue that V1 also functions as a post-perceptual egocentric cognitive map. We argue that three well-documented functions of V1, namely (i) the estimation of distance, (ii) the estimation of size, and (iii) multisensory integration, are better understood as post-perceptual cognitive inferences. This argument has two important implications. First, we argue that V1 must function as the neural correlates of the visual perception/cognition distinction and suggest how this can be accommodated by V1's laminar structure. Second, we use this insight to propose a low-level account of visual consciousness in contrast to mid-level accounts (recurrent processing theory; integrated information theory) and higher-level accounts (higher-order thought; global workspace theory). Detection thresholds have been traditionally used to rule out such an approach, but we explain why it is a mistake to equate visibility (and therefore the presence/absence of visual experience) with detection thresholds.
Collapse
Affiliation(s)
- Paul Linton
- Centre for Applied Vision Research, City, University of London, Northampton Square, London EC1V 0HB, UK
| |
Collapse
|
29
|
Sun Y, Fu J, Li L, Chen W, Meng Z, Su H, Yao Y, Dai W. Stereoacuity and its determinants in 7-year-old children: the Lhasa Childhood Eye Study. Graefes Arch Clin Exp Ophthalmol 2021; 260:599-608. [PMID: 34499245 DOI: 10.1007/s00417-021-05390-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 08/01/2021] [Accepted: 08/13/2021] [Indexed: 11/30/2022] Open
Abstract
PURPOSE To explore the distribution of stereoacuity and to examine its determinants in school-age children in Tibetan plateau, Southwest China. METHODS This is the cross-sectional part of a school-based cohort study of 7-year-old children in Lhasa, Tibet Autonomous Region, Southwest China. Children in first year of primary school were invited to undergo a comprehensive examination, including height, weight, visual acuity, cycloplegic autorefraction (1% cyclopentolate), anterior segment, cover and uncover test, and stereoacuity (Titmus Stereo Test). RESULTS A total of 1833 eligible subjects were included, with a mean age of 6.82 ± 0.46 years. Mean stereoacuity was 1.78 ± 0.21 in log units (median: 60 arcsec). Children with stereoacuity equal to 40 arcsec and stereoacuity worse than 100 arcsec accounted for 29.24% and 8.18% of the cohort, respectively. Tibetan ethnicity (OR = 1.98; 95%CI, 1.30-3.03), astigmatism (OR = 1.65; 95%CI, 1.26-2.17), strabismus (OR = 2.92; 95%CI, 1.38-6.18), and amblyopia (OR = 3.77; 95%CI, 1.14-12.49) were risk factors for normal stereoacuity (= 40 arcsec). Shorter height, younger age, strabismus, and worse BCVA (P < 0.05 for all) were both related to lower stereoacuity in Spearman correlation analysis and associated with lower stereoacuity in multivariate regression analysis. CONCLUSION Stereoacuity maturation does not appear fully completed in 7-year-old children, while few children present stereoacuity worse than 100 arcsec (8.18%). Lower stereoacuity was associated with younger age, shorter height, strabismus, and lower best-corrected visual acuity.
Collapse
Affiliation(s)
- Yunyun Sun
- Department of Strabismus and Pediatric Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China.,Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology & Visual Sciences Key Laboratory, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China
| | - Jing Fu
- Department of Strabismus and Pediatric Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China. .,Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology & Visual Sciences Key Laboratory, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China.
| | - Lei Li
- Department of Strabismus and Pediatric Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China.,Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology & Visual Sciences Key Laboratory, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China
| | - Weiwei Chen
- Department of Strabismus and Pediatric Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China.,Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology & Visual Sciences Key Laboratory, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China
| | - Zhaojun Meng
- Department of Strabismus and Pediatric Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China.,Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology & Visual Sciences Key Laboratory, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China
| | - Han Su
- Department of Strabismus and Pediatric Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China.,Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology & Visual Sciences Key Laboratory, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China
| | - Yao Yao
- Department of Strabismus and Pediatric Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China.,Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology & Visual Sciences Key Laboratory, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China
| | - Wei Dai
- Department of Strabismus and Pediatric Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China.,Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology & Visual Sciences Key Laboratory, No. 1 Dongjiaominxiang Street, Dongcheng District, 100730, Beijing, China
| |
Collapse
|
30
|
Abstract
Purpose Our visual system compares the inputs received from the two eyes to estimate the relative depths of features in the retinal image. We investigated how an imbalance in the strength of the input received from the two eyes affects stereopsis. We also explored the level of agreement between different measurements of sensory eye imbalance. Methods We measured the sensory eye imbalance and stereoacuity of 30 normally sighted participants. We made our measurements using a modified amblyoscope. The sensory eye imbalance was assessed through three methods: the difference between monocular contrast thresholds, the difference in dichoptic masking weight, and the contribution of each eye to a fused binocular percept. We referred them as the “threshold imbalance,” “masking imbalance,” and “fusion imbalance,” respectively. The stereoacuity threshold was measured by having subjects discriminate which of four circles were displaced in depth. All of our tests were performed using stimuli of the same spatial frequency (2.5 cycles/degree). Results We found a relationship between stereoacuity and sensory eye imbalance. However, this was only the case for fusion imbalance measurement (ρ = 0.52; P = 0.003). Neither the threshold imbalance nor the masking imbalance was significantly correlated with stereoacuity. We also found the threshold imbalance was correlated with both the fusion and masking imbalances (r = 0.46, P = 0.011 and r = 0.49, P = 0.005, respectively). However, a nonsignificant correlation was found between the fusion and masking imbalances. Conclusions Our findings suggest that there exist multiple types of sensory eye dominance that can be assessed by different tasks. We find only imbalances in dominance that result in biases to fused percepts are correlated with stereoacuity.
Collapse
Affiliation(s)
- Xi Wang
- Department of Ophthalmology, West China Hospital, Sichuan University, Chengdu, Sichuan, China.,Laboratory of Optometry and Vision Sciences, West China Hospital, Sichuan University, Chengdu, Sichuan, China.,McGill Vision Research Unit, Department of Ophthalmology & Visual Sciences, McGill University, Montreal, Quebec, Canada
| | - Alex S Baldwin
- McGill Vision Research Unit, Department of Ophthalmology & Visual Sciences, McGill University, Montreal, Quebec, Canada
| | - Robert F Hess
- McGill Vision Research Unit, Department of Ophthalmology & Visual Sciences, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
31
|
Duan Y, Thatte J, Yaklovleva A, Norcia AM. Disparity in Context: Understanding how monocular image content interacts with disparity processing in human visual cortex. Neuroimage 2021; 237:118139. [PMID: 33964460 PMCID: PMC10786599 DOI: 10.1016/j.neuroimage.2021.118139] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Revised: 04/16/2021] [Accepted: 04/19/2021] [Indexed: 11/24/2022] Open
Abstract
Horizontal disparities between the two eyes' retinal images are the primary cue for depth. Commonly used random ot tereograms (RDS) intentionally camouflage the disparity cue, breaking the correlations between monocular image structure and the depth map that are present in natural images. Because of the nonlinear nature of visual processing, it is unlikely that simple computational rules derived from RDS will be sufficient to explain binocular vision in natural environments. In order to understand the interplay between natural scene structure and disparity encoding, we used a depth-image-based-rendering technique and a library of natural 3D stereo pairs to synthesize two novel stereogram types in which monocular scene content was manipulated independent of scene depth information. The half-images of the novel stereograms comprised either random-dots or scrambled natural scenes, each with the same depth maps as the corresponding natural scene stereograms. Using these stereograms in a simultaneous Event-Related Potential and behavioral discrimination task, we identified multiple disparity-contingent encoding stages between 100 ~ 500 msec. The first disparity sensitive evoked potential was observed at ~100 msec after an earlier evoked potential (between ~50-100 msec) that was sensitive to the structure of the monocular half-images but blind to disparity. Starting at ~150 msec, disparity responses were stereogram-specific and predictive of perceptual depth. Complex features associated with natural scene content are thus at least partially coded prior to disparity information, but these features and possibly others associated with natural scene content interact with disparity information only after an intermediate, 2D scene-independent disparity processing stage.
Collapse
Affiliation(s)
- Yiran Duan
- Wu Tsai Neurosciences Institute, 290 Jane Stanford Way, Stanford, CA 94305
| | - Jayant Thatte
- Department of Electrical Engineering, David Packard Building, Stanford University, 350 Jane Stanford Way, Stanford, CA 94305
| | | | - Anthony M Norcia
- Wu Tsai Neurosciences Institute, 290 Jane Stanford Way, Stanford, CA 94305.
| |
Collapse
|
32
|
Abstract
Most animals have at least some binocular overlap, i.e., a region of space that is viewed by both eyes. This reduces the overall visual field and raises the problem of combining two views of the world, seen from different vantage points, into a coherent whole. However, binocular vision also offers many potential advantages, including increased ability to see around obstacles and increased contrast sensitivity. One particularly interesting use for binocular vision is comparing information from both eyes to derive information about depth. There are many different ways in which this might be done, but in this review, I refer to them all under the general heading of stereopsis. This review examines the different possible uses of binocular vision and stereopsis and compares what is currently known about the neural basis of stereopsis in different taxa. Studying different animals helps us break free of preconceptions stemming from the way that stereopsis operates in human vision and provides new insights into the different possible forms of stereopsis. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Jenny C A Read
- Biosciences Institute, Newcastle University, Newcastle upon Tyne NE2 4HH, United Kingdom;
| |
Collapse
|
33
|
Abstract
Stereovision is the ability to perceive fine depth variations from small differences in the two eyes' images. Using adaptive optics, we show that even minute optical aberrations that are not clinically correctable, and go unnoticed in everyday vision, can affect stereo acuity. Hence, the human binocular system is capable of using fine details that are not experienced in everyday vision. Interestingly, stereo acuity varied considerably across individuals even when they were provided identical perfect optics. We also found that individuals' stereo acuity is better when viewing with their habitual optics rather than someone else's (better) optics. Together, these findings suggest that the visual system compensates for habitual optical aberrations through neural adaptation and thereby optimizes stereovision uniquely for each individual. Thus, stereovision is limited by small optical aberrations and by neural adaptation to one's own optics.
Collapse
|
34
|
Natural binocular depth discrimination behavior in mice explained by visual cortical activity. Curr Biol 2021; 31:2191-2198.e3. [PMID: 33705714 DOI: 10.1016/j.cub.2021.02.031] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Revised: 01/20/2021] [Accepted: 02/15/2021] [Indexed: 12/16/2022]
Abstract
In mice and other mammals, forebrain neurons integrate right and left eye information to generate a three-dimensional representation of the visual environment. Neurons in the visual cortex of mice are sensitive to binocular disparity,1-3 yet it is unclear whether that sensitivity is linked to the perception of depth.4-8 We developed a natural task based on the classic visual cliff and pole descent tasks to estimate the psychophysical range of mouse depth discrimination.5,9 Mice with binocular vision descended to a near (shallow) surface more often when surrounding far (deep) surfaces were progressively more distant. Occlusion of one eye severely impaired their ability to target the near surface. We quantified the distance at which animals make their decisions to estimate the binocular image displacement of the checkerboard pattern on the near and far surfaces. Then, we assayed the disparity sensitivity of large populations of binocular neurons in primary visual cortex (V1) using two-photon microscopy2 and quantitatively compared this information available in V1 to their behavioral sensitivity. Disparity information in V1 matches the behavioral performance over the range of depths examined and was resistant to changes in binocular alignment. These findings reveal that mice naturally use stereoscopic cues to guide their behavior and indicate a neural basis for this depth discrimination task.
Collapse
|
35
|
Johnson KP, Fitzpatrick MJ, Zhao L, Wang B, McCracken S, Williams PR, Kerschensteiner D. Cell-type-specific binocular vision guides predation in mice. Neuron 2021; 109:1527-1539.e4. [PMID: 33784498 DOI: 10.1016/j.neuron.2021.03.010] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Revised: 02/09/2021] [Accepted: 03/05/2021] [Indexed: 12/20/2022]
Abstract
Predators use vision to hunt, and hunting success is one of evolution's main selection pressures. However, how viewing strategies and visual systems are adapted to predation is unclear. Tracking predator-prey interactions of mice and crickets in 3D, we find that mice trace crickets with their binocular visual fields and that monocular mice are poor hunters. Mammalian binocular vision requires ipsi- and contralateral projections of retinal ganglion cells (RGCs) to the brain. Large-scale single-cell recordings and morphological reconstructions reveal that only a small subset (9 of 40+) of RGC types in the ventrotemporal mouse retina innervate ipsilateral brain areas (ipsi-RGCs). Selective ablation of ipsi-RGCs (<2% of RGCs) in the adult retina drastically reduces the hunting success of mice. Stimuli based on ethological observations indicate that five ipsi-RGC types reliably signal prey. Thus, viewing strategies align with a spatially restricted and cell-type-specific set of ipsi-RGCs that supports binocular vision to guide predation.
Collapse
Affiliation(s)
- Keith P Johnson
- John F. Hardesty, MD Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, St. Louis, MO 63110, USA; Graduate Program in Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Michael J Fitzpatrick
- John F. Hardesty, MD Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, St. Louis, MO 63110, USA; Graduate Program in Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA; Medical Scientist Training Program, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Lei Zhao
- John F. Hardesty, MD Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Bing Wang
- John F. Hardesty, MD Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Sean McCracken
- John F. Hardesty, MD Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Philip R Williams
- John F. Hardesty, MD Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, St. Louis, MO 63110, USA; Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA; Hope Center for Neurological Disorders, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Daniel Kerschensteiner
- John F. Hardesty, MD Department of Ophthalmology and Visual Sciences, Washington University School of Medicine, St. Louis, MO 63110, USA; Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA; Hope Center for Neurological Disorders, Washington University School of Medicine, St. Louis, MO 63110, USA; Department of Biomedical Engineering, Washington University School of Medicine, St. Louis, MO 63110, USA.
| |
Collapse
|
36
|
He X, Hong J, Liu Z, Wang Q, Li T, Qu X, Fei N, Li W, Fu J. Decreased Functional Connectivity of the Primary Visual Cortex and the Correlation With Clinical Features in Patients With Intermittent Exotropia. Front Neurol 2021; 12:638402. [PMID: 33841308 PMCID: PMC8032987 DOI: 10.3389/fneur.2021.638402] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 03/02/2021] [Indexed: 12/14/2022] Open
Abstract
The purpose of this study is to investigate characteristic alterations of functional connectivity (FC) patterns in the primary visual area (V1) in patients with intermittent exotropia (IXT) using resting-state functional magnetic resonance imaging (rs-fMRI) and how they relate to clinical features. Twenty-six IXT patients and 21 age-, sex-, handedness-, and education-matched healthy controls (HCs) underwent rs-fMRI. We performed FC analyses between bilateral V1 and other brain areas and compared FC strength between two groups. A Pearson correlation analysis was used to evaluate the correlation between the FC differences and clinical features. Compared with HCs, patients with IXT showed significantly lower FC of the right V1 with the right calcarine sulcus and right superior occipital gyrus, and the left V1 with right cuneus and right postcentral gyrus. The Newcastle Control Test score was positively correlated with mean FC values between the left inferior parietal lobule and bilateral V1, and between the left supramarginal gyrus and left V1. The duration of IXT was positively correlated with mean FC values between the right inferior occipital gyrus and right V1. Reduced FC between the V1 and various brain regions involved in vision and eye movement processes may be associated with the underlying neural mechanisms of impaired visual function in patients with IXT.
Collapse
Affiliation(s)
- Xueying He
- Department of Radiology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Jie Hong
- Department of Ophthalmology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Zhaohui Liu
- Department of Radiology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Qian Wang
- Department of Radiology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Ting Li
- Department of Radiology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Xiaoxia Qu
- Department of Radiology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Nanxi Fei
- Department of Radiology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Wei Li
- Department of Radiology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Jing Fu
- Department of Ophthalmology, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
37
|
Yoshioka TW, Doi T, Abdolrahmani M, Fujita I. Specialized contributions of mid-tier stages of dorsal and ventral pathways to stereoscopic processing in macaque. eLife 2021; 10:58749. [PMID: 33625356 PMCID: PMC7959693 DOI: 10.7554/elife.58749] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2020] [Accepted: 02/18/2021] [Indexed: 11/22/2022] Open
Abstract
The division of labor between the dorsal and ventral visual pathways has been well studied, but not often with direct comparison at the single-neuron resolution with matched stimuli. Here we directly compared how single neurons in MT and V4, mid-tier areas of the two pathways, process binocular disparity, a powerful cue for 3D perception and actions. We found that MT neurons transmitted disparity signals more quickly and robustly, whereas V4 or its upstream neurons transformed the signals into sophisticated representations more prominently. Therefore, signaling speed and robustness were traded for transformation between the dorsal and ventral pathways. The key factor in this tradeoff was disparity-tuning shape: V4 neurons had more even-symmetric tuning than MT neurons. Moreover, the tuning symmetry predicted the degree of signal transformation across neurons similarly within each area, implying a general role of tuning symmetry in the stereoscopic processing by the two pathways.
Collapse
Affiliation(s)
- Toshihide W Yoshioka
- Laboratory for Cognitive Neuroscience, Graduate School of Frontier Biosciences, Osaka University, SuitaOsaka, Japan.,Center for Information and Neural Networks, Osaka University and National Institute of Information and Communications Technology, SuitaOsaka, Japan
| | - Takahiro Doi
- Department of Psychology, University of Pennsylvania, Philadelphia, United States
| | - Mohammad Abdolrahmani
- Laboratory for Neural Circuits and Behavior, RIKEN Center for Brain Science (CBS), Wako, Japan
| | - Ichiro Fujita
- Laboratory for Cognitive Neuroscience, Graduate School of Frontier Biosciences, Osaka University, SuitaOsaka, Japan.,Center for Information and Neural Networks, Osaka University and National Institute of Information and Communications Technology, SuitaOsaka, Japan
| |
Collapse
|
38
|
Abstract
Most binocular neurons in the mammalian visual cortex show matched selectivity for light stimuli presented through either eye. A recent study tracked the responses of individual neurons in early visual cortex over time, revealing that matched binocular selectivity develops through major rearrangements of binocular visual circuits.
Collapse
Affiliation(s)
| | - Mark Hübener
- Max Planck Institute of Neurobiology, Martinsried, Germany.
| |
Collapse
|
39
|
Disparity Sensitivity and Binocular Integration in Mouse Visual Cortex Areas. J Neurosci 2020; 40:8883-8899. [PMID: 33051348 DOI: 10.1523/jneurosci.1060-20.2020] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 09/18/2020] [Accepted: 09/22/2020] [Indexed: 01/02/2023] Open
Abstract
Binocular disparity, the difference between the two eyes' images, is a powerful cue to generate the 3D depth percept known as stereopsis. In primates, binocular disparity is processed in multiple areas of the visual cortex, with distinct contributions of higher areas to specific aspects of depth perception. Mice, too, can perceive stereoscopic depth, and neurons in primary visual cortex (V1) and higher-order, lateromedial (LM) and rostrolateral (RL) areas were found to be sensitive to binocular disparity. A detailed characterization of disparity tuning across mouse visual areas is lacking, however, and acquiring such data might help clarifying the role of higher areas for disparity processing and establishing putative functional correspondences to primate areas. We used two-photon calcium imaging in female mice to characterize the disparity tuning properties of neurons in visual areas V1, LM, and RL in response to dichoptically presented binocular gratings, as well as random dot correlograms (RDC). In all three areas, many neurons were tuned to disparity, showing strong response facilitation or suppression at optimal or null disparity, respectively, even in neurons classified as monocular by conventional ocular dominance (OD) measurements. Neurons in higher areas exhibited broader and more asymmetric disparity tuning curves compared with V1, as observed in primate visual cortex. Finally, we probed neurons' sensitivity to true stereo correspondence by comparing responses to correlated RDC (cRDC) and anticorrelated RDC (aRDC). Area LM, akin to primate ventral visual stream areas, showed higher selectivity for correlated stimuli and reduced anticorrelated responses, indicating higher-level disparity processing in LM compared with V1 and RL.SIGNIFICANCE STATEMENT A major cue for inferring 3D depth is disparity between the two eyes' images. Investigating how binocular disparity is processed in the mouse visual system will not only help delineating the role of mouse higher areas for visual processing, but also shed light on how the mammalian brain computes stereopsis. We found that binocular integration is a prominent feature of mouse visual cortex, as many neurons are selectively and strongly modulated by binocular disparity. Comparison of responses to correlated and anticorrelated random dot correlograms (RDC) revealed that lateromedial area (LM) is more selective to correlated stimuli, while less sensitive to anticorrelated stimuli compared with primary visual cortex (V1) and rostrolateral area (RL), suggesting higher-level disparity processing in LM, resembling primate ventral visual stream areas.
Collapse
|
40
|
Chen N, Chen Z, Fang F. Functional specialization in human dorsal pathway for stereoscopic depth processing. Exp Brain Res 2020; 238:2581-2588. [PMID: 32886136 DOI: 10.1007/s00221-020-05918-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Accepted: 09/01/2020] [Indexed: 11/25/2022]
Abstract
Binocular disparity, a primary cue for stereoscopic depth perception, is widely represented in visual cortex. However, the functional specialization in the disparity processing network remains unclear. Using magnetic resonance imaging-guided transcranial magnetic stimulation, we studied the causal contributions of V3A and MT+ to stereoscopic depth perception. Subjects viewed random-dot stereograms forming transparent planes with various interplane disparities. Their smallest detectable disparity and largest detectable disparity were measured in two experiments. We found that the smallest detectable disparity was affected by V3A, but not MT+ , stimulation. On the other hand, the largest detectable disparity was affected by both V3A and MT+ stimulation. Our results suggest different roles of V3A and MT+ in stereoscopic depth processing.
Collapse
Affiliation(s)
- Nihong Chen
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing, 100084, China.
- THU-IDG/McGovern Institute for Brain Research, Beijing, 100084, China.
| | - Zhimin Chen
- School of Psychological and Cognitive Sciences, Peking University, Beijing, 100871, China
| | - Fang Fang
- School of Psychological and Cognitive Sciences, Peking University, Beijing, 100871, China.
- Beijing Key Laboratory of Behavior and Mental Health, Beijing, China.
- PKU-IDG/McGovern Institute for Brain Research, Beijing, China.
- Peking-Tsinghua Center for Life Sciences, Peking University, Beijing, 100871, China.
| |
Collapse
|
41
|
Mamassian P, Zannoli M. Sensory loss due to object formation. Vision Res 2020; 174:22-40. [DOI: 10.1016/j.visres.2020.05.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2019] [Revised: 05/14/2020] [Accepted: 05/20/2020] [Indexed: 11/29/2022]
|
42
|
Predicting Stereopsis in Macular Degeneration. J Neurosci 2020; 40:5465-5470. [PMID: 32487694 DOI: 10.1523/jneurosci.0491-20.2020] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2020] [Revised: 04/10/2020] [Accepted: 05/25/2020] [Indexed: 11/21/2022] Open
Abstract
Each of our eyes sees a slightly different view of the physical world. Disparity is the small difference in position of features in the retinal images; stereopsis is the percept of depth from disparity. A distance between corresponding features in the retinal images of the two eyes smaller than the "upper disparity limit" yields a percept of depth; distances greater than this limit cause the two unfused monocular features to appear flattened into the fixation plane. This behavioral disparity limit is consistent with neurophysiological estimates of the largest disparity scale in primate, allowing us to relate physiological limits on plausible binocular interactions to separation between retinal locations. Here we test the hypothesis that this upper disparity limit predicts the presence of coarse stereopsis in humans with macular degeneration (MD), which affects the central retina but typically spares the periphery. The pattern of vision loss can be highly asymmetric, such that an intact location in one eye has a corresponding point in the other eye that lies within affected retina. Nevertheless, some individuals with MD have coarse stereopsis that is useful for eye-hand coordination. Our results show that individuals with MD (n = 25, male and female) have coarse stereopsis when the distance between intact retinal locations is less than the behavioral and physiological upper disparity limit at the corresponding eccentricity. Furthermore, for those without stereopsis, we can predict whether they can achieve stereopsis by using alternate retinal loci at further eccentricities whose separation is below the upper disparity limit.SIGNIFICANCE STATEMENT We show that the largest separation between features in the two eyes that yields a percept of depth in humans is related to the largest disparity scale in macaque medial temporal area and to the estimated size of the receptive fields in human depth-sensitive cortical regions. This upper disparity limit also predicts whether individuals with retinal damage due to macular degeneration will have stereopsis. Individuals have stereopsis when the separation between intact retinal locations in the two eyes is smaller than the upper disparity limit measured behaviorally. Our results indicate the importance of the behavioral upper disparity limit as a predictor for stereopsis in populations with retinal damage.
Collapse
|
43
|
Abstract
An ideal observer is a theoretical model observer that performs a specific sensory-perceptual task optimally, making the best possible use of the available information given physical and biological constraints. An image-computable ideal observer (pixels in, estimates out) is a particularly powerful type of ideal observer that explicitly models the flow of visual information from the stimulus-encoding process to the eventual decoding of a sensory-perceptual estimate. Image-computable ideal observer analyses underlie some of the most important results in vision science. However, most of what we know from ideal observers about visual processing and performance derives from relatively simple tasks and relatively simple stimuli. This review describes recent efforts to develop image-computable ideal observers for a range of tasks with natural stimuli and shows how these observers can be used to predict and understand perceptual and neurophysiological performance. The reviewed results establish principled links among models of neural coding, computational methods for dimensionality reduction, and sensory-perceptual performance in tasks with natural stimuli.
Collapse
Affiliation(s)
- Johannes Burge
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104, USA; .,Neuroscience Graduate Group, University of Pennsylvania, Philadelphia, Pennsylvania 19104, USA.,Bioengineering Graduate Group, University of Pennsylvania, Philadelphia, Pennsylvania 19104, USA
| |
Collapse
|
44
|
Effects of Mild Traumatic Brain Injury on Stereopsis Detected by a Virtual Reality System: Attempt to Develop a Screening Test. J Med Biol Eng 2020. [DOI: 10.1007/s40846-020-00542-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Abstract
Purpose
The study aimed to evaluate stereopsis as a surrogate marker for post-concussion oculomotor function to develop an objective test that can reliably and quickly detect mild traumatic brain injuries (TBI).
Methods
The cohort of this prospective clinical study included 30 healthy subjects (mean age 25 ± 2 years) and 30 TBI patients (43 ± 22 years) comprising 11 patients with moderate TBI and 19 patients with mild TBI. The healthy subjects were examined once, whereas the TBI patients were examined immediately after hospitalization, at 1 week, and at 2 months. A virtual reality (VR) program displayed three-dimensional rendering of four rotating soccer balls over VR glasses in different gaze directions. The subjects were instructed to select the ball that appeared to be raised from the screen as quickly as possible via remote control. The response times and fusion abilities in different gaze directions were recorded.
Results
The correlation between stereopsis and TBI severity was significant. The response times of the moderate and mild TBI groups were significantly longer than those of the healthy reference group. The response times of the moderate TBI group were significantly longer than those of the mild TBI group. The response times at follow-up examinations were significantly shorter than those immediately after hospitalization. Fusion ability was primarily defective in the gaze direction to the right (90°) and left (270° and 315°).
Conclusions
TBI patients showed impaired stereopsis. Measuring stereopsis in different positions of the visual field using VR can be effective for rapid concussion assessment.
Collapse
|
45
|
KESEMEN O, TİRYAKİ BK, TEZEL Ö, PAK A. Some Statistics in Polar Coordinate System with Uniform Angles. GAZI UNIVERSITY JOURNAL OF SCIENCE 2020. [DOI: 10.35378/gujs.610086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
46
|
Gil-Casas A, Piñero DP, Molina-Martin A. Binocular, Accommodative and Oculomotor Alterations In Multiple Sclerosis: A Review. Semin Ophthalmol 2020; 35:103-115. [PMID: 32228341 DOI: 10.1080/08820538.2020.1744671] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Multiple sclerosis (MS) is an acquired demyelinating and inflammatory neurodegenerative disease affecting the central nervous system (CNS). Clinical and subclinical ocular disturbances occur in almost all patients with MS. The objective of this narrative review was to collect and summarize the available scientific information on oculomotor, accommodative and binocular alterations that have been reported in MS. A systematic search strategy with the following descriptors was carried out: multiple sclerosis, ocular motility disorders, internuclear ophthalmoplegia, nystagmus, vergences, fixation, pupil reflex, accommodation and stereopsis. According to the search, some oculomotor alterations were found to be commonly reported in MS, such as alterations in saccades and nystagmus. In contrast, accommodative, vergence and stereopsis alterations have not been comprehensively studied despite their relevance, with only minimal evidence showing a potential negative impact of the disease on these aspects. In conclusion, oculomotor impairment is a common component of disability in MS patients and should be considered when managing this type of patients. More research is still needed to know the real impact of this disease on binocular vision and accommodation.
Collapse
Affiliation(s)
- Amparo Gil-Casas
- Clínica Optométrica, Foundation Lluís Alcanyís, University of Valencia, Valencia, Spain
| | - David P Piñero
- Optics and Visual Perception Group (GOPV). Department of Optics, Pharmacology and Anatomy, University of Alicante, Alicante, Spain
| | - Ainhoa Molina-Martin
- Optics and Visual Perception Group (GOPV). Department of Optics, Pharmacology and Anatomy, University of Alicante, Alicante, Spain
| |
Collapse
|
47
|
Iwaniuk AN, Wylie DR. Sensory systems in birds: What we have learned from studying sensory specialists. J Comp Neurol 2020; 528:2902-2918. [PMID: 32133638 DOI: 10.1002/cne.24896] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Revised: 02/09/2020] [Accepted: 02/17/2020] [Indexed: 12/27/2022]
Abstract
"Diversity" is an apt descriptor of the research career of Jack Pettigrew as it ranged from the study of trees, to clinical conditions, to sensory neuroscience. Within sensory neuroscience, he was fascinated by the evolution of sensory systems across species. Here, we review some of his work on avian sensory specialists and research that he inspired in others. We begin with an overview of the importance of the Wulst in stereopsis and the need for further study of the Wulst in relation to binocularity across avian species. Next, we summarize recent anatomical, behavioral, and physiological studies on optic flow specializations in hummingbirds. Beyond vision, we discuss the first evidence of a tactile "fovea" in birds and how this led to detailed studies of tactile specializations in waterfowl and sensorimotor systems in parrots. We then describe preliminary studies by Pettigrew of two endemic Australian species, the plains-wanderer (Pedionomus torquatus) and letter-winged kite (Elanus scriptus), that suggest the evolution of some unique auditory and visual specializations in relation to their unique behavior and ecology. Finally, we conclude by emphasizing the importance of a comparative and integrative approach to understanding avian sensory systems and provide an example of one system that has yet to be properly examined: tactile facial bristles in birds. Through reviewing this research and offering future avenues for discovery, we hope that others also embrace the comparative approach to understanding sensory system evolution in birds and other vertebrates.
Collapse
Affiliation(s)
- Andrew N Iwaniuk
- Department of Neuroscience, University of Lethbridge, Lethbridge, Alberta, Canada
| | - Douglas R Wylie
- Department of Biological Sciences, University of Alberta, Edmonton, Alberta, Canada
| |
Collapse
|
48
|
Binocular responsiveness of projection neurons of the praying mantis optic lobe in the frontal visual field. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2020; 206:165-181. [PMID: 32088748 PMCID: PMC7069917 DOI: 10.1007/s00359-020-01405-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2019] [Revised: 01/14/2020] [Accepted: 01/18/2020] [Indexed: 11/30/2022]
Abstract
Praying mantids are the only insects proven to have stereoscopic vision (stereopsis): the ability to perceive depth from the slightly shifted images seen by the two eyes. Recently, the first neurons likely to be involved in mantis stereopsis were described and a speculative neuronal circuit suggested. Here we further investigate classes of neurons in the lobula complex of the praying mantis brain and their tuning to stereoscopically-defined depth. We used sharp electrode recordings with tracer injections to identify visual projection neurons with input in the optic lobe and output in the central brain. In order to measure binocular response fields of the cells the animals watched a vertical bar stimulus in a 3D insect cinema during recordings. We describe the binocular tuning of 19 neurons projecting from the lobula complex and the medulla to central brain areas. The majority of neurons (12/19) were binocular and had receptive fields for both eyes that overlapped in the frontal region. Thus, these neurons could be involved in mantis stereopsis. We also find that neurons preferring different contrast polarity (bright vs dark) tend to be segregated in the mantis lobula complex, reminiscent of the segregation for small targets and widefield motion in mantids and other insects.
Collapse
|
49
|
Optimized but Not Maximized Cue Integration for 3D Visual Perception. eNeuro 2020; 7:ENEURO.0411-19.2019. [PMID: 31836597 PMCID: PMC6948924 DOI: 10.1523/eneuro.0411-19.2019] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Revised: 12/05/2019] [Accepted: 12/08/2019] [Indexed: 02/02/2023] Open
Abstract
Reconstructing three-dimensional (3D) scenes from two-dimensional (2D) retinal images is an ill-posed problem. Despite this, 3D perception of the world based on 2D retinal images is seemingly accurate and precise. The integration of distinct visual cues is essential for robust 3D perception in humans, but it is unclear whether this is true for non-human primates (NHPs). Here, we assessed 3D perception in macaque monkeys using a planar surface orientation discrimination task. Perception was accurate across a wide range of spatial poses (orientations and distances), but precision was highly dependent on the plane's pose. The monkeys achieved robust 3D perception by dynamically reweighting the integration of stereoscopic and perspective cues according to their pose-dependent reliabilities. Errors in performance could be explained by a prior resembling the 3D orientation statistics of natural scenes. We used neural network simulations based on 3D orientation-selective neurons recorded from the same monkeys to assess how neural computation might constrain perception. The perceptual data were consistent with a model in which the responses of two independent neuronal populations representing stereoscopic cues and perspective cues (with perspective signals from the two eyes combined using nonlinear canonical computations) were optimally integrated through linear summation. Perception of combined-cue stimuli was optimal given this architecture. However, an alternative architecture in which stereoscopic cues, left eye perspective cues, and right eye perspective cues were represented by three independent populations yielded two times greater precision than the monkeys. This result suggests that, due to canonical computations, cue integration for 3D perception is optimized but not maximized.
Collapse
|
50
|
Feord RC, Sumner ME, Pusdekar S, Kalra L, Gonzalez-Bellido PT, Wardill TJ. Cuttlefish use stereopsis to strike at prey. SCIENCE ADVANCES 2020; 6:eaay6036. [PMID: 31934631 PMCID: PMC6949036 DOI: 10.1126/sciadv.aay6036] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/02/2019] [Accepted: 11/08/2019] [Indexed: 06/10/2023]
Abstract
The camera-type eyes of vertebrates and cephalopods exhibit remarkable convergence, but it is currently unknown whether the mechanisms for visual information processing in these brains, which exhibit wildly disparate architecture, are also shared. To investigate stereopsis in a cephalopod species, we affixed "anaglyph" glasses to cuttlefish and used a three-dimensional perception paradigm. We show that (i) cuttlefish have also evolved stereopsis (i.e., the ability to extract depth information from the disparity between left and right visual fields); (ii) when stereopsis information is intact, the time and distance covered before striking at a target are shorter; (iii) stereopsis in cuttlefish works differently to vertebrates, as cuttlefish can extract stereopsis cues from anticorrelated stimuli. These findings demonstrate that although there is convergent evolution in depth computation, cuttlefish stereopsis is likely afforded by a different algorithm than in humans, and not just a different implementation.
Collapse
Affiliation(s)
- R. C. Feord
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3EG, UK
| | - M. E. Sumner
- Department of Ecology, Evolution and Behavior, University of Minnesota, St. Paul, MN 55108, USA
| | - S. Pusdekar
- Department of Ecology, Evolution and Behavior, University of Minnesota, St. Paul, MN 55108, USA
| | - L. Kalra
- Department of Ecology, Evolution and Behavior, University of Minnesota, St. Paul, MN 55108, USA
| | - P. T. Gonzalez-Bellido
- Department of Ecology, Evolution and Behavior, University of Minnesota, St. Paul, MN 55108, USA
| | - Trevor J. Wardill
- Department of Ecology, Evolution and Behavior, University of Minnesota, St. Paul, MN 55108, USA
| |
Collapse
|