Structure and function of the bird fovea

Avian eye-inspired perovskite artificial vision system for foveated and multispectral imaging

Avian eyes have deep central foveae as a result of extensive evolution. Deep foveae efficiently refract incident light, creating a magnified image of the target object and making it easier to track object motion. These features are essential for detecting and tracking remote objects in dynamic environments. Furthermore, avian eyes respond to a wide spectrum of light, including visible and ultraviolet light, allowing them to efficiently distinguish the target object from complex backgrounds. Despite notable advances in artificial vision systems that mimic animal vision, the exceptional object detection and targeting capabilities of avian eyes via foveated and multispectral imaging remain underexplored. Here, we present an artificial vision system that capitalizes on these aspects of avian vision. We introduce an artificial fovea and vertically stacked perovskite photodetector arrays whose designs were optimized by theoretical simulations for the demonstration of foveated and multispectral imaging. The artificial vision system successfully identifies colored and mixed-color objects and detects remote objects through foveated imaging. The potential for use in uncrewed aerial vehicles that need to detect, track, and recognize distant targets in dynamic environments is also discussed. Our avian eye-inspired perovskite artificial vision system marks a notable advance in bioinspired artificial visions.

Nanomaterial-Based Artificial Vision Systems: From Bioinspired Electronic Eyes to In-Sensor Processing Devices

High-performance robotic vision empowers mobile and humanoid robots to detect and identify their surrounding objects efficiently, which enables them to cooperate with humans and assist human activities. For error-free execution of these robots' tasks, efficient imaging and data processing capabilities are essential, even under diverse and complex environments. However, conventional technologies fall short of meeting the high-standard requirements of robotic vision under such circumstances. Here, we discuss recent progress in artificial vision systems with high-performance imaging and data processing capabilities enabled by distinctive electrical, optical, and mechanical characteristics of nanomaterials surpassing the limitations of traditional silicon technologies. In particular, we focus on nanomaterial-based electronic eyes and in-sensor processing devices inspired by biological eyes and animal visual recognition systems, respectively. We provide perspectives on key nanomaterials, device components, and their functionalities, as well as explain the remaining challenges and future prospects of the artificial vision systems.

Binocular field configuration in owls: the role of foraging ecology

The binocular field of vision differs widely in birds depending on ecological traits such as foraging. Owls (Strigiformes) have been considered to have a unique binocular field, but whether it is related to foraging has remained unknown. While taking into account allometry and phylogeny, we hypothesized that both daily activity cycle and diet determine the size and shape of the binocular field in owls. Here, we compared the binocular field configuration of 23 species of owls. While we found no effect of allometry and phylogeny, ecological traits strongly influence the binocular field shape and size. Binocular field shape of owls significantly differed from that of diurnal raptors. Among owls, binocular field shape was relatively conserved, but binocular field size differed among species depending on ecological traits, with larger binocular fields in species living in dense habitat and foraging on invertebrates. Our results suggest that (i) binocular field shape is associated with the time of foraging in the daily cycle (owls versus diurnal raptors) and (ii) that binocular field size differs between closely related owl species even though the general shape is conserved, possibly because the field of view is partially restricted by feathers, in a trade-off with auditory localization.

Increased neuron density in the midbrain of a foveate bird, pigeon, results from profound change in tissue morphogenesis

The increase of brain neuron number in relation with brain size is currently considered to be the major evolutionary path to high cognitive power in amniotes. However, how changes in neuron density did contribute to the evolution of the information-processing capacity of the brain remains unanswered. High neuron densities are seen as the main reason why the fovea located at the visual center of the retina is responsible for sharp vision in birds and primates. The emergence of foveal vision is considered as a breakthrough innovation in visual system evolution. We found that neuron densities in the largest visual center of the midbrain - i.e., the optic tectum - are two to four times higher in modern birds with one or two foveae compared to birds deprived of this specialty. Interspecies comparisons enabled us to identify elements of a hitherto unknown developmental process set up by foveate birds for increasing neuron density in the upper layers of their optic tectum. The late progenitor cells that generate these neurons proliferate in a ventricular zone that can expand only radially. In this particular context, the number of cells in ontogenetic columns increases, thereby setting the conditions for higher cell densities in the upper layers once neurons did migrate.

Peripheral and central sensation: multisensory orienting and recognition across species

Attentional bottlenecks force animals to deeply process only a selected fraction of sensory inputs. This motivates a unifying central-peripheral dichotomy (CPD), which separates multisensory processing into functionally defined central and peripheral senses. Peripheral senses (e.g., human audition and peripheral vision) select a fraction of the sensory inputs by orienting animals' attention; central senses (e.g., human foveal vision) allow animals to recognize the selected inputs. Originally used to understand human vision, CPD can be applied to multisensory processes across species. I first describe key characteristics of central and peripheral senses, such as the degree of top-down feedback and density of sensory receptors, and then show CPD as a framework to link ecological, behavioral, neurophysiological, and anatomical data and produce falsifiable predictions.

Foxd1-dependent induction of a temporal retinal character is required for visual function

Appropriate patterning of the retina during embryonic development is assumed to underlie the establishment of spatially localised specialisations that mediate the perception of specific visual features. For example, in zebrafish, an area involved in high acuity vision (HAA) is thought to be present in the ventro-temporal retina. Here, we show that the interplay of the transcription factor Rx3 with Fibroblast Growth Factor and Hedgehog signals initiates and restricts foxd1 expression to the prospective temporal retina, initiating naso-temporal regionalisation of the retina. Abrogation of Foxd1 results in the loss of temporal and expansion of nasal retinal character, and consequent absence of the HAA. These structural defects correlate with severe visual defects, as assessed in optokinetic and optomotor response assays. In contrast, optokinetic responses are unaffected in the opposite condition, in which nasal retinal character is lost at the expense of expanded temporal character. Our study indicates that the establishment of temporal retinal character during early retinal development is required for the specification of the HAA, and suggests a prominent role of the temporal retina in controlling specific visual functions.

The relative sizes of nuclei in the oculomotor complex vary by order and behaviour in birds

Eye movements are a critical component of visually guided behaviours, allowing organisms to scan the environment and bring stimuli of interest to regions of acuity in the retina. Although the control and modulation of eye movements by cranial nerve nuclei are highly conserved across vertebrates, species variation in visually guided behaviour and eye morphology could lead to variation in the size of oculomotor nuclei. Here, we test for differences in the size and neuron numbers of the oculomotor nuclei among birds that vary in behaviour and eye morphology. Using unbiased stereology, we measured the volumes and numbers of neurons of the oculomotor (nIII), trochlear (nIV), abducens (nVI), and Edinger-Westphal (EW) nuclei across 71 bird species and analysed these with phylogeny-informed statistics. Owls had relatively smaller nIII, nIV, nVI and EW nuclei than other birds, which reflects their limited degrees of eye movements. In contrast, nVI was relatively larger in falcons and hawks, likely reflecting how these predatory species must shift focus between the central and temporal foveae during foraging and prey capture. Unexpectedly, songbirds had an enlarged EW and relatively more nVI neurons, which might reflect accommodation and horizontal eye movements. Finally, the one merganser we measured also has an enlarged EW, which is associated with the high accommodative power needed for pursuit diving. Overall, these differences reflect species and clade level variation in behaviour, but more data are needed on eye movements in birds across species to better understand the relationships among behaviour, retinal anatomy, and brain anatomy.

A natural history of vertebrate vision loss: Insight from mammalian vision for human visual function

Research on the origin of vision and vision loss in naturally "blind" animal species can reveal the tasks that vision fulfills and the brain's role in visual experience. Models that incorporate evolutionary history, natural variation in visual ability, and experimental manipulations can help disentangle visual ability at a superficial level from behaviors linked to vision but not solely reliant upon it, and could assist the translation of ophthalmological research in animal models to human treatments. To unravel the similarities between blind individuals and blind species, we review concepts of 'blindness' and its behavioral correlates across a range of species. We explore the ancestral emergence of vision in vertebrates, and the loss of vision in blind species with reference to an evolution-based classification scheme. We applied phylogenetic comparative methods to a mammalian tree to explore the evolution of visual acuity using ancestral state estimations. Future research into the natural history of vision loss could help elucidate the function of vision and inspire innovations in how to address vision loss in humans.

Cone distribution and visual resolution of the yellow-legged gull, Larus michahellis (Naumann, 1840)

The morphological characteristics of the yellow-legged gull's photoreceptors and cone distribution were studied using light and electron microscopy. In wholemount fresh retinas, five different coloured oil droplets located in the cone inner segments could be seen and characterized by colour, diameter and stratification. The photoreceptors were classified by comparing the fresh and fixed vertical sections under a light and electron microscope. Rods were easily distinguished from cones based on the outer segment morphology and the absence of oil droplets in their inner segments. Four types of single cones were associated with red, yellow, colourless and transparent oil droplets. Unequal double cones comprised a long principal member with a green oil droplet and an accessory short member containing a green microdroplet which was highly electron-dense under electron microscopy. The different types of oil droplets were counted from microphotographs of fresh retinal samples in 20 regions. The density, percentage and diameter of the oil droplets were determined. The results showed that central regions had the highest oil droplet density which decreased towards the retinal periphery in all quadrants. Moreover, the oil droplet density was higher in the dorsotemporal quadrant than in other retinal regions. The average density of the red oil droplets was highest in the central areas, whereas colourless oil droplets had the highest density throughout the retina. In contrast, transparent oil droplets had the lowest density across all the regions of the retina. Finally, the retinal resolution was 52.61 cycles/degree. It was calculated using the posterior nodal distance and the oil droplet diameter. The work concludes by discussing the significance of the relative proportion of different cone types across the retina.

Ocular elongation and retraction in foveated reptiles

BACKGROUND

Pronounced asymmetric changes in ocular globe size during eye development have been observed in a number of species ranging from humans to lizards. In contrast, largely symmetric changes in globe size have been described for other species like rodents. We propose that asymmetric changes in the three-dimensional structure of the developing eye correlate with the types of retinal remodeling needed to produce areas of high photoreceptor density. To test this idea, we systematically examined three-dimensional aspects of globe size as a function of eye development in the bifoveated brown anole, Anolis sagrei.

RESULTS

During embryonic development, the anole eye undergoes dynamic changes in ocular shape. Initially spherical, the eye elongates in the presumptive foveal regions of the retina and then proceeds through a period of retraction that returns the eye to its spherical shape. During this period of retraction, pit formation and photoreceptor cell packing are observed. We found a similar pattern of elongation and retraction associated with the single fovea of the veiled chameleon, Chamaeleo calyptratus.

CONCLUSIONS

These results, together with those reported for other foveated species, support the idea that areas of high photoreceptor packing occur in regions where the ocular globe asymmetrically elongates and retracts during development.

Assessment of the pigeon (Columba livia) retina with spectral domain optical coherence tomography

BACKGROUND

To assess the normal retina of the pigeon eye using spectral domain optical coherence tomography (SD-OCT) and establish a normative reference.

METHODS

Twelve eyes of six ophthalmologically normal pigeons (Columba livia) were included. SD-OCT images were taken with dilated pupils under sedation. Four meridians, including the fovea, optic disc, red field, and yellow field, were obtained in each eye. The layers, including full thickness (FT), ganglion cell complex (GCC), thickness from the retinal pigmented epithelium to the outer nuclear layer (RPE-ONL), and from the retinal pigmented epithelium to the inner nuclear layer (RPE-INL), were manually measured.

RESULTS

The average FT values were significantly different among the four meridians (p < 0.05), with the optic disc meridian being the thickest (294.0 ± 13.9 µm). The average GCC was thickest in the optic disc (105.3 ± 27.1 µm) and thinnest in the fovea meridian (42.8 ± 15.3 µm). The average RPE-INL of the fovea meridian (165.5 ± 18.3 µm) was significantly thicker than that of the other meridians (p < 0.05). The average RPE-ONL of the fovea, optic disc, yellow field, and red field were 91.2 ± 5.2 µm, 87.7 ± 5.3 µm, 87.6 ± 6.5 µm, and 91.4 ± 3.9 µm, respectively. RPE-INL and RPE-ONL thickness of the red field meridian did not change significantly with measurement location (p > 0.05).

CONCLUSIONS

Measured data could be used as normative references for diagnosing pigeon retinopathies and further research on avian fundus structure.

DeepFoveaNet: Deep Fovea Eagle-Eye Bioinspired Model to Detect Moving Objects

Birds of prey especially eagles and hawks have a visual acuity two to five times better than humans. Among the peculiar characteristics of their biological vision are that they have two types of foveae; one shallow fovea used in their binocular vision, and a deep fovea for monocular vision. The deep fovea allows these birds to see objects at long distances and to identify them as possible prey. Inspired by the biological functioning of the deep fovea a model called DeepFoveaNet is proposed in this paper. DeepFoveaNet is a convolutional neural network model to detect moving objects in video sequences. DeepFoveaNet emulates the monocular vision of birds of prey through two Encoder-Decoder convolutional neural network modules. This model combines the capacity of magnification of the deep fovea and the context information of the peripheral vision. Unlike algorithms to detect moving objects, ranked in the first places of the Change Detection database (CDnet14), DeepFoveaNet does not depend on previously trained neural networks, neither on a huge number of training images for its training. Besides, its architecture allows it to learn spatiotemporal information of the video. DeepFoveaNet was evaluated in the CDnet14 database achieving high performance and was ranked as one of the ten best algorithms. The characteristics and results of DeepFoveaNet demonstrated that the model is comparable to the state-of-the-art algorithms to detect moving objects, and it can detect very small moving objects through its deep fovea model that other algorithms cannot detect.

Expression of cell markers and transcription factors in the avian retina compared with that in the marmoset retina

In the vertebrate retina, amacrine and ganglion cells represent the most diverse cell classes. They can be classified into different cell types by several features, such as morphology, light responses, and gene expression profile. Although birds possess high visual acuity (similar to primates that we used here for comparison) and tetrachromatic color vision, data on the expression of transcription factors in retinal ganglion cells of birds are largely missing. In this study, we tested various transcription factors, known to label subpopulations of cells in mammalian retinae, in two avian species: the common buzzard (Buteo buteo), a raptor with exceptional acuity, and the domestic pigeon (Columba livia domestica), a good navigator and widely used model for visual cognition. Staining for the transcription factors Foxp2, Satb1 and Satb2 labeled most ganglion cells in the avian ganglion cell layer. CtBP2 was established as marker for displaced amacrine cells, which allowed us to reliably distinguish ganglion cells from displaced amacrine cells and assess their densities in buzzard and pigeon. When we additionally compared the temporal and central fovea of the buzzard with the fovea of primates, we found that the cellular organization in the pits was different in primates and raptors. In summary, we demonstrate that the expression of transcription factors is a defining feature of cell types not only in the retina of mammals but also in the retina of birds. The markers, which we have established, may provide useful tools for more detailed studies on the retinal circuitry of these highly visual animals.

Visual Adaptations in Predatory and Scavenging Diurnal Raptors

Ecological diversity among diurnal birds of prey, or raptors, is highlighted regarding their sensory abilities. While raptors are believed to forage primarily using sight, the sensory demands of scavengers and predators differ, as reflected in their visual systems. Here, I have reviewed the visual specialisations of predatory and scavenging diurnal raptors, focusing on (1) the anatomy of the eye and (2) the use of vision in foraging. Predators have larger eyes than scavengers relative to their body mass, potentially highlighting the higher importance of vision in these species. Scavengers possess one centrally positioned fovea that allows for the detection of carrion at a distance. In addition to the central fovea, predators have a second, temporally positioned fovea that views the frontal visual field, possibly for prey capture. Spatial resolution does not differ between predators and scavengers. In contrast, the organisation of the visual fields reflects important divergences, with enhanced binocularity in predators opposed to an enlarged field of view in scavengers. Predators also have a larger blind spot above the head. The diversity of visual system specializations according to the foraging ecology displayed by these birds suggests a complex interplay between visual anatomy and ecology, often unrelatedly of phylogeny.

Paint it black: Efficacy of increased wind turbine rotor blade visibility to reduce avian fatalities

As wind energy deployment increases and larger wind-power plants are considered, bird fatalities through collision with moving turbine rotor blades are expected to increase. However, few (cost-) effective deterrent or mitigation measures have so far been developed to reduce the risk of collision. Provision of "passive" visual cues may enhance the visibility of the rotor blades enabling birds to take evasive action in due time. Laboratory experiments have indicated that painting one of three rotor blades black minimizes motion smear (Hodos 2003, Minimization of motion smear: Reducing avian collisions with wind turbines). We tested the hypothesis that painting would increase the visibility of the blades, and that this would reduce fatality rates in situ, at the Smøla wind-power plant in Norway, using a Before-After-Control-Impact approach employing fatality searches. The annual fatality rate was significantly reduced at the turbines with a painted blade by over 70%, relative to the neighboring control (i.e., unpainted) turbines. The treatment had the largest effect on reduction of raptor fatalities; no white-tailed eagle carcasses were recorded after painting. Applying contrast painting to the rotor blades significantly reduced the collision risk for a range of birds. Painting the rotor blades at operational turbines was, however, resource demanding given that they had to be painted while in-place. However, if implemented before construction, this cost will be minimized. It is recommended to repeat this experiment at other sites to ensure that the outcomes are generic at various settings.

Fovea-like Photoreceptor Specializations Underlie Single UV Cone Driven Prey-Capture Behavior in Zebrafish

In the eye, the function of same-type photoreceptors must be regionally adjusted to process a highly asymmetrical natural visual world. Here, we show that UV cones in the larval zebrafish area temporalis are specifically tuned for UV-bright prey capture in their upper frontal visual field, which may use the signal from a single cone at a time. For this, UV-photon detection probability is regionally boosted more than 10-fold. Next, in vivo two-photon imaging, transcriptomics, and computational modeling reveal that these cones use an elevated baseline of synaptic calcium to facilitate the encoding of bright objects, which in turn results from expressional tuning of phototransduction genes. Moreover, the light-driven synaptic calcium signal is regionally slowed by interactions with horizontal cells and later accentuated at the level of glutamate release driving retinal networks. These regional differences tally with variations between peripheral and foveal cones in primates and hint at a common mechanistic origin.

Mislocalization of cone nuclei impairs cone function in mice

The nuclei of cone photoreceptors are located on the apical side of the outer nuclear layer (ONL) in vertebrate retinas. However, the functional role of this evolutionarily conserved localization of cone nuclei is unknown. We previously showed that Linkers of the Nucleoskeleton to the Cytoskeleton (LINC complexes) are essential for the apical migration of cone nuclei during development. Here, we developed an efficient genetic strategy to disrupt cone LINC complexes in mice. Experiments with animals from both sexes revealed that disrupting cone LINC complexes resulted in mislocalization of cone nuclei to the basal side of ONL in mouse retina. This, in turn, disrupted cone pedicle morphology, and appeared to reduce the efficiency of synaptic transmission from cones to bipolar cells. Although we did not observe other developmental or phototransduction defects in cones with mislocalized nuclei, their dark adaptation was impaired, consistent with a deficiency in chromophore recycling. These findings demonstrate that the apical localization of cone nuclei in the ONL is required for the timely dark adaptation and efficient synaptic transmission in cone photoreceptors.

Electron microscopy study of the central retinal fovea in Pied flycatcher: evidence of a mechanism of light energy transmission through the retina

We present unique ultrastructural data on avian retinal cells. Presently and earlier (Zueva et al., 2016) we explored distribution of intermediate filaments (IFs) in retinal cells of the Pied flycatcher (Ficedula hypoleuca, Passeriformes, Aves) in the central foveolar zone. This retinal zone only contains single and double cone photoreceptors. Previously we found that continuous IFs span Müller cells (MC) lengthwise from the retinal inner limiting membrane (ILM) layer up to the outer limiting membrane (OLM) layer. Here we describe long cylindrical bundles of IFs (IFBs) inside the cone inner segments (CIS) adjoining the cone plasma membrane, with these IFBs following along the cone lengthwise, and surrounding the cone at equal spacing one from the other. Double cones form a combined unit, wherein they are separated by their respective plasma membranes. Double cones thus have a common external ring of IFBs, surrounding both cone components. In the layer of cilia, the IFBs that continue into the cone outer segment (COS) follow on to the cone apical tip along the direction of incident light, with single IFs separating from the IFB, touching, and sometimes passing in-between the light-sensitive lamellae of the COS. These new data support our previous hypothesis on the quantum mechanism of light energy propagation through the vertebrate retina (Zueva et al., 2016, 2019).

Inter-individual differences in foveal shape in a scavenging raptor, the black kite Milvus migrans

Birds, and especially raptors, are believed to forage mainly using visual cues. Indeed, raptors (scavengers and predators) have the highest visual acuity known to date. However, scavengers and predators differ in their visual systems such as in their foveal configuration. While the function of the foveal shape remains unknown, individual variation has never been quantified in birds. In this study, we examined whether foveal shape differs among individuals in relation to eye size, sex, age, eye (left or right) and genetic proximity in a scavenging raptor, the black kite Milvus migrans. We assessed foveal shape in 47 individuals using spectral domain optical coherence tomography (OCT) and geometric morphometric analysis. We found that foveal depth was significantly related to eye size. While foveal width also increased with eye size, it was strongly related to age; younger individuals had a wider fovea with a more pronounced rim. We found no relationship between foveal shape and genetic proximity, suggesting that foveal shape is not a hereditary trait. Our study revealed that the shape of the fovea is directly linked to eye size and that the physical structure of the fovea may develop during the entire life of black kites.

Spectral-domain optical coherence tomography imaging of normal foveae: A pilot study in 17 diurnal birds of prey

OBJECTIVE

To describe and to establish normative data for the foveae of diurnal birds of prey using spectral-domain optical coherence tomography (SD-OCT).

METHODS

All animals (9 red-tailed hawks, 3 Cooper's hawks, 3 American kestrels, 1 sharp-shinned hawk, and 1 broad-winged hawk) had an ophthalmic examination performed with slit lamp biomicroscopy and indirect ophthalmoscopy. Following ophthalmic examination, SD-OCT was performed in each eye that had a visible fundus and normal fovea on SD-OCT. Temporal foveae depth, central foveae depth, pecten-temporal foveae distance, and pecten-central foveae distance (PCFD) were measured using SD-OCT. Differences in measured outcomes between species were determined using generalized linear mixed effects models.

RESULTS

The central foveae (mean ± SD) displayed a small but significant depth variation between species (P = .002) and was deepest in red-tailed hawks (293 ± 16 µm), followed by American kestrels (260 ± 12 µm), broad-winged hawks (256 ± 16 µm), Cooper's hawks (250 ± 9 µm), and sharp-shinned hawks (239 ± 16 µm). The temporal foveae were shallower than the central foveae in all species tested, and there was a significant variation between species (P < .001). The temporal foveae (mean ± SD) were deepest in American kestrels (137 ± 8 µm), followed by red-tailed hawks (129 ± 3 µm), broad-winged hawks (59.5 ± 3.5 µm), Cooper's hawks (20.3 ± 6.4 µm), and sharp-shinned hawks (17.5 ± 0.7 µm). Pecten-temporal foveae distance was approximately 30% shorter than PCFD in all species. There were no differences in the parameters tested between the eyes within each species (P ≥ .47).

CONCLUSION

Normative foveae SD-OCT data were obtained in four species of diurnal birds of prey. Further studies are warranted to provide structural and functional information regarding normal and pathologic changes that can affect the foveae.

How fast can raptors see?

Birds, and especially raptors, are highly visual animals. Some of them have the highest spatial resolving power known in the animal kingdom, allowing prey detection at distance. While many raptors visually track fast-moving and manoeuvrable prey, requiring high temporal resolution, this aspect of their visual system has never been studied before. In this study, we estimated how fast raptors can see, by measuring the flicker fusion frequency of three species with different lifestyles. We found that flicker fusion frequency differed among species, being at least 129 Hz in the peregrine falcon, Falco peregrinus, 102 Hz in the saker falcon, Falco cherrug, and 81 Hz in the Harris's hawk, Parabuteo unicinctus We suggest a potential link between fast vision and hunting strategy, with high temporal resolution in the fast-flying falcons that chase fast-moving, manoeuvrable prey and a lower resolution in the Harris's hawk, which flies more slowly and targets slower prey.