Predictive saccade in the absence of smooth pursuit: interception of moving targets in the archer fish

A dynamic scale-mixture model of motion in natural scenes

Some of the most important tasks of visual and motor systems involve estimating the motion of objects and tracking them over time. Such systems evolved to meet the behavioral needs of the organism in its natural environment, and may therefore be adapted to the statistics of motion it is likely to encounter. By tracking the movement of individual points in movies of natural scenes, we begin to identify common properties of natural motion across scenes. As expected, objects in natural scenes move in a persistent fashion, with velocity correlations lasting hundreds of milliseconds. More subtly, but crucially, we find that the observed velocity distributions are heavy-tailed and can be modeled as a Gaussian scale-mixture. Extending this model to the time domain leads to a dynamic scale-mixture model, consisting of a Gaussian process multiplied by a positive scalar quantity with its own independent dynamics. Dynamic scaling of velocity arises naturally as a consequence of changes in object distance from the observer, and may approximate the effects of changes in other parameters governing the motion in a given scene. This modeling and estimation framework has implications for the neurobiology of sensory and motor systems, which need to cope with these fluctuations in scale in order to represent motion efficiently and drive fast and accurate tracking behavior.

Humans, fish, spiders and bees inherited working memory and attention from their last common ancestor

All brain processes that generate behaviour, apart from reflexes, operate with information that is in an "activated" state. This activated information, which is known as working memory (WM), is generated by the effect of attentional processes on incoming information or information previously stored in short-term or long-term memory (STM or LTM). Information in WM tends to remain the focus of attention; and WM, attention and STM together enable information to be available to mental processes and the behaviours that follow on from them. WM and attention underpin all flexible mental processes, such as solving problems, making choices, preparing for opportunities or threats that could be nearby, or simply finding the way home. Neither WM nor attention are necessarily conscious, and both may have evolved long before consciousness. WM and attention, with similar properties, are possessed by humans, archerfish, and other vertebrates; jumping spiders, honey bees, and other arthropods; and members of other clades, whose last common ancestor (LCA) is believed to have lived more than 600 million years ago. It has been reported that very similar genes control the development of vertebrate and arthropod brains, and were likely inherited from their LCA. Genes that control brain development are conserved because brains generate adaptive behaviour. However, the neural processes that generate behaviour operate with the activated information in WM, so WM and attention must have existed prior to the evolution of brains. It is proposed that WM and attention are widespread amongst animal species because they are phylogenetically conserved mechanisms that are essential to all mental processing, and were inherited from the LCA of vertebrates, arthropods, and some other animal clades.

Recognition of natural objects in the archerfish

Recognition of individual objects and their categorization is a complex computational task. Nevertheless, visual systems can perform this task in a rapid and accurate manner. Humans and other animals can efficiently recognize objects despite countless variations in their projection on the retina due to different viewing angles, distance, illumination conditions and other parameters. To gain a better understanding of the recognition process in teleosts, we explored it in archerfish, a species that hunts by shooting a jet of water at aerial targets and thus can benefit from ecologically relevant recognition of natural objects. We found that archerfish not only can categorize objects into relevant classes but also can do so for novel objects, and additionally they can recognize an individual object presented under different conditions. To understand the mechanisms underlying this capability, we developed a computational model based on object features and a machine learning classifier. The analysis of the model revealed that a small number of features was sufficient for categorization, and the fish were more sensitive to object contours than textures. We tested these predictions in additional behavioral experiments and validated them. Our findings suggest the existence of a complex visual process in the archerfish visual system that enables object recognition and categorization.

Highlighted Article: Archerfish are capable of natural object recognition and categorization based on a small number of visual features.

The (Under)Use of Eye-Tracking in Evolutionary Ecology

To survive and pass on their genes, animals must perform many tasks that affect their fitness, such as mate-choice, foraging, and predator avoidance. The ability to make rapid decisions is dependent on the information that needs to be sampled from the environment and how it is processed. We highlight the need to consider visual attention within sensory ecology and advocate the use of eye-tracking methods to better understand how animals prioritise the sampling of information from their environments prior to making a goal-directed decision. We consider ways in which eye-tracking can be used to determine how animals work within attentional constraints and how environmental pressures may exploit these limitations.

Predictive Smooth Pursuit Eye Movements

Smooth pursuit eye movements maintain the line of sight on smoothly moving targets. Although often studied as a response to sensory motion, pursuit anticipates changes in motion trajectories, thus reducing harmful consequences due to sensorimotor processing delays. Evidence for predictive pursuit includes (a) anticipatory smooth eye movements (ASEM) in the direction of expected future target motion that can be evoked by perceptual cues or by memory for recent motion, (b) pursuit during periods of target occlusion, and (c) improved accuracy of pursuit with self-generated or biologically realistic target motions. Predictive pursuit has been linked to neural activity in the frontal cortex and in sensory motion areas. As behavioral and neural evidence for predictive pursuit grows and statistically based models augment or replace linear systems approaches, pursuit is being regarded less as a reaction to immediate sensory motion and more as a predictive response, with retinal motion serving as one of a number of contributing cues.

What a predator can teach us about visual processing: a lesson from the archerfish

The archerfish is a predator with highly unusual visually guided behavior. It is most famous for its ability to hunt by shooting water jets at static or dynamic insect prey, up to two meters above the water's surface. In the lab, the archerfish can learn to distinguish and shoot at artificial targets presented on a computer screen, thus enabling well-controlled experiments. In recent years, these capacities have turned the archerfish into a model animal for studying a variety of visual functions, from visual saliency and visual search, through fast visually guided prediction, and all the way to higher level visual processing such as face recognition. Here we review these recent developments and show how they fall into two emerging lines of research on this animal model. The first is ethologically motivated and emphasizes how the natural environment and habitat of the archerfish interact with its visual processing during predation. The second is driven by parallels to the primate brain and aims to determine whether the latter's characteristic visual information processing capacities can also be found in the qualitatively different fish brain, thereby underscoring the functional universality of certain visual processes. We discuss the differences between these two lines of research and possible future directions.

The Brain of the Archerfish Toxotes chatareus: A Nissl-Based Neuroanatomical Atlas and Catecholaminergic/Cholinergic Systems

Over recent years, the seven-spot archerfish (Toxotes chatareus) has emerged as a new model for studies in visual and behavioral neuroscience thanks to its unique hunting strategy. Its natural ability to spit at insects outside of water can be used in the laboratory for well controlled behavioral experiments where the fish is trained to aim at targets on a screen. The need for a documentation of the neuroanatomy of this animal became critical as more research groups use it as a model. Here we present an atlas of adult T. chatareus specimens caught in the wild in South East Asia. The atlas shows representative sections of the brain and specific structures revealed by a classic Nissl staining as well as corresponding schematic drawings. Additional immunostainings for catecholaminergic and cholinergic systems were conducted to corroborate the identification of certain nuclei and the data of a whole brain scanner is available online. We describe the general features of the archerfish brain as well as its specificities, especially for the visual system and compare the neuroanatomy of the archerfish with other teleosts. This atlas of the archerfish brain shows all levels of the neuraxis and intends to provide a solid basis for further neuroscientific research on T. chatareus, in particular electrophysiological studies.

Eye movements in chameleons are not truly independent - evidence from simultaneous monocular tracking of two targets

Chameleons perform large-amplitude eye movements that are frequently referred to as independent, or disconjugate. When prey (an insect) is detected, the chameleon's eyes converge to view it binocularly and 'lock' in their sockets so that subsequent visual tracking is by head movements. However, the extent of the eyes' independence is unclear. For example, can a chameleon visually track two small targets simultaneously and monocularly, i.e. one with each eye? This is of special interest because eye movements in ectotherms and birds are frequently independent, with optic nerves that are fully decussated and intertectal connections that are not as developed as in mammals. Here, we demonstrate that chameleons presented with two small targets moving in opposite directions can perform simultaneous, smooth, monocular, visual tracking. To our knowledge, this is the first demonstration of such a capacity. The fine patterns of the eye movements in monocular tracking were composed of alternating, longer, 'smooth' phases and abrupt 'step' events, similar to smooth pursuits and saccades. Monocular tracking differed significantly from binocular tracking with respect to both 'smooth' phases and 'step' events. We suggest that in chameleons, eye movements are not simply 'independent'. Rather, at the gross level, eye movements are (i) disconjugate during scanning, (ii) conjugate during binocular tracking and (iii) disconjugate, but coordinated, during monocular tracking. At the fine level, eye movements are disconjugate in all cases. These results support the view that in vertebrates, basic monocular control is under a higher level of regulation that dictates the eyes' level of coordination according to context.

A Sensory-Driven Trade-Off between Coordinated Motion in Social Prey and a Predator's Visual Confusion

Social animals are capable of enhancing their awareness by paying attention to their neighbors, and prey found in groups can also confuse their predators. Both sides of these sensory benefits have long been appreciated, yet less is known of how the perception of events from the perspectives of both prey and predator can interact to influence their encounters. Here we examined how a visual sensory mechanism impacts the collective motion of prey and, subsequently, how their resulting movements influenced predator confusion and capture ability. We presented virtual prey to human players in a targeting game and measured the speed and accuracy with which participants caught designated prey. As prey paid more attention to neighbor movements their collective coordination increased, yet increases in prey coordination were positively associated with increases in the speed and accuracy of attacks. However, while attack speed was unaffected by the initial state of the prey, accuracy dropped significantly if the prey were already organized at the start of the attack, rather than in the process of self-organizing. By repeating attack scenarios and masking the targeted prey's neighbors we were able to visually isolate them and conclusively demonstrate how visual confusion impacted capture ability. Delays in capture caused by decreased coordination amongst the prey depended upon the collection motion of neighboring prey, while it was primarily the motion of the targets themselves that determined capture accuracy. Interestingly, while a complete loss of coordination in the prey (e.g., a flash expansion) caused the greatest delay in capture, such behavior had little effect on capture accuracy. Lastly, while increases in collective coordination in prey enhanced personal risk, traveling in coordinated groups was still better than appearing alone. These findings demonstrate a trade-off between the sensory mechanisms that can enhance the collective properties that emerge in social animals and the individual group member's predation risk during an attack.

Concept learning and the use of three common psychophysical paradigms in the archerfish (Toxotes chatareus)

Archerfish are well known for their specialized hunting technique of spitting water at prey located above the water line. This unique ability has made them a popular focus of study as researchers try to understand the mechanisms involved in targeting and spitting. In more recent years, archerfish have also become an increasingly popular model for studying visual discrimination and learning in general. Until now, only the alternative forced-choice (AFC) task has been used with archerfish, however, they may be capable of learning other classical discrimination tasks. As well as providing alternative, and potentially more efficient, means for testing their visual capabilities, these other tasks may also provide deeper insight into the extent to which an organism with no cortex can grasp the concepts underlying these tasks. In this paper, we consider both the matched-to-sample (MTS) and the odd-one-out (OOO) tasks as they require the subject to learn relatively sophisticated concepts rather than a straight, stimulus-reward relationship, of the kind underlying AFC tasks. A variety of line drawings displayed on a monitor were used as stimuli. We first determined if archerfish could complete the MTS and OOO test and then evaluated their ability to be retrained to new stimuli using a 4-AFC test. We found that archerfish were unable to learn the MTS and had only a limited capacity for learning the OOO task. We conclude that the MTS and OOO are impractical as paradigms for behavioral experiments with archerfish. However, the archerfish could rapidly learn to complete an AFC test and select the conditioned stimulus with a high degree of accuracy when faced with four stimuli, making this a powerful test for behavioral studies testing visual discrimination. In addition, the fish were able to learn the concept of oddity under particular training circumstances. This paper adds to the growing evidence that animals without a cortex are capable of learning some higher order concepts.

Visual receptive field properties of cells in the optic tectum of the archer fish

The archer fish is well known for its extreme visual behavior in shooting water jets at prey hanging on vegetation above water. This fish is a promising model in the study of visual system function because it can be trained to respond to artificial targets and thus to provide valuable psychophysical data. Although much behavioral data have indeed been collected over the past two decades, little is known about the functional organization of the main visual area supporting this visual behavior, namely, the fish optic tectum. In this article we focus on a fundamental aspect of this functional organization and provide a detailed analysis of receptive field properties of cells in the archer fish optic tectum. Using extracellular measurements to record activities of single cells, we first measure their retinotectal mapping. We then determine their receptive field properties such as size, selectivity for stimulus direction and orientation, tuning for spatial frequency, and tuning for temporal frequency. Finally, on the basis of all these measurements, we demonstrate that optic tectum cells can be classified into three categories: orientation-tuned cells, direction-tuned cells, and direction-agnostic cells. Our results provide an essential basis for future investigations of information processing in the archer fish visual system.