Principles of Insect Path Integration

Taking a shortcut: what mechanisms do fish use?

Path integration is a powerful navigational mechanism whereby individuals continuously update their distance and angular vector of movement to calculate their position in relation to their departure location, allowing them to return along the most direct route even across unfamiliar terrain. While path integration has been investigated in several terrestrial animals, it has never been demonstrated in aquatic vertebrates, where movement occurs through volumetric space and sensory cues available for navigation are likely to differ substantially from those in terrestrial environments. By performing displacement experiments with Lamprologus ocellatus, we show evidence consistent with fish using path integration to navigate alongside other mechanisms (allothetic place cues and route recapitulation). These results indicate that the use of path integration is likely to be deeply rooted within the vertebrate phylogeny irrespective of the environment, and suggests that fish may possess a spatial encoding system that parallels that of mammals.

Temporal effects of sugar intake on fly local search and honey bee dance behaviour

Honey bees communicate flight navigational information of profitable food to nestmates via their dance, a small-scale walking pattern, inside the nest. Hungry flies and honey bee foragers exhibit a sugar-elicited search involving path integration that bears a resemblance to dance behaviour. This study aimed to investigate the temporal dynamics of the initiation of sugar-elicited search and dance behaviour, using a comparative approach. Passive displacement experiments showed that feeding and the initiation of search could be spatially and temporally dissociated. Sugar intake increased the probability of initiating a search but the actual onset of walking triggers the path integration system to guide the search. When prevented from walking after feeding, flies and bees maintained their motivation for a path integration-based search for a duration of 3 min. In flies, turning and associated characters were significantly reduced during this period but remained higher than in flies without sugar stimulus. These results suggest that sugar elicits two independent behavioural responses: path integration and increased turning, with the initiation and duration of path integration system being temporally restricted. Honey bee dance experiments demonstrated that the motivation of foragers to initiate dance persisted for 15 min, while the number of circuits declined after 3 min following sugar ingestion. Based on these findings, we propose that food intake during foraging increases the probability to initiate locomotor behaviours involving the path integration system in both flies and honey bees, and this ancestral connection might have been co-opted and elaborated during the evolution of dance communication by honey bees.

Evolution of neural circuitry and cognition

Neural circuits govern the interface between the external environment, internal cues and outwardly directed behaviours. To process multiple environmental stimuli and integrate these with internal state requires considerable neural computation. Expansion in neural network size, most readily represented by whole brain size, has historically been linked to behavioural complexity, or the predominance of cognitive behaviours. Yet, it is largely unclear which aspects of circuit variation impact variation in performance. A key question in the field of evolutionary neurobiology is therefore how neural circuits evolve to allow improved behavioural performance or innovation. We discuss this question by first exploring how volumetric changes in brain areas reflect actual neural circuit change. We explore three major axes of neural circuit evolution-replication, restructuring and reconditioning of cells and circuits-and discuss how these could relate to broader phenotypes and behavioural variation. This discussion touches on the relevant uses and limitations of volumetrics, while advocating a more circuit-based view of cognition. We then use this framework to showcase an example from the insect brain, the multi-sensory integration and internal processing that is shared between the mushroom bodies and central complex. We end by identifying future trends in this research area, which promise to advance the field of evolutionary neurobiology.

Q-Learning to navigate turbulence without a map

We consider the problem of olfactory searches in a turbulent environment. We focus on agents that respond solely to odor stimuli, with no access to spatial perception nor prior information about the odor location. We ask whether navigation strategies to a target can be learned robustly within a sequential decision making framework. We develop a reinforcement learning algorithm using a small set of interpretable olfactory states and train it with realistic turbulent odor cues. By introducing a temporal memory, we demonstrate that two salient features of odor traces, discretized in few olfactory states, are sufficient to learn navigation in a realistic odor plume. Performance is dictated by the sparse nature of turbulent plumes. An optimal memory exists which ignores blanks within the plume and activates a recovery strategy outside the plume. We obtain the best performance by letting agents learn their recovery strategy and show that it is mostly casting cross wind, similar to behavior observed in flying insects. The optimal strategy is robust to substantial changes in the odor plumes, suggesting minor parameter tuning may be sufficient to adapt to different environments.

Effect of repetition of vertical and horizontal routes on navigation performance in Australian bull ants

Solitarily foraging ant species differ in their reliance on their two primary navigational systems- path integration and visual learning. Despite many species of Australian bull ants spending most of their foraging time on their foraging tree, little is known about the use of these systems while climbing. "Rewinding" displacements are commonly used to understand navigational system usage, and work by introducing a mismatch between these navigational systems, by displacing foragers after they have run-down their path integration vector. We used rewinding to test the role of path integration on the arboreal and terrestrial navigation of M. midas. We rewound foragers along either the vertical portion, the ground surface portion, or across both portions of their homing trip. Since rewinding involves repeatedly capturing and releasing foragers, we included a nondisplacement, capture-and-release control, in which the path integration vector is unchanged. We found that rewound foragers do not seem to accumulate path integration vector, although a limited effect of vertical rewinding was found, suggesting a potential higher sensitivity while descending the foraging tree. However, the decrease in navigational efficiency due to capture was larger than the vertical rewinding effect, which along with the negative impact of the vertical surface, and an interaction between capture and rewinding, may suggest aversion rather than path integration caused the vertical rewinding response. Together these results add to the evidence that M. midas makes minimal use of path integration while foraging, and the growing evidence that they are capable of quickly learning from aversive stimulus.

Anatomical organization of the cerebrum of the praying mantis Hierodula membranacea

Many predatory animals, such as the praying mantis, use vision for prey detection and capture. Mantises are known in particular for their capability to estimate distances to prey by stereoscopic vision. While the initial visual processing centers have been extensively documented, we lack knowledge on the architecture of central brain regions, pivotal for sensory motor transformation and higher brain functions. To close this gap, we provide a three-dimensional (3D) reconstruction of the central brain of the Asian mantis, Hierodula membranacea. The atlas facilitates in-depth analysis of neuron ramification regions and aides in elucidating potential neuronal pathways. We integrated seven 3D-reconstructed visual interneurons into the atlas. In total, 42 distinct neuropils of the cerebrum were reconstructed based on synapsin-immunolabeled whole-mount brains. Backfills from the antenna and maxillary palps, as well as immunolabeling of γ-aminobutyric acid (GABA) and tyrosine hydroxylase (TH), further substantiate the identification and boundaries of brain areas. The composition and internal organization of the neuropils were compared to the anatomical organization of the brain of the fruit fly (Drosophila melanogaster) and the two available brain atlases of Polyneoptera-the desert locust (Schistocerca gregaria) and the Madeira cockroach (Rhyparobia maderae). This study paves the way for detailed analyses of neuronal circuitry and promotes cross-species brain comparisons. We discuss differences in brain organization between holometabolous and polyneopteran insects. Identification of ramification sites of the visual neurons integrated into the atlas supports previous claims about homologous structures in the optic lobes of flies and mantises.

Directed retreat and navigational mechanisms in trail following Formica obscuripes

Ant species exhibit behavioural commonalities when solving navigational challenges for successful orientation and to reach goal locations. These behaviours rely on a shared toolbox of navigational strategies that guide individuals under an array of motivational contexts. The mechanisms that support these behaviours, however, are tuned to each species' habitat and ecology with some exhibiting unique navigational behaviours. This leads to clear differences in how ant navigators rely on this shared toolbox to reach goals. Species with hybrid foraging structures, which navigate partially upon a pheromone-marked column, express distinct differences in their toolbox, compared to solitary foragers. Here, we explore the navigational abilities of the Western Thatching ant (Formica obscuripes), a hybrid foraging species whose navigational mechanisms have not been studied. We characterise their reliance on both the visual panorama and a path integrator for orientation, with the pheromone's presence acting as a non-directional reassurance cue, promoting continued orientation based on other strategies. This species also displays backtracking behaviour, which occurs with a combination of unfamiliar terrestrial cues and the absence of the pheromone, thus operating based upon a combination of the individual mechanisms observed in solitarily and socially foraging species. We also characterise a new form of goalless orientation in these ants, an initial retreating behaviour that is modulated by the forager's path integration system. The behaviour directs disturbed inbound foragers back along their outbound path for a short distance before recovering and reorienting back to the nest.

Unpacking the navigation toolbox: insights from comparative cognition

The study of navigation is informed by ethological data from many species, laboratory investigation at behavioural and neurobiological levels, and computational modelling. However, the data are often species-specific, making it challenging to develop general models of how biology supports behaviour. Wiener et al. outlined a framework for organizing the results across taxa, called the 'navigation toolbox' (Wiener et al. In Animal thinking: contemporary issues in comparative cognition (eds R Menzel, J Fischer), pp. 51-76). This framework proposes that spatial cognition is a hierarchical process in which sensory inputs at the lowest level are successively combined into ever-more complex representations, culminating in a metric or quasi-metric internal model of the world (cognitive map). Some animals, notably humans, also use symbolic representations to produce an external representation, such as a verbal description, signpost or map that allows communication of spatial information or instructions between individuals. Recently, new discoveries have extended our understanding of how spatial representations are constructed, highlighting that the hierarchical relationships are bidirectional, with higher levels feeding back to influence lower levels. In the light of these new developments, we revisit the navigation toolbox, elaborate it and incorporate new findings. The toolbox provides a common framework within which the results from different taxa can be described and compared, yielding a more detailed, mechanistic and generalized understanding of navigation.

Route retracing: way pointing and multiple vector memories in trail-following ants

Maintaining positional estimates of goal locations is a fundamental task for navigating animals. Diverse animal groups, including both vertebrates and invertebrates, can accomplish this through path integration. During path integration, navigators integrate movement changes, tracking both distance and direction, to generate a spatial estimate of their start location, or global vector, allowing efficient direct return travel without retracing the outbound route. In ants, path integration is accomplished through the coupling of pedometer and celestial compass estimates. Within path integration, it has been theorized navigators may use multiple vector memories for way pointing. However, in many instances, these navigators may instead be homing via view alignment. Here, we present evidence that trail-following ants can attend to segments of their global vector to retrace their non-straight pheromone trails, without the confound of familiar views. Veromessor pergandei foragers navigate to directionally distinct intermediate sites via path integration by orienting along separate legs of their inbound route at unfamiliar locations, indicating these changes are not triggered by familiar external cues, but by vector state. These findings contrast with path integration as a singular memory estimate in ants and underscore the system's ability to way point to intermediate goals along the inbound route via multiple vector memories, akin to trapline foraging in bees visiting multiple flower patches. We discuss how reliance on non-straight pheromone-marked trails may support attending to separate vectors to remain on the pheromone rather than attempting straight-line shortcuts back to the nest.

Land Ho! Polarized light serves as a visual signal for landward orientation in displaced spiders

An organism's ability to identify goals within their environment, orient towards those goals, and successfully navigate to them are critical to all aspects of survival. Long-jawed orb weavers (Tetragnatha elongata) occupy riparian zones and perform orientation behaviors when displaced from this habitat onto the water. Spiders prefer to move toward the closest shoreline, regardless of release location, likely to avoid predation from fish. In this study, we conducted a series of investigations to determine the mechanism by which these spiders rapidly achieve zonal recovery. Occlusion experiments indicate that spiders use visual information to identify characteristics of the riparian habitat and navigate to shelter. While environmental characteristics such as color, contrast, and the sun's position do not appear to factor into this orientation behavior, the polarization of light appears critical. We propose that the polarization of light reflecting off the water's surface acts as a water detector and the absence of such at the edges of the pond (or via experimental induction) serves as a visual reference for the closest suitable habitat.

Emergent spatial goals in an integrative model of the insect central complex

The insect central complex appears to encode and process spatial information through vector manipulation. Here, we draw on recent insights into circuit structure to fuse previous models of sensory-guided navigation, path integration and vector memory. Specifically, we propose that the allocentric encoding of location provided by path integration creates a spatially stable anchor for converging sensory signals that is relevant in multiple behavioural contexts. The allocentric reference frame given by path integration transforms a goal direction into a goal location and we demonstrate through modelling that it can enhance approach of a sensory target in noisy, cluttered environments or with temporally sparse stimuli. We further show the same circuit can improve performance in the more complex navigational task of route following. The model suggests specific functional roles for circuit elements of the central complex that helps explain their high preservation across insect species.

Fine-grained descending control of steering in walking Drosophila

Locomotion involves rhythmic limb movement patterns that originate in circuits outside the brain. Purposeful locomotion requires descending commands from the brain, but we do not understand how these commands are structured. Here we investigate this issue, focusing on the control of steering in walking Drosophila. First, we describe different limb "gestures" associated with different steering maneuvers. Next, we identify a set of descending neurons whose activity predicts steering. Focusing on two descending cell types downstream from distinct brain networks, we show that they evoke specific limb gestures: one lengthens strides on the outside of a turn, while the other attenuates strides on the inside of a turn. Notably, a single descending neuron can have opposite effects during different locomotor rhythm phases, and we identify networks positioned to implement this phase-specific gating. Together, our results show how purposeful locomotion emerges from brain cells that drive specific, coordinated modulations of low-level patterns.

Stem cell-specific ecdysone signaling regulates the development and function of a Drosophila sleep homeostat

Complex behaviors arise from neural circuits that are assembled from diverse cell types. Sleep is a conserved and essential behavior, yet little is known regarding how the nervous system generates neuron types of the sleep-wake circuit. Here, we focus on the specification of Drosophila sleep-promoting neurons-long-field tangential input neurons that project to the dorsal layers of the fan-shaped body neuropil in the central complex (CX). We use lineage analysis and genetic birth dating to identify two bilateral Type II neural stem cells that generate these dorsal fan-shaped body (dFB) neurons. We show that adult dFB neurons express Ecdysone-induced protein E93, and loss of Ecdysone signaling or E93 in Type II NSCs results in the misspecification of the adult dFB neurons. Finally, we show that E93 knockdown in Type II NSCs affects adult sleep behavior. Our results provide insight into how extrinsic hormonal signaling acts on NSCs to generate neuronal diversity required for adult sleep behavior. These findings suggest that some adult sleep disorders might derive from defects in stem cell-specific temporal neurodevelopmental programs.

Neural representation of goal direction in the monarch butterfly brain

Neural processing of a desired moving direction requires the continuous comparison between the current heading and the goal direction. While the neural basis underlying the current heading is well-studied, the coding of the goal direction remains unclear in insects. Here, we used tetrode recordings in tethered flying monarch butterflies to unravel how a goal direction is represented in the insect brain. While recording, the butterflies maintained robust goal directions relative to a virtual sun. By resetting their goal directions, we found neurons whose spatial tuning was tightly linked to the goal directions. Importantly, their tuning was unaffected when the butterflies changed their heading after compass perturbations, showing that these neurons specifically encode the goal direction. Overall, we here discovered invertebrate goal-direction neurons that share functional similarities to goal-direction cells reported in mammals. Our results give insights into the evolutionarily conserved principles of goal-directed spatial orientation in animals.

Food-caching mountain chickadees can learn abstract rules to solve a complex spatial-temporal pattern

The use of abstract rules in behavioral decisions is considered evidence of executive functions associated with higher-level cognition. Laboratory studies across taxa have shown that animals may be capable of learning abstract concepts, such as the relationships between items, but often use simpler cognitive abilities to solve tasks. Little is known about whether or how animals learn and use abstract rules in natural environments. Here, we tested whether wild, food-caching mountain chickadees (Poecile gambeli) could learn an abstract rule in a spatial-temporal task in which the location of a food reward rotated daily around an 8-feeder square spatial array for up to 34 days. Chickadees initially searched for the daily food reward by visiting the most recently rewarding locations and then moving backward to visit previously rewarding feeders, using memory of previous locations. But by the end of the task, chickadees were more likely to search forward in the correct direction of rotation, moving away from the previously rewarding feeders. These results suggest that chickadees learned the direction rule for daily feeder rotation and used this to guide their decisions while searching for a food reward. Thus, chickadees appear to use an executive function to make decisions on a foraging-based task in the wild. VIDEO ABSTRACT.

Circuits for self-motion estimation and walking control in Drosophila

The brain's evolution and operation are inextricably linked to animal movement, and critical functions, such as motor control, spatial perception, and navigation, rely on precise knowledge of body movement. Such internal estimates of self-motion emerge from the integration of mechanosensory and visual feedback with motor-related signals. Thus, this internal representation likely depends on the activity of circuits distributed across the central nervous system. However, the circuits responsible for self-motion estimation, and the exact mechanisms by which motor-sensory coordination occurs within these circuits remain poorly understood. Recent technological advances have positioned Drosophila melanogaster as an advantageous model for investigating the emergence, maintenance, and utilization of self-motion representations during naturalistic walking behaviors. In this review, I will illustrate how the adult fly is providing insights into the fundamental problems of self-motion computations and walking control, which have relevance for all animals.

An insect-inspired model facilitating autonomous navigation by incorporating goal approaching and collision avoidance

Being one of the most fundamental and crucial capacity of robots and animals, autonomous navigation that consists of goal approaching and collision avoidance enables completion of various tasks while traversing different environments. In light of the impressive navigational abilities of insects despite their tiny brains compared to mammals, the idea of seeking solutions from insects for the two key problems of navigation, i.e., goal approaching and collision avoidance, has fascinated researchers and engineers for many years. However, previous bio-inspired studies have focused on merely one of these two problems at one time. Insect-inspired navigation algorithms that synthetically incorporate both goal approaching and collision avoidance, and studies that investigate the interactions of these two mechanisms in the context of sensory-motor closed-loop autonomous navigation are lacking. To fill this gap, we propose an insect-inspired autonomous navigation algorithm to integrate the goal approaching mechanism as the global working memory inspired by the sweat bee's path integration (PI) mechanism, and the collision avoidance model as the local immediate cue built upon the locust's lobula giant movement detector (LGMD) model. The presented algorithm is utilized to drive agents to complete navigation task in a sensory-motor closed-loop manner within a bounded static or dynamic environment. Simulation results demonstrate that the synthetic algorithm is capable of guiding the agent to complete challenging navigation tasks in a robust and efficient way. This study takes the first tentative step to integrate the insect-like navigation mechanisms with different functionalities (i.e., global goal and local interrupt) into a coordinated control system that future research avenues could build upon.

Animal homing: Ants build their own landmarks when they need them

Visual landmarks are extremely useful for successful navigation in many species, including ants. So much so that a new study shows that desert ants actually build their own landmarks when they need them.

Neural Networks for Navigation: From Connections to Computations

Many animals can navigate toward a goal they cannot see based on an internal representation of that goal in the brain's spatial maps. These maps are organized around networks with stable fixed-point dynamics (attractors), anchored to landmarks, and reciprocally connected to motor control. This review summarizes recent progress in understanding these networks, focusing on studies in arthropods. One factor driving recent progress is the availability of the Drosophila connectome; however, it is increasingly clear that navigation depends on ongoing synaptic plasticity in these networks. Functional synapses appear to be continually reselected from the set of anatomical potential synapses based on the interaction of Hebbian learning rules, sensory feedback, attractor dynamics, and neuromodulation. This can explain how the brain's maps of space are rapidly updated; it may also explain how the brain can initialize goals as stable fixed points for navigation.

The potential underlying mechanisms during learning flights

Hymenopterans, such as bees and wasps, have long fascinated researchers with their sinuous movements at novel locations. These movements, such as loops, arcs, or zigzags, serve to help insects learn their surroundings at important locations. They also allow the insects to explore and orient themselves in their environment. After they gained experience with their environment, the insects fly along optimized paths guided by several guidance strategies, such as path integration, local homing, and route-following, forming a navigational toolkit. Whereas the experienced insects combine these strategies efficiently, the naive insects need to learn about their surroundings and tune the navigational toolkit. We will see that the structure of the movements performed during the learning flights leverages the robustness of certain strategies within a given scale to tune other strategies which are more efficient at a larger scale. Thus, an insect can explore its environment incrementally without risking not finding back essential locations.

Scanning behaviour in ants: an interplay between random-rate processes and oscillators

At the start of a journey home or to a foraging site, ants often stop, interrupting their forward movement, turn on the spot a number of times, and fixate in different directions. These scanning bouts are thought to provide visual information for choosing a path to travel. The temporal organization of such scanning bouts has implications about the neural organisation of navigational behaviour. We examined (1) the temporal distribution of the start of such scanning bouts and (2) the dynamics of saccadic body turns and fixations that compose a scanning bout in Australian desert ants, Melophorus bagoti, as they came out of a walled channel onto open field at the start of their homeward journey. Ants were caught when they neared their nest and displaced to different locations to start their journey home again. The observed parameters were mostly similar across familiar and unfamiliar locations. The turning angles of saccadic body turning to the right or left showed some stereotypy, with a peak just under 45°. The direction of such saccades appears to be determined by a slow oscillatory process as described in other insect species. In timing, however, both the distribution of inter-scanning-bout intervals and individual fixation durations showed exponential characteristics, the signature for a random-rate or Poisson process. Neurobiologically, therefore, there must be some process that switches behaviour (starting a scanning bout or ending a fixation) with equal probability at every moment in time. We discuss how chance events in the ant brain that occasionally reach a threshold for triggering such behaviours can generate the results.

Bayesian inference in ring attractor networks

Working memories are thought to be held in attractor networks in the brain. These attractors should keep track of the uncertainty associated with each memory, so as to weigh it properly against conflicting new evidence. However, conventional attractors do not represent uncertainty. Here, we show how uncertainty could be incorporated into an attractor, specifically a ring attractor that encodes head direction. First, we introduce a rigorous normative framework (the circular Kalman filter) for benchmarking the performance of a ring attractor under conditions of uncertainty. Next, we show that the recurrent connections within a conventional ring attractor can be retuned to match this benchmark. This allows the amplitude of network activity to grow in response to confirmatory evidence, while shrinking in response to poor-quality or strongly conflicting evidence. This "Bayesian ring attractor" performs near-optimal angular path integration and evidence accumulation. Indeed, we show that a Bayesian ring attractor is consistently more accurate than a conventional ring attractor. Moreover, near-optimal performance can be achieved without exact tuning of the network connections. Finally, we use large-scale connectome data to show that the network can achieve near-optimal performance even after we incorporate biological constraints. Our work demonstrates how attractors can implement a dynamic Bayesian inference algorithm in a biologically plausible manner, and it makes testable predictions with direct relevance to the head direction system as well as any neural system that tracks direction, orientation, or periodic rhythms.

Comparative biology of spatial navigation in three arachnid orders (Amblypygi, Araneae, and Scorpiones)

From both comparative biology and translational research perspectives, there is escalating interest in understanding how animals navigate their environments. Considerable work is being directed towards understanding the sensory transduction and neural processing of environmental stimuli that guide animals to, for example, food and shelter. While much has been learned about the spatial orientation behavior, sensory cues, and neurophysiology of champion navigators such as bees and ants, many other, often overlooked animal species possess extraordinary sensory and spatial capabilities that can broaden our understanding of the behavioral and neural mechanisms of animal navigation. For example, arachnids are predators that often return to retreats after hunting excursions. Many of these arachnid central-place foragers are large and highly conducive to scientific investigation. In this review we highlight research on three orders within the Class Arachnida: Amblypygi (whip spiders), Araneae (spiders), and Scorpiones (scorpions). For each, we describe (I) their natural history and spatial navigation, (II) how they sense the world, (III) what information they use to navigate, and (IV) how they process information for navigation. We discuss similarities and differences among the groups and highlight potential avenues for future research.

An intrinsic oscillator underlies visual navigation in ants

Many insects display lateral oscillations while moving, but how these oscillations are produced and participate in visual navigation remains unclear. Here, we show that visually navigating ants continuously display regular lateral oscillations coupled with variations of forward speed that strongly optimize the distance covered while simultaneously enabling them to scan left and right directions. This pattern of movement is produced endogenously and conserved across navigational contexts in two phylogenetically distant ant species. Moreover, the oscillations' amplitude can be modulated by both innate or learnt visual cues to adjust the exploration/exploitation balance to the current need. This lower-level motor pattern thus drastically reduces the degree of freedom needed for higher-level strategies to control behavior. The observed dynamical signature readily emerges from a simple neural circuit model of the insect's conserved pre-motor area known as the lateral accessory lobe, offering a surprisingly simple but effective neural control and endorsing oscillation as a core, ancestral way of moving in insects.

Optic flow based spatial vision in insects

The optic flow, i.e., the displacement of retinal images of objects in the environment induced by self-motion, is an important source of spatial information, especially for fast-flying insects. Spatial information over a wide range of distances, from the animal's immediate surroundings over several hundred metres to kilometres, is necessary for mediating behaviours, such as landing manoeuvres, collision avoidance in spatially complex environments, learning environmental object constellations and path integration in spatial navigation. To facilitate the processing of spatial information, the complexity of the optic flow is often reduced by active vision strategies. These result in translations and rotations being largely separated by a saccadic flight and gaze mode. Only the translational components of the optic flow contain spatial information. In the first step of optic flow processing, an array of local motion detectors provides a retinotopic spatial proximity map of the environment. This local motion information is then processed in parallel neural pathways in a task-specific manner and used to control the different components of spatial behaviour. A particular challenge here is that the distance information extracted from the optic flow does not represent the distances unambiguously, but these are scaled by the animal's speed of locomotion. Possible ways of coping with this ambiguity are discussed.

From representations to servomechanisms to oscillators: my journey in the study of cognition

The study of comparative cognition bloomed in the 1970s and 1980s with a focus on representations in the heads of animals that undergird what animals can achieve. Even in action-packed domains such as navigation and spatial cognition, a focus on representations prevailed. In the 1990s, I suggested a conception of navigation in terms of navigational servomechanisms. A servomechanism can be said to aim for a goal, with deviations from the goal-directed path registering as an error. The error drives action to reduce the error in a negative-feedback loop. This loop, with the action reducing the very signal that drove action in the first place, is key to defining a servomechanism. Even though actions are crucial components of servomechanisms, my focus was on the representational component that encodes signals and evaluates errors. Recently, I modified and amplified this view in claiming that, in navigation, servomechanisms operate by modulating the performance of oscillators, endogenous units that produce periodic action. The pattern is found from bacteria travelling micrometres to sea turtles travelling thousands of kilometres. This pattern of servomechanisms working with oscillators is found in other realms of cognition and of life. I think that oscillators provide an effective way to organise an organism's own activities while servomechanisms provide an effective means to adjust to the organism's environment, including that of its own body.

Varieties of visual navigation in insects

The behaviours and cognitive mechanisms animals use to orient, navigate, and remember spatial locations exemplify how cognitive abilities have evolved to suit a number of different mobile lifestyles and habitats. While spatial cognition observed in vertebrates has been well characterised in recent decades, of no less interest are the great strides that have also been made in characterizing and understanding the behavioural and cognitive basis of orientation and navigation in invertebrate models and in particular insects. Insects are known to exhibit remarkable spatial cognitive abilities and are able to successfully migrate over long distances or pinpoint known locations relying on multiple navigational strategies similar to those found in vertebrate models-all while operating under the constraint of relatively limited neural architectures. Insect orientation and navigation systems are often tailored to each species' ecology, yet common mechanistic principles can be observed repeatedly. Of these, reliance on visual cues is observed across a wide number of insect groups. In this review, we characterise some of the behavioural strategies used by insects to solve navigational problems, including orientation over short-distances, migratory heading maintenance over long distances, and homing behaviours to known locations. We describe behavioural research using examples from a few well-studied insect species to illustrate how visual cues are used in navigation and how they interact with non-visual cues and strategies.

Integration of optic flow into the sky compass network in the brain of the desert locust

Flexible orientation through any environment requires a sense of current relative heading that is updated based on self-motion. Global external cues originating from the sky or the earth's magnetic field and local cues provide a reference frame for the sense of direction. Locally, optic flow may inform about turning maneuvers, travel speed and covered distance. The central complex in the insect brain is associated with orientation behavior and largely acts as a navigation center. Visual information from global celestial cues and local landmarks are integrated in the central complex to form an internal representation of current heading. However, it is less clear how optic flow is integrated into the central-complex network. We recorded intracellularly from neurons in the locust central complex while presenting lateral grating patterns that simulated translational and rotational motion to identify these sites of integration. Certain types of central-complex neurons were sensitive to optic-flow stimulation independent of the type and direction of simulated motion. Columnar neurons innervating the noduli, paired central-complex substructures, were tuned to the direction of simulated horizontal turns. Modeling the connectivity of these neurons with a system of proposed compass neurons can account for rotation-direction specific shifts in the activity profile in the central complex corresponding to turn direction. Our model is similar but not identical to the mechanisms proposed for angular velocity integration in the navigation compass of the fly Drosophila.

Behavioral algorithms and neural mechanisms underlying odor-modulated locomotion in insects

Odors released from mates and resources such as a host and food are often the first sensory signals that an animal can detect. Changes in locomotion in response to odors are an important mechanism by which animals access resources important to their survival. Odor-modulated changes in locomotion in insects constitute a whole suite of flexible behaviors that allow insects to close in on these resources from long distances and perform local searches to locate and subsequently assess them. Here, we review changes in odor-mediated locomotion across many insect species. We emphasize that changes in locomotion induced by odors are diverse. In particular, the olfactory stimulus is sporadic at long distances and becomes more continuous at short distances. This distance-dependent change in temporal profile produces a corresponding change in an insect's locomotory strategy. We also discuss the neural circuits underlying odor modulation of locomotion.

The role of the parahippocampal cortex in landmark-based distance estimation based on the contextual hypothesis

Parahippocampal cortex (PHC) is a vital neural bases in spatial navigation. However, its functional role is still unclear. "Contextual hypothesis," which assumes that the PHC participates in processing the spatial association between the landmark and destination, provides a potential answer to the question. Nevertheless, the hypothesis was previously tested using the picture categorization task, which is indirectly related to spatial navigation. By now, study is still needed for testing the hypothesis with a navigation-related paradigm. In the current study, we tested the hypothesis by an fMRI experiment in which participants performed a distance estimation task in a virtual environment under three different conditions: landmark free (LF), stable landmark (SL), and ambiguous landmark (AL). By analyzing the behavioral data, we found that the presence of an SL improved the participants' performance in distance estimation. Comparing the brain activity in SL-versus-LF contrast as well as AL-versus-LF contrast, we found that the PHC was activated by the SL rather than by AL when encoding the distance. This indicates that the PHC is elicited by strongly associated context and encodes the landmark reference for distance perception. Furthermore, accessing the representational similarity with the activity of the PHC across conditions, we observed a high similarity within the same condition but low similarity between conditions. This result indicated that the PHC sustains the contextual information for discriminating between scenes. Our findings provided insights into the neural correlates of the landmark information processing from the perspective of contextual hypothesis.

No Need for Landmarks: An Embodied Neural Controller for Robust Insect-Like Navigation Behaviors

Bayesian filters have been considered to help refine and develop theoretical views on spatial cell functions for self-localization. However, extending a Bayesian filter to reproduce insect-like navigation behaviors (e.g., home searching) remains an open and challenging problem. To address this problem, we propose an embodied neural controller for self-localization, foraging, backward homing (BH), and home searching of an advanced mobility sensor (AMOS)-driven insect-like robot. The controller, comprising a navigation module for the Bayesian self-localization and goal-directed control of AMOS and a locomotion module for coordinating the 18 joints of AMOS, leads to its robust insect-like navigation behaviors. As a result, the proposed controller enables AMOS to perform robust foraging, BH, and home searching against various levels of sensory noise, compared to conventional controllers. Its implementation relies only on self-localization and heading perception, rather than global positioning and landmark guidance. Interestingly, the proposed controller makes AMOS achieve spiral searching patterns comparable to those performed by real insects. We also demonstrated the performance of the controller for real-time indoor and outdoor navigation in a real insect-like robot without any landmark and cognitive map.

Sensory Evidence Accumulation Using Optic Flow in a Naturalistic Navigation Task

Sensory evidence accumulation is considered a hallmark of decision-making in noisy environments. Integration of sensory inputs has been traditionally studied using passive stimuli, segregating perception from action. Lessons learned from this approach, however, may not generalize to ethological behaviors like navigation, where there is an active interplay between perception and action. We designed a sensory-based sequential decision task in virtual reality in which humans and monkeys navigated to a memorized location by integrating optic flow generated by their own joystick movements. A major challenge in such closed-loop tasks is that subjects' actions will determine future sensory input, causing ambiguity about whether they rely on sensory input rather than expectations based solely on a learned model of the dynamics. To test whether subjects integrated optic flow over time, we used three independent experimental manipulations, unpredictable optic flow perturbations, which pushed subjects off their trajectory; gain manipulation of the joystick controller, which changed the consequences of actions; and manipulation of the optic flow density, which changed the information borne by sensory evidence. Our results suggest that both macaques (male) and humans (female/male) relied heavily on optic flow, thereby demonstrating a critical role for sensory evidence accumulation during naturalistic action-perception closed-loop tasks.SIGNIFICANCE STATEMENT The temporal integration of evidence is a fundamental component of mammalian intelligence. Yet, it has traditionally been studied using experimental paradigms that fail to capture the closed-loop interaction between actions and sensations inherent in real-world continuous behaviors. These conventional paradigms use binary decision tasks and passive stimuli with statistics that remain stationary over time. Instead, we developed a naturalistic visuomotor visual navigation paradigm that mimics the causal structure of real-world sensorimotor interactions and probed the extent to which participants integrate sensory evidence by adding task manipulations that reveal complementary aspects of the computation.

Long walk home: Magellanic penguins have strategies that lead them to areas where they can navigate most efficiently

Understanding how animals move in dense environments where vision is compromised is a major challenge. We used GPS and dead-reckoning to examine the movement of Magellanic penguins commuting through vegetation that precluded long-distance vision. Birds leaving the nest followed the shortest, quickest route to the sea (the 'ideal path', or 'I-path') but return tracks depended where the birds left the water. Penguins arriving at the beach departure spot mirrored the departure. Most of those landing at a distance from the departure spot travelled slowly, obliquely to the coast at a more acute angle than a beeline trajectory to the nest. On crossing their I-path, these birds then followed this route quickly to their nests. This movement strategy saves birds distance, time and energy compared to a route along the beach and the into the colony on the I-track and saves time and energy compared to a beeline trajectory which necessitates slow travel in unfamiliar areas. This suggests that some animals adopt tactics that take them to an area where their navigational capacities are enhanced for efficient travel in challenging environments.

Life in 2.5D: Animal Movement in the Trees

The complex, interconnected, and non-contiguous nature of canopy environments present unique cognitive, locomotor, and sensory challenges to their animal inhabitants. Animal movement through forest canopies is constrained; unlike most aquatic or aerial habitats, the three-dimensional space of a forest canopy is not fully realized or available to the animals within it. Determining how the unique constraints of arboreal habitats shape the ecology and evolution of canopy-dwelling animals is key to fully understanding forest ecosystems. With emerging technologies, there is now the opportunity to quantify and map tree connectivity, and to embed the fine-scale horizontal and vertical position of moving animals into these networks of branching pathways. Integrating detailed multi-dimensional habitat structure and animal movement data will enable us to see the world from the perspective of an arboreal animal. This synthesis will shed light on fundamental aspects of arboreal animals’ cognition and ecology, including how they navigate landscapes of risk and reward and weigh energetic trade-offs, as well as how their environment shapes their spatial cognition and their social dynamics.

Evidence of learning walks related to scorpion home burrow navigation

The navigation by chemo-textural familiarity hypothesis (NCFH) suggests that scorpions use their midventral pectines to gather chemical and textural information near their burrows and use this information as they subsequently return home. For NCFH to be viable, animals must somehow acquire home-directed ‘tastes’ of the substrate, such as through path integration (PI) and/or learning walks. We conducted laboratory behavioral trials using desert grassland scorpions (Paruroctonus utahensis). Animals reliably formed burrows in small mounds of sand we provided in the middle of circular, sand-lined behavioral arenas. We processed overnight infrared video recordings with a MATLAB script that tracked animal movements at 1–2 s intervals. In all, we analyzed the movements of 23 animals, representing nearly 1500 h of video recording. We found that once animals established their home burrows, they immediately made one to several short, looping excursions away from and back to their burrows before walking greater distances. We also observed similar excursions when animals made burrows in level sand in the middle of the arena (i.e. no mound provided). These putative learning walks, together with recently reported PI in scorpions, may provide the crucial home-directed information requisite for NCFH.

Highlighted Article: Evidence that sand scorpions perform looping walks immediately after establishing a burrow and the possible significance of these putative learning walks in terms of scorpion navigation.

Online learning for orientation estimation during translation in an insect ring attractor network

Insect neural systems are a promising source of inspiration for new navigation algorithms, especially on low size, weight, and power platforms. There have been unprecedented recent neuroscience breakthroughs with Drosophila in behavioral and neural imaging experiments as well as the mapping of detailed connectivity of neural structures. General mechanisms for learning orientation in the central complex (CX) of Drosophila have been investigated previously; however, it is unclear how these underlying mechanisms extend to cases where there is translation through an environment (beyond only rotation), which is critical for navigation in robotic systems. Here, we develop a CX neural connectivity-constrained model that performs sensor fusion, as well as unsupervised learning of visual features for path integration; we demonstrate the viability of this circuit for use in robotic systems in simulated and physical environments. Furthermore, we propose a theoretical understanding of how distributed online unsupervised network weight modification can be leveraged for learning in a trajectory through an environment by minimizing orientation estimation error. Overall, our results may enable a new class of CX-derived low power robotic navigation algorithms and lead to testable predictions to inform future neuroscience experiments.

Stimulus-dependent orientation strategies in monarch butterflies

Insects are well-known for their ability to keep track of their heading direction based on a combination of skylight cues and visual landmarks. This allows them to navigate back to their nest, disperse throughout unfamiliar environments, as well as migrate over large distances between their breeding and non-breeding habitats. The monarch butterfly (Danaus plexippus) for instance is known for its annual southward migration from North America to certain trees in Central Mexico. To maintain a constant flight route, these butterflies use a time-compensated sun compass for orientation which is processed in a region in the brain, termed the central complex. However, to successfully complete their journey, the butterflies’ brain must generate a multitude of orientation strategies, allowing them to dynamically switch from sun-compass orientation to a tactic behavior toward a certain target. To study if monarch butterflies exhibit different orientation modes and if they can switch between them, we observed the orientation behavior of tethered flying butterflies in a flight simulator while presenting different visual cues to them. We found that the butterflies’ behavior depended on the presented visual stimulus. Thus, while a dark stripe was used for flight stabilization, a bright stripe was fixated by the butterflies in their frontal visual field. If we replaced a bright stripe by a simulated sun stimulus, the butterflies switched their behavior and exhibited compass orientation. Taken together, our data show that monarch butterflies rely on and switch between different orientation modes, allowing the animal to adjust orientation to its actual behavioral demands.

Projection Filtering with Observed State Increments with Applications in Continuous-Time Circular Filtering

Angular path integration is the ability of a system to estimate its own heading direction from potentially noisy angular velocity (or increment) observations. Non-probabilistic algorithms for angular path integration, which rely on a summation of these noisy increments, do not appropriately take into account the reliability of such observations, which is essential for appropriately weighing one's current heading direction estimate against incoming information. In a probabilistic setting, angular path integration can be formulated as a continuous-time nonlinear filtering problem (circular filtering) with observed state increments. The circular symmetry of heading direction makes this inference task inherently nonlinear, thereby precluding the use of popular inference algorithms such as Kalman filters, rendering the problem analytically inaccessible. Here, we derive an approximate solution to circular continuous-time filtering, which integrates state increment observations while maintaining a fixed representation through both state propagation and observational updates. Specifically, we extend the established projection-filtering method to account for observed state increments and apply this framework to the circular filtering problem. We further propose a generative model for continuous-time angular-valued direct observations of the hidden state, which we integrate seamlessly into the projection filter. Applying the resulting scheme to a model of probabilistic angular path integration, we derive an algorithm for circular filtering, which we term the circular Kalman filter. Importantly, this algorithm is analytically accessible, interpretable, and outperforms an alternative filter based on a Gaussian approximation.

What view information is most important in the homeward navigation of an Australian bull ant, Myrmecia midas?

Many insects orient by comparing current panoramic views of their environment to memorised views. We tested the navigational abilities of night-active Myrmecia midas foragers while we blocked segments of their visual panorama. Foragers failed to orient homewards when the front view, lower elevations, entire terrestrial surround, or the full panorama was blocked. Initial scanning increased whenever the visual panorama was blocked but scanning only increased along the rest of the route when the front, back, higher, or lower elevations were blocked. Ants meandered more when the front, the back, or the higher elevations were obscured. When everything except the canopy was blocked, the ants were quick and direct, but moved in random directions, as if to escape. We conclude that a clear front view, or a clear lower panorama is necessary for initial homeward headings. Furthermore, the canopy is neither necessary nor sufficient for homeward initial heading, and the back and upper segments of views, while not necessary, do make finding home easier. Discrepancies between image analysis and ant behaviour when the upper and lower views were blocked suggests that ants are selective in what portions of the scene they attend to or learn.

Neuroecology beyond the brain: learning in Echinodermata

We propose an expansion of neuroecological comparisons to include the capabilities of brainless and non-neural organisms. We begin this enterprise by conducting a systematic search for studies on learning in echinoderms. Echinodermata are marine invertebrates comprising starfish, brittle stars, sea cucumbers, sea urchins, and sea lilies. Animals in this phylum lack any centralized brain and instead possess diffuse neural networks known as nerve nets. The learning abilities of these animals are of particular interest as, within the bilaterian clade, they are close evolutionary neighbors to chordates, a phylum whose members exhibit complex feats in learning and contain highly specialized brains. The learning capacities and limitations of echinoderms can inform the evolution of nervous systems and learning in Bilateria. We find evidence of both non-associative and associative learning (in the form of classical conditioning) in echinoderms, which was primarily focused on starfish. Additional evidence of learning is documented in brittle stars, sand dollars, and sea urchins. We then discuss the evolutionary significance of learning capabilities without a brain, the presence of embodied cognition across multiple groups, and compare the learning present in echinoderms with the impressive cognitive abilities documented in the oldest linage group within vertebrates (the major group within the phylum of chordates), fish.

Cold-induced anesthesia impairs path integration memory in dung beetles

Path integration is a general mechanism used by many animals to maintain an updated record of their position in relation to a set reference point.^1-11 To do this, they continually integrate direction and distance information into a memorized home vector. What remains unclear is how this vector is stored, maintained, and utilized for successful navigation. A recent computational model based on the neuronal circuitry of the insect central complex suggests that home vector memories are encoded across a set of putative memory neurons and maintained through ongoing recurrent neural activity.¹² To better understand the nature of the home vector memory and experimentally assess underlying mechanisms for maintaining it, we performed a series of experiments on the path integrating dung beetle Scarabaeus galenus.¹³ We found that, while the directional component of the home vector was maintained for up to 1 h, the distance component of the vector memory decreased gradually over time. Using cold-induced anesthesia, we disrupted the neural activity of beetles that had stored a home vector of known length and direction. This treatment diminished both components of the home vector memory, but by different amounts-the homing beetles lost their distance memory before their directional memory. Together, these findings present new insights into the functional properties of home vector memories and provide the first empirical evidence that a biological process that can be disrupted by cold-induced anesthesia is essential to support homing by path integration.

Anesthesia disrupts distance, but not direction, of path integration memory

Solitary foraging insects, such as ants, maintain an estimate of the direction and distance to their starting location as they move away from it, in a process known as path integration. This estimate, commonly known as the "home vector," is updated continuously as the ant moves^1-4 and is reset as soon as it enters its nest,⁵ yet ants prevented from returning to their nest can still use their home vector when released several hours later.^6,7 This conjunction of fast update and long persistence of the home vector memory does not directly map to existing accounts of short-, mid-, and long-term memory;^2,8-12 hence, the substrate of this memory remains unknown. Chill-coma anesthesia^13-15 has previously been shown to affect associative memory retention in fruit flies^14,16 and honeybees.^9,17,18 We investigate the nature of path integration memory by anesthetizing ants after they have accumulated home vector information and testing if the memory persists on recovery. We show that after anesthesia the memory of the distance ants have traveled is degraded, but the memory of the direction is retained. We also show that this is consistent with models of path integration that maintain the memory in a redundant Cartesian coordinate system and with the hypothesis that chill-coma produces a proportional reduction of the memory, rather than a subtractive reduction or increase of noise. The observed effect is not compatible with a memory based on recurrent circuit activity and points toward an activity-dependent molecular process as the basis of path integration memory.

A connectome of the Drosophila central complex reveals network motifs suitable for flexible navigation and context-dependent action selection

Flexible behaviors over long timescales are thought to engage recurrent neural networks in deep brain regions, which are experimentally challenging to study. In insects, recurrent circuit dynamics in a brain region called the central complex (CX) enable directed locomotion, sleep, and context- and experience-dependent spatial navigation. We describe the first complete electron-microscopy-based connectome of the Drosophila CX, including all its neurons and circuits at synaptic resolution. We identified new CX neuron types, novel sensory and motor pathways, and network motifs that likely enable the CX to extract the fly's head-direction, maintain it with attractor dynamics, and combine it with other sensorimotor information to perform vector-based navigational computations. We also identified numerous pathways that may facilitate the selection of CX-driven behavioral patterns by context and internal state. The CX connectome provides a comprehensive blueprint necessary for a detailed understanding of network dynamics underlying sleep, flexible navigation, and state-dependent action selection.

Drosophila re-zero their path integrator at the center of a fictive food patch

The ability to keep track of one's location in space is a critical behavior for animals navigating to and from a salient location, and its computational basis is now beginning to be unraveled. Here, we tracked flies in a ring-shaped channel as they executed bouts of search triggered by optogenetic activation of sugar receptors. Unlike experiments in open field arenas, which produce highly tortuous search trajectories, our geometrically constrained paradigm enabled us to monitor flies' decisions to move toward or away from the fictive food. Our results suggest that flies use path integration to remember the location of a food site even after it has disappeared, and flies can remember the location of a former food site even after walking around the arena one or more times. To determine the behavioral algorithms underlying Drosophila search, we developed multiple state transition models and found that flies likely accomplish path integration by combining odometry and compass navigation to keep track of their position relative to the fictive food. Our results indicate that whereas flies re-zero their path integrator at food when only one feeding site is present, they adjust their path integrator to a central location between sites when experiencing food at two or more locations. Together, this work provides a simple experimental paradigm and theoretical framework to advance investigations of the neural basis of path integration.

Fly navigation: Yet another ring

Flies keep track of a food site by path integration. A novel behavioral paradigm has been combined with computational models to show that Drosophila can track at least three food patches simultaneously by using the center of gravity of all food sites as the reference point for their path integrator.

A unified mechanism for innate and learned visual landmark guidance in the insect central complex

Insects can navigate efficiently in both novel and familiar environments, and this requires flexiblity in how they are guided by sensory cues. A prominent landmark, for example, can elicit strong innate behaviours (attraction or menotaxis) but can also be used, after learning, as a specific directional cue as part of a navigation memory. However, the mechanisms that allow both pathways to co-exist, interact or override each other are largely unknown. Here we propose a model for the behavioural integration of innate and learned guidance based on the neuroanatomy of the central complex (CX), adapted to control landmark guided behaviours. We consider a reward signal provided either by an innate attraction to landmarks or a long-term visual memory in the mushroom bodies (MB) that modulates the formation of a local vector memory in the CX. Using an operant strategy for a simulated agent exploring a simple world containing a single visual cue, we show how the generated short-term memory can support both innate and learned steering behaviour. In addition, we show how this architecture is consistent with the observed effects of unilateral MB lesions in ants that cause a reversion to innate behaviour. We suggest the formation of a directional memory in the CX can be interpreted as transforming rewarding (positive or negative) sensory signals into a mapping of the environment that describes the geometrical attractiveness (or repulsion). We discuss how this scheme might represent an ideal way to combine multisensory information gathered during the exploration of an environment and support optimal cue integration.