Multimodal interactions in insect navigation

Visual route following for tiny autonomous robots

Navigation is an essential capability for autonomous robots. In particular, visual navigation has been a major research topic in robotics because cameras are lightweight, power-efficient sensors that provide rich information on the environment. However, the main challenge of visual navigation is that it requires substantial computational power and memory for visual processing and storage of the results. As of yet, this has precluded its use on small, extremely resource-constrained robots such as lightweight drones. Inspired by the parsimony of natural intelligence, we propose an insect-inspired approach toward visual navigation that is specifically aimed at extremely resource-restricted robots. It is a route-following approach in which a robot's outbound trajectory is stored as a collection of highly compressed panoramic images together with their spatial relationships as measured with odometry. During the inbound journey, the robot uses a combination of odometry and visual homing to return to the stored locations, with visual homing preventing the buildup of odometric drift. A main advancement of the proposed strategy is that the number of stored compressed images is minimized by spacing them apart as far as the accuracy of odometry allows. To demonstrate the suitability for small systems, we implemented the strategy on a tiny 56-gram drone. The drone could successfully follow routes up to 100 meters with a trajectory representation that consumed less than 20 bytes per meter. The presented method forms a substantial step toward the autonomous visual navigation of tiny robots, facilitating their more widespread application.

C. elegans foraging as a model for understanding the neuronal basis of decision-making

Animals have evolved to seek, select, and exploit food sources in their environment. Collectively termed foraging, these ubiquitous behaviors are necessary for animal survival. As a foundation for understanding foraging, behavioral ecologists established early theoretical and mathematical frameworks which have been subsequently refined and supported by field and laboratory studies of foraging animals. These simple models sought to explain how animals decide which strategies to employ when locating food, what food items to consume, and when to explore the environment for new food sources. These foraging decisions involve integration of prior experience with multimodal sensory information about the animal's current environment and internal state. We suggest that the nematode Caenorhabditis elegans is well-suited for a high-resolution analysis of complex goal-oriented behaviors such as foraging. We focus our discussion on behavioral studies highlighting C. elegans foraging on bacteria and summarize what is known about the underlying neuronal and molecular pathways. Broadly, we suggest that this simple model system can provide a mechanistic understanding of decision-making and present additional avenues for advancing our understanding of complex behavioral processes.

Investigating visual navigation using spiking neural network models of the insect mushroom bodies

Ants are capable of learning long visually guided foraging routes with limited neural resources. The visual scene memory needed for this behaviour is mediated by the mushroom bodies; an insect brain region important for learning and memory. In a visual navigation context, the mushroom bodies are theorised to act as familiarity detectors, guiding ants to views that are similar to those previously learned when first travelling along a foraging route. Evidence from behavioural experiments, computational studies and brain lesions all support this idea. Here we further investigate the role of mushroom bodies in visual navigation with a spiking neural network model learning complex natural scenes. By implementing these networks in GeNN-a library for building GPU accelerated spiking neural networks-we were able to test these models offline on an image database representing navigation through a complex outdoor natural environment, and also online embodied on a robot. The mushroom body model successfully learnt a large series of visual scenes (400 scenes corresponding to a 27 m route) and used these memories to choose accurate heading directions during route recapitulation in both complex environments. Through analysing our model's Kenyon cell (KC) activity, we were able to demonstrate that KC activity is directly related to the respective novelty of input images. Through conducting a parameter search we found that there is a non-linear dependence between optimal KC to visual projection neuron (VPN) connection sparsity and the length of time the model is presented with an image stimulus. The parameter search also showed training the model on lower proportions of a route generally produced better accuracy when testing on the entire route. We embodied the mushroom body model and comparator visual navigation algorithms on a Quanser Q-car robot with all processing running on an Nvidia Jetson TX2. On a 6.5 m route, the mushroom body model had a mean distance to training route (error) of 0.144 ± 0.088 m over 5 trials, which was performance comparable to standard visual-only navigation algorithms. Thus, we have demonstrated that a biologically plausible model of the ant mushroom body can navigate complex environments both in simulation and the real world. Understanding the neural basis of this behaviour will provide insight into how neural circuits are tuned to rapidly learn behaviourally relevant information from complex environments and provide inspiration for creating bio-mimetic computer/robotic systems that can learn rapidly with low energy requirements.

Trail using ants follow idiosyncratic routes in complex landscapes

A large volume of research on individually navigating ants has shown how path integration and visually guided navigation form a major part of the ant navigation toolkit for many species and are sufficient mechanisms for successful navigation. One of the behavioural markers of the interaction of these mechanisms is that experienced foragers develop idiosyncratic routes that require that individual ants have personal and unique visual memories that they use to guide habitual routes between the nest and feeding sites. The majority of ants, however, inhabit complex cluttered environments and social pheromone trails are often part of the collective recruitment, organisation and navigation of these foragers. We do not know how individual navigation interacts with collective behaviour along shared trails in complex natural environments. We thus asked here if wood ants that forage through densely cluttered woodlands where they travel along shared trails repeatedly follow the same routes or if they choose a spread of paths within the shared trail. We recorded three long homing trajectories of 20 individual wood ants in their natural woodland habitat. We found that wood ants follow idiosyncratic routes when navigating along shared trails through highly complex visual landscapes. This shows that ants rely on individual memories for habitual route guidance even in cluttered environments when chemical trail information is available. We argue that visual cues are likely to be the dominant sensory modality for the idiosyncratic routes. These experiments shed new light on how ants, or insects in general, navigate through complex multimodal environments.

Directed retreat and navigational mechanisms in trail following Formica obscuripes

Ant species exhibit behavioural commonalities when solving navigational challenges for successful orientation and to reach goal locations. These behaviours rely on a shared toolbox of navigational strategies that guide individuals under an array of motivational contexts. The mechanisms that support these behaviours, however, are tuned to each species' habitat and ecology with some exhibiting unique navigational behaviours. This leads to clear differences in how ant navigators rely on this shared toolbox to reach goals. Species with hybrid foraging structures, which navigate partially upon a pheromone-marked column, express distinct differences in their toolbox, compared to solitary foragers. Here, we explore the navigational abilities of the Western Thatching ant (Formica obscuripes), a hybrid foraging species whose navigational mechanisms have not been studied. We characterise their reliance on both the visual panorama and a path integrator for orientation, with the pheromone's presence acting as a non-directional reassurance cue, promoting continued orientation based on other strategies. This species also displays backtracking behaviour, which occurs with a combination of unfamiliar terrestrial cues and the absence of the pheromone, thus operating based upon a combination of the individual mechanisms observed in solitarily and socially foraging species. We also characterise a new form of goalless orientation in these ants, an initial retreating behaviour that is modulated by the forager's path integration system. The behaviour directs disturbed inbound foragers back along their outbound path for a short distance before recovering and reorienting back to the nest.

Emergent spatial goals in an integrative model of the insect central complex

The insect central complex appears to encode and process spatial information through vector manipulation. Here, we draw on recent insights into circuit structure to fuse previous models of sensory-guided navigation, path integration and vector memory. Specifically, we propose that the allocentric encoding of location provided by path integration creates a spatially stable anchor for converging sensory signals that is relevant in multiple behavioural contexts. The allocentric reference frame given by path integration transforms a goal direction into a goal location and we demonstrate through modelling that it can enhance approach of a sensory target in noisy, cluttered environments or with temporally sparse stimuli. We further show the same circuit can improve performance in the more complex navigational task of route following. The model suggests specific functional roles for circuit elements of the central complex that helps explain their high preservation across insect species.

Visual accelerated and olfactory decelerated responses during multimodal learning in honeybees

To obtain accurate information about the outside world and to make appropriate decisions, animals often combine information from different sensory pathways to form a comprehensive representation of their environment. This process of multimodal integration is poorly understood, but it is common view that the single elements of a multimodal stimulus influence each other's perception by enhancing or suppressing their neural representation. The neuronal level of interference might be manifold, for instance, an enhancement might increase, whereas suppression might decrease behavioural response times. In order to investigate this in an insect behavioural model, the Western honeybee, we trained individual bees to associate a sugar reward with an odour, a light, or a combined olfactory-visual stimulus, using the proboscis extension response (PER). We precisely monitored the PER latency (the time between stimulus onset and the first response of the proboscis) by recording the muscle M17, which innervates the proboscis. We found that odours evoked a fast response, whereas visual stimuli elicited a delayed PER. Interestingly, the combined stimulus showed a response time in between the unimodal stimuli, suggesting that olfactory-visual integration accelerates visual responses but decelerates the olfactory response time.

An insect-inspired model facilitating autonomous navigation by incorporating goal approaching and collision avoidance

Being one of the most fundamental and crucial capacity of robots and animals, autonomous navigation that consists of goal approaching and collision avoidance enables completion of various tasks while traversing different environments. In light of the impressive navigational abilities of insects despite their tiny brains compared to mammals, the idea of seeking solutions from insects for the two key problems of navigation, i.e., goal approaching and collision avoidance, has fascinated researchers and engineers for many years. However, previous bio-inspired studies have focused on merely one of these two problems at one time. Insect-inspired navigation algorithms that synthetically incorporate both goal approaching and collision avoidance, and studies that investigate the interactions of these two mechanisms in the context of sensory-motor closed-loop autonomous navigation are lacking. To fill this gap, we propose an insect-inspired autonomous navigation algorithm to integrate the goal approaching mechanism as the global working memory inspired by the sweat bee's path integration (PI) mechanism, and the collision avoidance model as the local immediate cue built upon the locust's lobula giant movement detector (LGMD) model. The presented algorithm is utilized to drive agents to complete navigation task in a sensory-motor closed-loop manner within a bounded static or dynamic environment. Simulation results demonstrate that the synthetic algorithm is capable of guiding the agent to complete challenging navigation tasks in a robust and efficient way. This study takes the first tentative step to integrate the insect-like navigation mechanisms with different functionalities (i.e., global goal and local interrupt) into a coordinated control system that future research avenues could build upon.

The combined role of visual and olfactory cues in foraging by Cataglyphis ants in laboratory mazes

Foragers use several senses to locate food, and many animals rely on vision and smell. It is beneficial not to rely on a single sense, which might fail under certain conditions. We examined the contribution of vision and smell to foraging and maze exploration under laboratory conditions using Cataglyphis desert ants as a model. Foraging intensity, measured as the number of workers entering the maze and arriving at the target as well as target arrival time, were greater when food, blue light, or both were offered or presented in contrast to a control. Workers trained to forage for a combined food and light cue elevated their foraging intensity with experience. However, foraging intensity was not higher when using both cues simultaneously than in either one of the two alone. Following training, we split between the two cues and moved either the food or the blue light to the opposite maze corner. This manipulation impaired foraging success by either leading to fewer workers arriving at the target cell (when the light stayed and the food was moved) or to more workers arriving at the opposite target cell, empty of food (when the food stayed and the light was moved). This result indicates that ant workers use both senses when foraging for food and readily associate light with food.

Animal homing: Ants build their own landmarks when they need them

Visual landmarks are extremely useful for successful navigation in many species, including ants. So much so that a new study shows that desert ants actually build their own landmarks when they need them.

The potential underlying mechanisms during learning flights

Hymenopterans, such as bees and wasps, have long fascinated researchers with their sinuous movements at novel locations. These movements, such as loops, arcs, or zigzags, serve to help insects learn their surroundings at important locations. They also allow the insects to explore and orient themselves in their environment. After they gained experience with their environment, the insects fly along optimized paths guided by several guidance strategies, such as path integration, local homing, and route-following, forming a navigational toolkit. Whereas the experienced insects combine these strategies efficiently, the naive insects need to learn about their surroundings and tune the navigational toolkit. We will see that the structure of the movements performed during the learning flights leverages the robustness of certain strategies within a given scale to tune other strategies which are more efficient at a larger scale. Thus, an insect can explore its environment incrementally without risking not finding back essential locations.

A Multimodal Sensing CMOS Imager Based on Dual-Focus Imaging

Advanced machine intelligence is empowered not only by the ever-increasing computational capability for information processing but also by sensors for collecting multimodal information from complex environments. However, simply assembling different sensors can result in bulky systems and complex data processing. Herein, it is shown that a complementary metal-oxide-semiconductor (CMOS) imager can be transformed into a compact multimodal sensing platform through dual-focus imaging. By combining lens-based and lensless imaging, visual information, chemicals, temperature, and humidity can be detected with the same chip and output as a single image. As a proof of concept, the sensor is equipped on a micro-vehicle, and multimodal environmental sensing and mapping is demonstrated. A multimodal endoscope is also developed, and simultaneous imaging and chemical profiling along a porcine digestive tract is achieved. The multimodal CMOS imager is compact, versatile, and extensible and can be widely applied in microrobots, in vivo medical apparatuses, and other microdevices.

A virtuous cycle between invertebrate and robotics research: perspective on a decade of Living Machines research

Many invertebrates are ideal model systems on which to base robot design principles due to their success in solving seemingly complex tasks across domains while possessing smaller nervous systems than vertebrates. Three areas are particularly relevant for robot designers: Research on flying and crawling invertebrates has inspired new materials and geometries from which robot bodies (their morphologies) can be constructed, enabling a new generation of softer, smaller, and lighter robots. Research on walking insects has informed the design of new systems for controlling robot bodies (their motion control) and adapting their motion to their environment without costly computational methods. And research combining wet and computational neuroscience with robotic validation methods has revealed the structure and function of core circuits in the insect brain responsible for the navigation and swarming capabilities (their mental faculties) displayed by foraging insects. The last decade has seen significant progress in the application of principles extracted from invertebrates, as well as the application of biomimetic robots to model and better understand how animals function. This Perspectives paper on the past 10 years of the Living Machines conference outlines some of the most exciting recent advances in each of these fields before outlining lessons gleaned and the outlook for the next decade of invertebrate robotic research.

Impact of central complex lesions on innate and learnt visual navigation in ants

Wood ants are excellent navigators, using a combination of innate and learnt navigational strategies to travel between their nest and feeding sites. Visual navigation in ants has been studied extensively, however, we have little direct evidence for the underlying neural mechanisms. Here, we perform lateralized mechanical lesions in the central complex (CX) of wood ants, a midline structure known to allow an insect to keep track of the direction of sensory cues relative to its own orientation and to control movement. We lesioned two groups of ants and observed their behaviour in an arena with a large visual landmark present. The first group of ants were naïve and when intact such ants show a clear innate attraction to the conspicuous landmark. The second group of ants were trained to aim to a food location to the side of the landmark. The general heading of naïve ants towards a visual cue was not altered by the lesions, but the heading of ants trained to a landmark adjacent food position was affected. Thus, CX lesions had a specific impact on learnt visual guidance. We also observed that lateralised lesions altered the fine details of turning with lesioned ants spending less time turning to the side ipsilateral of the lesion. The results confirm the role of the CX in turn control and highlight its important role in the implementation of learnt behaviours that rely on information from other brain regions.

Polarization sensitivity and decentralized visual processing in an animal with a distributed visual system

The marine mollusc Acanthopleura granulata (Mollusca; Polyplacophora) has a distributed visual array composed of hundreds of small image-forming eyes embedded within its eight dorsal shell plates. As in other animals with distributed visual systems, we still have a poor understanding of the visual capabilities of A. granulata and we have yet to learn where and how it processes visual information. Using behavioral trials involving isoluminant looming visual stimuli, we found that A. granulata demonstrates spatial vision with an angular resolution of 6 deg. We also found that A. granulata responds to looming stimuli defined by contrasting angles of linear polarization. To learn where and how A. granulata processes visual information, we traced optic nerves using fluorescent lipophilic dyes. We found that the optic nerves innervate the underlying lateral neuropil, a neural tissue layer that circumnavigates the body. Adjacent optic nerves innervate the lateral neuropil with highly overlapping arborizations, suggesting it is the site of an integrated visuotopic map. Using immunohistochemistry, we found that the lateral neuropil of A. granulata is subdivided into two separate layers. In comparison, we found that a chiton with eyespots (Chiton tuberculatus) and two eyeless chitons (Ischnochiton papillosus and Chaetopleura apiculata) have lateral neuropil that is a singular circular layer without subdivision, findings consistent with previous work on chiton neuroanatomy. Overall, our results suggest that A. granulata effectuates its visually mediated behaviors using a unique processing scheme: it extracts spatial and polarization information using a distributed visual system, and then integrates and processes that information using decentralized neural circuits.

Varieties of visual navigation in insects

The behaviours and cognitive mechanisms animals use to orient, navigate, and remember spatial locations exemplify how cognitive abilities have evolved to suit a number of different mobile lifestyles and habitats. While spatial cognition observed in vertebrates has been well characterised in recent decades, of no less interest are the great strides that have also been made in characterizing and understanding the behavioural and cognitive basis of orientation and navigation in invertebrate models and in particular insects. Insects are known to exhibit remarkable spatial cognitive abilities and are able to successfully migrate over long distances or pinpoint known locations relying on multiple navigational strategies similar to those found in vertebrate models-all while operating under the constraint of relatively limited neural architectures. Insect orientation and navigation systems are often tailored to each species' ecology, yet common mechanistic principles can be observed repeatedly. Of these, reliance on visual cues is observed across a wide number of insect groups. In this review, we characterise some of the behavioural strategies used by insects to solve navigational problems, including orientation over short-distances, migratory heading maintenance over long distances, and homing behaviours to known locations. We describe behavioural research using examples from a few well-studied insect species to illustrate how visual cues are used in navigation and how they interact with non-visual cues and strategies.

Temporal configuration and modality of components determine the performance of bumble bees during the learning of a multimodal signal

Across communicative systems, the ability of compound signals to enhance receiver's perception and decoding is a potent explanation for the evolution of complexity. In nature, complex signaling involves spatiotemporal variation in perception of signal components; yet, how the synchrony between components affects performance of the receiver is much less understood. In the coevolution of plants and pollinators, bees are a model for understanding how visual and chemical components of floral displays may interact to influence performance. Understanding whether the temporal dimension of signal components impacts performance is central for evaluating hypotheses about the facilitation of information processing and for predicting how particular trait combinations function in nature. Here, I evaluated the role of the temporal dimension by testing the performance of bumble bees under restrained conditions while learning a bimodal (olfactory and visual) stimulus. I trained bumble bees under six different stimuli varying in their internal synchrony and structure. I also evaluated the acquisition of the individual components. I show that the temporal configuration and the identity of the components impact their combined and separate acquisition. Performance was favored by partial asynchrony and the initial presentation of the visual component, leading to higher acquisition of the olfactory component. This indicates that compound stimuli resembling the partially synchronous presentation of a floral display favor performance in a pollinator, thus highlighting the time dimension as crucial for the enhancement. Moreover, this supports the hypothesis that the evolution of multimodal floral signals may have been favored by the asynchrony perceived by the receiver during free flight.

Visual navigation: properties, acquisition and use of views

Panoramic views offer information on heading direction and on location to visually navigating animals. This review covers the properties of panoramic views and the information they provide to navigating animals, irrespective of image representation. Heading direction can be retrieved by alignment matching between memorized and currently experienced views, and a gradient descent in image differences can lead back to the location at which a view was memorized (positional image matching). Central place foraging insects, such as ants, bees and wasps, conduct distinctly choreographed learning walks and learning flights upon first leaving their nest that are likely to be designed to systematically collect scene memories tagged with information provided by path integration on the direction of and the distance to the nest. Equally, traveling along routes, ants have been shown to engage in scanning movements, in particular when routes are unfamiliar, again suggesting a systematic process of acquiring and comparing views. The review discusses what we know and do not know about how view memories are represented in the brain of insects, how they are acquired and how they are subsequently used for traveling along routes and for pinpointing places.

Geometry-based navigation in the dark: layout symmetry facilitates spatial learning in the house cricket, Acheta domesticus, in the absence of visual cues

The capacity to navigate by layout geometry has been widely recognized as a robust strategy of place-finding. It has been reported in various species, although most studies were performed with vision-based paradigms. In the presented study, we aimed to investigate layout symmetry-based navigation in the house cricket, Acheta domesticus, in the absence of visual cues. For this purpose, we used a non-visual paradigm modeled on the Tennessee Williams setup. We ensured that the visual cues were indeed inaccessible to insects. In the main experiment, we tested whether crickets are capable of learning to localize the centrally positioned, inconspicuous cool spot in heated arenas of various shapes (i.e., circular, square, triangular, and asymmetric quadrilateral). We found that the symmetry of the arena significantly facilitates crickets’ learning to find the cool spot, indicated by the increased time spent on the cool spot and the decreased latency in locating it in subsequent trials. To investigate mechanisms utilized by crickets, we analyzed their approach paths to the spot. We found that crickets used both heuristic and directed strategies of approaching the target, with the dominance of a semi-directed strategy (i.e., a thigmotactic phase preceding direct navigation to the target). We propose that the poor performance of crickets in the asymmetrical quadrilateral arena may be explained by the difficulty of encoding its layout with cues from a single modality.

The balbyter ant Camponotus fulvopilosus combines several navigational strategies to support homing when foraging in the close vicinity of its nest

Many insects rely on path integration to define direct routes back to their nests. When shuttling hundreds of meters back and forth between a profitable foraging site and a nest, navigational errors accumulate unavoidably in this compass- and odometer-based system. In familiar terrain, terrestrial landmarks can be used to compensate for these errors and safely guide the insect back to its nest with pin-point precision. In this study, we investigated the homing strategies employed by Camponotus fulvopilosus ants when repeatedly foraging no more than 1.25 m away from their nest. Our results reveal that the return journeys of the ants, even when setting out from a feeder from which the ants could easily get home using landmark information alone, are initially guided by path integration. After a short run in the direction given by the home vector, the ants then switched strategies and started to steer according to the landmarks surrounding their nest. We conclude that even when foraging in the close vicinity of its nest, an ant still benefits from its path-integrated vector to direct the start of its return journey.

Impacts of development and adult sex on brain cell numbers in the Black Soldier Fly, Hermetia illucens L. (Diptera: Stratiomyidae)

The Black Soldier Fly (Hermetia illucens, Diptera: Stratiomyidae) has been introduced across the globe, with numerous industry applications predicated on its tremendous growth during the larval stage. However, basic research on H. illucens biology (for example, studies of their central nervous system) are lacking. Despite their small brain volumes, insects are capable of complex behaviors; understanding how these behaviors are completed with such a small amount of neural tissue requires understanding processing power (e.g. number of cells) within the brain. Brain cell counts have been completed in only a few insect species (mostly Hymenoptera), and almost exclusively in adults. This limits the taxonomic breadth of comparative analyses, as well as any conclusions about how development and body size growth may impact brain cell populations. Here, we present the first images and cell counts of the H. illucens brain at four time points across development (early, mid, and late larval stages, and both male and female adults) using immunohistochemistry and isotropic fractionation. To assess sexual dimorphism in adults, we quantified the number of cells in the central brain vs. optic lobes of males and females separately. To assess if increases in body size during development might independently affect different regions of the CNS, we quantified the larval ventral nerve cord and central brain separately at all three stages. Together, these data provide the first description of the nervous system of a popular, farmed invertebrate and the first study of brain cell numbers using IF across developmental stages in any insect.

Innate visual attraction in wood ants is a hardwired behavior seen across different motivational and ecological contexts

Ants are expert navigators combining innate and learnt navigational strategies. Whereas we know that the ants' feeding state segregates visual-navigational memories in ants navigating along a learnt route, it is an open question if the motivational state also affects the ants' innate visual preferences. Wood ant foragers show an innate attraction to conspicuous visual cues. These foragers inhabit cluttered woodland habitat and feed on honeydew from aphids on trees. Hence, the attraction to 'tree-like' objects might be an ecologically relevant behavior that is tailored to the wood ants' foraging ecology. Foragers from other ant species with different foraging ecologies show very different innate attractions. We investigated here the innate visual response of wood ant foragers with different motivational states, i.e., unfed or fed, as well as males that show no foraging activity. Our results show that ants from all three groups orient toward a prominent visual cue, i.e., this intrinsic visuomotor response is not context-dependent, but a hardwired behavior seen across different motivational and ecological contexts.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s00040-022-00867-3.

The interplay of directional information provided by unpolarised and polarised light in the heading direction network of the diurnal dung beetle Kheper lamarcki

The sun is the most prominent source of directional information in the heading direction network of the diurnal, ball-rolling dung beetle Kheper lamarcki. If this celestial body is occluded from the beetle's field of view, the distribution of the relative weight between the directional cues that remain shifts in favour of the celestial pattern of polarised light. In this study, we continue to explore the interplay of the sun and polarisation pattern as directional cues in the heading direction network of K. lamarcki. By systematically altering the intensity and degree of the two cues presented, we effectively change the relative reliability of these directional cues as they appear to the dung beetle. The response of the ball-rolling beetle to these modifications allows us to closely examine how the weighting relationship of these two sources of directional information is influenced and altered in the heading direction network of the beetle. We conclude that the process in which K. lamarcki relies on directional information is very likely done based on Bayesian reasoning, where directional information conveying the highest certainty at a particular moment is afforded the greatest weight.

The role of food odor in invertebrate foraging

Foraging for food is an integral part of animal survival. In small insects and invertebrates, multisensory information and optimized locomotion strategies are used to effectively forage in patchy and complex environments. Here, the importance of olfactory cues for effective invertebrate foraging is discussed in detail. We review how odors are used by foragers to move toward a likely food source and the recent models that describe this sensory-driven behavior. We argue that smell serves a second function by priming an organism for the efficient exploitation of food. By appraising food odors, invertebrates can establish preferences and better adapt to their ecological niches, thereby promoting survival. The smell of food pre-prepares the gastrointestinal system and primes feeding motor programs for more effective ingestion as well. Optimizing resource utilization affects longevity and reproduction as a result, leading to drastic changes in survival. We propose that models of foraging behavior should include odor priming, and illustrate this with a simple toy model based on the marginal value theorem. Lastly, we discuss the novel techniques and assays in invertebrate research that could investigate the interactions between odor sensing and food intake. Overall, the sense of smell is indispensable for efficient foraging and influences not only locomotion, but also organismal physiology, which should be reflected in behavioral modeling.

Organization of the parallel antennal-lobe tracts in the moth

The olfactory pathways of the insect brain have been studied comprehensively for more than 40 years, yet the last decade has included a particularly large accumulation of new information relating to this system's structure. In moths, sharp intracellular recording and staining has been used to elucidate the anatomy and physiology of output neurons from the primary olfactory center, the antennal lobe. This review concentrates on the connection patterns characterizing these projection neurons, which follow six separate antennal-lobe tracts. In addition to highlighting the connections between functionally distinct glomerular clusters and higher-order olfactory neuropils, we discuss how parallel tracts in the male convey distinct features of the social signals released by conspecific and heterospecific females. Finally, we consider the current state of knowledge regarding olfactory processing in the moth's protocerebrum and make suggestions as to how the information concerning antennal-lobe output may be used to design future studies.

Context-dependent use of olfactory cues by foragers of Vespula germanica social wasps

Food search is guided by cues from different sensory modalities, such as olfactory and visual. In social wasps, olfaction plays a key role in locating new resources. However, while several studies have focused on the importance of odours in predation, less is known about their role during scavenging, when spatial memories become a relevant guidance mechanism. Here, we investigated whether the use of odours during carrion exploitation by Vespula germanica wasps depends on whether they are locating or relocating the resource. By means of field choice experiments, we evaluated wasp response to odours: an odour eliciting a spontaneous aversive response, a learnt odour eliciting an appetitive response, and the conspecifics' odour eliciting an attractive response. Experiments were conducted in different contexts, i.e., during food localisation by naïve foragers, re-localisation of a resource at the learnt site and re-localisation of a resource that had been displaced from the learnt site. All olfactory stimuli evaluated markedly influenced foraging decisions in naïve wasps and in experienced wasps when the food was moved from the learnt location. However, odours were ignored during the wasp's return to the foraging site. These results suggest a cue hierarchy, in which local landmarks are more reliable to relocate carrion, while olfaction would be useful to locate novel resources or relocate a known source when spatial memories fail. Our findings demonstrate a context-dependent use of odours during carrion exploitation by V. germanica wasps and highlight the importance of spatial memories as an important factor modulating odour response.

The Basis of Navigation Across Species

Animals navigate a wide range of distances, from a few millimeters to globe-spanning journeys of thousands of kilometers. Despite this array of navigational challenges, similar principles underlie these behaviors across species. Here, we focus on the navigational strategies and supporting mechanisms in four well-known systems: the large-scale migratory behaviors of sea turtles and lepidopterans as well as navigation on a smaller scale by rats and solitarily foraging ants. In lepidopterans, rats, and ants we also discuss the current understanding of the neural architecture which supports navigation. The orientation and navigational behaviors of these animals are defined in terms of behavioral error-reduction strategies reliant on multiple goal-directed servomechanisms. We conclude by proposing to incorporate an additional component into this system: the observation that servomechanisms operate on oscillatory systems of cycling behavior. These oscillators and servomechanisms comprise the basis for directed orientation and navigational behaviors. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Anthropogenic noise affects insect and arachnid behavior, thus changing interactions within and between species

Urbanization and the by-product pollutants of anthropogenic activity pose unique threats to arthropods by altering their sensory environments. Sounds generated by human activities, like construction and road traffic, can oversaturate or interfere with biotic acoustic cues that regulate important ecological processes, such as trophic interactions and the coordination of mating. Here, we review recent work exploring how anthropogenic noise impacts inter-intra-specific interactions in insects and arachnids. We outline empirical frameworks for future research that integrate three mechanisms by which anthropogenic noise alters behavior through interference with acoustic cues: masking, distraction, and misleading. Additionally, we emphasize the need for experimental designs that more accurately replicate natural soundscapes. We encourage future investigations on the effects of developmental exposure to noise pollution and the impacts of multiple interacting sensory pollutants on insect and arachnid behavior.

A unified mechanism for innate and learned visual landmark guidance in the insect central complex

Insects can navigate efficiently in both novel and familiar environments, and this requires flexiblity in how they are guided by sensory cues. A prominent landmark, for example, can elicit strong innate behaviours (attraction or menotaxis) but can also be used, after learning, as a specific directional cue as part of a navigation memory. However, the mechanisms that allow both pathways to co-exist, interact or override each other are largely unknown. Here we propose a model for the behavioural integration of innate and learned guidance based on the neuroanatomy of the central complex (CX), adapted to control landmark guided behaviours. We consider a reward signal provided either by an innate attraction to landmarks or a long-term visual memory in the mushroom bodies (MB) that modulates the formation of a local vector memory in the CX. Using an operant strategy for a simulated agent exploring a simple world containing a single visual cue, we show how the generated short-term memory can support both innate and learned steering behaviour. In addition, we show how this architecture is consistent with the observed effects of unilateral MB lesions in ants that cause a reversion to innate behaviour. We suggest the formation of a directional memory in the CX can be interpreted as transforming rewarding (positive or negative) sensory signals into a mapping of the environment that describes the geometrical attractiveness (or repulsion). We discuss how this scheme might represent an ideal way to combine multisensory information gathered during the exploration of an environment and support optimal cue integration.

Minding the gap: learning and visual scanning behaviour in nocturnal bull ants

Insects possess small brains but exhibit sophisticated behaviour, specifically their ability to learn to navigate within complex environments. To understand how they learn to navigate in a cluttered environment, we focused on learning and visual scanning behaviour in the Australian nocturnal bull ant, Myrmecia midas, which are exceptional visual navigators. We tested how individual ants learn to detour via a gap and how they cope with substantial spatial changes over trips. Homing M. midas ants encountered a barrier on their foraging route and had to find a 50 cm gap between symmetrical large black screens, at 1 m distance towards the nest direction from the centre of the releasing platform in both familiar (on-route) and semi-familiar (off-route) environments. Foragers were tested for up to 3 learning trips with the changed conditions in both environments. The results showed that on the familiar route, individual foragers learned the gap quickly compared with when they were tested in the semi-familiar environment. When the route was less familiar, and the panorama was changed, foragers were less successful at finding the gap and performed more scans on their way home. Scene familiarity thus played a significant role in visual scanning behaviour. In both on-route and off-route environments, panoramic changes significantly affected learning, initial orientation and scanning behaviour. Nevertheless, over a few trips, success at gap finding increased, visual scans were reduced, the paths became straighter, and individuals took less time to reach the goal.

Summary: Investigation of how nocturnal bull ants learn to move around obstacles in familiar and semi-familiar environments reveals that scene familiarity plays a significant role in navigation.

Compass Cue Integration and Its Relation to the Visual Ecology of Three Tribes of Ball-Rolling Dung Beetles

To guide their characteristic straight-line orientation away from the dung pile, ball-rolling dung beetles steer according to directional information provided by celestial cues, which, among the most relevant are the sun and polarised skylight. Most studies regarding the use of celestial cues and their influence on the orientation system of the diurnal ball-rolling beetle have been performed on beetles of the tribe Scarabaeini living in open habitats. These beetles steer primarily according to the directional information provided by the sun. In contrast, Sisyphus fasciculatus, a species from a different dung-beetle tribe (the Sisyphini) that lives in habitats with closely spaced trees and tall grass, relies predominantly on directional information from the celestial pattern of polarised light. To investigate the influence of visual ecology on the relative weight of these cues, we studied the orientation strategy of three different tribes of dung beetles (Scarabaeini, Sisyphini and Gymnopleurini) living within the same biome, but in different habitat types. We found that species within a tribe share the same orientation strategy, but that this strategy differs across the tribes; Scarabaeini, living in open habitats, attribute the greatest relative weight to the directional information from the sun; Sisyphini, living in closed habitats, mainly relies on directional information from polarised skylight; and Gymnopleurini, also living in open habitats, appear to weight both cues equally. We conclude that, despite exhibiting different body size, eye size and morphology, dung beetles nevertheless manage to solve the challenge of straight-line orientation by weighting visual cues that are particular to the habitat in which they are found. This system is however dynamic, allowing them to operate equally well even in the absence of the cue given the greatest relative weight by the particular species.

A transdisciplinary research agenda for understanding insect responses to ecological light pollution informed by evolutionary trap theory

Evolutionary traps are phenomena in which rapid environmental change causes environmental cues that historically guided adaptive behavioral or life-history decisions to become poor predictors of the consequences of such decisions for an organism's fitness. Evolutionary trap theory offers an ideal framework for understanding and mitigating the effects of ecological light pollution (ELP) on insects. We emphasize the utility of an evolutionary trap perspective in demonstrating the importance of an integrated understanding of the sensory, behavioral, evolutionary, and demographic mechanisms underlying insect responses to ELP. We also highlight neglected areas of research where greater focus can help enhance understanding of how ELP affects the persistence, evolutionary trajectory, and population dynamics of insects across space and time.

Find the food first: An omnivorous sensory morphotype predates biomechanical specialization for plant based diets in phyllostomid bats

The role of mechanical morphologies in the exploitation of novel niche space is well characterized; however, the role of sensory structures in unlocking new niches is less clear. Here, we investigate the relationship between the evolution of sensory structures and diet during the radiation of noctilionoid bats. With a broad range of foraging ecologies and a well-supported phylogeny, noctilionoids constitute an ideal group for studying this relationship. We used diffusible iodine-based contrast enhanced computed tomography scans of 44 noctilionoid species to analyze relationships between the relative volumes of three sensory structures (olfactory bulbs, orbits, and cochleae) and diet. We found a positive relationship between frugivory and both olfactory and orbit size. However, we also found a negative relationship between nectarivory and cochlea size. Ancestral state estimates suggest that larger orbits and olfactory bulbs were present in the common ancestor of family Phyllostomidae, but not in other noctilionoid. This constellation of traits indicates a shift toward omnivory at the base of Phyllostomidae, predating their radiation into an exceptionally broad range of dietary niches. This is consistent with a scenario in which changes in sensory systems associated with foraging and feeding set the stage for subsequent morphological modification and diversification.

Navigation and orientation in Coleoptera: a review of strategies and mechanisms

Spatial orientation is important for animals to forage, mate, migrate, and escape certain threats, and can require simple to complex cognitive abilities and behaviours. As these behaviours are more difficult to experimentally test in vertebrates, considerable research has focussed on investigating spatial orientation in insects. However, the majority of insect spatial orientation research tends to focus on a few taxa of interest, especially social insects. Beetles present an interesting insect group to study in this respect, due to their diverse taxonomy and biology, and prevalence as agricultural pests. In this article, I review research on beetle spatial orientation. Then, I use this synthesis to discuss mechanisms beetles employ in the context of different behaviours that require orientation or navigation. I conclude by discussing two future avenues for behavioural research on this topic, which could lead to more robust conclusions on how species in this diverse order are able to traverse through a wide variety of environments.

Mosquito Host Seeking in 3D Using a Versatile Climate-Controlled Wind Tunnel System

Future anthropogenic climate change is predicted to impact sensory-driven behaviors. Building on recent improvements in computational power and tracking technology, we have developed a versatile climate-controlled wind tunnel system, in which to study the effect of climate parameters, including temperature, precipitation, and elevated greenhouse gas levels, on odor-mediated behaviors in insects. To establish a baseline for future studies, we here analyzed the host-seeking behavior of the major malaria vector mosquito, Anopheles gambiae sensu strico, to human odor and carbon dioxide (CO₂), under tightly controlled climatic conditions, and isolated from potential background contamination by the presence of an experimenter. When presented with a combination of human foot odor and CO₂ (case study I), mosquitoes engaged in faster crosswind flight, spent more time in the filamentous odor plume and targeted the odor source more successfully. In contrast, female An. gambiae s. s. presented with different concentrations of CO₂ alone, did not display host-seeking behavior (case study II). These observations support previous findings on the role of human host-associated cues in host seeking and confirm the role of CO₂ as a synergist, but not a host-seeking cue on its own. Future studies are aimed at investigating the effect of climate change on odor-mediated behavior in mosquitoes and other insects. Moreover, the system will be used to investigate detection and processing of olfactory information in various behavioral contexts, by providing a fine-scale analysis of flight behavior.

Role of the pheromone for navigation in the group foraging ant, Veromessor pergandei

Navigation is comprised of a variety of strategies which rely on multiple external cues to shape a navigator's behavioral output. Here, we explored in the ant Veromessor pergandei, the interactions between the information provided by the pheromone trail and the home vector guided by the celestial compass. We found that a cross sensory interaction between the pheromone cue and the path integrator underlies correct orientation during the inbound journey. The celestial compass provides directional information, while the presence of the trail pheromone acts as a critical context cue, triggering distinct behaviors (vector orientation, search, and backtracking). While exposed to the pheromone, foragers orient to the vector direction regardless of vector state, while in the pheromone's absence, the current remaining vector determines the forager's navigational behavior. This interaction also occurs in foragers with no remaining path integrator, relying on the activation of a celestial compass-based memory of the previous trip. Such cue interactions maximize the foragers' return to the nest and inhibit movement off the pheromone trail. Finally, our manipulations continuously rotated foragers away from their desired heading, yet foragers were proficient at counteracting these changes, steering to maintain a correct compass heading even at rotational speeds of ~ 40°/s.

Multisensory integration supports configural learning of a home refuge in the whip spider Phrynus marginemaculatus

Whip spiders (Amblypygi) reside in structurally complex habitats and are nocturnally active yet display notable navigational abilities. From the theory that uncertainty in sensory inputs should promote multisensory representations to guide behavior, we hypothesized that their navigation is supported by a multisensory and perhaps configural representation of navigational inputs, an ability documented in a few insects and never reported in arachnids. We trained Phrynus marginemaculatus to recognize a home shelter characterized by both discriminative olfactory and tactile stimuli. In tests, subjects readily discriminated between shelters based on the paired stimuli. However, subjects failed to recognize the shelter in tests with either of the component stimuli alone. This result is consistent with the hypothesis that the terminal phase of their navigational behavior, shelter recognition, can be supported by the integration of multisensory stimuli as an enduring, configural representation. We hypothesize that multisensory learning occurs in the whip spiders' extraordinarily large mushroom bodies, which may functionally resemble the hippocampus of vertebrates.

The Critical Role of Head Movements for Spatial Representation During Bumblebees Learning Flight

Bumblebees perform complex flight maneuvers around the barely visible entrance of their nest upon their first departures. During these flights bees learn visual information about the surroundings, possibly including its spatial layout. They rely on this information to return home. Depth information can be derived from the apparent motion of the scenery on the bees' retina. This motion is shaped by the animal's flight and orientation: Bees employ a saccadic flight and gaze strategy, where rapid turns of the head (saccades) alternate with flight segments of apparently constant gaze direction (intersaccades). When during intersaccades the gaze direction is kept relatively constant, the apparent motion contains information about the distance of the animal to environmental objects, and thus, in an egocentric reference frame. Alternatively, when the gaze direction rotates around a fixed point in space, the animal perceives the depth structure relative to this pivot point, i.e., in an allocentric reference frame. If the pivot point is at the nest-hole, the information is nest-centric. Here, we investigate in which reference frames bumblebees perceive depth information during their learning flights. By precisely tracking the head orientation, we found that half of the time, the head appears to pivot actively. However, only few of the corresponding pivot points are close to the nest entrance. Our results indicate that bumblebees perceive visual information in several reference frames when they learn about the surroundings of a behaviorally relevant location.

Towards a multi-level understanding in insect navigation

To understand the brain is to understand behaviour. However, understanding behaviour itself requires consideration of sensory information, body movements and the animal's ecology. Therefore, understanding the link between neurons and behaviour is a multi-level problem, which can be achieved when considering Marr's three levels of understanding: behaviour, computation, and neural implementation. Rather than establishing direct links between neurons and behaviour, the matter boils down to understanding two transitions: the link between neurons and brain computation on one hand, and the link between brain computations and behaviour on the other hand. The field of insect navigation illustrates well the power of such two-sided endeavour. We provide here examples revealing that each transition requires its own approach with its own intrinsic difficulties, and show how modelling can help us reach the desired multi-level understanding.

Spatial cognition in the context of foraging styles and information transfer in ants

Ants are central-place foragers: they always return to the nest, and this requires the ability to remember relationships between features of the environment, or an individual's path through the landscape. The distribution of these cognitive responsibilities within a colony depends on a species' foraging style. Solitary foraging as well as leader-scouting, which is based on information transmission about a distant targets from scouts to foragers, can be considered the most challenging tasks in the context of ants' spatial cognition. Solitary foraging is found in species of almost all subfamilies of ants, whereas leader-scouting has been discovered as yet only in the Formica rufa group of species (red wood ants). Solitary foraging and leader-scouting ant species, although enormously different in their levels of sociality and ecological specificities, have many common traits of individual cognitive navigation, such as the primary use of visual navigation, excellent visual landmark memories, and the subordinate role of odour orientation. In leader-scouting species, spatial cognition and the ability to transfer information about a distant target dramatically differ among scouts and foragers, suggesting individual cognitive specialization. I suggest that the leader-scouting style of recruitment is closely connected with the ecological niche of a defined group of species, in particular, their searching patterns within the tree crown. There is much work to be done to understand what cognitive mechanisms underpin route planning and communication about locations in ants.

Multimodal influences on learning walks in desert ants (Cataglyphis fortis)

Ants are excellent navigators using multimodal information for navigation. To accurately localise the nest at the end of a foraging journey, visual cues, wind direction and also olfactory cues need to be learnt. Learning walks are performed at the start of an ant’s foraging career or when the appearance of the nest surrounding has changed. We investigated here whether the structure of such learning walks in the desert ant Cataglyphis fortis takes into account wind direction in conjunction with the learning of new visual information. Ants learnt to travel back and forth between their nest and a feeder, and we then introduced a black cylinder near their nest to induce learning walks in regular foragers. By doing this across days with different wind directions, we were able to probe how ants balance different sensory modalities. We found that (1) the ants’ outwards headings are influenced by the wind direction with their routes deflected such that they will arrive downwind of their target, (2) a novel object along the route induces learning walks in experienced ants and (3) the structure of learning walks is shaped by the wind direction rather than the position of the visual cue.