Integration of parallel mechanosensory and visual pathways resolved through sensory conflict

Moth resonant mechanics are tuned to wingbeat frequency and energetic demands

An insect's wingbeat frequency is a critical determinant of its flight performance and varies by multiple orders of magnitude across Insecta. Despite potential energetic benefits for an insect that matches its wingbeat frequency to its resonant frequency, recent work has shown that moths may operate off their resonant peak. We hypothesized that across species, wingbeat frequency scales with resonance frequency to maintain favourable energetics, but with an offset in species that use frequency modulation as a means of flight control. The moth superfamily Bombycoidea is ideal for testing this hypothesis because their wingbeat frequencies vary across species by an order of magnitude, despite similar morphology and actuation. We used materials testing, high-speed videography and a model of resonant aerodynamics to determine how components of an insect's flight apparatus (stiffness, wing inertia, muscle strain and aerodynamics) vary with wingbeat frequency. We find that the resonant frequency of a moth correlates with wingbeat frequency, but resonance curve shape (described by the Weis-Fogh number) and peak location vary within the clade in a way that corresponds to frequency-dependent biomechanical demands. Our results demonstrate that a suite of adaptations in muscle, exoskeleton and wing drive variation in resonant mechanics, reflecting potential constraints on matching wingbeat and resonant frequencies.

Visual guidance fine-tunes probing movements of an insect appendage

Visually guided reaching, a regular feature of human life, comprises an intricate neural control task. It includes identifying the target's position in 3D space, passing the representation to the motor system that controls the respective appendages, and adjusting ongoing movements using visual and proprioceptive feedback. Given the complexity of the neural control task, invertebrates, with their numerically constrained central nervous systems, are often considered incapable of this level of visuomotor guidance. Here, we provide mechanistic insights into visual appendage guidance in insects by studying the probing movements of the hummingbird hawkmoth's proboscis as they search for a flower's nectary. We show that visually guided proboscis movements fine-tune the coarse control provided by body movements in flight. By impairing the animals' view of their proboscis, we demonstrate that continuous visual feedback is required and actively sought out to guide this appendage. In doing so, we establish an insect model for the study of neural strategies underlying eye-appendage control in a simple nervous system.

Drosophila flying in augmented reality reveals the vision-based control autonomy of the optomotor response

For walking, swimming, and flying animals, the optomotor response is essential to stabilize gaze. How flexible is the optomotor response? Classic work in Drosophila has argued that flies adapt flight control under augmented visual feedback conditions during goal-directed bar fixation. However, whether the lower-level, reflexive optomotor response can similarly adapt to augmented visual feedback (partially autonomous) or not (autonomous) over long timescales is poorly understood. To address this question, we developed an augmented reality paradigm to study the vision-based control autonomy of the yaw optomotor response of flying fruit flies (Drosophila). Flies were placed in a flight simulator, which permitted free body rotation about the yaw axis. By feeding back body movements in real time to a visual display, we augmented and inverted visual feedback. Thus, this experimental paradigm caused a constant visual error between expected and actual visual feedback to study potential adaptive visuomotor control. By combining experiments with control theory, we demonstrate that the optomotor response is autonomous during augmented reality flight bouts of up to 30 min, which exceeds the reported learning epoch during bar fixation. Agreement between predictions from linear systems theory and experimental data supports the notion that the optomotor response is approximately linear and time invariant within our experimental assay. Even under positive visual feedback, which revealed the stability limit of flies in augmented reality, the optomotor response was autonomous. Our results support a hierarchical motor control architecture in flies with fast and autonomous reflexes at the bottom and more flexible behavior at higher levels.

The processing of proprioceptive signals in distributed networks: insights from insect motor control

The integration of sensory information is required to maintain body posture and to generate robust yet flexible locomotion through unpredictable environments. To anticipate required adaptations in limb posture and enable compensation of sudden perturbations, an animal's nervous system assembles external (exteroception) and internal (proprioception) cues. Coherent neuronal representations of the proprioceptive context of the body and the appendages arise from the concerted action of multiple sense organs monitoring body kinetics and kinematics. This multimodal proprioceptive information, together with exteroceptive signals and brain-derived descending motor commands, converges onto premotor networks - i.e. the local neuronal circuitry controlling motor output and movements - within the ventral nerve cord (VNC), the insect equivalent of the vertebrate spinal cord. This Review summarizes existing knowledge and recent advances in understanding how local premotor networks in the VNC use convergent information to generate contextually appropriate activity, focusing on the example of posture control. We compare the role and advantages of distributed sensory processing over dedicated neuronal pathways, and the challenges of multimodal integration in distributed networks. We discuss how the gain of distributed networks may be tuned to enable the behavioral repertoire of these systems, and argue that insect premotor networks might compensate for their limited neuronal population size by, in comparison to vertebrate networks, relying more heavily on the specificity of their connections. At a time in which connectomics and physiological recording techniques enable anatomical and functional circuit dissection at an unprecedented resolution, insect motor systems offer unique opportunities to identify the mechanisms underlying multimodal integration for flexible motor control.

Environmental force sensing helps robots traverse cluttered large obstacles

Robots can traverse sparse obstacles by sensing environmental geometry and avoiding contact with obstacles. However, for search and rescue in rubble, environmental monitoring through dense vegetation, and planetary exploration over Martian and lunar rocks, robots must traverse cluttered obstacles as large as themselves by physically interacting with them. Previous work discovered that the forest floor-dwelling discoid cockroach and a sensor-less minimalistic robot can traverse cluttered grass-like beam obstacles of various stiffness by transitioning across different locomotor modes. Yet the animal was better at traversal than the sensor-less robot, likely by sensing forces during obstacle interaction to control its locomotor transitions. Inspired by this, here we demonstrated in simulation that environmental force sensing helps robots traverse cluttered large obstacles. First, we developed a multi-body dynamics simulation and a physics model of the minimalistic robot interacting with beams to estimate beam stiffness from the sensed contact forces. Then, we developed a force feedback strategy for the robot to use the sensed beam stiffness to choose the locomotor mode with a lower mechanical energy cost. With feedforward pushing, the robot was stuck in front of stiff beams if it has a limited force capacity; without force limit, it traversed but suffered a high energy cost. Using obstacle avoidance, the robot traversed beams by avoiding beam contact regardless of beam stiffness, resulting in a high energy cost for flimsy beams. With force feedback, the robot determined beam stiffness, then traversed flimsy beams by pushing them over and stiff beams by rolling through the gap between them with a low energy cost. Stiffness estimation based on force sensing was accurate across varied body oscillation amplitude and frequency and position sensing uncertainty. Mechanical energy cost of traversal increased with sensorimotor delay. Future work should demonstrate cluttered large obstacle traversal using force feedback in a physical robot.

Gravisensation and modulation of gravitactic responses by other sensory cues in the monarch butterfly (Danaus plexippus)

Using the monarch butterfly (Danaus plexippus), we studied how animals can use cues from multiple sensory modalities for deriving directional information from their environment to display oriented movement. Our work focused on determining how monarchs use gravity as a cue for oriented movement and determined how cues from other sensory modalities, cues that by themselves also produce oriented movement (visual and magnetic directional cues), might modulate gravisensation. In two tests of gravisensation (movement in a vertical tube; righting behavior), we found that monarchs display negative gravitaxis only (movement opposite to the direction of gravity). Negative gravitaxis can be modulated by either visual (light) or magnetic field cues (inclination angle) that provide directional information. The modulation of gravity-mediated responses, however, depends on the relationship between cues when presented during trials, such as when cues are in accord or in conflict. For example, when light cues that elicit positive phototaxis conflicted with negative gravitaxis (light from below the monarch), monarch gravisensation was unaffected by directional light cues. We also found that the antennae play a role in gravity-mediated movement (righting), as, with antennae removed, monarch movement behavior was no longer the same as when the antennae were intact. Our results demonstrate that monarchs can use and integrate multiple, multimodal cues for oriented movement, but that the use of such cues can be hierarchical (that is, one cue dominant for movement), and the hierarchy of cues, and the responses towards them when found together, depends on the physical relationships between cues during movement.

Mechanosensory Control of Locomotion in Animals and Robots: Moving Forward

While animals swim, crawl, walk, and fly with apparent ease, building robots capable of robust locomotion remains a significant challenge. In this review, we draw attention to mechanosensation-the sensing of mechanical forces generated within and outside the body-as a key sense that enables robust locomotion in animals. We discuss differences between mechanosensation in animals and current robots with respect to (1) the encoding properties and distribution of mechanosensors and (2) the integration and regulation of mechanosensory feedback. We argue that robotics would benefit greatly from a detailed understanding of these aspects in animals. To that end, we highlight promising experimental and engineering approaches to study mechanosensation, emphasizing the mutual benefits for biologists and engineers that emerge from moving forward together.

Sensory fusion in the hoverfly righting reflex

We study how falling hoverflies use sensory cues to trigger appropriate roll righting behavior. Before being released in a free fall, flies were placed upside-down with their legs contacting the substrate. The prior leg proprioceptive information about their initial orientation sufficed for the flies to right themselves properly. However, flies also use visual and antennal cues to recover faster and disambiguate sensory conflicts. Surprisingly, in one of the experimental conditions tested, hoverflies flew upside-down while still actively flapping their wings. In all the other conditions, flies were able to right themselves using two roll dynamics: fast ([Formula: see text]50ms) and slow ([Formula: see text]110ms) in the presence of consistent and conflicting cues, respectively. These findings suggest that a nonlinear sensory integration of the three types of sensory cues occurred. A ring attractor model was developed and discussed to account for this cue integration process.

Salience of multisensory feedback regulates behavioral variability

Many animal behaviors are robust to dramatic variations in morphophysiological features, both across and within individuals. The control strategies that animals use to achieve such robust behavioral performances are not known. Recent evidence suggests that animals rely on sensory feedback rather than precise tuning of neural controllers for robust control. Here we examine the structure of sensory feedback, including multisensory feedback, for robust control of animal behavior. We re-examined two recent datasets of refuge tracking responses ofEigenmannia virescens, a species of weakly electric fish.Eigenmanniarely on both the visual and electrosensory cues to track the position of a moving refuge. The datasets include experiments that varied the strength of visual and electrosensory signals. Our analyses show that increasing the salience (perceptibility) of visual or electrosensory signals resulted in more robust and precise behavioral responses. Further, we find that robust performance was enhanced by multisensory integration of simultaneous visual and electrosensory cues. These findings suggest that engineers may achieve better system performance by improving the salience of multisensory feedback rather than solely focusing on precisely tuned controllers.

Learning to feed in the dark: how light level influences feeding in the hawkmoth Manduca sexta

Nocturnal insects like moths are essential for pollination, providing resilience to the diurnal pollination networks. Moths use both vision and mechanosensation to locate the nectary opening in the flowers with their proboscis. However, increased light levels due to artificial light at night (ALAN) pose a serious threat to nocturnal insects. Here, we examined how light levels influence the efficacy by which the crepuscular hawkmoth Manduca sexta locates the nectary. We used three-dimensional-printed artificial flowers fitted with motion sensors in the nectary and machine vision to track the motion of hovering moths under two light levels: 0.1 lux (moonlight) and 50 lux (dawn/dusk). We found that moths in higher light conditions took significantly longer to find the nectary, even with repeated visits to the same flower. In addition to taking longer, moths in higher light conditions hovered further from the flower during feeding. Increased light levels adversely affect learning and motor control in these animals.

The Dome: A virtual reality apparatus for freely locomoting rodents

The cognitive map in the hippocampal formation of rodents and other mammals integrates multiple classes of sensory and motor information into a coherent representation of space. Here, we describe the Dome, a virtual reality apparatus for freely locomoting rats, designed to examine the relative contributions of various spatial inputs to an animal’s spatial representation. The Dome was designed to preserve the range of spatial inputs typically available to an animal in free, untethered locomotion while providing the ability to perturb specific sensory cues. We present the design rationale and corresponding specifications of the Dome, along with a variety of engineering and biological analyses to validate the efficacy of the Dome as an experimental tool to examine the interaction between visual information and path integration in place cells in rodents.

De novo learning versus adaptation of continuous control in a manual tracking task

How do people learn to perform tasks that require continuous adjustments of motor output, like riding a bicycle? People rely heavily on cognitive strategies when learning discrete movement tasks, but such time-consuming strategies are infeasible in continuous control tasks that demand rapid responses to ongoing sensory feedback. To understand how people can learn to perform such tasks without the benefit of cognitive strategies, we imposed a rotation/mirror reversal of visual feedback while participants performed a continuous tracking task. We analyzed behavior using a system identification approach, which revealed two qualitatively different components of learning: adaptation of a baseline controller and formation of a new, task-specific continuous controller. These components exhibited different signatures in the frequency domain and were differentially engaged under the rotation/mirror reversal. Our results demonstrate that people can rapidly build a new continuous controller de novo and can simultaneously deploy this process with adaptation of an existing controller.

Tails, Flails, and Sails: How Appendages Improve Terrestrial Maneuverability by Improving Stability

Trade-offs in maneuverability and stability are essential in ecologically relevant situations with respect to robustness of locomotion, with multiple strategies apparent in animal model systems depending on their habitat and ecology. Free appendages such as tails and ungrounded limbs may assist in navigating this trade-off by assisting with balance, thereby increasing the acceleration that can be achieved without destabilizing the body. This comparative analysis explores the inertial mechanisms and, in some cases, fluid dynamic mechanisms by which appendages contribute to the stabilization of gait and perturbation response behaviors in a wide variety of animals. Following a broad review of examples from nature and bio-inspired robotics that illustrate the importance of appendages to the control of body orientation, two specific cases are examined through preliminary experiments: the role of arm motion in bipedal gait termination is explored using trajectory optimization, and the role of the cheetah’s tail during a deceleration maneuver is analyzed based on motion capture data. In both these examples, forward rotation of the appendage in question is found to counteract the unwanted forward pitch caused by the braking forces. It is theorized that this stabilizing action may facilitate more rapid deceleration by allowing larger or longer-acting braking forces to be applied safely.

Tail Beat Synchronization during Schooling Requires a Functional Posterior Lateral Line System in Giant Danios, Devario aequipinnatus

Swimming in schools has long been hypothesized to allow fish to save energy. Fish must exploit the energy from the wakes of their neighbors for maximum energy savings, a feat that requires them to both synchronize their tail movements and stay in certain positions relative to their neighbors. To maintain position in a school, we know that fish use multiple sensory systems, mainly their visual and flow sensing lateral line system. However, how fish synchronize their swimming movements in a school is still not well understood. Here, we test the hypothesis that this synchronization may depend on functional differences in the two branches of the lateral line sensory system that detects water movements close to the fish's body. The anterior branch, located on the head, encounters largely undisturbed free-stream flow, while the posterior branch, located on the trunk and tail, encounters flow that has been affected strongly by the tail movement. Thus, we hypothesize that the anterior branch may be more important for regulating position within the school, while the posterior branch may be more important for synchronizing tail movements. Our study examines functional differences in the anterior and posterior lateral line in the structure and tail synchronization of fish schools. We used a widely available aquarium fish that schools, the giant danio, Devario equipinnatus. Fish swam in a large circular tank where stereoscopic videos recordings were used to reconstruct the 3D position of each individual within the school and to track tail kinematics to quantify synchronization. For one fish in each school, we ablated using cobalt chloride either the anterior region only, the posterior region only, or the entire lateral line system. We observed that ablating any region of the lateral line system causes fish to swim in a "box" or parallel swimming formation, which was different from the diamond formation observed in normal fish. Ablating only the anterior region did not substantially reduce tail beat synchronization but ablating only the posterior region caused fish to stop synchronizing their tail beats, largely because the tail beat frequency increased dramatically. Thus, the anterior and posterior lateral line system appears to have different behavioral functions in fish. Most importantly, we showed that the posterior lateral line system played a major role in determining tail beat synchrony in schooling fish. Without synchronization, swimming efficiency decreases, which can have an impact on the fitness of the individual fish and group.

Multimodal integration across spatiotemporal scales to guide invertebrate locomotion

Locomotion is a hallmark of organisms that has enabled adaptive radiation to an extraordinarily diverse class of ecological niches, and allows animals to move across vast distances. Sampling from multiple sensory modalities enables animals to acquire rich information to guide locomotion. Locomotion without sensory feedback is haphazard, therefore sensory and motor systems have evolved complex interactions to generate adaptive behavior. Notably, sensory-guided locomotion acts over broad spatial and temporal scales to permit goal-seeking behavior, whether to localize food by tracking an attractive odor plume or to search for a potential mate. How does the brain integrate multimodal stimuli over different temporal and spatial scales to effectively control behavior? In this review, we classify locomotion into three ordinally ranked hierarchical layers that act over distinct spatiotemporal scales: stabilization, motor primitives, and higher-order tasks, respectively. We discuss how these layers present unique challenges and opportunities for sensorimotor integration. We focus on recent advances in invertebrate locomotion due to their accessible neural and mechanical signals from the whole brain, limbs and sensors. Throughout, we emphasize neural-level description of computations for multimodal integration in genetic model systems, including the fruit fly, Drosophila melanogaster, and the yellow fever mosquito, Aedes aegypti. We identify that summation (e.g. gating) and weighting-which are inherent computations of spiking neurons-underlie multimodal integration across spatial and temporal scales, therefore suggesting collective strategies to guide locomotion.

Remote radio control of insect flight reveals why beetles lift their legs in flight while other insects tightly fold

In the research and development of micro air vehicles, understanding and imitating the flight mechanism of insects presents a viable way of progressing forward. While research is being conducted on the flight mechanism of insects such as flies and dragonflies, research on beetles that can carry larger loads is limited. Here, we clarified the beetle midlegs' role in the attenuation and cessation of the wingbeat. We anatomically confirmed the connection between the midlegs and the elytra. We also further clarified which pair of legs are involved in the wingbeat attenuation mechanism, and lastly demonstrated free-flight control via remote leg muscle stimulation. Observation of multiple landings using a high-speed camera revealed that the wingbeat stopped immediately after their midlegs were lowered. Moreover, the action of lowering the midleg attenuated and often stopped the wingbeat. A miniature remote stimulation device (backpack) mountable on beetles was designed and utilized for the free-flight demonstration. Beetles in free flight were remotely induced into lowering (swing down) each leg pair via electrical stimulation, and they were found to lose significant altitude only when the midlegs were stimulated. Thus, the results of this study revealed that swinging down of the midlegs played a significant role in beetle wingbeat cessation. In the future, our findings on the wingbeat attenuation and cessation mechanism are expected to be helpful in designing bioinspired micro air vehicles.

Wing damage affects flight kinematics but not flower tracking performance in hummingbird hawkmoths

Wing integrity is crucial to the many insect species that spend distinct portions of their life in flight. How insects cope with the consequences of wing damage is therefore a central question when studying how robust flight performance is possible with such fragile chitinous wings. It has been shown in a variety of insect species that the loss in lift-force production resulting from wing damage is generally compensated by an increase in wing beat frequency rather than amplitude. The consequences of wing damage for flight performance, however, are less well understood, and vary considerably between species and behavioural tasks. One hypothesis reconciling the varying results is that wing damage might affect fast flight manoeuvres with high acceleration, but not slower ones. To test this hypothesis, we investigated the effect of wing damage on the manoeuvrability of hummingbird hawkmoths (Macroglossum stellatarum) tracking a motorised flower. This assay allowed us to sample a range of movements at different temporal frequencies, and thus assess whether wing damage affected faster or slower flight manoeuvres. We show that hummingbird hawkmoths compensate for the loss in lift force mainly by increasing wing beat amplitude, yet with a significant contribution of wing beat frequency. We did not observe any effects of wing damage on flight manoeuvrability at either high or low temporal frequencies.

Tactile active sensing in an insect plant pollinator

The interaction between insects and the flowers they pollinate has driven the evolutionary diversity of both insects and flowering plants, two groups with the most numerous species on Earth. Insects use vision and olfaction to localize host plants, but we know relatively little about how they find the tiny nectary opening in the flower, which can be well beyond their visual resolution. Especially when vision is limited, touch becomes crucial in successful insect-plant pollination interactions. Here, we studied the remarkable feeding behavior of crepuscular hawkmoths Manduca sexta, which use their long, actively controlled, proboscis to expertly explore flower-like surfaces. Using machine vision and 3D-printed artificial flower-like feeders, we revealed a novel behavior that shows moths actively probe surfaces, sweeping their proboscis from the feeder edge to its center repeatedly until they locate the nectary opening. Moreover, naive moths rapidly learn to exploit these flowers, and they adopt a tactile search strategy to more directly locate the nectary opening in as few as three to five consecutive visits. Our results highlight the proboscis as a unique active sensory structure and emphasize the central role of touch in nectar foraging insect-plant pollinator interactions.

The neuroecology of insect-plant interactions: the importance of physiological state and sensory integration

Natural behaviorally important stimuli are combinations of cues that are integrated by the nervous system to elicit behavior. Nonetheless, these cues dynamically change in time and space. In turn, the animal's internal state can cause changes in the encoding and representation of these stimuli. Despite abundant behavioral examples, links between the neural bases of sensory integration and the internal state-dependency of these responses remains an active study area. Recent studies in different insect models have provided new insights into how plasticity and the insect's internal state may influence odor representation. These studies show that complex stimuli are represented in unique percepts that are different from their sensory channels and that the representations may be modulated by physiological state.

Temperature-robust activity patterns arise from coordinated axonal Sodium channel properties

Action potentials are a key component of neuronal communication and their precise timing is critical for processes like learning, memory, and complex behaviors. Action potentials propagate through long axons to their postsynaptic partners, which requires axons not only to faithfully transfer action potentials to distant synaptic regions but also to maintain their timing. This is particularly challenging when axons differ in their morphological and physiological properties, as timing is predicted to diverge between these axons when extrinsic conditions change. It is unknown if and how diverse axons maintain timing during temperature changes that animals and humans encounter. We studied whether ambient temperature changes cause different timing in the periphery of neurons that centrally produce temperature-robust activity. In an approach combining modeling, imaging, and electrophysiology, we explored mechanisms that support timing by exposing the axons of three different neuron types from the same crustacean (Cancer borealis) motor circuit and involved in the same functional task to a range of physiological temperatures. We show that despite substantial differences between axons, the effects of temperature on action potential propagation were moderate and supported temperature-robust timing over long-distances. Our modeling demonstrates that to maintain timing, the underlying channel properties of these axons do not need to be temperature-insensitive or highly restricted, but coordinating the temperature sensitivities of the Sodium activation gate time constant and the maximum Sodium conductance is required. Thus, even highly temperature-sensitive ion channel properties can support temperature-robust timing between distinct neuronal types and across long distances.

Variability in locomotor dynamics reveals the critical role of feedback in task control

Animals vary considerably in size, shape, and physiological features across individuals, but yet achieve remarkably similar behavioral performances. We examined how animals compensate for morphophysiological variation by measuring the system dynamics of individual knifefish (Eigenmannia virescens) in a refuge tracking task. Kinematic measurements of Eigenmannia were used to generate individualized estimates of each fish’s locomotor plant and controller, revealing substantial variability between fish. To test the impact of this variability on behavioral performance, these models were used to perform simulated ‘brain transplants’—computationally swapping controllers and plants between individuals. We found that simulated closed-loop performance was robust to mismatch between plant and controller. This suggests that animals rely on feedback rather than precisely tuned neural controllers to compensate for morphophysiological variability.

People come in different shapes and sizes, but most will perform similarly well if asked to complete a task requiring fine manual dexterity – such as holding a pen or picking up a single grape. How can different individuals, with different sized hands and muscles, produce such similar movements? One explanation is that an individual’s brain and nervous system become precisely tuned to mechanics of the body’s muscles and skeleton. An alternative explanation is that brain and nervous system use a more “robust” control policy that can compensate for differences in the body by relying on feedback from the senses to guide the movements.

To distinguish between these two explanations, Uyanik et al. turned to weakly electric freshwater fish known as glass knifefish. These fish seek refuge within root systems, reed grass and among other objects in the water. They swim backwards and forwards to stay hidden despite constantly changing currents. Each fish shuttles back and forth by moving a long ribbon-like fin on the underside of its body. Uyanik et al. measured the movements of the ribbon fin under controlled conditions in the laboratory, and then used the data to create computer models of the brain and body of each fish. The models of each fish’s brain and body were quite different.

To study how the brain interacts with the body, Uyanik et al. then conducted experiments reminiscent of those described in the story of Frankenstein and transplanted the brain from each computer model into the body of different model fish. These “brain swaps” had almost no effect on the model’s simulated swimming behavior. Instead, these “Frankenfish” used sensory feedback to compensate for any mismatch between their brain and body.

This suggests that, for some behaviors, an animal’s brain does not need to be precisely tuned to the specific characteristics of its body. Instead, robust control of movement relies on many seemingly redundant systems that provide sensory feedback. This has implications for the field of robotics. It further suggests that when designing robots, engineers should prioritize enabling the robots to use sensory feedback to cope with unexpected events, a well-known idea in control engineering.

Tuneable reflexes control antennal positioning in flying hawkmoths

Complex behaviours may be viewed as sequences of modular actions, each elicited by specific sensory cues in their characteristic timescales. From this perspective, we can construct models in which unitary behavioural modules are hierarchically placed in context of related actions. Here, we analyse antennal positioning reflex in hawkmoths as a tuneable behavioural unit. Mechanosensory feedback from two antennal structures, Böhm’s bristles (BB) and Johnston’s organs (JO), determines antennal position. At flight onset, antennae attain a specific position, which is maintained by feedback from BB. Simultaneously, JO senses deflections in flagellum-pedicel joint due to frontal airflow, to modulate its steady-state position. Restricting JO abolishes positional modulation but maintains stability against perturbations. Linear feedback models are sufficient to predict antennal dynamics at various set-points. We modelled antennal positioning as a hierarchical neural-circuit in which fast BB feedback maintains instantaneous set-point, but slow JO feedback modulates it, thereby elucidating mechanisms underlying its robustness and flexibility.

Flying insects position their antennae by integrating multisensory inputs across different timescales. This study describes an underlying hierarchical neural circuit that maintains antennal position in a fast and robust manner, whilst retaining flexibility to incorporate slower feedback to modulate position.

Complementary spatial and timing control in rhythmic arm movements

Volitional rhythmic motor behaviors such as limb cycling and locomotion exhibit spatial and timing regularity. Such rhythmic movements are executed in the presence of exogenous visual and nonvisual cues, and previous studies have shown the pivotal role that vision plays in guiding spatial and temporal regulation. However, the influence of nonvisual information conveyed through auditory or touch sensory pathways, and its effect on control, remains poorly understood. To characterize the function of nonvisual feedback in rhythmic arm control, we designed a paddle juggling task in which volunteers bounced a ball off a rigid elastic surface to a target height in virtual reality by moving a physical handle with the right hand. Feedback was delivered at two key phases of movement: visual feedback at ball peaks only and simultaneous audio and haptic feedback at ball-paddle collisions. In contrast to previous work, we limited visual feedback to the minimum required for jugglers to assess spatial accuracy, and we independently perturbed the spatial dimensions and the timing of feedback. By separately perturbing this information, we evoked dissociable effects on spatial accuracy and timing, confirming that juggling, and potentially other rhythmic tasks, involves two complementary processes with distinct dynamics: spatial error correction and feedback timing synchronization. Moreover, we show evidence that audio and haptic feedback provide sufficient information for the brain to control the timing synchronization process by acting as a metronome-like cue that triggers hand movement. NEW & NOTEWORTHY Vision contains rich information for control of rhythmic arm movements; less is known, however, about the role of nonvisual feedback (touch and sound). Using a virtual ball bouncing task allowing independent real-time manipulation of spatial location and timing of cues, we show their dissociable roles in regulating motor behavior. We confirm that visual feedback is used to correct spatial error and provide new evidence that nonvisual event cues act to reset the timing of arm movements.

Fuelling on the wing: sensory ecology of hawkmoth foraging

Hawkmoths (Lepidoptera, Sphingidae) comprise around 1500 species, most of which forage on nectar from flowers in their adult stage, usually while hovering in front of the flower. The majority of species have a nocturnal lifestyle and are important nocturnal pollinators, but some species have turned to a diurnal lifestyle. Hawkmoths use visual and olfactory cues including CO₂ and humidity to detect and recognise rewarding flowers; they find the nectary in the flowers by means of mechanoreceptors on the proboscis and vision, evaluate it with gustatory receptors on the proboscis, and control their hovering flight position using antennal mechanoreception and vision. Here, we review what is presently known about the sensory organs and sensory-guided behaviour that control feeding behaviour of this fascinating pollinator taxon. We also suggest that more experiments on hawkmoth behaviour in natural settings are needed to fully appreciate their sensory capabilities.

The roles of vision and antennal mechanoreception in hawkmoth flight control

Flying animals need continual sensory feedback about their body position and orientation for flight control. The visual system provides essential but slow feedback. In contrast, mechanosensory channels can provide feedback at much shorter timescales. How the contributions from these two senses are integrated remains an open question in most insect groups. In Diptera, fast mechanosensory feedback is provided by organs called halteres and is crucial for the control of rapid flight manoeuvres, while vision controls manoeuvres in lower temporal frequency bands. Here, we have investigated the visual-mechanosensory integration in the hawkmoth Macroglossum stellatarum. They represent a large group of insects that use Johnston’s organs in their antennae to provide mechanosensory feedback on perturbations in body position. Our experiments show that antennal mechanosensory feedback specifically mediates fast flight manoeuvres, but not slow ones. Moreover, we did not observe compensatory interactions between antennal and visual feedback.

Insect and insect-inspired aerodynamics: unsteadiness, structural mechanics and flight control

Flying insects impress by their versatility and have been a recurrent source of inspiration for engineering devices. A large body of literature has focused on various aspects of insect flight, with an essential part dedicated to the dynamics of flapping wings and their intrinsically unsteady aerodynamic mechanisms. Insect wings flex during flight and a better understanding of structural mechanics and aeroelasticity is emerging. Most recently, insights from solid and fluid mechanics have been integrated with physiological measurements from visual and mechanosensors in the context of flight control in steady airs and through turbulent conditions. We review the key recent advances concerning flight in unsteady environments and how the multi-body mechanics of the insect structure-wings and body-are at the core of the flight control question. The issues herein should be considered when applying bio-informed design principles to robotic flapping wings.

Hawkmoth flight in the unsteady wakes of flowers

Flying animals maneuver and hover through environments where wind gusts and flower wakes produce unsteady flow. Although both flight maneuvers and aerodynamic mechanisms have been studied independently, little is known about how these interact in an environment where flow is already unsteady. Moths forage from flowers by hovering in the flower's wake. We investigated hawkmoths tracking a 3D-printed robotic flower in a wind tunnel. We visualized the flow in the wake and around the wings and compared tracking performance with previous experiments in a still-air flight chamber. As in still air, moths flying in the flower wake exhibit near-perfect tracking at the low frequencies at which natural flowers move. However, tracking in the flower wake results in a larger overshoot between 2 and 5 Hz. System identification of flower tracking reveals that moths also display reduced-order dynamics in wind compared with still air. Smoke visualization of the flower wake shows that the dominant vortex shedding corresponds to the same frequency band as the increased overshoot. Despite these large effects on tracking dynamics in wind, the leading edge vortex (LEV) remains bound to the wing throughout the wingstroke and does not burst. The LEV also maintains the same qualitative structure seen in steady air. Persistence of a stable LEV during decreased flower tracking demonstrates the interplay between hovering and maneuvering.

Sensory Feedback and Animal Locomotion: Perspectives from Biology and Biorobotics: An Introduction to the Symposium

The successful completion of many behaviors relies on sensory feedback. This symposium brought together researchers using novel techniques to study how different stimuli are encoded, how and where multimodal feedback is integrated, and how feedback modulates motor output in diverse modes of locomotion (aerial, aquatic, and terrestrial) in a diverse range of taxa (insects, fish, tetrapods), and in robots. Similar to biological organisms, robots can be equipped with integrated sensors and can rely on sensory feedback to adjust the output signal of a controller. Engineers often look to biology for inspiration on how animals have evolved solutions to problems similar to those experienced in robotic movement. Similarly, biologists too must proactively engage with engineers to apply computer and robotic models to test hypotheses and answer questions on the capacity and roles of sensory feedback in generating effective movement. Through a diverse group of researchers, including both biologists and engineers, the symposium attempted to catalyze new interdisciplinary collaborations and identify future research directions for the development of bioinspired sensory control systems, as well as the use of robots to test hypotheses in neuromechanics.

Multimodal sensory information is represented by a combinatorial code in a sensorimotor system

A ubiquitous feature of the nervous system is the processing of simultaneously arriving sensory inputs from different modalities. Yet, because of the difficulties of monitoring large populations of neurons with the single resolution required to determine their sensory responses, the cellular mechanisms of how populations of neurons encode different sensory modalities often remain enigmatic. We studied multimodal information encoding in a small sensorimotor system of the crustacean stomatogastric nervous system that drives rhythmic motor activity for the processing of food. This system is experimentally advantageous, as it produces a fictive behavioral output in vitro, and distinct sensory modalities can be selectively activated. It has the additional advantage that all sensory information is routed through a hub ganglion, the commissural ganglion, a structure with fewer than 220 neurons. Using optical imaging of a population of commissural neurons to track each individual neuron's response across sensory modalities, we provide evidence that multimodal information is encoded via a combinatorial code of recruited neurons. By selectively stimulating chemosensory and mechanosensory inputs that are functionally important for processing of food, we find that these two modalities were processed in a distributed network comprising the majority of commissural neurons imaged. In a total of 12 commissural ganglia, we show that 98% of all imaged neurons were involved in sensory processing, with the two modalities being processed by a highly overlapping set of neurons. Of these, 80% were multimodal, 18% were unimodal, and only 2% of the neurons did not respond to either modality. Differences between modalities were represented by the identities of the neurons participating in each sensory condition and by differences in response sign (excitation versus inhibition), with 46% changing their responses in the other modality. Consistent with the hypothesis that the commissural network encodes different sensory conditions in the combination of activated neurons, a new combination of excitation and inhibition was found when both pathways were activated simultaneously. The responses to this bimodal condition were distinct from either unimodal condition, and for 30% of the neurons, they were not predictive from the individual unimodal responses. Thus, in a sensorimotor network, different sensory modalities are encoded using a combinatorial code of neurons that are activated or inhibited. This provides motor networks with the ability to differentially respond to categorically different sensory conditions and may serve as a model to understand higher-level processing of multimodal information.

Responses to mechanically and visually cued water waves in the nervous system of the medicinal leech

Sensitivity to water waves is a key modality by which aquatic predators can detect and localize their prey. For one such predator - the medicinal leech, Hirudo verbana - behavioral responses to visual and mechanical cues from water waves are well documented. Here, we quantitatively characterized the response patterns of a multisensory interneuron, the S cell, to mechanically and visually cued water waves. As a function of frequency, the response profile of the S cell replicated key features of the behavioral prey localization profile in both visual and mechanical modalities. In terms of overall firing rate, the S cell response was not direction selective, and although the direction of spike propagation within the S cell system did follow the direction of wave propagation under certain circumstances, it is unlikely that downstream neuronal targets can use this information. Accordingly, we propose a role for the S cell in the detection of waves but not in the localization of their source. We demonstrated that neither the head brain nor the tail brain are required for the S cell to respond to visually cued water waves.

Neural evidence supports a dual sensory-motor role for insect wings

Flying insects use feedback from various sensory modalities including vision and mechanosensation to navigate through their environment. The rapid speed of mechanosensory information acquisition and processing compensates for the slower processing times associated with vision, particularly under low light conditions. While halteres in dipteran species are well known to provide such information for flight control, less is understood about the mechanosensory roles of their evolutionary antecedent, wings. The features that wing mechanosensory neurons (campaniform sensilla) encode remains relatively unexplored. We hypothesized that the wing campaniform sensilla of the hawkmoth, Manduca sexta, rapidly and selectively extract mechanical stimulus features in a manner similar to halteres. We used electrophysiological and computational techniques to characterize the encoding properties of wing campaniform sensilla. To accomplish this, we developed a novel technique for localizing receptive fields using a focused IR laser that elicits changes in the neural activity of mechanoreceptors. We found that (i) most wing mechanosensors encoded mechanical stimulus features rapidly and precisely, (ii) they are selective for specific stimulus features, and (iii) there is diversity in the encoding properties of wing campaniform sensilla. We found that the encoding properties of wing campaniform sensilla are similar to those for haltere neurons. Therefore, it appears that the neural architecture that underlies the haltere sensory function is present in wings, which lends credence to the notion that wings themselves may serve a similar sensory function. Thus, wings may not only function as the primary actuator of the organism but also as sensors of the inertial dynamics of the animal.

Parameters of motion vision in low-light in the hawkmoth, Manduca sexta

The hawkmoth Manduca sexta, is nocturnally active, beginning its flight activity at sunset, and executing rapid controlled maneuvers to search for food and mates in dim light conditions. This moth's visual system has been shown to trade off spatial and temporal resolution for increased sensitivity in these conditions. The study presented here uses tethered flying moths to characterize the flight performance envelope of M. sexta's wide-field-motion-triggered steering response in low light conditions by measuring attempted turning in response to wide-field visual motion. Moths were challenged with a horizontally oscillating sinusoidal grating at a range of luminance, from daylight to starlight conditions. The impact of luminance on response to a range of temporal frequencies and spatial wavelengths was assessed across a range of pattern contrasts. The optomotor response decreased as a function of decreasing luminance, and the lower limit of the moth's contrast sensitivity was found to be between 1% to 5%. The preferred spatial frequency for M. sexta increased from 0.06 to 0.3 cycles/degree as the luminance decreased, but the preferred temporal frequency remained stable at 4.5 Hz across all conditions. The relationship between the optomotor response time to the temporal frequency of the pattern movement did not vary significantly with luminance levels. Taken together, these results suggest that the behavioral response to wide-field visual input in M. sexta is adapted to operate during crepuscular to nocturnal luminance levels, and the decreasing light levels experienced during that period changes visual acuity and does not affect their response time significantly.

Comparative system identification of flower tracking performance in three hawkmoth species reveals adaptations for dim light vision

Flight control in insects is heavily dependent on vision. Thus, in dim light, the decreased reliability of visual signal detection also prompts consequences for insect flight. We have an emerging understanding of the neural mechanisms that different species employ to adapt the visual system to low light. However, much less explored are comparative analyses of how low light affects the flight behaviour of insect species, and the corresponding links between physiological adaptations and behaviour. We investigated whether the flower tracking behaviour of three hawkmoth species with different diel activity patterns revealed luminance-dependent adaptations, using a system identification approach. We found clear luminance-dependent differences in flower tracking in all three species, which were explained by a simple luminance-dependent delay model, which generalized across species. We discuss physiological and anatomical explanations for the variance in tracking responses, which could not be explained by such simple models. Differences between species could not be explained by the simple delay model. However, in several cases, they could be explained through the addition on a second model parameter, a simple scaling term, that captures the responsiveness of each species to flower movements. Thus, we demonstrate here that much of the variance in the luminance-dependent flower tracking responses of hawkmoths with different diel activity patterns can be captured by simple models of neural processing.This article is part of the themed issue 'Vision in dim light'.

Dynamic modulation of visual and electrosensory gains for locomotor control

Animal nervous systems resolve sensory conflict for the control of movement. For example, the glass knifefish, Eigenmannia virescens, relies on visual and electrosensory feedback as it swims to maintain position within a moving refuge. To study how signals from these two parallel sensory streams are used in refuge tracking, we constructed a novel augmented reality apparatus that enables the independent manipulation of visual and electrosensory cues to freely swimming fish (n = 5). We evaluated the linearity of multisensory integration, the change to the relative perceptual weights given to vision and electrosense in relation to sensory salience, and the effect of the magnitude of sensory conflict on sensorimotor gain. First, we found that tracking behaviour obeys superposition of the sensory inputs, suggesting linear sensorimotor integration. In addition, fish rely more on vision when electrosensory salience is reduced, suggesting that fish dynamically alter sensorimotor gains in a manner consistent with Bayesian integration. However, the magnitude of sensory conflict did not significantly affect sensorimotor gain. These studies lay the theoretical and experimental groundwork for future work investigating multisensory control of locomotion.