Side-to-side head movements to obtain motion depth cues: A short review of research on the praying mantis

Optic flow enrichment via Drosophila head and retina motions to support inflight position regulation

Developing a functional description of the neural control circuits and visual feedback paths underlying insect flight behaviors is an active research area. Feedback controllers incorporating engineering models of the insect visual system outputs have described some flight behaviors, yet they do not explain how insects are able to stabilize their body position relative to nearby targets such as neighbors or forage sources, especially in challenging environments in which optic flow is poor. The insect experimental community is simultaneously recording a growing library of in-flight head and eye motions that may be linked to increased perception. This study develops a quantitative model of the optic flow experienced by a flying insect or robot during head yawing rotations (distinct from lateral peering motions in previous work) with a single other target in view. This study then applies a model of insect visuomotor feedback to show via analysis and simulation of five species that these head motions sufficiently enrich the optic flow and that the output feedback can provide relative position regulation relative to the single target (asymptotic stability). In the simplifying case of pure rotation relative to the body, theoretical analysis provides a stronger stability guarantee. The results are shown to be robust to anatomical neck angle limits and body vibrations, persist with more detailed Drosophila lateral-directional flight dynamics simulations, and generalize to recent retinal motion studies. Together, these results suggest that the optic flow enrichment provided by head or pseudopupil rotation could be used in an insect's neural processing circuit to enable position regulation.

Wireless steerable vision for live insects and insect-scale robots

Vision serves as an essential sensory input for insects but consumes substantial energy resources. The cost to support sensitive photoreceptors has led many insects to develop high visual acuity in only small retinal regions and evolve to move their visual systems independent of their bodies through head motion. By understanding the trade-offs made by insect vision systems in nature, we can design better vision systems for insect-scale robotics in a way that balances energy, computation, and mass. Here, we report a fully wireless, power-autonomous, mechanically steerable vision system that imitates head motion in a form factor small enough to mount on the back of a live beetle or a similarly sized terrestrial robot. Our electronics and actuator weigh 248 milligrams and can steer the camera over 60° based on commands from a smartphone. The camera streams "first person" 160 pixels-by-120 pixels monochrome video at 1 to 5 frames per second (fps) to a Bluetooth radio from up to 120 meters away. We mounted this vision system on two species of freely walking live beetles, demonstrating that triggering image capture using an onboard accelerometer achieves operational times of up to 6 hours with a 10-milliamp hour battery. We also built a small, terrestrial robot (1.6 centimeters by 2 centimeters) that can move at up to 3.5 centimeters per second, support vision, and operate for 63 to 260 minutes. Our results demonstrate that steerable vision can enable object tracking and wide-angle views for 26 to 84 times lower energy than moving the whole robot.

Strategies of locomotion composition

This review aims to highlight the importance of saccades during locomotion as a strategy to reduce sensory information loss while the subject is moving. Acquiring sensory data from the environment during movement results in a temporal flow of information, as the sensory precept changes with the position of the observer. Accordingly, the movement pattern shapes the sensory flow. Therefore, the requirements of locomotion and sensation have to be balanced in the behaviour of the organism. Insect vision provides deep insight into the interplay between action and perception. Insects can shape their optic flow by reducing their rotational movements to fast and short saccades. This generates prolonged phases of translations which provide depth information. Extensive behavioural and physiological studies on insects show how shaping the optic flow facilitates the coding of motion vision. Indeed the saccadic strategy provides an elegant solution to optimise sensory flow. Complementary studies in other taxa reported similar locomotion strategies emphasising the crucial influence of sensory flow on locomotion.

The Dominant Role of Visual Motion Cues in Bumblebee Flight Control Revealed Through Virtual Reality

Flying bees make extensive use of optic flow: the apparent motion in the visual scene generated by their own movement. Much of what is known about bees' visually-guided flight comes from experiments employing real physical objects, which constrains the types of cues that can be presented. Here we implement a virtual reality system allowing us to create the visual illusion of objects in 3D space. We trained bumblebees, Bombus ignitus, to feed from a static target displayed on the floor of a flight arena, and then observed their responses to various interposing virtual objects. When a virtual floor was presented above the physical floor, bees were reluctant to descend through it, indicating that they perceived the virtual floor as a real surface. To reach a target at ground level, they flew through a hole in a virtual surface above the ground, and around an elevated virtual platform, despite receiving no reward for avoiding the virtual obstacles. These behaviors persisted even when the target was made (unrealistically) visible through the obstructing object. Finally, we challenged the bees with physically impossible ambiguous stimuli, which give conflicting motion and occlusion cues. In such cases, they behaved in accordance with the motion information, seemingly ignoring occlusion.

Monocular distance estimation with optical flow maneuvers and efference copies: a stability-based strategy

The visual cue of optical flow plays an important role in the navigation of flying insects, and is increasingly studied for use by small flying robots as well. A major problem is that successful optical flow control seems to require distance estimates, while optical flow is known to provide only the ratio of velocity to distance. In this article, a novel, stability-based strategy is proposed for monocular distance estimation, relying on optical flow maneuvers and knowledge of the control inputs (efference copies). It is shown analytically that given a fixed control gain, the stability of a constant divergence control loop only depends on the distance to the approached surface. At close distances, the control loop starts to exhibit self-induced oscillations. The robot can detect these oscillations and hence be aware of the distance to the surface. The proposed stability-based strategy for estimating distances has two main attractive characteristics. First, self-induced oscillations can be detected robustly by the robot and are hardly influenced by wind. Second, the distance can be estimated during a zero divergence maneuver, i.e., around hover. The stability-based strategy is implemented and tested both in simulation and on board a Parrot AR drone 2.0. It is shown that the strategy can be used to: (1) trigger a final approach response during a constant divergence landing with fixed gain, (2) estimate the distance in hover, and (3) estimate distances during an entire landing if the robot uses adaptive gain control to continuously stay on the 'edge of oscillation.'

Visually targeted reaching in horse-head grasshoppers

Visually targeted reaching to a specific object is a demanding neuronal task requiring the translation of the location of the object from a two-dimensionsal set of retinotopic coordinates to a motor pattern that guides a limb to that point in three-dimensional space. This sensorimotor transformation has been intensively studied in mammals, but was not previously thought to occur in animals with smaller nervous systems such as insects. We studied horse-head grasshoppers (Orthoptera: Proscopididae) crossing gaps and found that visual inputs are sufficient for them to target their forelimbs to a foothold on the opposite side of the gap. High-speed video analysis showed that these reaches were targeted accurately and directly to footholds at different locations within the visual field through changes in forelimb trajectory and body position, and did not involve stereotyped searching movements. The proscopids estimated distant locations using peering to generate motion parallax, a monocular distance cue, but appeared to use binocular visual cues to estimate the distance of nearby footholds. Following occlusion of regions of binocular overlap, the proscopids resorted to peering to target reaches even to nearby locations. Monocular cues were sufficient for accurate targeting of the ipsilateral but not the contralateral forelimb. Thus, proscopids are capable not only of the sensorimotor transformations necessary for visually targeted reaching with their forelimbs but also of flexibly using different visual cues to target reaches.

Hawk eyes II: diurnal raptors differ in head movement strategies when scanning from perches

Background

Relatively little is known about the degree of inter-specific variability in visual scanning strategies in species with laterally placed eyes (e.g., birds). This is relevant because many species detect prey while perching; therefore, head movement behavior may be an indicator of prey detection rate, a central parameter in foraging models. We studied head movement strategies in three diurnal raptors belonging to the Accipitridae and Falconidae families.

Methodology/Principal Findings

We used behavioral recording of individuals under field and captive conditions to calculate the rate of two types of head movements and the interval between consecutive head movements. Cooper's Hawks had the highest rate of regular head movements, which can facilitate tracking prey items in the visually cluttered environment they inhabit (e.g., forested habitats). On the other hand, Red-tailed Hawks showed long intervals between consecutive head movements, which is consistent with prey searching in less visually obstructed environments (e.g., open habitats) and with detecting prey movement from a distance with their central foveae. Finally, American Kestrels have the highest rates of translational head movements (vertical or frontal displacements of the head keeping the bill in the same direction), which have been associated with depth perception through motion parallax. Higher translational head movement rates may be a strategy to compensate for the reduced degree of eye movement of this species.

Conclusions

Cooper's Hawks, Red-tailed Hawks, and American Kestrels use both regular and translational head movements, but to different extents. We conclude that these diurnal raptors have species-specific strategies to gather visual information while perching. These strategies may optimize prey search and detection with different visual systems in habitat types with different degrees of visual obstruction.

Becoming airborne without legs: the kinematics of take-off in a flying snake, Chrysopelea paradisi

Among terrestrial vertebrate gliders, take-off presents a unique problem to flying snakes (Chrysopelea). Without legs, snakes must use fundamentally different kinematics to begin their aerial trajectories. To determine the effectiveness of different modes of take-off in a gliding snake (C. paradisi), I videotaped multiple views of take-off from a horizontal branch and quantified the two- and three-dimensional coordinates of three points on the snake's body. Performance values derived from these coordinates were used to describe take-off in C. paradisi, compare modes of take-off, and make predictions about the ecological use of take-off in the wild. Four types of take-off were identified. In most observed take-offs, snakes used a vertically looped take-off (termed 'anchored J-loop' and 'sliding J-loop'), which represent the only true jumping in snakes. In an anchored J-loop take-off, the snake formed an anterior hanging loop and then jumped by holding the posterior body static on the branch and accelerating up and away from the branch. This was the most commonly used take-off mode. A sliding J-loop take-off was similar but occurred with the entire body in motion. Snakes using such take-offs lowered less of their body below the branch than in an anchored J-loop take-off, resulting in shorter preparation and vertical acceleration durations and producing a lower maximum vertical velocity. However, these differences did not produce significant differences after the snakes were fully airborne and had started their aerial trajectories. The non-looped take-offs (termed ;dive' and ;fall') were the least kinematically complex. Compared to the non-looped take-offs, looped take-offs allowed snakes to reach higher, range farther, and attain greater speeds. Futhermore, snakes that launched with looped take-offs traveled farther over the course of a full glide trajectory when starting from a 10 m high perch. Take-off in C. paradisi is qualitatively similar to that in other species of Chrysopelea and may represent a suite of behaviors that preceded the evolution of gliding flight in snakes.

The role of edges in the selection of a jump target in Mantis religiosa

Before jumping to a landing object, praying mantids determine the distance, using information obtained from retinal image motion resulting from horizontal peering movements. The present study investigates the peering-jump behaviour of Mantis religiosa larvae with regard to jump targets differing in shape and size. The experimental animals were presented with square, triangular and round target objects with visual extensions of 20 degrees and 40 degrees. The cardboard objects, presented against a uniform white background, were solid black or shaded with a gradation from white to black. It was found that larger objects were preferred to smaller ones as jump targets, and that the square and triangle were preferred to the round disk. When two objects were presented, no preference was exhibited between square and triangular objects. However, when three objects were presented, the square was preferred. For targets with a visual angle of 40 degrees, the amplitude and velocity of the horizontal peering movements were greater for the round disk than for the square or triangle. This amplification of the peering movements suggests that weaker motion signals are generated in the case of curved edges. This may help to account for the preference for the square and triangle as jump targets.

Local mechanisms for the separation of optic flow-field components in the land crab,Cardisoma guanhumi: A role for motion parallax?

Although a number of global mechanisms have been proposed over the years that explain how crabs might separate the rotational and translational components of their optic flow field, there has been no evidence to date that local mechanisms such as motion parallax are used in this separation. We describe here a study that takes advantage of a recently developed suite of computer-generated visual stimuli that creates a three-dimensional world surrounding the crab in which we can simulate translational and rotational optic flow. We show that, while motion parallax is not the only mechanism used in flow-field separation, it does play a role in the recognition of translational optic flow fields in that, under conditions of low overall light intensity and low contrast ratio when crabs find the distinction between rotation and translation harder, smaller eye movements occur in response to translation when motion parallax cues are present than when they are absent. Thus, motion parallax is one of many cues that crabs use to separate rotational and translational optic flow by showing compensatory eye movements to only the former.

Behavioural-analytical studies of the role of head movements in depth perception in insects, birds and mammals

In this review, studies of the role of head movements in generating motion parallax which is used in depth perception are examined. The methods used and definitiveness of the results vary with the animal groups studied. In the case of insects, studies which quantify motor outputs have provided clear evidence that motion parallax evoked by head movements is used for distance estimation and depth perception. In the case of birds and rodents, training studies and analyses of the head movements themselves have provided similar indications. In the case of larger mammals, due to a lack of systematic experiments, the evidence is less conclusive.

Model of a predatory stealth behaviour camouflaging motion

A computational model of a stealth strategy inspired by the apparent mating tactics of male hoverflies is presented. The stealth strategy (motion camouflage) paradoxically allows a predator to approach a moving prey in such a way that it appears to be a stationary object. In the model, the predators are controlled by neural sensorimotor systems that base their decisions on realistic levels of input information. They are shown to be able to employ motion camouflage to approach prey that move along both real hoverfly flight paths and artificially generated flight paths. The camouflaged approaches made demonstrate that the control systems have an ability to predict future prey movements. This is illustrated using two- and three-dimensional simulations.

Motion detection in insect orientation and navigation

The visual systems of insects are exquisitely sensitive to motion. Over the past 40 years or so, motion processing in insects has been studied and characterised primarily through the optomotor response. This response, which is a turning response evoked by the apparent movement of the visual environment, serves to stabilise the insect's orientation with respect to the environment. Research over the past decade, however, is beginning to reveal the existence of a variety of other behavioural responses in insects, that use motion information in different ways. Here we review some of the recently characterised behaviours, describe the inferred properties of the underlying movement-detecting processes, and propose modified or new models to account for them.