Review of Multi-Agent Algorithms for Collective Behavior: a Structural Taxonomy

Insect visuomotor delay adjustments in group flight support swarm cohesion

Flying insects routinely demonstrate coordinated flight in crowded assemblies despite strict communication and processing constraints. This study experimentally records multiple flying insects tracking a moving visual stimulus. System identification techniques are used to robustly identify the tracking dynamics, including a visuomotor delay. The population delay distributions are quantified for solo and group behaviors. An interconnected visual swarm model incorporating heterogeneous delays is developed, and bifurcation analysis and swarm simulation are applied to assess swarm stability under the delays. The experiment recorded 450 insect trajectories and quantified visual tracking delay variation. Solitary tasks showed a 30ms average delay and standard deviation of 50ms, while group behaviors show a 15ms average and 8ms standard deviation. Analysis and simulation indicate that the delay adjustments during group flight support swarm formation and center stability, and are robust to measurement noise. These results quantify the role of visuomotor delay heterogeneity in flying insects and their role in supporting swarm cohesion through implicit communication.

Robot tool use: A survey

Using human tools can significantly benefit robots in many application domains. Such ability would allow robots to solve problems that they were unable to without tools. However, robot tool use is a challenging task. Tool use was initially considered to be the ability that distinguishes human beings from other animals. We identify three skills required for robot tool use: perception, manipulation, and high-level cognition skills. While both general manipulation tasks and tool use tasks require the same level of perception accuracy, there are unique manipulation and cognition challenges in robot tool use. In this survey, we first define robot tool use. The definition highlighted the skills required for robot tool use. The skills coincide with an affordance model which defined a three-way relation between actions, objects, and effects. We also compile a taxonomy of robot tool use with insights from animal tool use literature. Our definition and taxonomy lay a theoretical foundation for future robot tool use studies and also serve as practical guidelines for robot tool use applications. We first categorize tool use based on the context of the task. The contexts are highly similar for the same task (e.g., cutting) in non-causal tool use, while the contexts for causal tool use are diverse. We further categorize causal tool use based on the task complexity suggested in animal tool use studies into single-manipulation tool use and multiple-manipulation tool use. Single-manipulation tool use are sub-categorized based on tool features and prior experiences of tool use. This type of tool may be considered as building blocks of causal tool use. Multiple-manipulation tool use combines these building blocks in different ways. The different combinations categorize multiple-manipulation tool use. Moreover, we identify different skills required in each sub-type in the taxonomy. We then review previous studies on robot tool use based on the taxonomy and describe how the relations are learned in these studies. We conclude with a discussion of the current applications of robot tool use and open questions to address future robot tool use.

On the role and opportunities in teamwork design for advanced multi-robot search systems

Intelligent robotic systems are becoming ever more present in our lives across a multitude of domains such as industry, transportation, agriculture, security, healthcare and even education. Such systems enable humans to focus on the interesting and sophisticated tasks while robots accomplish tasks that are either too tedious, routine or potentially dangerous for humans to do. Recent advances in perception technologies and accompanying hardware, mainly attributed to rapid advancements in the deep-learning ecosystem, enable the deployment of robotic systems equipped with onboard sensors as well as the computational power to perform autonomous reasoning and decision making online. While there has been significant progress in expanding the capabilities of single and multi-robot systems during the last decades across a multitude of domains and applications, there are still many promising areas for research that can advance the state of cooperative searching systems that employ multiple robots. In this article, several prospective avenues of research in teamwork cooperation with considerable potential for advancement of multi-robot search systems will be visited and discussed. In previous works we have shown that multi-agent search tasks can greatly benefit from intelligent cooperation between team members and can achieve performance close to the theoretical optimum. The techniques applied can be used in a variety of domains including planning against adversarial opponents, control of forest fires and coordinating search-and-rescue missions. The state-of-the-art on methods of multi-robot search across several selected domains of application is explained, highlighting the pros and cons of each method, providing an up-to-date view on the current state of the domains and their future challenges.

High speed visual insect swarm tracker (Hi-VISTA) used to identify the effects of confinement on individual insect flight

Individual insects flying in crowded assemblies perform complex aerial maneuvers by sensing and feeding back neighbor measurements to small changes in their wing motions. To understand the individual feedback rules that permit these fast, adaptive behaviors in group flight, both experimental preparations inducing crowded flight and high-speed tracking systems capable of tracking both body motions and more subtle wing motion changes for multiple insects in simultaneous flight are needed. This measurement capability extends tracking beyond the previous focus on individual insects to multiple insects. This paper describes an experimental preparation that induces crowded insect flight in more naturalistic conditions (a laboratory-outdoor transition tunnel) and directly compares the resulting flight performance to traditional flight enclosures. Measurements are made possible via the introduction of a multi-agent high speed insect tracker called Hi-VISTA, which provides a capability to track wing and body motions of multiple insects using high speed cameras (9000-12 500 fps). Processing steps consist of automatic background identification, data association, hull reconstruction, segmentation, and feature measurement. To improve the biological relevance of laboratory experiments and develop a platform for interaction studies, this paper applies the Hi-VISTA measurement system toApis melliferaforagers habituated to transit flights through the transparent transition environment. Binary statistical analysis (Welch's t-test, Cohen's d effect size) of 95 flight trajectories is presented, quantifying the differences between flights in an unobstructed environment and in a confined tunnel volume. The results indicate that body pitch angle, heading rate, flapping frequency, and vertical speed (heave) are each affected by confinement, and other flight variables show minor or statistically insignificant changes. These results form a baseline as swarm tracking and analysis begins to isolate the effects of neighbors from environmental enclosures, and improve the connection of high speed insect laboratory experiments to outdoor field experiments.

Behavior Composition for Marine Pollution Source Localization Using a Mobile Sensor Network

Marine pollution, which can cause damage to marine ecosystems, cut fishery production, and even harm human health, has aroused worldwide interest in recent years. Marine pollution reduction operations can stagnate in the case that the source of the pollution is unknown or hidden. In this paper, we present a novel method for marine pollution source localization using a network of mobile sensor nodes, such as autonomous underwater vehicles equipped with chemical sensors. Traditional reactive control methods can respond quickly to the shape dynamics of a chemical plume; however, they can hardly achieve intelligent cooperation unlike deliberative methods. In this study, we present a behavior composition method that attempts to combine the advantages of reactive and deliberative methods. An upwind-customized crossover operation based on the genetic algorithm was formulated as one of the elementary behaviors. The upwind sprint and movement away from the centroid of the sensor nodes were also modeled as another two elementary behaviors. Different sensor nodes are capable of different simultaneous elementary behaviors, enabling behavior composition in the mobile sensor network during plume source localization. The proposed method was evaluated using a widely used filamentous plume simulation platform, which has been used to facilitate field experiments in real marine environments. Simulation results indicate that the proposed method achieved high time-efficiency and localization accuracy during plume source localization in marine environments.

A Survey of Adaptive Multi-Agent Networks and Their Applications in Smart Cities

The world is moving toward a new connected world in which millions of intelligent processing devices communicate with each other to provide services in transportation, telecommunication, and power grids in the future’s smart cities. Distributed computing is considered one of the efficient platforms for processing and management of massive amounts of data collected by smart devices. This can be implemented by utilizing multi-agent systems (MASs) with multiple autonomous computational entities by memory and computation capabilities and the possibility of message-passing between them. These systems provide a dynamic and self-adaptive platform for managing distributed large-scale systems, such as the Internet-of-Things (IoTs). Despite, the potential applicability of MASs in smart cities, very few practical systems have been deployed using agent-oriented systems. This research surveys the existing techniques presented in the literature that can be utilized for implementing adaptive multi-agent networks in smart cities. The related literature is categorized based on the steps of designing and controlling these adaptive systems. These steps cover the techniques required to define, monitor, plan, and evaluate the performance of an autonomous MAS. At the end, the challenges and barriers for the utilization of these systems in current smart cities, and insights and directions for future research in this domain, are presented.

Active Inferants: An Active Inference Framework for Ant Colony Behavior

In this paper, we introduce an active inference model of ant colony foraging behavior, and implement the model in a series of in silico experiments. Active inference is a multiscale approach to behavioral modeling that is being applied across settings in theoretical biology and ethology. The ant colony is a classic case system in the function of distributed systems in terms of stigmergic decision-making and information sharing. Here we specify and simulate a Markov decision process (MDP) model for ant colony foraging. We investigate a well-known paradigm from laboratory ant colony behavioral experiments, the alternating T-maze paradigm, to illustrate the ability of the model to recover basic colony phenomena such as trail formation after food location discovery. We conclude by outlining how the active inference ant colony foraging behavioral model can be extended and situated within a nested multiscale framework and systems approaches to biology more generally.

Swarm Robotic Behaviors and Current Applications

In swarm robotics multiple robots collectively solve problems by forming advantageous structures and behaviors similar to the ones observed in natural systems, such as swarms of bees, birds, or fish. However, the step to industrial applications has not yet been made successfully. Literature is light on real-world swarm applications that apply actual swarm algorithms. Typically, only parts of swarm algorithms are used which we refer to as basic swarm behaviors. In this paper we collect and categorize these behaviors into spatial organization, navigation, decision making, and miscellaneous. This taxonomy is then applied to categorize a number of existing swarm robotic applications from research and industrial domains. Along with the classification, we give a comprehensive overview of research platforms that can be used for testing and evaluating swarm behavior, systems that are already on the market, and projects that target a specific market. Results from this survey show that swarm robotic applications are still rare today. Many industrial projects still rely on centralized control, and even though a solution with multiple robots is employed, the principal idea of swarm robotics of distributed decision making is neglected. We identified mainly following reasons: First of all, swarm behavior emerging from local interactions is hard to predict and a proof of its eligibility for applications in an industrial context is difficult to provide. Second, current communication architectures often do not match requirements for swarm communication, which often leads to a system with a centralized communication infrastructure. Finally, testing swarms for real industrial applications is an issue, since deployment in a productive environment is typically too risky and simulations of a target system may not be sufficiently accurate. In contrast, the research platforms present a means for transforming swarm robotics solutions from theory to prototype industrial systems.