3D multi-robot olfaction in naturally ventilated indoor environments: Locating a time-varying source at unknown heights

Source localization is significant for mitigating indoor air pollution and safeguarding the well-being and safety of occupants. While most study focuses on mechanical ventilation and static sources, this study explores the less-explored domain of locating time-varying sources in naturally ventilated spaces. We have developed an innovative 3D localization system that adjusts to varying heights, significantly enhancing capabilities beyond traditional fixed-height 2D systems. To ensure consistency in experimental conditions, we conducted comparative analyses of 2D and 3D methods, using a swinging fan to simulate natural ventilation. Our findings reveal a substantial disparity in performance: the 2D method had a success rate below 46.7% in cases of height mismatches, while our 3D methods consistently achieved success rates above 66.7%, demonstrating their superior effectiveness in complex environments. Furthermore, we validated the 3D strategies in real naturally ventilated settings, confirming their wider applicability. This research extends the scope of indoor source localization and offers valuable insights and strategies for more effective pollution control.

Robotic Odor Source Localization via Vision and Olfaction Fusion Navigation Algorithm

Robotic odor source localization (OSL) is a technology that enables mobile robots or autonomous vehicles to find an odor source in unknown environments. An effective navigation algorithm that guides the robot to approach the odor source is the key to successfully locating the odor source. While traditional OSL approaches primarily utilize an olfaction-only strategy, guiding robots to find the odor source by tracing emitted odor plumes, our work introduces a fusion navigation algorithm that combines both vision and olfaction-based techniques. This hybrid approach addresses challenges such as turbulent airflow, which disrupts olfaction sensing, and physical obstacles inside the search area, which may impede vision detection. In this work, we propose a hierarchical control mechanism that dynamically shifts the robot's search behavior among four strategies: crosswind maneuver, Obstacle-Avoid Navigation, Vision-Based Navigation, and Olfaction-Based Navigation. Our methodology includes a custom-trained deep-learning model for visual target detection and a moth-inspired algorithm for Olfaction-Based Navigation. To assess the effectiveness of our approach, we implemented the proposed algorithm on a mobile robot in a search environment with obstacles. Experimental results demonstrate that our Vision and Olfaction Fusion algorithm significantly outperforms vision-only and olfaction-only methods, reducing average search time by 54% and 30%, respectively.

AlphaMobileSensing: A virtual testbed for mobile environmental monitoring

Environmental monitoring plays a critical role in creating and maintaining a comfortable, productive, and healthy environment. Built upon the advancements of robotics and data processing, mobile sensing demonstrates its potential to address problems regarding cost, deployment, and resolution that stationary monitoring encounters, which therefore has attracted increasing research attentions recently. To facilitate mobile sensing, two key algorithms are needed: the field reconstruction algorithm and the route planning algorithm. The field reconstruction algorithm is to reconstruct the entire environment field from spatially- and temporally-discrete measurements collected by the mobile sensors. The route planning algorithm is to instruct the mobile sensors where the mobile sensor needs to move to for the next measurements. The performance of mobile sensors highly depends on these two algorithms. However, developing and testing those algorithms in the real world is expensive, challenging, and time-consuming. To address these issues, we proposed and implemented an open-source virtual testbed, AlphaMobileSensing, that can be used to develop, test, and benchmark mobile sensing algorithms. AlphaMobileSensing aims to help users more easily develop and test the field reconstruction and route planning algorithms for mobile sensing solutions, without worrying about hardware fault, test accidents (such as collision during the test), etc. The separation of concerns can significantly reduce the cost of developing software solutions for mobile sensing. For versatility and flexibility, AlphaMobileSensing was wrapped up using the standardized interface of OpenAI Gym, and it also provides an interface for loading physical fields that were generated by numerical simulations as virtual test sites to perform mobile sensing and retrieving monitoring data. We demonstrated applications of the virtual testbed by implementing and testing algorithms for physical field reconstruction in both static and dynamic indoor thermal environments. AlphaMobileSensing provides a novel and flexible platform to develop, test, and benchmark mobile sensing algorithms more easily, conveniently, and efficiently. AlphaMobileSensing is open sourced at https://github.com/kishuqizhou/AlphaMobileSensing.

Electronic Supplementary Material ESM

the Appendix is available in the online version of this article at 10.1007/s12273-023-1001-9.

Odor Source Localization in Obstacle Regions Using Switching Planning Algorithms with a Switching Framework

Odor source localization (OSL) robots are essential for safety and rescue teams to overcome the problem of human exposure to hazardous chemical plumes. However, owing to the complicated geometry of environments, it is almost impossible to construct the dispersion model of the odor plume in practical situations to be used for probabilistic odor source search algorithms. Additionally, as time is crucial in OSL tasks, dynamically modifying the robot's balance of emphasis between exploration and exploitation is desired. In this study, we addressed both the aforementioned problems by simplifying the environment with an obstacle region into multiple sub-environments with different resolutions. Subsequently, a framework was introduced to switch between the Infotaxis and Dijkstra algorithms to navigate the agent and enable it to reach the source swiftly. One algorithm was used to guide the agent in searching for clues about the source location, whereas the other facilitated the active movement of the agent between sub-environments. The proposed algorithm exhibited improvements in terms of success rate and search time. Furthermore, the implementation of the proposed framework on an autonomous mobile robot verified its effectiveness. Improvements were observed in our experiments with a robot when the success rate increased 3.5 times and the average moving steps of the robot were reduced by nearly 35%.

Emergent behaviour and neural dynamics in artificial agents tracking odour plumes

Tracking an odour plume to locate its source under variable wind and plume statistics is a complex task. Flying insects routinely accomplish such tracking, often over long distances, in pursuit of food or mates. Several aspects of this remarkable behaviour and its underlying neural circuitry have been studied experimentally. Here we take a complementary in silico approach to develop an integrated understanding of their behaviour and neural computations. Specifically, we train artificial recurrent neural network agents using deep reinforcement learning to locate the source of simulated odour plumes that mimic features of plumes in a turbulent flow. Interestingly, the agents' emergent behaviours resemble those of flying insects, and the recurrent neural networks learn to compute task-relevant variables with distinct dynamic structures in population activity. Our analyses put forward a testable behavioural hypothesis for tracking plumes in changing wind direction, and we provide key intuitions for memory requirements and neural dynamics in odour plume tracking.

Odor source localization of multi-robots with swarm intelligence algorithms: A review

The use of robot swarms for odor source localization (OSL) can better adapt to the reality of unstable turbulence and find chemical contamination or hazard sources faster. Inspired by the collective behavior in nature, swarm intelligence (SI) is recognized as an appropriate algorithm framework for multi-robot system due to its parallelism, scalability and robustness. Applications of SI-based multi-robots for OSL problems have attracted great interest over the last two decades. In this review, we firstly summarize the trending issues in general robot OSL field through comparing some basic counterpart concepts, and then provide a detailed survey of various representative SI algorithms in multi-robot system for odor source localization. The research field originates from the first introduction of the standard particle swarm optimization (PSO) and flourishes in applying ever-increasing quantity of its variants as modified PSOs and hybrid PSOs. Moreover, other nature-inspired SI algorithms have also demonstrated the diversity and exploration of this field. The computer simulations and real-world applications reported in the literatures show that those algorithms could well solve the main problems of odor source localization but still retain the potential for further development. Lastly, we provide an outlook on possible future research directions.

Odour motion sensing enhances navigation of complex plumes

Odour plumes in the wild are spatially complex and rapidly fluctuating structures carried by turbulent airflows^1-4. To successfully navigate plumes in search of food and mates, insects must extract and integrate multiple features of the odour signal, including odour identity⁵, intensity⁶ and timing^6-12. Effective navigation requires balancing these multiple streams of olfactory information and integrating them with other sensory inputs, including mechanosensory and visual cues^9,12,13. Studies dating back a century have indicated that, of these many sensory inputs, the wind provides the main directional cue in turbulent plumes, leading to the longstanding model of insect odour navigation as odour-elicited upwind motion^6,8-12,14,15. Here we show that Drosophila melanogaster shape their navigational decisions using an additional directional cue-the direction of motion of odours-which they detect using temporal correlations in the odour signal between their two antennae. Using a high-resolution virtual-reality paradigm to deliver spatiotemporally complex fictive odours to freely walking flies, we demonstrate that such odour-direction sensing involves algorithms analogous to those in visual-direction sensing¹⁶. Combining simulations, theory and experiments, we show that odour motion contains valuable directional information that is absent from the airflow alone, and that both Drosophila and virtual agents are aided by that information in navigating naturalistic plumes. The generality of our findings suggests that odour-direction sensing may exist throughout the animal kingdom and could improve olfactory robot navigation in uncertain environments.

A fuzzy control algorithm for tracing air pollution based on unmanned aerial vehicles

The process of atmospheric pollutants traceability based on unmanned aerial vehicles (UAVs) is affected by many factors that can impact and increase the complexity of the traceability of atmospheric pollutants. In this study, we proposed a new algorithm called the fuzzy control traceability (FCT) to track odor plumes. Our proposed algorithm combined the characteristics and fuzzy control of the UAV and designed a controller based on the actual environment of the UAV. The fuzzy controller fuzzed the input gas concentration information, established fuzzy control rules by imitating human brain thinking, and outputted the turning angle and the move length according to rules, thus realizing intelligent tracking of the odor plume by the UAV. We compared the FCT algorithm with the bio-inspired "ZigZag" algorithm to validate its performance. Various concentration fields were constructed, and ten sets of experiments are performed using the two algorithms in different concentration fields. The average success rate of the FCT algorithm under different concentration fields was 95.4% higher than that of the ZigZag algorithm.Implications: Fuzzy control logic is applied to the field of air pollutant traceability of drones, and a single drone traceability algorithm based on fuzzy control is proposed; and in view of the shortcomings of a single traceability subject in the traceability, multiple traceability subjects are introduced to optimize fuzzy control.

BREEZE—Boundary Red Emission Zone Estimation Using Unmanned Aerial Vehicles

Catastrophic gas leak events require human First Responder Teams (FRTs) to map hazardous areas (red zones). The initial task of FRT in such events is to assess the risk according to the pollution level and to quickly evacuate civilians to prevent casualties. These teams risk their lives by manually mapping the gas dispersion. This process is currently performed using hand-held gas detectors and requires dense and exhaustive monitoring to achieve reliable maps. However, the conventional mapping process is impaired due to limited human mobility and monitoring capacities. In this context, this paper presents a method for gas sensing using unmanned aerial vehicles. The research focuses on developing a custom path planner—Boundary Red Emission Zone Estimation (BREEZE). BREEZE is an estimation approach that allows efficient red zone delineation by following its boundary. The presented approach improves the gas dispersion mapping process by performing adaptive path planning, monitoring gas dispersion in real time, and analyzing the measurements online. This approach was examined by simulating a cluttered urban site in different environmental conditions. The simulation results show the ability to autonomously perform red zone estimation faster than methods that rely on predetermined paths and with a precision higher than ninety percent.

Comparison and Improvement of Bioinspired Mobile Algorithms to Trace the Emission Source Based on the Simulation Scenarios

Hazardous gas emissions may have serious consequences for surrounding residents and the environment. Bioinspired mobile robots equipped with gas sensors have the potential to become a solution for precisely tracking and locating emission sources. In this study, the performance, efficiency, and accuracy of various bionic algorithms with bioinspired mobile sensors, i.e., silkworm, E. coli, ZigZag, and step-up algorithms, were compared using field simulations to track emission sources in the atmosphere. In the tracing process, the determination criteria of maximum concentration, minimum concentration (i.e., 0), and concentration gradient were discussed quantitatively. The simulation results showed that the silkworm algorithm has the best performance in locating the emission source, while the E. coli algorithm has the highest tracking efficiency. Therefore, a single source-determination criterion may be insufficient, since tracking accuracy and efficiency can vary with different simulation algorithms. To address these concerns, a new tracking strategy driven by the inverse motion and interface gradient (RMIG) was proposed, based on the behaviors of female mosquitoes seeking hosts by tracking CO2 plumes, to improve tracking efficiency. It was found that the locating efficiency driven by RMIG is greatly improved and higher than that of the E. coli algorithm in the tested cases, with 40% to 100% explicitly enhanced. Finally, the optimal correlated matching of concentration distribution (OCMCD) method was used to locate the source with a mobile sensor. Compared with traditional and common source-determination criteria, the RMIG-OCMCD method can significantly improve location accuracy. The proposed RMIG-OCMCD method could be a practical choice for tracking emission sources in the atmosphere if an appropriate search strategy is designed.

Emission source tracing based on bionic algorithm mobile sensors with artificial olfactory system

The leakage of hazardous chemicals and toxic volatile substances in the atmosphere may cause serious consequences such as explosion and poisoning. To identify the unknown leakage locations and gas compositions, a mobile robot system to trace the leak source in the outdoor was investigated. First, two bionic searching algorithms, Zigzag and Silkworm algorithms, were tested with outdoor experiments for locating the leak source. The results showed that the locating errors of these two algorithms were within 0.5 m in 10 by 20 m search space, but the failing ratio of Zigzag and Silkworm algorithm was still high (about 40–50%). Therefore, an improved tracing algorithm combining the Silkworm and Zigzag algorithm, called as zigzag–Silkworm algorithm, was proposed. Compared with Silkworm and Zigzag algorithms, zigzag–Silkworm algorithm had a higher success ratio of 80% in outdoor source tracing tests, and the searching efficiency was enhanced, the efficiency parameter L: L0 has improved from 2.58 for Silkworm and 2.66 for Zigzag to 2.17 for zigzag–Silkworm. Then, in order to identify the composition of the leaked gases during the source tracing, an artificial olfaction system (AOS) based on the gas sensor array and support vector machine was set on the mobile robot. The test results in the source tracing experiments with ammonia and ethanol emissions indicated that the recognition accuracy of emission gases reached to 99% with AOS equipped on the robot. Therefore, the mobile robot system equipped with the zigzag–Silkworm algorithm and the AOS is feasible to trace the leakage source and identify the emission composition in the outdoor leakage event with good performance in efficiency and accuracy although some underlying problems still need to be addressed in future work.

Event-Based Sensing and Signal Processing in the Visual, Auditory, and Olfactory Domain: A Review

The nervous systems converts the physical quantities sensed by its primary receptors into trains of events that are then processed in the brain. The unmatched efficiency in information processing has long inspired engineers to seek brain-like approaches to sensing and signal processing. The key principle pursued in neuromorphic sensing is to shed the traditional approach of periodic sampling in favor of an event-driven scheme that mimicks sampling as it occurs in the nervous system, where events are preferably emitted upon the change of the sensed stimulus. In this paper we highlight the advantages and challenges of event-based sensing and signal processing in the visual, auditory and olfactory domains. We also provide a survey of the literature covering neuromorphic sensing and signal processing in all three modalities. Our aim is to facilitate research in event-based sensing and signal processing by providing a comprehensive overview of the research performed previously as well as highlighting conceptual advantages, current progress and future challenges in the field.

Sensor-Based Control for Collaborative Robots: Fundamentals, Challenges, and Opportunities

The objective of this paper is to present a systematic review of existing sensor-based control methodologies for applications that involve direct interaction between humans and robots, in the form of either physical collaboration or safe coexistence. To this end, we first introduce the basic formulation of the sensor-servo problem, and then, present its most common approaches: vision-based, touch-based, audio-based, and distance-based control. Afterwards, we discuss and formalize the methods that integrate heterogeneous sensors at the control level. The surveyed body of literature is classified according to various factors such as: sensor type, sensor integration method, and application domain. Finally, we discuss open problems, potential applications, and future research directions.

Environmental chemical sensing using small drones: A review

Recent advances in miniaturization of chemical instrumentation and in low-cost small drones are catalyzing exponential growth in the use of such platforms for environmental chemical sensing applications. The versatility of chemically sensitive drones is reflected by their rapid adoption in scientific, industrial, and regulatory domains, such as in atmospheric research studies, industrial emission monitoring, and in enforcement of environmental regulations. As a result of this interdisciplinarity, progress to date has been reported across a broad spread of scientific and non-scientific databases, including scientific journals, press releases, company websites, and field reports. The aim of this paper is to assemble all of these pieces of information into a comprehensive, structured and updated review of the field of chemical sensing using small drones. We exhaustively review current and emerging applications of this technology, as well as sensing platforms and algorithms developed by research groups and companies for tasks such as gas concentration mapping, source localization, and flux estimation. We conclude with a discussion of the most pressing technological and regulatory limitations in current practice, and how these could be addressed by future research.

Braitenberg Vehicles as Computational Tools for Research in Neuroscience

Valentino Braitenberg reported his seminal thought experiment in 1984 using reactive automatons or vehicles with relatively simple sensorimotor connections as models for seemingly complex cognitive processes in biological brains. Braitenberg's work, meant as a metaphor for biological life encompassed a deep knowledge of and served as an analogy for the multitude of neural processes and pathways that underlie animal behavior, suggesting that seemingly complex behavior may arise from relatively simple designs. Braitenberg vehicles have been adopted in robotics and artificial life research for sensor-driven navigation behaviors in robots, such as localizing sound and chemical sources, orienting toward or away from current flow under water etc. The neuroscience community has benefitted from applying Braitenberg's bottom-up approach toward understanding analogous neural mechanisms underpinning his models of animal behavior. We present a summary of the latest studies of Braitenberg vehicles for bio-inspired navigation and relate the results to experimental findings on the neural basis of navigation behavior in animals. Based on these studies, we motivate the important role of Braitenberg vehicles as computational tools to inform research in behavioral neuroscience.

Decentralized Multi-agent information-theoretic control for target estimation and localization: finding gas leaks

This article presents a new decentralized multi-agent information-theoretic (DeMAIT) control algorithm for mobile sensors (agents). The algorithm leverages Bayesian estimation and information-theoretic motion planning for efficient and effective estimation and localization of a target, such as a chemical gas leak. The algorithm consists of: (1) a non-parametric Bayesian estimator, (2) an information-theoretic trajectory planner that generates “informative trajectories” for agents to follow, and (3) a controller and collision avoidance algorithm to ensure that each agent follows its trajectory as closely as possible in a safe manner. Advances include the use of a new information-gain metric and its analytical gradient, which do not depend on an infinite series like prior information metrics. Dynamic programming and multi-threading techniques are applied to efficiently compute the mutual information to minimize measurement uncertainty. The estimation and motion planning processes also take into account the dynamics of the sensors and agents. Extensive simulations are conducted to compare the performance between the DeMAIT algorithm to a traditional raster-scanning method and a clustering method with coordination. The main hypothesis that the DeMAIT algorithm outperforms the other two methods is validated, specifically where the average localization success rate for the DeMAIT algorithm is (a) higher and (b) more robust to changes in the source location, robot team size, and search area size than the raster-scanning and clustering methods. Finally, outdoor field experiments are conducted using a team of custom-built aerial robots equipped with gas concentration sensors to demonstrate efficacy of the DeMAIT algorithm to estimate and find the source of a propane gas leak.

Consensus-Based Odor Source Localization by Multiagent Systems Under Resource Constraints

With advancements in mobile robot olfaction, networked multiagent systems (MASs) are used in odor source localization (OSL). These MASs are often equipped with small microprocessors that have limited computing capabilities, and they usually operate in a bandwidth and energy-constrained environment. The exigent need for a faster localizing algorithm under communication and computational resource constraints invites many design challenges. In this paper, we have designed a two-level hierarchical cooperative control strategy for heterogeneous nonlinear MASs for OSL. The agents are forced toward consensus expeditiously once the information on the whereabouts of the source is attained. The synthesis of the controller occurs in a hierarchical manner-obtaining a group decision, followed by resource-efficient robust control. Odor concentration and wind information have been used in a group decision-making layer to predict a probable location of the source as a tracking reference. This reference is then fed to the control layer that is synthesized using event-triggered sliding-mode control (SMC). The advantage of using event-triggered control scheduling in conjunction with the SMC is rooted in retaining the robustness of the SMC while lowering the resource utilization burden. Numerical simulations confirm the efficiency of the scheme put forth.

Detection of Gas Drifting Near the Ground by Drone Hovering Over: Using Airflow Generated by Two Connected Quadcopters

This paper describes the utilization of the downwashes of multicopters for gas-sensing applications. Multirotor drones are an attractive platform for sensing applications. Their high maneuverability enables swift scanning of a target area with onboard sensors. When equipped with a gas sensor and used for gas-sensing applications, however, the strong downwash produced by the rotors poses a problem. When a multicopter is hovering at a low altitude, gas puffs leaked from a gas source on the ground are all blown away. Here, we propose to use two multicopters connected by a rod or a string and place a gas sensor at the midpoint of the rod/string. The downwash generated by each multicopter spreads radially after it impinges on the ground. When two multicopters are connected, the airflows spreading radially along the ground from the two multicopters impinge at the center and are deflected in the upward direction. Gas puffs wafting near the ground surface between the two multicopters are carried by this upward airflow to the gas sensor. Experimental results are presented to show the soundness of the proposed method. The connected quadcopters hovering over an ethanol gas source was able to detect the gas even with a moderate cross-flow.

Effective Exploration Behavior for Chemical-Sensing Robots

Mobile robots that can effectively detect chemical effluents could be useful in a variety of situations, such as disaster relief or drug sniffing. Such a robot might mimic biological systems that exhibit chemotaxis, which is movement towards or away from a chemical stimulant in the environment. Some existing robotic exploration algorithms that mimic chemotaxis suffer from the problems of getting stuck in local maxima and becoming "lost", or unable to find the chemical if there is no initial detection. We introduce the use of the RapidCell algorithm for mobile robots exploring regions with potentially detectable chemical concentrations. The RapidCell algorithm mimics the biology behind the biased random walk of Escherichia coli (E. coli) bacteria more closely than traditional chemotaxis algorithms by simulating the chemical signaling pathways interior to the cell. For comparison, we implemented a classical chemotaxis controller and a controller based on RapidCell, then tested them in a variety of simulated and real environments (using phototaxis as a surrogate for chemotaxis). We also added simple obstacle avoidance behavior to explore how it affects the success of the algorithms. Both simulations and experiments showed that the RapidCell controller more fully explored the entire region of detectable chemical when compared with the classical controller. If there is no detectable chemical present, the RapidCell controller performs random walk in a much wider range, hence increasing the chance of encountering the chemical. We also simulated an environment with triple effluent to show that the RapidCell controller avoided being captured by the first encountered peak, which is a common issue for the classical controller. Our study demonstrates that mimicking the adapting sensory system of E. coli chemotaxis can help mobile robots to efficiently explore the environment while retaining their sensitivity to the chemical gradient.

Surface-Enhanced Raman Scattering-Based Odor Compass: Locating Multiple Chemical Sources and Pathogens

Olfaction is important for identifying and avoiding toxic substances in living systems. Many efforts have been made to realize artificial olfaction systems that reflect the capacity of biological systems. A sophisticated example of an artificial olfaction device is the odor compass which uses chemical sensor data to identify odor source direction. Successful odor compass designs often rely on plume-based detection and mobile robots, where active, mechanical motion of the sensor platform is employed. Passive, diffusion-based odor compasses remain elusive as detection of low analyte concentrations and quantification of small concentration gradients from within the sensor platform are necessary. Further, simultaneously identifying multiple odor sources using an odor compass remains an ongoing challenge, especially for similar analytes. Here, we show that surface-enhanced Raman scattering (SERS) sensors overcome these challenges, and we present the first SERS odor compass. Using a grid array of SERS sensors, machine learning analysis enables reliable identification of multiple odor sources arising from diffusion of analytes from one or two localized sources. Specifically, convolutional neural network and support vector machine classifier models achieve over 90% accuracy for a multiple odor source problem. This system is then used to identify the location of an Escherichia coli biofilm via its complex signature of volatile organic compounds. Thus, the fabricated SERS chemical sensors have the needed limit of detection and quantification for diffusion-based odor compasses. Solving the multiple odor source problem with a passive platform opens a path toward an Internet of things approach to monitor toxic gases and indoor pathogens.

Olfaction, Vision, and Semantics for Mobile Robots. Results of the IRO Project

Olfaction is a valuable source of information about the environment that has not been sufficiently exploited in mobile robotics yet. Certainly, odor information can contribute to other sensing modalities, e.g., vision, to accomplish high-level robot activities, such as task planning or execution in human environments. This paper organizes and puts together the developments and experiences on combining olfaction and vision into robotics applications, as the result of our five-years long project IRO: Improvement of the sensory and autonomous capability of Robots through Olfaction. Particularly, it investigates mechanisms to exploit odor information (usually coming in the form of the type of volatile and its concentration) in problems such as object recognition and scene–activity understanding. A distinctive aspect of this research is the special attention paid to the role of semantics within the robot perception and decision-making processes. The obtained results have improved the robot capabilities in terms of efficiency, autonomy, and usefulness, as reported in our publications.

Autonomous Searching for a Diffusive Source Based on Minimizing the Combination of Entropy and Potential Energy

The infotaxis scheme is a search strategy for a diffusive source, where the sensor platform is driven to reduce the uncertainty about the source through climbing the information gradient. The infotaxis scheme has been successfully applied in many source searching tasks and has demonstrated fast and stable searching capabilities. However, the infotaxis scheme focuses on gathering information to reduce the uncertainty down to zero, rather than chasing the most probable estimated source when a reliable estimation is obtained. This leads the sensor to spend more time exploring the space and yields a longer search path. In this paper, from the context of exploration-exploitation balance, a novel search scheme based on minimizing free energy that combines the entropy and the potential energy is proposed. The term entropy is implemented as the exploration to gather more information. The term potential energy, leveraging the distance to the estimated sources, is implemented as the exploitation to reinforce the chasing behavior with the receding of the uncertainty. It results in a faster effective search strategy by which the sensor determines its actions by minimizing the free energy rather than only the entropy in traditional infotaxis. Simulations of the source search task based on the computational plume verify the efficiency of the proposed strategy, achieving a shorter mean search time.

A Comparative Study of Bio-Inspired Odour Source Localisation Strategies from the State-Action Perspective

Locating odour sources with robots is an interesting problem with many important real-world applications. In the past years, the robotics community has adapted several bio-inspired strategies to search for odour sources in a variety of environments. This work studies and compares some of the most common strategies from a behavioural perspective with the aim of knowing: (1) how different are the behaviours exhibited by the strategies for the same perceptual state; and (2) which are the most consensual actions for each perceptual state in each environment. The first step of this analysis consists of clustering the perceptual states, and building histograms of the actions taken for each cluster. In case of (1), a histogram is made for each strategy separately, whereas for (2), a single histogram containing the actions of all strategies is produced for each cluster of states. Finally, statistical hypotheses tests are used to find the statistically significant differences between the behaviours of the strategies in each state. The data used for performing this study was gathered from a purpose-built simulator which accurately simulates the real-world phenomena of odour dispersion and air flow, whilst being sufficiently fast to be employed in learning and evolutionary robotics experiments. This paper also proposes an xml-inspired structure for the generated datasets that are used to store the perceptual information of the robots over the course of the simulations. These datasets may be used in learning experiments to estimate the quality of a candidate solution or for measuring its novelty.

Application of an Array of Metal-Oxide Semiconductor Gas Sensors in an Assistant Personal Robot for Early Gas Leak Detection

This paper proposes the application of a low-cost gas sensor array in an assistant personal robot (APR) in order to extend the capabilities of the mobile robot as an early gas leak detector for safety purposes. The gas sensor array is composed of 16 low-cost metal-oxide (MOX) gas sensors, which are continuously in operation. The mobile robot was modified to keep the gas sensor array always switched on, even in the case of battery recharge. The gas sensor array provides 16 individual gas measurements and one output that is a cumulative summary of all measurements, used as an overall indicator of a gas concentration change. The results of preliminary experiments were used to train a partial least squares discriminant analysis (PLS-DA) classifier with air, ethanol, and acetone as output classes. Then, the mobile robot gas leak detection capabilities were experimentally evaluated in a public facility, by forcing the evaporation of (1) ethanol, (2) acetone, and (3) ethanol and acetone at different locations. The positive results obtained in different operation conditions over the course of one month confirmed the early detection capabilities of the proposed mobile system. For example, the APR was able to detect a gas leak produced inside a closed room from the external corridor due to small leakages under the door induced by the forced ventilation system of the building.

Design and Performance Evaluation of an Algorithm Based on Source Term Estimation for Odor Source Localization

Finding sources of airborne chemicals with mobile sensing systems finds applications across safety, security, environmental monitoring, and medical domains. In this paper, we present an algorithm based on Source Term Estimation for odor source localization that is coupled with a navigation method based on partially observable Markov decision processes. We propose a novel strategy to balance exploration and exploitation in navigation. Moreover, we study two variants of the algorithm, one exploiting a global and the other one a local framework. The method was evaluated through high-fidelity simulations and in a wind tunnel emulating a quasi-laminar air flow in a controlled environment, in particular by systematically investigating the impact of multiple algorithmic and environmental parameters (wind speed and source release rate) on the overall performance. The outcome of the experiments showed that the algorithm is robust to different environmental conditions in the global framework, but, in the local framework, it is only successful in relatively high wind speeds. In the local framework, on the other hand, the algorithm is less demanding in terms of energy consumption as it does not require any absolute positioning information from the environment and the robot travels less distance compared to the global framework.

Smelling Nano Aerial Vehicle for Gas Source Localization and Mapping

This paper describes the development and validation of the currently smallest aerial platform with olfaction capabilities. The developed Smelling Nano Aerial Vehicle (SNAV) is based on a lightweight commercial nano-quadcopter (27 g) equipped with a custom gas sensing board that can host up to two in situ metal oxide semiconductor (MOX) gas sensors. Due to its small form-factor, the SNAV is not a hazard for humans, enabling its use in public areas or inside buildings. It can autonomously carry out gas sensing missions of hazardous environments inaccessible to terrestrial robots and bigger drones, for example searching for victims and hazardous gas leaks inside pockets that form within the wreckage of collapsed buildings in the aftermath of an earthquake or explosion. The first contribution of this work is assessing the impact of the nano-propellers on the MOX sensor signals at different distances to a gas source. A second contribution is adapting the ‘bout’ detection algorithm, proposed by Schmuker et al. (2016) to extract specific features from the derivative of the MOX sensor response, for real-time operation. The third and main contribution is the experimental validation of the SNAV for gas source localization (GSL) and mapping in a large indoor environment (160 m²) with a gas source placed in challenging positions for the drone, for example hidden in the ceiling of the room or inside a power outlet box. Two GSL strategies are compared, one based on the instantaneous gas sensor response and the other one based on the bout frequency. From the measurements collected (in motion) along a predefined sweeping path we built (in less than 3 min) a 3D map of the gas distribution and identified the most likely source location. Using the bout frequency yielded on average a higher localization accuracy than using the instantaneous gas sensor response (1.38 m versus 2.05 m error), however accurate tuning of an additional parameter (the noise threshold) is required in the former case. The main conclusion of this paper is that a nano-drone has the potential to perform gas sensing tasks in complex environments.

Chemical Source Searching by Controlling a Wheeled Mobile Robot to Follow an Online Planned Route in Outdoor Field Environments

In this paper, we present an estimation-based route planning (ERP) method for chemical source searching using a wheeled mobile robot and validate its effectiveness with outdoor field experiments. The ERP method plans a dynamic route for the robot to follow to search for a chemical source according to time-varying wind and an estimated chemical-patch path (C-PP), where C-PP is the historical trajectory of a chemical patch detected by the robot, and normally different from the chemical plume formed by the spatial distribution of all chemical patches previously released from the source. Owing to the limitations of normal gas sensors and actuation capability of ground mobile robots, it is quite hard for a single robot to directly trace the intermittent and rapidly swinging chemical plume resulting from the frequent and random changes of wind speed and direction in outdoor field environments. In these circumstances, tracking the C-PP originating from the chemical source back could help the robot approach the source. The proposed ERP method was tested in two different outdoor fields using a wheeled mobile robot. Experimental results indicate that the robot adapts to the time-varying airflow condition, arriving at the chemical source with an average success rate and approaching effectiveness of about 90% and 0.4~0.6, respectively.

An autonomous robot for continuous tracking of millimetric-sized walkers

The precise and continuous tracking of millimetric-sized walkers-such as ants-is quite important in behavioral studies. However, due to technical limitations, most studies concentrate on trajectories within areas no more than 100 times bigger than the size of the walker or longer trajectories at the expense of either accuracy or continuity. Our work describes a scientific instrument designed to push the boundaries of precise and continuous motion analysis up to 1000 body lengths or more. It consists of a mobile robotic platform that uses digital image processing techniques to track the targets in real time by calculating their spatial position. During the experiments, all the images are stored and afterwards processed to estimate with higher precision the path traced by the walkers. Some preliminary results achieved using the proposed tracking system are presented.

A Semantic-Based Gas Source Localization with a Mobile Robot Combining Vision and Chemical Sensing

This paper addresses the localization of a gas emission source within a real-world human environment with a mobile robot. Our approach is based on an efficient and coherent system that fuses different sensor modalities (i.e., vision and chemical sensing) to exploit, for the first time, the semantic relationships among the detected gases and the objects visually recognized in the environment. This novel approach allows the robot to focus the search on a finite set of potential gas source candidates (dynamically updated as the robot operates), while accounting for the non-negligible uncertainties in the object recognition and gas classification tasks involved in the process. This approach is particularly interesting for structured indoor environments containing multiple obstacles and objects, enabling the inference of the relations between objects and between objects and gases. A probabilistic Bayesian framework is proposed to handle all these uncertainties and semantic relations, providing an ordered list of candidates to be the source. This candidate list is updated dynamically upon new sensor measurements to account for objects not previously considered in the search process. The exploitation of such probabilities together with information such as the locations of the objects, or the time needed to validate whether a given candidate is truly releasing gases, is delegated to a path planning algorithm based on Markov decision processes to minimize the search time. The system was tested in an office-like scenario, both with simulated and real experiments, to enable the comparison of different path planning strategies and to validate its efficiency under real-world conditions.

Toward Dynamic Monitoring and Suppressing Uncertainty in Wildfire by Multiple Unmanned Air Vehicle System

Containing a wildfire requires an efficient response and persistent monitoring. A crucial aspect is the ability to search for the boundaries of the wildfire by exploring a wide area. However, even as wildfires are increasing today, the number of available monitoring systems that can provide support is decreasing, creating an operational gap and slow response in such urgent situations. The objective of this work is to estimate a propagating boundary and create an autonomous system that works in real time. It proposes a coordination strategy with a new methodology for estimating the periphery of a propagating phenomenon using limited observations. The complete system design, tested on the high-fidelity simulation, demonstrates that steering the vehicles toward the highest perpendicular uncertainty generates the effective predictions. The results indicate that the new coordination scheme has a large beneficial impact on uncertainty suppression. This study thus suggests that an efficient solution for suppressing uncertainty in monitoring a wildfire is to use a fleet of low-cost unmanned aerial vehicles that can be deployed quickly. Further research is needed on other deployment schemes that work in different natural disaster case studies.

A Robot Equipped with a High-Speed LSPR Gas Sensor Module for Collecting Spatial Odor Information from On-Ground Invisible Odor Sources

Improving the efficiency of detecting the spatial distribution of gas information with a mobile robot is a great challenge that requires rapid sample collection, which is basically determined by the speed of operation of gas sensors. The present work developed a robot equipped with a high-speed gas sensor module based on localized surface plasmon resonance. The sensor module is designed to sample gases from an on-ground odor source, such as a footprint material or artificial odor marker, via a fine sampling tubing. The tip of the sampling tubing was placed close to the ground to reduce the sampling time and the effect of natural gas diffusion. On-ground ethanol odor sources were detected by the robot at high resolution (i.e., 2.5 cm when the robot moved at 10 cm/s), and the reading of gas information was demonstrated experimentally. This work may help in the development of environmental sensing robots, such as the development of odor source mapping and multirobot systems with pheromone tracing.

Autonomous Multi-Robot Search for a Hazardous Source in a Turbulent Environment

Finding the source of an accidental or deliberate release of a toxic substance into the atmosphere is of great importance for national security. The paper presents a search algorithm for turbulent environments which falls into the class of cognitive (infotaxi) algorithms. Bayesian estimation of the source parameter vector is carried out using the Rao-Blackwell dimension-reduction method, while the robots are controlled autonomously to move in a scalable formation. Estimation and control are carried out in a centralised replicated fusion architecture assuming all-to-all communication. The paper presents a comprehensive numerical analysis of the proposed algorithm, including the search-time and displacement statistics.

Chemical Source Localization Fusing Concentration Information in the Presence of Chemical Background Noise

We present the estimation of a likelihood map for the location of the source of a chemical plume dispersed under atmospheric turbulence under uniform wind conditions. The main contribution of this work is to extend previous proposals based on Bayesian inference with binary detections to the use of concentration information while at the same time being robust against the presence of background chemical noise. For that, the algorithm builds a background model with robust statistics measurements to assess the posterior probability that a given chemical concentration reading comes from the background or from a source emitting at a distance with a specific release rate. In addition, our algorithm allows multiple mobile gas sensors to be used. Ten realistic simulations and ten real data experiments are used for evaluation purposes. For the simulations, we have supposed that sensors are mounted on cars which do not have among its main tasks navigating toward the source. To collect the real dataset, a special arena with induced wind is built, and an autonomous vehicle equipped with several sensors, including a photo ionization detector (PID) for sensing chemical concentration, is used. Simulation results show that our algorithm, provides a better estimation of the source location even for a low background level that benefits the performance of binary version. The improvement is clear for the synthetic data while for real data the estimation is only slightly better, probably because our exploration arena is not able to provide uniform wind conditions. Finally, an estimation of the computational cost of the algorithmic proposal is presented.

Environmental monitoring using autonomous vehicles: a survey of recent searching techniques

Autonomous vehicles are becoming an essential tool in a wide range of environmental applications that include ambient data acquisition, remote sensing, and mapping of the spatial extent of pollutant spills. Among these applications, pollution source localization has drawn increasing interest due to its scientific and commercial interest and the emergence of a new breed of robotic vehicles capable of operating in harsh environments without human supervision. The aim is to find the location of a region that is the source of a given substance of interest (e.g. a chemical pollutant at sea or a gas leakage in air) using a group of cooperative autonomous vehicles. Motivated by fast paced advances in this challenging area, this paper surveys recent advances in searching techniques that are at the core of environmental monitoring strategies using autonomous vehicles.

Unlocking neural complexity with a robotic key

Complex brains evolved in order to comprehend and interact with complex environments in the real world. Despite significant progress in our understanding of perceptual representations in the brain, our understanding of how the brain carries out higher level processing remains largely superficial. This disconnect is understandable, since the direct mapping of sensory inputs to perceptual states is readily observed, while mappings between (unknown) stages of processing and intermediate neural states is not. We argue that testing theories of higher level neural processing on robots in the real world offers a clear path forward, since (1) the complexity of the neural robotic controllers can be staged as necessary, avoiding the almost intractable complexity apparent in even the simplest current living nervous systems; (2) robotic controller states are fully observable, avoiding the enormous technical challenge of recording from complete intact brains; and (3) unlike computational modelling, the real world can stand for itself when using robots, avoiding the computational intractability of simulating the world at an arbitrary level of detail. We suggest that embracing the complex and often unpredictable closed-loop interactions between robotic neuro-controllers and the physical world will bring about deeper understanding of the role of complex brain function in the high-level processing of information and the control of behaviour.

Adaptive source search in a gradient field

Most existing source search algorithms suffer from a high travel cost, and few of them have been analyzed in performance in noisy environments where local basins are presented. In this paper, the theseus gradient search (TGS) is proposed to effectively overcome local basins in search. Analytical performances of TGS and the gradient ascend with correlated random walk (GACRW), which is a variant of correlated random walk, are derived and compared. A gradient field model is proposed as an analytical tool that makes it feasible to analyze the performances. The analytical average searching costs of GACRW and TGS are obtained for the first time for this class of algorithms in the environments with local basins. The costs, expressed as functions of searching space size, local basin size, and local basin number are confirmed by simulation results. The performances of GACRW, TGS, and two chemotaxis algorithms are compared in the gradient field and a scenario of indoor radio source search in a hallway driven by real data of signal strengths. The results illustrate that GACRW and TGS are robust to noisy gradients and are more competitive than the chemotaxis-based algorithms in real applications. Both analytical and simulation results indicate that in the presence of local basins, TGS almost always costs the lowest.

Global coverage measurement planning strategies for mobile robots equipped with a remote gas sensor

The problem of gas detection is relevant to many real-world applications, such as leak detection in industrial settings and landfill monitoring. In this paper, we address the problem of gas detection in large areas with a mobile robotic platform equipped with a remote gas sensor. We propose an algorithm that leverages a novel method based on convex relaxation for quickly solving sensor placement problems, and for generating an efficient exploration plan for the robot. To demonstrate the applicability of our method to real-world environments, we performed a large number of experimental trials, both on randomly generated maps and on the map of a real environment. Our approach proves to be highly efficient in terms of computational requirements and to provide nearly-optimal solutions.

Optimal swarm formation for odor plume finding

This paper presents an analytical approach to the problem of odor plume finding by a network of swarm robotic gas sensors, and finds an optimal configuration for them, given a set of assumptions. Considering cross-wind movement for the swarm, we found that the best spatial formation of robots in finding odor plumes is diagonal line configuration with equal distance between each pair of neighboring robots. We show that the distance between neighboring pairs in the line topology depends mainly on the wind speed and the environmental conditions, whereas, the number of robots and the swarm's crosswind movement distance do not show significant impact on optimal configurations. These solutions were analyzed and verified by simulations and experimentally validated in a reduced scale realistic environment using a set of mobile robots.

Geometry-induced fluctuations of olfactory searches in bounded domains

In olfactory search an immobile target emits chemical molecules at constant rate. The molecules are transported by the medium, which is assumed to be turbulent. Considering a searcher able to detect such chemical signals and whose motion follows the infotaxis strategy, we study the statistics of the first-passage time to the target when the searcher moves on a finite two-dimensional lattice of different geometries. Far from the target, where the concentration of chemicals is low, the direction of the searcher's first movement is determined by the geometry of the domain and the topology of the lattice, inducing strong fluctuations on the average search time with respect to the initial position of the searcher. The domain is partitioned in well-defined regions characterized by the direction of the first movement. If the search starts over the interface between two different regions, large fluctuations in the search time are observed.