Iterative near-term ecological forecasting: Needs, opportunities, and challenges

Strategies for integrating scientific evidence in water policy and law in the face of uncertainty

Understanding how human actions and environmental change affect water resources is crucial for addressing complex water management issues. The scientific tools that can produce the necessary information are ecological indicators, referring to measurable properties of the ecosystem state; environmental monitoring, the data collection process that is required to evaluate the progress towards reaching water management goals; mathematical models, linking human disturbances with the ecosystem state to predict environmental impacts; and scenarios, assisting in long-term management and policy implementation. Paradoxically, despite the rapid generation of data, evolving scientific understanding, and recent advancements in systems modeling, there is a striking imbalance between knowledge production and knowledge utilization in decision-making. In this paper, we examine the role and potential capacity of scientific tools in guiding governmental decision-making processes and identify the most critical disparities between water management, policy, law, and science. We demonstrate how the complex, uncertain, and gradually evolving nature of scientific knowledge might not always fit aptly to the legislative and policy processes and structures. We contend that the solution towards increased understanding of socio-ecological systems and reduced uncertainty lies in strengthening the connections between water management theory and practice, among the scientific tools themselves, among different stakeholders, and among the social, economic, and ecological facets of water quality management, law, and policy. We conclude by tying in three knowledge-exchange strategies, namely - adaptive management, Driver-Pressure-Status-Impact-Response (DPSIR) framework, and participatory modeling - that offer complementary perspectives to bridge the gap between science and policy.

Multi-Factor Coral Disease Risk: A new product for early warning and management

Ecological forecasts are becoming increasingly valuable tools for conservation and management. However, there are few examples of near-real-time forecasting systems that account for the wide range of ecological complexities. We developed a new coral disease ecological forecasting system that explores a suite of ecological relationships and their uncertainty and investigates how forecast skill changes with shorter lead times. The Multi-Factor Coral Disease Risk product introduced here uses a combination of ecological and marine environmental conditions to predict the risk of white syndromes and growth anomalies across reefs in the central and western Pacific and along the east coast of Australia and is available through the US National Oceanic and Atmospheric Administration Coral Reef Watch program. This product produces weekly forecasts for a moving window of 6 months at a resolution of ~5 km based on quantile regression forests. The forecasts show superior skill at predicting disease risk on withheld survey data from 2012 to 2020 compared with predecessor forecast systems, with the biggest improvements shown for predicting disease risk at mid- to high-disease levels. Most of the prediction uncertainty arises from model uncertainty, so prediction accuracy and precision do not improve substantially with shorter lead times. This result arises because many predictor variables cannot be accurately forecasted, which is a common challenge across ecosystems. Weekly forecasts and scenarios can be explored through an online decision support tool and data explorer, co-developed with end-user groups to improve use and understanding of ecological forecasts. The models provide near-real-time disease risk assessments and allow users to refine predictions and assess intervention scenarios. This work advances the field of ecological forecasting with real-world complexities and, in doing so, better supports near-term decision making for coral reef ecosystem managers and stakeholders. Secondarily, we identify clear needs and provide recommendations to further enhance our ability to forecast coral disease risk.

Applying a method before its proof of concept: A cautionary tale using inferred food webs

There are significant pitfalls associated with developing food webs using inferred approaches, including violations of ecological assumptions, which considerably undermine their potentiality to resemble ecological communities and hence be practically useful. As data‐driven scientists, we must, at the very least, test against some empirical data to establish confidence that indeed the inferred food webs reflect their supposed in situ communities. Otherwise, using inferred networks to make bold claims—like the titular statement by Botella et al. (2024)  that food webs are influenced by land‐use intensity—is highly unlikely to be useful, especially when the aforementioned claim is unsubstantiated by the Authors' own statistical analyses.

Developing a predictive science of the biosphere requires the integration of scientific cultures

Increasing the speed of scientific progress is urgently needed to address the many challenges associated with the biosphere in the Anthropocene. Consequently, the critical question becomes: How can science most rapidly progress to address large, complex global problems? We suggest that the lag in the development of a more predictive science of the biosphere is not only because the biosphere is so much more complex, or because we do not have enough data, or are not doing enough experiments, but, in large part, because of unresolved tension between the three dominant scientific cultures that pervade the research community. We introduce and explain the concept of the three scientific cultures and present a novel analysis of their characteristics, supported by examples and a formal mathematical definition/representation of what this means and implies. The three cultures operate, to varying degrees, across all of science. However, within the biosciences, and in contrast to some of the other sciences, they remain relatively more separated, and their lack of integration has hindered their potential power and insight. Our solution to accelerating a broader, predictive science of the biosphere is to enhance integration of scientific cultures. The process of integration-Scientific Transculturalism-recognizes that the push for interdisciplinary research, in general, is just not enough. Unless these cultures of science are formally appreciated and their thinking iteratively integrated into scientific discovery and advancement, there will continue to be numerous significant challenges that will increasingly limit forecasting and prediction efforts.

Improving species distribution forecasts by measuring and communicating uncertainty: An invasive species case study

Forecasting invasion risk under future climate conditions is critical for the effective management of invasive species, and species distribution models (SDMs) are key tools for doing so. However, SDM-based forecasts are uncertain, especially when correlative statistical models extrapolate to nonanalog environmental domains, such as future climate conditions. Different assumptions about the functional form of the temperature-suitability relationship can impact predicted habitat suitability under novel conditions. Hence, methods to understand the sources of uncertainty are critical when applying SDMs. Here, we use high-resolution predictions of lake water temperatures to project changes in habitat suitability under future climate conditions for an invasive macrophyte (Myriophyllym spicatum). Future suitability was predicted using five global circulation models and three statistical models that assumed different species-temperature functional responses. The suitability of lakes for M. spicatum was overall predicted to increase under future climate conditions, but the magnitude and direction of change in suitability varied greatly among lakes. Variability was most pronounced for lakes under nonanalog temperature conditions, indicating that predictions for these lakes remained highly uncertain. Integrating predictions from SDMs that differ in their species-environment response function, while explicitly quantifying uncertainty across analog and nonanalog domains, can provide a more robust and useful approach to forecasting invasive species distribution under climate change.

Using neural ordinary differential equations to predict complex ecological dynamics from population density data

Simple models have been used to describe ecological processes for over a century. However, the complexity of ecological systems makes simple models subject to modelling bias due to simplifying assumptions or unaccounted factors, limiting their predictive power. Neural ordinary differential equations (NODEs) have surged as a machine-learning algorithm that preserves the dynamic nature of the data (Chen et al. 2018 Adv. Neural Inf. Process. Syst.). Although preserving the dynamics in the data is an advantage, the question of how NODEs perform as a forecasting tool of ecological communities is unanswered. Here, we explore this question using simulated time series of competing species in a time-varying environment. We find that NODEs provide more precise forecasts than autoregressive integrated moving average (ARIMA) models. We also find that untuned NODEs have a similar forecasting accuracy to untuned long-short term memory neural networks and both are outperformed in accuracy and precision by empirical dynamical modelling . However, we also find NODEs generally outperform all other methods when evaluating with the interval score, which evaluates precision and accuracy in terms of prediction intervals rather than pointwise accuracy. We also discuss ways to improve the forecasting performance of NODEs. The power of a forecasting tool such as NODEs is that it can provide insights into population dynamics and should thus broaden the approaches to studying time series of ecological communities.

Biological invasions are a population-level rather than a species-level phenomenon

Biological invasions pose a rapidly expanding threat to the persistence, functioning and service provisioning of ecosystems globally, and to socio-economic interests. The stages of successful invasions are driven by the same mechanism that underlies adaptive changes across species in general-via natural selection on intraspecific variation in traits that influence survival and reproductive performance (i.e., fitness). Surprisingly, however, the rapid progress in the field of invasion science has resulted in a predominance of species-level approaches (such as deny lists), often irrespective of natural selection theory, local adaptation and other population-level processes that govern successful invasions. To address these issues, we analyse non-native species dynamics at the population level by employing a database of European freshwater macroinvertebrate time series, to investigate spreading speed, abundance dynamics and impact assessments among populations. Our findings reveal substantial variability in spreading speed and abundance trends within and between macroinvertebrate species across biogeographic regions, indicating that levels of invasiveness and impact differ markedly. Discrepancies and inconsistencies among species-level risk screenings and real population-level data were also identified, highlighting the inherent challenges in accurately assessing population-level effects through species-level assessments. In recognition of the importance of population-level assessments, we urge a shift in invasive species management frameworks, which should account for the dynamics of different populations and their environmental context. Adopting an adaptive, region-specific and population-focused approach is imperative, considering the diverse ecological contexts and varying degrees of susceptibility. Such an approach could improve and refine risk assessments while promoting mechanistic understandings of risks and impacts, thereby enabling the development of more effective conservation and management strategies.

Employing hybrid deep learning for near-real-time forecasts of sensor-based algal parameters in a Microcystis bloom-dominated lake

Harmful cyanobacterial blooms (CyanoHABs) are increasingly impacting the ecosystem of lakes, reservoirs and estuaries globally. The integration of real-time monitoring and deep learning technology has opened up new horizons for early warnings of CyanoHABs. However, unlike traditional methods such as pigment quantification or microscopy counting, the high-frequency data from in-situ fluorometric sensors display unpredictable fluctuations and variability, posing a challenge for predictive models to discern underlying trends within the time-series sequence. This study introduces a hybrid framework for near-real-time CyanoHABs predictions in a cyanobacterium Microcystis-dominated lake - Lake Dianchi, China. The proposed model was validated using hourly Chlorophyll-a (Chl a) concentrations and algal cell densities. Our results demonstrate that applying decomposition-based singular spectrum analysis (SSA) significantly enhances the prediction accuracy of subsequent CyanoHABs models, particularly in the case of temporal convolutional network (TCN). Comparative experiments revealed that the SSA-TCN model outperforms other SSA-based deep learning models for predicting Chl a (R2 = 0.45-0.93, RMSE = 2.29-5.89 μg/L) and algal cell density (R2 = 0.63-0.89, RMSE = 9489.39-16,015.37 cells/mL) at one to four steps ahead predictions. The forecast of bloom intensities achieved a remarkable accuracy of 98.56 % and an average precision rate of 94.04 % ± 0.05 %. In addition, scenarios involving various input combinations of environmental factors demonstrated that water temperature emerged as the most effective driver for CyanoHABs predictions, with a mean RMSE of 2.94 ± 0.12 μg/L, MAE of 1.55 ± 0.09 μg/L, and R2 of 0.83 ± 0.01. Overall, the newly developed approach underscores the potential of a well-designed hybrid deep-learning framework for accurately predicting sensor-based algal parameters. It offers novel perspectives for managing CyanoHABs through online monitoring and artificial intelligence in aquatic ecosystems.

Ecological forecasts of insect range dynamics: a broad range of taxa includes winners and losers under future climate

Species distribution models are the primary tools to project future species' distributions, but this complex task is influenced by data limitations and evolving best practices. The majority of the 53 studies we examined utilized correlative models and did not follow current best practices for validating retrospective or future environmental data layers. Despite this, a summary of results is largely unsurprising: shifts toward cooler regions, but otherwise mixed dynamics emphasizing winners and losers. Harmful insects were more likely to show positive outcomes compared with beneficial species. Our restricted ability to consider mechanisms complicates interpretation of any single study. To improve this area of modeling, more classic field and lab studies to uncover basic ecology and physiology are crucial.

Life Is Uncertain: Inherent Variability Exhibited by Organisms, and at Higher Levels of Biological Organization

Organisms act stochastically. A not uncommon view in the ecological literature is that this is mainly due to the observer having insufficient information or a stochastic environment-and not partly because organisms themselves respond with inherent unpredictability. In this study, I compile the evidence that contradicts that view. Organisms generate uncertainty internally, which results in irreducible stochastic responses. I consider why: for instance, stochastic responses are associated with greater adaptability to changing environments and resource availability. Over longer timescales, biologically generated uncertainty influences behavior, evolution, and macroecological processes. Indeed, it could be stated that organisms are systems defined by the internal generation, magnification, and record-keeping of uncertainty as inputs to responses. Important practical implications arise if organisms can indeed be defined by an association with specific classes of inherent uncertainty: not least that isolating those signatures then provides a potential means for detecting life, for considering the forms that life could theoretically take, and for exploring the wider limits to how life might become distributed. These are all fundamental goals in astrobiology.

Weak evidence of density dependent population regulation when using the ability of two simple density dependent models to predict population size

The relative importance of density dependence regulation in natural population fluctuations has long been debated. The concept of density dependence implies that current abundance is determined by historical abundance. We have developed four models-two density dependent and two density independent-to predict population size one year beyond the training set and used predictive performance on more than 16,000 populations from 14 datasets to compare the understanding captured by those models. For 4 of 14 datasets the density dependent models make better predictions (i.e., density dependent regulated) than either of the density independent models. However, neither of the density dependent models is statistically significantly superior to density independent models for any of the 14 datasets. We conclude that the evidence for widespread density dependent population regulation in the forms represented by these two simple density-dependent models is weak. However, the density dependent models used here-the Logistic and Gompertz models-are simple representations of how population density might regulate natural populations and only examine density-dependent effects on population size. A comprehensive assessment of the relative importance of density-dependent population regulation will require testing the predictive ability of a wider range of density-dependent models including models examining effects on population characteristics other than population size.

A cloudy forecast for species distribution models: Predictive uncertainties abound for California birds after a century of climate and land-use change

Correlative species distribution models are widely used to quantify past shifts in ranges or communities, and to predict future outcomes under ongoing global change. Practitioners confront a wide range of potentially plausible models for ecological dynamics, but most specific applications only consider a narrow set. Here, we clarify that certain model structures can embed restrictive assumptions about key sources of forecast uncertainty into an analysis. To evaluate forecast uncertainties and our ability to explain community change, we fit and compared 39 candidate multi- or joint species occupancy models to avian incidence data collected at 320 sites across California during the early 20th century and resurveyed a century later. We found massive (>20,000 LOOIC) differences in within-time information criterion across models. Poorer fitting models omitting multivariate random effects predicted less variation in species richness changes and smaller contemporary communities, with considerable variation in predicted spatial patterns in richness changes across models. The top models suggested avian environmental associations changed across time, contemporary avian occupancy was influenced by previous site-specific occupancy states, and that both latent site variables and species associations with these variables also varied over time. Collectively, our results recapitulate that simplified model assumptions not only impact predictive fit but may mask important sources of forecast uncertainty and mischaracterize the current state of system understanding when seeking to describe or project community responses to global change. We recommend that researchers seeking to make long-term forecasts prioritize characterizing forecast uncertainty over seeking to present a single best guess. To do so reliably, we urge practitioners to employ models capable of characterizing the key sources of forecast uncertainty, where predictors, parameters and random effects may vary over time or further interact with previous occurrence states.

Context matters in ecological forecasting: Lessons in predicting species distributions

Forecasting the future state of a species is a tricky process, as there are numerous hidden factors that influence species trajectories in addition to the obvious unknowns about the future state of the planet. We echo the guidance of Clare et al. (2024) to use near‐term and long‐term forecasting in complementary ways. Near‐term forecasts can be used to guide specific management and conservation actions, which can be updated as new data and evidence are collected. Long‐term forecasts can be used to characterize uncertainty further into the future, which can help guide longstanding conservation planning and legislative actions that are based on such uncertainty in possible future outcomes.

Forecasting freshwater cyanobacterial harmful algal blooms for Sentinel-3 satellite resolved U.S. lakes and reservoirs

This forecasting approach may be useful for water managers and associated public health managers to predict near-term future high-risk cyanobacterial harmful algal blooms (cyanoHAB) occurrence. Freshwater cyanoHABs may grow to excessive concentrations and cause human, animal, and environmental health concerns in lakes and reservoirs. Knowledge of the timing and location of cyanoHAB events is important for water quality management of recreational and drinking water systems. No quantitative tool exists to forecast cyanoHABs across broad geographic scales and at regular intervals. Publicly available satellite monitoring has proven effective in detecting cyanobacteria biomass near-real time within the United States. Weekly cyanobacteria abundance was quantified from the Ocean and Land Colour Instrument (OLCI) onboard the Sentinel-3 satellite as the response variable. An Integrated Nested Laplace Approximation (INLA) hierarchical Bayesian spatiotemporal model was applied to forecast World Health Organization (WHO) recreation Alert Level 1 exceedance >12 μg L-1 chlorophyll-a with cyanobacteria dominance for 2192 satellite resolved lakes in the United States across nine climate zones. The INLA model was compared against support vector classifier and random forest machine learning models; and Dense Neural Network, Long Short-Term Memory (LSTM), Recurrent Neural Network (RNN), and Gneural Network (GNU) neural network models. Predictors were limited to data sources relevant to cyanobacterial growth, readily available on a weekly basis, and at the national scale for operational forecasting. Relevant predictors included water surface temperature, precipitation, and lake geomorphology. Overall, the INLA model outperformed the machine learning and neural network models with prediction accuracy of 90% with 88% sensitivity, 91% specificity, and 49% precision as demonstrated by training the model with data from 2017 through 2020 and independently assessing predictions with data from the 2021 calendar year. The probability of true positive responses was greater than false positive responses and the probability of true negative responses was less than false negative responses. This indicated the model correctly assigned lower probabilities of events when they didn't exceed the WHO Alert Level 1 threshold and assigned higher probabilities when events did exceed the threshold. The INLA model was robust to missing data and unbalanced sampling between waterbodies.

Ecological forecasts for marine resource management during climate extremes

Forecasting weather has become commonplace, but as society faces novel and uncertain environmental conditions there is a critical need to forecast ecology. Forewarning of ecosystem conditions during climate extremes can support proactive decision-making, yet applications of ecological forecasts are still limited. We showcase the capacity for existing marine management tools to transition to a forecasting configuration and provide skilful ecological forecasts up to 12 months in advance. The management tools use ocean temperature anomalies to help mitigate whale entanglements and sea turtle bycatch, and we show that forecasts can forewarn of human-wildlife interactions caused by unprecedented climate extremes. We further show that regionally downscaled forecasts are not a necessity for ecological forecasting and can be less skilful than global forecasts if they have fewer ensemble members. Our results highlight capacity for ecological forecasts to be explored for regions without the infrastructure or capacity to regionally downscale, ultimately helping to improve marine resource management and climate adaptation globally.

Digital twins: dynamic model-data fusion for ecology

Digital twins (DTs) are an emerging phenomenon in the public and private sectors as a new tool to monitor and understand systems and processes. DTs have the potential to change the status quo in ecology as part of its digital transformation. However, it is important to avoid misguided developments by managing expectations about DTs. We stress that DTs are not just big models of everything, containing big data and machine learning. Rather, the strength of DTs is in combining data, models, and domain knowledge, and their continuous alignment with the real world. We suggest that researchers and stakeholders exercise caution in DT development, keeping in mind that many of the strengths and challenges of computational modelling in ecology also apply to DTs.

Impacts of marine heatwaves on top predator distributions are variable but predictable

Marine heatwaves cause widespread environmental, biological, and socio-economic impacts, placing them at the forefront of 21st-century management challenges. However, heatwaves vary in intensity and evolution, and a paucity of information on how this variability impacts marine species limits our ability to proactively manage for these extreme events. Here, we model the effects of four recent heatwaves (2014, 2015, 2019, 2020) in the Northeastern Pacific on the distributions of 14 top predator species of ecological, cultural, and commercial importance. Predicted responses were highly variable across species and heatwaves, ranging from near total loss of habitat to a two-fold increase. Heatwaves rapidly altered political bio-geographies, with up to 10% of predicted habitat across all species shifting jurisdictions during individual heatwaves. The variability in predicted responses across species and heatwaves portends the need for novel management solutions that can rapidly respond to extreme climate events. As proof-of-concept, we developed an operational dynamic ocean management tool that predicts predator distributions and responses to extreme conditions in near real-time.

The Internet of Animals: what it is, what it could be

One of the biggest trends in ecology over the past decade has been the creation of standardized databases. Recently, this has included live data, formal linkages between disparate databases, and automated analytics, a synergy that we recognize as the Internet of Animals (IoA). Early IoA systems relate animal locations to remote-sensing data to predict species distributions and detect disease outbreaks, and use live data to inform management of endangered species. However, meeting the future potential of the IoA concept will require solving challenges of taxonomy, data security, and data sharing. By linking data sets, integrating live data, and automating workflows, the IoA has the potential to enable discoveries and predictions relevant to human societies and the conservation of animals.

Climate-ecosystem modelling made easy: The Land Sites Platform

Dynamic Global Vegetation Models (DGVMs) provide a state-of-the-art process-based approach to study the complex interplay between vegetation and its physical environment. For example, they help to predict how terrestrial plants interact with climate, soils, disturbance and competition for resources. We argue that there is untapped potential for the use of DGVMs in ecological and ecophysiological research. One fundamental barrier to realize this potential is that many researchers with relevant expertize (ecology, plant physiology, soil science, etc.) lack access to the technical resources or awareness of the research potential of DGVMs. Here we present the Land Sites Platform (LSP): new software that facilitates single-site simulations with the Functionally Assembled Terrestrial Ecosystem Simulator, an advanced DGVM coupled with the Community Land Model. The LSP includes a Graphical User Interface and an Application Programming Interface, which improve the user experience and lower the technical thresholds for installing these model architectures and setting up model experiments. The software is distributed via version-controlled containers; researchers and students can run simulations directly on their personal computers or servers, with relatively low hardware requirements, and on different operating systems. Version 1.0 of the LSP supports site-level simulations. We provide input data for 20 established geo-ecological observation sites in Norway and workflows to add generic sites from public global datasets. The LSP makes standard model experiments with default data easily achievable (e.g., for educational or introductory purposes) while retaining flexibility for more advanced scientific uses. We further provide tools to visualize the model input and output, including simple examples to relate predictions to local observations. The LSP improves access to land surface and DGVM modelling as a building block of community cyberinfrastructure that may inspire new avenues for mechanistic ecosystem research across disciplines.

Uncertainties in the adaptation of alpine pastures to climate change based on remote sensing products and modelling

Over the last century, the management of pastoral systems has undergone major changes to meet the livelihood needs of alpine communities. Faced with the changes induced by recent global warming, the ecological status of many pastoral systems has seriously deteriorated in the western alpine region. We assessed changes in pasture dynamics by integrating information from remote-sensing products and two process-based models, i.e. the grassland-specific, biogeochemical growth model PaSim and the generic crop-growth model DayCent. Meteorological observations and satellite-derived Normalised Difference Vegetation Index (NDVI) trajectories of three pasture macro-types (high, medium and low productivity classes) in two study areas - Parc National des Écrins (PNE) in France and Parco Nazionale Gran Paradiso (PNGP) in Italy - were used as a basis for the model calibration work. The performance of the models was satisfactory in reproducing pasture production dynamics (R² = 0.52 to 0.83). Projected changes in alpine pastures due to climate-change impacts and adaptation strategies indicate that: i) the length of the growing season is expected to increase between 15 and 40 days, resulting in changes in the timing and amount of biomass production, ii) summer water stress could limit pasture productivity; iii) earlier onset of grazing could enhance pasture productivity; iv) higher livestock densities could increase the rate of biomass regrowth, but major uncertainties in modelling processes need to be considered; and v) the carbon sequestration potential of pastures could decrease under limited water availability and warming.

Forecast-based action for conservation

Extreme weather events pose an immediate threat to biodiversity, but existing conservation strategies have limitations. Advances in meteorological forecasting and innovation in the humanitarian sector provide a possible solution-forecast-based action (FbA). The growth of ecological forecasting demonstrates the huge potential to anticipate conservation outcomes, but a lack of operational examples suggests a new approach is needed to translate forecasts into action. FbA provides such a framework, formalizing the use of meteorological forecasts to anticipate and mitigate the impacts of extreme weather. Based on experience from the humanitarian sector, I suggest how FbA could work in conservation, demonstrating key concepts using the theoretical example of heatwave impacts on sea turtle embryo mortality, and address likely challenges in realizing FbA for conservation, including establishing a financing mechanism, allocating funds to actions, and decision-making under uncertainty. FbA will demand changes in conservation research, practice, and governance. Researchers must increase efforts to understand the impacts of extreme weather at more immediate and actionable timescales and should coproduce forecasts of such impacts with practitioners. International conservation funders should establish systems to fund anticipatory actions based on uncertain forecasts.

Networking the forest infrastructure towards near real-time monitoring - A white paper

Forests account for nearly 90 % of the world's terrestrial biomass in the form of carbon and they support 80 % of the global biodiversity. To understand the underlying forest dynamics, we need a long-term but also relatively high-frequency, networked monitoring system, as traditionally used in meteorology or hydrology. While there are numerous existing forest monitoring sites, particularly in temperate regions, the resulting data streams are rarely connected and do not provide information promptly, which hampers real-time assessments of forest responses to extreme climate events. The technology to build a better global forest monitoring network now exists. This white paper addresses the key structural components needed to achieve a novel meta-network. We propose to complement - rather than replace or unify - the existing heterogeneous infrastructure with standardized, quality-assured linking methods and interacting data processing centers to create an integrated forest monitoring network. These automated (research topic-dependent) linking methods in atmosphere, biosphere, and pedosphere play a key role in scaling site-specific results and processing them in a timely manner. To ensure broad participation from existing monitoring sites and to establish new sites, these linking methods must be as informative, reliable, affordable, and maintainable as possible, and should be supplemented by near real-time remote sensing data. The proposed novel meta-network will enable the detection of emergent patterns that would not be visible from isolated analyses of individual sites. In addition, the near real-time availability of data will facilitate predictions of current forest conditions (nowcasts), which are urgently needed for research and decision making in the face of rapid climate change. We call for international and interdisciplinary efforts in this direction.

Learning from monitoring networks: Few-large vs. many-small plots and multi-scale analysis

In order to learn about broad scale ecological patterns, data from large-scale surveys must allow us to either estimate the correlations between the environment and an outcome and/or accurately predict ecological patterns. An important part of data collection is the sampling effort used to collect observations, which we decompose into two quantities: the number of observations or plots (n) and the per-observation/plot effort (E; e.g., area per plot). If we want to understand the relationships between predictors and a response variable, then lower model parameter uncertainty is desirable. If the goal is to predict a response variable, then lower prediction error is preferable. We aim to learn if and when aggregating data can help attain these goals. We find that a small sample size coupled with large observation effort coupled (few large) can yield better predictions when compared to a large number of observations with low observation effort (many small). We also show that the combination of the two values (n and E), rather than one alone, has an impact on parameter uncertainty. In an application to Forest Inventory and Analysis (FIA) data, we model the tree density of selected species at various amounts of aggregation using linear regression in order to compare the findings from simulated data to real data. The application supports the theoretical findings that increasing observational effort through aggregation can lead to improved predictions, conditional on the thoughtful aggregation of the observational plots. In particular, aggregations over extremely large and variable covariate space may lead to poor prediction and high parameter uncertainty. Analyses of large-range data can improve with aggregation, with implications for both model evaluation and sampling design: testing model prediction accuracy without an underlying knowledge of the datasets and the scale at which predictor variables operate can obscure meaningful results.

Daily activity timing in the Anthropocene

Animals are facing novel 'timescapes' in which the stimuli entraining their daily activity patterns no longer match historical conditions due to anthropogenic disturbance. However, the ecological effects (e.g., altered physiology, species interactions) of novel activity timing are virtually unknown. We reviewed 1328 studies and found relatively few focusing on anthropogenic effects on activity timing. We suggest three hypotheses to stimulate future research: (i) activity-timing mismatches determine ecological effects, (ii) duration and timing of timescape modification influence effects, and (iii) consequences of altered activity timing vary biogeographically due to broad-scale variation in factors compressing timescapes. The continued growth of sampling technologies promises to facilitate the study of the consequences of altered activity timing, with emerging applications for biodiversity conservation.

The effects of light pollution on migratory animal behavior

Light pollution is a global threat to biodiversity, especially migratory organisms, some of which traverse hemispheric scales. Research on light pollution has grown significantly over the past decades, but our review of migratory organisms demonstrates gaps in our understanding, particularly beyond migratory birds. Research across spatial scales reveals the multifaceted effects of artificial light on migratory species, ranging from local and regional to macroscale impacts. These threats extend beyond species that are active at night - broadening the scope of this threat. Emerging tools for measuring light pollution and its impacts, as well as ecological forecasting techniques, present new pathways for conservation, including transdisciplinary approaches.

Climate-informed forecasts reveal dramatic local habitat shifts and population uncertainty for northern boreal caribou

Most research on boreal populations of woodland caribou (Rangifer tarandus caribou) has been conducted in areas of high anthropogenic disturbance. However, a large portion of the species' range overlaps relatively pristine areas primarily affected by natural disturbances, such as wildfire. Climate-driven habitat change is a key concern for the conservation of boreal-dependent species, where management decisions have yet to consider knowledge from multiple ecological domains integrated into a cohesive and spatially explicit forecast of species-specific habitat and demography. We used a novel ecological forecasting framework to provide climate-sensitive projections of habitat and demography for five boreal caribou monitoring areas within the Northwest Territories (NWT), Canada, over 90 years. Importantly, we quantify uncertainty around forecasted mean values. Our results suggest habitat suitability may increase in central and southwest regions of the NWT's Taiga Plains ecozone but decrease in southern and northwestern regions driven by conversion of coniferous to deciduous forests. We do not project that boreal caribou population growth rates will change despite forecasted changes to habitat suitability. Our results emphasize the importance of efforts to protect and restore northern boreal caribou habitat despite climate uncertainty while highlighting expected spatial variations that are important considerations for local people who rely on them. An ability to reproduce previous work, and critical thought when incorporating sources of uncertainty, will be important to refine forecasts, derive management decisions, and improve conservation efficacy for northern species at risk.

Progress and opportunities in advancing near-term forecasting of freshwater quality

Near-term freshwater forecasts, defined as sub-daily to decadal future predictions of a freshwater variable with quantified uncertainty, are urgently needed to improve water quality management as freshwater ecosystems exhibit greater variability due to global change. Shifting baselines in freshwater ecosystems due to land use and climate change prevent managers from relying on historical averages for predicting future conditions, necessitating near-term forecasts to mitigate freshwater risks to human health and safety (e.g., flash floods, harmful algal blooms) and ecosystem services (e.g., water-related recreation and tourism). To assess the current state of freshwater forecasting and identify opportunities for future progress, we synthesized freshwater forecasting papers published in the past 5 years. We found that freshwater forecasting is currently dominated by near-term forecasts of water quantity and that near-term water quality forecasts are fewer in number and in the early stages of development (i.e., non-operational) despite their potential as important preemptive decision support tools. We contend that more freshwater quality forecasts are critically needed and that near-term water quality forecasting is poised to make substantial advances based on examples of recent progress in forecasting methodology, workflows, and end-user engagement. For example, current water quality forecasting systems can predict water temperature, dissolved oxygen, and algal bloom/toxin events 5 days ahead with reasonable accuracy. Continued progress in freshwater quality forecasting will be greatly accelerated by adapting tools and approaches from freshwater quantity forecasting (e.g., machine learning modeling methods). In addition, future development of effective operational freshwater quality forecasts will require substantive engagement of end users throughout the forecast process, funding, and training opportunities. Looking ahead, near-term forecasting provides a hopeful future for freshwater management in the face of increased variability and risk due to global change, and we encourage the freshwater scientific community to incorporate forecasting approaches in water quality research and management.

Self-optimization of training dataset improves forecasting of cyanobacterial bloom by machine learning

Data-driven model (DDM) prediction of aquatic ecological responses, such as cyanobacterial harmful algal blooms (CyanoHABs), is critically influenced by the choice of training dataset. However, a systematic method to choose the optimal training dataset considering data history has not yet been developed. Providing a comprehensive procedure with self-based optimal training dataset-selecting algorithm would self-improve the DDM performance. In this study, a novel algorithm was developed to self-generate possible training dataset candidates from the available input and output variable data and self-choose the optimal training dataset that maximizes CyanoHAB forecasting performance. Nine years of meteorological and water quality data (input) and CyanoHAB data (output) from a site on the Nakdong River, South Korea, were acquired and pretreated via an automated process. An artificial neural network (ANN) was chosen from among the DDM candidates by first-cut training and validation using the entire collected dataset. Optimal training datasets for the ANN were self-selected from among the possible self-generated training datasets by systematically simulating the performance in response to 46 periods and 40 sizes (number of data elements) of the generated training datasets. The best-performing models were screened to identify the candidate models. The best performance corresponded to 6-7 years of training data (∼18 % lower error) for forecasting 1-28 d ahead (1-28 d of forecasting lead time (FLT)). After the hyperparameters of the screened model candidates were fine-tuned, the best-performing model (7 years of data with 14 d FLT) was self-determined by comparing the forecasts with unseen CyanoHAB events. The self-determined model could reasonably predict CyanoHABs occurring in Korean waters (cyanobacteria cells/mL ≥ 1000). Thus, our proposed method of self-optimizing the training dataset effectively improved the predictive accuracy and operational efficiency of the DDM prediction of CyanoHAB.

Constraining nonlinear time series modeling with the metabolic theory of ecology

Forecasting the response of ecological systems to environmental change is a critical challenge for sustainable management. The metabolic theory of ecology (MTE) posits scaling of biological rates with temperature, but it has had limited application to population dynamic forecasting. Here we use the temperature dependence of the MTE to constrain empirical dynamic modeling (EDM), an equation-free nonlinear machine learning approach for forecasting. By rescaling time with temperature and modeling dynamics on a "metabolic time step," our method (MTE-EDM) improved forecast accuracy in 18 of 19 empirical ectotherm time series (by 19% on average), with the largest gains in more seasonal environments. MTE-EDM assumes that temperature affects only the rate, rather than the form, of population dynamics, and that interacting species have approximately similar temperature dependence. A review of laboratory studies suggests these assumptions are reasonable, at least approximately, though not for all ecological systems. Our approach highlights how to combine modern data-driven forecasting techniques with ecological theory and mechanistic understanding to predict the response of complex ecosystems to temperature variability and trends.

Assessing Ecosystem State Space Models: Identifiability and Estimation

Hierarchical probability models are being used more often than non-hierarchical deterministic process models in environmental prediction and forecasting, and Bayesian approaches to fitting such models are becoming increasingly popular. In particular, models describing ecosystem dynamics with multiple states that are autoregressive at each step in time can be treated as statistical state space models (SSMs). In this paper, we examine this subset of ecosystem models, embed a process-based ecosystem model into an SSM, and give closed form Gibbs sampling updates for latent states and process precision parameters when process and observation errors are normally distributed. Here, we use simulated data from an example model (DALECev) and study the effects changing the temporal resolution of observations on the states (observation data gaps), the temporal resolution of the state process (model time step), and the level of aggregation of observations on fluxes (measurements of transfer rates on the state process). We show that parameter estimates become unreliable as temporal gaps between observed state data increase. To improve parameter estimates, we introduce a method of tuning the time resolution of the latent states while still using higher-frequency driver information and show that this helps to improve estimates. Further, we show that data cloning is a suitable method for assessing parameter identifiability in this class of models. Overall, our study helps inform the application of state space models to ecological forecasting applications where (1) data are not available for all states and transfers at the operational time step for the ecosystem model and (2) process uncertainty estimation is desired.

Integrated Population Models: Achieving Their Potential

Precise and accurate estimates of abundance and demographic rates are primary quantities of interest within wildlife conservation and management. Such quantities provide insight into population trends over time and the associated underlying ecological drivers of the systems. This information is fundamental in managing ecosystems, assessing species conservation status and developing and implementing effective conservation policy. Observational monitoring data are typically collected on wildlife populations using an array of different survey protocols, dependent on the primary questions of interest. For each of these survey designs, a range of advanced statistical techniques have been developed which are typically well understood. However, often multiple types of data may exist for the same population under study. Analyzing each data set separately implicitly discards the common information contained in the other data sets. An alternative approach that aims to optimize the shared information contained within multiple data sets is to use a “model-based data integration” approach, or more commonly referred to as an “integrated model.” This integrated modeling approach simultaneously analyzes all the available data within a single, and robust, statistical framework. This paper provides a statistical overview of ecological integrated models, with a focus on integrated population models (IPMs) which include abundance and demographic rates as quantities of interest. Four main challenges within this area are discussed, namely model specification, computational aspects, model assessment and forecasting. This should encourage researchers to explore further and develop new practical tools to ensure that full utility can be made of IPMs for future studies.

Adaptive Gaussian Markov random field spatiotemporal models for infectious disease mapping and forecasting

Recent disease mapping literature presents adaptively parameterized spatiotemporal (ST) autoregressive (AR) or conditional autoregressive (CAR) models for Bayesian prediction of COVID-19 infection risks. These models were motivated to capture complex spatiotemporal dynamics and heterogeneities of infection risks. In the present paper, we synthesize, generalize, and unify the ST AR and CAR model constructions for models augmented by adaptive Gaussian Markov random fields, with an emphasis on disease forecasting. A general convolution construction is presented, with illustrative models motivated to (i) characterize local risk dependencies and influences over both spatial and temporal dimensions, (ii) model risk heterogeneities and discontinuities, and (iii) predict and forecast areal-level disease risks and occurrences. The broadened constructions allow rich options of intuitive parameterization for disease mapping and spatial regression. Illustrative parameterizations are presented for Bayesian hierarchical models of Poisson, zero-inflated Poisson, and Bernoulli data models, respectively. They are also discussed in the context of quantifying time-varying or time-invariant effects of (omitted) covariates, with application to prediction and forecasting areal-level COVID-19 infection occurrences and probabilities of zero-infection. The model constructions presented herein have much wider scope in offering a flexible framework for modelling complex spatiotemporal data and for estimation, learning, and forecasting purposes.

Mechanistic forecasts of species responses to climate change: The promise of biophysical ecology

A core challenge in global change biology is to predict how species will respond to future environmental change and to manage these responses. To make such predictions and management actions robust to novel futures, we need to accurately characterize how organisms experience their environments and the biological mechanisms by which they respond. All organisms are thermodynamically connected to their environments through the exchange of heat and water at fine spatial and temporal scales and this exchange can be captured with biophysical models. Although mechanistic models based on biophysical ecology have a long history of development and application, their use in global change biology remains limited despite their enormous promise and increasingly accessible software. We contend that greater understanding and training in the theory and methods of biophysical ecology is vital to expand their application. Our review shows how biophysical models can be implemented to understand and predict climate change impacts on species' behavior, phenology, survival, distribution, and abundance. It also illustrates the types of outputs that can be generated, and the data inputs required for different implementations. Examples range from simple calculations of body temperature at a particular site and time, to more complex analyses of species' distribution limits based on projected energy and water balances, accounting for behavior and phenology. We outline challenges that currently limit the widespread application of biophysical models relating to data availability, training, and the lack of common software ecosystems. We also discuss progress and future developments that could allow these models to be applied to many species across large spatial extents and timeframes. Finally, we highlight how biophysical models are uniquely suited to solve global change biology problems that involve predicting and interpreting responses to environmental variability and extremes, multiple or shifting constraints, and novel abiotic or biotic environments.

Pathways to global-change effects on biodiversity: new opportunities for dynamically forecasting demography and species interactions

In structured populations, persistence under environmental change may be particularly threatened when abiotic factors simultaneously negatively affect survival and reproduction of several life cycle stages, as opposed to a single stage. Such effects can then be exacerbated when species interactions generate reciprocal feedbacks between the demographic rates of the different species. Despite the importance of such demographic feedbacks, forecasts that account for them are limited as individual-based data on interacting species are perceived to be essential for such mechanistic forecasting-but are rarely available. Here, we first review the current shortcomings in assessing demographic feedbacks in population and community dynamics. We then present an overview of advances in statistical tools that provide an opportunity to leverage population-level data on abundances of multiple species to infer stage-specific demography. Lastly, we showcase a state-of-the-art Bayesian method to infer and project stage-specific survival and reproduction for several interacting species in a Mediterranean shrub community. This case study shows that climate change threatens populations most strongly by changing the interaction effects of conspecific and heterospecific neighbours on both juvenile and adult survival. Thus, the repurposing of multi-species abundance data for mechanistic forecasting can substantially improve our understanding of emerging threats on biodiversity.

Spatiotemporal dynamics of forest geometrid outbreaks

We highlight recent developments and avenues for advancement, which can improve insight into the causes of changes in the spatiotemporal dynamics of forest Geometridea moth species (hereafter 'geometrids'). Some forest geometrids possess fundamental biological traits, which make them particularly liable to outbreak range expansions and host shifts mitigated by climate change. Indeed, recently observed changes in geometrid spatiotemporal dynamics represent both new research opportunities and challenges for empirically testing drivers of intra- and interspecific spatial synchrony, including the role of trophic interactions and biological traits (e.g. dispersal ability). We advocate that the emerging field of near-term ecological forecasting holds promise for studies of the spatiotemporal dynamics of forest geometrids and could be tailored to give both accurate predictions at management-relevant timescales and new insights into the mechanisms that underlie spatiotemporal population dynamics.

Advancing freshwater ecological forecasts: Harmful algal blooms in Lake Erie

Ecological models help provide forecasts of ecosystem responses to natural and anthropogenic stresses. However, their ability to create reliable predictions requires forecasts with track records sufficiently long to build confidence, skill assessments, and treating uncertainty quantitatively. We use Lake Erie harmful algal blooms as a case study to help formalize ecological forecasting. Key challenges for models include uncertainty in the deterministic structure of the load-bloom relationship and the need to assess alternative drivers (e.g., biologically available phosphorus load, spring load, longer term cumulative load) with a larger dataset. We enhanced a Bayesian model considering new information and an expanded data set, test it through cross validation and blind forecasts, quantify and discuss its uncertainties, and apply it for assessing historical and future scenarios. Allowing a segmented relationship between bloom size and spring load indicates that loading above 0.15 Gg/month will have a substantially higher marginal impact on bloom size. The new model explains 84 % of interannual variability (9.09 Gg RMSE) when calibrated to the 19-year data set and 66 % of variability in cross validation (12.58 Gg RMSE). Blind forecasts explain 84 % of HAB variability between 2014 and 2020, which is substantially better than the actual forecast track record (R² = 0.32) over this same period. Because of internal phosphorus recycling, represented by the long-term cumulative load, it could take over a decade for HABs to fully respond to loading reductions, depending on the pace of those reductions. Thus, the desired speed and endpoint of the lake's recovery should be considered when updating and adaptively managing load reduction targets. Results are discussed in the context of ecological forecasting best pactices: incorporate new knowledge and data in model construction; account for multiple sources of uncertainty; evaluate predictive skill through validation and hindcasting; and answer management questions related to both short-term forecasts and long-term scenarios.

Science for social licence to arrest an ecosystem-transforming invasion

The primary role for scientific information in addressing complex environmental problems, such as biological invasions, is generally assumed to be as a guide for management decisions. However, scientific information often plays a minor role in decision-making, with practitioners instead relying on professional experience and local knowledge. We explore alternative pathways by which scientific information could help reduce the spread and impacts of invasive species. Our study centred on attempts to understand the main motivations and constraints of three local governance bodies responsible for the management of invasive (wilding) conifer species in the southern South Island of New Zealand in achieving strategic and operational goals. We used a combination of workshop discussions, questionnaire responses and visits to field sites to elicit feedback from study participants. We applied a mixed inductive-deductive thematic analysis approach to derive themes from the feedback received. The three main themes identified were: (1) impacts of wilding conifers and goals for wilding conifer control, (2) barriers to achieving medium- and long-term goals, and (3) science needed to support wilding conifer control. Participants identified reversal and prevention of both instrumental (e.g. reduced water availability for agriculture) and intrinsic (e.g. loss of biodiversity and landscape values) impacts of wilding conifer invasions as primary motivators behind wilding conifer control. Barriers to achieving goals were overwhelmingly social, relating either to unwillingness of landowners to participate or poorly designed regulatory frameworks. Consequently, science needs related primarily to gaining social licence to remove wilding conifers from private land and for more appropriate regulations. Scientific information provided via spread and impacts forecasting models was viewed as a key source of scientific information in gaining social licence. International experience suggests that invasive species control programmes often face significant external social barriers. Thus, for many biological invasions, the primary role of science might be to achieve social licence and regulatory support for the long-term goals of invasive species control programmes and the management interventions required to achieve those goals.

A probabilistic epidemiological model for infectious diseases: The case of COVID-19 at global-level

This study has developed a probabilistic epidemiological model a few weeks after the World Health Organization declared COVID-19 a pandemic (based on the little data available at that time). The aim was to assess relative risks for future scenarios and evaluate the effectiveness of different management actions for 1 year ahead. We quantified, categorized, and ranked the risks for scenarios such as business as usual, and moderate and strong mitigation. We estimated that, in the absence of interventions, COVID-19 would have a 100% risk of explosion (i.e., more than 25% infections in the world population) and 34% (2.6 billion) of the world population would have been infected until the end of simulation. We analyzed the suitability of model scenarios by comparing actual values against estimated values for the first 6 weeks of the simulation period. The results proved to be more suitable with a business-as-usual scenario in Asia and moderate mitigation in the other continents. If everything went on like this, we would have 55% risk of explosion and 22% (1.7 billion) of the world population would have been infected. Strong mitigation actions in all continents could reduce these numbers to, 7% and 3% (223 million), respectively. Although the results were based on the data available in March 2020, both the model and probabilistic approach proved to be practicable and could be a basis for risk assessment in future pandemic episodes with unknown virus, especially in the early stages, when data and literature are scarce.

Ecological conditions predict the intensity of Hendra virus excretion over space and time from bat reservoir hosts

The ecological conditions experienced by wildlife reservoirs affect infection dynamics and thus the distribution of pathogen excreted into the environment. This spatial and temporal distribution of shed pathogen has been hypothesised to shape risks of zoonotic spillover. However, few systems have data on both long-term ecological conditions and pathogen excretion to advance mechanistic understanding and test environmental drivers of spillover risk. We here analyse three years of Hendra virus data from nine Australian flying fox roosts with covariates derived from long-term studies of bat ecology. We show that the magnitude of winter pulses of viral excretion, previously considered idiosyncratic, are most pronounced after recent food shortages and in bat populations displaced to novel habitats. We further show that cumulative pathogen excretion over time is shaped by bat ecology and positively predicts spillover frequency. Our work emphasises the role of reservoir host ecology in shaping pathogen excretion and provides a new approach to estimate spillover risk.

Forecasting the future of life in Antarctica

Antarctic ecosystems are under increasing anthropogenic pressure, but efforts to predict the responses of Antarctic biodiversity to environmental change are hindered by considerable data challenges. Here, we illustrate how novel data capture technologies provide exciting opportunities to sample Antarctic biodiversity at wider spatiotemporal scales. Data integration frameworks, such as point process and hierarchical models, can mitigate weaknesses in individual data sets, improving confidence in their predictions. Increasing process knowledge in models is imperative to achieving improved forecasts of Antarctic biodiversity, which can be attained for data-limited species using hybrid modelling frameworks. Leveraging these state-of-the-art tools will help to overcome many of the data scarcity challenges presented by the remoteness of Antarctica, enabling more robust forecasts both near- and long-term.

Differences in initial abundances reveal divergent dynamic structures in Gause's predator-prey experiments

Improved understanding of complex dynamics has revealed insights across many facets of ecology, and has enabled improved forecasts and management of future ecosystem states. However, an enduring challenge in forecasting complex dynamics remains the differentiation between complexity and stochasticity, that is, to determine whether declines in predictability are caused by stochasticity, nonlinearity, or chaos. Here, we show how to quantify the relative contributions of these factors to prediction error using Georgii Gause's iconic predator-prey microcosm experiments, which, critically, include experimental replicates that differ from one another only in initial abundances. We show that these differences in initial abundances interact with stochasticity, nonlinearity, and chaos in unique ways, allowing us to identify the impacts of these factors on prediction error. Our results suggest that jointly analyzing replicate time series across multiple, distinct starting points may be necessary for understanding and predicting the wide range of potential dynamic types in complex ecological systems.

Life History of the Arctic Squid Gonatus fabricii (Cephalopoda: Oegopsida) Reconstructed by Analysis of Individual Ontogenetic Stable Isotopic Trajectories

Cephalopods are important in Arctic marine ecosystems as predators and prey, but knowledge of their life cycles is poor. Consequently, they are under-represented in the Arctic ecosystems assessment models. One important parameter is the change in ecological role (habitat and diet) associated with individual ontogenies. Here, the life history of Gonatus fabricii, the most abundant Arctic cephalopod, is reconstructed by the analysis of individual ontogenetic trajectories of stable isotopes (δ13C and δ15N) in archival hard body structures. This approach allows the prediction of the exact mantle length (ML) and mass when the species changes its ecological role. Our results show that the life history of G. fabricii is divided into four stages, each having a distinct ecology: (1) epipelagic squid (ML < 20 mm), preying mostly on copepods; (2) epi- and occasionally mesopelagic squid (ML 20−50 mm), preying on larger crustaceans, fish, and cephalopods; (3) meso- and bathypelagic squid (ML > 50 mm), preying mainly on fish and cephalopods; and (4) non-feeding bathypelagic gelatinous females (ML > 200 mm). Existing Arctic ecosystem models do not reflect the different ecological roles of G. fabricii correctly, and the novel data provided here are a necessary baseline for Arctic ecosystem modelling and forecasting.

Towards the fully automated monitoring of ecological communities

High-resolution monitoring is fundamental to understand ecosystems dynamics in an era of global change and biodiversity declines. While real-time and automated monitoring of abiotic components has been possible for some time, monitoring biotic components-for example, individual behaviours and traits, and species abundance and distribution-is far more challenging. Recent technological advancements offer potential solutions to achieve this through: (i) increasingly affordable high-throughput recording hardware, which can collect rich multidimensional data, and (ii) increasingly accessible artificial intelligence approaches, which can extract ecological knowledge from large datasets. However, automating the monitoring of facets of ecological communities via such technologies has primarily been achieved at low spatiotemporal resolutions within limited steps of the monitoring workflow. Here, we review existing technologies for data recording and processing that enable automated monitoring of ecological communities. We then present novel frameworks that combine such technologies, forming fully automated pipelines to detect, track, classify and count multiple species, and record behavioural and morphological traits, at resolutions which have previously been impossible to achieve. Based on these rapidly developing technologies, we illustrate a solution to one of the greatest challenges in ecology: the ability to rapidly generate high-resolution, multidimensional and standardised data across complex ecologies.