Highly optimized tolerance in epidemic models incorporating local optimization and regrowth

Three mechanisms for power laws on the Cayley tree

We compare preferential growth, critical phase transitions, and highly optimized tolerance (HOT) as mechanisms for generating power laws in the familiar and analytically tractable context of lattice percolation and forest fire models on the Cayley tree. All three mechanisms have been widely discussed in the context of complexity in natural and technological systems. This parallel study enables direct comparison of the mechanisms and associated lattice solutions. Criticality fits most naturally into the category of random processes, where power laws are a consequence of fluctuations in an ensemble with no intrinsic scale. The power laws in preferential growth can be understood in the context of competing exponential growth and decay processes. HOT generalizes this functional mechanism involving exponentials of exponentials to a broader class of nonexponential functions, which arise from optimization.

Evolutionary dynamics and highly optimized tolerance

We develop a numerical model of a lattice community based on Highly Optimized Tolerance (HOT), which relates the evolution of complexity to robustness tradeoffs in an uncertain environment. With the model, we explore scenarios for evolution and extinction which are abstractions of processes which are commonly discussed in biological and ecological case studies. These include the effects of different habitats on the phenotypic traits of the organisms, the effects of different mutation rates on adaptation, fitness, and diversity, and competition between generalists and specialists. The model exhibits a wide variety of microevolutionary and macroevolutionary phenomena which can arise in organisms which are subject to random mutation, and selection based on fitness evaluated in a specific environment. Generalists arise in uniform habitats, where different disturbances occur with equal frequency, while specialists arise when the relative frequency of different disturbances is skewed. Fast mutators are seen to play a primary role in adaptation, while slow mutators preserve well-adapted configurations. When uniform and skewed habitats are coupled through migration of the organisms, we observe a primitive form of punctuated equilibrium. Rare events in the skewed habitat lead to extinction of the specialists, whereupon generalists invade from the uniform habitat, adapt to their new surroundings, ultimately leading their progeny to become vulnerable to extinction in a subsequent rare disturbance.

Highly optimized tolerance and power laws in dense and sparse resource regimes

Power law cumulative frequency (P) versus event size (l) distributions P > or =l) approximately l(-alpha) are frequently cited as evidence for complexity and serve as a starting point for linking theoretical models and mechanisms with observed data. Systems exhibiting this behavior present fundamental mathematical challenges in probability and statistics. The broad span of length and time scales associated with heavy tailed processes often require special sensitivity to distinctions between discrete and continuous phenomena. A discrete highly optimized tolerance (HOT) model, referred to as the probability, loss, resource (PLR) model, gives the exponent alpha=1/d as a function of the dimension d of the underlying substrate in the sparse resource regime. This agrees well with data for wildfires, web file sizes, and electric power outages. However, another HOT model, based on a continuous (dense) distribution of resources, predicts alpha=1+1/d . In this paper we describe and analyze a third model, the cuts model, which exhibits both behaviors but in different regimes. We use the cuts model to show all three models agree in the dense resource limit. In the sparse resource regime, the continuum model breaks down, but in this case, the cuts and PLR models are described by the same exponent.

Design degrees of freedom and mechanisms for complexity

We develop a discrete spectrum of percolation forest fire models characterized by increasing design degrees of freedom (DDOF's). The DDOF's are tuned to optimize the yield of trees after a single spark. In the limit of a single DDOF, the model is tuned to the critical density. Additional DDOF's allow for increasingly refined spatial patterns, associated with the cellular structures seen in highly optimized tolerance (HOT). The spectrum of models provides a clear illustration of the contrast between criticality and HOT, as well as a concrete quantitative example of how a sequence of robustness tradeoffs naturally arises when increasingly complex systems are developed through additional layers of design. Such tradeoffs are familiar in engineering and biology and are a central aspect of the complex systems that can be characterized as HOT.

Complexity and robustness

Highly optimized tolerance (HOT) was recently introduced as a conceptual framework to study fundamental aspects of complexity. HOT is motivated primarily by systems from biology and engineering and emphasizes, (i) highly structured, nongeneric, self-dissimilar internal configurations, and (ii) robust yet fragile external behavior. HOT claims these are the most important features of complexity and not accidents of evolution or artifices of engineering design but are inevitably intertwined and mutually reinforcing. In the spirit of this collection, our paper contrasts HOT with alternative perspectives on complexity, drawing on real-world examples and also model systems, particularly those from self-organized criticality.