Behavior systems, associationism, and Pavlovian conditioning

Isolating the incentive salience of reward-associated stimuli: value, choice, and persistence

Sign- and goal-tracking are differentially associated with drug abuse-related behavior. Recently, it has been hypothesized that sign- and goal-tracking behavior are mediated by different neurobehavioral valuation systems, including differential incentive salience attribution. Herein, we used different conditioned stimuli to preferentially elicit different response types to study the different incentive valuation characteristics of stimuli associated with sign- and goal-tracking within individuals. The results demonstrate that all stimuli used were equally effective conditioned stimuli; however, only a lever stimulus associated with sign-tracking behavior served as a robust conditioned reinforcer and was preferred over a tone associated with goal-tracking. Moreover, the incentive value attributed to the lever stimulus was capable of promoting suboptimal choice, leading to a significant reduction in reinforcers (food) earned. Furthermore, sign-tracking to a lever was more persistent than goal-tracking to a tone under omission and extinction contingencies. Finally, a conditional discrimination procedure demonstrated that sign-tracking to a lever and goal-tracking to a tone were dependent on learned stimulus–reinforcer relations. Collectively, these results suggest that the different neurobehavioral valuation processes proposed to govern sign- and goal-tracking behavior are independent but parallel processes within individuals. Examining these systems within individuals will provide a better understanding of how one system comes to dominate stimulus–reward learning, thus leading to the differential role these systems play in abuse-related behavior.

A framework for the study of behavior

Behavior is defined as the expression of the activity of the nervous system. The basic units of behavior are perceptual mechanisms, central mechanisms, and motor mechanisms. These units can be organized into more complex units called behavior systems such as hunger, sex, aggression, fear, etc. Perceptual and central mechanisms include cognitive mechanisms such as ideas, beliefs, memories, intentions, and cognitive modules. Behavior can be analyzed at genetic, physiological, whole organism, and population levels, and the concepts used to analyze behavior should be appropriate to each level. One can ask causal, structural, and functional questions about current behavior, ontogeny, and phylogeny. Causal and functional questions are independent of each other and should not be confused. There has been much confusion and disagreement about the relation between cause and function, and several examples are analyzed. This article is part of a Special Issue entitled: In Honor of Jerry Hogan.

Habituation, sensitization, and Pavlovian conditioning

In this brief review, I argue that the impact of a stimulus on behavioral control increase as the distance of the stimulus to the body decreases. Habituation, i.e., decrement in response intensity repetition of the triggering stimulus, is the default state for sensory processing, and the likelihood of habituation is higher for distal stimuli. Sensitization, i.e., increment in response intensity upon stimulus repetition, occurs in a state dependent manner for proximal stimuli that make direct contact with the body. In Pavlovian conditioning paradigms, the unconditioned stimulus (US) is always a more proximal stimulus than the conditioned stimulus (CS). The mechanisms of associative and non-associative learning are not independent. CS-US pairings lead to formation of associations if sensitizing modulation from a proximal US prevents the habituation for a distal anticipatory CS.

The Structure of Scientific Evolution

Science is the construction and testing of systems that bind symbols to sensations according to rules. Material implication is the primary rule, providing the structure of definition, elaboration, delimitation, prediction, explanation, and control. The goal of science is not to secure truth, which is a binary function of accuracy, but rather to increase the information about data communicated by theory. This process is symmetric and thus entails an increase in the information about theory communicated by data. Important components in this communication are the elevation of data to the status of facts, the descent of models under the guidance of theory, and their close alignment through the evolving retroductive process. The information mutual to theory and data may be measured as the reduction in the entropy, or complexity, of the field of data given the model. It may also be measured as the reduction in the entropy of the field of models given the data. This symmetry explains the important status of parsimony (how thoroughly the data exploit what the model can say) alongside accuracy (how thoroughly the model represents what can be said about the data). Mutual information is increased by increasing model accuracy and parsimony, and by enlarging and refining the data field under purview.

Extinction from a rationalist perspective

The merging of the computational theory of mind and evolutionary thinking leads to a kind of rationalism, in which enduring truths about the world have become implicit in the computations that enable the brain to cope with the experienced world. The dead reckoning computation, for example, is implemented within the brains of animals as one of the mechanisms that enables them to learn where they are (Gallistel, 1990, 1995). It integrates a velocity signal with respect to a time signal. Thus, the manner in which position and velocity relate to one another in the world is reflected in the manner in which signals representing those variables are processed in the brain. I use principles of information theory and Bayesian inference to derive from other simple principles explanations for: (1) the failure of partial reinforcement to increase reinforcements to acquisition; (2) the partial reinforcement extinction effect; (3) spontaneous recovery; (4) renewal; (5) reinstatement; (6) resurgence (aka facilitated reacquisition). Like the principle underlying dead-reckoning, these principles are grounded in analytic considerations. They are the kind of enduring truths about the world that are likely to have shaped the brain's computations.

On the utilization of social animals as a model for social robotics

Social robotics is a thriving field in building artificial agents. The possibility to construct agents that can engage in meaningful social interaction with humans presents new challenges for engineers. In general, social robotics has been inspired primarily by psychologists with the aim of building human-like robots. Only a small subcategory of "companion robots" (also referred to as robotic pets) was built to mimic animals. In this opinion essay we argue that all social robots should be seen as companions and more conceptual emphasis should be put on the inter-specific interaction between humans and social robots. This view is underlined by the means of an ethological analysis and critical evaluation of present day companion robots. We suggest that human-animal interaction provides a rich source of knowledge for designing social robots that are able to interact with humans under a wide range of conditions.

STRUCTURED PSYCHOSOCIAL STRESS AND THERAPEUTIC FAILURE

Generalized language-of-thought arguments, appropriate, in the sense of Dretske, to interacting cognitive modules, permit exploration of how disease states interact with medical treatment, given an embedding context of structured psychosocial stress. The interpenetrating feedback between treatment and response creates a kind of idiotypic hall of mirrors generating a synergistic pattern of efficacy, treatment failure, adverse reactions, and patient noncompliance which, from a Rate Distortion perspective, embodies a distorted image of externally-imposed structured stress. For the US, accelerating spatial and social spread of such stress enmeshes both dominant and subordinate populations in a linked system of pathogenic social hierarchy which will express itself, not only in an increasingly unhealthy society, but in the diffusion of therapeutic failure, including, but not limited to, drug-based treatments.

Repeated extinction and reversal learning of an approach response supports an arousal-mediated learning model

We assessed the effects of repeated extinction and reversals of two conditional stimuli (CS+/CS-) on an appetitive conditioned approach response in rats. Three results were observed that could not be accounted for by a simple linear operator model such as the one proposed by Rescorla and Wagner (1972): (1) responding to a CS- declined faster when a CS+ was simultaneously extinguished; (2) reacquisition of pre-extinction performance recovered rapidly within one session; and (3) reversal of CS+/CS- contingencies resulted in a more rapid recovery to the current CS- (former CS+) than the current CS+, accompanied by a slower acquisition of performance to the current CS+. An arousal parameter that mediates learning was introduced to a linear operator model to account for these effects. The arousal-mediated learning model adequately fit the data and predicted data from a second experiment with different rats in which only repeated reversals of CS+/CS- were assessed. According to this arousal-mediated learning model, learning is accelerated by US-elicited arousal and it slows down in the absence of US. Because arousal varies faster than conditioning, the model accounts for the decline in responding during extinction mainly through a reduction in arousal, not a change in learning. By preserving learning during extinction, the model is able to account for relapse effects like rapid reacquisition, renewal, and reinstatement.

The dynamics of conditioning and extinction

Pigeons responded to intermittently reinforced classical conditioning trials with erratic bouts of responding to the conditioned stimulus. Responding depended on whether the prior trial contained a peck, food, or both. A linear persistence-learning model moved pigeons into and out of a response state, and a Weibull distribution for number of within-trial responses governed in-state pecking. Variations of trial and intertrial durations caused correlated changes in rate and probability of responding and in model parameters. A novel prediction--in the protracted absence of food, response rates can plateau above zero--was validated. The model predicted smooth acquisition functions when instantiated with the probability of food but a more accurate jagged learning curve when instantiated with trial-to-trial records of reinforcement. The Skinnerian parameter was dominant only when food could be accelerated or delayed by pecking. These experiments provide a framework for trial-by-trial accounts of conditioning and extinction that increases the information available from the data, permitting such accounts to comment more definitively on complex contemporary models of momentum and conditioning.

Theoretical and conceptual issues in time-place discrimination

The need to discover resources that are available under specific environmental constraints represents a fundamental environmental pressure on the evolution of behavior. Time-place discrimination refers to the ability to secure resources when they are available under specific temporal and spatial contingencies. This article reviews a number of examples of time-place discrimination. The review highlights theoretical and conceptual issues that are needed to behaviorally identify the mechanisms responsible for time-place performance. Next, limitations on time-place performance that may be imposed by a circadian system are described. Finally, a number of lines of research that broaden these limitations are discussed. These lines of research include studies that suggest that (i) a broad range of long intervals (outside the limited range of circadian entrainment) are timed, (ii) at least some long intervals (16-21 h) are timed with an endogenous self-sustaining oscillator, (iii) short intervals (in the range of 1-3 min) are timed with an endogenous self-sustaining oscillator, and (iv) memory for specific unique events (including when and where they occurred) is based on a circadian representation of time. It is concluded that a unified theory of timing that can retain the times of occurrence of individual events is needed. The time of occurrence of an event may be encoded not only with respect to a circadian oscillator but also with respect to other oscillators in the long-interval and short-interval ranges.

The Impact of Human Intuition in Psychology

An empirically valid outcome in psychology may differ in the degree to which the outcome does or does not conform to human intuition. The author provides a brief history of three psychological outcomes violating human intuition, notes the resemblance to the common sense revolution, and then discusses how human intuition may be detrimental to behaviorism and evolutionary perspectives of human nature. The role of human intuition in supernatural beliefs is considered and, finally, possible methods to improve the plausibility of counterintuitive outcomes are suggested.

An unexpected reduction in sucrose concentration activates the HPA axis on successive post shift days without attenuation by discriminative contextual stimuli

Previous studies have shown that the successive negative contrast procedure, in which food-restricted rats entrained to once daily, brief presentations of 32% sucrose are unexpectedly shifted to a 4% solution, results in an adrenocortical response on the second, but not the first postshift day. We attempted to generalize that finding in our own procedure. In Experiment 1, two groups of rats were given a 32% sucrose solution once daily in their home cages for 14 days before being shifted to a 4% solution. One group was killed 10 min after the first 4% solution and one was killed after the second 4% solution. In addition, two groups receiving either 32% or 4% sucrose throughout the experiment served as unshifted controls. In contrast to previous findings, both shifted groups exhibited prominent adrenocorticotropin hormone (ACTH) and adrenocortical (B) responses on both postshift days compared to unshifted controls, which did not differ from one another. Experiment 2a employed distinctive contexts to test if the lack of generality of the delayed HPA axis response was due to suppressive effects of S(+) on the first postshift day. Rats were given once daily 32% sucrose in S(+) and equal exposure time in S(-). Half of these rats were shifted to 4% sucrose in S(+) and half were shifted in S(-). These two groups were compared to home cage controls. Half of each group was killed after their first 4% sucrose, and half after the second 4% sucrose. All rats showed ACTH and B responses comparable to shifted rats in Experiment 1. S(+) failed to suppress the HPA axis, and the stress response was higher on the first compared to the second day of the shift. Experiment 2b established that distinctive contexts predicting sucrose, S(+), or not predicting sucrose, S(-), controlled behavioral choice and contextual discrimination. Thus, there was no evidence that issues of stimulus control could explain the lack of generality of previous findings. The data indicate that thwarting sucrose expectancies is stressful, and that this stress response habituates across days.

Effects of bed nucleus of the stria terminalis lesions on conditioned anxiety: aversive conditioning with long-duration conditional stimuli and reinstatement of extinguished fear

Four experiments investigated the effects of lesions of the bed nucleus of the stria terminalis (BNST) on conditioned fear and anxiety. Though BNST lesions did not disrupt fear conditioning with a short-duration conditional stimulus (CS; Experiments 1 and 3), the lesion attenuated conditioning with a longer duration CS (Experiments 1 and 2). Experiment 3 found that lesions attenuated reinstatement of extinguished fear, which relies on contextual conditioning. Experiment 4 confirmed that the lesion reduced unconditioned anxiety in an elevated zero maze. The authors suggest that long-duration CSs, whether explicit cues or contexts, evoke anxiety conditioned responses, which are dissociable from fear responses to shorter CSs. Results are consistent with behavioral and anatomical distinctions between fear and anxiety and with a behavior-systems view of defensive conditioning.

Long-interval timing is based on a self-sustaining endogenous oscillator

The mechanism of anticipating long-intervals (16-21 h) was investigated. Rats earned food by interrupting a photobeam in a food trough during 3- or 4-h meals. Intermeal intervals were 16, 21, and 24 h (offset to offset) for independent groups of rats (n=8 per group). After approximately a month of experience with the intermeal intervals, the meals were discontinued. The rate of visiting the food trough increased as a function of time before the meal. When meals were discontinued, visits continued to be periodic. The periodicity was approximately 21 h after 16- and 21-h intermeal intervals and approximately 28 h after 24-h intermeal intervals. These data suggest that long-interval timing is based on a self-sustaining, endogenous oscillator.

Amygdala central nucleus function is necessary for learning, but not expression, of conditioned auditory orienting

In Pavlovian appetitive conditioning, rats often acquire 2 classes of conditioned responses: those whose form is determined by the reinforcer, and those whose form is determined by characteristics of the conditioned stimulus (CS). Consistent with the results of previous lesion studies, reversible inactivation of amygdala central nucleus function during pairings of an auditory CS with food prevented the acquisition of conditioned orienting responses specific to auditory CSs, whereas food-related conditioned behaviors were acquired normally. Neither inactivation nor posttraining neurotoxic lesions of the central nucleus affected the expression of previously acquired conditioned orienting. Thus, although the central nucleus is critical to the acquisition of information required for conditioned orienting to auditory cues, it is not needed for maintaining this information for later use.

A behavior systems view of the organization of multiple responses during a partially or continuously reinforced interfood clock

We examined how a 50% Pavlovian partial reinforcement (PRF) schedule, versus a 100% continuous reinforcement (CRF) schedule, altered the asymptotic amount and distribution of focal and general search behavior in rats during 48-sec trials with and without a four-segment interfood clock (S1-S2-S3-S4-US). Under CRF, but not PRF, average asymptotic focal search (nosing in the feeder) increased across the last two clock segments (S3 and S4), and more for the clock group than the no-clock group. Locomotor general search peaked in the second clock segment (S2) for the CRF-clock and CRF-no-clock groups and in S3 for the PRF-clock groups. Furthermore, the ratio of general search to maximum focal search was higher for the PRF-clock group than for the CRF-clock group. This pattern of results supports the view that predictable reward presentations temporally organize search states and related responses between food presentations. The relative expression of these responses varies with the predictability and proximity of reward and is more sharply defined in the presence of a clock.

Excitatory backward conditioning in an appetitive conditioned reinforcement preparation with rats

Four experiments were conducted to examine appetitive backward conditioning in a conditioned reinforcement preparation. In all experiments, off-line classical conditioning was conducted following lever-press training on two levers. Presentations of a sucrose solution by a liquid dipper served as an unconditioned stimulus (US) and two auditory stimuli served as conditioned stimuli (CSs); one was paired with the US in either a forward (Experiment 1a) or a backward (Experiments 1b, 2, and 3) relationship, and the other served as a control CS, which was not paired with the US. In testing, each lever-press response produced a presentation of one of the CSs instead of appetitive reinforcers. The response to a lever was facilitated, compared to the response to another lever, when the response produced the backward CS presentation as well as when it produced the forward CS presentation; that is, the backward CS served as an excitatory conditioned reinforcer.

Sign-tracking (autoshaping) in rats: a comparison of cocaine and food as unconditioned stimuli

A series of experiments was performed to determine whether sign-tracking would occur in rats with intravenous (i.v.) cocaine as the unconditioned stimulus. In Experiment 1, a retractable lever paired with food produced strong sign-tracking, but a lever paired with one of three doses of i.v. cocaine did not elicit any approach or contact behavior. Experiment 2 demonstrated that doses of cocaine that did not elicit sign-tracking would function as a positive reinforcer for a lever contact operant. In Experiment 3, an artificial consummatory response was added to make the cocaine reinforcement episode more behaviorally comparable to that occasioned by food. Although the rats readily performed this response when it was required to receive cocaine infusions, they still did not contact a lever that signaled the availability of these infusions. It appears that cocaine is different from other positive reinforcers (e.g., food, water, warmth, or intracranial stimulation) in that it will not produce sign-tracking in rats.

Acquisition of schedule-induced polydipsia by rats in proximity to upcoming food delivery

Food-deprived rats that receive intermittent delivery of small amounts of food develop excessive drinking--specifically, schedule-induced polydipsia (SIP). A main characteristic of SIP is its occurrence at the beginning of interfood intervals. The purpose of this study was to demonstrate that SIP can be developed toward the end of interfood intervals, in closer proximity to upcoming than to preceding food delivery. In Experiment 1, two groups were exposed to a fixed-time (FT) 30-sec food schedule with water available during the first or the last 15 sec of each interfood interval. Two additional groups, which had access to water throughout, were exposed to FT 30-sec or FT 15-sec schedules of food presentation. The FT 30-sec group with free access to water developed the highest level of intake; similar and intermediate levels were induced in all the remaining groups. In Experiment 2, three groups of rats were exposed to an FT 90-sec food schedule with water available during the first, the second, or the last 30 sec of each interfood interval. One additional group with access to water throughout was exposed to the FT 90-sec schedule of food presentation. The group with free access to water developed a higher level of consumption than did the other groups, but by the end of training none of the four groups showed statistical differences in polydipsic drinking. Results show that adjunctive drinking can be developed in proximity to upcoming food delivery even with long interfood intervals.

Amygdala central nucleus function is necessary for learning but not expression of conditioned visual orienting

When exposed to pairings of a visual stimulus with food delivery, rats normally acquire both conditioned orienting responses directed toward the visual stimulus and conditioned food-related responses. Consistent with the results of previous lesion studies, reversible inactivation of amygdala central nucleus function before each conditioning session prevented the acquisition of conditioned orienting responses, whereas food-related behaviors were acquired normally. By contrast, neither inactivation nor neurotoxic lesions of central nucleus affected the expression of previously acquired conditioned orienting responses. Thus, the central nucleus is apparently not critical to the maintenance of information required for conditioned orienting, but instead is necessary for memory storage elsewhere. Specialized roles for components of a circuit for conditioned orienting, which includes the central nucleus, the substantia nigra, and dorsolateral striatum, are discussed.

Avoidance learning in the crayfish (Procambarus clarkii) depends on the predatory imminence of the unconditioned stimulus: a behavior systems approach to learning in invertebrates

Signaled avoidance learning in crayfish (Procambarus clarkii) was investigated when the crayfish were not confined, by indexing two types of locomotive movement to the escape compartment. Mild shocks, which induced tail flipping in the crayfish, and light illumination were used as unconditioned and conditioned stimuli, respectively. In Experiment 1, two groups of crayfish were trained in a one-way shuttle box. The crayfish in Group Forward were placed in the start compartment facing the escape compartment and they were able to escape/avoid shocks by walking forward, while the crayfish in Group Backward were placed in the compartment facing the opposite direction and they were able to escape by tail flipping. Avoidance learning was achieved only by walking, and not by tail flipping despite the fact that consistent tail flipping allowed the crayfish to avoid shocks. In Experiment 2, the experimental conditions were switched by using the ABA design. In this experiment, we confirmed that avoidance behavior was restricted to walking. These results are readily explained by the behavior systems approach.

The motivation to control and the origin of mind: Exploring the life–mind joint point in the Tree of Knowledge System

The evolved function of brain, cognitive, affective, conscious-psychological, and behavioral systems is to enable animals to attempt to gain control of the social (e.g., mates), biological (e.g., prey), and physical (e.g., nesting spots) resources that have tended to covary with survival and reproductive outcomes during the species' evolutionary history. These resources generate information patterns that range from invariant to variant. Invariant information is consistent across generations and within lifetimes (e.g., the prototypical shape of a human face) and is associated with modular brain and cognitive systems that coalesce around the domains of folk psychology, folk biology, and folk physics. The processing of information in these domains is implicit and results in automatic bottom-up behavioral responses. Variant information varies across generations and within lifetimes (e.g., as in social dynamics) and is associated with plastic brain and cognitive systems and explicit, consciously driven top-down behavioral responses. The fundamentals of this motivation-to-control model are outlined and links are made to Henriques' (2004) Tree of Knowledge System and Behavioral Investment Theory.

Social Transmission of Flavor Preferences in Two Species of Hamsters (Mesocricetus auratus and Phodopus campbelli)

Golden hamsters (Mesocricetus auratus) and dwarf hamsters (Phodopus campbelli) interacted with a conspecific demonstrator that had recently consumed a flavored food. When given a choice between their demonstrator's flavor and another flavor, the dwarf hamsters preferred the flavor their demonstrator had eaten. Golden hamsters did not prefer their demonstrators' diets when the demonstrators were unrelated adults or littermates, but they did when the demonstrator was their mother. Videotaping the interactions between demonstrators and observers revealed that adult golden hamsters did not investigate foods hoarded by their demonstrators whereas dwarf hamsters did. These results are interpreted in terms of the stimuli that activate feeding behavior systems in these 2 hamster species.

Phobias and preparedness: the selective, automatic, and encapsulated nature of fear

We describe evidence for an evolved module for fear elicitation and fear learning with four primary characteristics. First, it is preferentially activated by stimuli related to survival threats in evolutionary history. Thus, fear-relevant stimuli lead to superior conditioning of aversive associations compared with fear-irrelevant stimuli. Second, the module is automatically activated by fear-relevant stimuli, meaning that fear activation occurs before conscious cognitive analysis of the stimulus can occur. Third, the fear module is relatively impenetrable to conscious cognitive control, and fear conditioning with fear-relevant stimuli can occur even with subliminal conditioned stimuli. Fourth, the amygdala seems to be the central brain area dedicated to the fear module. Finally, we propose that there are two levels of fear conditioning, with an emotional level that is relatively independent of the cognitive contingency level, each mediated by different brain areas.

Molecular analyses of the principal components of response strength

Killeen and Hall (2001) showed that a common factor called strength underlies the key dependent variables of response probability, latency, and rate, and that overall response rate is a good predictor of strength. In a search for the mechanisms that underlie those correlations, this article shows that (a) the probability of responding on a trial is a two-state Markov process; (b) latency and rate of responding can be described in terms of the probability and period of stochastic machines called clocked Bernoulli modules, and (c) one such machine, the refractory Poisson process, provides a functional relation between the probability of observing a response during any epoch and the rate of responding. This relation is one of proportionality at low rates and curvilinearity at higher rates.

Niche-related learning in laboratory paradigms: the case of maze behavior in Norway rats

The general hypothesis underlying this paper is that behavior in traditional paradigms of laboratory learning is based on niche-related mechanisms. The specific hypothesis is that the behavior of Norway rats in laboratory mazes is based on niche-related mechanisms related to trail following and navigating. I evaluate seven types of evidence for this hypothesis: (a) resemblance of maze behavior to behavior in unconstrained settings; (b) importance of experimenter tuning of apparatus and procedures; (c) overdetermination of laboratory behavior; (d) reverse-engineering of niche-related mechanisms from laboratory data; (e) prediction of laboratory results from ecological data; (f) contribution of specific relative to general mechanisms; and (g) phylogenetic conservation and ecologically-based convergence and divergence of maze mechanisms. I conclude there is strong evidence for the hypothesis that behavior of rats in laboratory mazes is based on niche-related mechanisms. I suggest that a niche-related approach to laboratory learning paradigms has conceptual generality and the potential to facilitate connections with the study of neurophysiology, genetics, and evolution.

Conditioned inhibitory effects of discriminated Pavlovian training with food in rats depend on interactions of search modes, related repertoires, and response measures

Like other accounts of conditioned inhibition, behavior systems predicts (and Experiment 1 shows) that during summation and retardation tests, presentation of a negative conditioned stimulus (a CS-) created by discriminative Pavlovian food conditioning will interfere with a focal search response, such as nosing in the feeder. Unlike most other views, behavior systems predicts (and Experiment 2 shows) that the same CS- can potentiate a general search response, like attending to a moving artificial prey stimulus. Contacting the prey stimulus in extinction increased over baseline when a CS- but not a CS Novel preceded it. Experiment 3 showed this effect was not due to unconditioned qualities of the CS-. It appears that the effects of a discriminative CS- depend on the interaction of the training contingency with search modes related to the unconditioned stimulus (US), their perceptual-motor repertoires and environmental support, and the choice of response measure.

Integrating niche-related and general process approaches in the study of learning

For nearly a century the experimental analysis of learning in animals has been divided into niche-related and general-process approaches, each emphasizing different procedures and conceptual strategies. After considering several current forms of rapprochement, I outline evidence for the integrative hypothesis that niche-related learning provides the basis for results in traditional general-process learning paradigms. Although the full ramifications of this view are not developed here, its advantages include: a clearer relation between laboratory and field results; conceptual and pragmatic guidance in developing new paradigms, and applying old ones to different species and circumstances; clarification of the laws, limits, and anomalies in general-process paradigms; and a more efficient path for inter-relating the study of learning with neurophysiology, genetics, and evolution.

The principal components of response strength

As Skinner (1938) described it, response strength is the "state of the reflex with respect to all its static properties" (p. 15), which include response rate, latency, probability, and persistence. The relations of those measures to one another was analyzed by probabilistically reinforcing, satiating, and extinguishing pigeons' key pecking in a trials paradigm. Reinforcement was scheduled according to variable-interval, variable-ratio, and fixed-interval contingencies. Principal components analysis permitted description in terms of a single latent variable, strength, and this was validated with confirmatory factor analyses. Overall response rate was an excellent predictor of this state variable.

A modern learning theory perspective on the etiology of panic disorder

Several theories of the development of panic disorder (PD) with or without agoraphobia have emerged in the last 2 decades. Early theories that proposed a role for classical conditioning were criticized on several grounds. However, each criticism can be met and rejected when one considers current perspectives on conditioning and associative learning. The authors propose that PD develops because exposure to panic attacks causes the conditioning of anxiety (and sometimes panic) to exteroceptive and interoceptive cues. This process is reflected in a variety of cognitive and behavioral phenomena but fundamentally involves emotional learning that is best accounted for by conditioning principles. Anxiety, an anticipatory emotional state that functions to prepare the individual for the next panic, is different from panic, an emotional state designed to deal with a traumatic event that is already in progress. However, the presence of conditioned anxiety potentiates the next panic, which begins the individual's spiral into PD. Several biological and psychological factors create vulnerabilities by influencing the individual's susceptibility to conditioning. The relationship between the present view and other views, particularly those that emphasize the role of catastrophic misinterpretation of somatic sensations, is discussed.

A model of neurovisceral integration in emotion regulation and dysregulation

In the present paper we present the outlines of a model that integrates autonomic, attentional, and affective systems into a functional and structural network that may help to guide us in our understanding of emotion regulation and dysregulation. We will emphasize the relationship between attentional regulation and affective processes and propose a group of underlying physiological systems that serve to integrate these functions in the service of self-regulation and adaptability of the organism. We will attempt to place this network in the context of dynamical systems models which involve feedback and feedforward circuits with special attention to negative feedback mechanisms, inhibitory processes, and their role in response selection. From a systems perspective, inhibitory processes can be viewed as negative feedback circuits that allow for the interruption of ongoing behavior and the re-deployment of resources to other tasks. When these negative feedback mechanisms are compromised, positive feedback loops may develop as a result (of dis-inhibition). From this perspective, the relative sympathetic activation seen in anxiety disorders may represent dis-inhibition due to faulty inhibitory mechanisms.

Risk-sensitive foraging in rats: the effects of response-effort and reward-amount manipulations on choice behavior

The literature on risk-sensitive foraging theory provides several accounts of species that fluctuate between risk-averse and risk-prone strategies. The daily energy budget rule suggests that shifts in foraging strategy are precipitated by changes in the forager's energy budget. Researchers have attempted to alter the organism's energy budget using a variety of techniques such as food deprivation, manipulation of ambient temperatures, and delays to food reward; however, response-effort manipulations have been relatively neglected. A choice preparation using a wheel-running response and rats examined risk-sensitive preferences when both response effort and reward amounts were manipulated. Concurrently available reinforcement schedules (FI/60 and VI/60) yielded equivalent food amounts per unit time in all treatments. Two levels of response effort (20 or 120 g tangential resistance) and two levels of reward amount (three or nine pellets) were combined to form four distinct response-effort/reward-amount pairings. Increasing reward amounts significantly shifted choice toward the FI schedule in both response-effort conditions. The incidence of choice preference and the magnitude of shifts in choice were greater for the high response-effort conditions than for the low response-effort conditions. Implications of the significant interaction between response effort and reward amount are discussed in terms of a general energy-budget model.