The behavioral origins of phylogenic responses and ontogenic habits

An examination of innate behavior and its possible origins suggests parallels with the formation of habitual behavior. Inflexible but adaptive responses-innate reflexive behavior, Pavlovian conditioned responses, and operant habits-may have evolved from variable behavior in phylogeny and ontogeny. This form of "plasticity-first" scientific narrative was unpopular post-Darwin but has recently gained credibility in evolutionary biology. The present article seeks to identify originating events and contingencies contributing to such inflexible but adaptive behavior at both phylogenic and ontogenic levels of selection. In ontogeny, the development of inflexible performance (i.e., habit) from variable operant behavior is reminiscent of the genetic accommodation of initially variable phylogenic traits. The effects characteristic of habit (e.g., unresponsiveness to reinforcer devaluation) are explicable as the result of a conflict between behaviors at distinct levels of selection. The present interpretation validates the practice of seeking hard analogies between evolutionary biology and operant behavior. Finding such parallels implies the validity of a claim that organismal behavior, both innate and learned, is a product of selection by consequences. A complete and coherent account of organismal behavior may ultimately focus on functional selective histories in much the same way evolutionary biology does with its subject matter.

The effects of feature extinction in dual-response feature-positive discriminations

In a typical feature-positive discrimination, responding is reinforced (+) during the target stimulus (A) on trials with the feature stimulus (X), but not during target-alone trials (A-). When X and A are presented simultaneously, direct control by X is typically observed; however, when the stimuli are presented serially, X sets the occasion for responding to A. In the current dual-response procedures, one response (e.g., left lever press) was reinforced during feature-target trials (XA+) and a different response (e.g., right lever press) was reinforced during target-alone trials (A+). In Experiment 1, rats received either serial (X → A+) or simultaneous (X:A+) presentations of the feature-target compound along with target-alone trials (A+). Contrary to our predictions, the serial group failed to learn the discrimination and the simultaneous group demonstrated occasion setting. In Experiment 2, the salience of the feature was increased, which resulted in direct control by the feature in both groups. In Experiment 3, an additional serial group was included with a longer interval between the feature (X) and target (A). Despite the reduced temporal proximity of X to reinforcement, direct control was again observed in all groups. The current pattern of results in the simultaneous and serial groups is interpreted in relation to the enhanced salience of A relative to X, due to separate pairings of A-alone with reinforcement in the dual-response procedure. Consistent with previous findings, occasion setting was observed when A was most salient relative to X (Experiment 1, simultaneous group), but direct control was found when the salience of X was increased (Experiments 2-3). (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Devaluation of a conditioned reinforcer requires its reexposure

A change in motivational state does not guarantee a change in operant behaviour. Only after an organism has had contact with an outcome while in a relevant motivational state does behaviour change, a phenomenon called incentive learning. While ample evidence indicates that this is true for primary reinforcers, it has not been established for conditioned reinforcers. We performed an experiment with rats where lever-presses were reinforced by presentations of an audiovisual stimulus that had previously preceded food delivery; in the critical experimental groups, the audiovisual stimulus was then paired a single time with a strong electric shock. Some animals were reexposed to the audiovisual stimulus. Lever-presses yielding no outcomes were recorded in a subsequent test. Animals that had been reexposed to the audiovisual stimulus after the aversive training responded less than did those that had not received reexposure. Indeed, those animals that were not reexposed did not differ from a control group that received no aversive conditioning of the audiovisual stimulus. Moreover, these results were not mediated by a change in the food's reinforcement value, but instead reflect a change in behaviour with respect to the conditioned reinforcer itself. These are the first data to indicate that the affective value of conditioned stimuli, like that of unconditioned ones, is established when the organism comes into contact with them.

Spatial Overshadowing in Pigeons: Evidence for an Acquisition Deficit

We investigated theoretical accounts of spatial overshadowing using a landmark-based spatial-search task in a touchscreen preparation with pigeons. Pigeons first learned to find a hidden target on a screen using a compound of two visual cues as landmarks. Landmark A was proximal to the target while landmark X was distal to the target. Experiment 1 replicated our prior spatial overshadowing effect whereby landmark A overshadowed the development of spatial control by X. Spatial control by X was also poorer than by landmark Y which had been paired with the target alone but with the same absolute distance to the target as X had. Thus, the poor spatial control by X was not merely due to the greater X-target distance (relative to the A-target distance). Experiments 2a and 2b failed to find recovery from spatial overshadowing of X through either post-training extinction or counterconditioning of overshadowing landmark A, respectively. We interpret our results as being consistent with acquisition-focused models of elementary associative learning, but not with performance-focused models.

Extinction and spontaneous recovery of spatial behavior in pigeons

We investigated extinction and spontaneous recovery of spatial associations using a landmark-based appetitive search task in a touchscreen preparation with pigeons. Four visual landmarks (A, B, C, and D) were separately established as signals of a hidden reinforced target among an 8 × 7 array of potential target locations. The target was located above landmarks (LM) A and C and below B and D. After conditioning, A and B were extinguished. Responding to A and C was assessed on probe tests 2 days following extinction, whereas, B and D were tested 14 days after extinction. We observed spontaneous recovery from spatial extinction following a 14-day, but not a 2-day, postextinction retention interval. Furthermore, by plotting the spatial distribution of responding across the X and Y axes during testing, we found that spontaneous recovery of responding to the target in our task was due to enhanced spatial control (i.e., a change in the overall distribution of responses) following the long delay to testing. These results add spatial extinction and spontaneous recovery to the list of findings supporting the assertion that extinction involves new learning that attenuates the originally acquired response, and that original learning of the spatial relationship between paired events survives extinction. (PsycINFO Database Record

Occasion setting during a spatial-search task with pigeons

A spatial task was used to investigate if a stimulus could set the occasion for responding to a landmark. Pigeons were trained with a positive occasion setter (OS; a colored background display) signaling the contingency between a landmark (LM; visual patterned stimulus) and the location of a rewarded response. The two most common tests of an OS (transfer tests and post-training extinction of the OS) were then conducted. In Experiment 1, two occasion setting pairs were trained (+←XA/YB→+/A-/B-) with unique spatial relationships to a reinforced goal location. Transfer tests (XB- and YA-) revealed more responding to a landmark when paired with the same OS from training (e.g., XA) than on transfer tests, which was greater still than landmark-only trials (A-). Three pigeons demonstrated good spatial control of responding by the LM on transfer tests. In Experiment 2, the contingency and spatial relationship (e.g., left or right) between LM A and the goal were signaled by the OS (+←XA/YA→+/+←ZB/C→+/A-/B-). LM C was trained without an OS to assess the role of training history during transfer. Transfer tests again indicated an OS could facilitate responding and the LM controlled the location of responding. Training history affected spatial control, but not facilitation, by LM C. Lastly, post-training extinction of X had no effect on facilitation or spatial control during subsequent XA trials. These experiments are the first to evaluate conditional control of spatial information by landmarks using both of the standard tests for occasion setting.

Task complexity modifies the search strategy of rats

Human and non-human animals exhibit a variety of response strategies (e.g., place responding) when searching for a familiar place or evading predators. We still know little about the conditions that support the use of each strategy. We trained rats to locate a hidden food reward in a small-scale spatial search task. The complexity of the search task was manipulated by reducing the number of search locations (25, 4, and 2) within an open-field apparatus and by comparison to a path-based apparatus (plus-maze). After rats were trained to reliably locate the hidden food, each apparatus was shifted to gauge whether rats were searching at the location of the goal relative to extramaze cues (i.e., place responding), or searching in the direction of the goal relative to a combination of intramaze and extramaze cues (i.e.,directional responding). The results indicate that the open field supported place responding when more than two response locations were present, whereas, the four-arm plus-maze supported strong directional responding. These results extend prior research into the role of task demands on search strategy, as well as support the use of the four-choice open field as an analog to the Morris water task for future studies targeting the neural underpinnings of place responding.

Modulation of Variation by Response-Reward Spatial Proximity

There has been a recent surge in the experimental investigation of the control of behavioral variability. Currently, it is understood that variability in behavior is predictably modulated by reinforcement parameters (e.g., a probability of reward delivery and reward magnitude). In two experiments, we investigated how spatial proximity between response and reward locations impacts the production of behavioral variability in both response rate and lever press duration. Rats were trained to lever press on two levers in a standard operant chamber that only differed from one another in their proximity to a food niche (i.e., Near vs. Far); a second experimental factor, the probability of reward, was signaled by an auditory cue. In Experiment 1, trials with a high-probability stimulus terminated with reward on 100% of trials, while trials with a low-probability stimulus terminated with reward 25% of the time. We conducted a similar procedure in Experiment 2, but reduced the likelihood of reward on low-probability trials to 10%; additionally, we collected data in a post-acquisition extinction test. Overall, reduced proximity and probability increased variation of response rate, whereas only the probability factor affected lever press duration. Proximity also interacted with probability to influence variation in response rate. These findings extend the factors modulating behavioral variability to include the spatial proximity between a response and reward.

Explorations of object and location memory using fMRI

Content-specific sub-systems of visual working memory (VWM) have been explored in many neuroimaging studies with inconsistent findings and procedures across experiments. The present study employed functional magnetic resonance imaging (fMRI) and a change detection task using a high number of trials and matched stimulus displays across object and location change (what vs. where) conditions. Furthermore, individual task periods were studied independently across conditions to identify differences corresponding to each task period. Importantly, this combination of task controls has not previously been described in the fMRI literature. Composite results revealed differential frontoparietal activation during each task period. A separation of object and location conditions yielded a distributed system of dorsal and ventral streams during the encoding of information corresponding to bilateral inferior parietal lobule (IPL) and lingual gyrus activation, respectively. Differential activity was also shown during the maintenance of information in middle frontal structures bilaterally for objects and the right IPL and left insula for locations. Together, these results reflect a domain-specific dissociation spanning several cortices and task periods. Furthermore, differential activations suggest a general caudal-rostral separation corresponding to object and location memory, respectively.

Visual discrimination learning with an iPad-equipped apparatus

Visual discrimination tasks are commonly used to assess visual learning and memory in non-human animals. The current experiments explored the suitability of an iPad (Apple, Cupertino, California), as a low-cost alternative touchscreen for visual discrimination tasks. In Experiment 1, rats were trained with patterned black-and-white stimuli in a successive non-match to sample procedure. Rats successfully interacted with the iPad but failed to learn to withhold responding on trials in which the sample matched the comparison. Experiment 2 used the same patterned stimuli, but the procedure was simplified to a successive discrimination procedure and we explored the use of procedures known to facilitate discrimination learning. Rats that received training with differential outcomes and a differential reinforcement of other behavior schedule successfully acquired the task. In Experiment 3, the same rats were tested in a simultaneous discrimination task and we explored the use of a correction and non-correction method during acquisition. Rats that failed to learn the discrimination in the previous experiment, improved while trained with the correction method. These experiments support the use of the iPad in visual discrimination tasks and inform future studies investigating learning and memory within a touchscreen-equipped (iPad or other) apparatus.

Factors that influence negative summation in a spatial-search task with pigeons

A variant of the standard conditioned inhibition procedure was used to evaluate landmark-based spatial search in a touchscreen preparation. Pigeons were given compound trials with one landmark (A) positioned in a consistent spatial relationship to a hidden goal and another landmark (B) positioned randomly with respect to A and the hidden goal (AB+). On half of the non-reinforced inhibitory trials, A was paired with landmark X (AX-) and on the remaining trials B was paired with Y (BY-). All subjects were also given reinforced trials with a transfer excitor (T+). During conditioned inhibition training, subjects showed no change in overall responding during AX- trials but did show a decrease in the number of pecks to the goal location signaled by A. During non-reinforced summation tests with landmark T, X had a greater suppressive effect than did Y on overall responding but the percentage of pecks at the goal did not differ unless X was positioned near the expected goal signaled by T. These data demonstrate that the effectiveness of a stimulus trained as an inhibitor is dependent on the strength of the association between its training excitor (A) and the US, as well as, the spatial arrangement of stimuli during testing.

Overshadowing between landmarks on the touchscreen and in arena with pigeons

The role of generalization decrement in spatial overshadowing was evaluated using a landmark-based spatial search task in both a touchscreen preparation (Experiment 1a) and in an Automated Remote Environmental Navigation Apparatus (ARENA, Experiment 1b). A landmark appeared as a colored circle among a row of eight (touchscreen) or six (ARENA) potential locations. On overshadowing trials, Landmark X was located two positions away from a hidden goal, while another landmark, A, was in the position between X and the goal. On control trials, Landmark Y was positioned two locations away from the goal but without a closer landmark. All subjects were then tested with separate trials of A, X, Y, and BY. Testing revealed poor spatial control by X relative to A and Y, thereby replicating the spatial overshadowing effect. Spatial control by Y was similar when tested in compound with novel landmark (BY) and on trials of Y alone. Thus, overshadowing in a small-scale environment does not appear to be due to a process of generalization decrement between training and testing.

WITHDRAWN: fMRI correlates of visual working memory: What vs. where

This article has been withdrawn at the request of the authors. The Publisher apologizes for any inconvenience this may cause. The full Elsevier Policy on Article Withdrawal can be found at http://www.elsevier.com/locate/withdrawalpolicy. This article has been withdrawn at the request of the editor. The Publisher apologizes for any inconvenience this may cause. The full Elsevier Policy on Article Withdrawal can be found at http://www.elsevier.com/locate/withdrawalpolicy.

Behavioral research in pigeons with ARENA: an automated remote environmental navigation apparatus

Three experiments established the effectiveness of an Automated Remote Environmental Navigation Apparatus (ARENA) developed in our lab to study behavioral processes in pigeons. The technology utilizes one or more wireless modules, each capable of presenting colored lights as visual stimuli to signal reward and of detecting subject peck responses. In Experiment 1, subjects were instrumentally shaped to peck at a single ARENA module following an unsuccessful autoshaping procedure. In Experiment 2, pigeons were trained with a simultaneous discrimination procedure during which two modules were illuminated different colors; pecks to one color (S+) were reinforced while pecks to the other color (S-) were not. Pigeons learned to preferentially peck the module displaying the S+. In Experiment 3, two modules were lit the same color concurrently from a set of six colors in a conditional discrimination task. For three of the colors pecks to the module in one location (e.g., upper quadrant) were reinforced while for the remaining colors pecks at the other module (e.g., lower quadrant) were reinforced. After learning this discrimination, the color-reinforced location assignments were reversed. Pigeons successfully acquired the reversal. ARENA is an automated system for open-field studies and a more ecologically valid alternative to the touchscreen.

Associative Basis of Landmark Learning and Integration in Vertebrates

Early work on spatial navigation evaluated what stimuli (kinesthetic or extra-maze) support small-scale navigation and the nature of the underlying learning (place versus response) process. Contemporary research has focused primarily on how cues interact to determine spatial search. This review covers three general findings from research on landmark-based spatial search in vertebrates. First, pigeons and rats encode simple spatial maps in both open-field and touchscreen environments. Second, a nascent literature shows how simple maps can be integrated into complex maps through higher-order associative processes. The spatial-integration hypothesis provides an associative mechanism for spatial mapping that serves as an alternative to a previously posed configural mechanism. Finally, the evidence for associative cue-competition phenomena in landmark learning is reviewed-focusing on blocking and overshadowing. These findings support a role for associative learning in spatial tasks and provide a powerful explanatory framework for understanding cue integration and competition effects in landmark learning.

The special status of actions in causal reasoning in rats

A. P. Blaisdell, K. Sawa, K. J. Leising, and M. R. Waldmann (2006) reported evidence for causal reasoning in rats. After learning through Pavlovian observation that Event A (a light) was a common cause of Events X (an auditory stimulus) and F (food), rats predicted F in the test phase when they observed Event X as a cue but not when they generated X by a lever press. Whereas associative accounts predict associations between X and F regardless of whether X is observed or generated by an action, causal-model theory predicts that the intervention at test should lead to discounting of A, the regular cause of X. The authors report further tests of causal-model theory. One key prediction is that full discounting should be observed only when the alternative cause is viewed as deterministic and independent of other events, 2 hallmark features of actions but not necessarily of arbitrary events. Consequently, the authors observed discounting with only interventions but not other observable events (Experiments 1 and 2). Moreover, rats were capable of flexibly switching between observational and interventional predictions (Experiment 3). Finally, discounting occurred on the very first test trial (Meta-Analysis). These results confirm causal-model theory but refute associative accounts.

Temporal integration in Pavlovian appetitive conditioning in rats

We used an appetitive sensory preconditioning procedure to investigate temporal integration in rats in two experiments. In Phase 1, rats were presented with simultaneous compound trials on which a 10-sec conditioned stimulus (CS) X was embedded within a 60-sec CS A. In Group Early, CS X occurred during the early portion of CS A, whereas in Group Late, CS X occurred during the latter portion of CS A. In Phase 2, CS X was paired simultaneously with sucrose. On a subsequent test with CS A, the rate of magazine entries peaked during the early portions of the stimulus in Group Early and during the latter portions of the stimulus in Group Late (Experiments 1 and 2). Similar response peaks were not observed on tests with a control stimulus that had been presented in compound with a stimulus that did not signal reward (Experiment 2).

Causal reasoning in rats

Empirical research with nonhuman primates appears to support the view that causal reasoning is a key cognitive faculty that divides humans from animals. The claim is that animals approximate causal learning using associative processes. The present results cast doubt on that conclusion. Rats made causal inferences in a basic task that taps into core features of causal reasoning without requiring complex physical knowledge. They derived predictions of the outcomes of interventions after passive observational learning of different kinds of causal models. These competencies cannot be explained by current associative theories but are consistent with causal Bayes net theories.

Sensory Preconditioning in Spatial Learning Using a Touch Screen Task in Pigeons

The authors used a touch screen-based visual-search task to investigate spatial integration in pigeons. First, pigeons were presented with a consistent spatial relationship between compound visual landmarks (LMs) A-X and B-Y, separately. Next, pigeons learned to find a hidden goal on the monitor in the presence of LMs A and B. The goal bore a consistent spatial relationship to LM A, but not to LM B. On nonreinforced probe tests, the peak and distribution of responses to LM X suggest that pigeons computed a novel X-goal spatial relationship on the basis of X-A and A-goal spatial vectors. Responses to LM Y, however, revealed no evidence of spatial integration. These results replicate and extend those of A. P. Blaisdell and R. G. Cook (2005) using an open-field task.