Generalization of delayed matching to sample following training at different delays

Effects of brief post-sample cues signaling presence or absence of reinforcers in delayed matching-to-sample

When short-term memory is assessed in the delayed matching-to-sample (DMTS) procedure, performance is better when cues signal larger reinforcer magnitudes or higher reinforcer probabilities for correct responding. Previous studies demonstrating signaled-magnitude or signaled-probability effects presented cues for a prolonged period during the sample stimulus and/or retention interval. The present study asked whether a signaled-probability effect would occur with brief post-sample cues that signaled the presence or absence of reinforcement. Five pigeons responded in a DMTS task in which sample stimuli were sometimes followed by a 0.5-s cue signaling that reinforcers would either be available or not available in the current trial, and the retention interval varied from 0.5s to 20s. A reliable signaled-probability effect was found when reinforcers were arranged independently and for all correct responses, whereas a smaller, less systematic effect was found when reinforcers were arranged dependently and probabilistically. These findings highlight the importance of reinforcement contingencies and contingency discriminability in remembering, and add to the evidence showing that cues signaling differential reinforcement in DMTS may affect processes during the retention interval and comparison phase, rather than attention to the sample stimulus.

Selective dopaminergic effects on attention and memory in male mice exposed to Methylmercury during adolescence

Gestational exposure to methylmercury disrupts dopamine-mediated behavior and produces heightened sensitivity to monoamine agonists later in life. This has been reported and replicated following both pre- and post-natal exposure. Impacts of methylmercury when exposure occurs during the sensitive period of adolescence, a key period of dopaminergic development, remain underexplored. There have been variable results thus far in studies investigating links between adolescent exposure to methylmercury and alterations in executive function and altered sensitivity to monoamine agonists. The current study was designed to investigate adolescent exposure by exposing male mice to 0, 0.3, or 3 ppm methylmercury during adolescence and training them in a hybrid task to assess two executive functions, attention and memory, in adulthood. Behavior in these animals was probed with a range of doses of the dopamine agonist, d-amphetamine, and the norepinephrine agonist, desipramine. Attention and memory in these mice were sensitive to disruption by d-amphetamine and interacted with methylmercury exposure. Choice latencies were also longer in the MeHg-exposed mice. Desipramine did not affect behavior in these animals nor did it interact with methylmercury. It is concluded that methylmercury-related inhibition of behavior observed in this study were differentially sensitive to acute disruption in dopamine, but not norepinephrine, neurotransmission.

Methylmercury, attention, and memory: baseline-dependent effects of adult d-amphetamine and marginal effects of adolescent methylmercury

Methylmercury (MeHg) is an environmental neurotoxicant known to disrupt behavior related to dopamine neurotransmission in experimental models. Such disruptions are sensitive to dopamine agonists when administered acutely after exposure to MeHg has ended or when administered concurrently with MeHg exposure. Sustained attention and short-term remembering, components of attention-deficit/hyperactivity disorder (ADHD), are partially mediated by dopamine neurotransmission. In order to observe MeHg-related alterations in sustained attention and short-term memory, as well as determine sensitivity of MeHg exposed animals to dopamine agonists commonly used in the treatment of ADHD symptoms, rats were exposed to 0, 0.5, or 5 ppm MeHg throughout adolescence and trained in a hybrid sustained attention/short term memory visual signal detection task in adulthood. Behavior was then probed with acute i.p. injections of the dopamine agonist, d-amphetamine, which improves impaired attention and inhibits short-term memory in clinical syndromes like ADHD. Acute d-amphetamine dose-dependently decreased short-term memory as well as sustained attention. While MeHg alone did not impair accuracy or memory, it did interact with d-amphetamine to produce baseline-dependent inhibition of behavior. These findings further show that changes in behavior following low-level exposure to MeHg during adolescence are augmented by dopamine agonists. Observed impairments in memory following acute d-amphetamine are consistent with previous findings.

Adolescent methylmercury exposure alters short-term remembering, but not sustained attention, in male Long-Evans rats

Methylmercury is an environmental neurotoxicant found in fish that produces behavioral deficits following early developmental exposure. The impact of adolescent exposure to this developmental neurotoxicant is only recently being explored in animal models. Here, short-term memory and sustained attention were examined using a rodent model of adolescent methylmercury exposure. Rats were exposed to 0, 0.5, or 5 ppm methylmercury throughout the adolescent period and tested on a two-choice visual signal detection task in adulthood. Methylmercury improved short-term remembering in this procedure but the dose-effect curve was nonmonotonic, as has been reported previously: effects on memory were observed in animals exposed to 0.5 ppm methylmercury, but not 5 ppm. Methylmercury did not significantly alter sustained attention, which is in contrast to effects following gestational exposure in human populations. The results may suggest that attention is not involved with previously reported effects of methylmercury during adolescence, but certain procedural issues remain unresolved.

Towards a comparative science of emotion: Affect and consciousness in humans and animals

The componential view of human emotion recognises that affective states comprise conscious, behavioural, physiological, neural and cognitive elements. Although many animals display bodily and behavioural changes consistent with the occurrence of affective states similar to those seen in humans, the question of whether and in which species these are accompanied by conscious experiences remains controversial. Finding scientifically valid methods for investigating markers for the subjective component of affect in both humans and animals is central to developing a comparative understanding of the processes and mechanisms of affect and its evolution and distribution across taxonomic groups, to our understanding of animal welfare, and to the development of animal models of affective disorders. Here, contemporary evidence indicating potential markers of conscious processing in animals is reviewed, with a view to extending this search to include markers of conscious affective processing. We do this by combining animal-focused approaches with investigations of the components of conscious and non-conscious emotional processing in humans, and neuropsychological research into the structure and functions of conscious emotions.

Psychophysics of Remembering: The Discrimination Hypothesis

In a psychophysical approach to remembering, the events to be remembered are discriminated from other possibilities at the time of remembering, and not at the time of encoding or learning. The discrimination is specific to the retention interval at which remembering occurs, as shown by experiments demonstrating that discriminability and response bias are delay–specific. This article discusses a discrimination model for remembering that emphasizes the individual's history of learning about reward payoffs in similar experiences in the past. This model predicts the two characteristics of forgetting functions, initial discriminability and rate of forgetting.

A model for discriminating reinforcers in time and space

Both the response-reinforcer and stimulus-reinforcer relation are important in discrimination learning; differential responding requires a minimum of two discriminably-different stimuli and two discriminably-different associated contingencies of reinforcement. When elapsed time is a discriminative stimulus for the likely availability of a reinforcer, choice over time may be modeled by an extension of the Davison and Nevin (1999) model that assumes that local choice strictly matches the effective local reinforcer ratio. The effective local reinforcer ratio may differ from the obtained local reinforcer ratio for two reasons: Because the animal inaccurately estimates times associated with obtained reinforcers, and thus incorrectly discriminates the stimulus-reinforcer relation across time; and because of error in discriminating the response-reinforcer relation. In choice-based timing tasks, the two responses are usually highly discriminable, and so the larger contributor to differences between the effective and obtained reinforcer ratio is error in discriminating the stimulus-reinforcer relation. Such error may be modeled either by redistributing the numbers of reinforcers obtained at each time across surrounding times, or by redistributing the ratio of reinforcers obtained at each time in the same way. We assessed the extent to which these two approaches to modeling discrimination of the stimulus-reinforcer relation could account for choice in a range of temporal-discrimination procedures. The version of the model that redistributed numbers of reinforcers accounted for more variance in the data. Further, this version provides an explanation for shifts in the point of subjective equality that occur as a result of changes in the local reinforcer rate. The inclusion of a parameter reflecting error in discriminating the response-reinforcer relation enhanced the ability of each version of the model to describe data. The ability of this class of model to account for a range of data suggests that timing, like other conditional discriminations, is choice under the joint discriminative control of elapsed time and differential reinforcement. Understanding the role of differential reinforcement is therefore critical to understanding control by elapsed time.

Effect of stimulus and response separation in a matching-to-sample task in the brushtail possum (Trichosurus vulpecula)

This study seeks to investigate the impact of changing the proximity of stimulus and response manipulanda on matching-to-sample performance in possums. Possums were presented with five rows of blue and yellow stimuli arranged vertically 25mm apart above response levers. Generally, peak performance occurred at the distance from the lever currently being trained. Performance generalized to distances close to the currently trained distance and decreased in accuracy at distances further from the trained level. The findings from this experiment provide evidence for placing stimuli and response manipulanda close together to improve acquisition of a task, and increase the responding accuracy in MTS experiments. This suggests that spatial contiguity in the relative location of stimuli and response manipulanda is critical to animals performing complex operant tasks.

Working-memory training: effects on delay discounting in male Long Evans rats

Delay discounting describes the devaluation of a reward as the delay to the receipt of the reward increases. Because steep delay discounting is robustly correlated with a number of behavioral problems (e.g., substance dependence, gambling) and some evidence suggests steep discounting precedes and predicts drug-taking in humans and rats, this study sought to experimentally reduce rats' delay discounting. Human stimulant-dependent participants given working-memory training reportedly decreased their rates of discounting relative to a sham-training group (Bickel, Yi, Landes, Hill, & Baxter, 2011). To evaluate the cross-species generality of this effect, 38 male Long-Evans rats, matched on pretraining delay-discounting rates, were randomly assigned to receive 140 sessions of working-memory training or sham training (which required no memory of the sample stimulus). Large between-group differences in working memory were observed after training; however, posttraining delay-discounting rates were undifferentiated across groups. Potential explanations for these findings are discussed.

Impulsive choice predicts poor working memory in male rats

A number of maladaptive behaviors and poor health outcomes (e.g., substance abuse, obesity) correlate with impulsive choice, which describes the tendency to prefer smaller, immediate rewards in lieu of larger, delayed rewards. Working memory deficits are often reported in those diagnosed with the same maladaptive behaviors. Human studies suggest that impulsive choice is associated with working memory ability but, to date, only one study has explored the association between working memory and impulsive choice in rats and no relation was reported. The current study reevaluated the association between working memory and impulsive choice in 19 male Long-Evans rats. Psychophysical adjusting procedures were used to quantify working memory (titrating-delay match-to-position procedure) and impulsive choice (adjusting delay procedure). Rats were partitioned into low- and high-impulsive groups based on performance in the impulsive choice task. Low-impulsive rats performed significantly better in the working memory assessment. Across all rats, impulsive choice was negatively correlated with working memory performance. These findings support the hypothesis that prefrontal cortex function, specifically, working memory, is related to impulsive choice. Future research might profitably examine the experimental variables designed to influence working memory to evaluate the effects of these variables on impulsive choice and maladaptive behaviors with which it is correlated.

Rats exhibit asymmetrical retention functions for hedonic and nonhedonic samples in many-to-one symbolic delayed matching to sample

Rats were initially trained in a symbolic delayed matching-to-sample task either to discriminate hedonic samples that consisted of food or no food or to discriminate tone samples that differed in frequency and location. The retention functions for both the hedonic and tone samples were asymmetric, with forgetting of the food sample or the high-frequency tone occurring more rapidly than forgetting of the no-food sample or the low-frequency tone. Next, many-to-one (MTO) training was given in which tone samples were added for the rats initially trained with hedonic samples, and hedonic samples were added for the rats initially trained with tone samples. For both groups, a food sample and a tone sample (tone-F) were associated with responding to one lever (e.g., stationary), and a no-food sample and a different tone sample (tone-NF) were associated with responding to the alternative lever (e.g., moving). During retention testing, we found equivalent forgetting for the food and no-food samples, but forgetting of the tone-F sample occurred more rapidly than forgetting of the tone-NF sample. This is the first MTO study to suggest that rats, like pigeons, may use hedonic samples as the basis for the common coding of nonhedonic samples in MTO delayed matching.

Contingent stimuli signal subsequent reinforcer ratios

Conditioned reinforcer effects may be due to the stimulus' discriminative rather than its strengthening properties. While this was demonstrated in a frequently-changing choice procedure, a single attempt to replicate in a relatively static choice environment failed. We contend that this was because the information provided by the stimuli was nonredundant in the frequently-changing preparation, and redundant in the steady-state arrangement. In the present experiments, 6 pigeons worked in a steady-state concurrent schedule procedure with nonredundant informative stimuli (red keylight illuminations). When a response-contingent red keylight signaled that the next food delivery was more likely on one of the two alternatives, postkeylight choice responding was reliably for that alternative. This effect was enhanced after a history of extended informative red keylight presentation (Experiment 2). These results lend support to recent characterizations of conditioned reinforcer effects as reflective of a discriminative, rather than a reinforcing, property of the stimulus.

Reversing the course of forgetting

Forgetting functions were generated for pigeons in a delayed matching-to-sample task, in which accuracy decreased with increasing retention-interval duration. In baseline training with dark retention intervals, accuracy was high overall. Illumination of the experimental chamber by a houselight during the retention interval impaired performance accuracy by increasing the rate of forgetting. In novel conditions, the houselight was lit at the beginning of a retention interval and then turned off partway through the retention interval. Accuracy was low at the beginning of the retention interval and then increased later in the interval. Thus the course of forgetting was reversed. Such a dissociation of forgetting from the passage of time is consistent with an interference account in which attention or stimulus control switches between the remembering task and extraneous events.

Reversing the signaled magnitude effect in delayed matching to sample: delay-specific remembering

Pigeons performed a delayed matching-to-sample task in which large or small reinforcers for correct remembering were signaled during the retention interval. Accuracy was low when small reinforcers were signaled, and high when large reinforcers were signaled (the signaled magnitude effect). When the reinforcer-size cue was switched from small to large partway through the retention interval, accuracy accordingly changed from low to high. The opposite happened when the cue was switched from large to small. This dissociation of forgetting from the passage of time raises the possibility that remembering is delay-specific. The reversal of the signaled magnitude effect during the retention interval is consistent with an attentional account in which the stimulus control of remembering is influenced by extraneous events.

Transfer of stimulus control from a TFT to CRT screen

The use of television and computer screens for presenting stimuli to animals is increasing as it is non-invasive and can provide precise control over stimuli. Past studies have used cathode ray tube (CRT) screens; however, there is some evidence that these give different results to non-flickering thin film transistor (TFT) screens. Hens' critical flicker fusion frequency ranges between 80 and 90 Hz--above standard CRT screens. Thus, stimuli presented on CRT screens may appear distorted to hens. This study aimed to investigate whether changing the flicker rate of CRT screens altered hens' discrimination. Hens were trained (in a conditional discrimination) to discriminate between two stimuli on a TFT (flickerless) screen, and tested with the stimuli on a CRT screen at four flicker rates (60, 75, 85, and 100 Hz). The hens' accuracy generally decreased as the refresh rate of the CRT screen decreased. These results imply that the change in flicker rate changed the appearance of the stimuli enough to affect the hens' discrimination and stimulus control is disrupted when the stimuli appear to flicker.

Metacognition in animals

Metacognition is thinking about thinking. There is considerable interest in developing animal models of metacognition to provide insight about the evolution of mind and a basis for investigating neurobiological mechanisms of cognitive impairments in people. Formal modeling of low-level (i.e., alternative) mechanisms has recently demonstrated that prevailing standards for documenting metacognition are inadequate. Indeed, low-level mechanisms are sufficient to explain data from existing methods. Consequently, an assessment of what is 'lost' (in terms of existing methods and data) necessitates the development of new, innovative methods for metacognition. Development of new methods may prompt the establishment of new standards for documenting metacognition.

Effects of retention interval on performance in a numerical reproduction task

The retention interval (RI) between the sample and production phase in a numerical reproduction task was varied to determine whether a "produce-small" effect would be obtained with increased delays. Four pigeons were trained with a retention interval of 2s, and then tested with intervals of 0.5s and 8s. Results showed a number-dependent, "produce-large" effect-response number increased when RI was increased-analyses of average response number and accuracy suggested RI affected responding most on the 2-flash trials with an 8-s RI. Additionally, discrimination between trial types decreased as RI increased. Existing explanations for the "choose-short/small" effect appear unable to account for these results; however the "produce-large" effect may be attributed to a disruption in stimulus control over responding.

Seasonal variation in pigeon body weight and delayed matching-to-sample performance

The weights of 5 pigeons with free access to food, monitored over 3 calendar years in the laboratory, were found to fluctuate with season. All pigeons were at their heaviest in the winter and were lightest in the summer. Five different pigeons performed a standard delayed matching-to-sample task for 44 weeks from January to November. Their weights were held at 85% of their summer free-feeding weights, making their predicted deprivation level higher in the winter relative to predicted winter free-feeding weights. Slopes of forgetting functions fit to weekly response totals for each pigeon were shallower in winter, showing an improvement in accuracy with longer delays. Thus, delayed matching-to-sample performance may have been affected by the practice of maintaining the pigeons at a constant body weight throughout the calendar year.

Remembering as discrimination in delayed matching to sample: discriminability and bias

Task difficulty in delayed matching-to-sample tasks (DMTS) is increased by increasing the length of a retention interval. When tasks become more difficult, choice behavior becomes more susceptible to bias produced by unequal reinforcer ratios. Delaying reinforcement from choice behavior also increases both task difficulty and the biasing effect of unequal reinforcer probability. Six pigeons completed nine DMTS conditions with retention intervals of 0, 2, 4, 6, and 8 sec, in which reinforcer delays of 0, 2, and 4 sec were combined with ratios of reinforcer probabilities of .5/.5, .2/.8, and .8/.2 for correct red and green responses. Discriminability (log d) decreased with both increasing retention interval duration and increasing reinforcer delay. Sensitivity to reinforcement, the tendency for ratios of choice responses to follow unequal reinforcer probabilities, also increased as a function of both increasing retention interval and increasing reinforcer delay. The result is consistent with the view that remembering in DMTS tasks is a discriminated operant in which increasing task difficulty increases sensitivity to reinforcement.

Timing, remembering, and discrimination

Four pigeons were first trained in a timing procedure. In one condition, each trial began with the presentation of an X on the center key, followed by a delay (short or long), after which two side keys were lit. If the delay was short, pecks to the red side key were reinforced. If the delay was long, pecks to the green side key were reinforced. In a second condition, the opposite contingencies applied following presentation of a square on the center key. Choice responses were then tested at 10 time intervals ranging from short to long (1 to 4 s and 4 to 7 s in different conditions). The two timing conditions were combined to create a remembering condition in which correct responding depended upon discrimination of both the sample stimulus (X or square) and the delay interval (short or long). Choices varied systematically across delay in timing conditions, but in remembering conditions, accurate choice at the training delays did not initially generalize to intermediate delays. However, with prolonged training in the remembering task, the response pattern began to resemble that of the timing conditions. Generalization gradients were asymmetrical, in accordance with Weber's Law, in that greater generalization occurred with longer delays than with shorter delays.

Beyond bistability: Biophysics and temporal dynamics of working memory

Working memory has often been modeled and conceptualized as a kind of binary (bistable) memory switch, where stimuli turn on plateau-like persistent activity in subsets of cells, in line with many in vivo electrophysiological reports. A potentially related form of bistability, termed up- and down-states, has been studied with regard to its synaptic and ionic basis in vivo and in reduced cortical preparations. Also single cell mechanisms for producing bistability have been proposed and investigated in brain slices and computationally. Recently, however, it has been emphasized that clear plateau-like bistable activity is rather rare during working memory tasks, and that neurons exhibit a multitude of different temporally unfolding activity profiles and temporal structure within their spiking dynamics. Hence, working memory seems to be a highly dynamical neural process with yet unknown mappings from dynamical to computational properties. Empirical findings on ramping activity profiles and temporal structure will be reviewed, as well as neural models that attempt to account for it and its computational significance. Furthermore, recent in vivo, neural culture, and in vitro preparations will be discussed that offer new possibilities for studying the biophysical mechanisms underlying computational processes during working memory. These preparations have revealed additional evidence for temporal structure and spatio-temporally organized attractor states in cortical networks, as well as for specific computational properties that may characterize synaptic processing during high-activity states as during working memory. Together such findings may lay the foundations for highly dynamical theories of working memory based on biophysical principles.

Dopamine agonists and antagonists can produce an attenuation of response bias in a temporal discrimination task depending on discriminability of target duration

The current study examined the effects of the D2 agonist (quinpirole) and D2 antagonist (eticlopride) on temporal discrimination performance in a conditional discrimination task (Experiment I) and a delayed conditional discrimination task (Experiment II). In both experiments rats discriminated between a scheduled stimulus duration of 3 s versus 9 s. Consistent with previous reports, overall discrimination performance decreased in a dose-dependent manner with both drugs. Changes in response bias (the tendency to choose-short or choose-long irrespective of actual stimulus duration), however, were best characterized in terms of both drugs tending to attenuate the bias effects normally observed during baseline drug-free performance. Specifically, the 'choose-short' bias observed in Experiment I and at a relatively short, 0.1 s, delay in Experiment II became less extreme with increasing doses. In addition, the 'choose-long' bias observed at a relatively long, 6 s, delay in Experiment II also became less extreme with increasing doses. Thus, whether there was an apparent shift from a short response bias to long, or vice versa, was the product of the delay interval between stimulus presentation and choice rather than whether the drug in question was a D2 agonist or antagonist. Such an attenuation of bias may have arisen because of subjects confounding the delay interval with the actual discriminative stimulus duration.

Timing, memory for intervals, and memory for untimed stimuli: The role of instructional ambiguity

Theories of animal timing have had to account for findings that the memory for the duration of a timed interval appears to be dramatically shorted within a short time of its termination. This finding has led to the subjective shortening hypothesis and it has been proposed to account for the poor memory that animals appear to have for the initial portion of a timed interval when a gap is inserted in the to-be-timed signal. It has also been proposed to account for the poor memory for a relatively long interval that has been discriminated from a shorter interval. I suggest here a simpler account in which ambiguity between the gap or retention interval and the intertrial interval results in resetting the clock, rather than forgetting the interval. The ambiguity hypothesis, together with a signal salience mechanism that determines how quickly the clock is reset at the start of the intertrial interval can account for the results of the reported timing experiments that have used the peak procedure. Furthermore, instructional ambiguity rather than memory loss may account for the results of many animal memory experiments that do not involve memory for time.

Timing, memory for intervals, and memory for untimed stimuli: The role of instructional ambiguity

Theories of animal timing have had to account for findings that the memory for the duration of a timed interval appears to be dramatically shorted within a short time of its termination. This finding has led to the subjective shortening hypothesis and it has been proposed to account for the poor memory that animals appear to have for the initial portion of a timed interval when a gap is inserted in the to-be-timed signal. It has also been proposed to account for the poor memory for a relatively long interval that has been discriminated from a shorter interval. I suggest here a simpler account in which ambiguity between the gap or retention interval and the intertrial interval results in resetting the clock, rather than forgetting the interval. The ambiguity hypothesis, together with a signal salience mechanism that determines how quickly the clock is reset at the start of the intertrial interval can account for the results of the reported timing experiments that have used the peak procedure. Furthermore, instructional ambiguity rather than memory loss may account for the results of many animal memory experiments that do not involve memory for time.

The effects of changes in consequences on hens' performance in delayed-matching-to-sample tasks

A delayed-matching-to-sample (DMTS) task was used to investigate remembering with domestic hens. In Conditions 1 and 3 of Experiment 1, six hens responded under a mixed-delay procedure with delays of 0.25, 2, and 8 s. In Condition 2, the reinforcer for correct responding was delayed for 6 s after each correct matching response on 2-s delay trials. In Condition 1, discrimination performance decreased monotonically over the three delays. With the delay to the reinforcer, the decreases were non-monotonic as a result of the considerable drop in the accuracy of discrimination on the 2-s delay trials. Performance at the 2-s delay did not recover completely in Condition 3. In Conditions 1 and 3 of Experiment 2, five hens responded under a mixed-delay procedure with delays of 0, 4, and 16 s. In Condition 2 no reinforcers were provided for correct responding on 0- and 16-s delay trials. When reinforcers were available on all trials discrimination performance decreased monotonically with delay. There were non-monotonic changes in discrimination with delay when there was extinction at two delays resulting mainly from a large drop in discrimination performance at 0 s. In addition, response latencies increased markedly at the two delays associated with extinction. Performance recovered completely in Condition 3. The data support the ideas that remembering involves a temporal discrimination that the effects of delaying reinforcement and removing reinforcement may differ, and that the measurement of response latencies may be a useful tool in DMTS procedures.

On the form of the forgetting function: the effects of arithmetic and logarithmic distributions of delays

Forgetting functions with 18 delay intervals were generated for delayed matching-to-sample performance in pigeons. Delay interval variation was achieved by arranging five different sets of five delays across daily sessions. In different conditions, the delays were distributed in arithmetic or logarithmic series. There was no convincing evidence for different effects on discriminability of the distributions of different delays. The mean data were better fitted by some mathematical functions than by others, but the best-fitting functions depended on the distribution of delays. In further conditions with a fixed set of five delays, discriminability was higher with a logarithmic distribution of delays than with an arithmetic distribution. This result is consistent with the treatment of the forgetting function in terms of generalization decrement.

Neural representation of interval time

Animals can predict the time of occurrence of a forthcoming event relative to a preceding stimulus, i.e. the interval time between those two, given previous learning experience with the temporal contingency between them. Accumulating evidence suggests that a particular pattern of neural activity observed during tasks involving fixed temporal intervals might carry interval time information: the activity of some cortical and subcortical neurons ramps up slowly and linearly during the interval, like a temporal integrator, and peaks around the time at which the event is due to occur. The slope of this climbing activity, and hence the peak time, adjusts to the length of a temporal interval during repetitive experience with it. Various neural mechanisms for producing climbing activity with variable slopes, representing the length of learned intervals, are discussed.

Need probability effects in animal short-term memory

Five pigeons performed in a delayed matching-to-sample (DMTS) procedure with five delay durations (0.5, 2.5, 5, 10 and 20 s) mixed within sessions. Contrary to the predictions of need probability theory, discriminability decreased when fewer short than long delays were included in each session. To test whether the decrease in discriminability was due to a decrease in obtained reinforcement at short delays, the number of trials at each delay was held constant and reinforcer probability was increased with increasing delay. This manipulation produced a similar decrease in discriminability as when the frequency of delays was manipulated. It was concluded that the effect of delay frequency on the forgetting function is mediated by the effect of the reinforcer distribution, which influences discriminability by weakening stimulus control.

The effect of reinforcer delays on the form of the forgetting function

Pigeons were trained in a matching-to-sample procedure with retention intervals of 0, 2, 4, 6, and 8 s mixed within each session. In different conditions, reinforcement was delayed by 0, 1, 2, 4, 6, or 8 s from correct choice responses. Discriminability decreased with increasing retention-interval duration and with increasing reinforcer delay. Exponential forgetting functions were fitted to discriminability measures plotted as a function of retention interval. Initial discriminability (intercept of the fitted functions) decreased with increasing reinforcer delay. Rate of forgetting (slope of the fitted functions) increased with reinforcer delay, suggesting an interaction between the effects of reinforcer delay and retention interval. The data were well described by multiplying an exponential function describing the effects of retention interval by a hyperbolic function describing the effect of reinforcer delay. This description included an interaction term that allowed for a greater effect of reinforcer delay at longer retention intervals.

Temporal generalization and diffusion in forgetting

Two processes may contribute to the decrement in discriminability with increasing temporal distance between the occasioning event and later choice. One is the length of the interval and the other is generalization decrement. In the model described by White and Wixted [J. Exp. Anal. Behav. 71 (1999) 91-113], choice was predicted by the relative payoff for correct delayed matching responses, conditional on the current value of the stimulus sampled from Thurstone-like probability distributions of the effect of the sample stimuli. In the model, discriminability decreased with increasing temporal distance because the variance of the distributions increased with time. However, White and Wixted did not specify the function relating variance to temporal distance. If a diffusion process is assumed, and if diffusion increases exponentially with time, the resulting forgetting function is a negative exponential. An additional process involves exponential generalization of remembering from one time to other times. Alternative diffusion functions result in hyperbolic or power forgetting functions. The combination of two exponential processes yields forgetting functions that are double exponential in form and which appear consistent with a wide range of data.