Evaluation and development of a connectionist theory of configural learning

The nature of training in flavor preference learning determines the underlying associative structure

Pairing a palatable flavor (US) with an initially neutral flavor cue (CS) results in an acquired conditioned preference for the latter. Two main associations have been proposed to explain the acquisition of flavor preferences: Flavor-Flavor and Flavor-Nutrient learning. Although the hedonic reaction triggered by US consumption has also been suggested as a possible additional component underlying acquired flavor preference, this issue has received little attention. Here we explored whether the amount of training to the CS-US compound can favor the formation of a Flavor-Hedonic reaction association using rats as subjects and sucrose as the US. We expected that the more exposure to the CS-US compound, the stronger the S-R type association. Since S-R associations are not sensitive to devaluation procedures, we used a Sensory-Specific Satiety procedure to devalue the US after conditioning and then measured preferences for the CS. On Experiment 1 with a short restrictive training (classic procedure), preference for the CS was decreased after devaluation of the US compared to the control condition. On Experiment 2, with short unrestrictive training, preference for the CS was again weakened. Experiment 3 with a long unrestrictive training, rats expressed preference for the CS regardless of the devaluation procedure. These results suggest that, as with an instrumental paradigm, extensive training in flavor preference learning undermines the US devaluation effect.

Better together: isolation impedes memory formation for configural learning in Lymnaea stagnalis

Social interactions play an important role in learning and memory. There is great variability in the literature regarding the effects of social isolation on cognition. Here, we investigated how memory formation was affected when Lymnaea stagnalis, our model system, were socially isolated at three different time periods: before, during or after the configural learning training procedure. Each group of snails underwent configural learning where we recorded and compared their feeding behaviour before and after the pairing of an appetitive food stimulus with predator kairomones (i.e. the training procedure). We found that isolating snails before the training procedure had no effect on their learning and memory. However, when snails were isolated either during the training procedure or immediately after the training procedure, they no longer formed memory. These data provide further insight into how isolation impacts cognitive functioning in the context of higher-order learning.

Does drinking saccharin weaken an association of sweet with calories? Pre-exposure effects in flavor preference learning

The main aim of this experiment was to examine the claim that exposure to non-nutritive sweeteners weakens the formation of a sweet-calorie association. Three groups of food-deprived rats received training in which they drank an almond-flavored maltodextrin and saccharin solution. A final test phase assessed their preference for almond. The groups differed in preexposure prior to training. One was pre-exposed to saccharin, one to saccharin plus maltodextrin, and the third, control condition, received only water at this stage. When the rats continued under food deprivation for the test phase, the group exposed to the compound (saccharin plus maltodextrin) showed a weaker preference than the other two groups, while those pre-exposed to saccharin showed as strong a preference as the controls. When the test was conducted with the rats no longer food-deprived, only the water group showed a strong preference. These results support the proposal that rats can form both flavor-flavor and flavor-nutrient associations, expression of which will depend on motivational state. They did not find support for the suggestion that prior exposure to a non-nutritive sweetener can enhance subsequent learning about the nutritive properties of a sweet food.

The Basolateral Amygdala: The Core of a Network for Threat Conditioning, Extinction, and Second-Order Threat Conditioning

Threat conditioning, extinction, and second-order threat conditioning studied in animal models provide insight into the brain-based mechanisms of fear- and anxiety-related disorders and their treatment. Much attention has been paid to the role of the basolateral amygdala (BLA) in such processes, an overview of which is presented in this review. More recent evidence suggests that the BLA serves as the core of a greater network of structures in these forms of learning, including associative and sensory cortices. The BLA is importantly regulated by hippocampal and prefrontal inputs, as well as by the catecholaminergic neuromodulators, norepinephrine and dopamine, that may provide important prediction-error or learning signals for these forms of learning. The sensory cortices may be required for the long-term storage of threat memories. As such, future research may further investigate the potential of the sensory cortices for the long-term storage of extinction and second-order conditioning memories.

Learning About Reward Identities and Time

We discuss three empirical findings that we think any theory attempting to integrate interval timing with associative learning concepts will need to address. These empirical phenomena all come from studies that combine peak timing procedures with reinforcer devaluation or conditional discrimination tasks commonly employed, respectively, in interval timing or associative learning research traditions. The three phenomena we discuss include: (1) the observation that disruptions in reward identity encoding have little to no impact on the encoding of reward time in the a peak procedure (Delamater., 1998), (2) the findings that organisms tend to average their time estimates when presented with a stimulus compound consisting of separately learned stimuli indicating short or long reward times but that such temporal averaging, itself, is sensitive to post-conditioning selective reward devaluation, and (3) that rats can learn a temporal patterning task in which two stimuli presented independently indicate one time to reward availability while their compound indicates another. We review our prior results and present new findings illustrating these three phenomena and we discuss the special challenges they pose for cascade theories of timing, for multiple-oscillator models, and for any approach that attempts to integrate interval timing and associative models. We close by illustrating some ways in which multi-layer connectionist network models might begin to address some of our key findings. We believe this will require an approach that includes separate mechanisms that code for reward identity and time, but that does so in a way that permits for integration between the two systems.

Comparative biology of spatial navigation in three arachnid orders (Amblypygi, Araneae, and Scorpiones)

From both comparative biology and translational research perspectives, there is escalating interest in understanding how animals navigate their environments. Considerable work is being directed towards understanding the sensory transduction and neural processing of environmental stimuli that guide animals to, for example, food and shelter. While much has been learned about the spatial orientation behavior, sensory cues, and neurophysiology of champion navigators such as bees and ants, many other, often overlooked animal species possess extraordinary sensory and spatial capabilities that can broaden our understanding of the behavioral and neural mechanisms of animal navigation. For example, arachnids are predators that often return to retreats after hunting excursions. Many of these arachnid central-place foragers are large and highly conducive to scientific investigation. In this review we highlight research on three orders within the Class Arachnida: Amblypygi (whip spiders), Araneae (spiders), and Scorpiones (scorpions). For each, we describe (I) their natural history and spatial navigation, (II) how they sense the world, (III) what information they use to navigate, and (IV) how they process information for navigation. We discuss similarities and differences among the groups and highlight potential avenues for future research.

Stepwise learning of compound multidimensional visual stimuli by sorting out the dimensions of which they are composed in pigeons

Pigeons (Columba livia) were trained on a stage-wise go/no-go visual discrimination task. Sixteen compound stimuli were created from all the possible combinations of two stimulus values from four separable visual dimensions: shape (circle/square), size (large/small), line orientation (horizontal/vertical), and brightness (dark/light). Starting with 1 S + and 1 S - that differed in all four-dimensional values, in our later steps, we added S - stimuli one by one, sharing at first 1, then 2, and then 3 dimensions with S + by sorting them out. When the pigeons had clearly shown attending to each of four dimensions, we presented all 16 stimuli. In this last stage, the pigeons correctly rejected most of the S - stimuli despite seeing them for the first time. Thus, to discriminate 16 unique multidimensional stimuli, it was not necessary to learn all of them as compound stimuli in such an approach. However, the 4 learnt dimensions did not give fully comprehensive information about all the new and unique compound stimuli presented in the last stage. Mistakes were associated with similarity to S + and with the order of dimensional learning. Most pigeons made mistakes in the discrimination of S - stimuli that shared 3 (some shared two) dimensions with S + . The knowledge of the first-learned dimension of compound stimuli was less reliable than the dimensions learned in the last stage.

Subsampling of cues in associative learning

Theories of learning distinguish between elemental and configural stimulus processing depending on whether stimuli are processed independently or as whole configurations. Evidence for elemental processing comes from findings of summation in animals where a compound of two dissimilar stimuli is deemed to be more predictive than each stimulus alone, whereas configural processing is supported by experiments using similar stimuli in which summation is not found. However, in humans the summation effect is robust and impervious to similarity manipulations. In three experiments in human predictive learning, we show that summation can be obliterated when partially reinforced cues are added to the summands in training and tests. This lack of summation only holds when the partially reinforced cues are similar to the reinforced cues (experiment 1) and seems to depend on participants sampling only the most salient cue in each trial (experiments 2a and 2b) in a sequential visual search process. Instead of attributing our and others' instances of lack of summation to the customary idea of configural processing, we offer a formal subsampling rule that might be applied to situations in which the stimuli are hard to parse from each other.

Understanding Associative Learning Through Higher-Order Conditioning

Associative learning is often considered to require the physical presence of stimuli in the environment in order for them to be linked. This, however, is not a necessary condition for learning. Indeed, associative relationships can form between events that are never directly paired. That is, associative learning can occur by integrating information across different phases of training. Higher-order conditioning provides evidence for such learning through two deceptively similar designs – sensory preconditioning and second-order conditioning. In this review, we detail the procedures and factors that influence learning in these designs, describe the associative relationships that can be acquired, and argue for the importance of this knowledge in studying brain function.

Temporal and spatial contiguity are necessary for competition between events

Over the last 50 years, cue competition phenomena have shaped theoretical developments in animal and human learning. However, recent failures to observe competition effects in standard conditioning procedures, as well as the lengthy and ongoing debate surrounding cue competition in the spatial learning literature, have cast doubts on the generality of these phenomena. In the present study, we manipulated temporal contiguity between simultaneously trained predictors and outcomes (Experiments 1-4), and spatial contiguity between landmarks and goals in spatial learning (Supplemental Experiments 1 and 2; Experiment 5). Across different parametric variations, we observed overshadowing when temporal and spatial contiguity were strong, but no overshadowing when contiguity was weak. Thus, across temporal and spatial domains, we observed that contiguity is necessary for competition to occur, and that competition between cues presented simultaneously during learning is absent when these cues were either spatially or temporally discontiguous from the outcome. Consequently, we advance a model in which the contiguity between events is accounted for and which explains these results and reconciles the previously contradictory findings observed in spatial learning. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

An exploration of error-driven learning in simple two-layer networks from a discriminative learning perspective

Error-driven learning algorithms, which iteratively adjust expectations based on prediction error, are the basis for a vast array of computational models in the brain and cognitive sciences that often differ widely in their precise form and application: they range from simple models in psychology and cybernetics to current complex deep learning models dominating discussions in machine learning and artificial intelligence. However, despite the ubiquity of this mechanism, detailed analyses of its basic workings uninfluenced by existing theories or specific research goals are rare in the literature. To address this, we present an exposition of error-driven learning – focusing on its simplest form for clarity – and relate this to the historical development of error-driven learning models in the cognitive sciences. Although historically error-driven models have been thought of as associative, such that learning is thought to combine preexisting elemental representations, our analysis will highlight the discriminative nature of learning in these models and the implications of this for the way how learning is conceptualized. We complement our theoretical introduction to error-driven learning with a practical guide to the application of simple error-driven learning models in which we discuss a number of example simulations, that are also presented in detail in an accompanying tutorial.

Emergent Intraverbal and Reverse Intraverbal Behavior Following Listener Training in Children with Autism Spectrum Disorder

We evaluated whether intraverbal and reverse intraverbal behavior emerged following listener training in children with autism spectrum disorder (ASD). Six participants were each taught three sets of three “when?” questions in listener training. A multiple baseline design across behaviors (stimulus sets) was used to assess the effects of listener training. Results showed that intraverbal behavior emerged following listener training for five out of six participants. One participant received additional listener training and intraverbal training before intraverbal behavior emerged. Furthermore, reverse intraverbal responding occurred across all three sets of questions for three of the six participants. Establishing listener behavior may be a pathway for emergent intraverbal and reverse intraverbal responding in children with ASD. Future research could examine what skill repertoire may facilitate such transfer.

Modelling how cleaner fish approach an ephemeral reward task demonstrates a role for ecologically tuned chunking in the evolution of advanced cognition

What makes cognition “advanced” is an open and not precisely defined question. One perspective involves increasing the complexity of associative learning, from conditioning to learning sequences of events (“chaining”) to representing various cue combinations as “chunks.” Here we develop a weighted graph model to study the mechanism enabling chunking ability and the conditions for its evolution and success, based on the ecology of the cleaner fish Labroides dimidiatus. In some environments, cleaners must learn to serve visitor clients before resident clients, because a visitor leaves if not attended while a resident waits for service. This challenge has been captured in various versions of the ephemeral reward task, which has been proven difficult for a range of cognitively capable species. We show that chaining is the minimal requirement for solving this task in its common simplified laboratory format that involves repeated simultaneous exposure to an ephemeral and permanent food source. Adding ephemeral–ephemeral and permanent–permanent combinations, as cleaners face in the wild, requires individuals to have chunking abilities to solve the task. Importantly, chunking parameters need to be calibrated to ecological conditions in order to produce adaptive decisions. Thus, it is the fine-tuning of this ability, which may be the major target of selection during the evolution of advanced associative learning.

What makes cognition ‘advanced’ is an open and not precisely defined question. In this study, a cognitive model of cleaner fish learning the ephemeral-reward task demonstrates how a critical step in cognitive evolution may be understood as the evolution of chunking and its tuning to fit ecological conditions.

The retrosplenial cortex as a possible "sensory integration" area: A neural network modeling approach of the differential outcomes effect in negative patterning

We explored the hypothesis that learning a Pavlovian negative patterning task would be facilitated when training with differential, as opposed to non-differential, reinforcing outcomes. Two groups of rats received pairings of one visual and one auditory stimulus with food reward when these stimuli were presented on separate training trials, but without reward when both stimuli were presented on simultaneous stimulus compound trials (V+, A+, AV-; similar to an XOR problem). For Group Differential, each stimulus was separately paired with distinctively tasting food rewards, whereas for Group Non-Differential each stimulus was randomly paired with both food reward types across different stimulus element trials. We observed that rats learned the negative patterning task more rapidly and effectively when trained with differential outcomes. These data support a multi-layered connectionist model introduced by Delamater (2012) in which a multi-modal processing structure plays the role of a "sensory integration" area like that hypothesized for the retrosplenial cortex by Dave Bucci and his colleagues (e.g., Todd, Fournier, & Bucci, 2019). We discuss how such a region may develop different "negative occasion setting" and "configural inhibition" mechanisms in solving negative patterning and related tasks.

Configural learning memory can be transformed from intermediate-term to long-term in pond snail Lymnaea stagnalis

A lab bred W-strain of Lymnaea stagnalis exhibits configural learning (CL). CL is a form of higher order associative learning wherein when snails experience two contrasting stimuli together such as predatory odour (CE: crayfish effluent) and food odour (C: carrot odour) they learn and associate risk with food. The memory for CL has been shown to last 3 h. Here, we show that when only a single CL-training session is given only a 3 h memory is formed. Memory is not present 24 h after the training session. However, memory can be enhanced and snails show long term memory (24 h memory) when trained for a second time within a 7-day time period after the first CL-training. We further hypothesised that Green tea exposure will enhance memory persistence as catechins in green tea are shown to be cognitive enhancers. We thus subjected snails to CL training followed by green tea exposure which resulted in enhanced memory persistence and it occurred during memory consolidation phase. Thus, we show for the first time that CL intermediate-term memory can be transformed to long-term memory by green tea and multiple trainings in a lab bred strain of Lymnaea.

Another look at the extinction of conditioned flavor preferences: Amount of training and tests for spontaneous recovery

A conditioned flavor preference develops when hungry or thirsty rats experience a neutral flavor mixed in solution with a nutrient. In two sets of studies, we previously demonstrated that this learned preference is highly sensitive to flavor nonreinforcement (i.e., exposure to the flavor without the nutrient) either prior to (latent inhibition), during (partial reinforcement), or following (extinction) flavor-nutrient pairings. In each of these studies we employed a nutrient devaluation procedure to assess the integrity of specific flavor-nutrient associations following extinction, but more recently Gonzalez, Morillas, and Hall (Journal of Experimental Psychology: Animal Learning & Cognition, 42, 380-390, 2016) observed that sensitivity to extinction in thirsty rats in this preparation may depend upon use of a post-conditioning nutrient devaluation procedure. To assess the generality of our earlier results, but without including a post-conditioning nutrient devaluation phase, we assessed in three experiments the role of the number of flavor-nutrient pairings given prior to extinction and the possibility of spontaneous recovery following a 3-week delay. We observed that extinction consistently weakened the flavor preference in thirsty rats (in spite of the absence of a nutrient devaluation procedure) and also found no evidence for spontaneous recovery. These results establish that our prior findings that conditioned flavor preferences are weakened by extinction are quite robust in thirsty rats and that these extinction effects may be fairly permanent.

Motivational factors controlling flavor preference learning and performance: Effects of preexposure with nutritive and nonnutritive sweeteners

In three experiments thirsty rats were given exposure to a sweet solution (saccharin in some experiments, sucrose in others) prior to consuming a compound of the sweet substance and almond flavoring. Preference for that flavor, in a choice test of almond vs. water, was then assessed. In some cases the rats were hungry, in others they were not. When the sweetener used was saccharin, preexposure reduced the magnitude of the preference obtained on test in both hungry and nonhungry rats. When the sweetener was sucrose, preexposure had this effect only when the rats were hungry. The effects produced after preexposure to saccharin are interpreted as being the result of habituation to its sensory features that reduces the ability of these features to engage in subsequent learning. These effects will occur whether the animal is hungry or not. The results for sucrose are interpreted in terms of the fact that it possesses both sensory and nutritional properties, the role of the latter being dependent on the motivational state of subject. It is suggested that the sensory features of sucrose do not undergo habituation, but that an effect of preexposure can be obtained in hungry rats when the source of the learned preference will depend on learning about the nutritive consequences of the sucrose.

Mechanisms of higher-order learning in the amygdala

Adaptive behaviour is under the potent control of environmental cues. Such cues can acquire value by virtue of their associations with outcomes of motivational significance, be they appetitive or aversive. There are at least two ways through which an environmental cue can acquire value, through first-order and higher-order conditioning. In first-order conditioning, a neutral cue is directly paired with an outcome of motivational significance. In higher-order conditioning, a cue is indirectly associated with motivational events via a directly conditioned first-order stimulus. The present article reviews some of the associations that support learning in first- and higher-order conditioning, as well as the role of the BLA and the molecular mechanisms involved in these two types of learning.

Elemental and configural threat learning bias extinction generalization

Emotional experiences often contain a multitude of details that may be represented in memory as individual elements or integrated into a single representation. How details associated with a negative emotional event are represented in memory can have important implications for extinction strategies designed to reduce emotional responses. For example, is extinguishing one cue associated with an aversive outcome sufficient to reduce learned behavior to other cues present at the time of learning that were not directly extinguished? Here, we used a between-subjects multi-day threat conditioning and extinction task to assess whether participants generalize extinction from one cue to unextinguished cues. On Day 1, one group of participants learned that a compound conditioned stimulus, composed of a tone and colored square, predicted an uncomfortable shock to the wrist (Compound group). A second group learned that the tone and square separately predicted shock (Separate group). On Day 2, participants in both groups were exposed to the tone in the absence of shocks (cue extinction). On Day 3, we tested whether extinction generalized from the extinguished to the unextinguished cue, as well as to a compound composed of both cues. Results showed that configural and elemental learning had unique and opposite effects on extinction generalization. Subjects who initially learned that a compound cue predicted shock successfully generalized extinction learning from the tone to the square, but exhibited threat relapse to the compound cue. In contrast, subjects who initially learned that each cue individually predicted shock did not generalize extinction learning from the tone to the square, but threat responses to the compound were low. These results highlight the importance of whether details of an aversive event are represented as integrated or separated memories, as these representations affect the success or limits of extinction generalization.

Multisensory integration supports configural learning of a home refuge in the whip spider Phrynus marginemaculatus

Whip spiders (Amblypygi) reside in structurally complex habitats and are nocturnally active yet display notable navigational abilities. From the theory that uncertainty in sensory inputs should promote multisensory representations to guide behavior, we hypothesized that their navigation is supported by a multisensory and perhaps configural representation of navigational inputs, an ability documented in a few insects and never reported in arachnids. We trained Phrynus marginemaculatus to recognize a home shelter characterized by both discriminative olfactory and tactile stimuli. In tests, subjects readily discriminated between shelters based on the paired stimuli. However, subjects failed to recognize the shelter in tests with either of the component stimuli alone. This result is consistent with the hypothesis that the terminal phase of their navigational behavior, shelter recognition, can be supported by the integration of multisensory stimuli as an enduring, configural representation. We hypothesize that multisensory learning occurs in the whip spiders' extraordinarily large mushroom bodies, which may functionally resemble the hippocampus of vertebrates.

Odor-Induced Saltiness Enhancement: Insights Into The Brain Chronometry Of Flavor Perception

Flavor perception results from the integration of at least odor and taste. Evidence for such integration is that odors can have taste properties (odor-induced taste). Most brain areas involved in flavor perception are high-level areas; however, primary gustatory and olfactory areas also show activations in response to a combination of odor and taste. While the regions involved in flavor perception are now quite well identified, the network's organization is not yet understood. Using a close to real salty soup model with electroencephalography brain recording, we evaluated whether odor-induced saltiness enhancement would result in differences of amplitude and/or latency in late cognitive P3 peak mostly and/or in P1 early sensory peak. Three target solutions were created from the same base of green-pea soup: i) with a "usual" salt concentration (PPS2), ii) with "reduced" salt (PPS1: -50%), and iii) with reduced salt and a "beef stock" odor (PPS1B). Sensory data showed that the beef odor produced saltiness enhancement in PPS1B in comparison to PPS1. As the main EEG result, the late cognitive P3 peak was delayed by 25 ms in the odor-added solution PPS1B compared to PPS1. The odor alone did not explain this peak amplitude and higher latency in the P3 peak. These results support the classical view that high-level integratory areas process odor-taste interactions with potential top-down effects on primary sensory regions.

Pigeons process actor-action configurations more readily than bystander-action configurations

Behavior requires an actor. Two experiments using complex conditional action discriminations examined whether pigeons privilege information related to the digital actor who is engaged in behavior. In Experiment 1, each of two video displays contained a digital model, one an actor engaged in one of two behaviors (Indian dance or martial arts) and one a neutrally posed bystander. To correctly classify the display, the pigeons needed to conditionally process the action in conjunction with distinctive physical features of the actor or the bystander. Four actor-conditional pigeons learned to correctly discriminate the actions based on the identity of the actors, whereas four bystander-conditional birds failed to learn. Experiment 2 established that this failure was not due to the latter group's inability to spatially integrate information across the distance between the two models. Potentially, the colocalization of the relevant model identity and the action was critical due to a fundamental configural or integral representation of these properties. These findings contribute to our understanding of the evolution of action recognition, the recognition of social behavior, and forms of observational learning by animals.

Facilitation and retardation of flavor preference conditioning following prior exposure to the flavor conditioned stimulus

In two experiments, rats received pairings of an almond flavor (Experiments 1 and 2B) or a vanilla flavor (Experiment 2A) with sucrose. In each experiment, half of the rats received prior exposure to the flavor and half were exposed to water. Conditioned preference was then assessed through two-bottle, flavor versus water, choice tests. Latent inhibition (indicated by a weaker preference in pre-exposed subjects) was observed in the experiment using the vanilla flavor. However, facilitation (a stronger preference in pre-exposed subjects) instead of latent inhibition was evident with the almond flavor, both across acquisition trials and in the final choice test. These results indicate that, unlike most other paradigms of Pavlovian conditioning, conditioned stimulus pre-exposure in flavor preference learning may either facilitate or retard the acquisition (or the expression) of a conditioned flavor preference. We explore the proposal that the critical difference between the flavors lies in their hedonic values, with facilitation being more likely in a flavor that is initially disliked.

Neural Correlates of Causal Confounding

As scientists, we are keenly aware that if putative causes perfectly covary, the independent influence of neither can be discerned-a "no confounding" constraint on inference, fundamental to philosophical and statistical perspectives on causation. Intriguingly, a substantial behavioral literature suggests that naïve human reasoners, adults and children, are tacitly sensitive to causal confounding. Here, a combination of fMRI and computational cognitive modeling was used to investigate neural substrates mediating such sensitivity. While being scanned, participants observed and judged the influences of various putative causes with confounded or nonconfounded, deterministic or stochastic, influences. During judgments requiring generalization of causal knowledge from a feedback-based learning context to a transfer probe, activity in the dorsomedial pFC was better accounted for by a Bayesian causal model, sensitive to both confounding and stochasticity, than a purely error-driven algorithm, sensitive only to stochasticity. Implications for the detection and estimation of distinct forms of uncertainty, and for a neural mediation of domain-general constraints on causal induction, are discussed.

Sign and goal tracker rats process differently the incentive salience of a conditioned stimulus

Sign and goal tracker animals show different behavioral patterns in response to conditioned stimuli, which may be driven by different neural circuits involved in processing stimuli. Here, we explored whether sign and goal-tracker profiles implicated different brain regions and responses to incentive salience of stimuli. We performed three experiments using male Wistar rats. Experiment 1 showed that lesioning the medial prefrontal cortex increased the prevalence of the goal-tracker phenotype. Experiment 2 assessed the developmental trajectory of the salience incentive attribution to a conditioned stimulus, showing that increased incentive salience of stimuli increased the prevalence of the sign-tracker phenotype in mature, but not preadolescent rats. In experiment 3, the functional impact of the medial prefrontal cortex circuits was analyzed with a latent inhibition procedure. Sign tracker rats showed a reduced latent inhibition to stimuli previously exposed when compared to goal tracker or intermediate rats. The overall results of this study highlight a key role of the medial prefrontal cortex for sign tracking behavior. The expression of sign and goal tracker phenotypes changed after lesion to the medial prefrontal cortex (experiment 1), differed across development (experiment 2), and showed differences in the attentional processes to previously exposed stimuli, as preexposure to CS was ineffective in sign tracker animals (experiment 3). These data indicate that the responses to the incentive salience of stimuli in sign tracker and goal tracker profiles are likely driven by different neural circuitry, with a different role of prefrontal cortical function.

Beyond the "Conceptual Nervous System": Can computational cognitive neuroscience transform learning theory?

In the last century, learning theory has been dominated by an approach assuming that associations between hypothetical representational nodes can support the acquisition of knowledge about the environment. The similarities between this approach and connectionism did not go unnoticed to learning theorists, with many of them explicitly adopting a neural network approach in the modeling of learning phenomena. Skinner famously criticized such use of hypothetical neural structures for the explanation of behavior (the "Conceptual Nervous System"), and one aspect of his criticism has proven to be correct: theory underdetermination is a pervasive problem in cognitive modeling in general, and in associationist and connectionist models in particular. That is, models implementing two very different cognitive processes often make the exact same behavioral predictions, meaning that important theoretical questions posed by contrasting the two models remain unanswered. We show through several examples that theory underdetermination is common in the learning theory literature, affecting the solvability of some of the most important theoretical problems that have been posed in the last decades. Computational cognitive neuroscience (CCN) offers a solution to this problem, by including neurobiological constraints in computational models of behavior and cognition. Rather than simply being inspired by neural computation, CCN models are built to reflect as much as possible about the actual neural structures thought to underlie a particular behavior. They go beyond the "Conceptual Nervous System" and offer a true integration of behavioral and neural levels of analysis.

Occasion setting

Occasion setting refers to the ability of 1 stimulus, an occasion setter, to modulate the efficacy of the association between another, conditioned stimulus (CS) and an unconditioned stimulus (US) or reinforcer. Occasion setters and simple CSs are readily distinguished. For example, occasion setters are relatively immune to extinction and counterconditioning, and their combination and transfer functions differ substantially from those of simple CSs. Similarly, the acquisition of occasion setting is favored when stimuli are separated by longer intervals, by empty trace intervals, and are of different modalities, whereas the opposite conditions typically favor the acquisition of simple associations. Furthermore, the simple conditioning and occasion setting properties of a single stimulus can be independent, for example, that stimulus may simultaneously predict the occurrence of a reinforcer and indicate that another stimulus will not be reinforced. Many behavioral phenomena that are intractable to simple associative analysis are better understood within an occasion setting framework. Besides capturing the distinction between direct and modulatory control common to many arenas in neuroscience, occasion setting provides a model for the hierarchical organization of memory for events and event relations, and for contextual control more broadly. Although early lesion studies further differentiated between occasion setting and simple conditioning functions, little is known about the neurobiology of occasion setting. Modern techniques for precise manipulation and monitoring of neuronal activity in multiple brain regions are ideally suited for disentangling contributions of simple conditioning and occasion setting in associative learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Understanding the role of distance, direction and cue salience in an associative model of landmark learning

Navigation and spatial memory relies on the ability to use and recall environmental landmarks relative to important locations. Such learning is thought to result from the strengthening of associations between the goal location and environmental cues. Factors that contribute to the strength of this association include cue stability, saliency and cue location. Here we combine an autoregressive random walk model, that describes goal-directed swimming behaviour, with an associative learning model to provide an integrated model of landmark learning, using the water maze task. The model allows for the contribution of each cue, the salience and the vector information provided (both distance and directional) to be separately analysed. The model suggests that direction and distance information are independent components and can influence searching patterns. Importantly, the model can also be used to simulate various experimental scenarios to understand what has been learnt in relation to the cues, thereby offering new insights into how animals navigate.

Perceptual Generalization and Context in a Network Memory Inspired Long-Term Memory for Artificial Cognition

In the framework of open-ended learning cognitive architectures for robots, this paper deals with the design of a Long-Term Memory (LTM) structure that can accommodate the progressive acquisition of experience-based decision capabilities, or what different authors call "automation" of what is learnt, as a complementary system to more common prospective functions. The LTM proposed here provides for a relational storage of knowledge nuggets given the form of artificial neural networks (ANNs) that is representative of the contexts in which they are relevant in a configural associative structure. It also addresses the problem of continuous perceptual spaces and the task- and context-related generalization or categorization of perceptions in an autonomous manner within the embodied sensorimotor apparatus of the robot. These issues are analyzed and a solution is proposed through the introduction of two new types of knowledge nuggets: P-nodes representing perceptual classes and C-nodes representing contexts. The approach is studied and its performance evaluated through its implementation and application to a real robotic experiment.

Configural learning: a higher form of learning in Lymnaea

Events typically occur in a specific context and the ability to assign importance to this occurrence plays a significant role in memory formation and recall. When the scent of a crayfish predator (CE) is encountered in Lymnaea strains known to be predator-experienced (e.g. the W-strain), enhancement of memory formation and depression of feeding occurs, which are part of a suite of anti-predator behaviours. We hypothesized that Lymnaea possess a form of higher-order conditioning, namely configural learning. We tested this by simultaneously exposing W-strain Lymnaea to a carrot food-odour (CO) and predator scent (CE). Two hours later we operantly conditioned these snails with a single 0.5h training session in CO to determine whether training in CO results in long-term memory (LTM). In W-strain snails two 0.5h training sessions are required to cause LTM formation. A series of control experiments followed and demonstrated that only the CO+CE snails trained in CO had acquired enhanced memory forming ability. Additionally, following CE+CO pairing, CO no longer elicited an increased feeding response. Hence, snails have the ability to undergo configural learning. Following configural learning, CO becomes risk-signaling and evokes behavioural responses phenotypically similar to those elicited by exposure to CE.

Cue Competition and Incidental Learning: No Blocking or Overshadowing in the Colour-Word Contingency Learning Procedure Without Instructions to Learn

Overshadowing and blocking are two important findings that are frequently used to constrain models of associative learning. Overshadowing is the finding that learning about a cue (referred to as X) is reduced when that cue is always accompanied by a second cue (referred to as A) during the learning phase (AX). Blocking is the finding that after learning a stimulus-outcome relation for one stimulus (A), learning about a second stimulus (X) is reduced when the second stimulus is always accompanied by the first stimulus (AX). It remains unclear whether overshadowing and blocking result from explicit decision processes (e.g., “I know that A predicts the outcome, so I am not sure whether X does, too”), or whether cue competition is built directly into low-level association formation processes. In that vein, the present work examined whether overshadowing and/or blocking are present in an incidental learning procedure, where the predictive stimuli (words or shapes) are irrelevant to the cover task and merely correlated with the task-relevant stimulus dimension (colour). In two large online studies, we observed no evidence for overshadowing or blocking in this setup: (a) no evidence for an overshadowing cost was observed with compound (word-shape) cues relative to single cue learning conditions, and (b) contingency learning effects for blocked stimuli did not differ from those for blocking stimuli. However, when participants were given the explicit instructions to learn contingencies, evidence for blocking and overshadowing was observed. Together, these results suggest that contingencies of blocked/overshadowed stimuli are learned incidentally, but are suppressed by explicit decision processes due to knowledge of the contingencies for the blocking/overshadowing stimuli.

Testing analogical rule transfer in pigeons (Columba livia)

Categorization is an essential cognitive process useful for transferring knowledge from previous experience to novel situations. The mechanisms by which trained categorization behavior extends to novel stimuli, especially in animals, are insufficiently understood. To understand how pigeons learn and transfer category membership, seven pigeons were trained to classify controlled, bi-dimensional stimuli in a two-alternative forced-choice task. Following either dimensional, rule-based (RB) or information integration (II) training, tests were conducted focusing on the "analogical" extension of the learned discrimination to novel regions of the stimulus space (Casale, Roeder, & Ashby, 2012). The pigeons' results mirrored those from human and non-human primates evaluated using the same analogical task structure, training and testing: the pigeons transferred their discriminative behavior to the new extended values following RB training, but not after II training. Further experiments evaluating rule-based models and association-based models suggested the pigeons use dimensions and associations to learn the task and mediate transfer to stimuli within the novel region of the parametric stimulus space.

The discrimination of magnitude: A review and theoretical analysis

In a discrimination based on magnitude, the same stimulus is presented at two different magnitudes and an outcome, such as food, is signalled by one magnitude but not the other. The review presented in the first part of the article shows that, in general, such a discrimination is acquired more readily when the outcome is signalled by the larger rather than the smaller of the two magnitudes. This asymmetry is observed with magnitudes based on sound, odour, temporal duration, quantity, and physical length. The second part of the article, explores the implications of this pattern of results for the theory of discrimination learning presented by Pearce (1994). The asymmetry found with discriminations based on magnitude contradicts predictions derived from the original version of the theory, but it can be explained by a modified version. The asymmetry also has important implications for understanding how animals represent magnitudes.

Delay-Induced Super-Latent Inhibition as a Function of Order of Exposure to Two Flavours Prior to Compound Conditioning

A number of recent conditioned taste aversion (CTA) experiments have demonstrated a super-latent inhibition (LI) effect—namely, a time-induced increase in the effects of stimulus preexposure when the interval between acquisition and test is spent in a context that is different from the other experimental contexts. Two CTA experiments with rats were conducted to examine the role of primacy in producing super-LI. In Experiment 1, one of two flavours was pre-exposed, following which a second flavour was preexposed. After the second preexposure, animals were conditioned by pairing a compound of the two preexposed flavours with LiCl. The test stage was conducted 1 or 21 days after conditioning, with the interval being spent in either the same or different contexts. In the test, animals were confronted with two bottles, each with one of the two preexposed flavours. Super-LI was obtained only for the first preexposed flavour in the 21-day delay group that spent the interval in a different context. Experiment 2 was designed to ensure that the effects in Experiment 1 represented LI, and to control for order of presentation of the flavours and time between preexposure and acquisition. The results replicated those of Experiment 1. The two experiments support the importance of primacy in the general super-LI experiment where CS-alone preexposure precedes CS–US.

Second-order conditioning in human predictive judgements when there is little time to think

Associative accounts uniquely predict that second-order conditioning might be observed in human predictive judgements. Such an effect was found for cue X in two experiments in which participants were required to predict the outcomes of a series of training trials that included P + and PX−, but only when training was paced by requiring participants to make a prediction within 3 s on each trial. In Experiment 1 training on P + ended before training was given on PX − . In Experiment 2 trials with P+, PX−, T + and other cues were intermixed. In the unpaced group inhibitory learning was revealed by a summation test, TX versus TM, where M was a control stimulus. These results suggest either that pacing interferes with learning successive associations more than with learning simultaneous associations or that lack of time to think interferes with inferential processes required for this type of inhibitory learning.

NEURAL Networks and Consumer Behavior: NEURAL Models, Logistic Regression, and the Behavioral Perspective Model

This paper investigates the ability of connectionist models to explain consumer behavior, focusing on the feedforward neural network model, and explores the possibility of expanding the theoretical framework of the Behavioral Perspective Model to incorporate connectionist constructs. Numerous neural network models of varying complexity are developed to predict consumer loyalty as a crucial aspect of consumer behavior. Their performance is compared with the more traditional logistic regression model and it is found that neural networks offer consistent advantage over logistic regression in the prediction of consumer loyalty. Independently determined Utilitarian and Informational Reinforcement variables are shown to make a noticeable contribution to the explanation of consumer choice. The potential of connectionist models for predicting and explaining consumer behavior is discussed and routes for future research are suggested to investigate the predictive and explanatory capacity of connectionist models, such as neural network models, and for the integration of these into consumer behavior analysis within the theoretical framework of the Behavioral Perspective Model.

Three Ways That Non-associative Knowledge May Affect Associative Learning Processes

Associative learning theories offer one account of the way animals and humans assess the relationship between events and adapt their behavior according to resulting expectations. They assume knowledge about event relations is represented in associative networks, which consist of mental representations of cues and outcomes and the associative links that connect them. However, in human causal and contingency learning, many researchers have found that variance in standard learning effects is controlled by "non-associative" factors that are not easily captured by associative models. This has given rise to accounts of learning based on higher-order cognitive processes, some of which reject altogether the notion that humans learn in the manner described by associative networks. Despite the renewed focus on this debate in recent years, few efforts have been made to consider how the operations of associative networks and other cognitive operations could potentially interact in the course of learning. This paper thus explores possible ways in which non-associative knowledge may affect associative learning processes: (1) via changes to stimulus representations, (2) via changes to the translation of the associative expectation into behavior (3) via a shared source of expectation of the outcome that is sensitive to both the strength of associative retrieval and evaluation from non-associative influences.

Latent inhibition in flavor-preference conditioning: effects of motivational state and the nature of the reinforcer

In two experiments, rats received pairings of the flavor of almond with either fructose or maltodextrin, and the conditioned preference for almond was then tested. In each experiment, half of the rats had received prior exposure to almond on its own, and half had received no preexposure. In Experiment 1, in which the rats were hungry during the test, the preference was greater in the nonpreexposed subjects, both for those trained with fructose and those trained with maltodextrin; that is, latent inhibition was obtained with both reinforcers. In Experiment 2, in which the rats were not food deprived prior to the test, not only was there no latent inhibition with either of the reinforcers, but, for both, the preference was greater for preexposed than for nonpreexposed subjects. These results give no support to the proposal that different types of reinforcer generate different types of learning. They are, however, consistent with the proposal that different types of learning control behavior when a rat is hungry and when it is not, and that the form that generates the preference in the latter case is not susceptible to the latent inhibition effect.

Emergence of Intraverbal Responding Following Tact Instruction with Compound Stimuli

Effective intraverbal responding often requires control by multiple elements of a verbal stimulus. The purpose of this study was to examine the emergence of such intraverbal relations following tact instruction with compound stimuli and to analyze any resulting error patterns. Participants were seven typically developing children between 3 and 5 years of age. After being taught to tact four overlapping compound stimuli that differed along color and shape dimensions, participants were tested for emergent intraverbal responding. Three participants performed with high accuracy and four with intermediate accuracy when correct intraverbal responding required control by multiple elements (i.e., color names and shape names) of the verbal stimulus. Five participants performed with high accuracy when intraverbal responding required control by only a single stimulus element, and all participants showed emergence of reverse intraverbal relations when the response required naming only a single stimulus element (i.e., color or shape). There was an insufficient number of errors to perform detailed error analyses at the individual level, but overall, the first element of a verbal stimulus was more likely to exert control over the response than the second element, and color words were more likely to exert control than shape words. Results suggest that individual stimulus elements acquired independent control over the responses that had been established as tacts.

Evaluation of a Blocked-Trials Procedure to Establish Complex Stimulus Control over Intraverbal Responses in Children with Autism

We evaluated the use of a blocked-trials procedure to establish complex stimulus control over intraverbal responses. The participants were four young boys with a diagnosis of autism who had struggled to master intraverbals. The blocked-trials procedures involved presentation of stimuli in separate trial blocks. The trial blocks gradually reduced in size contingent upon correct responding, until the stimuli were presented in quasi-random order. All participants acquired multiple discriminations with the blocked-trials procedure, although additional procedures were needed to teach the first discrimination with two participants. Following acquisition of multiple discriminations, two participants acquired a novel discrimination with quasi-random presentation of stimuli, and a third participant demonstrated discriminated responding in intraverbal probes.

Role of hippocampus in polymodal-cue guided tasks in rats

To examine how signals from different sensory modalities are integrated to generate an appropriate goal-oriented behavior, we trained rats in an eight-arm radial maze to visit a cue arm provided with intramaze cues from different sensory modalities, i.e. visual, tactile and auditory, in order to obtain a reward. When the same rats were then examined on test trials in which the cue arm contained one of the stimuli that the animals were trained with (i.e. light, sound or rough sheet), they showed a significant impairment with respect to the performance on the polymodal-cue task. The contribution of the dorsal hippocampus to the acquisition and retention of polymodal-cue guided task was also examined. We found that rats with dorsal hippocampal lesions before training showed a significant deficit in the acquisition of polymodal-cue oriented task that improved with overtraining. The selective lesion of the dorsal hippocampus after training disrupted memory retention, but the animals' performance improved following retraining of the polymodal task. All hippocampal lesioned rats displayed an impaired performance on the unimodal test. These findings suggest that the dorsal hippocampus contributes to the processing of multimodal sensory information for the associative memory formation and consolidation.

Uncertainty and predictiveness determine attention to cues during human associative learning

Prior research has suggested that attention is determined by exploiting what is known about the most valid predictors of outcomes and exploring those stimuli that are associated with the greatest degree of uncertainty about subsequent events. Previous studies of human contingency learning have revealed evidence for one or other of these processes, but differences in the designs and procedures of these studies make it difficult to pinpoint the crucial determinant of whether attentional exploitation or exploration will dominate. Here we present two studies in which we systematically manipulated both the predictiveness of cues and uncertainty regarding the outcomes with which they were associated. This allowed us to demonstrate, for the first time, evidence of both attentional exploration and exploitation within the same experiment. Moreover, while the effect of predictiveness persisted to influence the rate of novel learning about the same cues in a second stage, the effect of uncertainty did not. This suggests that attentional exploration is more sensitive to a change of context than is exploitation. The pattern of data is simulated with a hybrid attentional model.