1
|
The molecular memory code and synaptic plasticity: A synthesis. Biosystems 2023; 224:104825. [PMID: 36610586 DOI: 10.1016/j.biosystems.2022.104825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 12/29/2022] [Accepted: 12/30/2022] [Indexed: 01/06/2023]
Abstract
The most widely accepted view of memory in the brain holds that synapses are the storage sites of memory, and that memories are formed through associative modification of synapses. This view has been challenged on conceptual and empirical grounds. As an alternative, it has been proposed that molecules within the cell body are the storage sites of memory, and that memories are formed through biochemical operations on these molecules. This paper proposes a synthesis of these two views, grounded in a computational model of memory. Synapses are conceived as storage sites for the parameters of an approximate posterior probability distribution over latent causes. Intracellular molecules are conceived as storage sites for the parameters of a generative model. The model stipulates how these two components work together as part of an integrated algorithm for learning and inference.
Collapse
|
2
|
Bouchekioua Y, Kosaki Y, Watanabe S, Blaisdell AP. Higher-Order Conditioning in the Spatial Domain. Front Behav Neurosci 2021; 15:766767. [PMID: 34887735 PMCID: PMC8650001 DOI: 10.3389/fnbeh.2021.766767] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Accepted: 10/25/2021] [Indexed: 11/25/2022] Open
Abstract
Spatial learning and memory, the processes through which a wide range of living organisms encode, compute, and retrieve information from their environment to perform goal-directed navigation, has been systematically investigated since the early twentieth century to unravel behavioral and neural mechanisms of learning and memory. Early theories about learning to navigate space considered that animals learn through trial and error and develop responses to stimuli that guide them to a goal place. According to a trial-and error learning view, organisms can learn a sequence of motor actions that lead to a goal place, a strategy referred to as response learning, which contrasts with place learning where animals learn locations with respect to an allocentric framework. Place learning has been proposed to produce a mental representation of the environment and the cartesian relations between stimuli within it-which Tolman coined the cognitive map. We propose to revisit some of the best empirical evidence of spatial inference in animals, and then discuss recent attempts to account for spatial inferences within an associative framework as opposed to the traditional cognitive map framework. We will first show how higher-order conditioning can successfully account for inferential goal-directed navigation in a variety of situations and then how vectors derived from path integration can be integrated via higher-order conditioning, resulting in the generation of higher-order vectors that explain novel route taking. Finally, implications to cognitive map theories will be discussed.
Collapse
Affiliation(s)
- Youcef Bouchekioua
- Department of Neuropharmacology, Graduate School of Medicine, Hokkaido University, Sapporo, Japan
| | - Yutaka Kosaki
- Department of Psychology, Waseda University, Tokyo, Japan
| | | | - Aaron P. Blaisdell
- Department of Psychology and Brain Research Institute, University of California, Los Angeles, Los Angeles, CA, United States
| |
Collapse
|
3
|
Seitz BM, Blaisdell AP, Sharpe MJ. Higher-Order Conditioning and Dopamine: Charting a Path Forward. Front Behav Neurosci 2021; 15:745388. [PMID: 34671247 PMCID: PMC8520911 DOI: 10.3389/fnbeh.2021.745388] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Accepted: 09/06/2021] [Indexed: 11/16/2022] Open
Abstract
Higher-order conditioning involves learning causal links between multiple events, which then allows one to make novel inferences. For example, observing a correlation between two events (e.g., a neighbor wearing a particular sports jersey), later helps one make new predictions based on this knowledge (e.g., the neighbor's wife's favorite sports team). This type of learning is important because it allows one to benefit maximally from previous experiences and perform adaptively in complex environments where many things are ambiguous or uncertain. Two procedures in the lab are often used to probe this kind of learning, second-order conditioning (SOC) and sensory preconditioning (SPC). In second-order conditioning (SOC), we first teach subjects that there is a relationship between a stimulus and an outcome (e.g., a tone that predicts food). Then, an additional stimulus is taught to precede the predictive stimulus (e.g., a light leads to the food-predictive tone). In sensory preconditioning (SPC), this order of training is reversed. Specifically, the two neutral stimuli (i.e., light and tone) are first paired together and then the tone is paired separately with food. Interestingly, in both SPC and SOC, humans, rodents, and even insects, and other invertebrates will later predict that both the light and tone are likely to lead to food, even though they only experienced the tone directly paired with food. While these processes are procedurally similar, a wealth of research suggests they are associatively and neurobiologically distinct. However, midbrain dopamine, a neurotransmitter long thought to facilitate basic Pavlovian conditioning in a relatively simplistic manner, appears critical for both SOC and SPC. These findings suggest dopamine may contribute to learning in ways that transcend differences in associative and neurological structure. We discuss how research demonstrating that dopamine is critical to both SOC and SPC places it at the center of more complex forms of cognition (e.g., spatial navigation and causal reasoning). Further, we suggest that these more sophisticated learning procedures, coupled with recent advances in recording and manipulating dopamine neurons, represent a new path forward in understanding dopamine's contribution to learning and cognition.
Collapse
Affiliation(s)
- Benjamin M Seitz
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, United States
| | - Aaron P Blaisdell
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, United States
| | - Melissa J Sharpe
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, United States
| |
Collapse
|
4
|
Buckley MG, Austen JM, Myles LAM, Smith S, Ihssen N, Lew AR, McGregor A. The effects of spatial stability and cue type on spatial learning: Implications for theories of parallel memory systems. Cognition 2021; 214:104802. [PMID: 34225248 DOI: 10.1016/j.cognition.2021.104802] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Revised: 05/25/2021] [Accepted: 06/03/2021] [Indexed: 11/30/2022]
Abstract
Some theories of spatial learning predict that associative rules apply under only limited circumstances. For example, learning based on a boundary has been claimed to be immune to cue competition effects because boundary information is the basis for the formation of a cognitive map, whilst landmark learning does not involve cognitive mapping. This is referred to as the cue type hypothesis. However, it has also been claimed that cue stability is a prerequisite for the formation of a cognitive map, meaning that whichever cue type was perceived as stable would enter a cognitive map and thus be immune to cue competition, while unstable cues will be subject to cue competition, regardless of cue type. In experiments 1 and 2 we manipulated the stability of boundary and landmark cues when learning the location of two hidden goals. One goal location was constant with respect to the boundary, and the other constant with respect to the landmark cues. For both cue types, the presence of distal orientation cues provided directional information. For half the participants the landmark cues were unstable relative to the boundary and orientation cues, whereas for the remainder of the participants the boundary was unstable relative to landmarks and orientation cues. In a second stage of training, all cues remained stable so that both goal locations could be learned with respect to both landmark and boundary information. According to the cue type hypothesis, boundary information should block learning about landmarks regardless of cue stability. According to the cue stability hypothesis, however, landmarks should block learning about the boundary when the landmarks appear stable relative to the boundary. Regardless of cue type or stability the results showed reciprocal blocking, contrary to both formulations of incidental cognitive mapping. Experiment 3 established that the results of Experiments 1 and 2 could not be explained in terms of difficulty in learning certain locations with respect to different cue types. In a final experiment, following training in which both landmarks and boundary cues signalled two goal locations, a new goal location was established with respect to the landmark cues, before testing with the boundary, which had never been used to define the new goal location. The results of this novel test of the interaction between boundary and landmark cues indicated that new learning with respect to the landmark had a profound effect on navigation with respect to the boundary, counter to the predictions of incidental cognitive mapping of boundaries.
Collapse
Affiliation(s)
- Matthew G Buckley
- Department of Psychology, Durham University, UK; School of Psychology, Aston University, UK.
| | | | | | - Shamus Smith
- School of Electrical Engineering and Computing, University of Newcastle, Australia
| | | | - Adina R Lew
- Department of Psychology, Lancaster University, UK
| | | |
Collapse
|
5
|
Chandran M, Thorwart A. Time in Associative Learning: A Review on Temporal Maps. Front Hum Neurosci 2021; 15:617943. [PMID: 33889079 PMCID: PMC8055836 DOI: 10.3389/fnhum.2021.617943] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Accepted: 03/09/2021] [Indexed: 11/16/2022] Open
Abstract
Ability to recall the timing of events is a crucial aspect of associative learning. Yet, traditional theories of associative learning have often overlooked the role of time in learning association and shaping the behavioral outcome. They address temporal learning as an independent and parallel process. Temporal Coding Hypothesis is an attempt to bringing together the associative and non-associative aspects of learning. This account proposes temporal maps, a representation that encodes several aspects of a learned association, but attach considerable importance to the temporal aspect. A temporal map helps an agent to make inferences about missing information by applying an integration mechanism over a common element present in independently acquired temporal maps. We review the empirical evidence demonstrating the construct of temporal maps and discuss the importance of this concept in clinical and behavioral interventions.
Collapse
Affiliation(s)
- Midhula Chandran
- Department of Psychology, Philipps-Universität Marburg, Marburg, Germany
| | | |
Collapse
|
6
|
Seitz BM, McCune K, MacPherson M, Bergeron L, Blaisdell AP, Logan CJ. Using touchscreen equipped operant chambers to study animal cognition. Benefits, limitations, and advice. PLoS One 2021; 16:e0246446. [PMID: 33606723 PMCID: PMC7894864 DOI: 10.1371/journal.pone.0246446] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Accepted: 01/19/2021] [Indexed: 12/13/2022] Open
Abstract
Operant chambers are small enclosures used to test animal behavior and cognition. While traditionally reliant on simple technologies for presenting stimuli (e.g., lights and sounds) and recording responses made to basic manipulanda (e.g., levers and buttons), an increasing number of researchers are beginning to use Touchscreen-equipped Operant Chambers (TOCs). These TOCs have obvious advantages, namely by allowing researchers to present a near infinite number of visual stimuli as well as increased flexibility in the types of responses that can be made and recorded. We trained wild-caught adult and juvenile great-tailed grackles (Quiscalus mexicanus) to complete experiments using a TOC. We learned much from these efforts, and outline the advantages and disadvantages of our protocols. Our training data are summarized to quantify the variables that might influence participation and success, and we discuss important modifications to facilitate animal engagement and participation in various tasks. Finally, we provide a “training guide” for creating experiments using PsychoPy, a free and open-source software that was incredibly useful during these endeavors. This article, therefore, should serve as a resource to those interested in switching to or maintaining a TOC, or who similarly wish to use a TOC to test the cognitive abilities of non-model species or wild-caught individuals.
Collapse
Affiliation(s)
- Benjamin M. Seitz
- University of California, Los Angeles, Los Angeles, California, United States of America
- * E-mail: (BMS); (CJL)
| | - Kelsey McCune
- University of California, Santa Barbara, Santa Barbara, California, United States of America
| | - Maggie MacPherson
- University of California, Santa Barbara, Santa Barbara, California, United States of America
| | - Luisa Bergeron
- University of California, Santa Barbara, Santa Barbara, California, United States of America
| | - Aaron P. Blaisdell
- University of California, Los Angeles, Los Angeles, California, United States of America
| | - Corina J. Logan
- Max Planck Institute for Evolutionary Anthropology, Leipzig, Germany
- * E-mail: (BMS); (CJL)
| |
Collapse
|
7
|
Bouchekioua Y, Blaisdell AP, Kosaki Y, Tsutsui-Kimura I, Craddock P, Mimura M, Watanabe S. Spatial inference without a cognitive map: the role of higher-order path integration. Biol Rev Camb Philos Soc 2020; 96:52-65. [PMID: 32939978 DOI: 10.1111/brv.12645] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2020] [Revised: 08/12/2020] [Accepted: 08/17/2020] [Indexed: 11/28/2022]
Abstract
The cognitive map has been taken as the standard model for how agents infer the most efficient route to a goal location. Alternatively, path integration - maintaining a homing vector during navigation - constitutes a primitive and presumably less-flexible strategy than cognitive mapping because path integration relies primarily on vestibular stimuli and pace counting. The historical debate as to whether complex spatial navigation is ruled by associative learning or cognitive map mechanisms has been challenged by experimental difficulties in successfully neutralizing path integration. To our knowledge, there are only three studies that have succeeded in resolving this issue, all showing clear evidence of novel route taking, a behaviour outside the scope of traditional associative learning accounts. Nevertheless, there is no mechanistic explanation as to how animals perform novel route taking. We propose here a new model of spatial learning that combines path integration with higher-order associative learning, and demonstrate how it can account for novel route taking without a cognitive map, thus resolving this long-standing debate. We show how our higher-order path integration (HOPI) model can explain spatial inferences, such as novel detours and shortcuts. Our analysis suggests that a phylogenetically ancient, vector-based navigational strategy utilizing associative processes is powerful enough to support complex spatial inferences.
Collapse
Affiliation(s)
- Youcef Bouchekioua
- Department of Psychology, Keio University, Tokyo, 108-8345, Japan.,Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, 160-8582, Japan
| | - Aaron P Blaisdell
- Department of Psychology & Brain Research Institute, University of California, Los Angeles, CA, 90095-1563, U.S.A
| | - Yutaka Kosaki
- Department of Psychology, Waseda University, Tokyo, 162-8644, Japan
| | - Iku Tsutsui-Kimura
- Center for Brain Science, Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, 02138, USA
| | - Paul Craddock
- Department of Psychology, University of Lille, Villeneuve d'Ascq, 59653, France
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, 160-8582, Japan
| | - Shigeru Watanabe
- Department of Psychology, Keio University, Tokyo, 108-8345, Japan
| |
Collapse
|
8
|
Kosaki Y, Pearce JM, McGregor A. The response strategy and the place strategy in a plus-maze have different sensitivities to devaluation of expected outcome. Hippocampus 2018; 28:484-496. [PMID: 29637657 PMCID: PMC6055719 DOI: 10.1002/hipo.22847] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2016] [Revised: 03/03/2018] [Accepted: 04/04/2018] [Indexed: 11/17/2022]
Abstract
Previous studies have suggested that spatial navigation can be achieved with at least two distinct learning processes, involving either cognitive map‐like representations of the local environment, referred to as the “place strategy”, or simple stimulus‐response (S‐R) associations, the “response strategy”. A similar distinction between cognitive/behavioral processes has been made in the context of non‐spatial, instrumental conditioning, with the definition of two processes concerning the sensitivity of a given behavior to the expected value of its outcome as well as to the response‐outcome contingency (“goal‐directed action” and “S‐R habit”). Here we investigated whether these two versions of dichotomist definitions of learned behavior, one spatial and the other non‐spatial, correspond to each other in a formal way. Specifically, we assessed the goal‐directed nature of two navigational strategies, using a combination of an outcome devaluation procedure and a spatial probe trial frequently used to dissociate the two navigational strategies. In Experiment 1, rats trained in a dual‐solution T‐maze task were subjected to an extinction probe trial from the opposite start arm, with or without prefeeding‐induced devaluation of the expected outcome. We found that a non‐significant preference for the place strategy in the non‐devalued condition was completely reversed after devaluation, such that significantly more animals displayed the use of the response strategy. The result suggests that the place strategy is sensitive to the expected value of the outcome, while the response strategy is not. In Experiment 2, rats with hippocampal lesions showed significant reliance on the response strategy, regardless of whether the expected outcome was devalued or not. The result thus offers further evidence that the response strategy conforms to the definition of an outcome‐insensitive, habitual form of instrumental behavior. These results together attest a formal correspondence between two types of dual‐process accounts of animal learning and behavior.
Collapse
Affiliation(s)
- Yutaka Kosaki
- Department of Psychology, Durham University, Durham DH1 3LE, United Kingdom.,School of Psychology, Cardiff University, Cardiff CF10 3AT, United Kingdom.,Department of Psychology, Waseda University, Shinjuku, Tokyo 162-8644, Japan
| | - John M Pearce
- School of Psychology, Cardiff University, Cardiff CF10 3AT, United Kingdom
| | - Anthony McGregor
- Department of Psychology, Durham University, Durham DH1 3LE, United Kingdom
| |
Collapse
|
9
|
Blaisdell AP, Schroeder JE, Fast CD. Spatial integration during performance in pigeons. Behav Processes 2017; 154:73-80. [PMID: 29274761 DOI: 10.1016/j.beproc.2017.12.012] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2017] [Revised: 12/14/2017] [Accepted: 12/17/2017] [Indexed: 10/18/2022]
Abstract
We've shown that pigeons can integrate separately acquired spatial maps into a cognitive map. Integration requires an element shared between maps. In two experiments using a spatial-search task in pigeons, we test spatial combination rules when no shared element was present during training. In all three experiments, pigeons first learned individual landmark-target maps. In subsequent tests involving combinations of landmarks, we found evidence that landmarks collaborate in guiding spatial choice at test (Experiment 1). In Experiment 2, pigeons were trained on two landmarks with different proximities to the target. On tests on a compound of both landmarks, pigeons showed stronger spatial control by the more proximal landmark, a performance overshadowing effect. Extinction of the proximal landmark shifted spatial control to the non-extinguished distal landmark. This reveals that the performance overshadowing effect was associative in nature, and not due to perceptual or spatial biases. This emphasis on spatial control during performance reflects the emphasis on performance processes that were a major focus in Ralph Miller's lab.
Collapse
Affiliation(s)
- Aaron P Blaisdell
- Department of Psychology, University of California, Los Angeles, CA, USA.
| | - Julia E Schroeder
- Department of Psychology, University of California, Los Angeles, CA, USA
| | | |
Collapse
|
10
|
Hébert M, Bulla J, Vivien D, Agin V. Are Distal and Proximal Visual Cues Equally Important during Spatial Learning in Mice? A Pilot Study of Overshadowing in the Spatial Domain. Front Behav Neurosci 2017. [PMID: 28634446 PMCID: PMC5459897 DOI: 10.3389/fnbeh.2017.00109] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Animals use distal and proximal visual cues to accurately navigate in their environment, with the possibility of the occurrence of associative mechanisms such as cue competition as previously reported in honey-bees, rats, birds and humans. In this pilot study, we investigated one of the most common forms of cue competition, namely the overshadowing effect, between visual landmarks during spatial learning in mice. To this end, C57BL/6J × Sv129 mice were given a two-trial place recognition task in a T-maze, based on a novelty free-choice exploration paradigm previously developed to study spatial memory in rodents. As this procedure implies the use of different aspects of the environment to navigate (i.e., mice can perceive from each arm of the maze), we manipulated the distal and proximal visual landmarks during both the acquisition and retrieval phases. Our prospective findings provide a first set of clues in favor of the occurrence of an overshadowing between visual cues during a spatial learning task in mice when both types of cues are of the same modality but at varying distances from the goal. In addition, the observed overshadowing seems to be non-reciprocal, as distal visual cues tend to overshadow the proximal ones when competition occurs, but not vice versa. The results of the present study offer a first insight about the occurrence of associative mechanisms during spatial learning in mice, and may open the way to promising new investigations in this area of research. Furthermore, the methodology used in this study brings a new, useful and easy-to-use tool for the investigation of perceptive, cognitive and/or attentional deficits in rodents.
Collapse
Affiliation(s)
- Marie Hébert
- Normandie Université, UNICAEN, INSERM, Physiopathology and Imaging of Neurological DisordersCaen, France.,Center for Mind/Brain Sciences, University of TrentoRovereto, Italy
| | - Jan Bulla
- Department of Mathematics, University of BergenBergen, Norway
| | - Denis Vivien
- Normandie Université, UNICAEN, INSERM, Physiopathology and Imaging of Neurological DisordersCaen, France.,CHU Caen, Clinical Research Department, CHU Caen Côte de Nacre, UNICAENCaen, France
| | - Véronique Agin
- Normandie Université, UNICAEN, INSERM, Physiopathology and Imaging of Neurological DisordersCaen, France
| |
Collapse
|
11
|
Leising KJ, Wong J, Blaisdell AP. Extinction and spontaneous recovery of spatial behavior in pigeons. JOURNAL OF EXPERIMENTAL PSYCHOLOGY. ANIMAL LEARNING AND COGNITION 2015; 41:371-7. [PMID: 26437383 PMCID: PMC4598953 DOI: 10.1037/xan0000076] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We investigated extinction and spontaneous recovery of spatial associations using a landmark-based appetitive search task in a touchscreen preparation with pigeons. Four visual landmarks (A, B, C, and D) were separately established as signals of a hidden reinforced target among an 8 × 7 array of potential target locations. The target was located above landmarks (LM) A and C and below B and D. After conditioning, A and B were extinguished. Responding to A and C was assessed on probe tests 2 days following extinction, whereas, B and D were tested 14 days after extinction. We observed spontaneous recovery from spatial extinction following a 14-day, but not a 2-day, postextinction retention interval. Furthermore, by plotting the spatial distribution of responding across the X and Y axes during testing, we found that spontaneous recovery of responding to the target in our task was due to enhanced spatial control (i.e., a change in the overall distribution of responses) following the long delay to testing. These results add spatial extinction and spontaneous recovery to the list of findings supporting the assertion that extinction involves new learning that attenuates the originally acquired response, and that original learning of the spatial relationship between paired events survives extinction. (PsycINFO Database Record
Collapse
|
12
|
Sawa K, Kurihara A. The effect of temporal information among events on Bayesian causal inference in rats. Front Psychol 2014; 5:1142. [PMID: 25339935 PMCID: PMC4189418 DOI: 10.3389/fpsyg.2014.01142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2014] [Accepted: 09/19/2014] [Indexed: 11/23/2022] Open
Abstract
A temporal relationship between events of potential cause and effect is critical to generate a causal relationship because the cause has to be followed by the effect. The present study investigated the role of temporal relationships between events in causal inference in rats via Pavlovian pairings. In Experiment 1A, subjects in Group Successive received training trials whereby Event 1 (tone or light) was followed by Events 2 (light or tone) and 3 (sucrose solution), whereas those in Group Simultaneous received simultaneous pairings of Events 1 and 2, and Events 1 and 3. During testing, a lever was inserted into the experimental chamber, where subjects were allowed to press the lever which produced the occurrence of Event 2 without reward. By measuring nose-poke responses during the presentation of Event 2, assumingly based on the prediction of occurrence of sucrose solution, subjects in Group Successive showed a relatively lower response rate than did those in Group Simultaneous. In Experiment 1B, this difference was not observed if subjects received the presentations of Event 2 which was irrelevant to their lever pressing during testing. These results suggest that rats can differentiate their response based on the elemental temporal information even when the integrated temporal map was the same, and implied that rats use temporal information as well as conditional probability based on causal Bayesian network account.
Collapse
Affiliation(s)
- Kosuke Sawa
- Department of Psychology, Senshu University Kawasaki, Japan
| | - Akira Kurihara
- Department of Psychology, Senshu University Kawasaki, Japan
| |
Collapse
|
13
|
Abstract
During feature-positive operant discriminations, a conditional cue, X, signals whether responses made during a second stimulus, A, are reinforced. Few studies have examined how landmarks, which can be trained to control the spatial distribution of responses during search tasks, might operate under conditional control. We trained college students to search for a target hidden on a computer monitor. Participants learned that responses to a hidden target location signaled by a landmark (e.g., A) would be reinforced only if the landmark was preceded by a colored background display (e.g., X). In Experiment 1, participants received feature-positive training (+←YB/ XA→+/A-/B-) with the hidden target to the right of A and to left of B. Responding during nonreinforced transfer test trials (XB-/YA-) indicated conditional control by the colored background, and spatial accuracy indicated a greater weighting of spatial information provided by the landmark than by the conditional cue. In Experiments 2a and 2b, the location of the target relative to landmark A was conditional on the colored background (+←YA/ XA→+/ ZB→+/ +←C /A-/B-). At test, conditional control and a greater weighting for the landmark's spatial information were again found, but we also report evidence for spatial interference by the conditional stimulus. Overall, we found that hierarchical accounts best explain the observed differences in response magnitude, whereas spatial accuracy was best explained via spatial learning models that emphasize the reliability, stability, and proximity of landmarks to a target.
Collapse
|
14
|
Molet M, Miller RR. Timing: an attribute of associative learning. Behav Processes 2014; 101:4-14. [PMID: 23751257 PMCID: PMC3823740 DOI: 10.1016/j.beproc.2013.05.015] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2013] [Revised: 05/06/2013] [Accepted: 05/30/2013] [Indexed: 10/26/2022]
Abstract
The evidence reviewed in this paper suggests that when two events occur in spatiotemporal proximity to one another, an association between the two events is formed which encodes the timing of the events in relation to one another (including duration, order, and interval). The primary evidence supporting the view that temporal relationships are encoded is that subsequent presentation of one event ordinarily elicits behavior indicative of an expectation of the other event at a specific time. Thus, temporal relationships appear to be one of several attributes encoded at acquisition.
Collapse
|
15
|
Bouchekioua Y, Miller HC, Craddock P, Blaisdell AP, Molet M. Spatial integration of boundaries in a 3D virtual environment. Acta Psychol (Amst) 2013; 144:316-23. [PMID: 23933001 DOI: 10.1016/j.actpsy.2013.06.015] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2013] [Revised: 05/09/2013] [Accepted: 06/23/2013] [Indexed: 11/15/2022] Open
Abstract
Prior research, using two- and three-dimensional environments, has found that when both human and nonhuman animals independently acquire two associations between landmarks with a common landmark (e.g., LM1-LM2 and LM2-LM3), each with its own spatial relationship, they behave as if the two unique LMs have a known spatial relationship despite their never having been paired. Seemingly, they have integrated the two associations to create a third association with its own spatial relationship (LM1-LM3). Using sensory preconditioning (Experiment 1) and second-order conditioning (Experiment 2) procedures, we found that human participants integrated information about the boundaries of pathways to locate a goal within a three-dimensional virtual environment in the absence of any relevant landmarks. Spatial integration depended on the participant experiencing a common boundary feature with which to link the pathways. These results suggest that the principles of associative learning also apply to the boundaries of an environment.
Collapse
|
16
|
Sturz BR, Kelly DM. Environment size and the use of feature and geometric cues for reorientation. Acta Psychol (Amst) 2013; 142:251-8. [PMID: 23370045 DOI: 10.1016/j.actpsy.2012.12.001] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2012] [Revised: 11/26/2012] [Accepted: 12/02/2012] [Indexed: 10/27/2022] Open
Abstract
We tested associative-based accounts of orientation by investigating the influence of environment size on the use of feature and geometric cues for reorientation. Two groups of participants were trained in dynamic three-dimensional virtual rectangular environments that differed in size to find a distinctly colored bin located at one of the four corners. Subsequently, we probed the reliance on feature and geometric cues for reorientation during test trials by presenting six trial types: Small Geometry Only, Large Geometry Only, Small Cue Conflict, Large Cue Conflict, Small Distal, and Large Distal. During Geometry Only test trials, all bins were black; thus, all distinctive featural information was removed leaving only geometric cues. For Cue Conflict test trials, all colored bins were shifted counter-clockwise one corner; thus, the geometric cues from the trained corner and the trained color were in direct conflict. During Distal test trials, the bin in the geometrically incorrect corner farthest from the trained corner was colored the same as during training; the remaining three bins were black. Thus, only this distant feature cue could be used to determine the location of the goal bin. Results suggested that geometric cues were used across changes in environment size, featural cues exerted greater influence when in conflict with geometric cues, and the far featural cue was used to disambiguate the correct from the rotationally equivalent location. In short, both feature and geometric cues were used for reorientation, and environment size influenced the relative use of feature and geometric cues. Collectively, our results provide evidence against associative-based accounts of orientation.
Collapse
|
17
|
Implicit chaining in cotton-top tamarins (Saguinus oedipus) with elements equated for probability of reinforcement. Anim Cogn 2013. [PMID: 23344718 DOI: 10.1007/s10071‐013‐0598‐y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/29/2022]
Abstract
Three experiments examined the implicit learning of sequences under conditions in which the elements comprising a sequence were equated in terms of reinforcement probability. In Experiment 1 cotton-top tamarins (Saguinus oedipus) experienced a five-element sequence displayed serially on a touch screen in which reinforcement probability was equated across elements at .16 per element. Tamarins demonstrated learning of this sequence with higher latencies during a random test as compared to baseline sequence training. In Experiments 2 and 3, manipulations of the procedure used in the first experiment were undertaken to rule out a confound owing to the fact that the elements in Experiment 1 bore different temporal relations to the intertrial interval (ITI), an inhibitory period. The results of Experiments 2 and 3 indicated that the implicit learning observed in Experiment 1 was not due to temporal proximity between some elements and the inhibitory ITI. The results taken together support two conclusion: First that tamarins engaged in sequence learning whether or not there was contingent reinforcement for learning the sequence, and second that this learning was not due to subtle differences in associative strength between the elements of the sequence.
Collapse
|
18
|
Locurto C, Dillon L, Collins M, Conway M, Cunningham K. Implicit chaining in cotton-top tamarins (Saguinus oedipus) with elements equated for probability of reinforcement. Anim Cogn 2013; 16:611-25. [PMID: 23344718 DOI: 10.1007/s10071-013-0598-y] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2012] [Revised: 01/10/2013] [Accepted: 01/11/2013] [Indexed: 10/27/2022]
Abstract
Three experiments examined the implicit learning of sequences under conditions in which the elements comprising a sequence were equated in terms of reinforcement probability. In Experiment 1 cotton-top tamarins (Saguinus oedipus) experienced a five-element sequence displayed serially on a touch screen in which reinforcement probability was equated across elements at .16 per element. Tamarins demonstrated learning of this sequence with higher latencies during a random test as compared to baseline sequence training. In Experiments 2 and 3, manipulations of the procedure used in the first experiment were undertaken to rule out a confound owing to the fact that the elements in Experiment 1 bore different temporal relations to the intertrial interval (ITI), an inhibitory period. The results of Experiments 2 and 3 indicated that the implicit learning observed in Experiment 1 was not due to temporal proximity between some elements and the inhibitory ITI. The results taken together support two conclusion: First that tamarins engaged in sequence learning whether or not there was contingent reinforcement for learning the sequence, and second that this learning was not due to subtle differences in associative strength between the elements of the sequence.
Collapse
Affiliation(s)
- Charles Locurto
- Department of Psychology, College of the Holy Cross, Worcester, MA 01610, USA.
| | | | | | | | | |
Collapse
|
19
|
Parnell R, Grasby K, Talk A. The prefrontal cortex is required for incidental encoding but not recollection of source information in rodents. Behav Brain Res 2012; 232:77-83. [PMID: 22504146 DOI: 10.1016/j.bbr.2012.03.040] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2011] [Revised: 03/11/2012] [Accepted: 03/28/2012] [Indexed: 10/28/2022]
Abstract
Lesion studies have suggested that the prefrontal cortex is involved in memory for contextual details surrounding the prior observation of objects or events, but it is unknown whether it is crucial for encoding details about the location at which cues are experienced, or for recall of that information. We used intracranial infusions of the GABA(A) receptor agonist muscimol in rodents to directly assess the role of the medial prefrontal cortex (mPFC) during incidental encoding and retrieval of information about the location of a cue during a spatial sensory preconditioning procedure. Rats experienced a single, discrete, sensory cue as they explored an open platform, and then were tested after a 24 h delay on recollection of the prior location of the cue. Activity in the mPFC was suppressed with muscimol during either encoding or retrieval of the information, with a control group receiving saline infusions before both phases. We found that mPFC suppression during the encoding phase blocked the formation of incidental memory about the cues but mPFC suppression during retrieval had no effect. Moreover, animals with suppressed frontal cortical activity in the encoding phase expressed smaller cue-directed orienting responses, indicating they attended less to the cue. These results suggest that the frontal cortex may be required to sustain attention to incidental cues in order to later recollect the location in which they have been previously experienced, but that once the location information is encoded the frontal cortex is not required for retrieval of that information.
Collapse
Affiliation(s)
- Rebecca Parnell
- Psychology Department, University of New England, Armidale, NSW 2350, Australia
| | | | | |
Collapse
|
20
|
Leising KJ, Sawa K, Blaisdell AP. Factors that influence negative summation in a spatial-search task with pigeons. Behav Processes 2012; 90:357-63. [PMID: 22503862 DOI: 10.1016/j.beproc.2012.03.018] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2011] [Revised: 02/10/2012] [Accepted: 03/27/2012] [Indexed: 10/28/2022]
Abstract
A variant of the standard conditioned inhibition procedure was used to evaluate landmark-based spatial search in a touchscreen preparation. Pigeons were given compound trials with one landmark (A) positioned in a consistent spatial relationship to a hidden goal and another landmark (B) positioned randomly with respect to A and the hidden goal (AB+). On half of the non-reinforced inhibitory trials, A was paired with landmark X (AX-) and on the remaining trials B was paired with Y (BY-). All subjects were also given reinforced trials with a transfer excitor (T+). During conditioned inhibition training, subjects showed no change in overall responding during AX- trials but did show a decrease in the number of pecks to the goal location signaled by A. During non-reinforced summation tests with landmark T, X had a greater suppressive effect than did Y on overall responding but the percentage of pecks at the goal did not differ unless X was positioned near the expected goal signaled by T. These data demonstrate that the effectiveness of a stimulus trained as an inhibitor is dependent on the strength of the association between its training excitor (A) and the US, as well as, the spatial arrangement of stimuli during testing.
Collapse
Affiliation(s)
- Kenneth J Leising
- Department of Psychology, Texas Christian University, 2800 S. University Drive, Fort Worth, TX 76129, United States.
| | | | | |
Collapse
|
21
|
Spatial integration using a 3D virtual environment with humans. Behav Processes 2011; 88:198-201. [DOI: 10.1016/j.beproc.2011.08.013] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2011] [Revised: 08/08/2011] [Accepted: 08/22/2011] [Indexed: 11/30/2022]
|
22
|
Prados J, Alvarez B, Reynolds G. Spatial integration in human geometry learning. Behav Brain Res 2011; 224:297-304. [DOI: 10.1016/j.bbr.2011.06.006] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2011] [Revised: 06/01/2011] [Accepted: 06/05/2011] [Indexed: 10/18/2022]
|
23
|
Molet M, Jozefowiez J, Miller RR. Integration of spatial relationships and temporal relationships in humans. Learn Behav 2010; 38:27-34. [PMID: 20065346 PMCID: PMC2846430 DOI: 10.3758/lb.38.1.27] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Three experiments tested human participants on a two-dimensional, computer, landmark-based search task to assess the integration of independently acquired spatial and temporal relationships. Experiment 1 showed that A-B spatial training followed by B-outcome spatial training resulted in spatial integration in such a way that A was effectively associated with the outcome. Experiment 2 showed that A-B spatial and temporal training followed by B-outcome spatial and temporal training resulted in integration that created both spatial and temporal relationships between A and the outcome. Experiment 3 refuted an alternative explanation, one that is based on decision-making speed, to the temporal-integration strategy that was suggested by Experiment 2. These results replicate in humans the observations regarding spatial integration made by Sawa, Leising, and Blaisdell (2005) using a spatial-search task with pigeons, and they extend those observations to temporal integration.
Collapse
Affiliation(s)
- Mikaël Molet
- Department of Psychology, State University of New York at Binghamton, NY 13902, USA
| | | | | |
Collapse
|
24
|
Simple and integrated detours: field tests with Columbian ground squirrels. Anim Cogn 2009; 12:655-70. [DOI: 10.1007/s10071-009-0224-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2008] [Revised: 04/03/2009] [Accepted: 04/07/2009] [Indexed: 11/26/2022]
|
25
|
Stahlman WD, Blaisdell AP. Blocking of spatial control by landmarks in rats. Behav Processes 2009; 81:114-8. [PMID: 19429205 DOI: 10.1016/j.beproc.2009.02.007] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2008] [Revised: 02/17/2009] [Accepted: 02/20/2009] [Indexed: 11/28/2022]
Abstract
We investigated spatial blocking among landmarks in an open-field foraging task in rats. In Phase 1, rats were presented with A+ trials during which landmark (LM) A signaled the location of hidden food. In Phase 2, rats were given AX+ trials in which LM X served as a redundant spatial cue to the location of food. Additionally, BY+ trials were given as a within-subjects overshadowing-control procedure. At test, rats received nonreinforced presentations of LM X and LM Y on separate trials. Rats took longer to find the training goal location in the presence of LM X than of LM Y, thereby demonstrating that spatial control by LM X was blocked by prior learning with LM A. This constitutes the first evidence in rats for spatial blocking of one proximal landmark by another-approximating a conventional blocking design.
Collapse
Affiliation(s)
- W David Stahlman
- University of California, Los Angeles, CA 90095-1563, United States
| | | |
Collapse
|
26
|
Evidence against integration of spatial maps in humans: generality across real and virtual environments. Anim Cogn 2008; 12:237-47. [PMID: 18766392 DOI: 10.1007/s10071-008-0182-z] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2008] [Revised: 08/02/2008] [Accepted: 08/04/2008] [Indexed: 10/21/2022]
Abstract
A real-world open-field search task was implemented with humans as an analogue of Blaisdell and Cook's (Anim Cogn 8:7-16, 2005) pigeon foraging task and Sturz, Bodily, and Katz's (Anim Cogn 9:207-217, 2006) human virtual foraging task to 1) determine whether humans were capable of integrating independently learned spatial maps and 2) make explicit comparisons of mechanisms used by humans to navigate real and virtual environments. Participants searched for a hidden goal located in one of 16 bins arranged in a 4 x 4 grid. In Phase 1, the goal was hidden between two landmarks (blue T and red L). In Phase 2, the goal was hidden to the left and in front of a single landmark (blue T). Following training, goal-absent trials were conducted in which the red L from Phase 1 was presented alone. Bin choices during goal-absent trials assessed participants' strategies: association (from Phase 1), generalization (from Phase 2), or integration (combination of Phase 1 and 2). Results were inconsistent with those obtained with pigeons but were consistent with those obtained with humans in a virtual environment. Specifically, during testing, participants did not integrate independently learned spatial maps but used a generalization strategy followed by a shift in search behavior away from the test landmark. These results were confirmed by a control condition in which a novel landmark was presented during testing. Results are consistent with the bulk of recent findings suggesting the use of alternative navigational strategies to cognitive mapping. Results also add to a growing body of literature suggesting that virtual environment approaches to the study of spatial learning and memory have external validity and that spatial mechanisms used by human participants in navigating virtual environments are similar to those used in navigating real-world environments.
Collapse
|
27
|
Leising KJ, Sawa K, Blaisdell AP. Temporal integration in Pavlovian appetitive conditioning in rats. Learn Behav 2007; 35:11-8. [PMID: 17557387 DOI: 10.3758/bf03196069] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We used an appetitive sensory preconditioning procedure to investigate temporal integration in rats in two experiments. In Phase 1, rats were presented with simultaneous compound trials on which a 10-sec conditioned stimulus (CS) X was embedded within a 60-sec CS A. In Group Early, CS X occurred during the early portion of CS A, whereas in Group Late, CS X occurred during the latter portion of CS A. In Phase 2, CS X was paired simultaneously with sucrose. On a subsequent test with CS A, the rate of magazine entries peaked during the early portions of the stimulus in Group Early and during the latter portions of the stimulus in Group Late (Experiments 1 and 2). Similar response peaks were not observed on tests with a control stimulus that had been presented in compound with a stimulus that did not signal reward (Experiment 2).
Collapse
|
28
|
Abstract
Rats were trained to find the hidden platform in a Morris pool, whose location was defined by reference to a small number of landmarks around the circumference of the pool. In each of three experiments, an experimental group was trained on alternate trials with two different subsets of three of the available landmarks, with the two subsets sharing one landmark in common. When tested with landmarks drawn from both of their training configurations, but without the landmark common to the two sets, they had no difficulty in locating the platform. In Experiment 1, they performed at least as well as a group trained with all the available landmarks present on every trial. In Experiment 2, they performed significantly better than a group trained with two different subsets of landmarks that shared no one landmark in common.
Collapse
|