1
|
A mathematical theory of relational generalization in transitive inference. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.22.554287. [PMID: 37662223 PMCID: PMC10473627 DOI: 10.1101/2023.08.22.554287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Humans and animals routinely infer relations between different items or events and generalize these relations to novel combinations of items. This allows them to respond appropriately to radically novel circumstances and is fundamental to advanced cognition. However, how learning systems (including the brain) can implement the necessary inductive biases has been unclear. Here we investigated transitive inference (TI), a classic relational task paradigm in which subjects must learn a relation (A > B and B > C) and generalize it to new combinations of items (A > C). Through mathematical analysis, we found that a broad range of biologically relevant learning models (e.g. gradient flow or ridge regression) perform TI successfully and recapitulate signature behavioral patterns long observed in living subjects. First, we found that models with item-wise additive representations automatically encode transitive relations. Second, for more general representations, a single scalar "conjunctivity factor" determines model behavior on TI and, further, the principle of norm minimization (a standard statistical inductive bias) enables models with fixed, partly conjunctive representations to generalize transitively. Finally, neural networks in the "rich regime," which enables representation learning and has been found to improve generalization, unexpectedly show poor generalization and anomalous behavior. We find that such networks implement a form of norm minimization (over hidden weights) that yields a local encoding mechanism lacking transitivity. Our findings show how minimal statistical learning principles give rise to a classical relational inductive bias (transitivity), explain empirically observed behaviors, and establish a formal approach to understanding the neural basis of relational abstraction.
Collapse
|
2
|
Emergent neural dynamics and geometry for generalization in a transitive inference task. PLoS Comput Biol 2024; 20:e1011954. [PMID: 38662797 PMCID: PMC11125559 DOI: 10.1371/journal.pcbi.1011954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 05/24/2024] [Accepted: 02/28/2024] [Indexed: 05/25/2024] Open
Abstract
Relational cognition-the ability to infer relationships that generalize to novel combinations of objects-is fundamental to human and animal intelligence. Despite this importance, it remains unclear how relational cognition is implemented in the brain due in part to a lack of hypotheses and predictions at the levels of collective neural activity and behavior. Here we discovered, analyzed, and experimentally tested neural networks (NNs) that perform transitive inference (TI), a classic relational task (if A > B and B > C, then A > C). We found NNs that (i) generalized perfectly, despite lacking overt transitive structure prior to training, (ii) generalized when the task required working memory (WM), a capacity thought to be essential to inference in the brain, (iii) emergently expressed behaviors long observed in living subjects, in addition to a novel order-dependent behavior, and (iv) expressed different task solutions yielding alternative behavioral and neural predictions. Further, in a large-scale experiment, we found that human subjects performing WM-based TI showed behavior inconsistent with a class of NNs that characteristically expressed an intuitive task solution. These findings provide neural insights into a classical relational ability, with wider implications for how the brain realizes relational cognition.
Collapse
|
3
|
Alteration of functional connectivity in the cortex and major brain networks of non-human primates following focused ultrasound exposure in the dorsal striatum. Brain Stimul 2023; 16:1196-1204. [PMID: 37558125 PMCID: PMC10530553 DOI: 10.1016/j.brs.2023.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 07/20/2023] [Accepted: 08/03/2023] [Indexed: 08/11/2023] Open
Abstract
BACKGROUND Focused ultrasound (FUS) is a non-invasive neuromodulation technology that is being investigated for potential treatment of neurological and psychiatric disorders. FUS combined with microbubbles can temporarily open the intact blood-brain barrier (BBB) of animals and humans, and facilitate drug delivery. FUS exposure, either with or without microbubbles, has been demonstrated to alter the behavior of non-human primates (NHP), and previous studies have demonstrated the transient and long-term effects of FUS neuromodulation on functional connectivity using resting state functional MRI. The behavioral effects of FUS vary depending on whether or not it is applied in conjunction with microbubbles to open the BBB, but it is unknown whether opening the BBB affects functional connectivity differently than FUS alone. OBJECTIVE To compare the effects of applying FUS alone (FUS neuromodulation) and FUS with microbubbles (FUS-BBB opening) on changes of resting state functional connectivity in NHP. METHODS We applied 2 min FUS exposure without (neuromodulation) and with microbubbles (BBB opening) in the dorsal striatum of lightly anesthetized non-human primates, and acquired resting state functional MRI 40 min respectively after FUS exposure. The functional connectivity (FC) in the cortex and major brain networks between the two approaches were measured and compared. RESULTS When applying FUS exposure to the caudate nucleus of NHP, we found that both FUS neuromodulation can activate FC between caudate and insular cortex, while inhibiting the FC between caudate and motor cortex. FUS-BBB opening can activate FC between the caudate and medial prefrontal cortex, and within the frontotemporal network (FTN). We also found both FUS and FUS-BBB opening can significantly activate FC within the default mode network (DMN). CONCLUSION The results suggest applying FUS to a deep brain structure can alter functional connectivity in the DMN and FTN, and that FUS neuromodulation and FUS-mediated BBB opening can have different effects on patterns of functional connectivity.
Collapse
|
4
|
Influence of Rule- and Reward-based Strategies on Inferences of Serial Order by Monkeys. J Cogn Neurosci 2022; 34:592-604. [DOI: 10.1162/jocn_a_01823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
Knowledge of transitive relationships between items can contribute to learning the order of a set of stimuli from pairwise comparisons. However, cognitive mechanisms of transitive inferences based on rank order remain unclear, as are relative contributions of reward associations and rule-based inference. To explore these issues, we created a conflict between rule- and reward-based learning during a serial ordering task. Rhesus macaques learned two lists, each containing five stimuli that were trained exclusively with adjacent pairs. Selection of the higher-ranked item resulted in rewards. “Small reward” lists yielded two drops of fluid reward, whereas “large reward” lists yielded five drops. Following training of adjacent pairs, monkeys were tested on novels pairs. One item was selected from each list, such that a ranking rule could conflict with preferences for large rewards. Differences between the corresponding reward magnitudes had a strong influence on accuracy, but we also observed a symbolic distance effect. That provided evidence of a rule-based influence on decisions. RT comparisons suggested a conflict between rule- and reward-based processes. We conclude that performance reflects the contributions of two strategies and that a model-based strategy is employed in the face of a strong countervailing reward incentive.
Collapse
|
5
|
Long term study of motivational and cognitive effects of low-intensity focused ultrasound neuromodulation in the dorsal striatum of nonhuman primates. Brain Stimul 2022; 15:360-372. [PMID: 35092823 PMCID: PMC9419899 DOI: 10.1016/j.brs.2022.01.014] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Revised: 01/18/2022] [Accepted: 01/24/2022] [Indexed: 12/20/2022] Open
Abstract
Noninvasive brain stimulation using transcranial focused ultrasound (FUS) has many potential applications as a research and clinical tool, including incorporation into neural prosthetics for cognitive rehabilitation. To develop this technology, it is necessary to evaluate the safety and efficacy of FUS neuromodulation for specific brain targets and cognitive functions. It is also important to test whether repeated long-term application of FUS to deep brain targets improves or degrades behavioral and cognitive function. To this end, we investigated the effects of FUS in the dorsal striatum of nonhuman primates (NHP) performing a visual-motor decision-making task for small or large rewards. Over the course of 2 years, we performed 129 and 147 FUS applications, respectively, in two NHP. FUS (0.5 MHz @ 0.2-0.8 MPa) was applied to the putamen and caudate in both hemispheres to evaluate the effects on movement accuracy, motivation, decision accuracy, and response time. Sonicating the caudate or the putamen unilaterally resulted in modest but statistically significant improvements in motivation and decision accuracy, but at the cost of slower reaction times. The effects were dose (i.e., FUS pressure) and reward dependent. There was no effect on reaching accuracy, nor was there long-term behavioral impairment or neurological trauma evident on T1-weighted, T2-weighted, or susceptibility-weighted MRI scans. Sonication also resulted in significant changes in resting state functional connectivity between the caudate and multiple cortical regions. The results indicate that applying FUS to the dorsal striatum can positively impact the motivational and cognitive aspects of decision making. The capability of FUS to improve motivation and cognition in NHPs points to its therapeutic potential in treating a wide variety of human neural diseases, and warrants further development as a novel technique for non-invasive deep brain stimulation.
Collapse
|
6
|
Transitive inference after minimal training in rhesus macaques (Macaca mulatta). JOURNAL OF EXPERIMENTAL PSYCHOLOGY. ANIMAL LEARNING AND COGNITION 2021; 47:464-475. [PMID: 34855434 PMCID: PMC8647760 DOI: 10.1037/xan0000298] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Rhesus macaques, when trained for several hundred trials on adjacent items in an ordered list (e.g., A > B, B > C, C > D), are able to make accurate transitive inferences (TI) about previously untrained pairs (e.g., A > C, B > D). How that learning unfolds during training, however, is not well understood. We sought to measure the relationship between the amount of TI training and the resulting response accuracy in 4 rhesus macaques using seven-item lists. The training conditions included the absolute minimal case of presenting each of the six adjacent pairs only once prior to testing. We also tested transfer to nonadjacent pairs with 24 and 114 training trials. Because performance during and after small amounts of training is expected to be near chance levels, we developed a descriptive statistical model to estimate potentially subtle learning effects in the presence of much larger random response variability and systematic bias. These results suggest that subjects learned serial order in an incremental fashion. Thus, rather than performing transitive inference by a logical process, serial learning in rhesus macaques proceeds in a manner more akin to a statistical inference, with an initial uncertainty about list position that gradually becomes more accurate as evidence accumulates. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
7
|
Safety evaluation of a clinical focused ultrasound system for neuronavigation guided blood-brain barrier opening in non-human primates. Sci Rep 2021; 11:15043. [PMID: 34294761 PMCID: PMC8298475 DOI: 10.1038/s41598-021-94188-3] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Accepted: 07/06/2021] [Indexed: 02/06/2023] Open
Abstract
An emerging approach with potential in improving the treatment of neurodegenerative diseases and brain tumors is the use of focused ultrasound (FUS) to bypass the blood-brain barrier (BBB) in a non-invasive and localized manner. A large body of pre-clinical work has paved the way for the gradual clinical implementation of FUS-induced BBB opening. Even though the safety profile of FUS treatments in rodents has been extensively studied, the histological and behavioral effects of clinically relevant BBB opening in large animals are relatively understudied. Here, we examine the histological and behavioral safety profile following localized BBB opening in non-human primates (NHPs), using a neuronavigation-guided clinical system prototype. We show that FUS treatment triggers a short-lived immune response within the targeted region without exacerbating the touch accuracy or reaction time in visual-motor cognitive tasks. Our experiments were designed using a multiple-case-study approach, in order to maximize the acquired data and support translation of the FUS system into human studies. Four NHPs underwent a single session of FUS-mediated BBB opening in the prefrontal cortex. Two NHPs were treated bilaterally at different pressures, sacrificed on day 2 and 18 post-FUS, respectively, and their brains were histologically processed. In separate experiments, two NHPs that were earlier trained in a behavioral task were exposed to FUS unilaterally, and their performance was tracked for at least 3 weeks after BBB opening. An increased microglia density around blood vessels was detected on day 2, but was resolved by day 18. We also detected signs of enhanced immature neuron presence within areas that underwent BBB opening, compared to regions with an intact BBB, confirming previous rodent studies. Logistic regression analysis showed that the NHP cognitive performance did not deteriorate following BBB opening. These preliminary results demonstrate that neuronavigation-guided FUS with a single-element transducer is a non-invasive method capable of reversibly opening the BBB, without substantial histological or behavioral impact in an animal model closely resembling humans. Future work should confirm the observations of this multiple-case-study work across animals, species and tasks.
Collapse
|
8
|
Negative allosteric modulation of metabotropic glutamate receptor 5 attenuates alcohol self-administration in baboons. Pharmacol Biochem Behav 2021; 208:173227. [PMID: 34224733 DOI: 10.1016/j.pbb.2021.173227] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 06/30/2021] [Accepted: 07/01/2021] [Indexed: 11/29/2022]
Abstract
Many of the behavioral symptoms that define alcohol use disorder (AUD) are thought to be mediated by amplified glutamatergic activity. As a result, previous preclinical studies have investigated glutamate receptor inhibition as a potential pharmacotherapy for AUD, particularly the metabotropic glutamate receptor 5 (mGlu5). In rodents, mGlu5 negative allosteric modulators (NAMs) have been shown to decrease alcohol self-administration. However, their effect on non-human primates has not previously been explored. To bridge this gap, the effects of mGlu5 NAM pretreatment on sweetened alcohol (8% w/v in diluted KoolAid) self-administration in female baboons were evaluated. Two different mGlu5 NAMs were tested: 1) 3-2((-Methyl-4-thiazolyl) ethynyl) pyridine (MTEP) which was administered at a dose of 2 mg/kg IM; and 2) auglurant (N-(5-fluoropyridin-2-yl)-6-methyl-4-(pyrimidin-5-yloxy)picolinamide), a newly developed NAM, which was tested under two different routes (0.001, 0.01, 0.03, 0.1 mg/kg IM and 0.1, 0.3, 1.0 mg/kg PO). MTEP decreased both fixed ratio and progressive ratio responding for sweetened alcohol. Auglurant, administered IM, decreased alcohol self-administration at doses that did not affect self-administration of an alcohol-free sweet liquid reward (0.01 to 0.1 mg/kg). Oral administration of auglurant was not effective in decreasing alcohol self-administration. Our results extend positive findings from rodent studies on mGlu5 regulation of alcohol drinking to female baboons and further strengthen the rationale for targeting mGlu5 in clinical trials for AUD.
Collapse
|
9
|
Abstract
The implied order of a ranked set of visual images can be learned without reliance on information that explicitly signals their order. Such learning is difficult to explain by associative mechanisms, but can be accounted for by cognitive representations and processes such as transitive inference. Our study sought to determine if those processes also apply to learning categories of images. We asked whether participants can (a) infer that stimulus images belonged to familiar categories, even when the images for each trial were unique, and (b) sort those categories into an ordering that obeys transitivity. Participants received minimal verbal instruction and a single session of training. Despite this, they learned the implied order of lists of fixed stimuli and lists of ordered categories, using trial-unique exemplars. We trained two groups, one for which stimuli were constant throughout training and testing (n = 60), and one for which exemplars of each category were trial-unique (n = 50). Our findings suggest that differing cognitive processes may underpin serial learning when learning about specific stimuli as opposed to stimulus categories.
Collapse
|
10
|
Combining brain perturbation and neuroimaging in non-human primates. Neuroimage 2021; 235:118017. [PMID: 33794355 DOI: 10.1016/j.neuroimage.2021.118017] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2020] [Revised: 03/07/2021] [Accepted: 03/22/2021] [Indexed: 12/11/2022] Open
Abstract
Brain perturbation studies allow detailed causal inferences of behavioral and neural processes. Because the combination of brain perturbation methods and neural measurement techniques is inherently challenging, research in humans has predominantly focused on non-invasive, indirect brain perturbations, or neurological lesion studies. Non-human primates have been indispensable as a neurobiological system that is highly similar to humans while simultaneously being more experimentally tractable, allowing visualization of the functional and structural impact of systematic brain perturbation. This review considers the state of the art in non-human primate brain perturbation with a focus on approaches that can be combined with neuroimaging. We consider both non-reversible (lesions) and reversible or temporary perturbations such as electrical, pharmacological, optical, optogenetic, chemogenetic, pathway-selective, and ultrasound based interference methods. Method-specific considerations from the research and development community are offered to facilitate research in this field and support further innovations. We conclude by identifying novel avenues for further research and innovation and by highlighting the clinical translational potential of the methods.
Collapse
|
11
|
Abstract
Does serial learning result in specific associations between pairs of items, or does it result in a cognitive map based on relations of all items? In 2 experiments, we trained human participants to learn various lists of photographic images. We then tested the participants on new lists of photographic images. These new lists were constructed by selecting only 1 image from each list learned during training. In Experiment 1, participants were trained to choose the earlier (experimenter defined) item when presented with adjacent pairs of items on each of 5 different 5-item lists. Participants were then tested on derived lists, in which each item retained its original ordinal position, even though each of the presented pairs was novel. Participants performed above chance on all of the derived lists. In Experiment 2, a different group of participants received the same training as those of Experiment 1, but the ordinal positions of items were systematically changed on each derived list. The response accuracy for Experiment 2 varied inversely with the degree to which an item's original ordinal position was changed. These results can be explained by a model in which participants learned to make both positional inferences about the absolute rank of each stimulus, and transitive inferences about the relative ranks of pairs of stimuli. These inferences enhanced response accuracy when ordinal position was maintained, but not when it was changed. Our results demonstrate quantitatively that, in addition to item-item associations that participants acquire while learning a list of arbitrary items, they form a cognitive map that represents both experienced and inferred relationships. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
12
|
Learned Representation of Implied Serial Order in Posterior Parietal Cortex. Sci Rep 2020; 10:9386. [PMID: 32523062 PMCID: PMC7287075 DOI: 10.1038/s41598-020-65838-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 05/08/2020] [Indexed: 11/20/2022] Open
Abstract
Monkeys can learn the implied ranking of pairs of images drawn from an ordered set, despite never seeing all of the images simultaneously and without explicit spatial or temporal cues. We recorded the activity of posterior parietal cortex (including lateral intraparietal area LIP) neurons while monkeys learned 7-item transitive inference (TI) lists with 2 items presented on each trial. Behavior and neuronal activity were significantly influenced by the ordinal relationship of the stimulus pairs, specifically symbolic distance (the difference in rank) and joint rank (the sum of the ranks). Symbolic distance strongly predicted decision accuracy and learning rate. An effect of joint rank on performance was found nested within the symbolic distance effect. Across the population of neurons, there was significant modulation of firing correlated with the relative ranks of the two stimuli presented on each trial. Neurons exhibited selectivity for stimulus rank during learning, but not before or after. The observed behavior is poorly explained by associative or reward mechanisms, and appears more consistent with a mental workspace model in which implied serial order is mapped within a spatial framework. The neural data suggest that posterior parietal cortex supports serial learning by representing information about the ordinal relationship of the stimuli presented during a given trial.
Collapse
|
13
|
Discovering Implied Serial Order Through Model-Free and Model-Based Learning. Front Neurosci 2019; 13:878. [PMID: 31481871 PMCID: PMC6710392 DOI: 10.3389/fnins.2019.00878] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2019] [Accepted: 08/05/2019] [Indexed: 12/24/2022] Open
Abstract
Humans and animals can learn to order a list of items without relying on explicit spatial or temporal cues. To do so, they appear to make use of transitivity, a property of all ordered sets. Here, we summarize relevant research on the transitive inference (TI) paradigm and its relationship to learning the underlying order of an arbitrary set of items. We compare six computational models of TI performance, three of which are model-free (Q-learning, Value Transfer, and REMERGE) and three of which are model-based (RL-Elo, Sequential Monte Carlo, and Betasort). Our goal is to assess the ability of these models to produce empirically observed features of TI behavior. Model-based approaches perform better under a wider range of scenarios, but no single model explains the full scope of behaviors reported in the TI literature.
Collapse
|
14
|
Reward associations do not explain transitive inference performance in monkeys. SCIENCE ADVANCES 2019; 5:eaaw2089. [PMID: 32128384 PMCID: PMC7032924 DOI: 10.1126/sciadv.aaw2089] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Accepted: 06/21/2019] [Indexed: 06/10/2023]
Abstract
Most accounts of behavior in nonhuman animals assume that they make choices to maximize expected reward value. However, model-free reinforcement learning based on reward associations cannot account for choice behavior in transitive inference paradigms. We manipulated the amount of reward associated with each item of an ordered list, so that maximizing expected reward value was always in conflict with decision rules based on the implicit list order. Under such a schedule, model-free reinforcement algorithms cannot achieve high levels of accuracy, even after extensive training. Monkeys nevertheless learned to make correct rule-based choices. These results show that monkeys' performance in transitive inference paradigms is not driven solely by expected reward and that appropriate inferences are made despite discordant reward incentives. We show that their choices can be explained by an abstract, model-based representation of list order, and we provide a method for inferring the contents of such representations from observed data.
Collapse
|
15
|
Abstract
PURPOSE OF REVIEW The past decade has seen rapid growth in the application of focused ultrasound (FUS) as a tool for basic neuroscience research and potential treatment of brain disorders. Here, we review recent developments in our understanding of how FUS can alter brain activity, perception and behavior when applied to the central nervous system, either alone or in combination with circulating agents. RECENT FINDINGS Focused ultrasound in the central nervous system can directly excite or inhibit neuronal activity, as well as affect perception and behavior. Combining FUS with intravenous microbubbles to open the blood-brain barrier also affects neural activity and behavior, and the effects may be more sustained than FUS alone. Opening the BBB also allows delivery of drugs that do not cross the intact BBB including viral vectors for gene delivery. SUMMARY While further research is needed to elucidate the biophysical mechanisms, focused ultrasound, alone or in combination with other factors, is rapidly maturing as an effective technology for altering brain activity. Future challenges include refining control over targeting specificity, the volume of affected tissue, cell-type specificity (excitatory or inhibitory), and the duration of neural and behavioral effects.
Collapse
|
16
|
Toward a Cognitive Neural Prosthesis Using Focused Ultrasound. Front Neurosci 2017; 11:607. [PMID: 29187808 PMCID: PMC5694829 DOI: 10.3389/fnins.2017.00607] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2017] [Accepted: 10/17/2017] [Indexed: 12/18/2022] Open
Abstract
Non-invasive brain stimulation using focused ultrasound has many potential applications as a research and clinical tool, including its incorporation as either an extracorporeal or implantable neural prosthetic. To this end, we investigated the effect of focused ultrasound (FUS) combined with systemically administered microbubbles on visual-motor decision-making behavior in monkeys. We applied FUS to the putamen in one hemisphere to open the blood-brain barrier (BBB), and then tested behavioral performance 3–4 h later. On days when the monkeys were treated with FUS, their decisions were faster and more accurate than days without sonication. The performance improvement suggested both a shift in the decision criterion and an enhancement of the use of sensory evidence in the decision process. FUS also interacted with the effect of a low dose of haloperidol. The findings indicate that a two-minute application of FUS can have a sustained impact on performance of complex cognitive tasks, and may increase the efficacy of psychoactive medications. The results lend further support to the idea that the dorsal striatum plays an integral role in evidence- and reward-based decision-making, and provide motivation for incorporating FUS into cognitive neural prosthetic devices.
Collapse
|
17
|
Inferential Learning of Serial Order of Perceptual Categories by Rhesus Monkeys ( Macaca mulatta). J Neurosci 2017; 37:6268-6276. [PMID: 28546309 PMCID: PMC5490063 DOI: 10.1523/jneurosci.0263-17.2017] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2017] [Revised: 05/10/2017] [Accepted: 05/16/2017] [Indexed: 11/21/2022] Open
Abstract
Category learning in animals is typically trained explicitly, in most instances by varying the exemplars of a single category in a matching-to-sample task. Here, we show that male rhesus macaques can learn categories by a transitive inference paradigm in which novel exemplars of five categories were presented throughout training. Instead of requiring decisions about a constant set of repetitively presented stimuli, we studied the macaque's ability to determine the relative order of multiple exemplars of particular stimuli that were rarely repeated. Ordinal decisions generalized both to novel stimuli and, as a consequence, to novel pairings. Thus, we showed that rhesus monkeys could learn to categorize on the basis of implied ordinal position, without prior matching-to-sample training, and that they could then make inferences about category order. Our results challenge the plausibility of association models of category learning and broaden the scope of the transitive inference paradigm.SIGNIFICANCE STATEMENT The cognitive abilities of nonhuman animals are of enduring interest to scientists and the general public because they blur the dividing line between human and nonhuman intelligence. Categorization and sequence learning are highly abstract cognitive abilities each in their own right. This study is the first to provide evidence that visual categories can be ordered serially by macaque monkeys using a behavioral paradigm that provides no explicit feedback about category or serial order. These results strongly challenge accounts of learning based on stimulus-response associations.
Collapse
|
18
|
Targeting Effects on the Volume of the Focused Ultrasound-Induced Blood-Brain Barrier Opening in Nonhuman Primates In Vivo. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2017; 64:798-810. [PMID: 28320656 PMCID: PMC5542068 DOI: 10.1109/tuffc.2017.2681695] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Drug delivery to subcortical regions is susceptible to the blood-brain barrier (BBB) impeding the molecular exchange between the blood stream and the brain parenchyma. Focused ultrasound (FUS) coupled with the administration of microbubbles has been proved to open the BBB locally, transiently, and noninvasively both in rodents and in nonhuman-primates (NHPs). The development of this disruption technique independent of MRI monitoring is of primordial importance yet restrained to the targeting optimization. This paper establishes the linear relationship of the incidence angle with the volume of BBB opening ( VBBB ) and the peak negative pressure when sonicating the caudate nucleus and the putamen region of five NHPs. In addition, the effect of central nervous system structures on the opening morphology is evaluated by identification of the gray-to-white-matter ratio at the opening site. Finally, the targeting accuracy is assessed through the estimation of the geometric and angle shift of the opening from the targeted region. Interestingly, results prove a monotonic increase of the opening volume with close to normal incidence angles. Moreover, 80.35% of the opening lies on gray-matter regions compared with only 19.41% attributed to the white matter. The opening was found to be shifted axially, toward the transducer, and laterally with an average angle shift of 4.5°. Finally, we were capable of showing reproducibility of targeting accuracy with the same stereotactic and ultrasonic parameters. This paper documents the a priori prediction of the opening volume through manipulation of the angle and pressure as well as establishing the predictability, accuracy, and safety of FUS-induced BBB opening in NHPs.
Collapse
|
19
|
Transitive inference in humans (Homo sapiens) and rhesus macaques (Macaca mulatta) after massed training of the last two list items. ACTA ACUST UNITED AC 2017; 131:231-245. [PMID: 28333486 PMCID: PMC5552434 DOI: 10.1037/com0000065] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Transitive inference (TI) is a classic learning paradigm for which the relative contributions of experienced rewards and representation-driven inference have been vigorously debated, particularly with regard to the notion that animals are capable of logic and reasoning. Rhesus macaque subjects and human participants performed a TI task in which, prior to learning a seven-item list ABCDEFG, a block of trials presented exclusively the pair FG. Contrary to the expectation of associative models, the high prior rate of reward for F did not disrupt learning of the entire list. Monkeys (who each completed many sessions) learned to anticipate that novel stimuli should be preferred over F. We interpret this as evidence of a task representation of TI that generalizes beyond learning about specific stimuli. Humans (who were task-naïve) showed a transitory bias to F when it was paired with novel stimuli, but very rapidly unlearned that bias. Performance with respect to the remaining stimuli was consistent with past reports of TI in both species. These results are difficult to reconcile with any account that seeks to assign the strength of association between individual stimuli and rewards. Instead, they support both sophisticated cognitive processes in both species, albeit with some species differences.
Collapse
|
20
|
Blood-Brain Barrier Opening in Behaving Non-Human Primates via Focused Ultrasound with Systemically Administered Microbubbles. Sci Rep 2015; 5:15076. [PMID: 26496829 PMCID: PMC4620488 DOI: 10.1038/srep15076] [Citation(s) in RCA: 68] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2015] [Accepted: 09/07/2015] [Indexed: 12/30/2022] Open
Abstract
Over the past fifteen years, focused ultrasound coupled with intravenously administered microbubbles (FUS) has been proven an effective, non-invasive technique to open the blood-brain barrier (BBB) in vivo. Here we show that FUS can safely and effectively open the BBB at the basal ganglia and thalamus in alert non-human primates (NHP) while they perform a behavioral task. The BBB was successfully opened in 89% of cases at the targeted brain regions of alert NHP with an average volume of opening 28% larger than prior anesthetized FUS procedures. Safety (lack of edema or microhemorrhage) of FUS was also improved during alert compared to anesthetized procedures. No physiological effects (change in heart rate, motor evoked potentials) were observed during any of the procedures. Furthermore, the application of FUS did not disrupt reaching behavior, but in fact improved performance by decreasing reaction times by 23 ms, and significantly decreasing touch error by 0.76 mm on average.
Collapse
|
21
|
Human substantia nigra neurons encode decision outcome and are modulated by categorization uncertainty in an auditory categorization task. Physiol Rep 2015; 3:3/9/e12422. [PMID: 26416969 PMCID: PMC4600370 DOI: 10.14814/phy2.12422] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
Abstract
The ability to categorize stimuli – predator or prey, friend or foe – is an essential feature of the decision-making process. Underlying that ability is the development of an internally generated category boundary to generate decision outcomes. While classic temporal difference reinforcement models assume midbrain dopaminergic neurons underlie the prediction error required to learn boundary location, these neurons also demonstrate a robust response to nonreward incentive stimuli. More recent models suggest that this may reflect a motivational aspect to performing a task which should be accounted for when modeling dopaminergic neuronal behavior. To clarify the role of substantia nigra dopamine neurons in uncertain perceptual decision making, we investigated their behavior using single neuron extracellular recordings in patients with Parkinson's disease undergoing deep brain stimulation. Subjects underwent a simple auditory categorical decision-making task in which they had to classify a tone as either low- or high-pitched relative to an explicit threshold tone and received feedback but no reward. We demonstrate that the activity of human SN dopaminergic neurons is predictive of perceptual categorical decision outcome and is modulated by uncertainty. Neuronal activity was highest during difficult (uncertain) decisions that resulted in correct responses and lowest during easy decisions that resulted in incorrect responses. This pattern of results is more consistent with a “motivational” role with regards to perceptual categorization and suggests that dopamine neurons are most active when critical information – as represented by uncertainty – is available for learning decision boundaries.
Collapse
|
22
|
Implicit Value Updating Explains Transitive Inference Performance: The Betasort Model. PLoS Comput Biol 2015; 11:e1004523. [PMID: 26407227 PMCID: PMC4583549 DOI: 10.1371/journal.pcbi.1004523] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2015] [Accepted: 08/24/2015] [Indexed: 11/19/2022] Open
Abstract
Transitive inference (the ability to infer that B > D given that B > C and C > D) is a widespread characteristic of serial learning, observed in dozens of species. Despite these robust behavioral effects, reinforcement learning models reliant on reward prediction error or associative strength routinely fail to perform these inferences. We propose an algorithm called betasort, inspired by cognitive processes, which performs transitive inference at low computational cost. This is accomplished by (1) representing stimulus positions along a unit span using beta distributions, (2) treating positive and negative feedback asymmetrically, and (3) updating the position of every stimulus during every trial, whether that stimulus was visible or not. Performance was compared for rhesus macaques, humans, and the betasort algorithm, as well as Q-learning, an established reward-prediction error (RPE) model. Of these, only Q-learning failed to respond above chance during critical test trials. Betasort’s success (when compared to RPE models) and its computational efficiency (when compared to full Markov decision process implementations) suggests that the study of reinforcement learning in organisms will be best served by a feature-driven approach to comparing formal models. Although machine learning systems can solve a wide variety of problems, they remain limited in their ability to make logical inferences. We developed a new computational model, called betasort, which addresses these limitations for a certain class of problems: Those in which the algorithm must infer the order of a set of items by trial and error. Unlike extant machine learning systems (but like children and many non-human animals), betasort is able to perform “transitive inferences” about the ordering of a set of images. The patterns of error made by betasort resemble those made by children and non-human animals, and the resulting learning achieved at low computational cost. Additionally, betasort is difficult to classify as either “model-free” or “model-based” according to the formal specifications of those classifications in the machine learning literature. One of the broader implications of these results is that achieving a more comprehensive understanding of how the brain learns will require analysts to entertain other candidate learning models.
Collapse
|
23
|
A new paradigm and computational framework to estimate stop-signal reaction time distributions from the inhibition of complex motor sequences. Front Comput Neurosci 2015; 9:87. [PMID: 26236226 PMCID: PMC4500928 DOI: 10.3389/fncom.2015.00087] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2015] [Accepted: 06/22/2015] [Indexed: 12/02/2022] Open
Abstract
Inhibitory control is an important component of executive function that allows organisms to abort emerging behavioral plans or ongoing actions on the fly as new sensory information becomes available. Current models treat inhibitory control as a race between a Go- and a Stop process that may be mediated by partially distinct neural substrates, i.e., the direct and the hyper-direct pathway of the basal ganglia. The fact that finishing times of the Stop process (Stop-Signal Reaction Time, SSRT) cannot be observed directly has precluded a precise comparison of the functional properties that govern the initiation (GoRT) and inhibition (SSRT) of a motor response. To solve this problem, we modified an existing inhibitory paradigm and developed a non-parametric framework to measure the trial-by-trial variability of SSRT. A series of simulations verified that the non-parametric approach is on par with a parametric approach and yields accurate estimates of the entire SSRT distribution from as few as ~750 trials. Our results show that in identical settings, the distribution of SSRT is very similar to the distribution of GoRT albeit somewhat shorter, wider and significantly less right-skewed. The ability to measure the precise shapes of SSRT distributions opens new avenues for research into the functional properties of the hyper-direct pathway that is believed to mediate inhibitory control.
Collapse
|
24
|
Smooth pursuit preparation modulates neuronal responses in visual areas MT and MST. J Neurophysiol 2015; 114:638-49. [PMID: 26019315 DOI: 10.1152/jn.00636.2014] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2014] [Accepted: 05/22/2015] [Indexed: 11/22/2022] Open
Abstract
Primates are able to track small moving visual targets using smooth pursuit eye movements. Target motion for smooth pursuit is signaled by neurons in visual cortical areas MT and MST. In this study, we trained monkeys to either initiate or withhold smooth pursuit in the presence of a moving target to test whether this decision was reflected in the relative strength of "go" and "no-go" processes. We found that the gain of the motor response depended strongly on whether monkeys were instructed to initiate or withhold pursuit, thus demonstrating voluntary control of pursuit initiation. We found that the amplitude of the neuronal response to moving targets in areas MT and MST was also significantly lower on no-go trials (by 2.1 spikes/s on average). The magnitude of the neural response reduction was small compared with the behavioral gain reduction. There were no significant differences in neuronal direction selectivity, spatial selectivity, or response reliability related to pursuit initiation or the absence thereof. Variability in eye speed was negatively correlated with firing rate variability after target motion onset during go trials but not during no-go trials, suggesting that MT and MST activity represents an error signal for a negative feedback controller. We speculate that modulation of the visual motion signals in areas MT and MST may be one of the first visual cortical events in the initiation of smooth pursuit and that the small early response modulation may be amplified to produce an all-or-none motor response by downstream areas.
Collapse
|
25
|
Long-Term Safety of Repeated Blood-Brain Barrier Opening via Focused Ultrasound with Microbubbles in Non-Human Primates Performing a Cognitive Task. PLoS One 2015; 10:e0125911. [PMID: 25945493 PMCID: PMC4422704 DOI: 10.1371/journal.pone.0125911] [Citation(s) in RCA: 104] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2014] [Accepted: 03/23/2015] [Indexed: 01/11/2023] Open
Abstract
Focused Ultrasound (FUS) coupled with intravenous administration of microbubbles (MB) is a non-invasive technique that has been shown to reliably open (increase the permeability of) the blood-brain barrier (BBB) in multiple in vivo models including non-human primates (NHP). This procedure has shown promise for clinical and basic science applications, yet the safety and potential neurological effects of long term application in NHP requires further investigation under parameters shown to be efficacious in that species (500kHz, 200–400 kPa, 4–5μm MB, 2 minute sonication). In this study, we repeatedly opened the BBB in the caudate and putamen regions of the basal ganglia of 4 NHP using FUS with systemically-administered MB over 4–20 months. We assessed the safety of the FUS with MB procedure using MRI to detect edema or hemorrhaging in the brain. Contrast enhanced T1-weighted MRI sequences showed a 98% success rate for openings in the targeted regions. T2-weighted and SWI sequences indicated a lack edema in the majority of the cases. We investigated potential neurological effects of the FUS with MB procedure through quantitative cognitive testing of’ visual, cognitive, motivational, and motor function using a random dot motion task with reward magnitude bias presented on a touchpanel display. Reaction times during the task significantly increased on the day of the FUS with MB procedure. This increase returned to baseline within 4–5 days after the procedure. Visual motion discrimination thresholds were unaffected. Our results indicate FUS with MB can be a safe method for repeated opening of the BBB at the basal ganglia in NHP for up to 20 months without any long-term negative physiological or neurological effects with the parameters used.
Collapse
|
26
|
Abstract
In a dynamic environment an organism has to constantly adjust ongoing behavior to adapt to a given context. This process requires continuous monitoring of ongoing behavior to provide its meaningful interpretation. The caudate nucleus is known to have a role in behavioral monitoring, but the nature of these signals during dynamic behavior is still unclear. We recorded neuronal activity in the caudate nucleus in monkeys during categorization behavior that changed rapidly across contexts. We found that neuronal activity maintained representation of the identity and context of a recently categorized stimulus, as well as interpreted the behavioral meaningfulness of the maintained trace. The accuracy of this cognitive monitoring signal was highest for behavior for which subjects were prone to make errors. Thus, the caudate nucleus provides interpretive monitoring of ongoing behavior, which is necessary for contextually specific decisions to adapt to rapidly changing conditions. DOI:http://dx.doi.org/10.7554/eLife.03727.001 The ability to adapt behavior in a changing environment is a hallmark of intelligent systems. From adjusting our driving speed to match road conditions to responding to a last-minute change of plans, mental flexibility underpins much of our day-to-day functioning. To perform optimally, an animal must continuously monitor its own behavior and adjust it according to circumstances. A region of the brain called the caudate nucleus is thought to contribute to this process by keeping track of the relation between an action and its outcomes, but it is not clear how it monitors cognitive aspects of ongoing behavior. Yanike and Ferrera have clarified this process by recording electrical activity from the caudate nucleus in two monkeys as they categorized visual stimuli. The monkeys viewed a moving stimulus and classified it as ‘fast’ or ‘slow’ relative to a reference speed that varied from trial to trial. The monkeys were trained to use two different references speeds and were told which reference speed to use at the start of each trial. They used an eye movement to indicate their decision. Most neurons within the caudate nucleus responded after the monkey had made a decision, suggesting that these neurons might be involved in evaluating the decision that had just been made. The response of the neurons depended on the stimulus speed, and also on the category (fast or slow) in which the stimulus belonged. This observation indicates that the caudate nucleus tracked the context (reference speed) as well as the stimulus speed. Yanike and Ferrera also showed that the response of the entire population of caudate neurons could be decoded to reveal both the speed of the stimulus and whether the monkey had categorized it as fast or slow. This shows that after a decision has been made, neurons continue to signal both the stimulus and the context in which that stimulus was presented. Such ‘post-decision’ monitoring is important for anticipating the outcome of the decision. Overall the results suggest that the caudate nucleus helps animals to adapt their behavior to rapidly changing circumstances by supporting decision-making that takes context into account. DOI:http://dx.doi.org/10.7554/eLife.03727.002
Collapse
|
27
|
Modifying cognition and behavior with electrical microstimulation: implications for cognitive prostheses. Neurosci Biobehav Rev 2014; 47:321-35. [PMID: 25242103 DOI: 10.1016/j.neubiorev.2014.09.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2014] [Accepted: 09/09/2014] [Indexed: 11/18/2022]
Abstract
A fundamental goal of cognitive neuroscience is to understand how brain activity generates complex mental states and behaviors. While neuronal activity may predict or correlate with behavioral responses in a cognitive task, the use of electrical microstimulation presents the possibility to augment such correlational findings with direct evidence for causal relationships. Although microstimulation has been used for many years as a tool for mapping sensory and motor function, its role in learning, memory and decision-making has emerged only recently. Focal microstimulation of higher cortical areas can produce complex mental states and sequences of action. However, the relationship between the locus of stimulation and the percepts or actions evoked is often stereotyped and inflexible. The challenge is to develop stimulation systems that do not have fixed output but can flexibly contribute to complex cognitive and behavioral tasks. We discuss how microstimulation has been instrumental in manipulating a wide spectrum of cognitive functions including working memory, perceptual decisions and executive control by enhancing attention, re-ordering temporal sequence of saccades, improving associative learning or cognitive performance. For example, stimulation in prefrontal, parietal and sensory cortices may establish causal effects on decision-making, while microstimulation of inferotemporal cortex or caudate nucleus enhances associative learning. Building cognitive prosthetics based on the insights gleaned from such studies may depend on the development of multiple-input, multiple-output (MIMO) devices that allow subjects to control stimulation with their own thoughts in a closed-loop system.
Collapse
|
28
|
WITHDRAWN: Manipulating Cognition and Behavior with Microstimulation, Implications for Cognitive Prostheses. Neurosci Biobehav Rev 2014; 42:303. [DOI: 10.1016/j.neubiorev.2013.12.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2013] [Revised: 12/23/2013] [Accepted: 12/28/2013] [Indexed: 10/25/2022]
|
29
|
Abstract
Why do humans make errors on seemingly trivial perceptual decisions? It has been shown that such errors occur in part because the decision process (evidence accumulation) is initiated before selective attention has isolated the relevant sensory information from salient distractors. Nevertheless, it is typically assumed that subjects increase accuracy by prolonging the decision process rather than delaying decision onset. To date it has not been tested whether humans can strategically delay decision onset to increase response accuracy. To address this question we measured the time course of selective attention in a motion interference task using a novel variant of the response signal paradigm. Based on these measurements we estimated time-dependent drift rate and showed that subjects should in principle be able trade speed for accuracy very effectively by delaying decision onset. Using the time-dependent estimate of drift rate we show that subjects indeed delay decision onset in addition to raising response threshold when asked to stress accuracy over speed in a free reaction version of the same motion-interference task. These findings show that decision onset is a critical aspect of the decision process that can be adjusted to effectively improve decision accuracy.
Collapse
|
30
|
Orienting of attention to gaze direction cues in rhesus macaques: species-specificity, and effects of cue motion and reward predictiveness. Front Psychol 2012; 3:202. [PMID: 22737139 PMCID: PMC3382411 DOI: 10.3389/fpsyg.2012.00202] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2011] [Accepted: 05/30/2012] [Indexed: 11/13/2022] Open
Abstract
Primates live in complex social groups and rely on social cues to direct their attention. For example, primates react faster to an unpredictable stimulus after seeing a conspecific looking in the direction of that stimulus. In the current study we tested the specificity of facial cues (gaze direction) for orienting attention and their interaction with other cues that are known to guide attention. In particular, we tested whether macaque monkeys only respond to gaze cues from conspecifics or if the effect generalizes across species. We found an attentional advantage of conspecific faces over human and cartoon faces. Because gaze cues are often conveyed by gesture, we also explored the effect of image motion (a simulated glance) on the orienting of attention in monkeys. We found that the simulated glance did not significantly enhance the speed of orienting for monkey-face stimuli, but had a significant effect for images of human faces. Finally, because gaze cues presumably guide attention toward relevant or rewarding stimuli, we explored whether orienting of attention was modulated by reward predictiveness. When the cue predicted reward location, face, and non-face cues were effective in speeding responses toward the cued location. This effect was strongest for conspecific faces. In sum, our results suggest that while conspecific gaze cues activate an intrinsic process that reflexively directs spatial attention, its effect is relatively small in comparison to other features including motion and reward predictiveness. It is possible that gaze cues are more important for decision-making and voluntary orienting than for reflexive orienting.
Collapse
|
31
|
Noninvasive, transient and selective blood-brain barrier opening in non-human primates in vivo. PLoS One 2011; 6:e22598. [PMID: 21799913 PMCID: PMC3142168 DOI: 10.1371/journal.pone.0022598] [Citation(s) in RCA: 114] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2011] [Accepted: 06/30/2011] [Indexed: 01/30/2023] Open
Abstract
The blood-brain barrier (BBB) is a specialized vascular system that impedes entry of all large and the vast majority of small molecules including the most potent central nervous system (CNS) disease therapeutic agents from entering from the lumen into the brain parenchyma. Microbubble-enhanced, focused ultrasound (ME-FUS) has been previously shown to disrupt noninvasively, selectively, and transiently the BBB in small animals in vivo. For the first time, the feasibility of transcranial ME-FUS BBB opening in non-human primates is demonstrated with subsequent BBB recovery. Sonications were combined with two different types of microbubbles (customized 4–5 µm and Definity®). 3T MRI was used to confirm the BBB disruption and to assess brain damage.
Collapse
|
32
|
Abstract
The blood-brain barrier (BBB) is a specialized vascular system that impedes entry of all large and the vast majority of small molecules including the most potent central nervous system (CNS) disease therapeutic agents from entering from the lumen into the brain parenchyma. Microbubble-enhanced, focused ultrasound (ME-FUS) has been previously shown to disrupt noninvasively, selectively, and transiently the BBB in small animals in vivo. For the first time, the feasibility of transcranial ME-FUS BBB opening in non-human primates is demonstrated with subsequent BBB recovery. Sonications were combined with two different types of microbubbles (customized 4-5 µm and Definity®). 3T MRI was used to confirm the BBB disruption and to assess brain damage.
Collapse
|
33
|
The dorsal medial frontal cortex is sensitive to time on task, not response conflict or error likelihood. Neuroimage 2010; 57:303-11. [PMID: 21168515 DOI: 10.1016/j.neuroimage.2010.12.027] [Citation(s) in RCA: 173] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2010] [Revised: 11/23/2010] [Accepted: 12/06/2010] [Indexed: 11/17/2022] Open
Abstract
The dorsal medial frontal cortex (dMFC) is highly active during choice behavior. Though many models have been proposed to explain dMFC function, the conflict monitoring model is the most influential. It posits that dMFC is primarily involved in detecting interference between competing responses thus signaling the need for control. It accurately predicts increased neural activity and response time (RT) for incompatible (high-interference) vs. compatible (low-interference) decisions. However, it has been shown that neural activity can increase with time on task, even when no decisions are made. Thus, the greater dMFC activity on incompatible trials may stem from longer RTs rather than response conflict. This study shows that (1) the conflict monitoring model fails to predict the relationship between error likelihood and RT, and (2) the dMFC activity is not sensitive to congruency, error likelihood, or response conflict, but is monotonically related to time on task.
Collapse
|
34
|
Suboptimal integration of reward magnitude and prior reward likelihood in categorical decisions by monkeys. Front Neurosci 2010; 4:186. [PMID: 21151367 PMCID: PMC2996133 DOI: 10.3389/fnins.2010.00186] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2010] [Accepted: 10/16/2010] [Indexed: 11/13/2022] Open
Abstract
Sensory decisions may be influenced by non-sensory information regarding reward magnitude or reward likelihood. Given identical sensory information, it is more optimal to choose an option if it is a priori more likely to be correct and hence rewarded (prior reward likelihood bias), or if it yields a larger reward, given that it is the correct choice (reward magnitude bias). Here, we investigated the ability of macaque monkeys to integrate reward magnitude and prior reward likelihood information into a categorical decision about stimuli with high signal strength but variable decision uncertainty. In the asymmetric reward magnitude condition, monkeys over-adjusted their decision criterion such that they chose the highly rewarded alternative far more often than was optimal; in contrast, monkeys did not adjust their decision criterion in response to asymmetric reward likelihood. This finding shows that in this setting, monkeys did not adjust their decision criterion based on the product of reward likelihood and reward magnitude as has been reported to be the case in value-based decisions that do not involve decision uncertainty due to stimulus categorization.
Collapse
|
35
|
Effects of heartbeat and respiration on macaque fMRI: implications for functional connectivity. Neuropsychologia 2009; 48:1886-94. [PMID: 19969009 DOI: 10.1016/j.neuropsychologia.2009.11.026] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2009] [Revised: 10/26/2009] [Accepted: 11/27/2009] [Indexed: 11/17/2022]
Abstract
The use of functional magnetic resonance imaging (fMRI) in non-human primates is on the increase. It is known that the blood-oxygen-level-dependent (BOLD) signal varies not only as a function of local neuronal energy consumption but also as a function of cardiac and respiratory activity. We mapped these cyclic cardiac and respiratory artifacts in anesthetized macaque monkeys and present an objective analysis of their impact on estimates of functional connectivity (fcMRI). Voxels with significant cardiac and respiratory artifacts were found in much the same regions as previously reported for awake humans. We show two example seeds where removing the artifacts clearly decreased the number of false positive and false negative correlations. In particular, removing the artifacts reduced correlations in the so-called resting state network. Temporal bandpass filtering or spatial smoothing may help to reduce the effects of artifacts in some cases but are not an adequate replacement for an algorithm that explicitly models and removes cyclic cardiac and respiratory artifacts.
Collapse
|
36
|
Frontal eye field neurons signal changes in decision criteria. Nat Neurosci 2009; 12:1458-62. [PMID: 19855389 PMCID: PMC2770427 DOI: 10.1038/nn.2434] [Citation(s) in RCA: 67] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2009] [Accepted: 09/22/2009] [Indexed: 11/18/2022]
|
37
|
Detection of time-varying signals in event-related fMRI designs. Neuroimage 2008; 43:509-20. [PMID: 18775784 DOI: 10.1016/j.neuroimage.2008.07.065] [Citation(s) in RCA: 206] [Impact Index Per Article: 12.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2008] [Revised: 07/08/2008] [Accepted: 07/31/2008] [Indexed: 10/21/2022] Open
Abstract
In neuroimaging research on attention, cognitive control, decision-making, and other areas where response time (RT) is a critical variable, the temporal variability associated with the decision is often assumed to be inconsequential to the hemodynamic response (HDR) in rapid event-related designs. On this basis, the majority of published studies model brain activity lasting less than 4 s with brief impulses representing the onset of neural or cognitive events, which are then convolved with the hemodynamic impulse response function (HRF). However, electrophysiological studies have shown that decision-related neuronal activity is not instantaneous, but in fact, often lasts until the motor response. It is therefore possible that small differences in neural processing durations, similar to human RTs, will produce noticeable changes in the HDR, and therefore in the results of regression analyses. In this study we compare the effectiveness of traditional models that assume no temporal variance with a model that explicitly accounts for the duration of very brief epochs of neural activity. Using both simulations and fMRI data, we show that brief differences in duration are detectable, making it possible to dissociate the effects of stimulus intensity from stimulus duration, and that optimizing the model for the type of activity being detected improves the statistical power, consistency, and interpretability of results.
Collapse
|
38
|
Abstract
Due to delays in visuomotor processing, eye movements directed toward moving targets must integrate both target position and velocity to be accurate. It is unknown where and how target velocity information is incorporated into the planning of rapid (saccadic) eye movements. We recorded the activity of neurons in frontal eye fields (FEFs) while monkeys made saccades to stationary and moving targets. A substantial fraction of FEF neurons was found to encode not only the initial position of a moving target, but the metrics (amplitude and direction) of the saccade needed to intercept the target. Many neurons also encoded target velocity in a nearly linear manner. The quasi-linear dependence of firing rate on target velocity means that the neuronal response can be directly read out to compute the future position of a target moving with constant velocity. This is demonstrated using a quantitative model in which saccade amplitude is encoded in the population response of neurons tuned to retinal target position and modulated by target velocity.
Collapse
|
39
|
Abstract
Saccadic eye movements remain spatially accurate even when the target becomes invisible and the initial eye position is perturbed. The brain accomplishes this in part by remapping the remembered target location in retinal coordinates. The computation that underlies this visual remapping is approximated by vector subtraction: the original saccade vector is updated by subtracting the vector corresponding to the intervening eye movement. The neural mechanism by which vector subtraction is implemented is not fully understood. Here, we investigate vector subtraction within a framework in which eye position and retinal target position signals interact multiplicatively (gain field). When the eyes move, they induce a spatial modulation of the firing rates across a retinotopic map of neurons. The updated saccade metric can be read from the shift of the peak of the population activity across the map. This model uses a quasi-linear (half-rectified) dependence on the eye position and requires the slope of the eye position input to be negatively proportional to the preferred retinal position of each neuron. We derive analytically this constraint and study its range of validity. We discuss how this mechanism relates to experimental results reported in the frontal eye fields of macaque monkeys.
Collapse
|
40
|
Abstract
The coordination of saccadic and smooth pursuit eye movements in macaque monkeys was investigated using a target selection paradigm with two moving targets crossing at a center fixation point. A task in which monkeys selected a target based on its color was used to test the hypothesis that common neural signals underlie target selection for pursuit and saccades, as well as testing whether target selection signals are available to the saccade and pursuit systems simultaneously or sequentially. Several combinations of target color, speed, and direction were used. In all cases, smooth pursuit was highly selective for the rewarded target before any saccade occurred. On >80% of the trials, the saccade was directed toward the same target as both pre- and postsaccadic pursuit. The results favor a model in which a shared target selection signal is simultaneously available to both the saccade and pursuit systems, rather than a sequential model.
Collapse
|
41
|
Abstract
Signals related to eye position are essential for visual perception and eye movements, and are powerful modulators of sensory responses in many regions of the visual and oculomotor systems. We show that visual and pre-saccadic responses of frontal eye field (FEF) neurons are modulated by initial eye position in a way suggestive of a multiplicative mechanism (gain field). Furthermore the slope of the eye position sensitivity tends to be negatively correlated with preferred retinal position across the population. A model with Gaussian visual receptive fields and linear-rectified eye position gain fields accounts for a large portion of the variance in the recorded data. Using physiologically derived parameters, this model is able to subtract the gaze shift from the vector representing the retinal location of the target. This computation might be used to maintain a memory of target location in space during ongoing eye movements. This updated spatial memory can be read directly from the locus of the peak of activity across the retinotopic map of FEF and it is the result of a vector subtraction between retinal target location when flashed and subsequent eye displacement in the dark.
Collapse
|
42
|
|
43
|
Modulation of Visual Responses in Macaque Frontal Eye Field during Covert Tracking of Invisible Targets. Cereb Cortex 2006; 17:918-28. [PMID: 16723405 DOI: 10.1093/cercor/bhl002] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
The purpose of this study was to investigate the interaction between internal representations of invisible moving targets and visual responses of neurons in frontal eye fields (FEFs). Monkeys were trained to make saccades to the extrapolated position of a target that was temporarily rendered invisible for variable durations as if it had passed behind an occluder. Flashed, task-irrelevant visual probe stimuli were used to study the visual responsiveness of FEF neurons during this task. Probes were flashed at various times and locations during the occlusion interval. Net changes in neuronal activity were obtained by comparing the activity on trials with probes with randomly interleaved trials without any probe. Most neurons showed an increase in firing rate in response to the probe, but some showed a decrease. Both types of responses were enhanced when the invisible target moved toward the receptive field (RF) as compared with trials on which the target moved away from the RF. Some neurons showed a spatial shift in the visual response during the occlusion interval. For cells that were excited by the probe, the shift tended to be correlated with the direction of motion of the target, whereas for cells that were inhibited the shift tended to be in the opposite direction. These results suggest that the role of FEF in predicting invisible target motion includes a sensory/perceptual component.
Collapse
|
44
|
A neural representation of categorization uncertainty in the human brain. Neuron 2006; 49:757-63. [PMID: 16504950 DOI: 10.1016/j.neuron.2006.01.032] [Citation(s) in RCA: 242] [Impact Index Per Article: 13.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2005] [Revised: 11/10/2005] [Accepted: 01/24/2006] [Indexed: 11/25/2022]
Abstract
The ability to classify visual objects into discrete categories ("friend" versus "foe"; "edible" versus "poisonous") is essential for survival and is a fundamental cognitive function. The cortical substrates that mediate this function, however, have not been identified in humans. To identify brain regions involved in stimulus categorization, we developed a task in which subjects classified stimuli according to a variable categorical boundary. Psychophysical functions were used to define a decision variable, categorization uncertainty, which was systematically manipulated. Using event-related functional MRI, we discovered that activity in a fronto-striatal-thalamic network, consisting of the medial frontal gyrus, anterior insula, ventral striatum, and dorsomedial thalamus, was modulated by categorization uncertainty. We found this network to be distinct from the frontoparietal attention network, consisting of the frontal and parietal eye fields, where activity was not correlated with categorization uncertainty.
Collapse
|
45
|
Abstract
Keeping pace with a constantly changing world requires the ability to make predictions about the future on a variety of timescales. A very basic example of this is the ability to predict the future location of a moving object in the brief time that it takes to perceive and respond to that object. In this issue of Neuron, experiments by Sundberg, Fallah, and Reynolds reveal a potential neural substrate for making short-range predictions about motion in visual area V4.
Collapse
|
46
|
Abstract
The visual responsiveness and spatial tuning of frontal eye field (FEF) neurons were determined using a delayed memory saccade task. Neurons with visual responses were then tested for direction selectivity using moving random dot patterns centered in the visual receptive field. The preferred axis of motion showed a significant tendency to be aligned with the receptive-field location so as to favor motion toward or away from the center of gaze. Centrifugal (outward) motion was preferred over centripetal motion. Motion-sensitive neurons in FEF thus appear to have a direction bias at the population level. This bias may facilitate the detection or discrimination of expanding optic flow patterns. The direction bias is similar to that seen in visual area MT and in posterior parietal cortex, from which FEF receives afferent projections. The outward motion bias may explain asymmetries in saccades made to moving targets. A representation of optic flow in FEF might be useful for planning eye movements during navigation.
Collapse
|
47
|
Perception, memory, and action in frontal and parietal cortex. Focus on "Selection and maintenance of saccade goals in the human frontal eye fields". J Neurophysiol 2006; 95:3309-10. [PMID: 16510779 DOI: 10.1152/jn.00163.2006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
|
48
|
Effects of electrical microstimulation in monkey frontal eye field on saccades to remembered targets. Vision Res 2006; 45:3414-29. [PMID: 15893784 DOI: 10.1016/j.visres.2005.03.014] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2005] [Revised: 03/14/2005] [Accepted: 03/26/2005] [Indexed: 10/25/2022]
Abstract
Spatially selective delay activity in the frontal eye field (FEF) is hypothesized to be part of a mechanism for the transformation of visual signals into instructions for voluntary movements. To understand the linkage between FEF activity and eye movement planning, we recorded neuronal responses of FEF neurons while monkeys performed a memory-saccade task. We then electrically stimulated the same sites during the memory-delay epoch of the task. The stimulation currents used were subthreshold for evoking saccades during a gap-fixation task. Microstimulation resulted in changes in the spatial and temporal components of saccade parameters: an increase in latency, and a shift in amplitude and direction. We performed a vector analysis to determine the relative influence of the visual cue and electrical stimulus on the memory-saccade. In general, the memory-saccade was strongly weighted toward the visual cue direction, yet the electrical stimulus introduced a consistent bias away from the receptive/movement field of the stimulation site. The effects of sub-threshold stimulation were consistent with a combination of vector subtraction and averaging, but not with vector summation. Vector subtraction may play a role in spatial updating of movement plans for memory-guided saccades when eye position changes during the memory period.
Collapse
|
49
|
|
50
|
Abstract
A long-standing issue concerning the executive function of the primate dorsolateral prefrontal cortex is how the activity of prefrontal neurons is linked to behavioral response selection. To establish a functional relationship between prefrontal memory fields and saccade target selection, we trained three macaque monkeys to make saccades to the remembered location of a visual cue in a delayed spatial match-to-sample saccade task. We electrically stimulated sites in the prefrontal cortex with subthreshold currents during the delay epoch while monkeys performed this task. Our results show that the artificially injected signal interacts with the neural activity responsible for target selection, biasing saccade choices either towards the receptive/movement field (RF/MF) or away from the RF/MF, depending on the stimulation site. These findings might reflect a functional link between prefrontal signals responsible for the selection bias by modulating the balance between excitation and inhibition in the competitive interactions underlying behavioral selection.
Collapse
|