1
|
Xue C, Markman SK, Chen R, Kramer LE, Cohen MR. Task interference as a neuronal basis for the cost of cognitive flexibility. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.04.583375. [PMID: 38496626 PMCID: PMC10942291 DOI: 10.1101/2024.03.04.583375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Abstract
Humans and animals have an impressive ability to juggle multiple tasks in a constantly changing environment. This flexibility, however, leads to decreased performance under uncertain task conditions. Here, we combined monkey electrophysiology, human psychophysics, and artificial neural network modeling to investigate the neuronal mechanisms of this performance cost. We developed a behavioural paradigm to measure and influence participants' decision-making and perception in two distinct perceptual tasks. Our data revealed that both humans and monkeys, unlike an artificial neural network trained for the same tasks, make less accurate perceptual decisions when the task is uncertain. We generated a mechanistic hypothesis by comparing this neural network trained to produce correct choices with another network trained to replicate the participants' choices. We hypothesized, and confirmed with further behavioural, physiological, and causal experiments, that the cost of task flexibility comes from what we term task interference. Under uncertain conditions, interference between different tasks causes errors because it results in a stronger representation of irrelevant task features and entangled neuronal representations of different features. Our results suggest a tantalizing, general hypothesis: that cognitive capacity limitations, both in health and disease, stem from interference between neural representations of different stimuli, tasks, or memories.
Collapse
Affiliation(s)
- Cheng Xue
- Department of Neurobiology, University of Chicago, IL, USA
| | - Sol K Markman
- Department of Neurobiology, University of Chicago, IL, USA
- Department of Brain & Cognitive Sciences, Massachusetts Institute of Technology, MA, USA
| | - Ruoyi Chen
- Department of Biological Sciences, Carnegie Mellon University, PA, USA
| | - Lily E Kramer
- Department of Neurobiology, University of Chicago, IL, USA
| | | |
Collapse
|
2
|
Langdon C, Genkin M, Engel TA. A unifying perspective on neural manifolds and circuits for cognition. Nat Rev Neurosci 2023; 24:363-377. [PMID: 37055616 PMCID: PMC11058347 DOI: 10.1038/s41583-023-00693-x] [Citation(s) in RCA: 19] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/06/2023] [Indexed: 04/15/2023]
Abstract
Two different perspectives have informed efforts to explain the link between the brain and behaviour. One approach seeks to identify neural circuit elements that carry out specific functions, emphasizing connectivity between neurons as a substrate for neural computations. Another approach centres on neural manifolds - low-dimensional representations of behavioural signals in neural population activity - and suggests that neural computations are realized by emergent dynamics. Although manifolds reveal an interpretable structure in heterogeneous neuronal activity, finding the corresponding structure in connectivity remains a challenge. We highlight examples in which establishing the correspondence between low-dimensional activity and connectivity has been possible, unifying the neural manifold and circuit perspectives. This relationship is conspicuous in systems in which the geometry of neural responses mirrors their spatial layout in the brain, such as the fly navigational system. Furthermore, we describe evidence that, in systems in which neural responses are heterogeneous, the circuit comprises interactions between activity patterns on the manifold via low-rank connectivity. We suggest that unifying the manifold and circuit approaches is important if we are to be able to causally test theories about the neural computations that underlie behaviour.
Collapse
Affiliation(s)
- Christopher Langdon
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
| | - Mikhail Genkin
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
| | - Tatiana A Engel
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA.
| |
Collapse
|
3
|
Jaffe PI, Poldrack RA, Schafer RJ, Bissett PG. Modelling human behaviour in cognitive tasks with latent dynamical systems. Nat Hum Behav 2023:10.1038/s41562-022-01510-8. [PMID: 36658212 DOI: 10.1038/s41562-022-01510-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Accepted: 12/06/2022] [Indexed: 01/21/2023]
Abstract
Response time data collected from cognitive tasks are a cornerstone of psychology and neuroscience research, yet existing models of these data either make strong assumptions about the data-generating process or are limited to modelling single trials. We introduce task-DyVA, a deep learning framework in which expressive dynamical systems are trained to reproduce sequences of response times observed in data from individual human subjects. Models fitted to a large task-switching dataset captured subject-specific behavioural differences with high temporal precision, including task-switching costs. Through perturbation experiments and analyses of the models' latent dynamics, we find support for a rational account of switch costs in terms of a stability-flexibility trade-off. Thus, our framework can be used to discover interpretable cognitive theories that explain how the brain dynamically gives rise to behaviour.
Collapse
Affiliation(s)
- Paul I Jaffe
- Department of Psychology, Stanford University, Stanford, CA, USA. .,Lumos Labs, San Francisco, CA, USA.
| | | | | | | |
Collapse
|
4
|
Sasaki R, Kumano H, Mitani A, Suda Y, Uka T. Task-Specific Employment of Sensory Signals Underlies Rapid Task Switching. Cereb Cortex 2022; 32:4657-4670. [PMID: 35088074 DOI: 10.1093/cercor/bhab508] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Revised: 12/09/2021] [Accepted: 12/10/2021] [Indexed: 11/13/2022] Open
Abstract
Much of our flexible behavior is dependent on responding efficiently to relevant information while discarding irrelevant information. Little is known, however, about how neural pathways governing sensory-motor associations can rapidly switch to accomplish such flexibility. Here, we addressed this question by electrically microstimulating middle temporal (MT) neurons selective for both motion direction and binocular disparity in monkeys switching between direction and depth discrimination tasks. Surprisingly, we frequently found that the observed psychophysical bias precipitated by delivering microstimulation to neurons whose preferred direction and depth were related to opposite choices in the two tasks was substantially shifted toward a specific movement. Furthermore, these effects correlated with behavioral switching performance. Our findings suggest that the outputs of sensory signals are task specific and that irrelevant sensory-motor pathways are gated depending on task demand so as to accomplish rapid attentional switching.
Collapse
Affiliation(s)
- Ryo Sasaki
- Department of Neuroscience, Graduate School of Medicine, Kyoto University, Kyoto 606-8501, Japan
| | - Hironori Kumano
- Department of Integrative Physiology, Graduate School of Medicine, University of Yamanashi, Yamanashi 409-3898, Japan
- Department of Neurophysiology, Juntendo University Graduate School of Medicine, Tokyo 113-8421, Japan
| | | | - Yuki Suda
- Department of Integrative Physiology, Graduate School of Medicine, University of Yamanashi, Yamanashi 409-3898, Japan
- Department of Neurophysiology, Juntendo University Graduate School of Medicine, Tokyo 113-8421, Japan
- Brain Science Institute, Tamagawa University, Tokyo 194-8610, Japan
| | - Takanori Uka
- Department of Integrative Physiology, Graduate School of Medicine, University of Yamanashi, Yamanashi 409-3898, Japan
- Department of Neurophysiology, Juntendo University Graduate School of Medicine, Tokyo 113-8421, Japan
- Brain Science Institute, Tamagawa University, Tokyo 194-8610, Japan
| |
Collapse
|
5
|
Pettine WW, Louie K, Murray JD, Wang XJ. Excitatory-inhibitory tone shapes decision strategies in a hierarchical neural network model of multi-attribute choice. PLoS Comput Biol 2021; 17:e1008791. [PMID: 33705386 PMCID: PMC7987200 DOI: 10.1371/journal.pcbi.1008791] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Revised: 03/23/2021] [Accepted: 02/15/2021] [Indexed: 12/14/2022] Open
Abstract
We are constantly faced with decisions between alternatives defined by multiple attributes, necessitating an evaluation and integration of different information sources. Time-varying signals in multiple brain areas are implicated in decision-making; but we lack a rigorous biophysical description of how basic circuit properties, such as excitatory-inhibitory (E/I) tone and cascading nonlinearities, shape attribute processing and choice behavior. Furthermore, how such properties govern choice performance under varying levels of environmental uncertainty is unknown. We investigated two-attribute, two-alternative decision-making in a dynamical, cascading nonlinear neural network with three layers: an input layer encoding choice alternative attribute values; an intermediate layer of modules processing separate attributes; and a final layer producing the decision. Depending on intermediate layer E/I tone, the network displays distinct regimes characterized by linear (I), convex (II) or concave (III) choice indifference curves. In regimes I and II, each option's attribute information is additively integrated. In regime III, time-varying nonlinear operations amplify the separation between offer distributions by selectively attending to the attribute with the larger differences in input values. At low environmental uncertainty, a linear combination most consistently selects higher valued alternatives. However, at high environmental uncertainty, regime III is more likely than a linear operation to select alternatives with higher value. Furthermore, there are conditions where readout from the intermediate layer could be experimentally indistinguishable from the final layer. Finally, these principles are used to examine multi-attribute decisions in systems with reduced inhibitory tone, leading to predictions of different choice patterns and overall performance between those with restrictions on inhibitory tone and neurotypicals.
Collapse
Affiliation(s)
- Warren Woodrich Pettine
- Center for Neural Science, New York University, New York, United States of America
- Department of Psychiatry, Yale University School of Medicine, New Haven, United States of America
| | - Kenway Louie
- Center for Neural Science, New York University, New York, United States of America
| | - John D. Murray
- Department of Psychiatry, Yale University School of Medicine, New Haven, United States of America
| | - Xiao-Jing Wang
- Center for Neural Science, New York University, New York, United States of America
| |
Collapse
|
6
|
Vezoli J, Magrou L, Goebel R, Wang XJ, Knoblauch K, Vinck M, Kennedy H. Cortical hierarchy, dual counterstream architecture and the importance of top-down generative networks. Neuroimage 2021; 225:117479. [PMID: 33099005 PMCID: PMC8244994 DOI: 10.1016/j.neuroimage.2020.117479] [Citation(s) in RCA: 42] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2020] [Revised: 09/29/2020] [Accepted: 10/15/2020] [Indexed: 12/18/2022] Open
Abstract
Hierarchy is a major organizational principle of the cortex and underscores modern computational theories of cortical function. The local microcircuit amplifies long-distance inter-areal input, which show distance-dependent changes in their laminar profiles. Statistical modeling of these changes in laminar profiles demonstrates that inputs from multiple hierarchical levels to their target areas show remarkable consistency, allowing the construction of a cortical hierarchy based on a principle of hierarchical distance. The statistical modeling that is applied to structure can also be applied to laminar differences in the oscillatory coherence between areas thereby determining a functional hierarchy of the cortex. Close examination of the anatomy of inter-areal connectivity reveals a dual counterstream architecture with well-defined distance-dependent feedback and feedforward pathways in both the supra- and infragranular layers, suggesting a multiplicity of feedback pathways with well-defined functional properties. These findings are consistent with feedback connections providing a generative network involved in a wide range of cognitive functions. A dynamical model constrained by connectivity data sheds insight into the experimentally observed signatures of frequency-dependent Granger causality for feedforward versus feedback signaling. Concerted experiments capitalizing on recent technical advances and combining tract-tracing, high-resolution fMRI, optogenetics and mathematical modeling hold the promise of a much improved understanding of lamina-constrained mechanisms of neural computation and cognition. However, because inter-areal interactions involve cortical layers that have been the target of important evolutionary changes in the primate lineage, these investigations will need to include human and non-human primate comparisons.
Collapse
Affiliation(s)
- Julien Vezoli
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany
| | - Loïc Magrou
- Univ Lyon, Université Claude Bernard Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, 69500 Bron, France
| | - Rainer Goebel
- Faculty of Psychology and Neuroscience, Department of Cognitive Neuroscience, Maastricht University, P.O. Box 616, 6200 MD, Maastricht, the Netherlands
| | - Xiao-Jing Wang
- Center for Neural Science, New York University (NYU), New York, NY 10003, USA
| | - Kenneth Knoblauch
- Univ Lyon, Université Claude Bernard Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, 69500 Bron, France
| | - Martin Vinck
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany.
| | - Henry Kennedy
- Univ Lyon, Université Claude Bernard Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, 69500 Bron, France; Institute of Neuroscience, State Key Laboratory of Neuroscience, Chinese Academy of Sciences (CAS) Key Laboratory of Primate Neurobiology, CAS, Shanghai 200031, China.
| |
Collapse
|
7
|
Sherfey J, Ardid S, Miller EK, Hasselmo ME, Kopell NJ. Prefrontal oscillations modulate the propagation of neuronal activity required for working memory. Neurobiol Learn Mem 2020; 173:107228. [PMID: 32561459 DOI: 10.1016/j.nlm.2020.107228] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2019] [Revised: 02/01/2020] [Accepted: 04/01/2020] [Indexed: 01/11/2023]
Abstract
Cognition involves using attended information, maintained in working memory (WM), to guide action. During a cognitive task, a correct response requires flexible, selective gating so that only the appropriate information flows from WM to downstream effectors that carry out the response. In this work, we used biophysically-detailed modeling to explore the hypothesis that network oscillations in prefrontal cortex (PFC), leveraging local inhibition, can independently gate responses to items in WM. The key role of local inhibition was to control the period between spike bursts in the outputs, and to produce an oscillatory response no matter whether the WM item was maintained in an asynchronous or oscillatory state. We found that the WM item that induced an oscillatory population response in the PFC output layer with the shortest period between spike bursts was most reliably propagated. The network resonant frequency (i.e., the input frequency that produces the largest response) of the output layer can be flexibly tuned by varying the excitability of deep layer principal cells. Our model suggests that experimentally-observed modulation of PFC beta-frequency (15-30 Hz) and gamma-frequency (30-80 Hz) oscillations could leverage network resonance and local inhibition to govern the flexible routing of signals in service to cognitive processes like gating outputs from working memory and the selection of rule-based actions. Importantly, we show for the first time that nonspecific changes in deep layer excitability can tune the output gate's resonant frequency, enabling the specific selection of signals encoded by populations in asynchronous or fast oscillatory states. More generally, this represents a dynamic mechanism by which adjusting network excitability can govern the propagation of asynchronous and oscillatory signals throughout neocortex.
Collapse
Affiliation(s)
- Jason Sherfey
- Center for Systems Neuroscience, Department of Psychological and Brain Sciences, Boston University, MA 02215, United States; The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA 02139, United States; Department of Mathematics and Statistics, Boston University, Boston, MA 02215, United States.
| | - Salva Ardid
- Department of Mathematics and Statistics, Boston University, Boston, MA 02215, United States; Department of Comparative Medicine, Yale University School of Medicine, New Haven, CT 06510, United States
| | - Earl K Miller
- The Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA 02139, United States
| | - Michael E Hasselmo
- Center for Systems Neuroscience, Department of Psychological and Brain Sciences, Boston University, MA 02215, United States
| | - Nancy J Kopell
- Department of Mathematics and Statistics, Boston University, Boston, MA 02215, United States.
| |
Collapse
|
8
|
Confais J, Malfait N, Brochier T, Riehle A, Kilavik BE. Is there an Intrinsic Relationship between LFP Beta Oscillation Amplitude and Firing Rate of Individual Neurons in Macaque Motor Cortex? Cereb Cortex Commun 2020; 1:tgaa017. [PMID: 34296095 PMCID: PMC8152857 DOI: 10.1093/texcom/tgaa017] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Revised: 03/25/2020] [Accepted: 05/07/2020] [Indexed: 11/18/2022] Open
Abstract
The properties of motor cortical local field potential (LFP) beta oscillations have been extensively studied. Their relationship to the local neuronal spiking activity was also addressed. Yet, whether there is an intrinsic relationship between the amplitude of beta oscillations and the firing rate of individual neurons remains controversial. Some studies suggest a mapping of spike rate onto beta amplitude, while others find no systematic relationship. To help resolve this controversy, we quantified in macaque motor cortex the correlation between beta amplitude and neuronal spike count during visuomotor behavior. First, in an analysis termed “task-related correlation”, single-trial data obtained across all trial epochs were included. These correlations were significant in up to 32% of cases and often strong. However, a trial-shuffling control analysis recombining beta amplitudes and spike counts from different trials revealed these task-related correlations to reflect systematic, yet independent, modulations of the 2 signals with the task. Second, in an analysis termed “trial-by-trial correlation”, only data from fixed trial epochs were included, and correlations were calculated across trials. Trial-by-trial correlations were weak and rarely significant. We conclude that there is no intrinsic relationship between the firing rate of individual neurons and LFP beta oscillation amplitude in macaque motor cortex.
Collapse
Affiliation(s)
- Joachim Confais
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France.,Cynbiose, Marcy l'Étoile 69280, France
| | - Nicole Malfait
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France
| | - Thomas Brochier
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France
| | - Alexa Riehle
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France.,Institute of Neuroscience and Medicine (INM-6), Jülich Research Centre, Jülich 52428, Germany
| | - Bjørg Elisabeth Kilavik
- Institut de Neurosciences de la Timone (INT), UMR 7289, CNRS, Aix-Marseille Université, Marseille 13005, France
| |
Collapse
|
9
|
Fleischer P, Hélie S. A unified model of rule-set learning and selection. Neural Netw 2020; 124:343-356. [PMID: 32044561 DOI: 10.1016/j.neunet.2020.01.028] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2019] [Revised: 01/21/2020] [Accepted: 01/23/2020] [Indexed: 10/25/2022]
Abstract
The ability to focus on relevant information and ignore irrelevant information is a fundamental part of intelligent behavior. It not only allows faster acquisition of new tasks by reducing the size of the problem space but also allows for generalizations to novel stimuli. Task-switching, task-sets, and rule-set learning are all intertwined with this ability. There are many models that attempt to individually describe these cognitive abilities. However, there are few models that try to capture the breadth of these topics in a unified model and fewer still that do it while adhering to the biological constraints imposed by the findings from the field of neuroscience. Presented here is a comprehensive model of rule-set learning and selection that can capture the learning curve results, error-type data, and transfer effects found in rule-learning studies while also replicating the reaction time data and various related effects of task-set and task-switching experiments. The model also factors in many disparate neurological findings, several of which are often disregarded by similar models.
Collapse
|
10
|
Ebitz RB, Sleezer BJ, Jedema HP, Bradberry CW, Hayden BY. Tonic exploration governs both flexibility and lapses. PLoS Comput Biol 2019; 15:e1007475. [PMID: 31703063 PMCID: PMC6867658 DOI: 10.1371/journal.pcbi.1007475] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Revised: 11/20/2019] [Accepted: 10/10/2019] [Indexed: 11/20/2022] Open
Abstract
In many cognitive tasks, lapses (spontaneous errors) are tacitly dismissed as the result of nuisance processes like sensorimotor noise, fatigue, or disengagement. However, some lapses could also be caused by exploratory noise: randomness in behavior that facilitates learning in changing environments. If so, then strategic processes would need only up-regulate (rather than generate) exploration to adapt to a changing environment. This view predicts that more frequent lapses should be associated with greater flexibility because these behaviors share a common cause. Here, we report that when rhesus macaques performed a set-shifting task, lapse rates were negatively correlated with perseverative error frequency across sessions, consistent with a common basis in exploration. The results could not be explained by local failures to learn. Furthermore, chronic exposure to cocaine, which is known to impair cognitive flexibility, did increase perseverative errors, but, surprisingly, also improved overall set-shifting task performance by reducing lapse rates. We reconcile these results with a state-switching model in which cocaine decreases exploration by deepening attractor basins corresponding to rule states. These results support the idea that exploratory noise contributes to lapses, affecting rule-based decision-making even when it has no strategic value, and suggest that one key mechanism for regulating exploration may be the depth of rule states.
Collapse
Affiliation(s)
- R. Becket Ebitz
- Department of Neuroscience and Center for Magnetic Resonance Research University of Minnesota, Minneapolis, MN, United States of America
| | - Brianna J. Sleezer
- Department of Neurobiology and Behavior, Cornell University, Ithaca, NY, United States of America
| | - Hank P. Jedema
- NIDA Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, United States of America
| | - Charles W. Bradberry
- NIDA Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, United States of America
| | - Benjamin Y. Hayden
- Department of Neuroscience and Center for Magnetic Resonance Research University of Minnesota, Minneapolis, MN, United States of America
| |
Collapse
|
11
|
Engel TA, Steinmetz NA. New perspectives on dimensionality and variability from large-scale cortical dynamics. Curr Opin Neurobiol 2019; 58:181-190. [PMID: 31585331 PMCID: PMC6859189 DOI: 10.1016/j.conb.2019.09.003] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2019] [Revised: 07/27/2019] [Accepted: 09/05/2019] [Indexed: 12/21/2022]
Abstract
The neocortex is a multi-scale network, with intricate local circuitry interwoven into a global mesh of long-range connections. Neural activity propagates within this network on a wide range of temporal and spatial scales. At the micro scale, neurophysiological recordings reveal coordinated dynamics in local neural populations, which support behaviorally relevant computations. At the macro scale, neuroimaging modalities measure global activity fluctuations organized into spatiotemporal patterns across the entire brain. Here we review recent advances linking the local and global scales of cortical dynamics and their relationship to behavior. We argue that diverse experimental observations on the dimensionality and variability of neural activity can be reconciled by considering how activity propagates in space and time on multiple spatial scales.
Collapse
Affiliation(s)
- Tatiana A Engel
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, United States.
| | - Nicholas A Steinmetz
- Department of Biological Structure, University of Washington, Seattle, WA 98195, United States.
| |
Collapse
|
12
|
Yim MY, Cai X, Wang XJ. Transforming the Choice Outcome to an Action Plan in Monkey Lateral Prefrontal Cortex: A Neural Circuit Model. Neuron 2019; 103:520-532.e5. [PMID: 31230761 DOI: 10.1016/j.neuron.2019.05.032] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2018] [Revised: 02/14/2019] [Accepted: 05/21/2019] [Indexed: 11/28/2022]
Abstract
In economic decisions, we make a good-based choice first, then we transform the outcome into an action to obtain the good. To elucidate the network mechanisms for such transformation, we constructed a neural circuit model consisting of modules representing choice, integration of choice with target locations, and the final action plan. We examined three scenarios regarding how the final action plan could emerge in the neural circuit and compared their implications with experimental data. Our model with heterogeneous connectivity predicts the coexistence of three types of neurons with distinct functions, confirmed by analyzing the neural activity in the lateral prefrontal cortex (LPFC) of behaving monkeys. We obtained a much more distinct classification of functional neuron types in the ventral than the dorsal region of LPFC, suggesting that the action plan is initially generated in ventral LPFC. Our model offers a biologically plausible neural circuit architecture that implements good-to-action transformation during economic choice.
Collapse
Affiliation(s)
- Man Yi Yim
- New York University Shanghai, Shanghai, 200122, China; NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, 200062, China; Present address: Center for Theoretical and Computational Neuroscience and Department of Neuroscience, University of Texas at Austin, Austin, TX 78712, USA
| | - Xinying Cai
- New York University Shanghai, Shanghai, 200122, China; NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, 200062, China; Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, 200062, China.
| | - Xiao-Jing Wang
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, 200062, China; Center for Neural Science, New York University, New York, NY 10003, USA; Shanghai Research Center for Brain Science and Brain-Inspired Intelligence, Zhangjiang Laboratory, Shanghai 201210, China.
| |
Collapse
|
13
|
Biased competition in the absence of input bias revealed through corticostriatal computation. Proc Natl Acad Sci U S A 2019; 116:8564-8569. [PMID: 30962383 DOI: 10.1073/pnas.1812535116] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
Classical accounts of biased competition require an input bias to resolve the competition between neuronal ensembles driving downstream processing. However, flexible and reliable selection of behaviorally relevant ensembles can occur with unbiased stimulation: striatal D1 and D2 spiny projection neurons (SPNs) receive balanced cortical input, yet their activity determines the choice between GO and NO-GO pathways in the basal ganglia. We here present a corticostriatal model identifying three mechanisms that rely on physiological asymmetries to effect rate- and time-coded biased competition in the presence of balanced inputs. First, tonic input strength determines which one of the two SPN phenotypes exhibits a higher mean firing rate. Second, low-strength oscillatory inputs induce higher firing rate in D2 SPNs but higher coherence between D1 SPNs. Third, high-strength inputs oscillating at distinct frequencies can preferentially activate D1 or D2 SPN populations. Of these mechanisms, only the latter accommodates observed rhythmic activity supporting rule-based decision making in prefrontal cortex.
Collapse
|
14
|
Visuomotor Correlates of Conflict Expectation in the Context of Motor Decisions. J Neurosci 2018; 38:9486-9504. [PMID: 30201772 DOI: 10.1523/jneurosci.0623-18.2018] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2018] [Revised: 07/28/2018] [Accepted: 09/01/2018] [Indexed: 01/18/2023] Open
Abstract
Many behaviors require choosing between conflicting options competing against each other in visuomotor areas. Such choices can benefit from top-down control processes engaging frontal areas in advance of conflict when it is anticipated. Yet, very little is known about how this proactive control system shapes the visuomotor competition. Here, we used electroencephalography in human subjects (male and female) to identify the visual and motor correlates of conflict expectation in a version of the Eriksen Flanker task that required left or right responses according to the direction of a central target arrow surrounded by congruent or incongruent (conflicting) flankers. Visual conflict was either highly expected (it occurred in 80% of trials; mostly incongruent blocks) or very unlikely (20% of trials; mostly congruent blocks). We evaluated selective attention in the visual cortex by recording target- and flanker-related steady-state visual-evoked potentials (SSVEPs) and probed action selection by measuring response-locked potentials (RLPs) in the motor cortex. Conflict expectation enhanced accuracy in incongruent trials, but this improvement occurred at the cost of speed in congruent trials. Intriguingly, this behavioral adjustment occurred while visuomotor activity was less finely tuned: target-related SSVEPs were smaller while flanker-related SSVEPs were higher in mostly incongruent blocks than in mostly congruent blocks, and incongruent trials were associated with larger RLPs in the ipsilateral (nonselected) motor cortex. Hence, our data suggest that conflict expectation recruits control processes that augment the tolerance for inappropriate visuomotor activations (rather than processes that downregulate their amplitude), allowing for overflow activity to occur without having it turn into the selection of an incorrect response.SIGNIFICANCE STATEMENT Motor choices made in front of discordant visual information are more accurate when conflict can be anticipated, probably due to the engagement of top-down control from frontal areas. How this control system modulates activity within visual and motor areas is unknown. Here, we show that, when control processes are recruited in anticipation of conflict, as evidenced by higher midfrontal theta activity, visuomotor activity is less finely tuned: visual processing of the goal-relevant location was reduced and the motor cortex displayed more inappropriate activations, compared with when conflict was unlikely. We argue that conflict expectation is associated with an expansion of the distance-to-selection threshold, improving accuracy while the need for online control of visuomotor activity is reduced.
Collapse
|
15
|
Calderini M, Zhang S, Berberian N, Thivierge JP. Optimal Readout of Correlated Neural Activity in a Decision-Making Circuit. Neural Comput 2018; 30:1573-1611. [PMID: 29652584 DOI: 10.1162/neco_a_01083] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
The neural correlates of decision making have been extensively studied with tasks involving a choice between two alternatives that is guided by visual cues. While a large body of work argues for a role of the lateral intraparietal (LIP) region of cortex in these tasks, this role may be confounded by the interaction between LIP and other regions, including medial temporal (MT) cortex. Here, we describe a simplified linear model of decision making that is adapted to two tasks: a motion discrimination and a categorization task. We show that the distinct contribution of MT and LIP may indeed be confounded in these tasks. In particular, we argue that the motion discrimination task relies on a straightforward visuomotor mapping, which leads to redundant information between MT and LIP. The categorization task requires a more complex mapping between visual information and decision behavior, and therefore does not lead to redundancy between MT and LIP. Going further, the model predicts that noise correlations within LIP should be greater in the categorization compared to the motion discrimination task due to the presence of shared inputs from MT. The impact of these correlations on task performance is examined by analytically deriving error estimates of an optimal linear readout for shared and unique inputs. Taken together, results clarify the contribution of MT and LIP to decision making and help characterize the role of noise correlations in these regions.
Collapse
Affiliation(s)
- Matias Calderini
- Center for Neural Dynamics and School of Psychology, University of Ottawa, Ontario K1N 6N5, Canada
| | - Sophie Zhang
- Center for Neural Dynamics and School of Psychology, University of Ottawa, Ontario K1N 6N5, Canada
| | - Nareg Berberian
- Center for Neural Dynamics and School of Psychology, University of Ottawa, Ontario K1N 6N5, Canada
| | - Jean-Philippe Thivierge
- Center for Neural Dynamics and School of Psychology, University of Ottawa, Ontario K1N 6N5, Canada
| |
Collapse
|
16
|
Chaisangmongkon W, Swaminathan SK, Freedman DJ, Wang XJ. Computing by Robust Transience: How the Fronto-Parietal Network Performs Sequential, Category-Based Decisions. Neuron 2017; 93:1504-1517.e4. [PMID: 28334612 DOI: 10.1016/j.neuron.2017.03.002] [Citation(s) in RCA: 94] [Impact Index Per Article: 13.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2016] [Revised: 09/30/2016] [Accepted: 02/27/2017] [Indexed: 10/19/2022]
Abstract
Decision making involves dynamic interplay between internal judgements and external perception, which has been investigated in delayed match-to-category (DMC) experiments. Our analysis of neural recordings shows that, during DMC tasks, LIP and PFC neurons demonstrate mixed, time-varying, and heterogeneous selectivity, but previous theoretical work has not established the link between these neural characteristics and population-level computations. We trained a recurrent network model to perform DMC tasks and found that the model can remarkably reproduce key features of neuronal selectivity at the single-neuron and population levels. Analysis of the trained networks elucidates that robust transient trajectories of the neural population are the key driver of sequential categorical decisions. The directions of trajectories are governed by network self-organized connectivity, defining a "neural landscape" consisting of a task-tailored arrangement of slow states and dynamical tunnels. With this model, we can identify functionally relevant circuit motifs and generalize the framework to solve other categorization tasks.
Collapse
Affiliation(s)
- Warasinee Chaisangmongkon
- Department of Neurobiology and Kavli Institute for Neuroscience, Yale University School of Medicine, New Haven, CT 06511, USA; Institute of Field Robotics, King Mongkut's University of Technology Thonburi, Bangkok 10140, Thailand
| | | | - David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA; Grossman Institute for Neuroscience, Quantitative Biology, and Human Behavior, Chicago, IL 60637, USA
| | - Xiao-Jing Wang
- Department of Neurobiology and Kavli Institute for Neuroscience, Yale University School of Medicine, New Haven, CT 06511, USA; Center for Neural Science, New York University, New York, NY 10003, USA; NYU-ECNU Joint Institute of Brain and Cognitive Science, NYU-Shanghai, Shanghai 200122, China.
| |
Collapse
|
17
|
Context-Dependent Accumulation of Sensory Evidence in the Parietal Cortex Underlies Flexible Task Switching. J Neurosci 2017; 36:12192-12202. [PMID: 27903728 DOI: 10.1523/jneurosci.1693-16.2016] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2016] [Revised: 10/06/2016] [Accepted: 10/12/2016] [Indexed: 11/21/2022] Open
Abstract
Switching behavior based on multiple rules is a fundamental ability of flexible behavior. Although interactions among the frontal, parietal, and sensory cortices are necessary for such flexibility, little is known about the neural computations concerning context-dependent information readouts. Here, we provide evidence that neurons in the lateral intraparietal area (LIP) accumulate relevant information preferentially depending on context. We trained monkeys to switch between direction and depth discrimination tasks and analyzed the buildup activity in the LIP depending on task context. In accordance with behavior, the rate of buildup to identical visual stimuli differed between tasks and buildup was prominent only for the stimulus dimension relevant to the task. These results indicate that LIP neurons accumulate relevant information depending on context to decide flexibly where to move the eye, suggesting that flexibility is, at least partly, implemented in the form of temporal integration gain control. SIGNIFICANCE STATEMENT Flexible behavior depending on context is a hallmark of human cognition. During flexible behavior, the frontal and parietal cortices have complex representations that hinder efforts to conceptualize their underlying computations. We now provide evidence that neurons in the lateral intraparietal area accumulate relevant information preferentially depending on context. We suggest that behavioral flexibility is implemented in the form of temporal integration gain control in the parietal cortex.
Collapse
|
18
|
Distributed representations of action sequences in anterior cingulate cortex: A recurrent neural network approach. Psychon Bull Rev 2017; 25:302-321. [DOI: 10.3758/s13423-017-1280-1] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|
19
|
Ye W, Liu S, Liu X, Yu Y. A neural model of the frontal eye fields with reward-based learning. Neural Netw 2016; 81:39-51. [PMID: 27284696 DOI: 10.1016/j.neunet.2016.05.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2015] [Revised: 05/03/2016] [Accepted: 05/06/2016] [Indexed: 11/24/2022]
Abstract
Decision-making is a flexible process dependent on the accumulation of various kinds of information; however, the corresponding neural mechanisms are far from clear. We extended a layered model of the frontal eye field to a learning-based model, using computational simulations to explain the cognitive process of choice tasks. The core of this extended model has three aspects: direction-preferred populations that cluster together the neurons with the same orientation preference, rule modules that control different rule-dependent activities, and reward-based synaptic plasticity that modulates connections to flexibly change the decision according to task demands. After repeated attempts in a number of trials, the network successfully simulated three decision choice tasks: an anti-saccade task, a no-go task, and an associative task. We found that synaptic plasticity could modulate the competition of choices by suppressing erroneous choices while enhancing the correct (rewarding) choice. In addition, the trained model captured some properties exhibited in animal and human experiments, such as the latency of the reaction time distribution of anti-saccades, the stop signal mechanism for canceling a reflexive saccade, and the variation of latency to half-max selectivity. Furthermore, the trained model was capable of reproducing the re-learning procedures when switching tasks and reversing the cue-saccade association.
Collapse
Affiliation(s)
- Weijie Ye
- School of Mathematics, South China University of Technology, Guangzhou, 510640, China
| | - Shenquan Liu
- School of Mathematics, South China University of Technology, Guangzhou, 510640, China.
| | - Xuanliang Liu
- School of Mathematics, South China University of Technology, Guangzhou, 510640, China
| | - Yuguo Yu
- Center for Computational Systems Biology, The State Key Laboratory of Medical Neurobiology and Institutes of Brain Science, Fudan University, School of Life Sciences, Shanghai, 200433, China
| |
Collapse
|
20
|
Balcarras M, Ardid S, Kaping D, Everling S, Womelsdorf T. Attentional Selection Can Be Predicted by Reinforcement Learning of Task-relevant Stimulus Features Weighted by Value-independent Stickiness. J Cogn Neurosci 2015; 28:333-49. [PMID: 26488586 DOI: 10.1162/jocn_a_00894] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Attention includes processes that evaluate stimuli relevance, select the most relevant stimulus against less relevant stimuli, and bias choice behavior toward the selected information. It is not clear how these processes interact. Here, we captured these processes in a reinforcement learning framework applied to a feature-based attention task that required macaques to learn and update the value of stimulus features while ignoring nonrelevant sensory features, locations, and action plans. We found that value-based reinforcement learning mechanisms could account for feature-based attentional selection and choice behavior but required a value-independent stickiness selection process to explain selection errors while at asymptotic behavior. By comparing different reinforcement learning schemes, we found that trial-by-trial selections were best predicted by a model that only represents expected values for the task-relevant feature dimension, with nonrelevant stimulus features and action plans having only a marginal influence on covert selections. These findings show that attentional control subprocesses can be described by (1) the reinforcement learning of feature values within a restricted feature space that excludes irrelevant feature dimensions, (2) a stochastic selection process on feature-specific value representations, and (3) value-independent stickiness toward previous feature selections akin to perseveration in the motor domain. We speculate that these three mechanisms are implemented by distinct but interacting brain circuits and that the proposed formal account of feature-based stimulus selection will be important to understand how attentional subprocesses are implemented in primate brain networks.
Collapse
Affiliation(s)
| | - Salva Ardid
- York University, Toronto, Canada.,Boston University
| | | | | | | |
Collapse
|
21
|
Ueltzhöffer K, Armbruster-Genç DJN, Fiebach CJ. Stochastic Dynamics Underlying Cognitive Stability and Flexibility. PLoS Comput Biol 2015; 11:e1004331. [PMID: 26068119 PMCID: PMC4466596 DOI: 10.1371/journal.pcbi.1004331] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2014] [Accepted: 05/11/2015] [Indexed: 11/19/2022] Open
Abstract
Cognitive stability and flexibility are core functions in the successful pursuit of behavioral goals. While there is evidence for a common frontoparietal network underlying both functions and for a key role of dopamine in the modulation of flexible versus stable behavior, the exact neurocomputational mechanisms underlying those executive functions and their adaptation to environmental demands are still unclear. In this work we study the neurocomputational mechanisms underlying cue based task switching (flexibility) and distractor inhibition (stability) in a paradigm specifically designed to probe both functions. We develop a physiologically plausible, explicit model of neural networks that maintain the currently active task rule in working memory and implement the decision process. We simplify the four-choice decision network to a nonlinear drift-diffusion process that we canonically derive from a generic winner-take-all network model. By fitting our model to the behavioral data of individual subjects, we can reproduce their full behavior in terms of decisions and reaction time distributions in baseline as well as distractor inhibition and switch conditions. Furthermore, we predict the individual hemodynamic response timecourse of the rule-representing network and localize it to a frontoparietal network including the inferior frontal junction area and the intraparietal sulcus, using functional magnetic resonance imaging. This refines the understanding of task-switch-related frontoparietal brain activity as reflecting attractor-like working memory representations of task rules. Finally, we estimate the subject-specific stability of the rule-representing attractor states in terms of the minimal action associated with a transition between different rule states in the phase-space of the fitted models. This stability measure correlates with switching-specific thalamocorticostriatal activation, i.e., with a system associated with flexible working memory updating and dopaminergic modulation of cognitive flexibility. These results show that stochastic dynamical systems can implement the basic computations underlying cognitive stability and flexibility and explain neurobiological bases of individual differences. In this work we develop a neurophysiologically inspired dynamical model that is capable of solving a complex behavioral task testing cognitive stability and flexibility. We can individually fit the behavior of each of 20 human subjects that conducted this stability-flexibility task during functional magnetic resonance imaging (fMRI). The physiological nature of our model allows us to estimate the energy consumption of the rule-representing module, which we use to predict the hemodynamic fMRI response. Through this model-based prediction, we localize the rule module to a frontoparietal network known to be required for cognitive stability and flexibility. In this way we both validate our model, which is based on noisy attractor dynamics, and specify the computational role of a cortical network that is well-established in human neuroimaging research. Additionally, we quantify the individual stability of the rule-representing states and relate this stability to individual differences in energy consumption during task switching versus distractor inhibition. Hereby we show that the activation of a thalamocorticostriatal network involved in the dopaminergic modulation of cognitive stability is modulated by the model-derived stability of the frontoparietal rule-representing network. Altogether, we show that noisy dynamic systems are likely to implement the basic computations underlying cognitive stability and flexibility.
Collapse
Affiliation(s)
- Kai Ueltzhöffer
- Department of Psychology, Goethe University Frankfurt, Frankfurt am Main, Germany
- Bernstein Center for Computational Neuroscience, Heidelberg University, Mannheim, Germany
- * E-mail:
| | - Diana J. N. Armbruster-Genç
- Department of Psychology, Goethe University Frankfurt, Frankfurt am Main, Germany
- Bernstein Center for Computational Neuroscience, Heidelberg University, Mannheim, Germany
| | - Christian J. Fiebach
- Department of Psychology, Goethe University Frankfurt, Frankfurt am Main, Germany
- Bernstein Center for Computational Neuroscience, Heidelberg University, Mannheim, Germany
- Department of Neuroradiology, Heidelberg University, Im Neuenheimer Feld, Heidelberg, Germany
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- IDeA Center for Individual Development and Adaptive Education, Frankfurt am Main, Germany
| |
Collapse
|
22
|
Belief states as a framework to explain extra-retinal influences in visual cortex. Curr Opin Neurobiol 2015; 32:45-52. [DOI: 10.1016/j.conb.2014.10.013] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2014] [Revised: 10/24/2014] [Accepted: 10/26/2014] [Indexed: 12/13/2022]
|
23
|
Mapping of functionally characterized cell classes onto canonical circuit operations in primate prefrontal cortex. J Neurosci 2015; 35:2975-91. [PMID: 25698735 DOI: 10.1523/jneurosci.2700-14.2015] [Citation(s) in RCA: 62] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Microcircuits are composed of multiple cell classes that likely serve unique circuit operations. But how cell classes map onto circuit functions is largely unknown, particularly for primate prefrontal cortex during actual goal-directed behavior. One difficulty in this quest is to reliably distinguish cell classes in extracellular recordings of action potentials. Here we surmount this issue and report that spike shape and neural firing variability provide reliable markers to segregate seven functional classes of prefrontal cells in macaques engaged in an attention task. We delineate an unbiased clustering protocol that identifies four broad spiking (BS) putative pyramidal cell classes and three narrow spiking (NS) putative inhibitory cell classes dissociated by how sparse, bursty, or regular they fire. We speculate that these functional classes map onto canonical circuit functions. First, two BS classes show sparse, bursty firing, and phase synchronize their spiking to 3-7 Hz (theta) and 12-20 Hz (beta) frequency bands of the local field potential (LFP). These properties make cells flexibly responsive to network activation at varying frequencies. Second, one NS and two BS cell classes show regular firing and higher rate with only marginal synchronization preference. These properties are akin to setting tonically the excitation and inhibition balance. Finally, two NS classes fired irregularly and synchronized to either theta or beta LFP fluctuations, tuning them potentially to frequency-specific subnetworks. These results suggest that a limited set of functional cell classes emerges in macaque prefrontal cortex (PFC) during attentional engagement to not only represent information, but to subserve basic circuit operations.
Collapse
|
24
|
Ardid S, Wang XJ. The “tweaking principle” for task switching. BMC Neurosci 2014. [PMCID: PMC4125041 DOI: 10.1186/1471-2202-15-s1-p14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|