The effects of positive versus negative feedback on information-integration category learning

The tail of the caudate is sensitive to both gain and loss feedback during information integration categorization

Although most category learning studies use feedback for training, little attention has been paid to how individuals utilize feedback implemented as gains or losses during categorization. We compared skilled categorization under three different conditions: Gain (earn points for correct answers), Gain and Loss (earn points for correct answers and lose points for wrong answers) and Correct or Wrong (accuracy feedback only). We also manipulated difficulty and point value, with near boundary stimuli having the highest number of points to win or lose, and stimuli far from the boundary having the lowest point value. We found that the tail of the caudate was sensitive to feedback condition, with highest activity when both Gain and Loss feedback were present and least activity when only Gain or accuracy feedback was present. We also found that activity across the caudate was affected by distance from the decision bound, with greatest activity for the near boundary high value stimuli, and lowest for far low value stimuli. Overall these results indicate that the tail of the caudate is sensitive not only to positive rewards but also to loss and punishment, consistent with recent animal research finding tail of the caudate activity in aversive learning.

Embodiment and repeated exposure do not suffice for abstract concepts acquisition: evidence from tonal music cognition

Research on abstract concepts (AC) suggests that while some AC are enacted indirectly and occasionally, others are largely grounded in our sensory-motor and affective experience, and the opportunities to enact them are countless, which would allow us to acquire them without supervision. From this, the following question arises: do embodiment and repeated exposure suffice to dispense with supervision in abstract concepts acquisition (ACA)? In the present study, this question was addressed in the context of tonal music cognition, which demands a high level of abstraction, and via musical materials that participants had frequently heard and sung. Specifically, highly trained, moderately trained, and untrained participants (24 each) were given 12 well-known melodic fragments ending on tones instantiating 6 different scale degrees (2 times each) and asked to group (round 1) or pair (round 2) those fragments whose last tone conveyed the same (or a similar enough) level of stability or rest. If embodiment and repeated exposure suffice for ACA, then one would expect a scale degree-based grouping strategy regardless of participants' training level. Results showed that only highly trained participants systematically grouped stimuli ending on the same scale degree, particularly in round 2; moderately trained participants' performance was mixed, and tonality's influence on untrained participants was negligible. Further, moderately trained and untrained participants performed inconsistently, discarding in round 2 almost all of the pairs formed in round 1. These findings are integrated with previous findings on the effect of language, affect, and category type on conceptualization to account for why and when ACA requires supervision.

Re-conceptualising Total Quality Leadership: a framework development and future research agenda

Purpose

The aim of this paper is to theoretically explore the concept of leadership in a Total Quality Management (TQM) context by developing a new theoretical framework of understanding Total Quality Leadership (TQL) as well as by opening the dialogue in researching further key elements of TQL.

Design/methodology/approach

The approach that the paper adopts is conceptual. Based on exploration of the wider management and leadership literature of empirical and theoretical studies, this paper develops a framework of TQL.

Findings

The suggested TQL framework is composed by three main pillars, namely the proactive, adaptive and the relational. The former consists of elements like anticipation of current business environment complexities and filtering of information that enhances practice decision making. The second pillar refers to adaptation, autonomy and feedback while the last one emphasises on the importance of aspects like social interactions, engagement and empathy. The paper explains why the specific pillars with the additional elements are critical for TQM success.

Originality/value

Given the tremendous challenges that organisations face due to increased complexity and demanding competition of the business environments globally, the role of leadership as the major “soft” aspect of TQM approach, seems to be vital more than ever. But the type of TQL appropriate to enhance total quality success nowadays, is still (and should be) under continuous exploration. This conceptual study attempts to provide new theoretical insights of TQL as well as to open the dialogue around the main elements consisting of TQL and how the future research agenda is formulated.

Assessing reinforcing versus aversive consequences in a real-time secondhand smoke intervention

Few studies have examined the relative effectiveness of reinforcing versus aversive consequences at changing behavior in real-world environments. Real-time sensing devices makes it easier to investigate such questions, offering the potential to improve both intervention outcomes and theory. This research aims to describe the development of a real-time, operant theory-based secondhand smoke (SHS) intervention and compare the efficacy of aversive versus aversive plus reinforcement contingency systems. Indoor air particle monitors were placed in the households of 253 smokers for approximately three months. Participants were assigned to a measurement-only control group (N = 129) or one of the following groups: 1.) aversive only (AO, N = 71), with aversive audio/visual consequences triggered by the detection of elevated air particle measurements, or 2.) aversive plus reinforcement (AP, N = 53), with reinforcing consequences contingent on the absence of SHS added to the AO intervention. Residualized change ANCOVA analysis compared particle concentrations over time and across groups. Post-hoc pairwise comparisons were also performed. After controlling for Baseline, Post-Baseline daily particle counts (F = 6.42, p = 0.002), % of time >15,000 counts (F = 7.72, p < 0.001), and daily particle events (F = 4.04, p = 0.02) significantly differed by study group. Nearly all control versus AO/AP pair-wise comparisons were statistically significant. No significant differences were found for AO versus AP groups. The aversive feedback system reduced SHS, but adding reinforcing consequences did not further improve outcomes. The complexity of real-world environments requires the nuances of these two contingency systems continue to be explored, with this study demonstrating that real-time sensing technology can serve as a platform for such research.

Gamification of health professions education: a systematic review

Gamification refers to using game attributes in a non-gaming context. Health professions educators increasingly turn to gamification to optimize students' learning outcomes. However, little is known about the concept of gamification and its possible working mechanisms. This review focused on empirical evidence for the effectiveness of gamification approaches and theoretical rationales for applying the chosen game attributes. We systematically searched multiple databases, and included all empirical studies evaluating the use of game attributes in health professions education. Of 5044 articles initially identified, 44 met the inclusion criteria. Negative outcomes for using gamification were not reported. Almost all studies included assessment attributes (n = 40), mostly in combination with conflict/challenge attributes (n = 27). Eight studies revealed that this specific combination had increased the use of the learning material, sometimes leading to improved learning outcomes. A relatively small number of studies was performed to explain mechanisms underlying the use of game attributes (n = 7). Our findings suggest that it is possible to improve learning outcomes in health professions education by using gamification, especially when employing game attributes that improve learning behaviours and attitudes towards learning. However, most studies lacked well-defined control groups and did not apply and/or report theory to understand underlying processes. Future research should clarify mechanisms underlying gamified educational interventions and explore theories that could explain the effects of these interventions on learning outcomes, using well-defined control groups, in a longitudinal way. In doing so, we can build on existing theories and gain a practical and comprehensive understanding of how to select the right game elements for the right educational context and the right type of student.

Assessing the role of managerial feedback in changing routines in small and medium enterprises

Purpose

In an ever-complexifying business context, organizations need to continuously adapt, adjust and change their routines in order to remain competitive. Drawing upon a qualitative study focusing on three Southeastern European countries (Greece, Bulgaria and Serbia), this paper explores the role played by managerial feedback on routine change within small and medium enterprises (SMEs).

Design/methodology/approach

The authors draw from an in-depth qualitative study of six manufacturing SMEs located in three Southeastern European countries: Greece, Bulgaria and Serbia. The process of data collection, which spanned over a period of fifteen months, was centred around both interviews and observations.

Findings

The authors argue that feedback is a powerful and constructive managerial practice that sets to initiate changes in routines through three different means: (1) making sense of the changes required (by channelling information), (2) rationalizing the decision for changing the unproductive routines and (3) reviewing the process of change through the legitimization of situational routines. In addition to this, the authors found that managers perceive that routines need to change for four main reasons: inability to meet targets (e.g. performance); too cumbersome to deal with complex environments; inflexibility and failing to provide control; obsolete in terms of providing a sense of confidence.

Practical implications

This research provides evidence that feedback is an important managerial means of changing routines in informal, less bureaucratic and less formalized workplaces such as SMEs. Managers might embrace deformalized approaches to feedback when dealing with routines in SMEs. Working within a very sensitive structure where the majority of changes on routines need to be operationalized through their hands, managers and practitioners should deploy feedback in order to highlight the importance of routines as sources of guiding actions, activities and operations occurring in SMEs that create better internal challenges and processes.

Originality/value

The authors’ research suggests that routines are subject of change in dynamic and turbulent situations. Perceiving routines as antithetical to change fails to capture the distinctive features of change such as its fluidity, open-endedness, and inseparability. Likewise, the authors claim that routines are socially constructed organizational phenomena that can be modulated in different ways in SMEs.

Differing effects of gain and loss feedback on rule-based and information-integration category learning

Although most category-learning studies use feedback for training, little attention has been paid to how individuals use feedback value and framing of feedback as gains or losses to support learning. We compared learning of rule-based (RB) and information-integration (II) categories with point-valued feedback in which participants gained or lost higher point values for more difficult category members (those closer to the decision bound). We implemented point-valued feedback in four different conditions: Gain (earn points for correct answers), Loss (lose points for incorrect answers), Gain+Loss (earn points for correct answers and lose points for incorrect answers), and Control (accuracy feedback only without point gain or loss). Participants were trained until they reached criterion. Overall, point-valued feedback led to better learning than control conditions. However, the patterns differed across category-learning tasks. In the II task participants reached learning criterion fastest when they received both Gains and Losses. This is consistent with the reliance of II learning on reinforcement-based mechanisms and research showing common coding of gains and losses in neural regions underlying II learning. In contrast, in the RB task, participants reached criterion most rapidly when they received either Gains or Losses, but not both Gains and Losses together. The relative impairment in the Gain+Loss condition in RB learning may be due to conflicting executive function demands for interpreting and using the separate Gain and Loss information, and is consistent with reliance of RB learning on explicit hypothesis-testing mechanisms.

Eye Tracking the Feedback Assigned to Undergraduate Students in a Digital Assessment Game

High-quality feedback exerts a crucial influence on learning new skills and it is one of the most common psychological interventions. However, knowing how to deliver feedback effectively is challenging for educators in both traditional and online classroom environments. This study uses psychophysiological methodology to investigate attention allocation to different feedback valences (i.e., positive and negative feedback), as the eye tracker provides accurate information about individuals' locus of attention when they process feedback. We collected learning analytics via a behavioral assessment game and eye-movement measures via an eye tracker to infer undergraduate students' cognitive processing of feedback that is assigned to them after completing a task. The eye movements of n = 30 undergraduates at a university in Western Canada were tracked by the EyeLink 1000 Plus eye tracker while they played Posterlet, a digital game-based assessment. In Posterlet, students designed three posters and received critical (negative) or confirmatory (positive) feedback from virtual characters in the game after completing each poster. Analyses showed that, overall, students attended to critical feedback more than to confirmatory feedback, as measured by the time spent on feedback in total, per word, and per letter, and by the number of feedback fixations and revisits. However, there was no difference in dwell time between valences prior to any feedback revisits, suggesting that returning to read critical feedback more often than confirmatory feedback accounts for the overall dwell time difference between valences when feedback is assigned to students. The study summarizes the eye movement record on critical and confirmatory feedback, respectively. Implications of this research include enhancing our understanding of the differential temporal cognitive processing of feedback valences that may ultimately improve the delivery of feedback.

Task and distribution sampling affect auditory category learning

There is substantial evidence that two distinct learning systems are engaged in category learning. One is principally engaged when learning requires selective attention to a single dimension (rule-based), and the other is drawn online by categories requiring integration across two or more dimensions (information-integration). This distinction has largely been drawn from studies of visual categories learned via overt category decisions and explicit feedback. Recent research has extended this model to auditory categories, the nature of which introduces new questions for research. With the present experiment, we addressed the influences of incidental versus overt training and category distribution sampling on learning information-integration and rule-based auditory categories. The results demonstrate that the training task influences category learning, with overt feedback generally outperforming incidental feedback. Additionally, distribution sampling (probabilistic or deterministic) and category type (information-integration or rule-based) both affect how well participants are able to learn. Specifically, rule-based categories are learned equivalently, regardless of distribution sampling, whereas information-integration categories are learned better with deterministic than with probabilistic sampling. The interactions of distribution sampling, category type, and kind of feedback impacted category-learning performance, but these interactions have not yet been integrated into existing category-learning models. These results suggest new dimensions for understanding category learning, inspired by the real-world properties of auditory categories.

Dynamics of error-related activity in deterministic learning - an EEG and fMRI study

There is a close relationship between progress in learning and the error-monitoring system. EEG and fMRI studies using probabilistic learning have revealed the distinct dynamics of this system after response and feedback, i.e. an increase of error-related and a decrease of feedback-related activity in the anterior cingulate cortex (ACC). Based on the existing theories, it can be presumed that during deterministic learning feedback-related activity in ACC would also increase. Since these assumptions have not yet been confirmed, it can be only speculated based on the data from the probabilistic paradigms how the information is being integrated within the ACC during deterministic learning. Here we implemented the Paired Associate Deterministic Learning task to the EEG and fMRI experiments. The analysis of EEG data showed a significant increase in the amplitude for both ERN and FN. Similarly, the fMRI results showed an increase in response-related and feedback-related activity of the ACC in erroneous trials. Our findings are in line with the current theories of ACC function: increasing ACC activity can be linked to the detected discrepancy between expected and obtained outcomes. We argue that expectancy violations in the course of deterministic learning are signalled by both, internal and external evaluation system.

Comparing the effects of positive and negative feedback in information-integration category learning

Categorical learning is dependent on feedback. Here, we compare how positive and negative feedback affect information-integration (II) category learning. Ashby and O'Brien (2007) demonstrated that both positive and negative feedback are required to solve II category problems when feedback was not guaranteed on each trial, and reported no differences between positive-only and negative-only feedback in terms of their effectiveness. We followed up on these findings and conducted 3 experiments in which participants completed 2,400 II categorization trials across three days under 1 of 3 conditions: positive feedback only (PFB), negative feedback only (NFB), or both types of feedback (CP; control partial). An adaptive algorithm controlled the amount of feedback given to each group so that feedback was nearly equated. Using different feedback control procedures, Experiments 1 and 2 demonstrated that participants in the NFB and CP group were able to engage II learning strategies, whereas the PFB group was not. Additionally, the NFB group was able to achieve significantly higher accuracy than the PFB group by Day 3. Experiment 3 revealed that these differences remained even when we equated the information received on feedback trials. Thus, negative feedback appears significantly more effective for learning II category structures. This suggests that the human implicit learning system may be capable of learning in the absence of positive feedback.

Hierarchical control of procedural and declarative category-learning systems

Substantial evidence suggests that human category learning is governed by the interaction of multiple qualitatively distinct neural systems. In this view, procedural memory is used to learn stimulus-response associations, and declarative memory is used to apply explicit rules and test hypotheses about category membership. However, much less is known about the interaction between these systems: how is control passed between systems as they interact to influence motor resources? Here, we used fMRI to elucidate the neural correlates of switching between procedural and declarative categorization systems. We identified a key region of the cerebellum (left Crus I) whose activity was bidirectionally modulated depending on switch direction. We also identified regions of the default mode network (DMN) that were selectively connected to left Crus I during switching. We propose that the cerebellum-in coordination with the DMN-serves a critical role in passing control between procedural and declarative memory systems.

The role of feedback contingency in perceptual category learning

Feedback is highly contingent on behavior if it eventually becomes easy to predict, and weakly contingent on behavior if it remains difficult or impossible to predict even after learning is complete. Many studies have demonstrated that humans and nonhuman animals are highly sensitive to feedback contingency, but no known studies have examined how feedback contingency affects category learning, and current theories assign little or no importance to this variable. Two experiments examined the effects of contingency degradation on rule-based and information-integration category learning. In rule-based tasks, optimal accuracy is possible with a simple explicit rule, whereas optimal accuracy in information-integration tasks requires integrating information from 2 or more incommensurable perceptual dimensions. In both experiments, participants each learned rule-based or information-integration categories under either high or low levels of feedback contingency. The exact same stimuli were used in all 4 conditions, and optimal accuracy was identical in every condition. Learning was good in both high-contingency conditions, but most participants showed little or no evidence of learning in either low-contingency condition. Possible causes of these effects, as well as their theoretical implications, are discussed. (PsycINFO Database Record

Self-Regulation of Anterior Insula with Real-Time fMRI and Its Behavioral Effects in Obsessive-Compulsive Disorder: A Feasibility Study

Introduction

Obsessive-compulsive disorder (OCD) is a common and chronic condition that can have disabling effects throughout the patient's lifespan. Frequent symptoms among OCD patients include fear of contamination and washing compulsions. Several studies have shown a link between contamination fears, disgust over-reactivity, and insula activation in OCD. In concordance with the role of insula in disgust processing, new neural models based on neuroimaging studies suggest that abnormally high activations of insula could be implicated in OCD psychopathology, at least in the subgroup of patients with contamination fears and washing compulsions.

Methods

In the current study, we used a Brain Computer Interface (BCI) based on real-time functional magnetic resonance imaging (rtfMRI) to aid OCD patients to achieve down-regulation of the Blood Oxygenation Level Dependent (BOLD) signal in anterior insula. Our first aim was to investigate whether patients with contamination obsessions and washing compulsions can learn to volitionally decrease (down-regulate) activity in the insula in the presence of disgust/anxiety provoking stimuli. Our second aim was to evaluate the effect of down-regulation on clinical, behavioural and physiological changes pertaining to OCD symptoms. Hence, several pre- and post-training measures were performed, i.e., confronting the patient with a disgust/anxiety inducing real-world object (Ecological Disgust Test), and subjective rating and physiological responses (heart rate, skin conductance level) of disgust towards provoking pictures.

Results

Results of this pilot study, performed in 3 patients (2 females), show that OCD patients can gain self-control of the BOLD activity of insula, albeit to different degrees. In two patients positive changes in behaviour in the EDT were observed following the rtfMRI trainings. Behavioural changes were also confirmed by reductions in the negative valence and in the subjective perception of disgust towards symptom provoking images.

Conclusion

Although preliminary, results of this study confirmed that insula down-regulation is possible in patients suffering from OCD, and that volitional decreases of insula activation could be used for symptom alleviation in this disorder.

Posterror slowing predicts rule-based but not information-integration category learning

We examined whether error monitoring, operationalized as the degree to which individuals slow down after committing an error (i.e., posterror slowing), is differentially important in the learning of rule-based versus information-integration category structures. Rule-based categories are most efficiently solved through the application of an explicit verbal strategy (e.g., "sort by color"). In contrast, information-integration categories are believed to be learned in a trial-by-trial, associative manner. Our results indicated that posterror slowing predicts enhanced rule-based but not information-integration category learning. Implications for multiple category-learning systems are discussed.

Combining computational modeling and neuroimaging to examine multiple category learning systems in the brain

Considerable evidence has argued in favor of multiple neural systems supporting human category learning, one based on conscious rule inference and one based on implicit information integration. However, there have been few attempts to study potential system interactions during category learning. The PINNACLE (Parallel Interactive Neural Networks Active in Category Learning) model incorporates multiple categorization systems that compete to provide categorization judgments about visual stimuli. Incorporating competing systems requires inclusion of cognitive mechanisms associated with resolving this competition and creates a potential credit assignment problem in handling feedback. The hypothesized mechanisms make predictions about internal mental states that are not always reflected in choice behavior, but may be reflected in neural activity. Two prior functional magnetic resonance imaging (fMRI) studies of category learning were re-analyzed using PINNACLE to identify neural correlates of internal cognitive states on each trial. These analyses identified additional brain regions supporting the two types of category learning, regions particularly active when the systems are hypothesized to be in maximal competition, and found evidence of covert learning activity in the “off system” (the category learning system not currently driving behavior). These results suggest that PINNACLE provides a plausible framework for how competing multiple category learning systems are organized in the brain and shows how computational modeling approaches and fMRI can be used synergistically to gain access to cognitive processes that support complex decision-making machinery.

Information-integration category learning and the human uncertainty response

The human response to uncertainty has been well studied in tasks requiring attention and declarative memory systems. However, uncertainty monitoring and control have not been studied in multi-dimensional, information-integration categorization tasks that rely on non-declarative procedural memory. Three experiments are described that investigated the human uncertainty response in such tasks. Experiment 1 showed that following standard categorization training, uncertainty responding was similar in information-integration tasks and rule-based tasks requiring declarative memory. In Experiment 2, however, uncertainty responding in untrained information-integration tasks impaired the ability of many participants to master those tasks. Finally, Experiment 3 showed that the deficit observed in Experiment 2 was not because of the uncertainty response option per se, but rather because the uncertainty response provided participants a mechanism via which to eliminate stimuli that were inconsistent with a simple declarative response strategy. These results are considered in the light of recent models of category learning and metacognition.

Adaptation, expertise, and giftedness: towards an understanding of cortical, subcortical, and cerebellar network contributions

Current cortico-centric models of cognition lack a cohesive neuroanatomic framework that sufficiently considers overlapping levels of function, from "pathological" through "normal" to "gifted" or exceptional ability. While most cognitive theories presume an evolutionary context, few actively consider the process of adaptation, including concepts of neurodevelopment. Further, the frequent co-occurrence of "gifted" and "pathological" function is difficult to explain from a cortico-centric point of view. This comprehensive review paper proposes a framework that includes the brain's vertical organization and considers "giftedness" from an evolutionary and neurodevelopmental vantage point. We begin by discussing the current cortico-centric model of cognition and its relationship to intelligence. We then review an integrated, dual-tiered model of cognition that better explains the process of adaptation by simultaneously allowing for both stimulus-based processing and higher-order cognitive control. We consider the role of the basal ganglia within this model, particularly in relation to reward circuitry and instrumental learning. We review the important role of white matter tracts in relation to speed of adaptation and development of behavioral mastery. We examine the cerebellum's critical role in behavioral refinement and in cognitive and behavioral automation, particularly in relation to expertise and giftedness. We conclude this integrated model of brain function by considering the savant syndrome, which we believe is best understood within the context of a dual-tiered model of cognition that allows for automaticity in adaptation as well as higher-order executive control.

Human category learning 2.0

During the 1990s and early 2000s, cognitive neuroscience investigations of human category learning focused on the primary goal of showing that humans have multiple category-learning systems and on the secondary goals of identifying key qualitative properties of each system and of roughly mapping out the neural networks that mediate each system. Many researchers now accept the strength of the evidence supporting multiple systems, and as a result, during the past few years, work has begun on the second generation of research questions-that is, on questions that begin with the assumption that humans have multiple category-learning systems. This article reviews much of this second generation of research. Topics covered include (1) How do the various systems interact? (2) Are there different neural systems for categorization and category representation? (3) How does automaticity develop in each system? and (4) Exactly how does each system learn?

Remote care nearby

A telemedicine application has a better chance of being accepted if the users can easily handle it and if the application fulfils the clinical needs of both patients and professionals. This requires a methodology for development in which three key matters need to be dealt with: (1) clinical content; (2) design; and (3) outcome. Concerning the clinical content, telemedicine services for patients with chronic disorders that aim to increase their level of functioning need to monitor aspects of the patient's functioning and provide adequate feedback about this. Promising parameters of functioning are related to general physical activity and muscle activation patterns. Providing adequate feedback requires choices about the content of the information, the modality of the feedback and its timing. Unfortunately, research into effective feedback strategies is still in its infancy. Concerning the design it appears that the different stakeholders involved speak different languages, that there is a lack of knowledge about aspects related to acceptance and a lack of good methods to define user requirements. Scenario-based requirements analysis is a promising technique to overcome these barriers. Concerning the outcome, evaluation of telemedicine services in everyday clinical practice has been mainly directed at measurement of technical performance and user satisfaction. Large scale clinical evaluation studies with multiple end points are needed. This development methodology with its three aspects was used for a myofeedback-based teletreatment service. This showed that telemedicine applications can be developed that have the potential to make health care more effective, efficient and accessible.

Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning

The dopaminergic system is known to play a central role in reward-based learning (Schultz, 2006), yet it was also observed to be involved when only cognitive feedback is given (Aron et al., 2004). Within the domain of information-integration category learning, in which information from several stimulus dimensions has to be integrated predecisionally (Ashby and Maddox, 2005), the importance of contingent feedback is well established (Maddox et al., 2003). We examined the common neural correlates of reward anticipation and prediction error in this task. Sixteen subjects performed two parallel information-integration tasks within a single event-related functional magnetic resonance imaging session but received a monetary reward only for one of them. Similar functional areas including basal ganglia structures were activated in both task versions. In contrast, a single structure, the nucleus accumbens, showed higher activation during monetary reward anticipation compared with the anticipation of cognitive feedback in information-integration learning. Additionally, this activation was predicted by measures of intrinsic motivation in the cognitive feedback task and by measures of extrinsic motivation in the rewarded task. Our results indicate that, although all other structures implicated in category learning are not significantly affected by altering the type of reward, the nucleus accumbens responds to the positive incentive properties of an expected reward depending on the specific type of the reward.

Regulating recognition decisions through incremental reinforcement learning

Does incremental reinforcement learning influence recognition memory judgments? We examined this question by subtly altering the relative validity or availability of feedback in order to differentially reinforce old or new recognition judgments. Experiment 1 probabilistically and incorrectly indicated that either misses or false alarms were correct in the context of feedback that was otherwise accurate. Experiment 2 selectively withheld feedback for either misses or false alarms in the context of feedback that was otherwise present. Both manipulations caused prominent shifts of recognition memory decision criteria that remained for considerable periods even after feedback had been altogether removed. Overall, these data demonstrate that incremental reinforcement-learning mechanisms influence the degree of caution subjects exercise when evaluating explicit memories.

A note on DeCaro, Thomas, and Beilock (2008): further data demonstrate complexities in the assessment of information-integration category learning

DeCaro et al. [DeCaro, M. S., Thomas, R. D., & Beilock, S. L. (2008). Individual differences in category learning: Sometimes less working memory capacity is better than more. Cognition, 107(1), 284-294] explored how individual differences in working memory capacity differentially mediate the learning of distinct category structures. Specifically, their results showed that greater working memory capacity facilitates the learning of novel category structures that are verbalisable and discoverable through logical reasoning processes. Conversely, however, greater working memory was shown to impede the learning of novel category structures thought to be non-verbalisable, inaccessible to conscious reasoning and discoverable only through implicit (procedural) learning of appropriate stimulus-category responses. The present paper calls into question the specific nature of the category learning tasks used, in particular their ability to discriminate between different modes of category learning.

Neurocomputational models of basal ganglia function in learning, memory and choice

The basal ganglia (BG) are critical for the coordination of several motor, cognitive, and emotional functions and become dysfunctional in several pathological states ranging from Parkinson's disease to Schizophrenia. Here we review principles developed within a neurocomputational framework of BG and related circuitry which provide insights into their functional roles in behavior. We focus on two classes of models: those that incorporate aspects of biological realism and constrained by functional principles, and more abstract mathematical models focusing on the higher level computational goals of the BG. While the former are arguably more "realistic", the latter have a complementary advantage in being able to describe functional principles of how the system works in a relatively simple set of equations, but are less suited to making specific hypotheses about the roles of specific nuclei and neurophysiological processes. We review the basic architecture and assumptions of these models, their relevance to our understanding of the neurobiological and cognitive functions of the BG, and provide an update on the potential roles of biological details not explicitly incorporated in existing models. Empirical studies ranging from those in transgenic mice to dopaminergic manipulation, deep brain stimulation, and genetics in humans largely support model predictions and provide the basis for further refinement. Finally, we discuss possible future directions and possible ways to integrate different types of models.

A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism

Parkinson's disease (PD) patients exhibit cognitive deficits, including reinforcement learning, working memory (WM) and set shifting. Computational models of the basal ganglia-frontal system posit similar mechanisms for these deficits in terms of reduced dynamic range of striatal dopamine (DA) signals in both medicated and non-medicated states. Here, we report results from the first study that tests PD patients on and off dopaminergic medications in a modified version of the AX continuous performance (AX-CPT) working memory task, consisting of three performance phases and one phase requiring WM associations to be learned via reinforcement feedback. Patients generally showed impairments relative to controls. Medicated patients showed deficits specifically when having to ignore distracting stimuli during the delay. Our models suggest that this impairment is due to medication causing excessive WM updating by enhancing striatal "Go" signals that facilitate such updating, while concurrently suppressing "NoGo" signals. In contrast, patients off medication showed deficits consistent with an overall reduction in striatal DA and associated Go updating signals. Supporting this dichotomy, patients on and off medication both showed attentional shifting deficits, but for different reasons. Deficits in non-medicated patients were consistent with an inability to update the new attentional set, whereas those in medicated patients were evident when having to ignore distractors that had previously been task relevant. Finally, in the feedback-based WM phase, medicated patients were better than unmedicated patients, suggesting a key role of striatal DA in using feedback to update information into WM. These results lend further insight into the role of basal ganglia dopamine in WM and broadly support predictions from neurocomputational models.