New approaches to the study of amnesic patients: what can a neurofunctional philosophy and neural network methods offer?

A neural interpretation of exemplar theory

Exemplar theory assumes that people categorize a novel object by comparing its similarity to the memory representations of all previous exemplars from each relevant category. Exemplar theory has been the most prominent cognitive theory of categorization for more than 30 years. Despite its considerable success in providing good quantitative fits to a wide variety of accuracy data, it has never had a detailed neurobiological interpretation. This article proposes a neural interpretation of exemplar theory in which category learning is mediated by synaptic plasticity at cortical-striatal synapses. In this model, categorization training does not create new memory representations, rather it alters connectivity between striatal neurons and neurons in sensory association cortex. The new model makes identical quantitative predictions as exemplar theory, yet it can account for many empirical phenomena that are either incompatible with or outside the scope of the cognitive version of exemplar theory. (PsycINFO Database Record

Striatal and hippocampal entropy and recognition signals in category learning: simultaneous processes revealed by model-based fMRI

Category learning is a complex phenomenon that engages multiple cognitive processes, many of which occur simultaneously and unfold dynamically over time. For example, as people encounter objects in the world, they simultaneously engage processes to determine their fit with current knowledge structures, gather new information about the objects, and adjust their representations to support behavior in future encounters. Many techniques that are available to understand the neural basis of category learning assume that the multiple processes that subserve it can be neatly separated between different trials of an experiment. Model-based functional magnetic resonance imaging offers a promising tool to separate multiple, simultaneously occurring processes and bring the analysis of neuroimaging data more in line with category learning's dynamic and multifaceted nature. We use model-based imaging to explore the neural basis of recognition and entropy signals in the medial temporal lobe and striatum that are engaged while participants learn to categorize novel stimuli. Consistent with theories suggesting a role for the anterior hippocampus and ventral striatum in motivated learning in response to uncertainty, we find that activation in both regions correlates with a model-based measure of entropy. Simultaneously, separate subregions of the hippocampus and striatum exhibit activation correlated with a model-based recognition strength measure. Our results suggest that model-based analyses are exceptionally useful for extracting information about cognitive processes from neuroimaging data. Models provide a basis for identifying the multiple neural processes that contribute to behavior, and neuroimaging data can provide a powerful test bed for constraining and testing model predictions.

Automaticity and multiple memory systems

A large number of criteria have been proposed for determining when a behavior has become automatic. Almost all of these were developed before the widespread acceptance of multiple memory systems. Consequently, popular frameworks for studying automaticity often neglect qualitative differences in how different memory systems guide initial learning. Unfortunately, evidence suggests that automaticity criteria derived from these frameworks consistently misclassify certain sets of initial behaviors as automatic. Specifically, criteria derived from cognitive science mislabel much behavior still under the control of procedural memory as automatic, and criteria derived from animal learning mislabel some behaviors under the control of declarative memory as automatic. Even so, neither set of criteria make the opposite error-that is, both sets correctly identify any automatic behavior as automatic. In fact, evidence suggests that although there are multiple memory systems and therefore multiple routes to automaticity, there might nevertheless be only one common representation for automatic behaviors. A number of possible cognitive and cognitive neuroscience models of this single automaticity system are reviewed. WIREs Cogn Sci 2012, 3:363-376. doi: 10.1002/wcs.1172 For further resources related to this article, please visit the WIREs website.

Learning the exception to the rule: model-based FMRI reveals specialized representations for surprising category members

Category knowledge can be explicit, yet not conform to a perfect rule. For example, a child may acquire the rule "If it has wings, then it is a bird," but then must account for exceptions to this rule, such as bats. The current study explored the neurobiological basis of rule-plus-exception learning by using quantitative predictions from a category learning model, SUSTAIN, to analyze behavioral and functional magnetic resonance imaging (fMRI) data. SUSTAIN predicts that exceptions require formation of specialized representations to distinguish exceptions from rule-following items in memory. By incorporating quantitative trial-by-trial predictions from SUSTAIN directly into fMRI analyses, we observed medial temporal lobe (MTL) activation consistent with 2 predicted psychological processes that enable exception learning: item recognition and error correction. SUSTAIN explains how these processes vary in the MTL across learning trials as category knowledge is acquired. Importantly, MTL engagement during exception learning was not captured by an alternate exemplar-based model of category learning or by standard contrasts comparing exception and rule-following items. The current findings thus provide a well-specified theory for the role of the MTL in category learning, where the MTL plays an important role in forming specialized category representations appropriate for the learning context.

Procedural interference in perceptual classification: implicit learning or cognitive complexity?

Researchers have argued that an implicit procedural-learning system underlies performance for information integration category structures, whereas a separate explicit system underlies performance for rule-based categories. One source of evidence is a dissociation in which procedural interference harms performance in information integration structures, but not in rule-based ones. The present research provides evidence that some form of overall difficulty or category complexity lies at the root of the dissociation. The authors report studies in which procedural interference is observed for even simple rule-based structures under more sensitive testing conditions. Furthermore, the magnitude of the interference is large when the nature of the rule is made more complex. By contrast, the magnitude of interference is greatly reduced for an information integration structure that is cognitively simple. These results challenge the view that a procedural-learning system mediates performance on information integration categories, but not on rule-based ones.

Discontinuous categories affect information-integration but not rule-based category learning

Three experiments were conducted that provide a direct examination of within-category discontinuity manipulations on the implicit, procedural-based learning and the explicit, hypothesis-testing systems proposed in F. G. Ashby, L. A. Alfonso-Reese, A. U. Turken, and E. M. Waldron's (1998) competition between verbal and implicit systems model. Discontinuous categories adversely affected information-integration but not rule-based category learning. Increasing the magnitude of the discontinuity did not lead to a significant decline in performance. The distance to the bound provides a reasonable description of the generalization profile associated with the hypothesis-testing system, whereas the distance to the bound plus the distance to the trained response region provides a reasonable description of the generalization profile associated with the procedural-based learning system. These results suggest that within-category discontinuity differentially impacts information-integration but not rule-based category learning and provides information regarding the detailed processing characteristics of each category learning system.

Dissociating explicit and procedural-learning based systems of perceptual category learning

A fundamental question is whether people have available one category learning system, or many. Most multiple systems advocates postulate one explicit and one implicit system. Although there is much agreement about the nature of the explicit system, there is less agreement about the nature of the implicit system. In this article, we review a dual systems theory of category learning called competition between verbal and implicit systems (COVIS) developed by Ashby et al. The explicit system dominates the learning of verbalizable, rule-based category structures and is mediated by frontal brain areas such as the anterior cingulate, prefrontal cortex (PFC), and head of the caudate nucleus. The implicit system, which uses procedural learning, dominates the learning of non-verbalizable, information-integration category structures, and is mediated by the tail of the caudate nucleus and a dopamine-mediated reward signal. We review nine studies that test six a priori predictions from COVIS, each of which is supported by the data.

Optimal classifier feedback improves cost-benefit but not base-rate decision criterion learning in perceptual categorization

Unequal payoffs engender separate reward- and accuracy-maximizing decision criteria; unequal base rates do not. When payoffs are unequal, observers place greater emphasis on accuracy than is optimal. This study compares objective classifier (the objectively correct response) with optimal classifier feedback (the optimal classifier's response) when payoffs or base rates are unequal. It provides a critical test of Maddox and Bohil's (1998) competition between reward and accuracy maximization (COBRA) hypothesis, comparing it with a competition between reward and probability matching (COBRM) and a competition between reward and equal response frequencies (COBRE) hypothesis. The COBRA prediction that optimal classifier feedback leads to better decision criterion leaning relative to objective classifier feedback when payoffs are unequal, but not when base rates are unequal, was supported. Model-based analyses suggested that the weight placed on accuracy was reduced for optimal classifier feedback relative to objective classifier feedback. In addition, delayed feedback affected learning of the reward-maximizing decision criterion.

Human Category Learning

Much recent evidence suggests some dramatic differences in the way people learn perceptual categories, depending on exactly how the categories were constructed. Four different kinds of category-learning tasks are currently popular-rule-based tasks, information-integration tasks, prototype distortion tasks, and the weather prediction task. The cognitive, neuropsychological, and neuroimaging results obtained using these four tasks are qualitatively different. Success in rule-based (explicit reasoning) tasks depends on frontal-striatal circuits and requires working memory and executive attention. Success in information-integration tasks requires a form of procedural learning and is sensitive to the nature and timing of feedback. Prototype distortion tasks induce perceptual (visual cortical) learning. A variety of different strategies can lead to success in the weather prediction task. Collectively, results from these four tasks provide strong evidence that human category learning is mediated by multiple, qualitatively distinct systems.

Disrupting feedback processing interferes with rule-based but not information-integration category learning

The effect of a sequentially presented memory scanning task on rule-based and information-integration category learning was investigated. On each trial in the short feedback-processing time condition, memory scanning immediately followed categorization. On each trial in the long feedback-processing time condition, categorization was followed by a 2.5-sec delay and then memory scanning. In the control condition, no memory scanning was required. Rule-based category learning was significantly worse in the short feedback-processing time condition than in the long feedback-processing time condition or control condition, whereas information-integration category learning was equivalent across conditions. In the rule-based condition, a smaller proportion of observers learned the task in the short feedback-processing time condition, and those who learned took longer to reach the performance criterion than did those in the long feedback-processing time or control condition. No differences were observed in the information integration task. These results provide support for a multiple-systems approach to category learning and argue against the validity of single-system approaches.

Evidence for a procedural-learning-based system in perceptual category learning

The consistency of the mapping from category to response location was investigated to test the hypothesis that abstract category labels are learned by the hypothesis testing system to solve rule-based tasks, whereas response position is learned by the procedural-learning system to solve information-integration tasks. Accuracy rates were examined to isolate global performance deficits, and model-based analyses were performed to identify the types of response strategies used by observers. A-B training (consistent mapping) led to more accurate responding relative to yes-no training (variable mapping) in the information-integration category learning task. Model-based analyses indicated that the yes-no accuracy decline was due to an increase in the use of rule-based strategies to solve the information-integration task. Yes-no training had no effect on the accuracy of responding or distribution of best-fitting models relative to A-B training in the rule-based category learning tasks. These results both provide support for a multiple-systems approach to category learning in which one system is procedural-learning-based and argue against the validity of single-system approaches.

Probability matching, accuracy maximization, and a test of the optimal classifier's independence assumption in perceptual categorization

Observers completed perceptual categorization tasks that included 25 base-rate/payoff conditions constructed from the factorial combination of five base-rate ratios (1:3, 1:2, 1:1, 2:1, and 3:1) with five payoff ratios (1:3, 1:2, 1:1, 2:1, and 3:1). This large database allowed an initial comparison of the competition between reward and accuracy maximization (COBRA) hypothesis with a competition between reward maximization and probability matching (COBRM) hypothesis, and an extensive and critical comparison of the flat-maxima hypothesis with the independence assumption of the optimal classifier. Model-based instantiations of the COBRA and COBRM hypotheses provided good accounts of the data, but there was a consistent advantage for the COBRM instantiation early in learning and for the COBRA instantiation later in learning. This pattern held in the present study and in a reanalysis of Bohil and Maddox (2003). Strong support was obtained for the flat-maxima hypothesis over the independence assumption, especially as the observers gained experience with the task. Model parameters indicated that observers' reward-maximizing decision criterion rapidly approaches the optimal value and that more weight is placed on accuracy maximization in separate base-rate/payoff conditions than in simultaneous base-rate/payoff conditions. The superiority of the flat-maxima hypothesis suggests that violations of the independence assumption are to be expected, and are well captured by the flat-maxima hypothesis, with no need for any additional assumptions.

Category number impacts rule-based but not information-integration category learning: further evidence for dissociable category-learning systems

Category number effects on rule-based and information-integration category learning were investigated. Category number affected accuracy and the distribution of best-fitting models in the rule-based task but had no effect on accuracy and little effect on the distribution of best-fining models in the information-integration task. In the 2 category conditions, rule-based learning was better than information-integration learning, whereas in the 4 category conditions, unidimensional and conjunctive rule-based learning was worse than information-integration learning. Rule-based strategies were used in the 2-category/rule-based condition, but about half of the observers used rule-based strategies in the 4-category unidimensional and conjunctive rule-based conditions. Information-integration strategies were used in the 4-category/ information-integration condition and by the end of training were used in the 2-category/information-integration condition.

Procedural learning in perceptual categorization

In two experiments, observers learned two types of category structures: those in which perfect accuracy could be achieved via some explicit rule-based strategy and those in which perfect accuracy required integrating information from separate perceptual dimensions at some predecisional stage. At the end of training, some observers were required to switch their hands on the response keys, whereas the assignment of categories to response keys was switched for other observers. With the rule-based category structures, neither change in response instructions interfered with categorization accuracy. However, with the information-integration structures, switching response key assignments interfered with categorization performance, but switching hands did not. These results are consistent with the hypothesis that abstract category labels are learned in rule-based categorization, whereas response positions are learned in information-integration categorization. The association to response positions also supports the hypothesis of a procedural-learning-based component to information integration categorization.

Delayed feedback effects on rule-based and information-integration category learning

The effect of immediate versus delayed feedback on rule-based and information-integration category learning was investigated. Accuracy rates were examined to isolate global performance deficits, and model-based analyses were performed to identify the types of response strategies used by observers. Feedback delay had no effect on the accuracy of responding or on the distribution of best fitting models in the rule-based category-learning task. However, delayed feedback led to less accurate responding in the information-integration category-learning task. Model-based analyses indicated that the decline in accuracy with delayed feedback was due to an increase in the use of rule-based strategies to solve the information-integration task. These results provide support for a multiple-systems approach to category learning and argue against the validity of single-system approaches.

Generalizing a neuropsychological model of visual categorization to auditory categorization of vowels

Twelve male listeners categorized 54 synthetic vowel stimuli that varied in second and third formant frequency on a Bark scale into the American English vowel categories [see text]. A neuropsychologically plausible model of categorization in the visual domain, the Striatal Pattern Classifier (SPC; Ashby & Waldron, 1999), is generalized to the auditory domain and applied separately to the data from each observer. Performance of the SPC is compared with that of the successful Normal A Posteriori Probability model (NAPP; Nearey, 1990; Nearey & Hogan, 1986) of auditory categorization. A version of the SPC that assumed piece-wise linear response region partitions provided a better account of the data than the SPC that assumed linear partitions, and was indistinguishable from a version that assumed quadratic response region partitions. A version of the NAPP model that assumed nonlinear response regions was superior to the NAPP model with linear partitions. The best fitting SPC provided a good account of each observer's data but was outperformed by the best fitting NAPP model. Implications for bridging the gap between the domains of visual and auditory categorization are discussed.

The Conceptual Nervous System and Personality

In this paper the conceptual nervous system approach to the study of personality is traced back to the ideas of Pavlov. The links between his ideas and two strands of modern European personality theory ( Eysenck's, 1967 , arousal theory of extraversion; Gray's, 1970 , reinforcement sensitivity theory) are emphasized. Recent data concerning reinforcement sensitivity theory have revealed a diversity of relationships between personality trait measures and the behavioral responses to the signals of reinforcement present. In view of these data, a reappraisal of the basics of reinforcement sensitivity theory are then presented, using neural network techniques to explore the conceptual nervous system features fundamental to reinforcement sensitivity theory. Simulations using these techniques are also presented which provide possible explanations for the variations in the experimental data, thereby suggesting that reinforcement sensitivity theory should be revised, rather than abandoned. One revision proposes that the fundamental brain systems involved may produce their behavioral effects solely via the influences of their outputs on arousal levels, with arousal linked to aspects of performance in a manner resembling Pavlovian transmarginal inhibition.