A friendly critique of neuropsychology: facing the challenges of our future

Integrating Lifestyle Factor Science into Neuropsychological Practice: A National Academy of Neuropsychology Education Paper

OBJECTIVE

The primary aim of this paper is to review evidence and clinical implications related to lifestyle activities associated with promoting brain and cognitive health. Our review targets four key lifestyle factors: physical activity and exercise, social engagement, cognitively stimulating activity, and consuming Mediterranean-style diets.

METHOD

We conducted a critical review of the lifestyle factor literature in the four domains listed earlier. We contextualize this literature review by translating findings, when possible, into evidence-based recommendations to consider when providing neuropsychological services.

RESULTS

There is significant current evidence supporting the role of physical activity and exercise, social engagement, cognitively stimulating activity, and consuming Mediterranean-style diets on positive brain and cognitive health outcomes. While some null findings are present in all four areas reviewed, the weight of the evidence supports the notion that engaging in these activities may promote brain and cognitive functioning.

CONCLUSIONS

Clinical neuropsychologists can have confidence in recommending engagement in physical activity, social activity, and cognitively stimulating activity, and adhering to a Mediterranean-style diet to promote brain and cognitive health. We discuss limitations in existing lifestyle factor research and future directions to enhance the existing evidence base, including additional research with historically underrepresented groups and individuals with neurological conditions.

Translation, cross-cultural adaptation and validation of the 10-item Weekly Calendar Planning Activity in Spanish-speaking ABI patients: a multicenter study

We present the process of translation, adaptation, and validation in the Spanish context of the 10-item version of the Weekly Calendar Planning Activity (WCPA-10), a performance-based measure of cognitive instrumental activities of daily living (C-IADL). The study consisted of two phases: I) translation/cultural adaptation of the WCPA, conducted by professional bilingual translators, a panel of experts, and a pilot study, and II) validation in a sample of 42 acquired brain injury patients (ABI) and 42 healthy participants (HC). WCPA primary outcomes showed expected convergent/discriminant validity patterns with socio-demographical and clinical variables and cognitive processes identifying those WCPA outcomes that best predicted executive and memory deficits measured with a battery of traditional neuropsychological tests. In addition, performance on the WCPA was a significant predictor of everyday functioning over variables such as socio-demographics or global cognition when measured with traditional tests. External validity was established by the WCPA's ability to identify everyday cognitive deficits in ABI patients compared to HC, even in those with subtle cognitive impairment based on neuropsychological tests. The Spanish WCPA-10 seems an appropriate and sensitive assessment tool to identify cognitive-functional impairment in ABI-patients, even those with subtle cognitive impairment. The results also highlight the relevance of this kind of test, as they indicate a better prediction of patients' real-world functioning than traditional neuropsychological tests.

Matching science to reality: how to deploy a participant-driven digital brain health platform

Introduction

Advances in digital technologies for health research enable opportunities for digital phenotyping of individuals in research and clinical settings. Beyond providing opportunities for advanced data analytics with data science and machine learning approaches, digital technologies offer solutions to several of the existing barriers in research practice that have resulted in biased samples.

Methods

A participant-driven, precision brain health monitoring digital platform has been introduced to two longitudinal cohort studies, the Boston University Alzheimer's Disease Research Center (BU ADRC) and the Bogalusa Heart Study (BHS). The platform was developed with prioritization of digital data in native format, multiple OS, validity of derived metrics, feasibility and usability. A platform including nine remote technologies and three staff-guided digital assessments has been introduced in the BU ADRC population, including a multimodal smartphone application also introduced to the BHS population. Participants select which technologies they would like to use and can manipulate their personal platform and schedule over time.

Results

Participants from the BU ADRC are using an average of 5.9 technologies to date, providing strong evidence for the usability of numerous digital technologies in older adult populations. Broad phenotyping of both cohorts is ongoing, with the collection of data spanning cognitive testing, sleep, physical activity, speech, motor activity, cardiovascular health, mood, gait, balance, and more. Several challenges in digital phenotyping implementation in the BU ADRC and the BHS have arisen, and the protocol has been revised and optimized to minimize participant burden while sustaining participant contact and support.

Discussion

The importance of digital data in its native format, near real-time data access, passive participant engagement, and availability of technologies across OS has been supported by the pattern of participant technology use and adherence across cohorts. The precision brain health monitoring platform will be iteratively adjusted and improved over time. The pragmatic study design enables multimodal digital phenotyping of distinct clinically characterized cohorts in both rural and urban U.S. settings.

Capturing cognitive changes in multiple sclerosis by performance-based functional and virtual reality assessments

Cognitive impairment (CI) has been recognized as one of the core multiple sclerosis (MS) symptoms that profoundly impact lives of people with MS (PwMS). Clinical trials have begun to focus on cognition as a primary or secondary outcome, but translating improvements in cognitive testing scores to functioning in the real world is difficult. Performance-based functional assessments and virtual reality (VR) assessments, which incorporate real-world challenges, have been proposed as a way to better assess functional cognition (i.e., cognitive performance and its impact on real-life cognitive functioning of PwMS) and could address the difficulty in evaluating the impact of a treatment on real-world functioning. In this narrative review, we identify and summarize some of the promising recent research applications of performance-based functional assessments and VR tools to assess functional cognition in MS. Overall, most of the studies suggest that functional and VR assessments can detect cognitive differences between people with and without MS and between PwMS with and without CI. Furthermore, performance on some of the functional and VR assessments was associated with performance on standard cognitive assessments. However, developing any guidelines on how to implement these assessments in clinical practice is difficult because of the relatively small sample size across these studies. Performance-based functional and VR assessments represent an innovative approach to increasing sensitivity of how cognitive impairments/abilities present in the daily life of PwMS. More studies, with a larger sample size, robust research methods, and pre- and post-treatment assessments, are warranted to validate relevant, accessible functional and VR assessments before implementing these assessment approaches in clinical practice.

Test-retest reliability and practice effects of the virtual environment grocery store (VEGS)

INTRODUCTION

The use of virtual reality (VR) technology has been suggested as a method to increase ecological validity in neuropsychological assessments. Although validity has been a focus in VR research, little attention has been paid to other psychometric properties such as test-retest reliability and practice effects. Practice effects are common on traditional neuropsychological tests and can be impacted by novelty. Because VR is not widely used it was expected that participants would demonstrate higher practice effects on VR as compared to paper-and-pencil testing.

METHOD

To compare test-retest reliability and practice effects in VR and traditional paper-and-pencil testing, the Virtual Environment Grocery Store (VEGS) and California Verbal Learning Test - Second Edition (CVLT-II) were used in healthy adults (n = 44). Participants received follow-up testing approximately 2 weeks after the initial visit.

RESULTS

Significant practice effects of similar magnitude were seen on memory scores (i.e., total learning, long-delay free recall, and long-delay cued recall) on the VEGS and the CVLT-II. The VEGS and CVLT-II memory scores also demonstrated strong test-retest reliability (r's > .71). Lastly, total learning scores (d = .32) and long-delay cued recall (d = .70) scores were significantly higher on the CVLT-II compared to the VEGS (p's < .01).

CONCLUSIONS

Results suggested similar test-retest reliability and practice effects of the VEGS and CVLT-II, although the VEGS has the benefit of being an immersive technology that simulates an everyday activity. The study replicated past findings that the VEGS is more difficult than the CVLT-II which may be a useful property for clinical assessment.

Executive Dysfunctions in Schizophrenia: A Critical Review of Traditional, Ecological, and Virtual Reality Assessments

In recent years, interest has grown in measuring executive function in schizophrenia with ecological and virtual reality (VR) tools. However, there is a lack of critical analysis comparing those tools with traditional ones. This paper aims to characterize executive dysfunction in schizophrenia by comparing ecological and virtual reality assessments with traditional tools, and to describe the neurobiological and psychopathological correlates. The analysis revealed that ecological and VR tests have higher levels of verisimilitude and similar levels of veridicality compared to traditional tools. Both negative symptoms and disorganization correlate significantly with executive dysfunction as measured by traditional tools, but their relationships with measures based on ecological and VR methods are still unclear. Although there is much research on brain correlates of executive impairments in schizophrenia with traditional tools, it is uncertain if these results will be confirmed with the use of ecological and VR tools. In the diagnosis of executive dysfunction, it is important to use a variety of neuropsychological methods—especially those with confirmed ecological validity—to properly recognize the underlying characteristics of the observed deficits and to implement effective forms of therapy.

Links between parent-reported measures of poor sleep and executive function in childhood autism and attention deficit hyperactivity disorder

OBJECTIVES

This study sought to assess whether poor sleep is associated with aspects of executive function (EF) among children with autism spectrum disorder (ASD), attention deficit hyperactivity disorder (ADHD), or typical development (TD), after adjusting for demographic variables, stimulant medications, intelligence, anxiety, inattention, and hyperactivity.

DESIGN

Cross-sectional.

SETTING

Children recruited through ongoing studies at the Kennedy Krieger Institute.

PARTICIPANTS

We studied 735 children (323 TD; 177 ASD; 235 ADHD) aged 8 to 12 years.

MEASUREMENTS

We investigated associations of parent-reported sleep measures from the Children's Sleep Habits Questionnaire (CSHQ) with parent-report measures of EF and performance-based processing speed with each clinical population. EF was measured using 8 clinical T scores that fall under 2 domains (behavioral regulation and metacognition) from the Behavior Rating Inventory of EF (BRIEF) and the processing speed index from the Wechsler Intelligence Scale for Children-IV or -V.

RESULTS

Higher CSHQ scores were associated with poorer EF on all BRIEF scales, across all child groups, after adjustment for demographic factors, stimulant medications, and IQ. Among children with ADHD, these associations largely remained after adjusting for anxiety. Among those ASD, anxiety partially accounted for these associations, especially for behavioral regulation EF outcomes. Co-occurring symptoms of inattention and hyperactivity/impulsivity further accounted for the associations between sleep and EF. Poor sleep was not significantly associated with processing speed.

CONCLUSIONS

Strong links exist between parent-reported poor sleep and executive dysfunction in children with typical development. Targeting anxiety may alleviate executive dysfunction, especially among children with ASD.

The C Factor: Cognitive dysfunction as a transdiagnostic dimension in psychopathology

Research into cognitive functions across psychological disorders suggests that cognitive deficiencies may be present across multiple disorders, potentially pointing to a transdiagnostic phenomenon. More recently, a single dimension model of psychopathology, the p factor, has been proposed, in which cognitive deficits are thought to be an intrinsic construct, assumed to be transdiagnostic. However, no systematic investigation to date tested this hypothesis. The aim of the present study was to systematically review meta-analyses to assess the hypothesis that the C factor (cognitive dysfunction) is transdiagnostic in psychopathology and review potential moderators that may account for such a phenomenon. We conducted a systematic review of meta-analyses examining cognitive function across all disorders for which data were available. Included meta-analyses (n = 82), comprising 97 clinical samples, yielded 1,055 effect sizes. Twelve major disorders/categories (e.g., bipolar disorder, substance use disorders) were included, comprising 29 distinct clinical entities (e.g., euthymic bipolar disorder; alcohol use disorder). Results show that all disorders reviewed are associated with underperformance across cognitive domains, supporting the hypothesis that the C factor (or cognitive dysfunction) is a transdiagnostic factor related to p. To examine moderators that may explain or contribute to c, we first consider important interpretative limitations of neuropsychological data in psychopathology. More crucially, we review oft-neglected motivational and emotional transdiagnostic constructs of p, as prominent contributing constructs to the C factor. These constructs are offered as a roadmap for future research examining these constructs related to p, that contribute, and may account for cognitive dysfunctions in psychopathology.

Extending the usefulness of the verbal memory test: The promise of machine learning

The evaluation of verbal memory is a core component of neuropsychological assessment in a wide range of clinical and research settings. Leveraging story recall to assay neurocognitive function could be made more useful if it were possible to administer frequently (i.e., would allow for the collection of more patient data over time) and automatically assess the recalls with machine learning methods. In the present study, we evaluated a novel story recall test with 24 parallel forms that was deployed using smart devices in 94 psychiatric inpatients and 80 nonpatient adults. Machine learning and vector-based natural language processing methods were employed to automate test scoring, and performance using these methods was evaluated in their incremental validity, criterion validity (i.e., convergence with trained human raters), and parallel forms reliability. Our results suggest moderate to high consistency across the parallel forms, high convergence with human raters (r values ~ 0.89), and high incremental validity for discriminating between groups. While much work remains, the present findings are critical for implementing an automated, neuropsychological test deployable using remote technologies across multiple and frequent administrations.

An empirically based proposal to identify a short battery to detect neuropsychological impairment in a general adult practice

Objectives: To demonstrate that 1) models based on small numbers of tests can be statistically developed to identify neuropsychological impairment in a general adult neuropsychology clinic and 2) those models show strong predictive validity on replication in a slightly different sample. Method: Latent Class Analyses (LCA) were used to determine neuropsychological classification in 231 patients referred to general adult neuropsychology services. A clinical rating scale was also used to approximate clinical decision-making. Regression models were constructed in a training sample (n = 127) drawn from an adult neuropsychology clinic using test scores from seven different a priori test battery combinations to predict group membership or clinical rating. The utility of the seven models was assessed in a testing sample (n = 104) from another independent adult neuropsychology clinic. Results: The LCA yielded a two class solution characterized by impaired versus non-impaired performance on neuropsychological tests. A seven test battery provided the best balance of accuracy and length in predicting LCA group with a sensitivity of 84.4% and a specificity of 90%. Sensitivity and specificity were slightly attenuated using the clinical rating scale as the criterion, but the seven test battery still provided good accuracy (AUC=.906). Conclusions: Test protocols based on only five to eight test scores can accurately identify most patients with clinical impairment in a diverse adult neuropsychology clinic. Development of short protocols with adequate sensitivity and specificity will become increasingly important to address long waiting lists in light of the COVID pandemic against the general backdrop of increasing demand for neuropsychological services.

Neuropsychology and the dementia spectrum: Differential diagnosis, clinical management, and forensic utility

BACKGROUND

The utility of neuropsychology in the treatment and evaluation of neuropsychological disorders and neurodegenerative diseases is supported by scientific study. As a discipline, neuropsychology's value and efficacy when applied to the dementia spectrum are rooted in its inherent adaptability as a practical, cost-effective, and scientifically based resource for differential diagnosis, treatment planning, and forensic decision making.

OBJECTIVES

This article provides a framework for conceptualizing dementia as a spectrum of disorders and outlines a rationale for preferential reliance upon neuropsychological tenets. The function of neuropsychology in differential diagnosis, clinical management, integrative care, and forensic applications is delineated for use as a contemporary interdisciplinary reference.

METHODOLOGY

An overview of the literature on dementia as a spectrum of disorders has been integrated with the science and practice of neuropsychology.

CONCLUSIONS

The utility of neuropsychology emanates from its focus on brain functioning and the discipline's appreciation for the relationship between brain functioning and cognition, mental state, and behavior. Early and routine referral for neuropsychological assessment allows for the objective determination of normal versus abnormal neurocognitive functioning, provides a baseline for serial reassessment, and leads to the more rapid deployment of effective treatments. Beyond the hospital and clinic, neuropsychological expertise is increasingly sought after as integral to the legal system when decisions regarding eligibility for long term care and questions about capacity require objective and reliable measurement.

Beyond cognitive dysfunction: Relevance of ecological validity of neuropsychological tests in multiple sclerosis

In neurological diseases such as multiple sclerosis (MS), a neuropsychological assessment is often requested to assist clinicians in evaluating the role of cognition in a patient's level of everyday functioning. To be effective in this charge, it is assumed that performance on neuropsychological tests is related to how a person may function in everyday life, and the question is often asked: "Are neuropsychological tests ecologically valid?" In this review, we synthesize the literature that examines the use of neuropsychological tests to assess functioning across a variety of everyday functioning domains in MS (i.e. driving, employment, instrumental activities of daily living (IADLs)). However, we critically examine the usefulness of asking this broad question regarding ecological validity, given the psychometric and conceptual pitfalls it may yield. While many neuropsychological tests may be generally considered "ecologically valid" in MS, it is much more helpful to specify for whom, under what circumstances, and to what degree.

Which approach to measure cognitive functioning should be preferred when exploring the association between cognitive functioning and participation after stroke?

A variety of approaches are currently used to explore the relationship between cognitive functioning and participation after stroke. We aimed to gain insight into the preferred approach to measure cognitive functioning when exploring the association between cognitive functioning and participation in the long term after stroke. In this inception cohort study 128 individuals with stroke participated and were assessed at a single time point three to four years after the event. Participation was measured using the Restrictions subscale of the Utrecht Scale for Evaluation of Rehabilitation-Participation. Subjective cognitive complaints were assessed using the Cognition subscale of the Checklist for Cognitive and Emotional Consequences (CLCE-24-C). Objective cognitive performance was measured using the Montreal Cognitive Assessment (MoCA) and a neuropsychological test battery (NTB) testing multiple cognitive domains. Participation showed a strong correlation (r = 0.51) with the CLCE-24-C and moderate correlations with the domains of visuospatial perception (r = 0.37) and mental speed (r = 0.36). Backward linear regression analyses showed that participation restrictions were best explained by the combination of the CLCE-24-C and a test for visuospatial perception (R²= 0.31). Our findings suggest the use of a combination of subjective cognitive complaints and objective cognitive performance to explore the relationship between cognitive functioning and participation after stroke.

Neuropsychological Diagnostic Accuracy: Factors That Might Lead to a Wrong Diagnosis and How to Avoid Them

False positives and false negatives in neuropsychological assessment can occur due to different reasons and they could have serious consequences such as the administration of an unnecessary treatment that may cause adverse effects and failure to provide timely treatment to patients. Therefore, it is important to know how confident we can be in the diagnosis. Tests scores are insufficient to this end. As a starting point, we need to establish hypotheses about the patient’s condition using the information we have collected from several sources. We also need to use information about the psychometric properties of the tests, predictive values and base rates of neurocognitive disorders and low scores. Whenever this information is lacking the interpretation of performance should be cautious. Several strategies are discussed that may contribute to improve diagnostic accuracy.

Is Episodic Future Thinking Important for Instrumental Activities of Daily Living? A Study in Neurological Patients and Healthy Older Adults

OBJECTIVE

Episodic future thinking is the ability to mentally project oneself into the future. This construct has been explored extensively in cognitive neuroscience and may be relevant for adaptive functioning. However, it has not been determined whether the measurement of episodic future thinking might be valuable in a clinical neuropsychological setting. The current study investigated (1) the relationship between episodic future thinking and instrumental activities of daily living (IADLs); and (2) whether episodic future thinking is related to IADLs over and above standard measures of cognition.

METHOD

Sixty-one older adults with heterogeneous neurological conditions and 41 healthy older adults completed a future thinking task (the adapted Autobiographical Interview), a performance-based measure of instrumental activities of daily living (the Independent Living Scales), and standard clinical measures of memory and executive functioning.

RESULTS

Episodic future thinking significantly predicted IADLs after accounting for age, education, gender, and depression (increase in R2 = .050, p = .010). Episodic future thinking significantly predicted IADLs over and above executive functioning (increase in R2 = .025, p = .030), but was not predictive of IADLs over and above memory (p = .157).

CONCLUSIONS

This study suggests that episodic future thinking is significantly associated with IADLs, beyond what can be accounted for by executive functioning. However, episodic future thinking did not predict IADLs over and above memory. Overall, there is limited evidence for the clinical utility of episodic future thinking. The findings suggest that an episodic future thinking task does not provide enough valuable information about IADLs to justify its inclusion in a clinical neuropsychological setting.

Alzheimer's disease and the processing of uncertainty during choice task performance: Executive dysfunction within the Hick-Hyman law

The Hick-Hyman law states that choice response time (RT) increases linearly with increasing information uncertainty. Neuroimaging studies suggest that the representation of uncertainty in support of response generation is mediated by the cognitive control network (CCN), which is disrupted in Alzheimer's disease (AD). Thus, we predicted that patients with AD would be sensitive to increased uncertainty particularly under conditions that place demands on the internal representation of uncertainty, and that choice RT performance under these conditions would be associated with performance on tests of executive function. Cognitively normal older adults (CN) and patients with AD completed card-sorting tasks that separately manipulated either externally cued uncertainty (i.e., number of sorting piles with a fixed probability of each stimulus type) or more internally driven uncertainty (i.e., the probability of each stimulus type with a fixed number of sorting piles). Consistent with our predictions, AD patients were impaired relative to CN particularly on the internally driven uncertainty task, and RT in this task was associated with performance on neuropsychological measures of executive functioning but not episodic memory. We suggest that this pattern of findings is consistent with presumed disruptions to the CCN in AD and provides neuropsychological evidence in support of the role of the CCN in the representation of uncertainty.

Positive neuropsychology: The science and practice of promoting cognitive health

Positive psychology has influenced multiple subfields within psychology and areas outside of psychology. While positive psychology's focus on positive mental health and character strengths did not appear to meaningfully impact neuropsychology in its earlier stages, more recent indications suggest that the neuropsychological literature, and perhaps the field as a whole, has begun to embrace related research and practice applications. In this context, positive neuropsychology has emerged as a neuropsychological orientation focused on the study and practice of promoting cognitive health. The present review discusses the origins of positive neuropsychology and elaborates on its six key evidence-based domains: compensatory strategy use, activity engagement, prevention of cognitive impairment, public education, exceptional cognition, and positive cognitive outcomes in neuropsychiatric populations. This broad perspective on cognitive wellness can easily be embraced by both clinicians and researchers and offers multiple directions for future growth. Ultimately, consideration of various methods to promote cognitive health can inform our understanding of optimal brain function, maximize functioning in individuals with cognitive limitations, and enhance quality of life among populations served by neuropsychologists.

Further validation of booklet category test subscales for learning, set loss, and memory in a mixed clinical sample

Although it has long been proposed that performance on the Booklet Category Test (BCT) relies on a number of different cognitive abilities, including executive functioning, perceptual reasoning, and memory, only a single total error score is typically derived and interpreted in clinical practice. BCT subscales based on factor analyses of subtest errors or designed specifically to measure specific cognitive domains have been proposed to better assess the multidimensional abilities underlying BCT performance. The aim of this study was to independently replicate and extend previous findings regarding the validity of these subscales. A mixed clinical sample of 137 patients completed the BCT and a number of additional measures used to assess neuropsychological domains of selective attention, various aspects of executive functioning, intellectual functioning, and memory. Correlation and regression analyses were used to explore the convergent and discriminant validity of each subscale. Subscales varied in the number and magnitude of their significant correlations with scores derived from traditional measures. In general, findings supported the convergent validity of BCT category learning, set loss, and memory subscales. However, findings regarding discriminant validity were more variable across subscales. Results provide additional support for the multidimensional nature of the BCT and the validity of derived subscales to measure specific aspects of cognitive functioning beyond what is measured by a total errors score. The recently proposed subscales examined in the current study appear to be worthy of further investigation by clinicians and researchers to determine their clinical utility.

DSM Nosology Changes in Neuropsychological Diagnoses through the Years: A Look at ADHD and Mild Neurocognitive Disorder

This article discusses the evolution of modern neuropsychology as a field and the concomitant changes in the Diagnostic and Statistical Manual of Mental Disorders (DSM). Themes in neuropsychology through the years will be highlighted alongside discussion of how neuropsychologists and neuropsychological research have influenced and have been influenced by the DSM. The DSM 5 attention-deficit/hyperactivity disorder and mild neurocognitive disorder will be used as examples to reflect the evolution of the disorders in relation to neuropsychology and the DSM. In particular, recent criticism and research regarding the nosology of both disorders and future directions will be presented in the context of neuropsychology and DSM. Finally, influence regarding changes to the DSM 5 on neuropsychology in clinical decision making, test selection, and diagnosis will be discussed.

Behavior, neuropsychology and fMRI

Cognitive neuroscientists in the late 20th century began the task of identifying the part(s) of the brain concerned with normal behavior as manifest in the psychological capacities as affective powers, reasoning, behaving purposively and the pursuit of goals, following introduction of the 'functional magnetic resonance imaging' (fMRI) method for identifying brain activity. For this research program to be successful two questions require satisfactory answers. First, as the fMRI method can currently only be used on stationary subjects, to what extent can neuropsychological tests applicable to such stationary subjects be correlated with normal behavior. Second, to what extent can correlations between the various neuropsychological tests on the one hand, and sites of brain activity determined with fMRI on the other, be regarded as established. The extent to which these questions have yet received satisfactory answers is reviewed, and suggestions made both for improving correlations of neuropsychological tests with behavior as well as with the results of fMRI-based observations.

Cognitive rehabilitation of memory for mild cognitive impairment: a methodological review and model for future research

Several recent reviews have suggested that cognitive rehabilitation may hold promise in the treatment of memory deficits experienced by patients with mild cognitive impairment. In contrast to the previous reviews that mainly focused on outcome, the current review examines key methodological challenges that are critical for designing and interpreting research studies and translating results into clinical practice. Using methodological details from 36 studies, we first examine diagnostic variability and how the use of cutoffs may bias samples toward more severely impaired patients. Second, the strengths and limitations of several common rehabilitative techniques are discussed. Half of the reviewed studies used a multi-technique approach that precludes the causal attribution between any specific technique and subsequent improvement. Third, there is a clear need to examine the dose-response relationship since this information was strikingly absent from most studies. Fourth, outcome measures varied widely and frequently depended on neuropsychological tests with little theoretical justification or ecological relevance. Fifth, we discuss how the variability in each of these other four areas complicates efforts to examine training generalization. Overall, future studies should place greater emphasis on ecologically relevant treatment approaches and outcome measures and we propose a hierarchical model that may aid in this pursuit.

Why it is time to develop the use of cognitive event-related potentials in the treatment of psychiatric diseases

The relapse rate for many psychiatric disorders is staggeringly high, indicating that treatment methods combining psychotherapy with neuropharmacological interventions are not entirely effective. Therefore, in psychiatry, there is a current push to develop alternatives to psychotherapy and medication-based approaches. Cognitive deficits have gained considerable importance in the field as critical features of mental illness, and it is now believed that they might represent valid therapeutic targets. Indeed, an increase in cognitive skills has been shown to have a long-lasting, positive impact on the patients' quality of life and their clinical symptoms. We hereby present four principal arguments supporting the use of event-related potentials (ERP) that are derived from electroencephalography, which allow the identification of specific neurocognitive deficiencies in patients. These arguments could assist psychiatrists in the development of individualized, targeted therapy, as well as a follow-up and rehabilitation plan specific to each patient's deficit. Furthermore, they can be used as a tool to assess the possible benefits of combination therapy, consisting of medication, psychotherapy, and "ERP-oriented cognitive rehabilitation". Using this strategy, specific cognitive interventions could be planned based on each patient's needs, for an "individualized" or "personalized" therapy, which may have the potential to reduce relapse rates for many psychiatric disorders. The implementation of such a combined approach would require intense collaboration between psychiatry departments, clinical neurophysiology laboratories, and neuropsychological rehabilitation centers.

Use of Virtual Reality Tasks to Assess Prospective Memory: Applicability and Evidence

Virtual reality (VR) is a term used to describe computer-generated virtual environments that the patient can explore and interact with in real time. In this review, the use of VR to construct ecologically valid tasks for use in neuropsychological assessment and rehabilitation is discussed with particular reference to the measurement of prospective memory (PM) abilities. PM, the ability to act upon delayed intentions, is an example of an everyday ability requiring the coordination of a different cognitive processes that is ideally suited to research and rehabilitation using VR. Studies investigating PM and related abilities in patients with brain impairments are surveyed, and it is established that there is evidence for the utility of applying VR procedures to measure prospective remembering. Future research could usefully focus on the construction of a standardised testing procedure with credible psychometric characteristics. In particular, there needs to be evidence for the criterion validity of such tests. Another potential research avenue is the evaluation of VR platforms as tools to teach memory skills and awareness of impairments. It is concluded that difficulties in adapting programs to specific clinical needs, technical issues, and the reluctance of many clinicians to use computer-based technology need to be overcome before VR is likely to be widely used to measure PM.

Virtual Simulations and the Second Life Metaverse

In neuropsychology’s received paradigm, the “normal science” of assessment and treatment planning appears to be approaching a paradigm shift: first, there are the general developments in other neurosciences that inform the practice of neuropsychological assessment. Second, there is the shift in the purpose of neuropsychological assessment from differential diagnosis of brain pathology to predictions about activities of everyday functioning and treatment planning. Third, there is growing need that neuropsychologists update their outdated technology for ecologically valid assessments. The impending paradigm shift may be well served to include the utility of virtual worlds for ecologically valid neuropsychological assessments. Actualization of the potential of virtual worlds for assessment will require the following: comparisons with well-validated neuropsychological measures, data storage, improved documentation of specific computer hardware and software used in experimental methods, and enhanced methods and result reporting by the researchers publishing studies on virtual worlds.

Functional cooking skills and neuropsychological functioning in patients with stroke: an ecological validity study

Efforts to relate neuropsychological performance to real-world task functioning have predominantly yielded lackluster results, typically with neuropsychological performance accounting for modest amounts of variance in function. Nonetheless, the ecological validity of neuropsychological measures for predicting functional abilities remains a strong research interest and clinical necessity. This study relates neuropsychological performance to performance on a standardised cooking task (Rabideau Kitchen Evaluation - Revised; RKE-R) in persons with stroke. Results showed that while the composite score of mean neuropsychological performance had the largest association with meal preparation, several neuropsychological measures were significantly related to the RKE-R. Groups of left and right hemisphere stroke patients were not significantly different in terms of RKE-R performance. These results suggest that functional cooking task performance is related to intact cognitive abilities in delayed verbal memory, simple auditory attention, and visuospatial skills, as well as overall cognitive performance. Implications for neuropsychologists are discussed.

A computer-based procedure for assessing functional cognitive skills in patients with neurological injuries: The virtual street

PRIMARY OBJECTIVE

The aim of the present investigation was to construct and pilot test a computer-based multi-tasking procedure that could be used to assess the ability of patients with neurological damage to remember instructions in the real world.

RESEARCH DESIGN

A simulated street scene was constructed from a network of photographs and sounds that patients could move through using a touch screen. Three patients with severe, moderate or mild cognitive impairment were assessed on a range of neuropsychological tests and three multi-tasking procedures based in the street. The performance of each patient was compared with that of a matched control.

PROCEDURE

Three tests were administered, each of which involved 'walking' along the length of the street once. On the first test, participants were given up to five errands to remember while moving along the street. On the other two tests they were given three instructions to carry out repeatedly (e.g. 'Record the name of the nearest shop when you hear a dog bark'). In one condition they were given the three instructions on a sheet they could consult and in the other they had no list.

OUTCOMES AND RESULTS

In each case the patient performed more poorly on the multi-tasking test than the matched control. The patients' performance on the computer-based tests was consistent with clinical descriptions of their memory-related deficits.

CONCLUSION

The results illustrate the way in which computer presentation of naturalistic stimuli can be used to construct flexible and standardized tests of memory functioning that have enhanced ecological validity.

Therapeutic Neuropsychological Assessment: A Humanistic Model and Case Example

One of the challenges the field of clinical neuropsychology faces is to develop an assessment process that is relevant to the needs of patients and referral sources and responsive to those needs. One method for meeting this need is for psychologists and neuropsychologists to extend their services to develop clinical interventions that serve to enhance patients' cognitive and emotional well-being. Feedback to patients from the results of neuropsychological tests is an intervention that is considered an important part of the assessment process, and there is evidence that direct feedback has positive therapeutic effects for patients. Although many authors have provided suggestions and principles for conducting neuropsychological test feedback, there is no agreed-on conceptual framework for doing so. The following article presents a humanistic model for providing feedback from the results of neuropsychological tests and a case example of its application with a young woman suffering from a brain tumor.