Marrying Past and Present Neuropsychology: Is the Future of the Process-Based Approach Technology-Based?

Executive functions and processing speed in covert cerebral small vessel disease

BACKGROUND AND PURPOSE

Executive dysfunction and slowed processing speed are central cognitive impairments in cerebral small vessel disease (cSVD). It is unclear whether the subcomponents of executive functions become equally affected and whether computerized tests are more sensitive in detecting early cognitive changes over traditional tests. The associations of specific executive abilities (cognitive flexibility, inhibitory control, working memory) and processing speed with white matter hyperintensities (WMHs) and Instrumental Activities of Daily Living (IADL) were examined.

METHODS

In the Helsinki Small Vessel Disease Study, 152 older individuals without stroke or dementia were assessed with brain magnetic resonance imaging and comprehensive neuropsychological evaluation. WMH volumes were obtained with automated segmentation. Executive functions and processing speed measures included established paper-and-pencil tests and the computer-based Flexible Attention Test (FAT), Simon task and Sustained Attention to Response Task.

RESULTS

White matter hyperintensity volume and IADL were associated with multiple cognitive measures across subdomains independently of demographic factors. The highest effect sizes were observed for FAT numbers and number-letter tasks (tablet modifications from the Trail Making Test), FAT visuospatial span, Simon task and semantic verbal fluency. Some of the widely used tests such as Stroop inhibition, phonemic fluency and digit span were not significantly associated with either WMHs or IADL.

CONCLUSION

Processing speed and executive function subcomponents are broadly related to functional abilities and WMH severity in covert cSVD, but the strength of associations within subdomains is heavily dependent on the assessment method. Digital tests providing precise measures of reaction times and response accuracy seem to outperform many of the conventional paper-and-pencil tests.

Retest reliability and reliable change of community-dwelling Black/African American older adults with and without mild cognitive impairment using NIH Toolbox-Cognition Battery and Cogstate Brief Battery for laptop

OBJECTIVE

With the increased use of computer-based tests in clinical and research settings, assessing retest reliability and reliable change of NIH Toolbox-Cognition Battery (NIHTB-CB) and Cogstate Brief Battery (Cogstate) is essential. Previous studies used mostly White samples, but Black/African Americans (B/AAs) must be included in this research to ensure reliability.

METHOD

Participants were B/AA consensus-confirmed healthy controls (HCs) (n = 49) or mild cognitive impairment (MCI) (n = 34) adults 60-85 years that completed NIHTB-CB and Cogstate for laptop at two timepoints within 4 months. Intraclass correlations, the Bland-Altman method, t-tests, and the Pearson correlation coefficient were used. Cut scores indicating reliable change provided.

RESULTS

NIHTB-CB composite reliability ranged from .81 to .93 (95% CIs [.37-.96]). The Fluid Composite demonstrated a significant difference between timepoints and was less consistent than the Crystallized Composite. Subtests were less consistent for MCIs (ICCs = .01-.89, CIs [-1.00-.95]) than for HCs (ICCs = .69-.93, CIs [.46-.92]). A moderate correlation was found for MCIs between timepoints and performance on the Total Composite (r = -.40, p = .03), Fluid Composite (r = -.38, p = .03), and Pattern Comparison Processing Speed (r = -.47, p = .006).On Cogstate, HCs had lower reliability (ICCs = .47-.76, CIs [.05-.86]) than MCIs (ICCs = .65-.89, CIs [.29-.95]). Identification reaction time significantly improved between testing timepoints across samples.

CONCLUSIONS

The NIHTB-CB and Cogstate for laptop show promise for use in research with B/AAs and were reasonably stable up to 4 months. Still, differences were found between those with MCI and HCs. It is recommended that race and cognitive status be considered when using these measures.

Characterization and assessment of executive functions through a virtual cooking task in euthymic patients with bipolar disorder

Bipolar disorder (BD)1 implies impairments in executive functions during euthymia that interfere in psychosocial functioning. Virtual reality assessments may confer advantages respect to traditional assessments in terms of efficiency and ecological validity. The aim of this study was to validate a novel Virtual Cooking Task (VCT) for executive functions assessment in euthymic patients with BD. This is a cross-sectional study in which a group of BD patients (n = 42) and healthy controls (n = 42) were assessed with the VCT and a battery of computerized standard tasks (CST). Additionally, the influence on psychosocial functioning of both forms of assessment, measured with the FAST, was investigated to check ecological validity. In BD group significant impairments in interference, working memory and sustained attention were found in CST and VCT respect to controls. However, deficits in planning and problem-solving were also revealed with the VCT. With respect to psychosocial functioning, only VCT variables were able to predict FAST scores at the assessment time. The VCT showed a greater sensitivity than CST to assess executive functions and real-life functioning in BD. This provides evidence about the opportunity to design novel cognitive assessments for diagnostic and therapeutic purposes in BD.

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

Suite test. A virtual reality based neuropsychological assessment tool for memory. A normative study on immediate, short-term and delayed memory tasks

OBJECTIVE

To collect normative data for the Suite test, a virtual reality (VR) tool designed to assess memory processes.

METHOD

The normative sample included 676 subjects (49.7% female), aged from 12 to 85 years. The Suite test comprises a 360-degree VR environment designed as a furniture shop, in which participants must group specific sets of furniture items (ordered by different families of customers) by clicking on the furniture to be packed following instructions from a voice-over.

RESULTS

Core variables provided were grouped into immediate, short-term and long-term delayed recall. Cluster analyses established five age groups (12 years old, 13 to 26, 27 to 44, 45 to 58, and 59 to 85) with gender differentiated norms only deemed necessary for those transitioning from adolescence to adulthood (13 to 26) and from middle age to older adulthood (45 to 58). No statistically significant differences were found for additional gender × age normative groups, or for any group differentiated by educational level. A confirmatory factor analysis raised the existence of two differentiated factors, one associated to encoding processes (immediate memory trials) and the other to retrieval processes (both short term and long-term delayed recall trials grouping into the same factor). Additional results on the test reliability and internal consistency are presented.

CONCLUSIONS

Suite Test can help explore memory deficits across the life span and differentiate between visual and verbal memory strategies. Further research is required to study the test sensitivity and specificity, as well as convergent validity studies with well-established memory assessment tools.

Cognitive dispersion is related to subtle objective daily functioning changes in older adults with and without cognitive impairment

Early detection of cognitive and functional decline is difficult given that current tools are insensitive to subtle changes. The present study evaluated whether cognitive dispersion on neuropsychological testing improved prediction of objectively assessed daily functioning using unobtrusive monitoring technologies. Hierarchical linear regression was used to evaluate whether cognitive dispersion added incremental information beyond mean neuropsychological performance in the prediction of objectively assessed IADLs (i.e., computer use, pillbox use, driving) in a sample of 104 community-dwelling older adults without dementia (Mage = 74.59, 38.5% Female, 90.4% White). Adjusting for age, sex, education, and mean global cognitive performance, cognitive dispersion improved prediction of average daily computer use duration (R2 Δ = 0.100, F Change, p = 0.005), computer use duration variability (R2 Δ = 0.089, F Change p = 0.009), and average daily duration of nighttime driving (R2 Δ = 0.072, F Change p = 0.013). These results suggest cognitive dispersion may improve prediction of objectively assessed functional changes in older adults without dementia.

Validity and reliability of a digital solution for cognitive assessment: The Brain on Track®

Background

Cognitive assessment and the early detection of cognitive impairments have been enhanced by the use of remote digital solutions. The Brain on Track® is one of these digital solutions used in clinical practice for online screening and monitoring of cognitive functioning.

Objectives

This study aimed to explore the validity and reliability of the Brain on Track® computerized test on a tablet device in adults.

Methods

A community sample of 54 young adults, 51 middle-aged adults, and 50 older adults were invited to attend in two assessment sessions. The first session included data collection on sociodemographic data, user digital literacy, Brain on Track® on the computer and on the tablet device, and usability from the user and moderator perspective. The second session included the Montreal Cognitive Assessment Questionnaire (MoCA) and a second completion of the Brain on Track® on tablet to assess the criterion validity and test-retest reliability. Hypothesis testing was used to assess construct validity.

Results

A weak to moderate correlation was found between the Brain on Track® tablet score and the MoCA. The ICC was 0.72, 0.84, and 0.79, and Cronbach's alpha was 0.84, 0.83, and 0.89 in young adults, middle-aged adults, and older adults, respectively.

Conclusions

This study suggested that the Brain on Track® administered using a tablet device has criterion validity, particularly in middle-aged and older adults, and internal consistency and test-retest reliability in adults of any age group.

A psychometric study of an executive function assessment instrument (TDI-FE)

BACKGROUND

This study aims to present and discuss the psychometric properties of executive functions, which were measured using the TDI-FE instrument. The analysis encompasses its internal structure, potential sensitivity to fatigue factors, relationships with external criteria, and diagnostic accuracy.

METHODS

The study sample comprised 382 students from Brazil, aged 6-8 years. Child development variables were screened using the TDI-FE and gold standard tests (Cancellation Attention and Trail Making Tests). The proposed scale comprised four activities: a test with fruit images with three tasks, and one memory game.

RESULTS

The one-factor model of EF of the TDI-FE failed to fit to the data. However, fit substantially improved once a latent fatigue factor was controlled in the model. The latent factor of EF assessed by the TDI-FE tasks was coherently associated with a series of external variables, including two popular collateral measures of EF. The diagnostic accuracy was reasonable, and a cut-off of 37 points produced 70% of sensitivity and 60% of specificity.

CONCLUSION

Results indicated that the TDI-FE demonstrated sound psychometric properties and diagnostic accuracy, then consisting of an efficient alternative for the assessment of EFs in early childhood education. The study also proved the need to control for response biases such as fatigue in the latent variable models of EF. The TDI-FE is notable because of its low cost and easy application, and it might fulfill a need for instruments for individuals from different contexts at this stage of development in Brazil.

Adherence type impacts completion rates of frequent mobile cognitive assessments among older adults with and without cognitive impairment

Background

Prior to a diagnosis of Alzheimer's disease, many individuals experience cognitive and behavioral fluctuations that are not detected during a single session of traditional neuropsychological assessment. Mobile applications now enable high-frequency cognitive data to be collected remotely, introducing new opportunities and challenges. Emerging evidence suggests cognitively impaired older adults are capable of completing mobile assessments frequently, but no study has observed whether completion rates vary by assessment frequency or adherence type.

Methods

Thirty-three older adults were recruited from the Boston University Alzheimer's Disease Research Center (mean age = 73.5 years; 27.3% cognitively impaired; 57.6% female; 81.8% White, 18.2% Black). Participants remotely downloaded and completed the DANA Brain Vital application on their own mobile devices throughout the study. The study schedule included seventeen assessments to be completed over the course of a year. Specific periods during which assessments were expected to be completed were defined as subsegments, while segments consisted of multiple subsegments. The first segment included three subsegments to be completed within one week, the second segment included weekly subsegments and spanned three weeks, and the third and fourth segments included monthly subsegments spanning five and six months, respectively. Three distinct adherence types - subsegment adherence, segment adherence, and cumulative adherence - were examined to determine how completion rates varied depending on assessment frequency and adherence type.

Results

Adherence type significantly impacted whether the completion rates declined. When utilizing subsegment adherence, the completion rate significantly declined (p = 0.05) during the fourth segment. However, when considering completion rates from the perspective of segment adherence, a decline in completion rate was not observed. Overall adherence rates increased as adherence parameters were broadened from subsegment adherence (60.6%) to segment adherence (78.8%), to cumulative adherence (90.9%).

Conclusions

Older adults, including those with cognitive impairment, are able to complete remote cognitive assessments at a high-frequency, but may not necessarily adhere to prescribed schedules.

Translation, cross-cultural adaptation and validation of the 10-item Weekly Calendar Planning Activity in Spanish-speaking ABI patients: a multicenter study

We present the process of translation, adaptation, and validation in the Spanish context of the 10-item version of the Weekly Calendar Planning Activity (WCPA-10), a performance-based measure of cognitive instrumental activities of daily living (C-IADL). The study consisted of two phases: I) translation/cultural adaptation of the WCPA, conducted by professional bilingual translators, a panel of experts, and a pilot study, and II) validation in a sample of 42 acquired brain injury patients (ABI) and 42 healthy participants (HC). WCPA primary outcomes showed expected convergent/discriminant validity patterns with socio-demographical and clinical variables and cognitive processes identifying those WCPA outcomes that best predicted executive and memory deficits measured with a battery of traditional neuropsychological tests. In addition, performance on the WCPA was a significant predictor of everyday functioning over variables such as socio-demographics or global cognition when measured with traditional tests. External validity was established by the WCPA's ability to identify everyday cognitive deficits in ABI patients compared to HC, even in those with subtle cognitive impairment based on neuropsychological tests. The Spanish WCPA-10 seems an appropriate and sensitive assessment tool to identify cognitive-functional impairment in ABI-patients, even those with subtle cognitive impairment. The results also highlight the relevance of this kind of test, as they indicate a better prediction of patients' real-world functioning than traditional neuropsychological tests.

Explainable automated evaluation of the clock drawing task for memory impairment screening

Introduction

The clock drawing task (CDT) is frequently used to aid in detecting cognitive impairment, but current scoring techniques are time-consuming and miss relevant features, justifying the creation of an automated quantitative scoring approach.

Methods

We used computer vision methods to analyze the stored scanned images (N = 7,109), and an intelligent system was created to examine these files in a study of aging World Trade Center responders. Outcomes were CDT, Montreal Cognitive Assessment (MoCA) score, and incidence of mild cognitive impairment (MCI).

Results

The system accurately distinguished between previously scored CDTs in three CDT scoring categories: contour (accuracy = 92.2%), digits (accuracy = 89.1%), and clock hands (accuracy = 69.1%). The system reliably predicted MoCA score with CDT scores removed. Predictive analyses of the incidence of MCI at follow-up outperformed human-assigned CDT scores.

Discussion

We created an automated scoring method using scanned and stored CDTs that provided additional information that might not be considered in human scoring.

Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument

OBJECTIVES

The main objectives of this study are to identify the dimensions of Ecological Validity (EV) within the definitions of this concept, understand how they are operationalized in neurocognitive tests, and propose a checklist for EV attributes in neurocognitive tests.

METHOD

A systematized review was combined with content analysis of the selected papers, using the inductive method. We analyzed 82 studies on the EV of neurocognitive tests, 19 literature reviews and 63 empirical studies. Based on this review, we identified the relevant criteria for evaluating EV.

RESULTS

EV is a multidimensional concept with two main dimensions: representativeness and generalization. Representativeness involves the subdimensions simplicity-complexity and artificial-natural and several criteria organized on a continuum from low EV to high EV. Generalization is dependent on representativeness and is influenced by different cognitive and non-cognitive factors. We propose six stages for operationalizing EV, from defining the objectives of the neurocognitive assessment to the methodology for scoring and interpreting the results.

CONCLUSION

This systematized review helps to operationalize the concept of EV by providing a tool for evaluating and improving EV while developing new tests. Further studies with a longitudinal design can compare the predictive value of tests with higher versus lower EV-checklist scores.Key pointsQuestion: Understand the definition of EV, its dimensions and subdimensions, how EV is operationalized in neurocognitive tests and propose a checklist for the EV attributes of neurocognitive tests.Findings: The primary findings were that representativeness and generalization are the main dimensions of EV. Representativeness involves several subdimensions, whereas generalization is dependent on representativeness and is influenced by cognitive and non-cognitive factors. We provided an EV-checklist organized into six parts.Importance: The EV-checklist can be used to guide the development of ecologically valid neurocognitive tests and/or assess the EV of existing ones.Next steps: Examine the predictive value of tests that have higher EV-checklist scores.

The functional connectivity and neuropsychology underlying mental planning operations: data from the digital clock drawing test

We examined the construct of mental planning by quantifying digital clock drawing digit placement accuracy in command and copy conditions, and by investigating its underlying neuropsychological correlates and functional connectivity. We hypothesized greater digit misplacement would associate with attention, abstract reasoning, and visuospatial function, as well as functional connectivity from a major source of acetylcholine throughout the brain: the basal nucleus of Meynert (BNM). Participants (n = 201) included non-demented older adults who completed all metrics within 24 h of one another. A participant subset met research criteria for mild cognitive impairment (MCI; n = 28) and was compared to non-MCI participants on digit misplacement accuracy and expected functional connectivity differences. Digit misplacement and a comparison dissociate variable of total completion time were acquired for command and copy conditions. a priori fMRI seeds were the bilateral BNM. Command digit misplacement is negatively associated with semantics, visuospatial, visuoconstructional, and reasoning (p's < 0.01) and negatively associated with connectivity from the BNM to the anterior cingulate cortex (ACC; p = 0.001). Individuals with MCI had more misplacement and less BNM-ACC connectivity (p = 0.007). Total completion time involved posterior and cerebellar associations only. Findings suggest clock drawing digit placement accuracy may be a unique metric of mental planning and provide insight into neurodegenerative disease.

[Revue systématique des tests cognitifs validés et/ou ayant des normes de référence pour la population canadienne francophone âgée]

Il est essentiel d'utiliser des tests cognitifs ayant été validés et détenant des normes de référence auprès de la population cible, puisque les réalités culturelles et linguistiques différentes entre l'échantillon de validation ou auprès duquel les normes ont été créées et la population cible peuvent affecter les résultats. Cette revue systématique vise à recenser et décrire les tests cognitifs (incluant tests, questionnaires et grilles d'observation) validés et/ou présentant des normes sur la population âgée canadienne francophone. Au total, 46 articles ont été sélectionnés. Cette revue recense 9 tests validés, 20 tests avec normes de référence et 18 tests validés et avec normes, couvrant la majorité des domaines cognitifs (fonctions mnésiques, attentionnelles, exécutives, perceptivo-motrices et langagières), excepté la cognition sociale. La quasi-totalité des échantillons ont été recrutés au Québec. Les tests relevés présentent majoritairement des indices psychométriques satisfaisants et généralement des normes considérant l'âge, le sexe et l'éducation. Cette revue systématique permettra aux cliniciens et chercheurs canadiens en vieillissement d'orienter optimalement leurs choix de tests cognitifs.

The challenge of neuropsychological assessment of visual/visuo-spatial memory: A critical, historical review, and lessons for the present and future

A proliferation of tests exists for the assessment of auditory-verbal memory processes. However, from a clinical practice perspective, the situation is less clear when it comes to the ready availability of reliable and valid tests for the evaluation of visual/visuo-spatial memory processes. While, at face value, there appear to be a wide range of available tests of visual/visuo-spatial memory, utilizing different types of materials and assessment strategies, a number of criticisms have been, and arguably should be, leveled at the majority of these tests. The criticisms that have been directed toward what are typically considered to be visual/visuo-spatial memory tests, such as (1) the potential for verbal mediation, (2) over-abstraction of stimuli, (3) the requirement of a drawing response, and (4) the lack of sensitivity to unilateral brain lesions, mean that, in reality, the number of readily available valid tests of visual/visuo-spatial memory is, at best, limited. This article offers a critical, historical review on the existing measures and resources for the neuropsychological assessment of visual/visuo-spatial memory, and it showcases some examples of newer tests that have aimed to overcome the challenges of assessing these important aspects of memory. The article also identifies new trends and examples of how technological advances such as virtual reality may add value to overcome previous obstacles to assessment, thereby offering professionals more reliable, accurate means to evaluate visual/visuo-spatial memory in clinical practice.

Comparison of Traditional and Virtual Reality-Based Episodic Memory Performance in Clinical and Non-Clinical Cohorts

The California Verbal Learning Test, Second Edition (CVLT-II) and the Virtual Environment Grocery Store (VEGS) use list learning and recognition tasks to assess episodic memory. This study aims to: (1) Replicate prior construct validity results among a new sample of young adults and healthy older adults; (2) Extend this work to a clinical sample of older adults with a neurocognitive diagnosis; (3) Compare CVLT-II and VEGS performance among these groups; and (4) Validate the independence of CVLT and VEGS episodic memory performance measures from executive functioning performance measures. Typically developing young adults (n = 53) and older adults (n = 85), as well as older adults with a neurocognitive diagnosis (n = 18), were administered the CVLT-II, VEGS, and D-KEFS CWIT. Results found that (1) the relationship of the VEGS and CVLT-II measures was highly correlated on all variables, (2) compared to the CVLT-II, participants (particularly older adults) recalled fewer items on the VEGS, and (3) the CVLT-II and VEGS were generally independent of D-KEFS CWIT. It appeared that the VEGS may be more difficult than the CVLT-II, possibly reflecting the word length effect. Performance may have also been impacted by the presence of everyday distractors in the virtual environment.

Utility of the Addenbrooke’s Cognitive Examination III online calculator to differentiate the primary progressive aphasia variants

The Addenbrooke’s Cognitive Examination III is a brief cognitive screening tool that is widely used for the detection and monitoring of dementia. Recent findings suggest that the three variants of primary progressive aphasia can be distinguished based on their distinct profiles on the five subdomain scores of this test. Here, we investigated the utility of the Addenbrooke’s Cognitive Examination III to differentiate the primary progressive aphasia variants based on their item-by-item performance profiles on this test. From these results, we created an interactive primary progressive aphasia Addenbrooke’s Cognitive Examination III calculator which predicts the variant based on a patient’s unique item-by-item profile. Twenty-eight logopenic variant, 25 non-fluent variant and 37 semantic variant primary progressive aphasia patients and 104 healthy controls completed the Addenbrooke’s Cognitive Examination III at first clinical presentation. Multinomial regression analyses were conducted to establish performance profiles among groups, and R Shiny from RStudio was used to create the interactive Addenbrooke’s Cognitive Examination III diagnostic calculator. To verify its accuracy, probability values of the regression model were derived based on a 5-fold cross-validation of cases. The calculator’s accuracy was then verified in an independent sample of 17 logopenic, 19 non-fluent and 13 semantic variant primary progressive aphasia patients and 68 Alzheimer’s disease patients who had completed the Addenbrooke’s Cognitive Examination III (or an older version of this test: Revised) and had in vivo amyloid-PET imaging and/or brain autopsy pathological confirmation. Cross-validation of cases in the calculator model revealed different rates of sensitivity in classifying variants: semantic = 100%, non-fluent = 80.6% and logopenic = 79.9%; healthy controls were distinguished from primary progressive aphasia patients with 100% sensitivity. Verification of in vivo amyloid and/or autopsy-confirmed patients showed that the calculator correctly classified 10/13 (77%) semantic variant, 3/19 (16%) non-fluent variant and 4/17 (24%) logopenic variant patients. Importantly, for patients who were not classified, diagnostic probability values mostly pointed toward the correct clinical diagnosis. Furthermore, misclassified diagnoses of the primary progressive aphasia cohort were rare (1/49; 2%). Although 22 of the 68 Alzheimer’s disease patients (32%) were misclassified with primary progressive aphasia, 19/22 were misclassified with the logopenic variant (i.e. falling within the same neuropathological entity). The Addenbrooke’s Cognitive Examination III primary progressive aphasia diagnostic calculator demonstrates sound accuracy in differentiating the variants based on an item-by-item Addenbrooke’s Cognitive Examination III profile. This calculator represents a new frontier in using data-driven approaches to differentiate the primary progressive aphasia variants.

The Boston Process Approach and Digital Neuropsychological Assessment: Past Research and Future Directions

Neuropsychological assessment using the Boston Process Approach (BPA) suggests that an analysis of the strategy or the process by which tasks and neuropsychological tests are completed, and the errors made during test completion convey much information regarding underlying brain and cognition and are as important as overall summary scores. Research over the last several decades employing an analysis of process and errors has been able to dissociate between dementia patients diagnosed with Alzheimer's disease, vascular dementia associated with MRI-determined white matter alterations, and Parkinson's disease; and between mild cognitive impairment subtypes. Nonetheless, BPA methods can be labor intensive to deploy. However, the recent availability of digital platforms for neuropsychological test administration and scoring now enables reliable, rapid, and objective data collection. Further, digital technology can quantify highly nuanced data previously unobtainable to define neurocognitive constructs with high accuracy. In this paper, a brief review of the BPA is provided. Studies that demonstrate how digital technology translates BPA into specific neurocognitive constructs using the Clock Drawing Test, Backward Digit Span Test, and a Digital Pointing Span Test are described. Implications for using data driven artificial intelligence-supported analytic approaches enabling the creation of more sensitive and specific detection/diagnostic algorithms for putative neurodegenerative illness are also discussed.

Cognition in prodromal Parkinson's disease

One characteristic of Parkinson's disease (PD) is a prodromal phase, lasting many years during which both pre-clinical motor and non-motor symptoms occur. Around one-fifth of patients with PD manifest mild cognitive impairment at time of clinical diagnosis. Thus, important challenges are to define the time of onset of cognitive dysfunction in the prodromal phase of PD, and to define its co-occurrence with other specific characteristics. Evidence for cognitive change in prodromal PD comes from various study designs, including both longitudinal and cross-sectional approaches with different target groups. These studies support the concept that changes in global cognitive function and alterations in executive functions occur, and that these changes may be present up to 6 years before clinical PD diagnosis. Notably, this evidence led to including global cognitive impairment as an independent prodromal marker in the recently updated research criteria of the Movement Disorder Society for prodromal PD. Knowledge in this field, however, is still at its beginning, and evidence is sparse about many aspects of this topic. Further longitudinal studies including standardized assessments of global and domain-specific cognitive functions are needed to gain further knowledge about the first appearance, the course, and the interaction of cognitive deficits with other non-motor symptoms in prodromal stage PD. Treatment approaches, including non-pharmacological interventions, in individuals with prodromal PD might help to prevent or delay cognitive dysfunction in early PD.

Identifying Mild Cognitive Impairment by Using Human-Robot Interactions

BACKGROUND

Mild cognitive impairment (MCI), which is common in older adults, is a risk factor for dementia. Rapidly growing health care demand associated with global population aging has spurred the development of new digital tools for the assessment of cognitive performance in older adults.

OBJECTIVE

To overcome methodological drawbacks of previous studies (e.g., use of potentially imprecise screening tools that fail to include patients with MCI), this study investigated the feasibility of assessing multiple cognitive functions in older adults with and without MCI by using a social robot.

METHODS

This study included 33 older adults with or without MCI and 33 healthy young adults. We examined the utility of five robotic cognitive tests focused on language, episodic memory, prospective memory, and aspects of executive function to classify age-associated cognitive changes versus MCI. Standardized neuropsychological tests were collected to validate robotic test performance.

RESULTS

The assessment was well received by all participants. Robotic tests assessing delayed episodic memory, prospective memory, and aspects of executive function were optimal for differentiating between older adults with and without MCI, whereas the global cognitive test (i.e., Mini-Mental State Examination) failed to capture such subtle cognitive differences among older adults. Furthermore, robot-administered tests demonstrated sound ability to predict the results of standardized cognitive tests, even after adjustment for demographic variables and global cognitive status.

CONCLUSION

Overall, our results suggest the human-robot interaction approach is feasible for MCI identification. Incorporating additional cognitive test measures might improve the stability and reliability of such robot-assisted MCI diagnoses.

Diagnostic Validity of the Smart Aging Serious Game: An Innovative Tool for Digital Phenotyping of Mild Neurocognitive Disorder

BACKGROUND

The Smart Aging Serious Game (SASG) is an ecologically-based digital platform used in mild neurocognitive disorders. Considering the higher risk of developing dementia for mild cognitive impairment (MCI) and vascular cognitive impairment (VCI), their digital phenotyping is crucial. A new understanding of MCI and VCI aided by digital phenotyping with SASG will challenge current differential diagnosis and open the perspective of tailoring more personalized interventions.

OBJECTIVE

To confirm the validity of SASG in detecting MCI from healthy controls (HC) and to evaluate its diagnostic validity in differentiating between VCI and HC.

METHODS

161 subjects (74 HC: 37 males, 75.47±2.66 mean age; 60 MCI: 26 males, 74.20±5.02; 27 VCI: 13 males, 74.22±3.43) underwent a SASG session and a neuropsychological assessment (Montreal Cognitive Assessment (MoCA), Free and Cued Selective Reminding Test, Trail Making Test). A multi-modal statistical approach was used: receiver operating characteristic (ROC) curves comparison, random forest (RF), and logistic regression (LR) analysis.

RESULTS

SASG well captured the specific cognitive profiles of MCI and VCI, in line with the standard neuropsychological measures. ROC analyses revealed high diagnostic sensitivity and specificity of SASG and MoCA (AUCs > 0.800) in detecting VCI versus HC and MCI versus HC conditions. An acceptable to excellent classification accuracy was found for MCI and VCI (HC versus VCI; RF: 90%, LR: 91%. HC versus MCI; RF: 75%; LR: 87%).

CONCLUSION

SASG allows the early assessment of cognitive impairment through ecological tasks and potentially in a self-administered way. These features make this platform suitable for being considered a useful digital phenotyping tool, allowing a non-invasive and valid neuropsychological evaluation, with evident implications for future digital-health trails and rehabilitation.

The journey is just as important as the destination-Digital neuropsychological assessment provides performance stability measures in patients with acquired brain injury

BACKGROUND

Cognitive performances on neuropsychological paper-and-pencil tests are generally evaluated quantitatively by examining a final score (e.g., total duration). Digital tests allow for a quantitative evaluation of "how" a patient attained a final score, which opens the possibility to assess more subtle cognitive impairment even when final scores are evaluated as normal. We assessed performance stability (i.e., the number of fluctuations in test performance) to investigate (1) differences in performance stability between patients with acquired brain injury (ABI) and healthy controls; (2) the added value of performance stability measures in patients with ABI; and (3) the relation between performance stability and cognitive complaints in daily life in patients with ABI.

METHODS

We administered three digital neuropsychological tests (Rey Auditory Verbal Learning Test, Trail Making Test, Stroop Colour and Word Test) and the Cognitive Complaints-Participation (CoCo-P) inventory in patients with ABI (n = 161) and healthy controls (n = 91).

RESULTS

Patients with ABI fluctuated more in their performance on all tests, when compared to healthy controls. Furthermore, 4-15% of patients who performed inside normal range on the conventional final scores were outside normal range on the performance stability measures. The performance stability measures, nor the conventional final scores, were associated with cognitive complaints in daily life.

CONCLUSIONS

Stability in test performance of patients was clearly dissociable from healthy controls, and may assess additional cognitive weaknesses which might not be observed or objectified with paper-and-pencil tests. More research is needed for developing measures better associated with cognitive complaints.

Digital Technology Differentiates Graphomotor and Information Processing Speed Patterns of Behavior

BACKGROUND

Coupling digital technology with traditional neuropsychological test performance allows collection of high-precision metrics that can clarify and/or define underlying constructs related to brain and cognition.

OBJECTIVE

To identify graphomotor and information processing trajectories using a digitally administered version of the Digit Symbol Substitution Test (DSST).

METHODS

A subset of Long Life Family Study participants (n = 1,594) completed the DSST. Total time to draw each symbol was divided into 'writing' and non-writing or 'thinking' time. Bayesian clustering grouped participants by change in median time over intervals of eight consecutively drawn symbols across the 90 s test. Clusters were characterized based on sociodemographic characteristics, health and physical function data, APOE genotype, and neuropsychological test scores.

RESULTS

Clustering revealed four 'thinking' time trajectories, with two clusters showing significant changes within the test. Participants in these clusters obtained lower episodic memory scores but were similar in other health and functional characteristics. Clustering of 'writing' time also revealed four performance trajectories where one cluster of participants showed progressively slower writing time. These participants had weaker grip strength, slower gait speed, and greater perceived physical fatigability, but no differences in cognitive test scores.

CONCLUSION

Digital data identified previously unrecognized patterns of 'writing' and 'thinking' time that cannot be detected without digital technology. These patterns of performance were differentially associated with measures of cognitive and physical function and may constitute specific neurocognitive biomarkers signaling the presence of subtle to mild dysfunction. Such information could inform the selection and timing of in-depth neuropsychological assessments and help target interventions.

Response Time Measures as Supplementary Validity Indicators in Forced-Choice Recognition Memory Performance Validity Tests: A Systematic Review

Performance validity tests (PVTs) based on the forced-choice recognition memory (FCRM) paradigm are commonly used for the detection of noncredible performance. Examinees' response times (RTs) are affected by cognitive processes associated with deception and can also be gathered without lengthening the duration of the assessment. Consequently, interest in the utility of these measures as supplementary validity indicators in FCRM-PVTs has grown over the years. The current systematic review summarizes both clinical and simulation (i.e., healthy participants simulating cognitive impairment) studies of RTs in FCRM-PVTs. The findings of 25 peer-reviewed articles (n = 26 empirical studies) indicate that noncredible performance in FCRM-PVTs is associated with longer RTs. Additionally, there are indications that noncredible performance is associated with larger variability in RTs. RT measures, however, have lower discrimination capacity than conventional accuracy measures. Their utility may therefore lie in reaching decisions regarding cases with border zone accuracy scores, as well as aiding in the detection of more sophisticated examinees who are aware of the use of accuracy-based validity indicators in FCRM-PVTs. More research, however, is required before these measures are incorporated in daily practice and clinical decision-making processes.

Paradigm Shift Toward Digital Neuropsychology and High-Dimensional Neuropsychological Assessments: Review

Neuropsychologists in the digital age have increasing access to emerging technologies. The National Institutes of Health (NIH) initiatives for behavioral and social sciences have emphasized these developing scientific and technological potentials (eg, novel sensors) for augmented characterization of neurocognitive, behavioral, affective, and social processes. Perhaps these innovative technologies will lead to a paradigm shift from disintegrated and data-poor behavioral science to cohesive and data-rich science that permits improved translation from bench to bedside. The 4 main advances influencing the scientific priorities of a recent NIH Office of Behavioral and Social Sciences Research strategic plan include the following: integration of neuroscience into behavioral and social sciences, transformational advances in measurement science, digital intervention platforms, and large-scale population cohorts and data integration. This paper reviews these opportunities for novel brain-behavior characterizations. Emphasis is placed on the increasing concern of neuropsychology with these topics and the need for development in these areas to maintain relevance as a scientific discipline and advance scientific developments. Furthermore, the effects of such advancements necessitate discussion and modification of training as well as ethical and legal mandates for neuropsychological research and praxes.

Digital neuropsychological assessment: Feasibility and applicability in patients with acquired brain injury

INTRODUCTION

Digital neuropsychological assessment (d-NPA) has several advantages over paper-and-pencil tests in neuropsychological assessment, such as a more standardized stimulus presentation and response acquisition. We investigated (1) the feasibility and user-experience of a d-NPA in patients with acquired brain injury (ABI) and healthy controls; (2) the applicability of conventional paper-and-pencil norms on digital tests; and (3) whether familiarity with a tablet would affect test performance on a tablet.

METHOD

We administered a d-NPA in stroke patients (n = 59), traumatic brain injury patients (n = 61) and healthy controls (n = 159). The neuropsychological tests were presented on a tablet and participants used a pencil stylus to respond. We examined the completion rate to assess the feasibility, and a semi-structured interview was conducted to examine the user-experience. The applicability of conventional norms was examined by the number of healthy controls performing <10^th percentile, which was expected to be no more than 10%. The effect of tablet familiarity on test performance was examined with a regression-based model.

RESULTS

Overall, 94% of patients completed the d-NPA. The d-NPA was considered pleasant by patients and healthy controls. Conventional norms that exist for paper-and-pencil tests were not applicable on the digital version of the tests, as up to 34% of healthy controls showed an abnormal performance on half of the tests. Tablet familiarity did not affect test performance on a tablet, indicating that participants who were more experienced with working with a tablet did not perform better on digital tests.

CONCLUSIONS

The administration of a d-NPA is feasible in patients with ABI. Familiarity with a tablet did not impact test performance, which is particularly important in neuropsychological assessment. Future research should focus on developing norms in order to implement a d-NPA in clinical practice.