Neurocognitive Constructs Underlying Executive Control in Statistically-Determined Mild Cognitive Impairment

Digital assessment of cognition in neurodegenerative disease: a data driven approach leveraging artificial intelligence

Introduction

A rapid and reliable neuropsychological protocol is essential for the efficient assessment of neurocognitive constructs related to emergent neurodegenerative diseases. We developed an AI-assisted, digitally administered/scored neuropsychological protocol that can be remotely administered in ~10 min. This protocol assesses the requisite neurocognitive constructs associated with emergent neurodegenerative illnesses.

Methods

The protocol was administered to 77 ambulatory care/memory clinic patients (56.40% women; 88.50% Caucasian). The protocol includes a 6-word version of the Philadelphia (repeatable) Verbal Learning Test [P(r)VLT], three trials of 5 digits backward from the Backwards Digit Span Test (BDST), and the "animal" fluency test. The protocol provides a comprehensive set of traditional "core" measures that are typically obtained through paper-and-pencil tests (i.e., serial list learning, immediate and delayed free recall, recognition hits, percent correct serial order backward digit span, and "animal" fluency output). Additionally, the protocol includes variables that quantify errors and detail the processes used in administering the tests. It also features two separate, norm-referenced summary scores specifically designed to measure executive control and memory.

Results

Using four core measures, we used cluster analysis to classify participants into four groups: cognitively unimpaired (CU; n = 23), amnestic mild cognitive impairment (MCI; n = 17), dysexecutive MCI (n = 23), and dementia (n = 14). Subsequent analyses of error and process variables operationally defined key features of amnesia (i.e., rapid forgetting, extra-list intrusions, profligate responding to recognition foils); key features underlying reduced executive abilities (i.e., BDST items and dysexecutive errors); and the strength of the semantic association between successive responses on the "animal" fluency test. Executive and memory index scores effectively distinguished between all four groups. There was over 90% agreement between how cluster analysis of digitally obtained measures classified patients compared to classification using a traditional comprehensive neuropsychological protocol. The correlations between digitally obtained outcome variables and analogous paper/pencil measures were robust.

Discussion

The digitally administered protocol demonstrated a capacity to identify patterns of impaired performance and classification similar to those observed with standard paper/pencil neuropsychological tests. The inclusion of both core measures and detailed error/process variables suggests that this protocol can detect subtle, nuanced signs of early emergent neurodegenerative illness efficiently and comprehensively.

Dysexecutive difficulty and subtle everyday functional disabilities: the digital Trail Making Test

Background

Digital neuropsychological tests reliably capture real-time, process-based behavior that traditional paper/pencil tests cannot detect, enabling earlier detection of neurodegenerative illness. We assessed relations between informant-based subtle and mild functional decline and process-based features extracted from the digital Trail Making Test-Part B (dTMT-B).

Methods

A total of 321 community-dwelling participants (56.0% female) were assessed with the Functional Activities Questionnaire (FAQ) and the dTMT-B. Three FAQ groups were constructed: FAQ = 0 (unimpaired); FAQ = 1-4 (subtle impairment); FAQ = 5-8 (mild impairment).

Results

Compared to the FAQ-unimpaired group, other groups required longer pauses inside target circles (p < 0.050) and produced more total pen strokes to complete the test (p < 0.016). FAQ-subtle participants required more time to complete the entire test (p < 0.002) and drew individual lines connecting successive target circles slower (p < 0.001) than FAQ-unimpaired participants. Lines connecting successive circle targets were less straight among FAQ-mild, compared to FAQ-unimpaired participants (p < 0.044). Using stepwise nominal regression (reference group = FAQ-unimpaired), pauses inside target circles classified other participants into their respective groups (p < 0.015, respectively). Factor analysis using six dTMT-B variables (oblique rotation) yielded a two-factor solution related to impaired motor/cognitive operations (48.96% variance explained) and faster more efficient motor/cognitive operations (28.88% variance explained).

Conclusion

Digital assessment technology elegantly quantifies occult, nuanced behavior not previously appreciated, operationally defines critical underlying neurocognitive constructs related to functional abilities, and yields selected process-based scores that outperform traditional paper/pencil test scores for participant classification. When brought to scale, the dTMT-B test could be a sensitive tool to detect subtle-to-mild functional deficits in emergent neurodegenerative illnesses.

The Role of Clinical Assessment in the Era of Biomarkers

Hippocratic Medicine revolved around the three main principles of patient, disease, and physician and promoted the systematic observation of patients, rational reasoning, and interpretation of collected information. Although these remain the cardinal features of clinical assessment today, Medicine has evolved from a more physician-centered to a more patient-centered approach. Clinical assessment allows physicians to encounter, observe, evaluate, and connect with patients. This establishes the patient-physician relationship and facilitates a better understanding of the patient-disease relationship, as the ultimate goal is to diagnose, prognosticate, and treat. Biomarkers are at the core of the more disease-centered approach that is currently revolutionizing Medicine as they provide insight into the underlying disease pathomechanisms and biological changes. Genetic, biochemical, radiographic, and clinical biomarkers are currently used. Here, we define a seven-level theoretical construct for the utility of biomarkers in neurodegenerative diseases. Level 1-3 biomarkers are considered supportive of clinical assessment, capable of detecting susceptibility or risk factors, non-specific neurodegeneration or dysfunction, and/or changes at the individual level which help increase clinical diagnostic accuracy and confidence. Level 4-7 biomarkers have the potential to surpass the utility of clinical assessment through detection of early disease stages and prediction of underlying pathology. In neurodegenerative diseases, biomarkers can potentiate, but cannot substitute, clinical assessment. In this current era, aside from adding to the discovery, evaluation/validation, and implementation of more biomarkers, clinical assessment remains crucial to maintaining the personal, humanistic, and sociocultural aspects of patient care. We would argue that clinical assessment is a custom that should never go obsolete.

Teleneuropsychology for vascular cognitive impairment: Which tools do we have?

The halt of clinical activities imposed during the COVID-19 pandemic forced clinicians to find alternative strategies to provide continuity of care and services, and led to a renewed interest in use of teleneuropsychology (TNP) to remotely assess patients. Recent TNP guidelines recommend maximizing the reproduction of standard in-person assessment, particularly through videoconferences. However, consistency of the adaptations of usual cognitive tests to videoconference needs further elucidation. This review aims at critical reviewing which cognitive tests could be recommended for a remote evaluation of patients with vascular cognitive impairment (VCI) among those widely recognized as reference standards. Current evidence supports the use of global cognitive efficiency (MMSE and MoCA), verbal memory (Revised Hopkins Verbal Learning Test), and language tests (phonemic and semantic verbal fluencies, Boston Naming Test), while there is a lack of strong validity support for measures of visuospatial functions (Rey-Osterreith Complex Figure), and executive functioning and processing speed (Trail making Test, and Digit symbol or Symbol digit tests). This represents a major limitation in the evaluation of VCI because its cognitive profile in often characterized by attention and executive deficits. At present, a videoconference TNP visit appears useful for a brief evaluation of global cognitive efficiency, and to 'triage' patients towards a second level in person evaluation. In future, hybrid models of TNP based on data collected across multiple modalities, incorporating both adaptation of usual cognitive tools and new computerized tools in the supervised videoconference setting, are likely to become the best option for a comprehensive remote cognitive assessment.

Dissociating Statistically Determined Normal Cognitive Abilities and Mild Cognitive Impairment Subtypes with DCTclock

OBJECTIVE

To determine whether the DCTclock can detect differences across groups of patients seen in the memory clinic for suspected dementia.

METHOD

Patients (n = 123) were classified into the following groups: cognitively normal (CN), subtle cognitive impairment (SbCI), amnestic cognitive impairment (aMCI), and mixed/dysexecutive cognitive impairment (mx/dysMCI). Nine outcome variables included a combined command/copy total score and four command and four copy indices measuring drawing efficiency, simple/complex motor operations, information processing speed, and spatial reasoning.

RESULTS

Total combined command/copy score distinguished between groups in all comparisons with medium to large effects. The mx/dysMCI group had the lowest total combined command/copy scores out of all groups. The mx/dysMCI group scored lower than the CN group on all command indices (p < .050, all analyses); and lower than the SbCI group on drawing efficiency (p = .011). The aMCI group scored lower than the CN group on spatial reasoning (p = .019). Smaller effect sizes were obtained for the four copy indices.

CONCLUSIONS

These results suggest that DCTclock command/copy parameters can dissociate CN, SbCI, and MCI subtypes. The larger effect sizes for command clock indices suggest these metrics are sensitive in detecting early cognitive decline. Additional research with a larger sample is warranted.

Neurocognitive Operations Underlying Working Memory Abilities: An Analysis of Latency and Time-Based Parameters

BACKGROUND

The theory of executive attention (Fuster, 2015) suggests considerable plasticity regarding when specific neurocognitive operations are recruited to bring executive tasks to fruition.

OBJECTIVE

We tested the hypothesis that differing neurocognitive operations are recruited upon the initiation of a response, but that other distinct neurocognitive operations are recruited towards the middle or end of a response.

METHODS

The Backward Digit Span Test (BDST) was administered to 58 memory clinic patients (MCI, n = 22; no-MCI, n = 36). Latency to generate all correct 5-span responses was obtained. Statistical analyses found that optimal group classification was achieved using the first and third digit backward. First and third response latencies were analyzed in relation to verbal working memory (WM), visual WM, processing speed, visuospatial operations, naming/lexical access, and verbal episodic memory tests.

RESULTS

For the first response, slower latencies were associated with better performance in relation to verbal WM and visuospatial test performance. For the third response, faster latencies were associated with better processing speed and visuospatial test performance.

CONCLUSION

Consistent with the theory of executive attention, these data show that the neurocognitive operations underlying successful executive test performance are not monolithic but can be quite nuanced with differing neurocognitive operations associated with specific time epochs. Results support the efficacy of obtaining time-based latency parameters to help disambiguate successful executive neurocognitive operations in memory clinic patients.

The Boston Process Approach and Digital Neuropsychological Assessment: Past Research and Future Directions

Neuropsychological assessment using the Boston Process Approach (BPA) suggests that an analysis of the strategy or the process by which tasks and neuropsychological tests are completed, and the errors made during test completion convey much information regarding underlying brain and cognition and are as important as overall summary scores. Research over the last several decades employing an analysis of process and errors has been able to dissociate between dementia patients diagnosed with Alzheimer's disease, vascular dementia associated with MRI-determined white matter alterations, and Parkinson's disease; and between mild cognitive impairment subtypes. Nonetheless, BPA methods can be labor intensive to deploy. However, the recent availability of digital platforms for neuropsychological test administration and scoring now enables reliable, rapid, and objective data collection. Further, digital technology can quantify highly nuanced data previously unobtainable to define neurocognitive constructs with high accuracy. In this paper, a brief review of the BPA is provided. Studies that demonstrate how digital technology translates BPA into specific neurocognitive constructs using the Clock Drawing Test, Backward Digit Span Test, and a Digital Pointing Span Test are described. Implications for using data driven artificial intelligence-supported analytic approaches enabling the creation of more sensitive and specific detection/diagnostic algorithms for putative neurodegenerative illness are also discussed.

Digital Neuropsychological Assessment: New Technology for Measuring Subtle Neuropsychological Behavior

Technology has transformed the science and practice of medicine. In this special mini-forum, data using digital neuropsychological technology are reported. All of these papers demonstrate how coupling digital technology with standard paper and pencil neuropsychological tests are able to extract behavior not otherwise obtainable. As digital assessment methods mature, early identification of persons with emergent neurodegenerative and other neurological illness may be possible.