Is the montreal cognitive assessment superior to the mini-mental state examination in detecting subtle cognitive impairment among middle-aged outpatient U.S. Military veterans?

What traditional neuropsychological assessment got wrong about mild traumatic brain injury. II: limitations in test development, research design, statistical and psychometric issues

PRIMARY OBJECTIVE

This is Part II of a four-part opinion review on traditional neuropsychological assessment methods and findings associated with mild traumatic brain injury (mTBI). This Part II review focuses on historical, psychometric and statistical issues involving traditional neuropsychological methods that have been used in neuropsychological outcome studies of mTBI, but demonstrates the critical limitations of traditional methods.

RESEARCH DESIGN

This is an opinion review.

METHODS AND PROCEDURES

Traditional neuropsychological tests are dated and lack specificity in evaluating such a heterogenous and complex injury as occurs with mTBI.

MAIN OUTCOME AND RESULTS

In this review, we demonstrate traditional neuropsychological methods were never developed as standalone measures for detecting subtle changes in neurocognitive or neurobehavioral functioning and likewise, never designed to address the multifaceted issues related to underlying mTBI neuropathology symptom burden from having sustained a concussive brain injury.

CONCLUSIONS

For neuropsychological assessment to continue to contribute to clinical practice and outcome literature involving mTBI, major innovative changes are needed that will likely require technological advances of novel assessment techniques more specifically directed to evaluating the mTBI patient. These will be discussed in Part IV.

Genetic Liability, Exposure Severity, and Post-Traumatic Stress Disorder Predict Cognitive Impairment in World Trade Center Responders

BACKGROUND

There is a high incidence of cognitive impairment among World Trade Center (WTC) responders, comorbid with post-traumatic stress disorder (PTSD). Yet, it remains unknown whether genetic liability for Alzheimer's disease, PTSD, educational attainment, or for a combination of these phenotypes, is associated with cognitive impairment in this high-risk population. Similarly, whether the effects of genetic liability are comparable to PTSD and indicators of exposure severity remains unknown.

OBJECTIVE

In a study of 3,997 WTC responders, polygenic scores for Alzheimer's disease, PTSD, and educational attainment were used to test whether genome-wide risk for one or more of these phenotypes is associated with cognitive impairment, controlling for population stratification, while simultaneously estimating the effects of demographic factors and indicators of 9/11 exposure severity, including symptoms of PTSD.

RESULTS

Polygenic scores for Alzheimer's disease and educational attainment were significantly associated with an increase and decrease, respectively, in the hazard rate of mild cognitive impairment. The polygenic score for Alzheimer's disease was marginally associated with an increase in the hazard rate of severe cognitive impairment, but only age, exposure severity, and symptoms of PTSD were statistically significant predictors.

CONCLUSION

These results add to the emerging evidence that many WTC responders are suffering from mild cognitive impairments that resemble symptoms of Alzheimer's disease, as genetic liability for Alzheimer's disease predicted incidence of mild cognitive impairment. However, compared to polygenic scores, effect sizes were larger for PTSD and the type of work that responders completed during rescue and recovery efforts.

Montreal Cognitive Assessment scores of Veterans and Canadian Armed Forces personnel seeking mental health treatment

LAY SUMMARY

The Montreal Cognitive Assessment (MoCA) is a test of mild cognitive impairment that is commonly administered to military personnel seeking mental health treatment. However, there is little research on the average MoCA score for military Veterans. This study looked at MoCA scores provided by Canadian Armed Forces members and Veterans receiving services for an operational-related mental health condition. Scores below the cut-off for mild cognitive impairment were not uncommon and were related to education level, as well as to severity of posttraumatic stress disorder and depression. These findings will help clinicians better contextualize score variation among clients.

Can MoCA and MMSE Be Interchangeable Cognitive Screening Tools? A Systematic Review

BACKGROUND AND OBJECTIVES

Cognitive disorders may be an early sign of neuropsychiatric disorders; however, it remains unclear whether the screening measures are interchangeable. The aim of this study was to contrast the most commonly used screening tools-Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment (MoCA)-for early detection of neurocognitive disorder (NCD).

RESEARCH DESIGN AND METHODS

This study presents a descriptive systematic review and informative literature according to the Cochrane Foundation's guidelines. The keywords "Mini-Mental State Examination" and "Montreal Cognitive Assessment" were searched in the Web of Science, SciELO, and LILACS databases.

RESULTS

Fifty-one studies were selected including a total sample of 11,870 participants (8,360 clinical patients and 3,510 healthy controls). Most studies were published in the past 5 years using a cross-sectional design, carried out across the world. They were organized by age ranges (18-69 years and 20-89 years), years of schooling, and mental status (with and without mental and behavior disorders). Sixteen of 18 studies had participants aged 18-69 years, and 21 out of 33 studies within the older set suggested that the MoCA is a more sensitive tool for detecting NCD.

DISCUSSION AND IMPLICATIONS

Thirty-seven studies suggested that the MoCA is a more sensitive tool for NCD detection because it assesses executive function and visuospatial abilities. Some individuals who demonstrated normal cognitive function on the MMSE had lower performance on the MoCA. However, it seems necessary to establish different cutoffs based on years of schooling to avoid false positives. Future studies should contrast MoCA with other screening tools designed for NCD assessment.

Cognitive Function and its Risk Factors Among Older US Adults Living at Home

BACKGROUND

The Montreal Cognitive Assessment (MoCA) has not been administered to a representative national sample, precluding comparison of patient scores to the general population and for risk factor identification.

METHODS

A validated survey-based adaptation of the MoCA (MoCA-SA) was administered to a probability sample of home-dwelling US adults aged 62 to 90, using the National Social Life, Health, and Aging Project (n=3129), yielding estimates of prevalence in the United States. The association between MoCA-SA scores and sociodemographic and health-related risk factors were determined.

RESULTS

MoCA-SA scores decreased with age, and there were substantial differences among sex, education, and race/ethnicity groups. Poor physical health, functional status, and depression were also associated with lower cognitive performance; current health behaviors were not. Using the recommended MoCA cut-point score for Mild Cognitive Impairment (MoCA score <26; MoCA-SA score <17), 72% (95% confidence interval, 69% to 74%) of older US adults would be classified as having some degree of cognitive impairment.

CONCLUSIONS

Our results provide an important national estimate for interpreting MoCA scores from individual patients, and establish wide variability in cognition among older home-dwelling US adults. Care should be taken in applying previously-established MoCA cut-points to the general population, especially when evaluating individuals from educationally and ethnically diverse groups.

A practical computerized decision support system for predicting the severity of Alzheimer's disease of an individual

Computerized clinical decision support systems can help to provide objective, standardized, and timely dementia diagnosis. However, current computerized systems are mainly based on group analysis, discrete classification of disease stages, or expensive and not readily accessible biomarkers, while current clinical practice relies relatively heavily on cognitive and functional assessments (CFA). In this study, we developed a computational framework using a suite of machine learning tools for identifying key markers in predicting the severity of Alzheimer's disease (AD) from a large set of biological and clinical measures. Six machine learning approaches, namely Kernel Ridge Regression (KRR), Support Vector Regression, and k-Nearest Neighbor for regression and Support Vector Machine (SVM), Random Forest, and k-Nearest Neighbor for classification, were used for the development of predictive models. We demonstrated high predictive power of CFA. Predictive performance of models incorporating CFA was shown to consistently have higher accuracy than those based solely on biomarker modalities. We found that KRR and SVM were the best performing regression and classification methods respectively. The optimal SVM performance was observed for a set of four CFA test scores (FAQ, ADAS13, MoCA, MMSE) with multi-class classification accuracy of 83.0%, 95%CI = (72.1%, 93.8%) while the best performance of the KRR model was reported with combined CFA and MRI neuroimaging data, i.e., R ² = 0.874, 95%CI = (0.827, 0.922). Given the high predictive power of CFA and their widespread use in clinical practice, we then designed a data-driven and self-adaptive computerized clinical decision support system (CDSS) prototype for evaluating the severity of AD of an individual on a continuous spectrum. The system implemented an automated computational approach for data pre-processing, modelling, and validation and used exclusively the scores of selected cognitive measures as data entries. Taken together, we have developed an objective and practical CDSS to aid AD diagnosis.

Neuropsychological correlates of self-reported impulsivity and informant-reported maladaptive behaviour among veterans with posttraumatic stress disorder and traumatic brain injury history

OBJECTIVE

Frontal lobe deficits resulting from traumatic brain injury (TBI) and/or posttraumatic stress disorder (PTSD) have been linked to impulsive behaviour. We sought to examine whether neuropsychological performance predicted self-reported impulsivity and informant-reported maladaptive behaviour.

METHOD

We administered the Delis-Kaplan Executive Function System (D-KEFS) to 116 Iraq/Afghanistan-era veterans diagnosed with a history of TBI and PTSD.

RESULTS

Poorer performance on D-KEFS Stroop Task (both colour and word, separately) and Trail making (letter sequencing and motor speed) tasks and higher PTSD symptom severity were associated with higher self-reported impulsivity. Trail making letter sequencing performance was negatively associated with informant-reported maladaptive behaviour. Regression analyses revealed PTSD symptom severity and Trail making letter sequencing best predicted self-reported impulsivity, even when accounting for age, sex, and education. Only Trail making letter sequencing predicted informant-reported maladaptive behaviour when accounting for other variables in the model.

CONCLUSIONS

Attention and processing speed impairments and PTSD symptom severity appear to be important predictors of impulsivity and problematic behaviour among veterans. Findings have implications for theoretical models of aggression and violence and inform the assessment and treatment of individuals with TBI and PTSD.

Multicenter Validation of an MMSE-MoCA Conversion Table

BACKGROUND

Accumulating evidence points to the superiority of the MoCA over the MMSE as a cognitive screening tool. To facilitate the transition from the MMSE to the MoCA in clinical and research settings, authors have developed MMSE-MoCA conversion tables. However, it is unknown whether a conversion table generated from Alzheimer's disease (AD) patients would apply to patients with other dementia subtypes like vascular dementia or frontotemporal dementia. Furthermore, the reliability and accuracy of MMSE-MoCA conversion tables has not been properly evaluated.

METHOD

We retrospectively examined the MMSE-MoCA relationship in a large multicenter sample gathered from 3 Memory Clinics in Quebec, Canada (1492 patients). We produced an MMSE-MoCA conversion table using the equi-percentile method with log-linear smoothing. We then cross-validated our conversion table with the ADNI dataset (1202 patients) and evaluated its accuracy for future predictions.

RESULTS

The MMSE-MoCA conversion table is consistent with previously published tables and has an intra-class correlation of 0.633 with the ADNI sample. However, we found that the MMSE-MoCA relationship is significantly modified by diagnosis (P < .01), with dementia subtypes associated with a dysexecutive syndrome showing a trend towards higher MMSE than other dementia syndromes for a given MoCA score. The large width of 95% confidence interval (CI) for a new prediction suggests questionable reliability for clinical use.

CONCLUSION

In this study, we validated a conversion table between MMSE and MoCA using a large multicenter sample. Our results suggest caution in interpreting the tables in heterogeneous clinical populations, as the MMSE-MoCA relationship may be different across dementia subtypes.

The effects of strength training on cognitive performance in elderly women

Aging is a degenerative process marked by recognized functional, physiological, and metabolic impairments, such as dynapenia and diminished cognitive capacity. Therefore, the search for innovative strategies to prevent/delay these physiological and cognitive disorders is essential to guarantee the independence and life quality of an elderly population. The aim of this work is to verify the effect of a 12-week resistance exercise program on the general physical aptitude and cognitive capacities of elderly and sedentary women. Twenty-nine women (65.87±5.69 years) were divided into two groups. The control group was composed of eight elderly women who met the same inclusion criteria of the study and the strength training group was composed of 29 elderly women who were subjected to a resistance exercise program defined by 12 upper and lower limb exercises combined in 3×10 repetitions with 1-minute interval between repetitions and two resting minutes between exercises (three times/week). Weight loads were fixed between 60% and 75% of the apparent 1 repetition maximum, which was estimated by the test of 10 maximum repetitions. The direct curl was performed for upper body strength evaluation with 2.3 kg dumbbells for 30 seconds, whereas the chair test was used for lower body evaluation (total sit–stand movements in 30 seconds). The cognitive capacities of subjects were evaluated by “The Montreal Cognitive Assessment” questionnaire. After 12 weeks, the elderly group showed significant increases in the average upper body strength (58%), lower body strength (68%), and cognitive capacity (19%). The present study demonstrated that regular resistance exercises could provide significant gains on the upper and lower body strength concomitant to positive improvements on cognitive capacities of elderly women, bringing enhanced life quality.

Mini-Mental State Examination (MMSE) for the detection of dementia in clinically unevaluated people aged 65 and over in community and primary care populations

BACKGROUND

The Mini Mental State Examination (MMSE) is a cognitive test that is commonly used as part of the evaluation for possible dementia.

OBJECTIVES

To determine the diagnostic accuracy of the Mini-Mental State Examination (MMSE) at various cut points for dementia in people aged 65 years and over in community and primary care settings who had not undergone prior testing for dementia.

SEARCH METHODS

We searched the specialised register of the Cochrane Dementia and Cognitive Improvement Group, MEDLINE (OvidSP), EMBASE (OvidSP), PsycINFO (OvidSP), LILACS (BIREME), ALOIS, BIOSIS previews (Thomson Reuters Web of Science), and Web of Science Core Collection, including the Science Citation Index and the Conference Proceedings Citation Index (Thomson Reuters Web of Science). We also searched specialised sources of diagnostic test accuracy studies and reviews: MEDION (Universities of Maastricht and Leuven, www.mediondatabase.nl), DARE (Database of Abstracts of Reviews of Effects, via the Cochrane Library), HTA Database (Health Technology Assessment Database, via the Cochrane Library), and ARIF (University of Birmingham, UK, www.arif.bham.ac.uk). We attempted to locate possibly relevant but unpublished data by contacting researchers in this field. We first performed the searches in November 2012 and then fully updated them in May 2014. We did not apply any language or date restrictions to the electronic searches, and we did not use any methodological filters as a method to restrict the search overall.

SELECTION CRITERIA

We included studies that compared the 11-item (maximum score 30) MMSE test (at any cut point) in people who had not undergone prior testing versus a commonly accepted clinical reference standard for all-cause dementia and subtypes (Alzheimer disease dementia, Lewy body dementia, vascular dementia, frontotemporal dementia). Clinical diagnosis included all-cause (unspecified) dementia, as defined by any version of the Diagnostic and Statistical Manual of Mental Disorders (DSM); International Classification of Diseases (ICD) and the Clinical Dementia Rating.

DATA COLLECTION AND ANALYSIS

At least three authors screened all citations.Two authors handled data extraction and quality assessment. We performed meta-analysis using the hierarchical summary receiver-operator curves (HSROC) method and the bivariate method.

MAIN RESULTS

We retrieved 24,310 citations after removal of duplicates. We reviewed the full text of 317 full-text articles and finally included 70 records, referring to 48 studies, in our synthesis. We were able to perform meta-analysis on 28 studies in the community setting (44 articles) and on 6 studies in primary care (8 articles), but we could not extract usable 2 x 2 data for the remaining 14 community studies, which we did not include in the meta-analysis. All of the studies in the community were in asymptomatic people, whereas two of the six studies in primary care were conducted in people who had symptoms of possible dementia. We judged two studies to be at high risk of bias in the patient selection domain, three studies to be at high risk of bias in the index test domain and nine studies to be at high risk of bias regarding flow and timing. We assessed most studies as being applicable to the review question though we had concerns about selection of participants in six studies and target condition in one study.The accuracy of the MMSE for diagnosing dementia was reported at 18 cut points in the community (MMSE score 10, 14-30 inclusive) and 10 cut points in primary care (MMSE score 17-26 inclusive). The total number of participants in studies included in the meta-analyses ranged from 37 to 2727, median 314 (interquartile range (IQR) 160 to 647). In the community, the pooled accuracy at a cut point of 24 (15 studies) was sensitivity 0.85 (95% confidence interval (CI) 0.74 to 0.92), specificity 0.90 (95% CI 0.82 to 0.95); at a cut point of 25 (10 studies), sensitivity 0.87 (95% CI 0.78 to 0.93), specificity 0.82 (95% CI 0.65 to 0.92); and in seven studies that adjusted accuracy estimates for level of education, sensitivity 0.97 (95% CI 0.83 to 1.00), specificity 0.70 (95% CI 0.50 to 0.85). There was insufficient data to evaluate the accuracy of the MMSE for diagnosing dementia subtypes.We could not estimate summary diagnostic accuracy in primary care due to insufficient data.

AUTHORS' CONCLUSIONS

The MMSE contributes to a diagnosis of dementia in low prevalence settings, but should not be used in isolation to confirm or exclude disease. We recommend that future work evaluates the diagnostic accuracy of tests in the context of the diagnostic pathway experienced by the patient and that investigators report how undergoing the MMSE changes patient-relevant outcomes.

Relationship between the Montreal Cognitive Assessment and Mini-mental State Examination for assessment of mild cognitive impairment in older adults

BACKGROUND

The Montreal Cognitive Assessment (MoCA) was developed to enable earlier detection of mild cognitive impairment (MCI) relative to familiar multi-domain tests like the Mini-Mental State Exam (MMSE). Clinicians need to better understand the relationship between MoCA and MMSE scores.

METHODS

For this cross-sectional study, we analyzed 219 healthy control (HC), 299 MCI, and 100 Alzheimer's disease (AD) dementia cases from the Alzheimer's Disease Neuroimaging Initiative (ADNI)-GO/2 database to evaluate MMSE and MoCA score distributions and select MoCA values to capture early and late MCI cases. Stepwise variable selection in logistic regression evaluated relative value of four test domains for separating MCI from HC. Functional Activities Questionnaire (FAQ) was evaluated as a strategy to separate dementia from MCI. Equi-percentile equating produced a translation grid for MoCA against MMSE scores. Receiver Operating Characteristic (ROC) analyses evaluated lower cutoff scores for capturing the most MCI cases.

RESULTS

Most dementia cases scored abnormally, while MCI and HC score distributions overlapped on each test. Most MCI cases scored ≥ 17 on MoCA (96.3%) and ≥ 24 on MMSE (98.3%). The ceiling effect (28-30 points) for MCI and HC was less using MoCA (18.1%) versus MMSE (71.4%). MoCA and MMSE scores correlated most for dementia (r = 0.86; versus MCI r = 0.60; HC r = 0.43). Equi-percentile equating showed a MoCA score of 18 was equivalent to MMSE of 24. ROC analysis found MoCA ≥ 17 as the cutoff between MCI and dementia that emphasized high sensitivity (92.3%) to capture MCI cases. The core and orientation domains in both tests best distinguished HC from MCI groups, whereas comprehension/executive function and attention/calculation were not helpful. Mean FAQ scores were significantly higher and a greater proportion had abnormal FAQ scores in dementia than MCI and HC.

CONCLUSIONS

MoCA and MMSE were more similar for dementia cases, but MoCA distributes MCI cases across a broader score range with less ceiling effect. A cutoff of ≥ 17 on the MoCA may help capture early and late MCI cases; depending on the level of sensitivity desired, ≥ 18 or 19 could be used. Functional assessment can help exclude dementia cases. MoCA scores are translatable to the MMSE to facilitate comparison.

Evaluation of Cognitive Symptoms Following Concussion

The assessment of cognitive symptoms following concussion has evolved over the last several decades as a distinct focus in research and an essential component of clinical decision making and management. The aims of this paper are to (1) identify issues related to assessment of postconcussion cognitive functioning and (2) provide a review of common self-report and performance-based measures, including computerized-based assessments (CBAs), and, more traditional, comprehensive neuropsychological evaluations. We conclude that (1) there has yet to emerge one cognitive-symptom measurement method that can be considered the "gold standard" for all settings, (2) the usefulness of cognitive symptoms assessment findings in the clinical management decisions rests a great deal on the background of the practitioner, and (3) cognitive-symptom assessment needs to be considered in the context of a broader evaluation of other postconcussion symptoms.

Altered baseline brain activity in type 2 diabetes: a resting-state fMRI study

PURPOSE

This study aims to investigate whether altered baseline brain activity exists in type 2 diabetes mellitus (T2DM) patients using resting-state functional magnetic resonance imaging (rs-fMRI) and whether abnormal neural activity in the middle temporal gyrus (MTG) is correlated with cognitive function.

METHODS

T2DM patients (n=28) were compared with nondiabetic age-, sex-, and education-matched control subjects (n=29) using rs-fMRI. We computed the amplitude of low-frequency fluctuations (ALFF) of fMRI signals to measure spontaneous neuronal activity and detect the relationship between rs-fMRI information and clinical data.

RESULTS

Compared with healthy controls, T2DM patients had significantly decreased ALFF values in the bilateral middle temporal gyrus, left fusiform gyrus, left middle occipital gyrus, right inferior occipital gyrus; and increased ALFF values in both the bilateral cerebellum posterior lobe and right cerebellum culmen. Moreover, we found an inverse correlation between the ALFF values in the MTG and both the HbA1c (r=-0.451, p=0.016) and the score of Trail Making Test-B (r=-0.420, p=0.026) in the patient group. On the other hand, C-peptide level and pancreatic β-cell function had a positive correlation (r=0.429, p=0.023; r=0.453, p=0.016, respectively) with the ALFF value in the middle temporal gyrus.

CONCLUSION

The present study confirms that T2DM patients have altered ALFF in many brain regions, which is associated with poor neurocognitive performances, severity of consistent hyperglycemic state and impaired β-cell function. ALFF disturbance in MTG may play a central role in cognitive decline associated with T2DM and serve as reference for future clinical diagnosis.

Everyday cognition in older adults: associations with neuropsychological performance and structural brain imaging

The recently developed Everyday Cognition scales (ECog) measure multiple cognitively relevant functional domains (e.g., Everyday Memory, Everyday Language, Everyday Visuospatial abilities, and three everyday executive domains). The present study further evaluated the validity of the ECog by examining its relationship with objective measures of neuropsychological function, and neurobiological markers of disease as reflected by structural neuroimaging. Participants included 474 older adults (244 normals, 142 with MCI, 88 with dementia). The neuropsychological domains measured were episodic memory, semantic memory, spatial ability, and executive functioning. Brain MRI volumes included total brain (BV), hippocampus (HC) and dorsolateral prefrontal cortex (DLPFC). Neuropsychological measures of episodic memory and executive function were most consistently related to the ECog domains; spatial abilities had a specific relationship to the Everyday Visuospatial ECog domain. HC and BV volumes were related to most ECog domains, while DLPFC volume was independently related to two everyday executive domains (Everyday Planning and Everyday Organization). The pattern of associations varied somewhat as a function of diagnosis. Episodic memory and HC had more consistent associations with the ECog domains in older adults with MCI/dementia than in cognitively normal elderly.