Reliability of an Adapted Version of the Modified Six Elements Test as a Measure of Executive Function

Applying linguistic demand analysis to functional multitasking assessments

PURPOSE

The linguistic demand of task instructions in cognitive assessments may mask or even invalidate cognitive testing results for individuals with language differences or impairments. The purpose of this study was to apply an analysis of linguistic demand to a sample of functional multitasking assessments.

METHOD

We sampled the task instructions and materials from seven functional multitasking assessments that are based on everyday activities. We calculated indices of linguistic demand.

RESULTS

The Density Index is based on total number of words, total number of sentences, total number of different words, total number of syllables, and complex (not-simple) sentences. The Breakfast Task and the Frisch Cooking Task consistently ranked lowest in linguistic demand for both instructions and materials based on the indices reviewed. These tasks are most likely to be appropriate for individuals with language impairment.

CONCLUSIONS

Clinicians have a responsibility to fairly evaluate cognitive functions of individuals with impaired language functioning. The analysis of linguistic demand provides a useful way to evaluate task instructions and materials in a systematic way, so that individuals with language impairments or language differences might be more appropriately evaluated.

Conceptualization of the term "ecological validity" in neuropsychological research on executive function assessment: a systematic review and call to action

OBJECTIVE

"Ecological validity" (EV) is classically defined as test's ability to predict real-world functioning, either alone or together with test's similarity to real-world tasks. In neuropsychological literature on assessment of executive functions (EF), EV is conceptualized inconsistently, leading to misconceptions about the utility of tests. The goal of this systematic review was to examine how EV is conceptualized in studies of EF tests described as ecologically valid.

METHOD

MEDLINE and PsychINFO Databases were searched. PRISMA guidelines were observed. After applying inclusion and exclusion criteria, this search yielded 90 articles. Deductive content analysis was employed to determine how the term EV was used.

RESULTS

About 1/3 of the studies conceptualized EV as the test's ability to predict functional outcomes, 1/3 as both the ability to predict functional outcome and similarity to real-world tasks, and 1/3 were either unclear about the meaning of the term or relied on notions unrelated to classical definitions (e.g., similarity to real-world tasks alone, association with other tests, or the ability to discriminate between populations).

CONCLUSIONS

Conceptualizations of the term EV in literature on EF assessment vary grossly, subsuming the notions of criterion, construct, and face validity, as well as sensitivity/specificity. Such inconsistency makes it difficult to interpret clinical utility of tests that are described as ecologically valid. We call on the field to require that, at minimum, the term EV be clearly defined in all publications, or replaced with more concrete terminology (e.g., criterion validity).

Six elements test vs D-KEFS: what does "Ecological Validity" tell us?

OBJECTIVE

Extensive research shows that tests of executive functioning (EF) predict instrumental activities of daily living (IADLs) but are nevertheless often criticized for having poor ecological validity. The Modified Six Elements Test (MSET) is a pencil-and-paper test that was developed to mimic the demands of daily life, with the assumption that this would result in a more ecologically valid test. Although the MSET has been extensively validated in its ability to capture cognitive deficits in various populations, support for its ability to predict functioning in daily life is mixed. This study aimed to examine the MSET's ability to predict IADLs assessed via three different modalities relative to traditional EF measures.

METHOD

Participants (93 adults aged 60 - 85) completed the MSET, traditional measures of EF (Delis-Kaplan Executive Function System; D-KEFS), and self-reported and performance-based IADLs in the lab. Participants then completed three weeks of IADL tasks at home, using the Daily Assessment of Independent Living and Executive Skills (DAILIES) protocol.

RESULTS

The MSET predicted only IADLs completed at home, while the D-KEFS predicted IADLs across all three modalities. Further, the D-KEFS predicted home-based IADLs beyond the MSET when pitted against each other, whereas the MSET did not contribute beyond the D-KEFS.

CONCLUSIONS

Traditional EF tests (D-KEFS) appear to be superior to the MSET in predicting IADLs in community-dwelling older adults. The present results argue against replacing traditional measures with the MSET when addressing functional independence of generally high-functioning and cognitive healthy older adult patients.

Social cognitive training for adults with Noonan syndrome: a feasibility study

PURPOSE

Noonan syndrome (NS) is a genetic disorder that is associated with social cognitive problems. While treatment aimed at the improvement of social cognition is available for other neuropsychiatric disorders, no such interventions yet exist for NS patients. In this study, the development of the first social cognitive training for NS patients is described and its applicability and feasibility evaluated.

METHODS

Eleven adult patients with NS participated in this controlled proof-of-principle study. Six patients were included in the treatment group and five in the control group. Neuropsychological testing was performed in both groups at baseline and posttreatment. Social cognition was a primary outcome measure and nonsocial cognition and psychopathology secondary outcome measures. Differences between pre- and posttest were investigated with Wilcoxon signed-rank tests, and a process evaluation was performed to aid interpretation of the results.

RESULTS

Both groups were comparable with regard to age, estimated intelligence, and baseline performance. Although no significant differences were found between pre- and posttest scores on primary and secondary outcome measures in either group, a medium-large effect size was found on emotion recognition in the treatment group. Also, the process evaluation demonstrated the feasibility of the training.

CONCLUSION

This first social cognitive training for adult patients with NS has proven to be feasible for this population and showed some encouraging results regarding emotion recognition, although the training protocol could be optimized. Further investigation is required using a randomized controlled design in a larger sample, in order to substantiate the overall effectiveness of the training.