Italian telephone-based Mini-Mental State Examination (Itel-MMSE): item-level psychometric properties

A digital teleneuropsychology platform for the diagnosis of mild cognitive impairment: from concept to certification as a medical device

BACKGROUND

Innovative digital solutions are shaping a new concept of dementia care, opening additional venues for prevention, diagnosis, monitoring and treatment. Hereby, we report the development of a tablet-based teleneuropsychology platform (Tenèpsia®), from concept to certification as Medical Device (MD) Class IIA, as per new MD regulation 745/2017.

METHODS

The platform was designed for the remote cognitive evaluation and created thanks to the effort of a collaborative working group including experts from three Italian scientific societies and Biogen Italia S.r.l. (hereafter "Biogen"), and developers from Xenia Reply and Inside AI. The development strategy was guided by converting traditional paper-and-pencil tests into digital versions while maintaining comparable neuropsychological features and optimizing patient accessibility and user experience. The experts focused on the choice and adaptation of traditional neuropsychology measures for a 45-min teleneuropsychology assessment.

RESULTS

The developers created a web and a mobile interface, respectively, for the professional (neuropsychologist) and non-professional (patient and caregiver) use. Recording of voice, drawing and typing information was enabled. Instant dashboards provide a quick overview of the patient's condition. Simulation activities were performed to obtain MD certification, valid across Europe.

CONCLUSION

Neuropsychology services will benefit from the implementation in clinics of harmonized digital tools with adequate scientific and technological standards. The use of digital cognitive testing for the diagnosis of mild cognitive impairment is expected to enhance patient and clinician outcomes through simplified, digital objective data collection, sparing of time and resources, with a positive impact on healthcare costs and access to treatments, reducing inequalities and delays in diagnosis and cure.

A Comparison of Item Characteristics and Test Information Between the K-MMSE~2:SV and K-MMSE

Background and Purpose

The Korean-Mini Mental State Examination, 2nd edition (K-MMSE~2) was recently released. This study aimed to determine whether the K-MMSE~2: Standard Version (K-MMSE~2:SV) had the same test characteristics as the K-MMSE.

Methods

A total of 1,514 healthy community-based participants aged 19 to 90 years were administered the K-MMSE~2:SV Blue Form along with the language items from the K-MMSE. The item and test characteristics and test information for the K-MMSE~2:SV and K-MMSE were compared using Item Response Theory analysis.

Results

Item discriminations for the K-MMSE~2:SV and K-MMSE were above the moderate range for all items except Recall. Most of the items on the K-MMSE~2:SV and K-MMSE had item category difficulty in the very easy or easy range. The test information curve (TIC) showed that the K-MMSE~2:SV and K-MMSE provide almost the same amount of information (27.86 vs. 28.44), with both tests providing the most information at an ability level of -1.57. The generalizability (G) coefficient for the K-MMSE~2:SV and K-MMSE was 0.99.

Conclusions

These results indicate that the K-MMSE~2:SV and K-MMSE are equally optimal tests for screening for mild cognitive impairment and early dementia. Given that the amount of test information provided by the two tests was almost identical, the shapes of the TICs were very similar, and the G coefficient was close to 1, we can conclude that the K-MMSE and K-MMSE~2:SV are equivalent tests.

The Telephone Language Screener (TLS): standardization of a novel telephone-based screening test for language impairment

BACKGROUND

This study aimed at developing and standardizing the Telephone Language Screener (TLS), a novel, disease-nonspecific, telephone-based screening test for language disorders.

METHODS

The TLS was developed in strict pursuance to the current psycholinguistic standards. It comprises nine tasks assessing phonological, lexical-semantic and morpho-syntactic components, as well as an extra Backward Digit Span task. The TLS was administered to 480 healthy participants (HPs), along with the Telephone-based Semantic Verbal Fluency (t-SVF) test and a Telephone-based Composite Language Index (TBCLI), as well as to 37 cerebrovascular/neurodegenerative patients-who also underwent the language subscale of the Telephone Interview for Cognitive Status (TICS-L). An HP subsample was also administered an in-person language battery. Construct validity, factorial structure, internal consistency, test-retest and inter-rater reliability were tested. Norms were derived via Equivalent Scores. The capability of the TLS to discriminate patients from HPs and to identify, among the patient cohort, those with a defective TICS-L, was also examined.

RESULTS

The TLS was underpinned by a mono-component structure and converged with the t-SVF (p < .001), the TBCLI (p < .001) and the in-person language battery (p = .002). It was internally consistent (McDonald's ω = 0.67) and reliable between raters (ICC = 0.99) and at retest (ICC = 0.83). Age and education, but not sex, were predictors of TLS scores. The TLS optimally discriminated patients from HPs (AUC = 0.80) and successfully identified patients with an impaired TICS-L (AUC = 0.92). In patients, the TLS converged with TICS-L scores (p = 0.016).

DISCUSSION

The TLS is a valid, reliable, normed and clinically feasible telephone-based screener for language impairment.

Tele-Global Examination of Mental State (Tele-GEMS): an open tool for the remote neuropsychological screening

Tele-neuropsychology, i.e., the application of remote audio-visual technologies to neuropsychological evaluation or rehabilitation, has become increasingly popular and widespread during and after the COVID-19 pandemic. New tools with updated normative data and appropriate methodological developments are necessary. We present Tele-GEMS, a telephone-based cognitive screening developed on N = 601 Italian participants. It yields a global score tapping on orientation, memory, spatial representation, language, and pragmatic abilities. Its administration lasts about 10 min. Clinical cut-offs are provided, accounting for demographic variables (age, education, and sex) and also for a comprehensive index taking into account cognitively stimulating life experiences that can build up a cognitive reserve. Tele-GEMS shows good internal consistency and a good inter-rater agreement. The test includes the thresholds for estimating a significant change after repeated measurements. Tele-GEMS has a good construct validity as assessed with MoCA and a suitable criterion validity assessed with its in-person version (GEMS). All the materials and the instructions, including scripts and an online Application for the automatic calculation of cut-offs, are accessible on OSF at https://osf.io/t3bma/ under a Creative Commons license.

The Italian telephone-based Verbal Fluency Battery (t-VFB): standardization and preliminary clinical usability evidence

Background

This study aimed at standardizing and providing preliminary evidence on the clinical usability of the Italian telephone-based Verbal Fluency Battery (t-VFB), which includes phonemic (t-PVF), semantic (t-SVF) and alternate (t-AVF) verbal fluency tasks.

Methods

Three-hundred and thirty-five Italian healthy participants (HPs; 140 males; age range = 18-96 years; education range = 4-23 years) and 27 individuals with neurodegenerative or cerebrovascular diseases were administered the t-VFB. Switch number and cluster size were computed via latent semantic analyses. HPs underwent the telephone-based Mental State Examination (MMSE) and Backward Digit Span (BDS). Construct validity, factorial structure, internal consistency, test-retest and inter-rater reliability and equivalence with the in-person Verbal Fluency tasks were assessed. Norms were derived via Equivalent Scores. Diagnostic accuracy against clinical populations was assessed.

Results

The majority of t-VFB scores correlated among each other and with the BDS, but not with the MMSE. Switch number correlated with t-PVF, t-SVF, t-AVF scores, whilst cluster size with the t-SVF and t-AVF scores only. The t-VFB was underpinned by a mono-component structure and was internally consistent (Cronbach's α = 0.91). Test-retest (ICC = 0.69-0.95) and inter-rater reliability (ICC = 0.98-1) were optimal. Each t-VFB test was statistically equivalent to its in-person version (equivalence bounds yielding a p < 0.05). Education predicted all t-VFB scores, whereas age t-SVF and t-AVF scores and sex only some t-SVF scores. Diagnostic accuracy against clinical samples was optimal (AUC = 0.81-0.86).

Discussion

The t-VFB is a valid, reliable and normed telephone-based assessment tool for language and executive functioning, equivalent to the in-person version; results show promising evidence of its diagnostic accuracy in neurological populations.

Telephone-based Frontal Assessment Battery (t-FAB): standardization for the Italian population and clinical usability in neurological diseases

Background

Despite the relevance of telephone-based cognitive screening tests in clinical practice and research, no specific test assessing executive functioning is available. The present study aimed at standardizing and providing evidence of clinical usability for the Italian telephone-based Frontal Assessment Battery (t-FAB).

Methods

The t-FAB (ranging 0–12), comprising two subtests, has two versions: one requiring motor responses (t-FAB-M) and the other verbal responses (t-FAB-V). Three hundred and forty-six Italian healthy adults (HPs; 143 males; age range = 18–96 years; education range = 4–23 years) and 40 participants with neurological diseases were recruited. To HPs, the t-FAB was administered along with a set of telephone-based tests: MMSE, verbal fluency (VF), backward digit span (BDS). The in-person version of the FAB was administered to both HPs and clinical groups. Factorial structure, construct validity, inter-rater and test–retest reliability, t-FAB-M vs. t-FAB-V equivalence and diagnostic accuracy were assessed. Norms were derived via Equivalent Scores.

Results

In HPs, t-FAB measures yielded high inter-rater/test–retest reliability (ICC = .78–.94), were internally related (p ≤ .005) and underpinned by a single component, converging with the telephone-based MMSE, VF, BDS (p ≤ .0013). The two t-FAB versions were statistically equivalent in clinical groups (ps of both equivalence bounds < .001). Education predicted all t-FAB scores (p < .001), whereas age only the t-FAB-M score (p ≤ .004). t-FAB scores converge with the in-person FAB in HPs and clinical groups (r_s = .43–.78). Both t-FAB versions were accurate in discriminating HPs from the clinical cohort (AUC = .73-.76).

Discussion

The t-FAB is a normed, valid, reliable and clinically usable telephone-based cognitive screening test to adopt in both clinical and research practice.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40520-022-02155-3.