Validity, reliability, and psychometric properties of a computerized, cognitive assessment test (Cognivue®)

How Do Nurses Assess Cognition in Adults With Neurological Conditions? A Scoping Review

BACKGROUND

According to epidemiological studies, neurological cognitive problems are increasingly prevalent in the aging population, with estimates that the number of people living with cognitive impairment will triple by 2050. Therefore, early detection in rehabilitation settings is needed to manage cognitive changes to ensure that individuals living with these conditions receive care and support that addresses their needs.

PURPOSE

This scoping review, based on the Arksey and O'Malley method, aims to investigate the cognitive assessments used for patients with neurological conditions in current nursing practice.

METHOD

PubMed, Ovid Medline, and CINAHL databases were searched to identify relevant articles published from 2017 to 2023 in English. Twenty-four articles met the inclusion criteria. Cognitive assessments were evaluated across acute care/hospital, outpatient/clinic, community, and long-term care/nursing home settings.

RESULTS

The Mini-Mental State Examination is the most frequently used tool across all settings except for long-term care. Cognition includes many different domains such as executive functioning and speed of processing information; however, most tools only capture memory. The nursing profession must expand its standardized nursing vocabulary to capture cognition better.

CONCLUSIONS

As rehabilitation nurses navigate diverse clinical environments, recognition of contextual nuances is important in selecting cognitive function measurement tools most suitable for their setting.

Validity and Reliability Study of Online Cognitive Tracking Software (BEYNEX)

Background

Detecting cognitive impairment such as Alzheimer's disease early and tracking it over time is essential for individuals at risk of cognitive decline.

Objective

This research aimed to validate the Beynex app's gamified assessment tests and the Beynex Performance Index (BPI) score, which monitor cognitive performance across seven categories, considering age and education data.

Methods

Beynex test cut-off scores of participants (n = 91) were derived from the optimization function and compared to the Montreal Cognitive Assessment (MoCA) test. Validation and reliability analyses were carried out with data collected from an additional 214 participants.

Results

Beynex categorization scores showed a moderate agreement with MoCA ratings (weighted Cohen's Kappa = 0.48; 95% CI: 0.38-0.60). Calculated Cronbach's Alpha indicates good internal consistency. Test-retest reliability analysis using a linear regression line fitted to results yielded R∧2 of 0.65 with a 95% CI: 0.58, 0.71.

Discussion

Beynex's ability to reliably detect and track cognitive impairment could significantly impact public health, early intervention strategies and improve patient outcomes.

An Interprofessional Approach to Aural Rehabilitation for Adults with Hearing Loss and Cognitive Concerns

Individuals with hearing loss are at risk for cognitive decline. The traditional approach to audiological care does not typically involve a team approach that addresses cognitive concerns. While cognitive screening is within the scope of practice in audiology, audiologists are not typically trained in interpreting screening results or providing rehabilitation that supports cognitive health. However, as growing evidence shows that hearing loss is tied to cognitive decline, a team approach is required to support whole-person care. Speech-language pathologists, who specialize in optimizing communication, are best situated to collaborate with audiologists to provide holistic aural rehabilitation. Audiologists and speech-language pathologists who partner to support a client's communication skills and social relationships play an important role in the life of an individual with hearing loss. In this perspective, we describe relevant background information about hearing loss and cognition and present an interprofessional approach to aural rehabilitation for adults with hearing loss who have cognitive concerns. We also discuss implications for future research.

Cognitive Assessment with Cognivue Clarity®: Psychometric Properties and Normative Ranges in a Diverse Population

Background

Detecting cognitive impairment in clinical practice is challenging as most instruments do not perform well in diverse samples of older adults. These same instruments are often used for eligibility into clinical trials making it difficult to recruit minoritized adults into Alzheimer's disease (AD) studies. Cognivue Clarity® is an FDA-cleared computerized 10-minute cognitive screening platform using adaptive psychophysics to detect cognitive impairment.

Objective

Test the ability of Cognivue Clarity to measure cognitive performance in a diverse community sample compared with the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS).

Methods

This study enrolled 452 participants across 6 US study sites and completed both Cognivue Clarity device and RBANS. Psychometric properties and exploratory factor analysis of Cognivue Clarity were explored and comparisons against RBANS across different age, sex, education, and ethnoracial groups were conducted.

Results

Participants had a mean age of 47.9±16.1 years (range: 18-85), 63.6% were female, 45.9% had ≤12 years of education, 31.2% were African American and 9.2% were Hispanic. Cognivue Clarity had strong internal consistency, test-retest reliability and minimal practice effects. A 4-factor structure (Memory, Attention, Visuomotor, and Discrimination) had excellent goodness-of-fit. Normalizing age effects improved performance. Race and education effects were similar to those seen with RBANS. Cognivue Clarity had strong correlations with RBANS.

Conclusions

Our study supports the use of Cognivue Clarity as an easy-to-use, brief, and valid cognitive assessment that measures cognitive performance. In the correct clinical setting, Cognivue Clarity may identify individuals with likely cognitive impairment who could be candidates for AD research studies.

Digital Cognitive Assessment Tests for Older Adults: Systematic Literature Review

BACKGROUND

The global health pandemic has affected the increasing older adult population, especially those with mental illnesses. It is necessary to prevent cases of cognitive impairment in adults early on, and this requires the support of information and communication technologies for evaluating and training cognitive functions. This can be achieved through computer applications designed for cognitive assessment.

OBJECTIVE

In this review, we aimed to assess the state of the art of the current platforms and digital test applications for cognitive evaluation, with a focus on older adults.

METHODS

A systematic literature search was conducted on 3 databases (Web of Science, PubMed, and Scopus) to retrieve recent articles on the applications of digital tests for cognitive assessment and analyze them based on the methodology used. Four research questions were considered. Through the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology, following the application of inclusion and exclusion criteria, a total of 20 articles were finally reviewed.

RESULTS

Some gaps and trends were identified regarding the types of digital applications and technologies used, the evaluated effects on cognitive domains, and the psychometric parameters and personal characteristics considered for validation.

CONCLUSIONS

Computerized tests (similar to paper-and-pencil tests) and test batteries (on computers, tablets, or web platforms) were the predominant types of assessments. Initial studies with simulators, virtual environments, and daily-life activity games were also conducted. Diverse validation methods and psychometric properties were observed; however, there was a lack of evaluations that involved specific populations with diverse education levels, cultures, and degrees of technology acceptance. In addition, these evaluations should consider emotional and usability aspects.

Current Diagnostic Pathways for Alzheimer's Disease: A Cross-Sectional Real-World Study Across Six Countries

Background

Diagnostic pathways for patients presenting with cognitive complaints may vary across geographies.

Objective

To describe diagnostic pathways of patients presenting with cognitive complaints across 6 countries.

Methods

This real-world, cross-sectional study analyzed chart-extracted data from healthcare providers (HCPs) for 6,744 patients across China, France, Germany, Spain, UK, and the US.

Results

Most common symptoms at presentation were cognitive (memory/amnestic; 89.86%), followed by physical/behavioral (87.13%). Clinical/cognitive tests were used in > 95%, with Mini-Mental State Examination being the most common cognitive test (79.0%). Blood tests for APOE ɛ4/other mutations, or to rule out treatable causes, were used in half of the patients. Clinical and cognitive tests were used at higher frequency at earlier visits, and amyloid PET/CSF biomarker testing at higher frequency at later visits. The latter were ordered at low rates even by specialists (across countries, 5.7% to 28.7% for amyloid PET and 5.0% to 27.3% for CSF testing). Approximately half the patients received a diagnosis (52.1% of which were Alzheimer's disease [AD]). Factors that influenced risk of not receiving a diagnosis were HCP type (higher for primary care physicians versus specialists) and region (highest in China and Germany).

Conclusion

These data highlight variability in AD diagnostic pathways across countries and provider types. About 45% of patients are referred/told to 'watch and wait'. Improvements can be made in the use of amyloid PET and CSF testing. Efforts should focus on further defining biomarkers for those at risk for AD, and on dismantling barriers such low testing capacity and reimbursement challenges.

Can we trust computers to assess the cognition of stroke patients? A systematic review

Purpose

To summarize the classification of computerized cognitive assessment (CCA) tools for assessing stroke patients, to clarify their benefits and limitations, and to reveal strategies for future studies on CCA tools.

Methods

A literature review was performed using PubMed, Embase, Scopus, JAMA Network, Cochrane Library and PsycINFO databases from January 1st, 2010, to August 1st, 2022. Two authors independently screened the literature following the same criteria, evaluated the study quality, and collected data from the articles.

Results

A total of 8,697 papers were acquired from the six databases. A total of 74 potentially eligible articles were selected for review. Of these, 29 articles were not relevant to this research, 3 were reviews, 2 were not written in English, and 1 was on an ongoing trial. By screening the references of the reviews, 3 additional articles were included in this study. Thus, a total of 42 articles met the criteria for the review. In terms of the CCA tools analyzed in these studies, they included five types: virtual reality (VR)-based, robot-based, telephone-based, smartphone-based, and computer-based cognitive assessments. Patients' stages of the disease ranged from the subacute phase and rehabilitation phase to the community phase. A total of 27 studies supported the effectiveness of CCA tools, while 22 out of 42 articles mentioned their benefits and 32 revealed areas for future improvement of CCA tools.

Conclusions

Although the use of CCA tools for assessing the cognition of post-stroke patients is becoming popular, there are still some limitations and challenges of using such tools in stroke survivors. More evidence is thus needed to verify the value and specific role of these tools in assessing the cognitive impairment of stroke patients.

Comprehensive assessment of neurocognitive function, inflammation markers, and adiposity in treated HIV and control

To compare the neurocognitive scores between persons living with human immunodeficiency virus (PLWH) and persons without human immunodeficiency virus (HIV) and assess the relationship between neurocognition, HIV status and variables, inflammation, and body composition measures. Cross-sectional study involving 225 participants (126 PLWH on antiretroviral therapy [ART] and 99 persons without HIV). For the first time in HIV, we used Cognivue®, an food and drug administration (FDA)-approved computer-based test to assess cognitive function. The test was calibrated to individuals' unique cognitive ability and measured 6 cognitive domains and 2 performance parameters. Markers of inflammation, immune activation, insulin resistance, and body fat composition (using dual-energy X-ray absorptiometry scan) were collected. Classical t tests, chi-square tests, and spearman correlations were used to compare and explore relationships between variables. Inverse probability weighting adjusted average treatment effect models were performed to evaluate the differences between PLWH and persons without HIV, adjusting for age, race, sex, and heroin use. Overall, 64% were male, 46% were Black, with a mean age of 43 years. Among PLWH, 83% had an undetectable HIV-1 RNA level (≤20 copies/mL). Compared persons without HIV, PLWH performed poorer across 4 domains: visuospatial (P = .035), executive function (P = .029), naming/language (P = .027), and abstraction (P = .018). In addition, PLWH had a significantly longer processing speed time compared to controls (1686.0 ms vs 1606.0 ms [P = .007]). In PLWH, lower cognitive testing domain scores were associated with higher inflammatory markers (high sensitivity C-reactive protein [hsCRP]) and with higher total fat and visceral adipose tissue (P < .05). Neurocognitive impairment (NCI) in HIV is associated with inflammation and total and central adiposity.

Screening for Mild Cognitive Impairment in the Preoperative Setting: A Narrative Review

Cognitive impairment predisposes patients to the development of delirium and postoperative cognitive dysfunction. In particular, in older patients, the adverse sequelae of cognitive decline in the perioperative period may contribute to adverse outcomes after surgical procedures. Subtle signs of cognitive impairment are often not previously diagnosed. Therefore, the aim of this review is to describe the available cognitive screeners suitable for preoperative screening and their psychometric properties for identifying mild cognitive impairment, as preoperative workup may improve perioperative care for patients at risk for postoperative cognitive dysfunction. Electronic systematic and snowball searches of PubMed, PsycInfo, ClinicalKey, and ScienceDirect were conducted for the period 2015–2020. Major inclusion criteria for articles included those that discussed a screener that included the cognitive domain ‘memory’, that had a duration time of less than 15 min, and that reported sensitivity and specificity to detect mild cognitive impairment. Studies about informant-based screeners were excluded. We provided an overview of the characteristics of the cognitive screener, such as interrater and test-retest reliability correlations, sensitivity and specificity for mild cognitive impairment and cognitive impairment, and duration of the screener and cutoff points. Of the 4775 identified titles, 3222 were excluded from further analysis because they were published prior to 2015. One thousand four hundred and forty-eight titles did not fulfill the inclusion criteria. All abstracts of 52 studies on 45 screeners were examined of which 10 met the inclusion criteria. For these 10 screeners, a further snowball search was performed to obtain related studies, resulting in 20 articles. Screeners included in this review were the Mini-Cog, MoCA, O3DY, AD8, SAGE, SLUMS, TICS(-M), QMCI, MMSE2, and Mini-ACE. The sensitivity and specificity range to detect MCI in an older population is the highest for the MoCA, with a sensitivity range of 81–93% and a specificity range of 74–89%. The MoCA, with the highest combination of sensitivity and specificity, is a feasible and valid routine screening of pre-surgical cognitive function. This warrants further implementation and validation studies in surgical pathways with a large proportion of older patients.

Initial Adaptation of the General Cognitive Assessment Battery by Cognifit™ for Bulgarian Older Adults

BACKGROUND

Online neuropsychological assessment batteries may facilitate the screening of cognitive functions in older adults and could be useful for early diagnosis and detection of cognitive impairments.

OBJECTIVE

The primary aim of this study was to assess the psychometric qualities of an online multi-domain cognitive assessment battery (General Cognitive Assessment Battery (GCAB) by Cognifit™) applied for the first time in Bulgaria.

METHODS

A total of 20 healthy older adults (6 male and 14 female, aged 60-82) completed the GCAB as well as the Mini-Mental State Examination (MMSE) and the Consortium to Establish a Registry for Alzheimer's Disease (CERAD) neuropsychological battery. Descriptive statistics were used to describe the demographic characteristics of the sample and the scores on the GCAB and the CERAD battery. The internal consistency of the GCAB was evaluated using item analysis and measured with Cronbach's alpha. The concurrent validity of the GCAB was assessed with respect to the CERAD using Spearman's r after verifying the linear relationship between the GCAB and CERAD scores.

RESULTS

The GCAB showed good concurrent validity when compared with the corresponding CERAD tests. The correlation coefficients ranged from 0.67 for working memory to 0.47 for short-term auditory memory. We found very good reliability of the GCAB, with the inter-class correlation coefficient higher than 0.8 for all cognitive domains. There were no significant correlations between MMSE and GCAB scores.

CONCLUSION

The GCAB was found to be valid for the cognitive screening of Bulgarian healthy older adults and may provide an adequate assessment of their cognitive status. The GCAB showed good concurrent validity when compared with the CERAD battery, measuring similar cognitive constructs. Further work is necessary to explore its validity and reliability.

APTA Cross Sections and Academies Recommendations for COVID-19 Core Outcome Measures

The novel coronavirus (COVID-19) emerged as a major health concern within the United States in early 2020. Because this is a novel virus, little guidance exists for best practice to evaluate this population within the field of physical therapy.

Cognitive screening for adult psychiatric outpatients: Comparison of the Cognivue® to the Montreal Cognitive Assessment

In this editorial we comment on the article by Cahn-Hidalgo D published in a recent issue of the World Journal of Psychiatry 2020; 10(1); 1-11. We focus on the importance of utilizing psychometrically valid cognitive screening tools when assessing for cognitive decline in older adults in a psychiatric outpatient setting. We compared the use of Cognivue^® to use of the montreal cognitive assessment (MoCA) as a cognitive screening tool. A total of 58 patients aged 55 and over participated in this comparison study. Patients completed cognitive screening on Cognivue^®, a new Food and Drug Administration-cleared computer screening device, and the MoCA. The results of patient performance using these two instruments were analyzed. Sixteen (28%) patients screened negative for cognitive impairment on both assessments. Forty-two (72%) patients screened positive on one or both of the assessments. There was 43% agreement between Cognivue^® and the MoCA in identifying patients with cognitive impairment, and individual subtests were weakly correlated. The MoCA was determined to be the preferred instrument due to its high sensitivity and specificity (100% and 87%, respectively) when screening for cognitive impairment. We propose that the use of Cognivue^® cognitive screening tool be closely reviewed until more research proves that the test meets the standards for reliability and validity. It is important for clinicians to remember that screeners should not be used to diagnosis patients with neurocognitive disorders; instead, they should be used to determine whether further evaluation is warranted. Additionally, misdiagnosing of neurocognitive disorders can pose unnecessary psychological and emotional harm to patients and their families and also lead to incorrect treatment and undue healthcare costs.

Neuropsychological Tests in Post-operative Cognitive Dysfunction: Methods and Applications

Post-operative cognitive dysfunction (POCD) is a neurological complication that relatively frequently occurs in older people after anesthesia/surgery, with varying durations and significant differences in the severity of cognitive impairment. POCD is mainly characterized by memory loss mostly without consciousness disorders, accompanied by abnormal emotions, behaviors, and language, mostly without consciousness disorder. The clinical performance of POCD lacks specificity but can reflect the severity of cognitive impairment in patients. The diagnosis of POCD cannot be separated from the evaluation of perioperative cognitive function of patients, and the more popular and accepted method is neuropsychological tests (NPTs).

Test-retest reliability of the Turkish translation of the Penn Computerized Neurocognitive Battery

Psychiatric disorders are associated with cognitive dysfunction (CD), and reliable screening and follow-up of CD is essential both for research and clinical practice globally; yet, most assessments are in Western languages. We aimed to evaluate the test-retest reliability of the Turkish version of the Penn Computerized Neurocognitive Battery (PennCNB) to guide confident interpretation of results. Fifty-eight healthy individuals completed the PennCNB Turkish version in two sessions. After quality control, reliability analysis was conducted using Intraclass Correlation Coefficients (ICC), corrected for practice effects. Most measures were not significantly different between the sessions and had acceptable ICC values, with several exceptions. Scores were improved considerably for some memory measures, including immediate Facial Memory and Spatial Memory, and for incorrect responses in abstraction and mental flexibility, with correspondingly acceptable ICCs. Test-retest assessment of the Turkish version of the PennCNB shows that it can be used as a reliable real-time measurement of cognitive function in snapshot cross-sectional or longitudinal determinations. Preliminary validity assessment in this normative sample showed expected positive correlations with education level and negative correlations with age. Thus, the Turkish version of the PennCNB can be considered a reliable neuropsychological testing tool in research and clinical practice. Practice effects should be considered, especially when applied in short intervals. Significantly better performances in the retest, beyond practice effect, likely reflect nonlinear improvements in some participants who "learned how to learn" the memory tests or had insight on solving the abstraction and mental flexibility test.