Comparing Web-Based and Lab-Based Cognitive Assessment Using the Cambridge Neuropsychological Test Automated Battery: A Within-Subjects Counterbalanced Study

Feasibility of computerized motor, cognitive and speech tests in the home: Analysis of TAS Test in 2,300 older adults

BACKGROUND

Early detection of Alzheimer's disease (AD) risk is crucial for dementia prevention. Tasmanian Test (TAS Test) is a novel, unsupervised, computerized assessment of motor, cognitive, and speech function designed to detect AD risk.

OBJECTIVES

To evaluate the feasibility, usability, and acceptability of TAS Test.

DESIGN AND SETTING

TAS Test was administered remotely at home and/or in a research facility, using personal computers.

PARTICIPANTS

2,351 adults aged 50-89 years (mean 65.35), 71.76 % female, from Tasmania, Australia.

MEASUREMENTS

Completion rates, ease-of-use, distraction, test duration, and enjoyment scores. Demographics, computer literacy, cognition, and mood were analyzed.

RESULTS

Over 80 % completed motor and cognitive components with 92.8 % completing speech tests. 89.81 % found the duration acceptable. 80.90 % of remote and 83.46 % of onsite participants enjoyed the procedure. High usability and acceptability were reported, with age, gender, education, computer literacy, cognition and mood having minimal or no impact.

CONCLUSIONS

TAS Test demonstrated high completion rates and user satisfaction across a large community sample, supporting its feasibility as an unsupervised computerized assessment tool. Future research should address demographic representation and technical refinements.

Associations between ambient pollen exposure and measures of cognitive performance

Background

Prior research suggests pollen allergies may be associated with cognitive function, although the effect sizes and specific cognitive outcomes varied across studies. With pollen seasons starting earlier and intensifying due to climate change, understanding the effects of pollen exposure on cognition is increasingly relevant. This study investigated the relationship between ambient pollen exposure and cognitive performance in Swiss adults.

Methods

Four cognitive assessments were used to measure the daily performance of 392 participants (299 with pollen allergies) over a 10-day period during pollen season. We used generalized additive mixed models to assess the exposure-response relationship between individualized pollen exposure and cognitive performance, as well as allergic symptom severity and cognitive performance, adjusting for individual characteristics and time-varying environmental and individual confounders (e.g., air pollution, weather, and coffee intake).

Results

We did not find any statistically significant relationships between pollen exposure or severity of allergic symptoms and overall score or reaction time on tests of response inhibition, attention, and visual-spatial memory. We observed a 1% increase [95% confidence interval (CI) = 0.13%, 2.0%] in average reaction time on a test of grammatical reasoning for allergic participants at an exposure of 300 pollen/m3 (12-hour average).

Conclusion

Overall, our study population did not exhibit changes in cognitive performance related to pollen exposure or perceived allergic symptoms. A marginal, but statistically significant effect on the response time of pollen-allergic individuals was observed for a test of verbal reasoning, however, this is likely to be a chance finding considering the number of exposures and outcomes evaluated.

Cognitive reserve moderates the effect of COVID-19 on cognition: A systematic review and meta-analysis of individual participant data

Elucidating the factors that mitigate the effects of COVID-19 on cognitive function offers important insights for public health policy and intervention. This systematic review and individual participant data (IPD) meta-analysis assesses cognitive reserve (CR) as a potential moderator of post-COVID-19 cognitive dysfunction (PCCD). Under PRISMA-IPD guidelines, data searches were conducted via PubMed, PsycINFO, Scopus, and Embase, up to January 2023. Eligible studies included at least one cognitive assessment, CR proxy, and disease severity indicator. Of 5604 studies, 87 were eligible (10,950 COVID-19 cases; 78,305 controls), and IPD was obtained for 29 datasets (3919 COVID-19 cases; 8267 controls). Three-level random-effects meta-analyses indicated that CR had a moderate positive association (rsp =.29), and COVID-19 severity had a small negative association (rsp = -.07) with cognitive outcomes. These effects were moderated by a significant within-study interaction. Cognitive deficits following COVID-19 were 33 % smaller among high CR individuals, and 33 % greater among low CR individuals, relative to those with average CR. Population-based initiatives promoting reserve-building behaviors may alleviate the PCCD-related public health burden. REVIEW REGISTRATION: PROSPERO registration number: CRD42022360670.

Outcome measurement of cognitive impairment and dementia in serious digital games: a scoping review

PURPOSE

Dementia prevalence is increasing worldwide. With the emergence of digital rehabilitation, serious digital games are a potential tool to maintain and monitor function in people living with dementia. It is unclear however whether games can measure changes in cognition. We conducted a scoping review to identify the types of outcomes measured in studies of serious digital games for people with dementia and cognitive impairment.

METHODS

We included primary research of any design including adults with cognitive impairment arising from dementia or another health condition; reported data about use of serious digital games; and included any cognitive outcome. We searched Medline (via EBSCO), PsycInfo, CINAHL, Web of Science, from inception to 4th March 2024 and extracted study characteristics.

RESULTS

We reviewed 5899 titles, including 25 full text studies. We found heterogeneity in domains and measures used: global cognition (n = 15), specific cognitive processes (n = 13), motor function (n = 5), mood (n = 6), activities of daily living (n = 5), physiological processes (n = 4) and quality of life (n = 2). Use of outcome measurement tools was inconsistent; the most frequently used measures were the Montreal Cognitive Assessment (n = 8), the Mini-Mental State Examination (n = 7), and the Trail Making Test (n = 7). Nine studies used in-game measures, most of which were related to game performance.

CONCLUSION

We found very few studies with assessment of cognition within the game. Studies of serious games for people with dementia and cognitive impairment should develop digital outcome tools based on recommendations in Core Outcome Sets, to increase consistency between studies.

Measuring Cognitive Impairments Associated With Schizophrenia in Clinical Practice: Overview of Current Challenges and Future Opportunities

BACKGROUND

Cognitive impairment associated with schizophrenia (CIAS) negatively impacts daily functioning, quality of life, and recovery, yet effective pharmacotherapies and practical assessments for clinical practice are lacking. Despite the pivotal progress made with establishment of the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) Consensus Cognitive Battery (MCCB) for clinical research, implementation of the full MCCB is too time-consuming and cost-ineffective for most clinicians in clinical practice.

STUDY DESIGN

Here we discuss current assessments in relation to delivery format (interview-based and performance-based), validity, ease of use for clinicians and patients, reliability/reproducibility, cost-effectiveness, and suitability for clinical implementation. Key challenges and future opportunities for improving cognitive assessments are also presented.

STUDY RESULTS

Current assessments that require 30 min to complete would have value in clinical settings, but the associated staff training and time required might preclude their application in most clinical settings. Initial profiling of cognitive deficits may require about 30 min to assist in the selection of evidence-based treatments; follow-up monitoring with brief assessments (10-15 min in duration) to detect treatment-related effects on global cognition may complement this approach. Guidance on validated brief cognitive tests for the strategic monitoring of treatment effects on CIAS is necessary.

CONCLUSIONS

With increased advancements in technology-based and remote assessments, development of validated formats of remote and in-person assessment, and the necessary training models and infrastructure required for implementation, are likely to be of increasing clinical relevance for future clinical practice.

Mayo Normative Studies: regression-based normative data for remote self-administration of the Stricker Learning Span, Symbols Test, and Mayo Test Drive Screening Battery Composite and validation in individuals with mild cognitive impairment and dementia

Objective: Few normative data for unsupervised, remotely-administered computerized cognitive measures are available. We examined variables to include in normative models for Mayo Test Drive (MTD, a multi-device remote cognitive assessment platform) measures, developed normative data, and validated the norms. Method: 1240 Cognitively Unimpaired (CU) adults ages 32-100 years (96% White) from the Mayo Clinic Study of Aging and Mayo Alzheimer's Disease Research Center with Clinical Dementia Rating® of 0 were included. We converted raw scores to normalized scaled scores and derived regression-based normative data adjusting for age, age2, sex, and education (base model); alternative norms are also provided (age + age2 + sex; age + age2). We assessed additional terms using an a priori cut-off of 1% variance improvement above the base model. We examined low test performance rates (< -1 SD) in independent validation samples (n = 167 CU, n = 64 mild cognitive impairment (MCI), n = 14 dementia). Rates were significantly different when 95% confidence intervals (CI) did not include the expected 14.7% base rate. Results: No model terms met the a priori cut-off beyond the base model, including device type, response input source (e.g. mouse, etc.), or session interference. Norms showed expected low performance rates in CU and greater rates of low performance in MCI and dementia in independent validation samples. Conclusion: Typical normative models appear appropriate for remote self-administered MTD measures and are sensitive to cognitive impairment. Device type and response input source did not explain enough variance for inclusion in normative models but are important for individual-level interpretation. Future work will increase the inclusion of individuals from under-represented groups.

Smartwatch- and smartphone-based remote assessment of brain health and detection of mild cognitive impairment

Consumer-grade mobile devices are used by billions worldwide. Their ubiquity provides opportunities to robustly capture everyday cognition. 'Intuition' was a remote observational study that enrolled 23,004 US adults, collecting 24 months of longitudinal multimodal data via their iPhones and Apple Watches using a custom research application that captured routine device use, self-reported health information and cognitive assessments. The study objectives were to classify mild cognitive impairment (MCI), characterize cognitive trajectories and develop tools to detect and track cognitive health at scale. The study addresses sources of bias in current cognitive health research, including limited representativeness (for example, racial/ethnic, geographic) and accuracy of cognitive measurement tools. We describe study design and provide baseline cohort characteristics. Next, we present foundational proof-of-concept MCI classification modeling results using interactive cognitive assessment data. Initial findings support the reliability and validity of remote MCI detection and the usefulness of such data in describing at-risk cognitive health trajectories in demographically diverse aging populations. ClinicalTrials.gov identifier: NCT05058950 .

Participant perspectives about decentralised trial procedures in a remote delivery nutrition intervention trial

Participant recruitment and retention are consistently recognised as significant, costly challenges in nutrition intervention trials. Decentralised study procedures address some of the recruitment and retention limitations in traditional trial methodology. Understanding participant perceptions and experiences of decentralised methods in nutrition studies is key to improving trial design and conduct. The aim of this study was to explore participant opinions about remote delivery of a dietary supplement intervention trial. Adults enrolled in a clinical trial of a milk fat globule membrane nutritional supplement for improvement of psychological wellbeing were invited to take part in a post-intervention interview. Interviews were conducted over video conferencing and transcribed. Using a semi-structured interview format six aspects of trial design were discussed: general processes, written instructions, contact throughout the study, self-collection of saliva samples, wearable device use, and cognitive assessment. Thematic analysis derived themes from the data for each of the aspects of trial conduct discussed. Seventy-three participants completed the interview. Interviewees reported a positive overall experience of the remote delivery procedures used. Accessible communication between researchers and participants and clear written instructions were identified as key to participant experience. Recall of instructions and adherence to the nutritional intervention was difficult for some respondents with suggestions made for facilitating this in future remote delivery nutrition studies. Use of wearables, in-home saliva sampling, and self-administered cognitive assessments were feasible and acceptable to most participants. The remote delivery of a nutritional intervention trial, including self-collected biological samples, is feasible and positively viewed by participants.

Accuracy of Reaction Time Measurement on Automated Neuropsychological Assessment Metric UltraMobile

OBJECTIVE

This observational study examined the accuracy of simple reaction time (RT) measurements on various touchscreen tablet devices using the Automated Neuropsychological Assessment Metric (ANAM) UltraMobile test battery. The study investigated the implications of interpreting ANAM UltraMobile with laptop-based normative data by analyzing the magnitude and variability of RT accuracy across devices.

METHOD

RT accuracy on 10 different tablets was assessed using a photodetector and robotic arm to respond to stimuli at predetermined response times. The recorded RT was compared with the true RT obtained from the robotic arm to calculate the RT error.

RESULTS

ANAM UltraMobile recorded slower RTs than the laptop version. Additionally, RT error varied considerably among the 10 tablet models, suggesting psychometrically significant implications that could lead to interpretive errors when using laptop-based normative data.

CONCLUSIONS

Relative to the RT error from the laptop-based version of ANAM, tablet data from ANAM UltraMobile are significantly slower and exhibit large variability between devices. These differences may have clinically significant implications for the comparability of the two versions. The findings suggest that further research with human participants is needed to assess the equivalence of ANAM UltraMobile with its predecessor.

Detecting early cognitive deficits in preclinical Alzheimer's disease using a remote digital multi-day learning paradigm

Remote, digital cognitive testing on an individual's own device provides the opportunity to deploy previously understudied but promising cognitive paradigms in preclinical Alzheimer's disease (AD). The Boston Remote Assessment for NeuroCognitive Health (BRANCH) captures a personalized learning curve for the same information presented over seven consecutive days. Here, we examined BRANCH multi-day learning curves (MDLCs) in 167 cognitively unimpaired older adults (age = 74.3 ± 7.5, 63% female) with different amyloid-β (A) and tau (T) biomarker profiles on positron emission tomography. MDLC scores decreased across ascending biomarker groups, with the A + T- group performing numerically worse (β = -0.24, 95%CI[-0.55,0.07], p = 0.128) and the A + T+ group performing significantly worse (β = -0.58, 95%CI[-1.06,-0.10], p = 0.018) than the A-T- group. Further, lower MDLC scores were associated with greater cortical thinning (β = 0.18, 95%CI[0.04,0.34], p = 0.013). Our results suggest that diminished MDLCs track with advanced AD pathophysiology, and demonstrate how a digital multi-day learning paradigm can provide novel insights about cognitive decline during preclinical AD.

Subjective cognitive decline predicts longitudinal neuropsychological test performance in an unsupervised online setting in the Brain Health Registry

BACKGROUNDS

Digital, online assessments are efficient means to detect early cognitive decline, but few studies have investigated the relationship between remotely collected subjective cognitive change and cognitive decline. We hypothesized that the Everyday Cognition Scale (ECog), a subjective change measure, predicts longitudinal change in cognition in the Brain Health Registry (BHR), an online registry for neuroscience research.

METHODS

This study included BHR participants aged 55 + who completed both the baseline ECog and repeated administrations of the CANTAB® Paired Associates Learning (PAL) visual learning and memory test. Both self-reported ECog (Self-ECog) and study partner-reported ECog (SP-ECog), and two PAL scores (first attempt memory score [FAMS] and total errors adjusted [TEA]) were assessed. We estimated associations between multiple ECog scoring outputs (ECog positive [same or above cut-off score], ECog consistent [report of consistent decline in any item], and total score) and longitudinal change in PAL. Additionally we assessed the ability of ECog to identify 'decliners', who exhibited the worst PAL progression slopes corresponding to the fifth percentile and below.

RESULTS

Participants (n = 16,683) had an average age of 69.07 ± 7.34, 72.04% were female, and had an average of 16.66 ± 2.26 years of education. They were followed for an average of 2.52 ± 1.63 visits over a period of 11.49 ± 11.53 months. Both Self-ECog positive (estimate = -0.01, p < 0.001, R²m = 0.56) and Self-ECog consistent (estimate=-0.01, p = 0.002, R²m = 0.56) were associated with longitudinal change in PAL FAMS after adjusting demographics and clinical confounders. Those who were Self-ECog total (Odds ratio [95% confidence interval] = 1.390 [1.121-1.708]) and SP-ECog consistent (2.417 [1.591-3.655]) had higher probability of being decliners based on PAL FAMS.

CONCLUSION

In the BHR's unsupervised online setting, baseline subjective change was feasible in predicting longitudinal decline in neuropsychological tests. Online, self-administered measures of subjective cognitive change might have a potential to predict objective subjective change and identify individuals with cognitive impairments.

Web-based cognitive screening in bipolar disorder: validation of the Internet-based Cognitive Assessment Tool in remote administration settings

BACKGROUND

Cognitive impairments are prevalent during remission in bipolar disorder (BD), but existing cognitive screening tools are time- and resource-intensive. Digital, web-based options can facilitate detection and monitoring of these impairments across clinical and research settings.

METHODS

This cross-sectional study investigated psychometric properties of the Internet-based Cognitive Assessment Tool (ICAT) when self-administered in home-based settings. Newly diagnosed, remitted outpatients with BD and healthy controls (HC) underwent cognitive testing with the standard paper-pencil tool Screen for Cognitive Impairment in Psychiatry (SCIP) in-clinic and ICAT at-home as part of baseline assessments for an intervention trial (ClinicalTrials ID: 2021-000862-14).

RESULTS

Data were analyzed for 31 BD patients and 29 HC. We demonstrated a strong positive correlation between at-home ICAT and in-clinic SCIP total scores within patients with BD (r(29) = 0.66, p < .001), which survived subsyndromal mood symptoms adjustment (partial r(25) = 0.67, p < .001), indicating adequate concurrent validity. There was a moderate positive correlation between ICAT and SCIP total scores across the entire sample (r(54) = 0.56, p < .001) and between subtest scores (r = 0.29-0.61, ps ≤ .03), except the executive functions tasks (p = .1). BD patients exhibited no impaired performance compared to HC on ICAT or SCIP (ps ≥ .08).

CONCLUSIONS

ICAT is a valid and feasible online tool for remote cognitive screening in remitted patients with BD. Web-based screening constitutes an accessible and efficient approach for implementing systematic cognitive screening in BD.

Remote Digital Technologies for the Early Detection and Monitoring of Cognitive Decline in Patients With Type 2 Diabetes: Insights From Studies of Neurodegenerative Diseases

Type 2 diabetes (T2D) is a risk factor for cognitive decline. In neurodegenerative disease research, remote digital cognitive assessments and unobtrusive sensors are gaining traction for their potential to improve early detection and monitoring of cognitive impairment. Given the high prevalence of cognitive impairments in T2D, these digital tools are highly relevant. Further research incorporating remote digital biomarkers of cognition, behavior, and motor functioning may enable comprehensive characterizations of patients with T2D and may ultimately improve clinical care and equitable access to research participation. The aim of this commentary article is to review the feasibility, validity, and limitations of using remote digital cognitive tests and unobtrusive detection methods to identify and monitor cognitive decline in neurodegenerative conditions and apply these insights to patients with T2D.

Assessing time-based prospective memory online: A comparison study between laboratory-based and web-based testing

Prospective memory (PM, i.e., the ability to remember and perform future intentions) is assessed mainly within laboratory settings; however, in the last two decades, several studies have started testing PM online. Most part of those studies focused on event-based PM (EBPM), and only a few assessed time-based PM (TBPM), possibly because time keeping is difficult to control or standardise without experimental control. Thus, it is still unclear whether time monitoring patterns in online studies replicate typical patterns obtained in laboratory tasks. In this study, we therefore aimed to investigate whether the behavioural outcome measures obtained from the traditional TBPM paradigm in the laboratory-accuracy and time monitoring-are comparable with an online version in a sample of 101 younger adults. Results showed no significant difference in TBPM performance in the laboratory versus online setting, as well as no difference in time monitoring. However, we found that participants were somewhat faster and more accurate at the ongoing task during the laboratory assessment, but those differences were not related to holding an intention in mind. The findings suggest that, although participants seemed generally more distracted when tested remotely, online assessment yielded similar results in key temporal characteristics and behavioural performance as for the laboratory assessment. The results are discussed in terms of possible conceptual and methodological implications for online testing.

Lack of optimistic bias during social evaluation learning reflects reduced positive self-beliefs in depression and social anxiety, but via distinct mechanisms

Processing social feedback optimistically may maintain positive self-beliefs and stable social relationships. Conversely, a lack of this optimistic bias in depression and social anxiety may perpetuate negative self-beliefs and maintain symptoms. Research investigating this mechanism is scarce, however, and the mechanisms by which depressed and socially anxious individuals respond to social evaluation may also differ. Using a range of computational approaches in two large datasets (mega-analysis of previous studies, n = 450; pre-registered replication study, n = 807), we investigated how depression (PHQ-9) and social anxiety (BFNE) symptoms related to social evaluation learning in a computerized task. Optimistic bias (better learning of positive relative to negative evaluations) was found to be negatively associated with depression and social anxiety. Structural equation models suggested this reflected a heightened sensitivity to negative social feedback in social anxiety, whereas in depression it co-existed with a blunted response to positive social feedback. Computational belief-based learning models further suggested that reduced optimism was driven by less positive trait-like self-beliefs in both depression and social anxiety, with some evidence for a general blunting in belief updating in depression. Recognizing such transdiagnostic similarities and differences in social evaluation learning across disorders may inform approaches to personalizing treatment.

Generating normative data from web-based administration of the Cambridge Neuropsychological Test Automated Battery using a Bayesian framework

Introduction

Normative cognitive data can distinguish impairment from healthy cognitive function and pathological decline from normal ageing. Traditional methods for deriving normative data typically require extremely large samples of healthy participants, stratifying test variation by pre-specified age groups and key demographic features (age, sex, education). Linear regression approaches can provide normative data from more sparsely sampled datasets, but non-normal distributions of many cognitive test results may lead to violation of model assumptions, limiting generalisability.

Method

The current study proposes a novel Bayesian framework for normative data generation. Participants (n = 728; 368 male and 360 female, age 18-75 years), completed the Cambridge Neuropsychological Test Automated Battery via the research crowdsourcing website Prolific.ac. Participants completed tests of visuospatial recognition memory (Spatial Working Memory test), visual episodic memory (Paired Associate Learning test) and sustained attention (Rapid Visual Information Processing test). Test outcomes were modelled as a function of age using Bayesian Generalised Linear Models, which were able to derive posterior distributions of the authentic data, drawing from a wide family of distributions. Markov Chain Monte Carlo algorithms generated a large synthetic dataset from posterior distributions for each outcome measure, capturing normative distributions of cognition as a function of age, sex and education.

Results

Comparison with stratified and linear regression methods showed converging results, with the Bayesian approach producing similar age, sex and education trends in the data, and similar categorisation of individual performance levels.

Conclusion

This study documents a novel, reproducible and robust method for describing normative cognitive performance with ageing using a large dataset.

Mayo Normative Studies: regression-based normative data for remote self-administration of the Stricker Learning Span, Symbols Test and Mayo Test Drive Screening Battery Composite and validation in individuals with Mild Cognitive Impairment and dementia

Objective

Few normative data for unsupervised, remotely-administered computerized cognitive measures are available. We examined variables to include in normative models for Mayo Test Drive (a multi-device remote cognitive assessment platform) measures, developed normative data, and validated the norms.

Method

1240 Cognitively Unimpaired (CU) adults ages 32-100-years (96% white) from the Mayo Clinic Study of Aging and Mayo Alzheimer's Disease Research Center with Clinical Dementia Rating® of 0 were included. We converted raw scores to normalized scaled scores and derived regression-based normative data adjusting for age, age2, sex and education (base model); alternative norms are also provided (age+age2+sex; age+age2). We assessed additional terms using an a priori cut-off of 1% variance improvement above the base model. We examined low test performance rates (<-1 standard deviation) in independent validation samples (n=167 CU, n=64 mild cognitive impairment (MCI), n=14 dementia). Rates were significantly different when 95% confidence intervals (CI) did not include the expected 14.7% base rate.

Results

No model terms met the a priori cut-off beyond the base model, including device type, response input source (e.g., mouse, etc.) or session interference. Norms showed expected low performance rates in CU and greater rates of low performance in MCI and dementia in independent validation samples.

Conclusion

Typical normative models appear appropriate for remote self-administered MTD measures and are sensitive to cognitive impairment. Device type and response input source did not explain enough variance for inclusion in normative models but are important for individual-level interpretation. Future work will increase inclusion of individuals from under-represented groups.

Initial results from the PHEFREE longitudinal natural history study: Cross-sectional observations in a cohort of individuals with phenylalanine hydroxylase (PAH) deficiency

Over fifty years have passed since the last large scale longitudinal study of individuals with PAH deficiency in the U.S. Since then, there have been significant changes in terms of treatment recommendations as well as treatment options. The Phenylalanine Families and Researchers Exploring Evidence (PHEFREE) Consortium was recently established to collect a more up-to-date and extensive longitudinal natural history in individuals with phenylketonuria across the lifespan. In the present paper, we describe the structure and methods of the PHEFREE longitudinal study protocol and report cross-sectional data from an initial sample of 73 individuals (5 months to 54 years of age) with PAH deficiency who have enrolled. Looking forward, the study holds the promise for advancing the field on several fronts including the validation of novel neurocognitive tools for assessment in individuals with PKU as well as evaluation of the long-term effects of changes in metabolic control (e.g., effects of Phe-lowering therapies) on outcome.

Development of a self-administered online battery for remote assessment of executive functions and verbal memory: equivalence with face-to-face administration, preliminary norms, and acceptance

OBJECTIVES

Interest in teleneuropsychology services increased considerably after the COVID-19 pandemic. However, the utility of unsupervised administration of computerized tests remains largely unexplored. In the present study, we developed a brief computerized battery that assesses self-reported cognitive abilities and performances on executive functioning and verbal memory. We investigated the equivalence of the self-administration online (SAO) procedure and the face-to-face (FTF) administration. Preliminary normative data were developed and the acceptance of the SAO procedure was explored.

METHODS

A community sample of 169 Greek adults [94 women; mean age: 41.95 (SD = 13.40) years, mean years of education: 15.10 (SD = 2.65)] completed the SAO assessment. A subgroup of 40 participants was tested in a counterbalanced way both with SAO and FTF. Participants' performances were compared with paired sample t-tests and the agreement between the two methods was estimated with intraclass correlation coefficients (ICCs). Multiple linear regression analyses were applied to investigate the effect of demographic characteristics on SAO measures.

RESULTS

No difference between SAO and FTF scores was observed. ICCs indicated moderate to good agreement (.418-.848) for most measures. Age was positively associated with self-reported cognitive state and negatively with neuropsychological performances and the level of acceptance of the SAO procedure. Approximately 80% of participants reported satisfaction from the SAO assessment, 69% good compliance with the instructions, but less than 30% belief that the FTF assessment could be adequately replaced.

CONCLUSION

SAO testing is feasible and well accepted among Greek adults yielding equivalent results with FTF testing. Despite the wide satisfaction, though, notable reluctance was noted for the substitution of FTF with SAO procedures.

No association between alexithymia and emotion recognition or theory of mind in a sample of adolescents enhanced for autistic traits

LAY ABSTRACT

Alexithymia is a sub-clinical condition characterised by difficulties identifying and describing one's own emotions, which is found in many, but not all autistic people. The alexithymia hypothesis suggests that certain aspects of socio-cognitive functioning typically attributed to autism, namely difficulties in emotion recognition, might be better explained by often co-occurring alexithymia. It is important to understand what is specific to autism and what is due to other co-occurring characteristics to develop appropriate support for autistic people. However, most research on this topic has been conducted in adults, which limits our knowledge about the relevance of this theory to younger autistic populations. This study tested whether difficulties in emotion recognition and theory of mind traditionally associated with autism might be better explained by alexithymia in a sample of adolescents with and without a diagnosis of autism. Results found that difficulties in emotion recognition and theory of mind were both associated with autistic traits, and this was not accounted for by individual differences in levels of alexithymia. This research suggests that more work is needed to understand the applicability of the alexithymia hypothesis in younger populations, but that at least in adolescents and when using parent-report measures, alexithymia may not account for emotion recognition or theory of mind difficulties associated with autistic traits.

Montreal Cognitive Assessment (MoCA) as a screening tool for cognitive impairment in early stages of psychosis

Background

Cognitive alterations have been reported in early stages of psychosis including people with First Episode Psychosis (FEP), Clinical High-Risk Mental State (CHR), and Psychotic-Like Experience (PLE). This study aimed to compare the cognitive function in early stages of psychosis using the Montreal Cognitive Assessment (MoCA), a low-cost and brief assessment tool of cognitive functions.

Methods

A total of 154 individuals, including 35 with FEP, 38 CHR, 44 PLE, and 37 healthy controls (HC), were evaluated with the MoCA in Santiago, Chile. We calculated the mean total score of the MoCA and the standard deviation of the mean. Groups were assessed for a trend to lower scores in a pre-determined sequence (HC > PLE > CHR > FEP) using the Jonckheere-Terpstra test (TJT).

Results

The mean total MoCA scores were 24.8 ± 3.3 in FEP, 26.4 ± 2.4 in CHR, 26.4 ± 2.3 in PLE, and 27.2 ± 1.8 in HC. The analyses revealed a significant trend (p < 0.05) toward lower MoCA individual domain scores and MoCA total scores in the following order: HC > PLE > CHR > FEP. The mean total scores of all groups were above the cut-off for cognitive impairment (22 points).

Conclusions

The MoCA describes lower scores in cognition across early stages of psychosis and may be a useful low-cost assessment instrument in early intervention centers of poorly resourced settings.

The Real-World Usability, Feasibility, and Performance Distributions of Deploying a Digital Toolbox of Computerized Assessments to Remotely Evaluate Brain Health: Development and Usability Study

BACKGROUND

An ongoing global challenge is managing brain health and understanding how performance changes across the lifespan.

OBJECTIVE

We developed and deployed a set of self-administrable, computerized assessments designed to measure key indexes of brain health across the visual and auditory sensory modalities. In this pilot study, we evaluated the usability, feasibility, and performance distributions of the assessments in a home-based, real-world setting without supervision.

METHODS

Potential participants were untrained users who self-registered on an existing brain training app called BrainHQ. Participants were contacted via a recruitment email and registered remotely to complete a demographics questionnaire and 29 unique assessments on their personal devices. We examined participant engagement, descriptive and psychometric properties of the assessments, associations between performance and self-reported demographic variables, cognitive profiles, and factor loadings.

RESULTS

Of the 365,782 potential participants contacted via a recruitment email, 414 (0.11%) registered, of whom 367 (88.6%) completed at least one assessment and 104 (25.1%) completed all 29 assessments. Registered participants were, on average, aged 63.6 (SD 14.8; range 13-107) years, mostly female (265/414, 64%), educated (329/414, 79.5% with a degree), and White (349/414, 84.3% White and 48/414, 11.6% people of color). A total of 72% (21/29) of the assessments showed no ceiling or floor effects or had easily modifiable score bounds to eliminate these effects. When correlating performance with self-reported demographic variables, 72% (21/29) of the assessments were sensitive to age, 72% (21/29) of the assessments were insensitive to gender, 93% (27/29) of the assessments were insensitive to race and ethnicity, and 93% (27/29) of the assessments were insensitive to education-based differences. Assessments were brief, with a mean duration of 3 (SD 1.0) minutes per task. The pattern of performance across the assessments revealed distinctive cognitive profiles and loaded onto 4 independent factors.

CONCLUSIONS

The assessments were both usable and feasible and warrant a full normative study. A digital toolbox of scalable and self-administrable assessments that can evaluate brain health at a glance (and longitudinally) may lead to novel future applications across clinical trials, diagnostics, and performance optimization.

Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures

INTRODUCTION

Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies.

METHOD

In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects.

RESULTS

Internal consistency was good across samples (ρxx = .80 to .85, p < .001). Test-retest reliability was marginal (ICC = .49, p < .001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ = .44 to .76, p < .001), while correlations with discriminant measures were small (ρ = .23 to .27, p < .05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to -.21, p < .001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p < .001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p < .001), but there were not significantly more perfect scores.

CONCLUSION

The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples.

Development of a smartphone screening test for preclinical Alzheimer's disease and validation across the dementia continuum

BACKGROUND

Dementia prevalence is predicted to triple to 152 million globally by 2050. Alzheimer's disease (AD) constitutes 70% of cases. There is an urgent need to identify individuals with preclinical AD, a 10-20-year period of progressive brain pathology without noticeable cognitive symptoms, for targeted risk reduction. Current tests of AD pathology are either too invasive, specialised or expensive for population-level assessments. Cognitive tests are normal in preclinical AD. Emerging evidence demonstrates that movement analysis is sensitive to AD across the disease continuum, including preclinical AD. Our new smartphone test, TapTalk, combines analysis of hand and speech-like movements to detect AD risk. This study aims to [1] determine which combinations of hand-speech movement data most accurately predict preclinical AD [2], determine usability, reliability, and validity of TapTalk in cognitively asymptomatic older adults and [3], prospectively validate TapTalk in older adults who have cognitive symptoms against cognitive tests and clinical diagnoses of Mild Cognitive Impairment and AD dementia.

METHODS

Aim 1 will be addressed in a cross-sectional study of at least 500 cognitively asymptomatic older adults who will complete computerised tests comprising measures of hand motor control (finger tapping) and oro-motor control (syllabic diadochokinesis). So far, 1382 adults, mean (SD) age 66.20 (7.65) years, range 50-92 (72.07% female) have been recruited. Motor measures will be compared to a blood-based AD biomarker, phosphorylated tau 181 to develop an algorithm that classifies preclinical AD risk. Aim 2 comprises three sub-studies in cognitively asymptomatic adults: (i) a cross-sectional study of 30-40 adults to determine the validity of data collection from different types of smartphones, (ii) a prospective cohort study of 50-100 adults ≥ 50 years old to determine usability and test-retest reliability, and (iii) a prospective cohort study of ~1,000 adults ≥ 50 years old to validate against cognitive measures. Aim 3 will be addressed in a cross-sectional study of ~200 participants with cognitive symptoms to validate TapTalk against Montreal Cognitive Assessment and interdisciplinary consensus diagnosis.

DISCUSSION

This study will establish the precision of TapTalk to identify preclinical AD and estimate risk of cognitive decline. If accurate, this innovative smartphone app will enable low-cost, accessible screening of individuals for AD risk. This will have wide applications in public health initiatives and clinical trials.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT06114914, 29 October 2023. Retrospectively registered.

Online cognitive testing in Parkinson's disease: advantages and challenges

Parkinson's disease (PD) is primarily characterized by motor symptoms. Yet, many people with PD experience cognitive decline, which is often unnoticed by clinicians, although it may have a significant impact on quality of life. For over half a century, traditional in-person PD cognitive assessment lacked accessibility, scalability, and specificity due to its inherent limitations. In this review, we propose that novel methods of online cognitive assessment could potentially address these limitations. We first outline the challenges of traditional in-person cognitive testing in PD. We then summarize the existing literature on online cognitive testing in PD. Finally, we explore the advantages, but also the limitations, of three major processes involved in online PD cognitive testing: recruitment and sampling methods, measurement and participation, and disease monitoring and management. Taking the limitations into account, we aim to highlight the potential of online cognitive testing as a more accessible and efficient approach to cognitive testing in PD.

Exploring the multiverse of analysis options for the alcohol Stroop

The alcohol Stroop is a widely used task in addiction science to measure the theoretical concept of attentional bias (a selective attention to alcohol-related cues in the environment), which is thought to be associated with clinical outcomes (craving and consumption). However, recent research suggests findings from this task can be equivocal. This may be because the task has many different potential analysis pipelines, which increase researcher degrees of freedom when analysing data and reporting results. These analysis pipelines largely come from how outlying reaction times on the task are identified and handled (e.g. individual reaction times > 3 standard deviations from the mean are removed from the distribution; removal of all participant data if > 25% errors are made). We used specification curve analysis across two alcohol Stroop datasets using alcohol-related stimuli (one published and one novel) to examine the robustness of the alcohol Stroop effect to different analytical decisions. We used a prior review of this research area to identify 27 unique analysis pipelines. Across both data sets, the pattern of results was similar. The alcohol Stroop effect was present and largely robust to different analysis pipelines. Increased variability in the Stroop effect was observed when implementing outlier cut-offs for individual reaction times, rather than the removal of participants. Stricter outlier thresholds tended to reduce the size of the Stroop interference effect. These specification curve analyses are the first to examine the robustness of the alcohol Stroop to different analysis strategies, and we encourage researchers to adopt such analytical methods to increase confidence in their inferences across cognitive and addiction science.

Exploring bias in horizontal and vertical spatial representations using mental number lines and the greyscales task

People have a leftward bias when making visuospatial judgements about horizontally arranged stimuli ("pseudoneglect"), and a superior bias when making visuospatial judgements about vertically arranged stimuli. The leftward visuospatial bias in physical space seems to extend to the mental representation of space. However, whether any bias exists in mental representation of vertical space is unknown. We investigated whether people show a visuospatial bias in the mental representation of vertical space, and if any bias in mental representations of horizontal and vertical space related to the extent of bias in physical space. Participants (n = 171) were presented with three numbers and asked which interval was smaller/larger (counterbalanced): the interval between the first and middle, or middle and last number. Participants were instructed to either think of the numbers as houses on a street or as floors of a building, or were given no imagery instructions. Participants in the houses on a street condition showed a leftward bias, but there was no superior bias in the floors of a building condition. In contrast, we replicated previous findings of leftward and superior bias on greyscales tasks. Our findings reinforce previous evidence that numbers are represented horizontally and ascending left to right by default.

Remote Testing of Reading Comprehension in 8-Year-Old Children: Mode and Setting Effects

Proctored remote testing of cognitive abilities in the private homes of test-takers is becoming an increasingly popular alternative to standard psychological assessments in test centers or classrooms. Because these tests are administered under less standardized conditions, differences in computer devices or situational contexts might contribute to measurement biases that impede fair comparisons between test-takers. Because it is unclear whether cognitive remote testing might be a feasible assessment approach for young children, the present study (N = 1,590) evaluated a test of reading comprehension administered to children at the age of 8 years. To disentangle mode from setting effects, the children finished the test either in the classroom on paper or computer or remotely on tablets or laptops. Analyses of differential response functioning found notable differences between assessment conditions for selected items. However, biases in test scores were largely negligible. Only for children with below-average reading comprehension small setting effects between on-site and remote testing were observed. Moreover, response effort was higher in the three computerized test versions, among which, reading on tablets most strongly resembled the paper condition. Overall, these results suggest that, on average, even for young children remote testing introduces little measurement bias.

Divergent effects of listening demands and evaluative threat on listening effort in online and laboratory settings

Objective

Listening effort (LE) varies as a function of listening demands, motivation and resource availability, among other things. Motivation is posited to have a greater influence on listening effort under high, compared to low, listening demands.

Methods

To test this prediction, we manipulated the listening demands of a speech recognition task using tone vocoders to create moderate and high listening demand conditions. We manipulated motivation using evaluative threat, i.e., informing participants that they must reach a particular "score" for their results to be usable. Resource availability was assessed by means of working memory span and included as a fixed effects predictor. Outcome measures were indices of LE, including reaction times (RTs), self-rated work and self-rated tiredness, in addition to task performance (correct response rates). Given the recent popularity of online studies, we also wanted to examine the effect of experimental context (online vs. laboratory) on the efficacy of manipulations of listening demands and motivation. We carried out two highly similar experiments with two groups of 37 young adults, a laboratory experiment and an online experiment. To make listening demands comparable between the two studies, vocoder settings had to differ. All results were analysed using linear mixed models.

Results

Results showed that under laboratory conditions, listening demands affected all outcomes, with significantly lower correct response rates, slower RTs and greater self-rated work with higher listening demands. In the online study, listening demands only affected RTs. In addition, motivation affected self-rated work. Resource availability was only a significant predictor for RTs in the online study.

Discussion

These results show that the influence of motivation and listening demands on LE depends on the type of outcome measures used and the experimental context. It may also depend on the exact vocoder settings. A controlled laboratory settings and/or particular vocoder settings may be necessary to observe all expected effects of listening demands and motivation.

Associations of physical activity and history of sports participation with subjective and objective measures of executive functioning in university students

This study examined how physical activity and history of sports participation affect subjective and objective executive functioning in university students. A total of 215 university students aged 18-25 (81% female) completed a virtual assessment of executive function. The correlates were age, sex, physical activity, and history of sports participation. Structural equation modeling was used to examine objective executive function using a three-factor model (shifting, updating, inhibition). The Executive Function Index (EFI) was used to measure subjective executive functioning, and linear regression was used to examine total EFI scores. Physical activity (b = 0.12, p < .01) was a significant correlate of subjective but not objective executive functioning. Male sex and history of sports participation were significantly positively related to the objective measure of inhibition (b = 0.64, p < .01; b = 0.18, p < .05). These findings suggest that subjective and objective measures of executive functioning should be differentiated when investigating their relationship with physical activity and history of sports participation.

Unsupervised Online Paired Associates Learning Task from the Cambridge Neuropsychological Test Automated Battery (CANTAB®) in the Brain Health Registry

BACKGROUND

Unsupervised online cognitive assessments have demonstrated promise as an efficient and scalable approach for evaluating cognition in aging, and Alzheimer's disease and related dementias.

OBJECTIVES

The aim of this study was to evaluate the feasibility, usability, and construct validity of the Paired Associates Learning task from the Cambridge Neuropsychological Test Automated Battery® in adults enrolled in the Brain Health Registry.

DESIGN, SETTING, PARTICIPANTS, MEASUREMENTS

The Paired Associates Learning task was administered to Brain Health Registry participants in a remote, unsupervised, online setting. In this cross-sectional analysis, we 1) evaluated construct validity by analyzing associations between Paired Associates Learning performance and additional participant registry data, including demographics, self- and study partner-reported subjective cognitive change (Everyday Cognition scale), self-reported memory concern, and depressive symptom severity (Patient Health Questionnaire-9) using multivariable linear regression models; 2) determined the predictive value of Paired Associates Learning and other registry variables for identifying participants who self-report Mild Cognitive Impairment by employing multivariable binomial logistic regressions and calculating the area under the receiver operator curve; 3) investigated feasibility by looking at task completion rates and statistically comparing characteristics of task completers and non-completers; and 4) evaluated usability in terms of participant requests for support from BHR related to the assessment.

RESULTS

In terms of construct validity, in participants who took the Paired Associates Learning for the first time (N=14,528), worse performance was associated with being older, being male, lower educational attainment, higher levels of self- and study partner-reported decline, more self-reported memory concerns, greater depressive symptom severity, and self-report of Mild Cognitive Impairment. Paired Associates Learning performance and Brain Health Registry variables together identified those with self-reported Mild Cognitive Impairment with moderate accuracy (areas under the curve: 0.66-0.68). In terms of feasibility, in a sub-sample of 29,176 participants who had the opportunity to complete Paired Associates Learning for the first time in the registry, 14,417 started the task. 11,647 (80.9% of those who started) completed the task. Compared to those who did not complete the task at their first opportunity, those who completed were older, had more years of education, more likely to self-identify as White, less likely to self-identify as Latino, less likely to have a subjective memory concern, and more likely to report a family history of Alzheimer's disease. In terms of usability, out of 8,395 received requests for support from BHR staff via email, 4.4% (n=374) were related to PAL. Of those, 82% were related to technical difficulties.

CONCLUSIONS

Our findings support moderate feasibility, good usability, and construct validity of cross-sectional Paired Associates Learning in an unsupervised online registry, but also highlight the need to make the assessment more inclusive and accessible to individuals from ethnoculturally and socioeconomically diverse communities. A future, improved version could be a scalable, efficient method to assess cognition in many different settings, including clinical trials, observational studies, healthcare, and public health.

Estimating presymptomatic episodic memory impairment using simple hand movement tests: A cross-sectional study of a large sample of older adults

INTRODUCTION

Finding low-cost methods to detect early-stage Alzheimer's disease (AD) is a research priority for neuroprotective drug development. Presymptomatic Alzheimer's is associated with gait impairment but hand motor tests, which are more accessible, have hardly been investigated. This study evaluated how home-based Tasmanian (TAS) Test keyboard tapping tests predict episodic memory performance.

METHODS

1169 community participants (65.8 ± 7.4 years old; 73% female) without cognitive symptoms completed online single-key and alternate-key tapping tests and episodic memory, working memory, and executive function cognitive tests.

RESULTS

All single-key (R2 adj  = 8.8%, ΔAIC = 5.2) and alternate-key (R2 adj  = 9.1%, ΔAIC = 8.8) motor features predicted episodic memory performance relative to demographic and mood confounders only (R2 adj  = 8.1%). No tapping features improved estimation of working memory.

DISCUSSION

Brief self-administered online hand movement tests predict asymptomatic episodic memory impairment. This provides a potential low-cost home-based method for stratification of enriched cohorts.

HIGHLIGHTS

We devised two brief online keyboard tapping tests to assess hand motor function. 1169 cognitively asymptomatic adults completed motor- and cognitive tests online. Impaired hand motor function predicted reduced episodic memory performance. This brief self-administered test may aid stratification of community cohorts.

Associations of Perceived Stress and Psychological Resilience With Cognition and a Modifiable Dementia Risk Score in Middle-Aged Adults

OBJECTIVES

Psychological stress has been proposed as a risk factor for cognitive impairment and dementia. However, it remains unclear how an individual's stress-coping ability (i.e., psychological resilience) is related to cognition. This cross-sectional study investigated whether perceived stress and psychological resilience were associated with cognition and a modifiable dementia risk score in a large community-based sample of cognitively normal adults. The moderating effect of psychological resilience was also examined.

METHODS

Participants (mean age = 57 ± 7 years) enrolled in the web-based Healthy Brain Project completed the Perceived Stress Scale and the Connor-Davidson Resilience Scale. Domains of attention and working memory were assessed using the Cogstate Brief Battery (n = 1,709), and associative memory was assessed using the Cambridge Neuropsychological Test Automated Battery (n = 1,522). Dementia risk was estimated for 1,913 participants using a modified version of the Cardiovascular Risk Factors, Aging, and Incidence of Dementia dementia risk score, calculated using only readily modifiable dementia risk factors.

RESULTS

In separate linear regression analyses adjusted for age, sex, education, and race, greater levels of perceived stress and lower levels of psychological resilience were associated with poorer performance across all cognitive domains, as well as a higher modifiable dementia risk score. Psychological resilience did not moderate the effect of perceived stress on cognition or the dementia risk score.

DISCUSSION

Higher perceived stress and lower resilience were associated with poorer cognition and a greater burden of modifiable dementia risk factors. Intervention studies are required to determine if lowering stress and building resilience can mitigate cognitive deficits and reduce dementia risk.

A review of the reliability of remote neuropsychological assessment

The provision of clinical neuropsychological services has predominately been undertaken by way of standardized administration in a face-to-face setting. Interpretation of psychometric findings in this context is dependent on the use of normative comparison. When the standardization in which such psychometric measures are employed deviates from how they were employed in the context of the development of its associated norms, one is left to question the reliability and hence, validity of any such findings and in turn, diagnostic decision making. In light of the current COVID-19 pandemic and resultant social distancing direction, face-to-face neuropsychological assessment has been challenging to undertake. As such, remote (i.e., virtual) neuropsychological assessment has become an obvious solution. Here, and before the results from remote neuropsychological assessment can be said to stand on firm scientific grounds, it is paramount to ensure that results garnered remotely are reliable and valid. To this end, we undertook a review of the literature and present an overview of the landscape. To date, the literature shows evidence for the reliability of remote administration and the clinical implications are paramount. When and where needed, neuropsychologists, psychometric technicians and examinees may no longer need to be in the same physical space to undergo an assessment. These findings are most relevant given the physical distancing practices because of COVID-19. And whilst remote assessment should never supplant face-to-face neuropsychological assessments, it does serve as a valid alternative when necessary.

Computerized Cognitive Test Batteries for Children and Adolescents-A Scoping Review of Tools For Lab- and Web-Based Settings From 2000 to 2021

OBJECTIVE

Cognitive functioning is essential to well-being. Since cognitive difficulties are common in many disorders, their early identification is critical, notably during childhood and adolescence. This scoping review aims to provide a comprehensive literature overview of computerized cognitive test batteries (CCTB) that have been developed and used in children and adolescents over the past 22 years and to evaluate their psychometric properties.

METHOD

Among 3192 records identified from three databases (PubMed, PsycNET, and Web of Science) between 2000 and 2021, 564 peer-reviewed articles conducted in children and adolescents aged 3 to 18 years met inclusion criteria. Twenty main CCTBs were identified and further reviewed following PRISMA guidelines. Relevant study details (sample information, topic, location, setting, norms, and psychometrics) were extracted, as well as administration and instrument characteristics for the main CCTBs.

RESULTS

Findings suggest that CCTB use varies according to age, location, and topic, with eight tools accounting for 85% of studies, and the Cambridge Neuropsychological Test Automated Battery (CANTAB) being most frequently used. Few instruments were applied in web-based settings or include social cognition tasks. Only 13% of studies reported psychometric properties.

CONCLUSIONS

Over the past two decades, a high number of computerized cognitive batteries have been developed. Among these, more validation studies are needed, particularly across diverse cultural contexts. This review offers a comprehensive synthesis of CCTBs to aid both researchers and clinicians to conduct cognitive assessments in children in either a lab- or web-based setting.

Sex Differences in Attention and Attitude Toward Infant and Sexual Images

Reproduction in mammals includes two general categories of behaviors: mating and parenting. Historically and cross-culturally, men invest more than women in mating; women invest more than men in parenting. Sex differences in attention and attitude toward mating and parenting stimuli have rarely been assessed together despite theoretical interest. To evaluate these differences simultaneously in a naturalistic setting, 582 study participants (459 women, 123 men) were presented with sexual and infant images, online in the privacy of their home, at three time periods spanning several weeks for a more reliable result. Attention was measured by covertly recording viewing time of images using Qualtrics software, and attitude was measured via self-report after each viewing session. Men reported a more positive attitude than women toward the sexual images; women reported a more positive attitude than men toward the infant images. Women viewed the infant images marginally longer than did men, and the infant-to-sexual viewing ratio was larger for women. The sexual-to-infant viewing ratio was larger for men than for women. Unexpectedly, both genders viewed the sexual images longer than the infant images, with no significant gender difference in the sexual image viewing time. The results suggest that women and men may give equal attention to visual sexual stimuli despite self-reported sex differences in interest. The possibly underestimated valence of visual sexual stimuli for women is discussed.

Oral intake of carboxy alkyl ester improves attention: A randomized double-blind cross-over placebo-controlled study

OBJECTIVE

To test the null hypothesis that oral intake of the dietary supplement carboxy alkyl ester (CAE) would have no effect on attention as revealed by mean rapid visual information processing (RVIP) scores.

METHODS

In a randomized double-blind cross-over placebo-controlled trial, healthy participants (age 19-66 years) of both sexes were randomly assigned to consume 700 mg of CAE or 700 mg of placebo. They received baseline attention testing via the RVIP task. Then they consumed CAE or placebo followed by RVIP testing. Participants were then given a washout period where they did not consume CAE or placebo. Afterward, individuals who initially consumed CAE were given the placebo and those who initially consumed the placebo were given CAE. Finally, all participants were tested again via RVIP.

RESULTS

A priori statistical computation revealed that 30-day oral intake of CAE improved mean RVIP test scores (t = 2.4, p < .05) relative to that at baseline, which resulted in a rejection of the null hypothesis.

CONCLUSIONS

Daily oral intake of the CAE dietary supplement may boost attention and further research is now needed to confirm this observation.

Feasibility and impact of a remote moderate-intensity yoga intervention on stress and executive functioning in working adults: a randomized controlled trial

The feasibility of a moderate-intensity yoga intervention, delivered remotely via supervised and unsupervised sessions, and its psychosocial and cognitive effects have not been thoroughly investigated. This randomized controlled trial assessed feasibility and preliminary efficacy of an 8-week moderate-intensity yoga intervention (3×/week, 50 min) delivered remotely (vs. a waitlist control arm), on stress and cognitive functioning. Participants (n = 86) were low active, full-time working adults (81.40% female; Mage = 41 years) with symptoms of stress. Feasibility was assessed via adherence, enjoyment, and safety; stress and anxiety via self-report questionnaires; and executive functioning via neuropsychological tests. Overall attendance was 75.1%, 100% of participants enjoyed the intervention, and only one adverse event was reported. At follow-up, the yoga group had significantly lower stress and anxiety, and higher accuracy on working memory tasks. Remote moderate intensity yoga practice proved safe, enjoyable, and may reduce stress and improve cognitive functioning. This study was pre-registered on ClinicalTrials.gov (NCT04740229).

Web-based cognitive assessment in older adults: Where do we stand?

PURPOSE OF REVIEW

The use of digital tools for remote cognitive measurement of older adults is generating increasing interest due to the numerous advantages offered for accessibility and scalability. However, these tools also pose distinctive challenges, necessitating a thorough analysis of their psychometric properties, feasibility and acceptability.

RECENT FINDINGS

In this narrative review, we present the recent literature on the use of web-based cognitive assessment to characterize cognition in older adults and to contribute to the diagnosis of age-related neurodegenerative diseases. We present and discuss three types of web-based cognitive assessments: conventional cognitive tests administered through videoconferencing; unsupervised web-based assessments conducted on a computer; and unsupervised web-based assessments performed on smartphones.

SUMMARY

There have been considerable progress documenting the properties, strengths and limitations of web-based cognitive assessments. For the three types of assessments reported here, the findings support their promising potential for older adults. However, certain aspects, such as the construct validity of these tools and the development of robust norms, remain less well documented. Nonetheless, the beneficial potential of these tools, and their current validation and feasibility data, justify their application [see Supplementary Digital Content (SDC), http://links.lww.com/CONR/A69 ].

Autistic traits modulate the influence of face masks on gaze perception

Detecting when others are looking at us is a crucial social skill. Accordingly, a range of gaze angles is perceived as self-directed; this is termed the "cone of direct gaze" (CoDG). Multiple cues, such as nose and head orientation, are integrated during gaze perception. Thus, occluding the lower portion of the face, such as with face masks during the COVID-19 pandemic, may influence how gaze is perceived. Individual differences in the prioritisation of eye-region and non-eye-region cues may modulate the influence of face masks on gaze perception. Autistic individuals, who may be more reliant on non-eye-region directional cues during gaze perception, might be differentially affected by face masks. In the present study, we compared the CoDG when viewing masked and unmasked faces (N = 157) and measured self-reported autistic traits. The CoDG was wider for masked compared to unmasked faces, suggesting that reduced reliability of lower face cues increases the range of gaze angles perceived as self-directed. Additionally, autistic traits positively predicted the magnitude of CoDG difference between masked and unmasked faces. This study provides crucial insights into the effect of face masks on gaze perception, and how they may affect autistic individuals to a greater extent.

Sensory processing sensitivity, memory and cognitive training with neurofeedback

Sensory processing sensitivity (SPS) is a biological trait associated with enhanced awareness of and responsivity to the environment, as well as depth of cognitive processing. However, only a few studies have investigated how contextual factors impact cognition as a function of SPS. Thus, this study examined whether SPS is associated with differential changes in cognitive function resulting from participation in a 4-week app-based cognitive training program with neurofeedback (CT-NF). Participants (M age = 66 years) were randomized to either a treatment (CT-NF) or control group (Tetris). They completed a self-report measure of SPS (the Highly Sensitive Person Scale), and cognitive tests at pre- and post-intervention. Results revealed that individuals with higher levels of SPS in the treatment group showed superior improvements in memory (MEM) and visual memory (VSM), relative to other participants and other measures of cognition. These findings are consistent with theories of SPS and studies showing that enhanced visual perceptiveness and memory are associated with the trait. Moreover, they highlight the cognitive mechanisms that might be especially important for SPS. In conclusion, these findings suggest that those with high SPS may experience enhancements in MEM and VSM, resulting from a 4-week app-based CT-NF program.

Research on digital tool in cognitive assessment: a bibliometric analysis

Objective

The number of research into new cognitive assessment tools has increased rapidly in recent years, sparking great interest among professionals. However, there is still little literature revealing the current status and future trends of digital technology use in cognitive assessment. The aim of this study was to summarize the development of digital cognitive assessment tools through the bibliometric method.

Methods

We carried out a comprehensive search in the Web of Science Core Collection to identify relevant papers published in English between January 1, 2003, and April 3, 2023. We used the subjects such as "digital," "computer," and "cognitive," and finally 13,244 related publications were collected. Then we conducted the bibliometric analysis by Bibliometrix" R-package, VOSviewer and CiteSpace software, revealing the prominent countries, authors, institutions, and journals.

Results

11,045 articles and 2,199 reviews were included in our analyzes. The number of annual publications in this field was rising rapidly. The results showed that the most productive countries, authors and institutions were primarily located in economically developed regions, especially the North American, European, and Australian countries. Research cooperation tended to occur in these areas as well. The application of digital technology in cognitive assessment appealed to growing attention during the outbreak of the COVID-19 epidemic.

Conclusion

Digital technology uses have had a great impact on cognitive assessment and health care. There have been substantial papers published in these areas in recent years. The findings of the study indicate the great potential of digital technology in cognitive assessment.

Neurocognitive and self-reported psychosocial and behavioral functioning in siblings of individuals with neurodevelopmental conditions: a study using remote self-administered testing

OBJECTIVE

This study compared and explored the neurocognitive profiles of siblings of persons with and without neurodevelopmental conditions (NDCs) and associations between objective test performance and self-reported psychosocial functioning.

METHODS

Siblings of persons with and without NDCs (64 NDC and 64 control siblings; mean age 19.88 years, range 11-27 years, 73.44% female, 75.78% White Caucasian) completed self-report questionnaires and self-administered computerized neurocognitive tests of executive functioning (EF). Using Bayesian analyses, we examined cross-sectional associations between self-reported psychosocial functioning and cognitive test performance, and predictors of EF over 15 months.

RESULTS

NDC siblings had poorer working memory, inhibition, attention, and shifting compared to controls, as measured by experimental paradigms on the backward Corsi span, N-Back 2-back task, Stop Signal Task, Sustained Attention to Response Task, and the Wisconsin Card Sorting Test (effect size δ ranging 0.49 to 0.64). Bayesian cross-sectional networks revealed negative emotion reactivity and working memory difficulties were central to the NDC sibling network. Over 15 months, poorer EF (k low test scores) was predicted by negative emotion reactivity, sleep problems, and anxiety, over and above effects of age and subclinical autistic and ADHD traits. Siblings of autistic individuals and persons with fetal alcohol spectrum disorder had higher rates of neurocognitive and psychiatric difficulties than other NDCs and controls (Bayes factors >20).

CONCLUSIONS

Neurocognitive difficulties were associated with transdiagnostic vulnerability to poorer wellbeing in NDC siblings. These findings demonstrate the feasibility of remote online cognitive testing and highlight the importance of individualized prevention and intervention for NDC siblings.

Total choline intake and working memory performance in adults with phenylketonuria

BACKGROUND

Despite early diagnosis and compliance with phenylalanine (Phe)-restricted diets, many individuals with phenylketonuria (PKU) still exhibit neurological changes and experience deficits in working memory and other executive functions. Suboptimal choline intake may contribute to these impairments, but this relationship has not been previously investigated in PKU. The objective of this study was to determine if choline intake is correlated with working memory performance, and if this relationship is modified by diagnosis and metabolic control.

METHODS

This was a cross-sectional study that included 40 adults with PKU and 40 demographically matched healthy adults. Web-based neurocognitive tests were used to assess working memory performance and 3-day dietary records were collected to evaluate nutrient intake. Recent and historical blood Phe concentrations were collected as measures of metabolic control.

RESULTS

Working memory performance was 0.32 z-scores (95% CI 0.06, 0.58) lower, on average, in participants with PKU compared to participants without PKU, and this difference was not modified by total choline intake (F[1,75] = 0.85, p = 0.36). However, in a subgroup with complete historical blood Phe data, increased total choline intake was related to improved working memory outcomes among participants with well controlled PKU (Phe = 360 µmol/L) after adjusting for intellectual ability and mid-childhood Phe concentrations (average change in working memory per 100 mg change in choline = 0.11; 95% CI 0.02, 0.20; p = 0.02). There also was a trend, albeit nonsignificant (p = 0.10), for this association to be attenuated with increased Phe concentrations.

CONCLUSIONS

Clinical monitoring of choline intake is essential for all individuals with PKU but may have important implications for working memory functioning among patients with good metabolic control. Results from this study should be confirmed in a larger controlled trial in people living with PKU.

CSF Aβ42 and tau biomarkers in cognitively unimpaired Aβ- middle-aged and older APOE ε4 carriers

This study aimed to determine the relationship between the apolipoprotein E (APOE) ε4 allele and cerebrospinal fluid (CSF) and neuroimaging biomarkers of Alzheimer's disease, and cognition in cognitively unimpaired (CU) middle-aged adults (n = 82; M_age = 58.2), and in Aβ- CU older adults (n = 71; M_age = 71.8). Aβ- CU middle-aged ε4 carriers showed lower CSF Aβ₄₂ levels, higher levels of CSF total tau (t-tau) and neurofilament light (NfL), and poorer cognitive performance compared to noncarriers (Cohen's d: 0.30-0.56). In Aβ- CU older adults, ε4 carriers also had lower CSF Aβ₄₂ levels and higher levels of CSF t-tau and p-tau181, compared to noncarriers (Cohen's d: 0.65-0.74). In both Aβ- middle-aged and older adults, hippocampal and total brain volume were equivalent between ε4 carriers and noncarriers. In Aβ- CU middle-aged adults, APOE ε4 is associated with decreased levels of Aβ, increased tau and NfL, and poorer cognition. Similar relationships were observed in Aβ- CU older adults. These results have implications for understanding clinicopathological relationships between APOE ε4 and the emergence of cognitive and biomarker abnormalities in Aβ- adults.

The effect of bilingualism on executive functions when languages are similar: a comparison between Hungarian-Serbian and Slovak-Serbian young adult bilinguals

Among the factors argued to contribute to a bilingual advantage in executive function (EF), the combination of languages spoken by the bilingual is often overlooked. In this study, we explored the role of language similarity on memory and EF task by comparing performance of three groups of young adults-Hungarian-Serbian and Slovak-Serbian early balanced bilinguals, and Serbian-speaking monolinguals. Slovak is typologically related to Serbian, which are both Slavic, in contrast to Hungarian, which is Finno-Ugric. On the computerized tasks from the CANTAB battery (CANTAB Cognition, 2016, www.cantab.com), differences between monolinguals and bilinguals emerged on the EF tasks: Stockings of Cambridge (SOC) and Attentional Set Shifting (AST), but not the memory tasks: Delayed Matching to Sample (DMS), Paired Associate Learning (PAL), Spatial Working Memory (SWM). Both Hungarian-Serbian and Slovak-Serbian bilinguals outperformed the monolinguals on the more difficult SOC tasks, solved using more than a minimally required number of moves. This is in line with reports that bilinguals perform better under more complex conditions that require more monitoring and switching. However, bilinguals speaking Hungarian and Serbian spent less time preparing to execute the simpler SOC tasks, which can be solved in a minimum of two or three moves; they also exhibited reduced local switching cost and were faster overall on AST than both the Slovak-Serbian bilinguals and Serbian monolinguals. The advantageous performance of speakers of the typologically unrelated languages in our study suggests that these bilinguals may have more efficient attention switching and inhibition systems than bilinguals who speak typologically similar languages.

Remote testing in Abbiategrasso (RTA): results from a counterbalanced cross-over study on direct-to-home neuropsychology with older adults

BACKGROUND

The SARS-CoV-2 pandemic forced to rethink teleneuropsychology, since neuropsychological assessments started to be performed by phone or videoconference, with personal devices and without direct assistance from the clinician, a practice called "Direct-To-Home NeuroPsychology" (DTH-NP).

AIMS

The present study, employing a counterbalanced cross-over design, was aimed at evaluating (1) the feasibility and (2) the acceptability of DTH-NP in Italian older adults without previously diagnosed neurocognitive disorder, (3) the comparability between remote and face-to-face administration of selected neuropsychological tests.

METHODS

Fifty-eight community-dwelling older adults (65-85 years) were randomly assigned to one of two groups performing a complete neuropsychological assessment remotely (via phone call and videoconference) and face-to-face, in a counterbalance order, 8 weeks apart. The study recruitment rate was calculated, and the number of uncompleted tests and acceptability questionnaire responses were compared between the two administration modalities. Comparability was defined as good reliability of DTH-NP (intraclass correlation coefficient) and agreement between remote and face-to-face scores (Bland-Altman plots).

RESULTS

Recruitment rate was 81%, with a preference for telephonic contact (79%). The acceptability analysis did not reveal any issues related to the DTH-NP assessment, even if most participants would rather repeat it face-to-face. Tests assessing short-term memory, language, and reasoning showed good comparability.

DISCUSSION AND CONCLUSION

Our results point out to a good recruitment rate in a DTH-NP study in an Italian population of older adults (mean age = 80), satisfying acceptability of DTH-NP and remote-face-to-face comparability of certain verbally mediated tests. Further studies including larger samples in videoconference modality, and outpatients, could better clarify its strengths and limits.

Remote group therapies for cognitive health in schizophrenia-spectrum disorders: Feasible, acceptable, engaging

Severe cognitive impairments and cognitive distortions are core to schizophrenia-spectrum disorders (SSDs) and are associated with deteriorated social functioning. Despite well-established efficacy of group psychosocial therapies targeting cognitive health in SSDs, dissemination of these programs remains limited. Remote delivery offers a promising strategy for increasing the programs' accessibility. Yet, little research has evaluated group therapies for cognitive health delivered in this way. Thus, we aimed to assess, from participants' and therapists' perspectives, the feasibility, acceptability, as well as levels and process of engagement in a videoconference delivery of group psychosocial therapies for SSD patients' cognitive health. Participants, outpatients, attended Action Based Cognitive Remediation or Metacognitive Training, both adapted for videoconference. Then, participants and therapists completed post-therapy questionnaires. Of the 28 participants attending at least one session, 75% completed more than half of sessions and seven dropped out. Technology did not appear to significantly hinder participation in the programs. All completing participants reported a positive experience with therapy, 67% were not bothered by the distance from the therapist, and 77% trusted that the information shared was kept confidential. Therapist-rated levels of attention M = 7.5/9 (SD = 1.04), participation M = 6.91/9 (SD = 1.32), and social interactions M = 5.31/9 (SD = 1.96) were satisfactory. Nonetheless, participants indicated that they would have appreciated more social interactions with group members. These positive results validate the earliest stage in the implementation process for remote group therapies targeting cognitive health in SSDs. Remote delivery promises to improve access to therapies targeting cognitive health and, ultimately, facilitate functional recovery for SSD patients.

Web-Based Independent Versus Laboratory-Based Stop-Signal Task Performance: Within-Subjects Counterbalanced Comparison Study

BACKGROUND

Considered a facet of behavioral impulsivity, response inhibition facilitates adaptive and goal-directed behavior. It is often assessed using the Stop-Signal Task (SST), which is presented on stand-alone computers under controlled laboratory conditions. Sample size may consequently be a function of cost or time and sample diversity constrained to those willing or able to attend the laboratory. Statistical power and generalizability of results might, in turn, be impacted. Such limitations may potentially be overcome via the implementation of web-based testing.

OBJECTIVE

The aim of this study was to investigate if there were differences between variables derived from a web-based SST when it was undertaken independently-that is, outside the laboratory, on any computer, and in the absence of researchers-versus when it was performed under laboratory conditions.

METHODS

We programmed a web-based SST in HTML and JavaScript and employed a counterbalanced design. A total of 166 individuals (mean age 19.72, SD 1.85, range 18-36 years; 146/166, 88% female) were recruited. Of them, 79 undertook the independent task prior to visiting the laboratory and 78 completed the independent task following their laboratory visit. The average time between SST testing was 3.72 (SD 2.86) days. Dependent samples and Bayesian paired samples t tests were used to examine differences between laboratory-based and independent SST variables. Correlational analyses were conducted on stop-signal reaction times (SSRT).

RESULTS

After exclusions, 123 participants (mean age 19.73, SD 1.97 years) completed the SST both in the laboratory and independently. While participants were less accurate on go trials and exhibited reduced inhibitory control when undertaking the independent-compared to the laboratory-based-SST, there was a positive association between the SSRT of each condition (r=.48; P<.001; 95% CI 0.33-0.61).

CONCLUSIONS

Findings suggest a web-based SST, which participants undertake on any computer, at any location, and in the absence of the researcher, is a suitable measure of response inhibition.

Cognitive Training with Neurofeedback Using fNIRS Improves Cognitive Function in Older Adults

This study examined the effects of a 4-week cognitive training program with neurofeedback (CT-NF) among 86 healthy adults (M = 66.34 years, range 54-84) randomized to either a treatment (app-based ABC games) or control (Tetris) group. Participants completed seven cognitive assessments, pre- and post-intervention, and measured their cortical brain activity using a XB-01 functional near-infrared spectroscopy (fNIRS) brain sensor, while engaging in CT-NF. The treatment (ABC) group showed significant (pre/post-intervention) improvements in memory (MEM), verbal memory (VBM), and composite cognitive function, while the control group did not. However, both groups showed significant improvements in processing speed (PS) and executive function (EF). In line with other studies, we found that strength of cortical brain activity (measured during CT-NF) was associated with both cognitive (pre and post) and game performance. In sum, our findings suggest that CT-NF and specifically ABC exercises, confer improved cognition in the domains of MEM, VBM, PS, and EF.