Remote cognitive assessment in severe mental illness: a scoping review

Mobile sensing-based depression severity assessment in participants with heterogeneous mental health conditions

Mobile sensing-based depression severity assessment could complement the subjective questionnaires-based assessment currently used in practice. However, previous studies on mobile sensing for depression severity assessment were conducted on homogeneous mental health condition participants; evaluation of possible generalization across heterogeneous groups has been limited. Similarly, previous studies have not investigated the potential of free-living audio data for depression severity assessment. Audio recordings from free-living could provide rich sociability features to characterize depressive states. We conducted a study with 11 healthy individuals, 13 individuals with major depressive disorder, and eight individuals with schizoaffective disorders. Communication logs and location data from the participants' smartphones and continuous audio recordings of free-living from a wearable audioband were obtained over a week for each participant. The depression severity prediction model trained using communication log and location data features had a root mean squared error (rmse) of 6.80. Audio-based sociability features further reduced the rmse to 6.07 (normalized rmse of 0.22). Audio-based sociability features also improved the F1 score in the five-class depression category classification model from 0.34 to 0.46. Thus, free-living audio-based sociability features complement the commonly used mobile sensing features to improve depression severity assessment. The prediction results obtained with mobile sensing-based features are better than the rmse of 9.83 (normalized rmse of 0.36) and the F1 score of 0.25 obtained with a baseline model. Additionally, the predicted depression severity had a significant correlation with reported depression severity (correlation coefficient of 0.76, p < 0.001). Thus, our work shows that mobile sensing could model depression severity across participants with heterogeneous mental health conditions, potentially offering a screening tool for depressive symptoms monitoring in the broader population.

Measuring Cognitive Impairments Associated With Schizophrenia in Clinical Practice: Overview of Current Challenges and Future Opportunities

BACKGROUND

Cognitive impairment associated with schizophrenia (CIAS) negatively impacts daily functioning, quality of life, and recovery, yet effective pharmacotherapies and practical assessments for clinical practice are lacking. Despite the pivotal progress made with establishment of the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) Consensus Cognitive Battery (MCCB) for clinical research, implementation of the full MCCB is too time-consuming and cost-ineffective for most clinicians in clinical practice.

STUDY DESIGN

Here we discuss current assessments in relation to delivery format (interview-based and performance-based), validity, ease of use for clinicians and patients, reliability/reproducibility, cost-effectiveness, and suitability for clinical implementation. Key challenges and future opportunities for improving cognitive assessments are also presented.

STUDY RESULTS

Current assessments that require 30 min to complete would have value in clinical settings, but the associated staff training and time required might preclude their application in most clinical settings. Initial profiling of cognitive deficits may require about 30 min to assist in the selection of evidence-based treatments; follow-up monitoring with brief assessments (10-15 min in duration) to detect treatment-related effects on global cognition may complement this approach. Guidance on validated brief cognitive tests for the strategic monitoring of treatment effects on CIAS is necessary.

CONCLUSIONS

With increased advancements in technology-based and remote assessments, development of validated formats of remote and in-person assessment, and the necessary training models and infrastructure required for implementation, are likely to be of increasing clinical relevance for future clinical practice.

Integration of sex/gender and utilization of ecological Momentary assessment of cognition in clinical populations: A scoping review

Objectives: We aimed to describe the methods of smartphone-based cognitive ecological momentary assessment designs in clinical populations, with an intention to evaluate how the role of sex and/or gender has been considered in the design and analyses, particularly including female-specific physiology. Methods: This scoping review was conducted based on JBI scoping review methodology. On March 2nd, 2023, we searched for literature across four databases. Screening of the results and data extraction were conducted in duplicate according to the a priori methods in the pre-registered protocol. Results: 31 articles were included in this review. Participants ranged in age from 15-85 years old with various clinical disorders. Prompts were given between 1-7 times per day for 7-84 days. Executive function was the most frequently assessed cognitive domain. Over half the studies (n = 17, 55%) did not investigate the effects of sex and/or gender, and only one study considered the impact of hormonal therapy. Many studies (n = 14, 45%) used sex and gender interchangeably or incorrectly. Conclusions: Studies varied in design, with heterogeneity in the reporting of methodological information. The lack of attention to sex/gender on neuropsychological outcomes can lead to confusion and contradiction regarding its potential impact on cognition in clinical populations. This may hinder the identification of effective interventions for those assigned female at birth who have been overlooked or considered indistinguishable from their male counterparts. Given the well-documented impact of sex/gender on cognition, it is essential that future neuropsychological research, especially EMA-based studies, prioritize investigating sex/gender to ensure better outcomes for all.

Strategies for Achieving Better Cognitive Health in Individuals with Schizophrenia Spectrum: A Focus on the Canadian Landscape: Stratégies pour atteindre une meilleure santé cognitive chez les personnes souffrant du spectre de la schizophrénie : un regard sur le paysage canadien

BACKGROUND

Schizophrenia spectrum disorders (SSDs) are a group of psychiatric disorders characterized by positive and negative symptoms as well as cognitive impairment that can significantly affect daily functioning.

METHOD

We reviewed evidence-based strategies for improving cognitive function in patients with SSDs, focusing on the Canadian landscape.

RESULTS

Although antipsychotic medications can address the positive symptoms of SSDs, cognitive symptoms often persist, causing functional impairment and reduced quality of life. Moreover, cognitive function in patients with SSDs is infrequently assessed in clinical practice, and evidence-based recommendations for addressing cognitive impairment in people living with schizophrenia are limited. While cognitive remediation (CR) can improve several domains of cognitive function, most individuals with SSDs are currently not offered such an intervention. While the development of implementation strategies for CR is underway, available and emerging pharmacological treatments may help overcome the limited capacity for psychosocial approaches. Furthermore, combining pharmacological with non-pharmacological interventions may improve outcomes compared to pharmacotherapy or CR alone.

CONCLUSION

This review highlights the challenges and discusses the potential solutions related to the assessment and management of cognitive impairment to help mental health-care practitioners better manage cognitive impairment and improve daily functioning in individuals with SSDs.

CLINICAL AND COGNITIVE PHENOTYPING OF COPY NUMBER VARIANTS PATHOGENIC FOR NEURODEVELOPMENTAL DISORDERS FROM A MULTI-ANCESTRY BIOBANK

Background

Rare copy number variants (CNVs) are pathogenic for neurodevelopmental disorders (NDDs) and effect neurocognitive impairment. In aggregate, NDD CNVs may present in up to 2% of population cohorts with implications for neuropsychiatric disease risk and cognitive health. However, analyses of NDD CNVs in biobanks or population cohorts have been hindered by limited clinical or cognitive phenotypes, and a lack of ancestral diversity. In the current proof-of-concept study, NDD CNV carriers were recontacted from BioMe, a multi-ancestry biobank derived from the Mount Sinai healthcare system, to enable 'deep phenotyping' beyond electronic health record outcomes.

Methods

From BioMe biobank, 892 adult participants were recontacted, including 335 harboring NDD CNVs, 217 with schizophrenia and 340 neurotypical controls as comparators. Clinical and cognitive assessments were administered to each recruited participant.

Results

Seventy-three participants completed study assessments (mean age=48.8 years; 66% female; 36% African, 26% European, 34% Hispanic), or 8% of the recontacted subset, including 30 NDD CNV carriers across 15 loci. Among NDD CNV carriers, assessments indicated 40% with mood and anxiety disorders, 30% with learning disorders, and 13% with a history of special education. NDD CNV carriers were significantly cognitively impaired compared to controls on digit span backwards (Beta=-1.76, FDR=0.04) and digit span sequencing (Beta=-2.01, FDR=0.04).

Conclusions

Feasibility of "recall-by-genotype" from a multi-ancestry biobank was established for NDD CNV carriers, along with comparator groups. The current study corroborated past reports of NDD CNVs effects of cognitive impairment, while elucidating clinical phenotypes for recalled individuals. Future "recall-by-genotype" studies may further facilitate clinical characterization of disease-relevant genomic variants.

Digital phenotyping correlates of mobile cognitive measures in schizophrenia: A multisite global mental health feasibility trial

Traditional cognitive assessments in schizophrenia are time-consuming and necessitate specialized training, making routine evaluation challenging. To overcome these limitations, this study investigates the feasibility and advantages of utilizing smartphone-based assessments to capture both cognitive functioning and digital phenotyping data and compare these results to gold standard measures. We conducted a secondary analysis of data from 76 individuals with schizophrenia, who were recruited across three sites (one in Boston, two in India) was conducted. The open-source mindLAMP smartphone app captured digital phenotyping data and Trails A/B assessments of attention / memory for up to 12 months. The smartphone-cognitive tasks exhibited potential for normal distribution and these scores showed small but significant correlations with the results from the Brief Assessment of Cognition in Schizophrenia, especially the digital span and symbol coding tasks (r2 = 0.21). A small but significant correlation (r2 = 0.29) between smartphone-derived cognitive scores and health-related behaviors such as sleep duration patterns was observed. Smartphone-based cognitive assessments show promise as cross-cultural tools that can capture relevant data on momentary states among individuals with schizophrenia. Cognitive results related to sleep suggest functional applications to digital phenotyping data, and the potential of this multimodal data approach in research.

Tablet-Based Cognitive and Eye Movement Measures as Accessible Tools for Schizophrenia Assessment: Multisite Usability Study

BACKGROUND

Schizophrenia is a complex mental disorder characterized by significant cognitive and neurobiological alterations. Impairments in cognitive function and eye movement have been known to be promising biomarkers for schizophrenia. However, cognitive assessment methods require specialized expertise. To date, data on simplified measurement tools for assessing both cognitive function and eye movement in patients with schizophrenia are lacking.

OBJECTIVE

This study aims to assess the efficacy of a novel tablet-based platform combining cognitive and eye movement measures for classifying schizophrenia.

METHODS

Forty-four patients with schizophrenia, 67 healthy controls, and 41 patients with other psychiatric diagnoses participated in this study from 10 sites across Japan. A free-viewing eye movement task and 2 cognitive assessment tools (Codebreaker task from the THINC-integrated tool and the CognitiveFunctionTest app) were used for conducting assessments in a 12.9-inch iPad Pro. We performed comparative group and logistic regression analyses for evaluating the diagnostic efficacy of the 3 measures of interest.

RESULTS

Cognitive and eye movement measures differed significantly between patients with schizophrenia and healthy controls (all 3 measures; P<.001). The Codebreaker task showed the highest classification effectiveness in distinguishing schizophrenia with an area under the receiver operating characteristic curve of 0.90. Combining cognitive and eye movement measures further improved accuracy with a maximum area under the receiver operating characteristic curve of 0.94. Cognitive measures were more effective in differentiating patients with schizophrenia from healthy controls, whereas eye movement measures better differentiated schizophrenia from other psychiatric conditions.

CONCLUSIONS

This multisite study demonstrates the feasibility and effectiveness of a tablet-based app for assessing cognitive functioning and eye movements in patients with schizophrenia. Our results suggest the potential of tablet-based assessments of cognitive function and eye movement as simple and accessible evaluation tools, which may be useful for future clinical implementation.

Detecting mild cognitive impairment remotely with the modified memory impairment screen by telephone

The original Memory Impairment Screen by Telephone (MIST) was designed to identify individuals with dementia but was relatively ineffective for identification of less severe impairment observed in mild cognitive impairment (MCI). We expanded the original MIST to create a modified instrument (mMIST) with greater sensitivity to less severe memory impairment. Older men and women with subjective cognitive decline were assessed by phone with the mMIST and subsequently classified independently with MCI or non-pathological cognitive decline. Participants with MCI produced lower scores on the mMIST than did participants without MCI, 10.8 ± 2.7 vs 13.3 ± 1.3, t = 5.68, p < 0.001, and performance on the mMIST predicted performances on the California Verbal Learning Test (CVLT), Verbal Paired Associate Learning Test (VPAL), Montreal Cognitive Assessment (MoCA) total score, and MoCA memory index score, p < 0.001. Receiver operating characteristic (ROC) analyses identified the optimal cut score on the mMIST to distinguish participants with and without MCI with Sensitivity = 73.1%, Specificity = 79.1%, and AUC = 0.79. Predictive values for distinguishing the amnestic form of MCI (aMCI) from non-amnestic MCI were Sensitivity = 81.8%, Specificity = 30%, and AUC = 0.82. These findings indicate that the mMIST is a valid screening instrument for identifying MCI. It can be administered remotely at low cost and low participant burden. Also, the mMIST has potential utility for remote cross-sectional and longitudinal evaluation in research and clinical contexts. Further investigation is indicated to corroborate its utility for assessment of aging patients and research participants.

Remote assessment of the Penn computerised neurocognitive battery in individuals with 22q11.2 deletion syndrome

BACKGROUND

Neurocognitive functioning is an integral phenotype of 22q11.2 deletion syndrome relating to severity of psychopathology and outcomes. A neurocognitive battery that could be administered remotely to assess multiple cognitive domains would be especially beneficial to research on rare genetic variants, where in-person assessment can be unavailable or burdensome. The current study compares in-person and remote assessments of the Penn computerised neurocognitive battery (CNB).

METHODS

Participants (mean age = 17.82, SD = 6.94 years; 48% female) completed the CNB either in-person at a laboratory (n = 222) or remotely (n = 162).

RESULTS

Results show that accuracy of CNB performance was equivalent across the two testing locations, while slight differences in speed were detected in 3 of the 11 tasks.

CONCLUSIONS

These findings suggest that the CNB can be used in remote settings to assess multiple neurocognitive domains.

Assessment of Cognitive Impairment and Related Factors Among Elderly People in Jordan

Background

With an increase in elderly people, it is essential to address the issue of cognitive impairment and support healthy aging. This study aimed to assess cognitive impairment and factors associated with it among older adults.

Materials and Methods

A cross-sectional study was carried out in different catchment areas within the Jerash governorate in the north of Jordan. The Elderly Cognitive Assessment Questionnaire (ECAQ) and a household face-to-face interview were used to collect data from 220 older adult participants aged 60 years and more. Descriptive statistics were conducted to describe the study variables. Correlation tests were applied to find associations between them. Logistic regression analysis was applied, with a minimum significance level (p < 0.05).

Results

About 9.10% of the older adults had cognitive impairment. Cognitive impairment was correlated with age, self-perceived health, hypertension, stroke, and mental illness. The primary predictors of cognitive impairment were age [odds ratio (OR) =1.07 (1.01-1.14), p = 0.001] and stroke [OR = 10.92 (1.44-82.85), p = 0.001].

Conclusions

While many factors were correlated with cognitive impairment, the strongest predictors of cognitive impairment were age and stroke.

Psychometric validation and clinical correlates of an experiential foraging task

Measuring the function of decision-making systems is a central goal of computational psychiatry. Individual measures of decisional function could be used to describe neurocognitive profiles that underpin psychopathology and offer insights into deficits that are shared across traditional diagnostic classes. However, there are few demonstrably reliable and mechanistically relevant metrics of decision making that can accurately capture the complex overlapping domains of cognition whilst also quantifying the heterogeneity of function between individuals. The WebSurf task is a reverse-translational human experiential foraging paradigm which indexes naturalistic and clinically relevant decision-making. To determine its potential clinical utility, we examined the psychometric properties and clinical correlates of behavioural parameters extracted from WebSurf in an initial exploratory experiment and a pre-registered validation experiment. Behaviour was stable over repeated administrations of the task, as were individual differences. The ability to measure decision making consistently supports the potential utility of the task in predicting an individual's propensity for response to psychiatric treatment, in evaluating clinical change during treatment, and in defining neurocognitive profiles that relate to psychopathology. Specific aspects of WebSurf behaviour also correlate with anhedonic and externalising symptoms. Importantly, these behavioural parameters may measure dimensions of psychological variance that are not captured by traditional rating scales. WebSurf and related paradigms might therefore be useful platforms for computational approaches to precision psychiatry.

Objective cognitive functioning in patients with stress-related disorders: a cross-sectional study using remote digital cognitive testing

BACKGROUND

Patients with stress-related mental disorders often report cognitive impairment, but studies investigating objective cognitive impairment in patients with stress-related disorders have produced inconsistent findings.

AIM

The primary aim of this study was to investigate objective cognitive functioning in patients diagnosed with the stress-related disorders adjustment disorder or exhaustion disorder, compared to a healthy normative group. Secondary aims were to conduct subgroup analyses of cognitive functioning between the diagnostic groups and explore associations between self-reported symptoms and cognitive functioning.

METHODS

Cognitive test results on a digitally self-administered cognitive test battery from 266 patients (adjustment disorder, n = 131; exhaustion disorder, n = 135) were cross-sectionally compared with results from a healthy normative group (N = 184 to 692) using one-tailed t-tests. ANOVAs were conducted for subgroup analyses, and regression analyses for associations between self-reported symptoms and cognitive functioning. Effect sizes were calculated.

RESULTS

Patients performed significantly worse than the normative group on all measures with small to moderate effect sizes ranging from d = -.13 to -.57. Those diagnosed with exhaustion disorder performed worse than norms on more measures than did patients with adjustment disorder, but no significant differences between diagnostic groups were found on any measure. Self-reported memory impairment was weakly associated with one of two memory measures. No clear associations between self-reported burnout symptoms and objective cognitive functioning were found.

CONCLUSIONS

This study adds to the literature indicative of small to moderate objective cognitive impairments in patients diagnosed with stress-related mental disorders. Further exploration into mechanisms of cognitive functioning in different populations is needed for development of theoretical models that may explain the weak correlation between self-reported symptoms and objective measures.

TRIAL REGISTRATION

ClinicalTrial.gov: NCT04797273. Trial registration date 15 March 2021. This study was also pre-registered on Open Science Framework (osf.io) with https://doi.org/10.17605/OSF.IO/TQXZV .

Neurocognitive and self-reported psychosocial and behavioral functioning in siblings of individuals with neurodevelopmental conditions: a study using remote self-administered testing

OBJECTIVE

This study compared and explored the neurocognitive profiles of siblings of persons with and without neurodevelopmental conditions (NDCs) and associations between objective test performance and self-reported psychosocial functioning.

METHODS

Siblings of persons with and without NDCs (64 NDC and 64 control siblings; mean age 19.88 years, range 11-27 years, 73.44% female, 75.78% White Caucasian) completed self-report questionnaires and self-administered computerized neurocognitive tests of executive functioning (EF). Using Bayesian analyses, we examined cross-sectional associations between self-reported psychosocial functioning and cognitive test performance, and predictors of EF over 15 months.

RESULTS

NDC siblings had poorer working memory, inhibition, attention, and shifting compared to controls, as measured by experimental paradigms on the backward Corsi span, N-Back 2-back task, Stop Signal Task, Sustained Attention to Response Task, and the Wisconsin Card Sorting Test (effect size δ ranging 0.49 to 0.64). Bayesian cross-sectional networks revealed negative emotion reactivity and working memory difficulties were central to the NDC sibling network. Over 15 months, poorer EF (k low test scores) was predicted by negative emotion reactivity, sleep problems, and anxiety, over and above effects of age and subclinical autistic and ADHD traits. Siblings of autistic individuals and persons with fetal alcohol spectrum disorder had higher rates of neurocognitive and psychiatric difficulties than other NDCs and controls (Bayes factors >20).

CONCLUSIONS

Neurocognitive difficulties were associated with transdiagnostic vulnerability to poorer wellbeing in NDC siblings. These findings demonstrate the feasibility of remote online cognitive testing and highlight the importance of individualized prevention and intervention for NDC siblings.

A Patient-Clinician Discussion of Current Challenges in Schizophrenia Part 1: Addressing Daily Functioning and Cognitive Impairments Associated with Schizophrenia [Podcast]

Dr John M. Kane discusses cognitive impairments in schizophrenia with fellow expert Dr Philip D. Harvey and patient advocate and mental health clinician, Mr Carlos A. Larrauri, who was diagnosed with schizophrenia. The podcast aims to raise awareness of the unmet need to address cognitive impairments associated with schizophrenia (CIAS) as well as the challenges/opportunities faced by patients and clinicians regarding assessments and treatments. The authors emphasize the importance of a treatment focus on daily functioning, in parallel with cognitive symptoms, to mitigate impairments and improve overall outcomes. Mr Larrauri presents the patient perspective and shares his experiences of how psychosocial support and cognitive training can benefit recovery and help patients achieve their goals.

Probing the Association between Cognition, Suicidal Behavior and Tryptophan Metabolism in a Sample of Individuals Living with Bipolar Disorder: A Secondary Analysis

Background and Objectives: Alterations in hot cognition and in the tryptophan metabolism through serotonin (5-HT) and kynurenine (KYN) pathways have been associated with an increased risk of suicidal behavior. Here, we aim at probing the association between Stroop test performances and tryptophan pathway components in a sample of individuals with bipolar disorder (BD). Materials and Methods: We explored the association between the Emotion Inhibition Subtask (EIS) performances of the Brief Assessment of Cognition for Affective Disorders (BAC-A) and plasmatic levels of 5-hydroxytriptophan (5-HTP), 5-HT, KYN, 3-hydroxykynurenine (3-HK), quinolinic acid (QA), and kynurenic acid (KYNA) among subjects reporting lifetime suicide ideation (LSI) vs. non-LSI and subjects reporting lifetime suicide attempts (LSA) vs. non-LSA. Results: In a sample of 45 subjects with BD, we found a statistically significant different performance for LSA vs. non-LSA in the color naming (CN) and neutral words (NW) EIS subtasks. There was a significant association between CN performances and plasma 5-HTP levels among LSI and LSA subjects but not among non-LSI or non-LSA. Conclusions: In our sample, patients with LSA and LSI presented lower performances on some EIS subtasks compared to non-LSA and non-LSI. Moreover, we found an inverse correlation between plasma 5-HTP concentration and some EIS performances in LSA and LSI but not among non-LSA or non-LSI. This may represent an interesting avenue for future studies probing this complex association.

Smartphone digital phenotyping, surveys, and cognitive assessments for global mental health: Initial data and clinical correlations from an international first episode psychosis study

Objective

To examine feasibility and acceptability of smartphone mental health app use for symptom, cognitive, and digital phenotyping monitoring among people with schizophrenia in India and the United States.

Methods

Participants in Boston, USA and Bhopal and Bangalore, India used a smartphone app to monitor symptoms, play cognitive games, access relaxation and psychoeducation resources and for one month, with an initial clinical and cognitive assessment and a one-month follow-up clinical assessment. Engagement with the app was compared between study sites, by clinical symptom severity and by cognitive functioning. Digital phenotyping data collection was also compared between three sites.

Results

By Kruskal-Wallis rank-sum test, we found no difference between app activities completed or digital phenotyping data collected across the three study sites. App use also did not correlate to clinical or cognitive assessment scores. When using the app for symptom monitoring, preliminary findings suggest app-based assessment correlate with standard cognitive and clinical assessments.

Conclusions

Smartphone app for symptom monitoring and digital phenotyping for individuals with schizophrenia appears feasible and acceptable in a global context. Clinical utility of this app for real-time assessments is promising, but further research is necessary to determine the long-term efficacy and generalizability for serious mental illness.