Audio-digital recordings for surveillance in clinical trials of major depressive disorder

Use of video-recordings of site-based interviews for quality assurance in a study of subjects with schizophrenia and persistent negative symptoms

Site-independent ratings derived from audio-digital recordings of site-based interviews are often used for quality assurance monitoring to affirm ratings reliability in CNS clinical trials. The present study of subjects with schizophrenia and persistent negative symptoms used video instead of audio recordings of site-based interviews and thereby facilitated visual observation of the subject by the remote rater. "Paired" site-independent scores of the Positive and Negative Syndrome Scale (PANSS) and Brief Negative Symptom Scale (BNSS) were obtained from video-recordings of site-based interviews. The intraclass correlation between site-based and paired site-independent ratings was r = 0.839 for the total PANSS scores (n = 1006) and r = 0.871 for the total BNSS scores (n = 892); <5 % of paired scores deviated outside the acceptable confidence intervals. Ratings "outliers" were identified and remediated. We examined the pattern of paired scoring deviations for the BNSS, total PANSS, PANSS symptom subscales, and the Marder negative symptom factor. Each metric revealed a bidirectional pattern of scoring deviations such that mean site-based ratings were higher than site-independent ratings when symptom severity was high but lower than site-independent ratings when symptom severity was low. The pattern of bidirectional paired scoring deviations observed in this analysis has previously been noted in paired ratings analyses of subjects experiencing an acute exacerbation of psychosis in schizophrenia and major depressive disorder as well. The bidirectional pattern may reflect inherent differences between live ratings and remotely scored recorded ratings. This analysis affirms the utility of video-recordings of site-based ratings for surveillance in trials with subjects with schizophrenia and persistent negative symptoms.

A qualitative investigation of the Montgomery-Åsberg depression rating scale: discrepancies in rater perceptions and data trends in remote assessments of rapid-acting antidepressants in treatment resistant depression

Introduction

Despite the development of many successful pharmaceutical interventions, a significant subset of patients experience treatment-resistant depression (TRD). Ketamine and its derivatives constitute a novel therapeutic approach to treat TRD; however, standard tools, such as the Montgomery-Åsberg Depression Rating Scale (MADRS) are still being used to measure symptoms and track changes.

Methods

The aim of this study was to review item-level differences between rate of data change (MADRS score) and rater-weighted perception of the most useful items for assessing change in symptoms while remotely conducting the 10-item version of the MADRS in TRD in a clinical trial of rapid-acting antidepressants. Two studies of rapid-acting antidepressants in the treatment of TRD were used to identify item-scoring trends when MADRS is administered remotely and repeatedly (733 subjects across 10 visits). Scoring trends were evaluated in tandem to a rater survey completed by 75 raters. This was completed to gain insight on MADRS items' perceived level of helpfulness when assessing change of symptoms in rapid-acting antidepressant trials.

Results

MADRS items 'Reduced sleep', 'Apparent sadness', and 'Pessimistic thoughts' were found to have the greatest average data change by visit, while raters ranked 'Reported sadness', 'Lassitude' and 'Apparent sadness' as the most helpful items when assessing symptom change.

Discussion

The diversion between rate of data-change ranking and rater perception of helpfulness could be related to difficulty in assessing specific items, to the novel treatment itself, and/or to the sensitivity to symptom change to which raters are accustomed in traditional antidepressant treatments.

Current and Emerging Technologies to Address the Placebo Response Challenge in CNS Clinical Trials: Promise, Pitfalls, and Pathways Forward

Excessive placebo response rates have long been a major challenge for central nervous system (CNS) drug discovery. As CNS trials progressively shift toward digitalization, decentralization, and novel remote assessment approaches, questions are emerging about whether innovative technologies can help mitigate the placebo response. This article begins with a conceptual framework for understanding placebo response. We then critically evaluate the potential of a range of innovative technologies and associated research designs that might help mitigate the placebo response and enhance detection of treatment signals. These include technologies developed to directly address placebo response; technology-based approaches focused on recruitment, retention, and data collection with potential relevance to placebo response; and novel remote digital phenotyping technologies. Finally, we describe key scientific and regulatory considerations when evaluating and selecting innovative strategies to mitigate placebo response. While a range of technological innovations shows potential for helping to address the placebo response in CNS trials, much work remains to carefully evaluate their risks and benefits.

Patterns of activity correlate with symptom severity in major depressive disorder patients

Objective measures, such as activity monitoring, can potentially complement clinical assessment for psychiatric patients. Alterations in rest-activity patterns are commonly encountered in patients with major depressive disorder. The aim of this study was to investigate whether features of activity patterns correlate with severity of depression symptoms (evaluated by Montgomery-Åsberg Rating Scale (MADRS) for depression). We used actigraphy recordings collected during ongoing major depressive episodes from patients not undergoing any antidepressant treatment. The recordings were acquired from two independent studies using different actigraphy systems. Data was quality-controlled and pre-processed for feature extraction following uniform procedures. We trained multiple regression models to predict MADRS score from features of activity patterns using brute-force and semi-supervised machine learning algorithms. The models were filtered based on the precision and the accuracy of fitting on training dataset before undergoing external validation on an independent dataset. The features enriched in the models surviving external validation point to high depressive symptom severity being associated with less complex activity patterns and stronger coupling to external circadian entrainers. Our results bring proof-of-concept evidence that activity patterns correlate with severity of depressive symptoms and suggest that actigraphy recordings may be a useful tool for individual evaluation of patients with major depressive disorder.

Site-independent confirmation of primary site-based PANSS ratings in a schizophrenia trial

Blinded, site-independent (remote) ratings from audio-digital recordings of site-based Positive and Negative Syndrome Scale (PANSS) interviews were obtained in a 5-week, randomized, double-blinded study assessing the safety, tolerability, and efficacy of KarXT (a fixed combination of xanomeline and trospium chloride) in hospitalized adults with schizophrenia experiencing an acute exacerbation of psychosis (EMERGENT-1; ClinicalTrials.gov identifier: NCT3697252). The blinded site-independent raters had no knowledge of site location, study visit, drug vs. placebo assignment, or any treatment emergent adverse events (TEAEs). Concordance analyses of 561 paired site-based and site-independent PANSS ratings across all visits revealed a high correlation (ICC = 0.775). Paired scoring differences were positively correlated with the PANSS total score (Spearman's rho = 0.37, p < 0.0001). Paired PANSS scores were available from 148 subjects at both the baseline and end of study visits (KarXT = 72, Placebo = 76). Site-based PANSS total scores (primary aim) revealed a significantly greater improvement from baseline in the KarXT group compared to the placebo group (p < 0.0001). The blinded site-independent PANSS total scores derived from listening to and scoring the recorded site-based PANSS interviews replicated this finding (p < 0.001) and yielded an overall predictive value of 85.1% for matching the site-based response/non-response outcomes. TEAE's have the potential to "unblind" site-based ratings. In this study, the site-independent raters were blinded to TEAEs, affirmed the site-based PANSS ratings, and mitigated concerns about possible functional unblinding of site-based raters. This method of blinded assessment via audio-digital recordings may have utility for other studies concerned with ratings precision and/or functional unblinding.

Audio-digital recordings to assess ratings reliability in clinical trials of schizophrenia

We examined ratings reliability in 5 clinical trials of subjects with schizophrenia experiencing an acute exacerbation of psychosis. Audio-digital recordings of site-based interviews of the Positive and Negative Syndrome Scale (PANSS) or Brief Psychiatric Rating Scale (BPRS) were used to obtain blinded, site-independent scores to evaluate paired scoring concordance. High intraclass correlations were noted between 1810 paired site-based and site-independent PANSS scores (r = 0.801) and 1837 paired BPRS scores (r = 0.897) with high limits of agreement such that 93.9% of paired scores were within the calculated 95% confidence intervals. In 2 studies where sufficient PANSS data was available at baseline and endpoint, blinded site-independent ratings yielded a predictive value of 84.2% for replicating site-based response/nonresponse treatment outcomes. There was a significant positive correlation between site-based scores and paired scoring deviations (PANSS: r = 0.246; p < 0.0001; BPRS: r = 0.176; p < 0.0001). The magnitude (symptom severity) of PANSS or BPRS scores affected the directionality of paired scoring deviations in each study. Site-based raters scored the most symptomatic subjects higher and less symptomatic subjects lower than the paired site-independent raters on either instrument. This analysis affirms the utility of paired audio-digital scoring of site-based interviews as a surveillance strategy for schizophrenia studies. We noted a high predictive value of blinded site-independent raters to replicate site-based treatment outcomes. The bi-directionality of paired scoring deviations observed for both the PANSS and BPRS is consistent with findings found for depression rating instruments.