Medication Nonadherence, "Professional Subjects," and Apparent Placebo Responders: Overlapping Challenges for Medications Development

Evaluation, analysis, and reporting of medication adherence for clinical trials of anticoagulants in children: guidance from the ISTH SSC Subcommittee on Pediatric and Neonatal Thrombosis and Hemostasis

In response to growing recognition that nonadherence prevents children, adolescents, and young adults from achieving the therapeutic benefits of anticoagulant medication, the International Society on Thrombosis and Haemostasis Scientific and Standardization Committee Subcommittee on Pediatric and Neonatal Thrombosis and Hemostasis convened a working party on medication adherence. The primary aim of this article was to synthesize recommendations from the larger adherence science literature to provide guidance regarding the classification, collection, and interpretation of anticoagulation adherence data. The secondary aim of this article was to evaluate the degree to which trials published from 2013 to 2023 adhered to these guidance recommendations. As less than half of all trials reported on adherence and none included all recommended elements, the proposed International Society on Thrombosis and Haemostasis Scientific and Standardization Committee guidance has the potential to enhance the rigor and reproducibility of pediatric anticoagulant research.

Results of a randomized, double-blind, placebo-controlled trial of lorcaserin in cocaine use disorder

BACKGROUND

Cocaine use disorder (CUD) is a major public health problem for which there is no approved pharmacotherapy. The primary purpose of this study was to evaluate the ability of lorcaserin, a 5-hydroxytryptamine2 C (5-HT2 C) receptor agonist, to facilitate abstinence in individuals seeking treatment for CUD.

METHODS

This was a 12-site, randomized, parallel arm study with a 13-week Treatment Phase that included a 1-week, single-blind run-in period when all participants received twice daily 15mg acetazolamide capsules (a medication adherence marker), followed by randomization to either twice daily 10mg lorcaserin or placebo capsules for the remaining 12 weeks. Pre-randomization data were utilized in an enrichment strategy aimed at achieving high levels of medication adherence and low placebo response rates in a subgroup of participants that qualified for the "efficacy population." For lorcaserin vs. placebo, the primary efficacy endpoint was the proportion of participants in the efficacy population achieving abstinence during the last three weeks of treatment, as evidenced by self-report of no cocaine use, confirmed by urine testing.

RESULTS

Within the efficacy population, 1.1% of 91 participants receiving lorcaserin and 4.3% of 92 receiving placebo achieved abstinence during the last 3 weeks of treatment. Among all randomized participants, 2.5% of 118 receiving lorcaserin and 5.6% of 124 receiving placebo achieved similar abstinence. Study participants receiving lorcaserin exhibited significantly greater reductions in body weight and BMI, indicating that medication adherence was sufficient to produce a pharmacological effect.

CONCLUSIONS

Twice daily 10mg lorcaserin failed to demonstrate efficacy in the treatment of CUD.

Pairwise comparisons of three medication adherence outcomes in adolescents who use alcohol

BACKGROUND

Accurate assessment of medication adherence is important for understanding pharmacotherapy outcomes across all phases of adolescent substance use disorder (SUD) clinical trials. The objective of this study was to describe and assess the pairwise concordance between three commonly used non-biological medication adherence assessment methods in adolescents who use alcohol to inform the selection of medication adherence measures for use in future youth SUD trials.

METHODS

Participants (N = 32, 17-19-years-old) took N-acetylcysteine and placebo, in a randomized cross-over design, for 10 days each. Medication adherence was assessed (20 days total) via pill count, medication videos submitted twice daily, and the Medication Event Monitoring System (MEMS®). Lin's Concordance Correlation Coefficient (CCC) assessed concordance and Bland-Altman plots are reported. Linear mixed-effects models with main effects of medication, treatment block (first medication, second medication), and sequence were also run.

RESULTS

Medication videos yielded the lowest (64%) and pill count yielded the highest (89%) adherence estimates. CCC values indicated poor correspondence, except between pill count and MEMS. The Bland-Altman plots showed good pairwise agreement between all methods. Linear mixed-effects models indicated a difference between the first and second cross-over medication, with adherence estimates being lower for the second medication, regardless of whether it was N-acetylcysteine or placebo.

CONCLUSIONS

The study yielded important and practical information. First, incorporating more than one method of adherence assessment may capture estimated floor and ceiling adherence in the absence of a biological marker. This is particularly relevant for remote or hybrid studies where bio-marker collection is challenging. Selection of the assessment methods will depend on study goals. Second, the continuation of medication adherence research can benefit each phase of clinical trials and inform rigorous pharmacotherapy evaluation.

Innovative Technologies in CNS Trials: Promises and Pitfalls for Recruitment, Retention, and Representativeness

Objective

Recruitment of a sufficiently large and representative patient sample and its retention during central nervous system (CNS) trials presents major challenges for study sponsors. Technological advances are reshaping clinical trial operations to meet these challenges, and the COVID-19 pandemic further accelerated this development.

Method of Research

The International Society for CNS Clinical Trials and Methodology (ISCTM; www.isctm.org) Innovative Technologies for CNS Trials Working Group surveyed the state of technological innovations for improved recruitment and retention and assessed their promises and pitfalls.

Results

Online advertisement and electronic patient registries can enhance recruitment, but challenges with sample representativeness, conversion rates from eligible prescreening to enrolled patients, data privacy and security, and patient identification remain hurdles for optimal use of these technologies. Electronic medical records (EMR) mining with artificial intelligence (AI)/machine learning (ML) methods is promising but awaits translation into trials. During the study treatment phase, technological innovations increasingly support participant retention, including adherence with the investigational treatment. Digital tools for adherence and retention support take many forms, including patient-centric communication channels between researchers and participants, real-time study reminders, and digital behavioral interventions to increase study compliance. However, such tools add technical complexities to trials, and their impact on the generalizability of results are largely unknown.

Conclusion

Overall, the group found a scarcity of systematic data directly assessing the impact of technological innovations on study recruitment and retention in CNS trials, even for strategies with already high adoption, such as online recruitment. Given the added complexity and costs associated with most technological innovations, such data is needed to fully harness technologies for CNS trials and drive further adoption.

Medication Adherence in Tobacco Cessation Clinical Trials

Adherence is a critical mediator of treatment outcome across health conditions and low rates of adherence undermine success in smoking cessation treatment. This narrative review provides an overview of different techniques that can be used to measure adherence to smoking cessation treatments and outlines strategies to address treatment adherence. Techniques to measure adherence include conducting pill counts, collecting self-reports of adherence, directly observed therapy, biochemical verification methods, and electronic data collection via medication events monitoring systems. Techniques examined for increasing tobacco cessation treatment adherence include counseling, automated adherence calls, feedback from electronic monitors, contingency management and directly observed therapy. Adherence monitoring and optimization should be a standard component of smoking cessation treatment research.

Validation of a novel Psychosis-Implicit Association Test (P-IAT) as a diagnostic support tool

Despite significant advances in early-intervention services for psychosis, delays in identifying patients continue to impede the delivery of prompt and effective treatments. We sought to develop and preliminarily validate a self-administered psychosis implicit association task (P-IAT) as a screening and diagnostic support tool for identifying individuals with psychotic illness in community settings. The P-IAT is a response latency task, designed to measure the extent to which individuals implicitly associate psychosis-related terms with the "self." The P-IAT was administered to 57 participants across 3 groups: healthy controls (N=19), inpatients hospitalized with active psychosis (N=19), and outpatients with psychotic disorders (N=19). Mean D-scores (the output of the task) differed significantly between the illness groups and healthy controls (Mann-Whitney U=138, p<.001). A receiver operating curve was plotted to assess the performance of D-scores in predicting a psychosis diagnosis, yielding an area under the curve of 0.81. When participant D-scores exceeded -0.24, the test achieved a specificity of 100% (sensitivity: 47%), with all 18 participants scoring above this threshold belonging to the illness groups. The discriminant performance of the P-IAT suggests its potential to augment existing screening instruments and inform referral decision making, particularly in settings with limited access to specialist providers.

Placebo Response in Trials of Negative Symptoms in Schizophrenia: A Critical Reassessment of the Evidence

BACKGROUND

Summarizing evidence from clinical trials of patients with schizophrenia with predominant or prominent negative symptoms (NS), a prior meta-analysis reported a large placebo effect in negative symptoms (Cohen's d = 2.909). Assuming that such an effect was clinically not plausible, we performed a critical re-assessment and an update of the previous results with newly available data from add-on and monotherapy studies.

STUDY DESIGN

Random-effect meta/regression analysis of trials that focused on predominant or prominent NS; and adopted a double-blind, randomized, placebo-controlled design. The final pooled meta-analytic database, based on the available add-on and monotherapy studies combined, included 24 publications containing data on a total of 25 studies (21 add-on, 4 monotherapy).

STUDY RESULTS

The pooled overall estimate for the placebo effect from the primary analysis for all included studies had a medium effect size, with a Cohen's d value of 0.6444 (SE = 0.091). The estimates were similar in the add-on and monotherapy studies. Meta-regression indicated that the high placebo response was significantly associated with clinical trial characteristics, including the high ratio of patients assigned to active vs. placebo treatment and short trial duration.

CONCLUSIONS

These results represent a major downward correction for a current effect size estimate of the placebo response in the negative symptoms of schizophrenia. Our findings also pinpoint certain clinical trial characteristics, which may serve as important predictors of the placebo response. The knowledge of these factors can have important implications for drug development and trial design for new drugs for negative symptoms of schizophrenia.

(Non-) impact of task experience on behavioral economic decision-making

Behavioral economic research has been widely conducted via crowdsourcing resources to evaluate novel task designs or pilot interventions. One under recognized and yet-to-be tested concern is the impact of non-naïvety (i.e., prior task exposure) on behavioral economic task performance. We evaluated the influence of non-naïvety on task performance in two popular areas of behavioral economic research: behavioral economic demand and delay discounting. Participants (N = 485) recruited using Amazon Mechanical Turk (mTurk) completed alcohol and soda purchase tasks and delay discounting tasks for monetary and alcohol outcomes. Equivalence of responding and effect sizes with clinical variables were compared based on prior task experience. Over one quarter of participants reported demand task experience (26.9%) and nearly half endorsed delay discounting task experience (48.6%). Statistically equivalent responding was observed for alcohol purchase task data with less-than-small effect size differences based on task experience (d = 0.01-0.13). Similar results were observed for a soda purchase task thereby supporting generalization to a non-alcohol commodity. Measures of convergent and discriminant validity for behavioral economic demand indicated medium-to-large and stimulus-specific effect sizes with little variation based on prior task exposure. Delay discounting for money and alcohol showed some sensitivity to prior task experience (i.e., less steep discounting for non-naïve participants), however these effects were attenuated after accounting for group differences in alcohol use. These findings support the fidelity of behavioral economic task outcomes and emphasize that participant non-naïvety in crowdsourcing settings may minimally impact performance on behavioral economic assays commonly used in behavioral and addiction science. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

No Effect of Coenzyme Q10 on Cognitive Function, Psychological Symptoms, and Health-related Outcomes in Schizophrenia and Schizoaffective Disorder: Results of a Randomized, Placebo-Controlled Trial

BACKGROUND

Cognitive impairments, negative symptoms, affective symptoms, and low energy are highly prevalent features of schizophrenia. Mitochondrial dysfunction has been hypothesized as one of the numerous factors to underlie the manifestation of these symptoms. The objective of this study was to evaluate whether Coenzyme Q10 (CoQ10) has a role in the treatment of schizophrenia and schizoaffective disorder.

METHODS

A double-blind, randomized, placebo-controlled trial was conducted to assess the effects of CoQ10 supplementation (300 mg/day) on the co-primary outcomes of attention and working memory performance after 3 and 6 months. Secondary outcomes included plasma CoQ10 levels, mitochondrial function, energy, depression, anxiety, negative symptoms, and quality oflife.

FINDINGS

In total, 72 patients were randomized to intervention groups. Overall, there was no effect of CoQ10 supplementation on the primary outcome measures at 3 or 6 months. Further, with the exception of plasma CoQ10 levels, CoQ10 supplementation also had no effect on the secondary outcomes. At 3 months, CoQ10 concentration was significantly higher in the CoQ10 group (3.85 μg/mL) compared with placebo (1.13 μg/mL); this difference was not present at 6 months.

CONCLUSIONS

The results of the study suggest that CoQ10 supplementation at 300 mg/day for 6 months is unlikely to be beneficial for cognitive, psychological and health-related outcomes in schizophrenia and schizoaffective disorder. However, a number of limitations including low adherence, modest sample size, and attrition, likely reduce estimates of effects. As such, results should be considered preliminary.

DOT Diary: Developing a Novel Mobile App Using Artificial Intelligence and an Electronic Sexual Diary to Measure and Support PrEP Adherence Among Young Men Who Have Sex with Men

Young men who have sex with men (YMSM) are highly vulnerable to HIV. While pre-exposure prophylaxis (PrEP) has demonstrated effectiveness, adherence has been low among YMSM and difficult to measure accurately. In collaboration with a healthcare company, we configured an automated directly-observed therapy (aDOT) platform for monitoring and supporting PrEP use. Based on interest expressed in focus groups among 54 YMSM, we combined aDOT with an electronic sexual diary to provide feedback on level of protection during sex and to motivate app use. In an 8-week optimization pilot with 20 YMSM in San Francisco and Atlanta, the app was found to be highly acceptable, with median System Usability Scale scores in the "excellent" range (80/100). App use was high, with median PrEP adherence of 91% based on aDOT-confirmed dosing. Most (84%) participants reported the app helped with taking PrEP. These promising findings support further evaluation of DOT Diary in future effectiveness studies.

Digitally Enabled, Patient-Centric Clinical Trials: Shifting the Drug Development Paradigm

The rapidly advancing field of digital health technologies provides a great opportunity to radically transform the way clinical trials are conducted and to shift the clinical trial paradigm from a site-centric to a patient-centric model. Merck's (Kenilworth, NJ) digitally enabled clinical trial initiative is focused on introduction of digital technologies into the clinical trial paradigm to reduce patient burden, improve drug adherence, provide a means of more closely engaging with the patient, and enable higher quality, faster, and more frequent data collection. This paper will describe the following four key areas of focus from Merck's digitally enabled clinical trials initiative, along with corresponding enabling technologies: (i) use of technologies that can monitor and improve drug adherence (smart dosing), (ii) collection of pharmacokinetic (PK), pharmacodynamic (PD), and biomarker samples in an outpatient setting (patient-centric sampling), (iii) use of digital devices to collect and measure physiological and behavioral data (digital biomarkers), and (iv) use of data platforms that integrate digital data streams, visualize data in real-time, and provide a means of greater patient engagement during the trial (digital platform). Furthermore, this paper will discuss the synergistic power in implementation of these approaches jointly within a trial to enable better understanding of adherence, safety, efficacy, PK, PD, and corresponding exposure-response relationships of investigational therapies as well as reduced patient burden for clinical trial participation. Obstacle and challenges to adoption and full realization of the vision of patient-centric, digitally enabled trials will also be discussed.

Frequency of concealment, fabrication and falsification of study data by deceptive subjects

Purpose

Many studies have found evidence that research subjects engage in deceptive practices while participating in health-related studies. Little is known, however, about how often subjects use deception and the percentage of studies a typical subject will contaminate with false data. This study examined the frequency of use of different types of deception among a sample of subjects who admit to using deception.

Methods

A sample of 59 subjects who had participated in at least two health-related studies in the past 12 months and admitted to using deception in at least one were interviewed. Subjects were asked a series of questions about concealing information and fabricating information to gain entry into studies. Subjects were also asked about falsifying data after being enrolled in a health-related study. All study data reported pertains to only subjects who reported using deception in health-related studies and is based on subjects’ study participation only within the last 12 months from the date of the interview.

Results

Subjects who conceal information in order to enroll in trials reported using concealment in about two thirds (67%) of the trials they participated in over the past 12 months. On average, these subjects’ use of concealment was highest for mental health information (58% of studies) and physical health information (57% of studies). The average frequency of fabricating information in order to enroll in trials was 53% with exaggerating health symptoms (45% of studies) and pretending to have a health condition (39% of studies) as the two most widely used strategies. Subjects who falsify study data after enrollment reported doing so 40% of the time. These subjects falsely reported improvement in the health condition being studied in 38% of the trials they took part in. Subjects who admitted to throwing away study medication to create the appearance of compliance reported doing so 32% of the time.

Limitations

Although this study provides evidence that subjects who admit to using deception contaminate a high percentage of studies, larger and more geographically diverse samples are needed to understand the full extent of the problem of deceptive subjects in research. Regional economic, cultural, or organizational factors may be related to the rate of subjects using deception. It is also possible that this sample underrepresents the use of deception as there are likely subjects who use deception that would be unwilling to admit the extent of this behavior.

Conclusion

Deceptive subject's behavior poses a threat to the integrity of research findings. Given that deceptive subjects contaminate a high percentage of studies they take part in by concealing information, fabricating information, and falsifying study data after enrollment, efforts to identify and exclude these subjects is important to the integrity of research findings. Strategies to exclude deceptive subjects from health research should be used to inform study designs. Widespread adoption of research subject identity registries could greatly reduce the scope of studies that a single deceptive subject could contaminate. Technological solutions that provide an objective measure of medication compliance may be valuable tools for limiting fraudulent reports of compliance.

Validity of the Mood Disorder Questionnaire (MDQ) as a screening tool for bipolar spectrum disorders in anabaptist populations

The Mood Disorder Questionnaire (MDQ) is an established screening tool for bipolar spectrum disorders (BSD), but has not been validated in diverse populations and the best scoring method remains uncertain. This study assessed diagnostic validity of the MDQ among Anabaptists, an underserved population frequently involved in genetic research. 161 participants completed the MDQ and were diagnosed by a best-estimate final diagnosis (BEFD). Diagnostic agreements between alternate MDQ scoring methods and the BEFD were quantified using Cohen's Kappa (κ), sensitivity (α), and specificity (β). Scoring criteria evaluated included >7 simultaneous symptoms and at least moderate impairment, >7 simultaneous symptoms, with at least mild impairment, >7 symptoms only, with no further requirement, and three novel scoring methods that require >5 symptoms or fewer. Diagnostic agreement varied. The original method proved most specific but had the lowest κ and sensitivity. κ increased with more liberal scoring criteria, reaching a maximum under the lower-threshold symptom methods, with little loss of specificity in the 5-symptom method. Decreasing the symptom threshold below 5 conferred little or no benefit. These results support the diagnostic validity of the MDQ among this Anabaptist sample and suggest that a 5-symptom scoring method may increase diagnostic sensitivity in populations at high risk for bipolar disorder.

How the EMERGE guideline on medication adherence can improve the quality of clinical trials

Medication adherence in drug trials is suboptimal, affecting the quality of these studies and adding significant costs. Nonadherence in this setting can lead to null findings, unduly large sample sizes and the need for dose modification after a drug has been approved. Despite these drawbacks, adherence behaviours are not consistently measured, analysed or reported appropriately in trial settings. The ESPACOMP Medication Adherence Reporting Guideline (EMERGE) offers a solution by facilitating a sound protocol design that takes this crucial factor into account. This article summarises key evidence on traditional and newer measurements of adherence, discusses implementation in clinical trial settings and makes recommendations about the analysis and interpretation of adherence data. Given the potential benefits of this approach, the authors call on regulators and the pharmaceutical industry to endorse the EMERGE guideline.

Recent Stressful Life Events in Euthymic Major Depressive Disorder Patients: Sociodemographic and Clinical Characteristics

BACKGROUND

Stressful life events (SLE) may influence the illness course and outcome. This study aimed to characterize socio-demographic and clinical features of euthymic major depressive disorder (MDD) outpatients with SLE compared with those without.

METHODS

The present sample included 628 (mean age=55.1 ± 16.1) currently euthymic MDD outpatients of whom 250 (39.8%) reported SLE and 378 (60.2%) did not.

RESULTS

After univariate analyses, outpatients with SLE were most frequently widowed and lived predominantly with friends/others. Moreover, relative to outpatients without SLE, those with SLE were more likely to have a family history of suicidal behavior, manifested melancholic features, report a higher Coping Orientation to the Problems Experienced (COPE) positive reinterpretation/growth and less likely to have a comorbid panic disorder, residual interepisodic symptoms, use previous psychiatric medications, and currently use of antidepressants. Having a family history of suicide (OR=9.697; p=≤.05), history of psychotropic medications use (OR=2.888; p=≤.05), and reduced use of antidepressants (OR=.321; p=.001) were significantly associated with SLE after regression analyses. Mediation analyses showed that the association between current use of antidepressants and SLE was mediated by previous psychiatric medications.

CONCLUSION

Having a family history of suicide, history of psychotropic medications use, and reduced use of antidepressants is linked to a specific "at risk" profile characterized by the enhanced vulnerability to experience SLE.

WITHDRAWN: Size Does Matter, But It Isn't Everything: The Challenge of Modest Treatment Effects in Chronic Pain Clinical Trials

Available online This article has been withdrawn at the request of the author(s) and/or editor. The Publisher apologizes for any inconvenience this may cause. The full Elsevier Policy on Article Withdrawal can be found at https://www.elsevier.com/about/our-business/policies/article-withdrawal.

Is High Placebo Response Really a Problem in Depression Trials? A Critical Re-analysis of Depression Studies

Objective: We investigated the accuracy of the often-stated assumption that placebo nonadditivity and an increasing placebo response are major problems in clinical trials and the cause of a trend for smaller treatment effects observed in clinical trials for major depressive disorder (MDD) in recent years. Method of research: We reviewed data from 122 MDD trials conducted between the years 1983 and 2010 (analyzed originally by Undurraga and Baldessarini in 2012) to determine whether the data support the assumption of placebo additivity. Statistical techniques, such as conventional least squares regression, orthogonal least squares regression and locally weighted loess smoothing, were applied to the data set. Results: Re-analysis of the data set showed the active and placebo responses to be highly correlated, to the degree that would be expected assuming placebo additivity, when random variability in both active and placebo response is considered. Despite the placebo responses in MDD trials increasing up to approximately the year 1998, we found no evidence that it has continued to increase since this date, or that it has been the cause of smaller reported treatment effects in recent years. Conclusion: Attempts to reduce the placebo response are unlikely to increase the treatment effect since they are likely to reduce drug nonspecific effects in the treatment arm by a similar amount. Thus, it should come as no surprise that trial designs set up with the sole purpose of reducing placebo response fail to discernibly benefit our ability to identify new effective treatments.

Evaluation of a plasticity-based cognitive training program in schizophrenia: Results from the eCaesar trial

OBJECTIVE

Cognitive impairment in schizophrenia is a core feature of the disorder. Computerized cognitive training has shown promise in pilot studies. A 26-week randomized blinded placebo-controlled trial was conducted to investigate the effect of a novel computerized cognitive training program on cognitive and functional capacity outcomes.

METHOD

The study followed MATRICS guidelines for the evaluation of interventions designed to improve cognitive function in schizophrenia. Participants (N = 150) were randomized to experimental (computerized cognitive training in a game-like format) or active control (computer games) groups. Training was conducted in-clinic, with an intended training schedule of 5 days per week, 1 h per day, for 26 weeks. Co-primary outcome measures were the MATRICS Consensus Cognitive Battery (MCCB) composite score and the UCSD Performance-Based Skills Assessment (UPSA-2) total score, secondary outcome measures included the Cognitive Assessment Interview (CAI) and the Short-Form-12 Mental Composite Score (SF-12 MCS). Target engagement was assessed with task-learning based assessment.

RESULTS

At baseline, the groups were well matched. No significant effect of the experimental treatment was seen on the primary or secondary outcome measures compared to the active control. Review of the task learning/target engagement data suggested inadequate target engagement.

CONCLUSIONS

Results do not support a cognitive or functional capacity benefit from this implementation of a computerized cognitive training program in people with schizophrenia. In future trials, careful consideration is merited of the assessment of task learning/target engagement, the effects of making the cognitive training game-like on motivation, and the implicit effects of trial requirements on participant selection.

When All Else Fails, Listen to the Patient: A Viewpoint on the Use of Ecological Momentary Assessment in Clinical Trials

A major problem in mental health clinical trials, such as depression, is low assay sensitivity in primary outcome measures. This has contributed to clinical trial failures, resulting in the exodus of the pharmaceutical industry from the Central Nervous System space. This reduced assay sensitivity in psychiatry outcome measures stems from inappropriately broad measures, recall bias, and poor interrater reliability. Limitations in the ability of traditional measures to differentiate between the trait versus state-like nature of individual depressive symptoms also contributes to measurement error in clinical trials. In this viewpoint, we argue that ecological momentary assessment (EMA)-frequent, real time, in-the-moment assessments of outcomes, delivered via smartphone-can both overcome these psychometric challenges and reduce clinical trial failures by increasing assay sensitivity and minimizing recall and rater bias. Used in this manner, EMA has the potential to further our understanding of treatment response by allowing for the assessment of dynamic interactions between treatment and distinct symptom response.

Vortioxetine for attention deficit hyperactivity disorder in adults: A randomized, double-blind, placebo-controlled, proof-of-concept study

BACKGROUND

Stimulants remain the mainstay of treatment for attention-deficit hyperactivity disorder (ADHD) but are often associated with insufficient response or poor tolerability, leading to many patients not wishing to be treated with controlled substances.

AIMS

This randomized, placebo-controlled, proof-of-concept study (NCT02327013) evaluated the efficacy of a multimodal antidepressant, vortioxetine, in the treatment of ADHD, using a two-stage sequential parallel comparison design.

METHODS

Patients aged 18-55 years with a diagnosis of ADHD (DSM-5) and a total score ⩾24 on the Adult ADHD Investigator Symptom Rating Scale (AISRS) were randomized in study stage I with a 1:1:3 ratio to six weeks of treatment with vortioxetine 10 or 20 mg/day, or placebo ( n = 227). In study stage II, placebo non-responders (AISRS total score reduction <30% from stage I baseline) were re-randomized with a 1:1:1 ratio to six weeks of vortioxetine 10 or 20 mg/day, or placebo ( n = 59).

RESULTS

Across the two study stages combined, ADHD symptoms improved by approximately eight AISRS points in all treatment groups, showing no difference from placebo for either dose of vortioxetine, the study thus failing to meet its primary endpoint. However, both doses of vortioxetine separated from placebo in improving overall patient functioning, as measured by the Sheehan Disability Scale.

CONCLUSION

Studies are warranted to further investigate this suggested benefit of a multimodal antidepressant for patient functioning in ADHD while addressing issues of non-adherence and placebo response. The study confirmed vortioxetine 10 mg and 20 mg as generally well-tolerated.

Neuropathic pain clinical trials: factors associated with decreases in estimated drug efficacy

Multiple recent pharmacological clinical trials in neuropathic pain have failed to show beneficial effect of drugs with previously demonstrated efficacy, and estimates of drug efficacy seems to have decreased with accumulation of newer trials. However, this has not been systematically assessed. Here, we analyze time-dependent changes in estimated treatment effect size in pharmacological trials together with factors that may contribute to decreases in estimated effect size. This study is a secondary analysis of data from a previous published NeuPSIG systematic review and meta-analysis, updated to include studies published up till March 2017. We included double-blind, randomized, placebo-controlled trials examining the effect of drugs for which we had made strong or weak recommendations for use in neuropathic pain in the previously published review. As the primary outcome, we used an aggregated number needed to treat for 50% pain reduction (alternatively 30% pain reduction or moderate pain relief). Analyses involved 128 trials. Number needed to treat values increased from around 2 to 4 in trials published between 1982 and 1999 to much higher (less effective) values in studies published from 2010 onwards. Several factors that changed over time, such as larger study size, longer study duration, and more studies reporting 50% or 30% pain reduction, correlated with the decrease in estimated drug effect sizes. This suggests that issues related to the design, outcomes, and reporting have contributed to changes in the estimation of treatment effects. These factors are important to consider in design and interpretation of individual study data and in systematic reviews and meta-analyses.

Methods to reduce the incidence of false negative trial results in substance use treatment research

Treatment development and evaluation for substance use disorders are hindered when randomized controlled trials fail to show a treatment effect when one exists. This manuscript provides an overview of addressable methodological factors that may contribute to incorrect trial results. The collection of remote, naturalistic, real-time adherence and substance use data through ambulatory assessment methods in everyday life is presented as a partial solution. Other recommendations related to participant recruitment and selection, ensuring adequate consistency/fidelity and dose of treatment, and rigorously assessing clinical outcomes are discussed. With implementation of eligibility criteria verification, treatment adherence monitoring, and remote assessment of substance use and biomarkers, ambulatory assessment may help improve clinical trial success rates by improving precision, increasing reproducibility, and reducing the impact of methodological issues that may lead to inaccurate trial results.

Effects of Varenicline, Depressive Symptoms, and Region of Enrollment on Smoking Cessation in Depressed Smokers

Introduction

Despite effective treatments, relapse to smoking remains a vexing global health problem. One predictor of relapse is depressive symptoms. Medications such as varenicline reduce withdrawal-related symptoms of depression, reducing relapse. This study examined whether varenicline moderated the effect of depressive symptoms on relapse, and whether this varied by region of enrollment.

Methods

Adult smokers (n = 525; 37% male) with past or current, stable major depressive disorder recruited from United States (n = 255), and European (n = 270) sites participated in a randomized, double-blind cessation treatment trial including 12 weeks of varenicline or placebo, with 40-week nontreatment follow-up.

Results

Longitudinal and binary logistic regressions were used to model the probability of sustained abstinence by end of treatment and point-prevalence abstinence in follow-up. The association between depression symptoms and abstinence was moderated by intervention group at end of treatment, and by region during follow-up: more severe symptoms were associated with end-of-treatment relapse for placebo (odds ratio [OR] = 0.91, p = .003), but not varenicline (OR = 0.99, p = .568). During follow-up, increased symptoms of depression predicted greater likelihood of smoking for European (p = .009) but not US participants. Europeans were more likely to be abstinent for both outcomes (p < .01).

Conclusions

These results extend studies demonstrating varenicline is associated with less withdrawal-related depression, and suggest it aids cessation even in smokers with depressive symptoms. Findings also suggest regional differences in the relationship between depressive symptoms and cessation that may be related to differences in prevalence.

Implications

This study indicates varenicline may aid cessation partially by reducing withdrawal-related symptoms of depression. It also suggests that the impact of depressive symptoms on cessation varies regionally, and that this variation may be related to differences in smoking prevalence.

Use of a Digital Medication Management System for Effective Assessment and Enhancement of Patient Adherence to Therapy (ReX): Feasibility Study

Background

Medication nonadherence is a major problem in health care, imposing poor clinical outcomes and a heavy financial burden on all stakeholders. Current methods of medication adherence assessment are severely limited: they are applied only periodically, do not relate to actual pill intake, and suffer from patient bias due to errors, misunderstanding, or intentional nonadherence. ReX is an innovative medication management system designed to address poor patient adherence and enhance patient engagement with their therapy. ReX controls and tracks pills from the point of packaging right through to the patient’s mouth. ReX generates robust, real-time adherence data. The system enables patients to report outcomes, complete surveys, and receive messages and instructions. ReX includes a reusable drug dispensing unit, disposable cassette containing pills, and a cloud-based data portal.

Objective

We aimed to evaluate ReX feasibility by human factor studies including evaluation of ReX safety; ReX acceptance and usability; and ReX efficacy of providing pills according to a preprogrammed dose regimen, managing reminders and adherence data, and enhancing the adherence rate compared with the standard of care.

Methods

The ReX system was evaluated in 2 human factor, nonclinical feasibility studies. Human subjects used ReX for the administration of pill-shaped Tic Tac sweets. The initial study evaluated ReX use and pill intake administration; second was a self-controlled, 4-day home-use study. All subjects took pills at home, according to a preprogrammed dose regimen, for 4 days each via the device (ReX test) or from standard packaging (control test). The adherence rate (percent of pills taken) was measured by the study subject’s report, remaining pills count, and ReX records (in the ReX test). ReX safety and usability were evaluated by a questionnaire filled out by the subject.

Results

The initial feasibility study evaluated usability and acceptance of the ReX novel approach to pill dispensing. All subjects successfully managed 2 pill intakes. The ReX device was rated as easy to use by 81% (48/59) of subjects. The 4-day home-use study evaluated the safety, efficacy, and usability of the ReX system. No adverse event occurred; no pill overdose or pill malformation was reported. The overall adherence rate in the ReX test was 97.6% compared with 76.3% in the control test (P<.001). Real-time, personalized reminders provided in the event of a delay in pill intake contributed to 18.0% of doses taken during the ReX test. The ReX system was found easy to use by 87% (35/40) of subjects; 90% (36/40) felt comfortable using it for their medication.

Conclusions

ReX’s novel “tracking to the mouth” technology was found usable and accepted by subjects. The assessment of adherence rates was reliable; adherence of subjects to the dose regimen was significantly enhanced when using ReX compared with the standard of care.

Deception in clinical trials and its impact on recruitment and adherence of study participants

Deceptive practices by participants in clinical research are prevalent. It has been shown that as high as 75% of participants withheld information to avoid exclusion from studies. Self-reported adherence has been found to be largely inaccurate. Overcoming deception is a critical issue, since the safety of study participants, the integrity of research data and research resources are at risk. In this review article, we examine deception from the perspective of investigators conducting clinical trials; we describe the types (concealment, fabrication, drug holidays and collusion), prevalence, risks, and predictors of deception, and propose an approach to reduce the impact of deception, especially on adherence, in clinical trials.

Risk-Based Data Monitoring: Quality Control in Central Nervous System (CNS) Clinical Trials

Monitoring the quality of clinical trial efficacy outcome data has received increased attention in the past decade, with regulatory guidance encouraging it to be conducted proactively, and remotely. However, the methods utilized to develop and implement risk-based data monitoring (RBDM) programs vary, and there is a dearth of published material to guide these processes in the context of central nervous system (CNS) trials. We reviewed regulatory guidance published within the past 6 years, generic white papers, and studies applying RBDM to data from CNS clinical trials. Methodologic considerations and system requirements necessary to establish an effective, real-time risk-based monitoring platform in CNS trials are presented. Key RBDM terms are defined in the context of CNS trial data, such as "critical data," "risk indicators," "noninformative data," and "mitigation of risk." Additionally, potential benefits of, and challenges associated with implementation of data quality monitoring are highlighted. Application of methodological and system requirement considerations to real-time monitoring of clinical ratings in CNS trials has the potential to minimize risk and enhance the quality of clinical trial data.

Using REDCap for ambulatory assessment: Implementation in a clinical trial for smoking cessation to augment in-person data collection

BACKGROUND

The use of ambulatory assessment to study behavior and physiology in daily life is becoming more common, yet barriers to implementation remain. Limitations in budget, time, and expertise may inhibit development or purchase of dedicated ambulatory assessment software. Research Electronic Data Capture (REDCap) is widely used worldwide, offering a cost-effective and accessible option for implementing research studies.

OBJECTIVES

To present a step-by-step guideline on how to implement ambulatory assessment using REDCap and provide preliminary evidence of feasibility.

METHODS

Feasibility and acceptability data are presented for randomized participants (N ranged from 19 to 36, depending on analysis) from an ongoing 8-week smoking cessation pharmacological clinical trial (ClinicalTrials.gov Identifier: NCT02737358). Participants (N = 36; 50% female) completed up to three ambulatory assessment surveys per day, depending on the phase of the study. These included self-report and video confirmation of smoking biomarkers and medication adherence.

RESULTS

Participants completed 74.8% of morning reports (86.6% for study completers), 73.8% of videos confirming smoking biomarkers, and 70.4% of videos confirming medication adherence. Study completers reported that the REDCap assessments were easy to use, and 78.9% of participants preferred the REDCap assessments to traditional, paper measures.

CONCLUSIONS

These data from a pharmacological trial suggest feasibility of remote data collection using REDCap. As REDCap functionality is continually evolving, it is likely that options for collecting ambulatory assessment data via this platform will progressively improve allowing for greater individualization of assessment scheduling for enhancing data collection in clinical trials.

Detecting Deception in Our Research Participants: Are Your Participants Who You Think They Are?

There is increasing awareness of the potential negative impacts of participant deception on research, including possibly undermining reliability and reproducibility of study findings. These deceptive individuals set their personal interests above the rules of study participation, thereby jeopardizing data quality as well as placing themselves and others at risk. The costs of participant deception are numerous. Overall, it reduces statistical power and may even result in false conclusions about efficacy and safety. To date, most studies have not utilized sufficient methods to detect rule-breaking subjects. The purpose of this article is to bring to the attention of alcohol and other drug researchers issues involving deceptive participants. The review will suggest alcohol-specific as well as more general strategies to identify and thereby minimize enrollment of these deceptive participants. Specifically, we will identify strategies that are employed in different phases of human alcohol research and advance approaches that may be helpful to the field in reducing these contaminants. As a field, we need to be more proactive in identifying the deceptive participant even at the cost of more burdensome study enrollment. In light of the systemic nature and multipronged damage that this emerging pattern of deception inflicts on clinical research, it is imperative that we each assume greater responsibility for our role in mitigating this source of research contamination.

From bench to bedside: mGluR2 positive allosteric modulators as medications to treat substance use disorders

OBJECTIVE

This paper provides an overview of the role of type 2 metabotropic glutamate receptors (mGluR2) in addiction and behaviors reflecting addictive processes.

RESULTS

AZD8529, an mGluR2 positive allosteric modulator (PAM), failed to separate from placebo in a phase II schizophrenia trial. The demonstration by Athina Markou's laboratory that AZD8529 attenuated both nicotine self-administration and cue-induced reinstatement was a key factor in the decision to move this compound into a smoking cessation study.

CONCLUSION

Here, we highlight Markou laboratory's contribution to this project, as well as several innovative features of the phase II clinical trial that has already completed enrollment with top line results expected in early 2017.

Guarding the Gate: Remote Structured Assessments to Enhance Enrollment Precision in Depression Trials

BACKGROUND

Failed treatment trials are common in major depressive disorder and treatment-resistant depression, and remotely performed multifaceted, centralized structured interviews can potentially enhance signal detection by ensuring that enrolled patients meet eligibility criteria.

METHODS

We assessed the use of a specific remote structured interview that validated the diagnosis, level of treatment resistance, and depression severity. The objectives were to (1) assess the rate at which patients who were deemed eligible for participation in trials by site investigators were ineligible, (2) assess the reasons for ineligibility, (3) compare rates of ineligibility between academic and nonacademic sites, (4) compare eligibility between US and non-US sites, and (5) report the placebo response rates in trials utilizing this quality assurance approach, comparing its placebo response rates with those reported in the literature. Methods included a pooled analysis of 9 studies that utilized this methodology (SAFER interviews).

RESULTS

Overall, 15.33% of patients who had been deemed eligible at research sites were not eligible after the structured interviews. The most common reason was that patients did not meet the study requirements for level of treatment resistance. Pass rates were significantly higher at non-US compared with US sites (94.6% vs 83.3%, respectively; P < 0.001). There was not a significant difference between academic and nonacademic sites (87.8% vs 82.4%; P = 0.08). Placebo response rates were 13.0% to 27.3%, below the 30% to 40% average in antidepressant clinical trials, suggesting a benefit of the quality assurance provided by these interviews.

CONCLUSIONS

The use of a remotely structured interview by experienced clinical researchers was feasible and possibly contributed to lower-than-average placebo response rates. The difference between US and non-US sites should be the subject of further research.

Use of a Novel Artificial Intelligence Platform on Mobile Devices to Assess Dosing Compliance in a Phase 2 Clinical Trial in Subjects With Schizophrenia

Background

Accurately monitoring and collecting drug adherence data can allow for better understanding and interpretation of the outcomes of clinical trials. Most clinical trials use a combination of pill counts and self-reported data to measure drug adherence, despite the drawbacks of relying on these types of indirect measures. It is assumed that doses are taken, but the exact timing of these events is often incomplete and imprecise.

Objective

The objective of this pilot study was to evaluate the use of a novel artificial intelligence (AI) platform (AiCure) on mobile devices for measuring medication adherence, compared with modified directly observed therapy (mDOT) in a substudy of a Phase 2 trial of the α7 nicotinic receptor agonist (ABT-126) in subjects with schizophrenia.

Methods

AI platform generated adherence measures were compared with adherence inferred from drug concentration measurements.

Results

The mean cumulative pharmacokinetic adherence over 24 weeks was 89.7% (standard deviation [SD] 24.92) for subjects receiving ABT-126 who were monitored using the AI platform, compared with 71.9% (SD 39.81) for subjects receiving ABT-126 who were monitored by mDOT. The difference was 17.9% (95% CI -2 to 37.7; P=.08).

Conclusions

Using drug levels, this substudy demonstrates the potential of AI platforms to increase adherence, rapidly detect nonadherence, and predict future nonadherence. Subjects monitored using the AI platform demonstrated a percentage change in adherence of 25% over the mDOT group. Subjects were able to use the technology successfully for up to 6 months in an ambulatory setting with early termination rates that are comparable to subjects outside of the substudy.

Trial Registration

ClinicalTrials.gov NCT01655680 https://clinicaltrials.gov/ct2/show/NCT01655680?term=NCT01655680

Strategies to exclude subjects who conceal and fabricate information when enrolling in clinical trials

Clinical trials within the US face an increasing challenge with the recruitment of quality candidates. One readily available group of subjects that have high rates of participation in clinical research are subjects who enroll in multiple trials for the purpose of generating income through study payments. Aside from issues of safety and generalizability, evidence suggests that these subjects employ methods of deception to qualify for the strict entrance criteria of some studies, including concealing information and fabricating information. Including these subjects in research poses a significant risk to the integrity of data quality and study designs. Strategies to limit enrollment of subjects whose motivation is generating income have not been systematically addressed in the literature. The present paper is intended to provide investigators with a range of strategies for developing and implementing a study protocol with protections to minimize the enrollment of subjects whose primary motivation for enrolling is to generate income. This multifaceted approach includes recommendations for advertising strategies, payment strategies, telephone screening strategies, and baseline screening strategies. The approach also includes recommendations for attending to inconsistent study data and subject motivation. Implementing these strategies may be more or less important depending upon the vulnerability of the study design to subject deception. Although these strategies may help researchers exclude subjects with a higher rate of deceptive practices, widespread adoption of subject registries would go a long way to decrease the chances of subjects enrolling in multiple studies or more than once in the same study.

Considerations in the Evaluation of Potential Efficacy of Medications for Alcohol and Drug Use Disorders: An Editorial

The societal burden created by alcohol and drug use disorders is estimated to be on the order of hundreds of billions of dollars, creating a need for effective medications to reduce use and prevent relapse. While there are FDA-approved medications to facilitate abstinence and prevent relapse for some indications including, alcohol, tobacco, and opiate use disorders, there are no approved treatments for other abused substances, including cocaine, methamphetamine, and cannabis, leaving these critical medical needs unmet. The development of such medications has fallen largely to the government with efforts spearheaded by the National Institute on Drug Abuse and the National Institute on Alcoholism and Alcohol Abuse. Both agencies have medication development programs with preclinical components that include the standardized evaluation of compounds using animal models. This chapter describes the rationale and considerations involved in the use of such models, including reinstatement of drug self-administration.

Mitigating the Effects of Nonadherence in Clinical Trials

Accounting for subject nonadherence and eliminating inappropriate subjects in clinical trials are critical elements of a successful study. Nonadherence can increase variance, lower study power, and reduce the magnitude of treatment effects. Inappropriate subjects (including those who do not have the illness under study, fail to report exclusionary conditions, falsely report medication adherence, or participate in concurrent trials) confound safety and efficacy signals. This paper, a product of the International Society for CNS Clinical Trial Methodology (ISCTM) Working Group on Nonadherence in Clinical Trials, explores and models nonadherence in clinical trials and puts forth specific recommendations to identify and mitigate its negative effects. These include statistical analyses of nonadherence data, novel protocol design, and the use of biomarkers, subject registries, and/or medication adherence technologies.

Methodological issues associated with preclinical drug development and increased placebo effects in schizophrenia clinical trials

Recent failures to detect efficacy in clinical trials investigating pharmacological treatments for schizophrenia raise concerns regarding the potential contribution of methodological shortcomings to this research. This review provides an examination of two key methodological issues currently suspected of playing a role in hampering schizophrenia drug development; 1) limitations on the translational utility of preclinical development models, and 2) methodological challenges posed by increased placebo effects. Recommendations for strategies to address these methodological issues are addressed.