Appropriate statistical methods for analysing partially nested randomised controlled trials with continuous outcomes: a simulation study

The Effectiveness of GenerationPMTO During Sustained Implementation in the Public Mental Health System: A Single-Arm Open Trial Evaluation

To support families and reduce the burden of child mental, emotional, and behavioral problems, evidence-based parenting interventions must remain effective in real-world service delivery contexts. The purpose of the current study was to evaluate the effectiveness of the GenerationPMTO (GenPMTO) intervention during sustained implementation in the Michigan public mental health system using a single-arm open trial (pre-post) design. We also examined potential predictors of treatment response. A multilevel analysis framework was utilized to evaluate data from 365 caregivers who completed GenPMTO treatment. Results revealed significant positive improvements from pretest to posttest in all four outcome domains (i.e., parenting confidence, parenting practices, caregiver depressive symptoms, child behavior problems). When compared to group-based GenPMTO delivery, the individual delivery format was associated with significantly greater improvements in overall effective parenting practices, as well as in the subdomain of skill encouragement. Caregiver gender, caregiver educational level, and child age were all implicated as predictors of GenPMTO outcomes. These findings add to the literature by supporting the effectiveness of the GenPMTO intervention when fully integrated into mental health care practice and can inform continued efforts to provide families with evidence-based services in community settings.

Effects of socioeconomic status on baseline values and outcomes at 24 months in the Treatment of Advanced Glaucoma Study randomised controlled Trial

BACKGROUND/AIMS

Socioeconomic status (SES) is associated with late disease presentation and poorer outcomes. We evaluate the effect of SES on treatment outcomes and report the correlation between SES and baseline characteristics of participants in the Treatment of Advanced Glaucoma Study.

METHODS

Pragmatic multicentre randomised controlled trial. Four hundred and fifty-three patients presenting with advanced open-angle glaucoma in at least one eye (Hodapp-Parrish-Anderson classification). Participants were randomised to either glaucoma drops (medical arm) or trabeculectomy (surgery arm). Clinical characteristics, Quality of life measurement (QoL) and SES defined by the Index of Multiple Deprivation are reported. Subgroup analysis explored treatment effect modifications of SES at 24 months. Correlation between SES and baseline characteristics was tested with the χ2 test of association for dichotomous variables and pairwise Pearson's correlation for continuous variables.

RESULTS

The mean visual field mean deviation was -17.2 (6.7)dB for the most deprived quintile of participants and -13.0 (5.5) for the least deprived quintile in the index eye. At diagnosis, there was a strong correlation between SES and ethnicity, age, extent of visual field loss and number of visits to opticians prior to diagnosis. At 24 months, there was no evidence that the treatment effect was moderated by SES.

CONCLUSIONS

In patients presenting with advanced glaucoma. SES at baseline is correlated with poorer visual function, poorer Visual Function Questionnaire-25 QoL, ethnicity, age and number visits to an optician in the years preceding diagnosis. SES at baseline does not have an effect of the success of treatment at 24 months.

TRIAL REGISTRATION NUMBER

ISRCTN56878850.

Evaluating Primary Treatment for People with Advanced Glaucoma: Five-Year Results of the Treatment of Advanced Glaucoma Study

PURPOSE

To determine whether primary trabeculectomy or medical treatment produces better outcomes in terms of quality of life (QoL), clinical effectiveness, and safety in patients with advanced glaucoma.

DESIGN

Multicenter randomized controlled trial.

PARTICIPANTS

Between June 3, 2014, and May 31, 2017, 453 adults with newly diagnosed advanced open-angle glaucoma in at least 1 eye (Hodapp classification) were recruited from 27 secondary care glaucoma departments in the United Kingdom. Two hundred twenty-seven were allocated to trabeculectomy, and 226 were allocated medical management.

METHODS

Participants were randomized on a 1:1 basis to have either mitomycin C-augmented trabeculectomy or escalating medical management with intraocular pressure (IOP)-reducing drops as the primary intervention and were followed up for 5 years.

MAIN OUTCOME MEASURES

The primary outcome was vision-specific QoL measured with the 25-item Visual Function Questionnaire (VFQ-25) at 5 years. Secondary outcomes were general health status, glaucoma-related QoL, clinical effectiveness (IOP, visual field, and visual acuity), and safety.

RESULTS

At 5 years, the mean ± standard deviation VFQ-25 scores in the trabeculectomy and medication arms were 83.3 ± 15.5 and 81.3 ± 17.5, respectively, and the mean difference was 1.01 (95% confidence interval [CI], -1.99 to 4.00; P = 0.51). The mean IOPs were 12.07 ± 5.18 mmHg and 14.76 ± 4.14 mmHg, respectively, and the mean difference was -2.56 (95% CI, -3.80 to -1.32; P < 0.001). Glaucoma severity measured with visual field mean deviation were -14.30 ± 7.14 dB and -16.74 ± 6.78 dB, respectively, with a mean difference of 1.87 (95% CI, 0.87-2.87 dB; P < 0.001). Safety events occurred in 115 (52.2%) of patients in the trabeculectomy arm and 124 (57.9%) of patients in the medication arm (relative risk, 0.92; 95% CI, 0.72-1.19; P = 0.54). Serious adverse events were rare.

CONCLUSIONS

At 5 years, the Treatment of Advanced Glaucoma Study demonstrated that primary trabeculectomy surgery is more effective in lowering IOP and preventing disease progression than primary medical treatment in patients with advanced disease and has a similar safety profile.

FINANCIAL DISCLOSURE(S)

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

A tailored psychological intervention for anxiety and depression management in people with chronic obstructive pulmonary disease: TANDEM RCT and process evaluation

Background

People with chronic obstructive pulmonary disease have high levels of anxiety and depression, which is associated with increased morbidity and poor uptake of effective treatments, such as pulmonary rehabilitation. Cognitive-behavioural therapy improves mental health of people with long-term conditions and could potentially increase uptake of pulmonary rehabilitation, enabling synergies that could enhance the mental health of people with chronic obstructive pulmonary disease.

Aim

Our aim was to develop and evaluate the clinical effectiveness and cost effectiveness of a tailored cognitive-behavioural approach intervention, which links into, and optimises the benefits of, routine pulmonary rehabilitation.

Design

We carried out a pragmatic multicentre randomised controlled trial using a 1.25 : 1 ratio (intervention : control) with a parallel process evaluation, including assessment of fidelity.

Setting

Twelve NHS trusts and five Clinical Commissioning Groups in England were recruited into the study. The intervention was delivered in participant's own home or at a local NHS facility, and by telephone.

Participants

Between July 2017 and March 2020 we recruited adults with moderate/very severe chronic obstructive pulmonary disease and mild/moderate anxiety and/or depression, meeting eligibility criteria for assessment for pulmonary rehabilitation. Carers of participants were invited to participate.

Intervention

The cognitive-behavioural approach intervention (i.e. six to eight 40- to 60-minute sessions plus telephone support throughout pulmonary rehabilitation) was delivered by 31 trained respiratory healthcare professionals to participants prior to commencing pulmonary rehabilitation. Usual care included routine pulmonary rehabilitation referral.

Main outcome measures

Co-primary outcomes were Hospital Anxiety and Depression Scale - anxiety and Hospital Anxiety and Depression Scale - depression at 6 months post randomisation. Secondary outcomes at 6 and 12 months included health-related quality of life, smoking status, uptake of pulmonary rehabilitation and healthcare use.

Results

We analysed results from 423 randomised participants (intervention, n = 242; control, n = 181). Forty-three carers participated. Follow-up at 6 and 12 months was 93% and 82%, respectively. Despite good fidelity for intervention delivery, mean between-group differences in Hospital Anxiety and Depression Scale at 6 months ruled out clinically important effects (Hospital Anxiety and Depression Scale - anxiety mean difference -0.60, 95% confidence interval -1.40 to 0.21; Hospital Anxiety and Depression Scale - depression mean difference -0.66, 95% confidence interval -1.39 to 0.07), with similar results at 12 months. There were no between-group differences in any of the secondary outcomes. Sensitivity analyses did not alter these conclusions. More adverse events were reported for intervention participants than for control participants, but none related to the trial. The intervention did not generate quality-of-life improvements to justify the additional cost (adjusted mean difference £770.24, 95% confidence interval -£27.91 to £1568.39) to the NHS. The intervention was well received and many participants described positive affects on their quality of life. Facilitators highlighted the complexity of participants' lives and considered the intervention to be of potential valuable; however, the intervention would be difficult to integrate within routine clinical services. Our well-powered trial delivered a theoretically designed intervention with good fidelity. The respiratory-experienced facilitators were trained to deliver a low-intensity cognitive-behavioural approach intervention, but high-intensity cognitive-behavioural therapy might have been more effective. Our broad inclusion criteria specified objectively assessed anxiety and/or depression, but participants were likely to favour talking therapies. Randomisation was concealed and blinding of outcome assessment was breached in only 15 participants.

Conclusions

The tailored cognitive-behavioural approach intervention delivered with fidelity by trained respiratory healthcare professionals to people with chronic obstructive pulmonary disease was neither clinically effective nor cost-effective. Alternative approaches that are integrated with routine long-term condition care are needed to address the unmet, complex clinical and psychosocial needs of this group of patients.

Trial registration

This trial is registered as ISRCTN59537391.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 13/146/02) and is published in full in Health Technology Assessment; Vol. 28, No. 1. See the NIHR Funding and Awards website for further award information.

Comparison of diagnosis-based risk adjustment methods for episode-based costs to apply in efficiency measurement

BACKGROUND

The recent rising health spending intrigued efficiency and cost-based performance measures. However, mortality risk adjustment methods are still under consideration in cost estimation, though methods specific to cost estimate have been developed. Therefore, we aimed to compare the performance of diagnosis-based risk adjustment methods based on the episode-based cost to utilize in efficiency measurement.

METHODS

We used the Health Insurance Review and Assessment Service-National Patient Sample as the data source. A separate linear regression model was constructed within each Major Diagnostic Category (MDC). Individual models included explanatory (demographics, insurance type, institutional type, Adjacent Diagnosis Related Group [ADRG], diagnosis-based risk adjustment methods) and response variables (episode-based costs). The following risk adjustment methods were used: Refined Diagnosis Related Group (RDRG), Charlson Comorbidity Index (CCI), National Health Insurance Service Hierarchical Condition Categories (NHIS-HCC), and Department of Health and Human Service-HCC (HHS-HCC). The model accuracy was compared using R-squared (R2), mean absolute error, and predictive ratio. For external validity, we used the 2017 dataset.

RESULTS

The model including RDRG improved the mean adjusted R2 from 40.8% to 45.8% compared to the adjacent DRG. RDRG was inferior to both HCCs (RDRG adjusted R2 45.8%, NHIS-HCC adjusted R2 46.3%, HHS-HCC adjusted R2 45.9%) but superior to CCI (adjusted R2 42.7%). Model performance varied depending on the MDC groups. While both HCCs had the highest explanatory power in 12 MDCs, including MDC P (Newborns), RDRG showed the highest adjusted R2 in 6 MDCs, such as MDC O (pregnancy, childbirth, and puerperium). The overall mean absolute errors were the lowest in the model with RDRG ($1,099). The predictive ratios showed similar patterns among the models regardless of the  subgroups according to age, sex, insurance type, institutional type, and the upper and lower 10th percentiles of actual costs. External validity also showed a similar pattern in the model performance.

CONCLUSIONS

Our research showed that either NHIS-HCC or HHS-HCC can be useful in adjusting comorbidities for episode-based costs in the process of efficiency measurement.

Tailored psychological intervention for anxiety or depression in COPD (TANDEM): a randomised controlled trial

BACKGROUND

The TANDEM multicentre, pragmatic, randomised controlled trial evaluated whether a tailored psychological intervention based on a cognitive behavioural approach for people with COPD and symptoms of anxiety and/or depression improved anxiety or depression compared with usual care (control).

METHODS

People with COPD and moderate to very severe airways obstruction and Hospital Anxiety and Depression Scale subscale scores indicating mild to moderate anxiety (HADS-A) and/or depression (HADS-D) were randomised 1.25:1 (242 intervention and 181 control). Respiratory health professionals delivered the intervention face-to-face over 6-8 weeks. Co-primary outcomes were HADS-A and HADS-D measured 6 months post-randomisation. Secondary outcomes at 6 and 12 months included: HADS-A and HADS-D (12 months), Beck Depression Inventory II, Beck Anxiety Inventory, St George's Respiratory Questionnaire, social engagement, the EuroQol instrument five-level version (EQ-5D-5L), smoking status, completion of pulmonary rehabilitation, and health and social care resource use.

RESULTS

The intervention did not improve anxiety (HADS-A mean difference -0.60, 95% CI -1.40-0.21) or depression (HADS-D mean difference -0.66, 95% CI -1.39-0.07) at 6 months. The intervention did not improve any secondary outcomes at either time-point, nor did it influence completion of pulmonary rehabilitation or healthcare resource use. Deaths in the intervention arm (13/242; 5%) exceeded those in the control arm (3/181; 2%), but none were associated with the intervention. Health economic analysis found the intervention highly unlikely to be cost-effective.

CONCLUSION

This trial has shown, beyond reasonable doubt, that this cognitive behavioural intervention delivered by trained and supervised respiratory health professionals does not improve psychological comorbidity in people with advanced COPD and depression or anxiety.

Stress and Depression Are Associated with Sexual Function and Satisfaction in Young Men Who Have Sex with Men

Prior research suggests that better mental health and higher relationship quality are associated with better sexual function and satisfaction. Such insights can inform intervention development for mental, relationship, and sexual health concerns. This study examined the interactions among these variables in a racially and ethnically diverse group of young men who have sex with men (YMSM) in serious relationships (N = 348). Data were drawn from wave 5 of a longitudinal cohort study. We examined cross-sectional associations between depression and stress (predictors) and sexual function, sexual satisfaction, and anal discomfort (outcomes) and to what extent these associations were moderated by relationship quality. Higher endorsement of depression and stress was associated with worse sexual functioning, lower sexual satisfaction, and more anal discomfort. We also found that fewer negative interactions, stronger commitment, and higher relationship satisfaction were associated with better sexual functioning and higher sexual satisfaction. Higher relationship satisfaction and commitment were found to attenuate the association between stress and sexual satisfaction. Contrary to expectations, higher relationship satisfaction also showed a trend toward exacerbating the association between depression and sexual functioning. These results suggest that, for YMSM, high relationship satisfaction and commitment may protect sexual satisfaction from being negatively impacted by high stress. However, YMSM in highly satisfying relationships may experience poor sexual functioning associated with depression as particularly distressing. This study addressed a major gap in the literature by focusing on mental, relationship, and sexual health in a diverse sample. Future research should examine a wider range of sexual functioning outcomes and include minority stress in study design.

Cognitive functional therapy with or without movement sensor biofeedback versus usual care for chronic, disabling low back pain (RESTORE): a randomised, controlled, three-arm, parallel group, phase 3, clinical trial

BACKGROUND

Low back pain is the leading cause of years lived with disability globally, but most interventions have only short-lasting, small to moderate effects. Cognitive functional therapy (CFT) is an individualised approach that targets unhelpful pain-related cognitions, emotions, and behaviours that contribute to pain and disability. Movement sensor biofeedback might enhance treatment effects. We aimed to compare the effectiveness and economic efficiency of CFT, delivered with or without movement sensor biofeedback, with usual care for patients with chronic, disabling low back pain.

METHODS

RESTORE was a randomised, controlled, three-arm, parallel group, phase 3 trial, done in 20 primary care physiotherapy clinics in Australia. We recruited adults (aged ≥18 years) with low back pain lasting more than 3 months with at least moderate pain-related physical activity limitation. Exclusion criteria were serious spinal pathology (eg, fracture, infection, or cancer), any medical condition that prevented being physically active, being pregnant or having given birth within the previous 3 months, inadequate English literacy for the study's questionnaires and instructions, a skin allergy to hypoallergenic tape adhesives, surgery scheduled within 3 months, or an unwillingness to travel to trial sites. Participants were randomly assigned (1:1:1) via a centralised adaptive schedule to usual care, CFT only, or CFT plus biofeedback. The primary clinical outcome was activity limitation at 13 weeks, self-reported by participants using the 24-point Roland Morris Disability Questionnaire. The primary economic outcome was quality-adjusted life-years (QALYs). Participants in both interventions received up to seven treatment sessions over 12 weeks plus a booster session at 26 weeks. Physiotherapists and patients were not masked. This trial is registered with the Australian New Zealand Clinical Trials Registry, ACTRN12618001396213.

FINDINGS

Between Oct 23, 2018 and Aug 3, 2020, we assessed 1011 patients for eligibility. After excluding 519 (51·3%) ineligible patients, we randomly assigned 492 (48·7%) participants; 164 (33%) to CFT only, 163 (33%) to CFT plus biofeedback, and 165 (34%) to usual care. Both interventions were more effective than usual care (CFT only mean difference -4·6 [95% CI -5·9 to -3·4] and CFT plus biofeedback mean difference -4·6 [-5·8 to -3·3]) for activity limitation at 13 weeks (primary endpoint). Effect sizes were similar at 52 weeks. Both interventions were also more effective than usual care for QALYs, and much less costly in terms of societal costs (direct and indirect costs and productivity losses; -AU$5276 [-10 529 to -24) and -8211 (-12 923 to -3500).

INTERPRETATION

CFT can produce large and sustained improvements for people with chronic disabling low back pain at considerably lower societal cost than that of usual care.

FUNDING

Australian National Health and Medical Research Council and Curtin University.

Reducing Opioid Use for Chronic Pain With a Group-Based Intervention: A Randomized Clinical Trial

Importance

Opioid use for chronic nonmalignant pain can be harmful.

Objective

To test whether a multicomponent, group-based, self-management intervention reduced opioid use and improved pain-related disability compared with usual care.

Design, Setting, and Participants

Multicentered, randomized clinical trial of 608 adults taking strong opioids (buprenorphine, dipipanone, morphine, diamorphine, fentanyl, hydromorphone, methadone, oxycodone, papaveretum, pentazocine, pethidine, tapentadol, and tramadol) to treat chronic nonmalignant pain. The study was conducted in 191 primary care centers in England between May 17, 2017, and January 30, 2019. Final follow-up occurred March 18, 2020.

Intervention

Participants were randomized 1:1 to either usual care or 3-day-long group sessions that emphasized skill-based learning and education, supplemented by 1-on-1 support delivered by a nurse and lay person for 12 months.

Main Outcomes and Measures

The 2 primary outcomes were Patient-Reported Outcomes Measurement Information System Pain Interference Short Form 8a (PROMIS-PI-SF-8a) score (T-score range, 40.7-77; 77 indicates worst pain interference; minimal clinically important difference, 3.5) and the proportion of participants who discontinued opioids at 12 months, measured by self-report.

Results

Of 608 participants randomized (mean age, 61 years; 362 female [60%]; median daily morphine equivalent dose, 46 mg [IQR, 25 to 79]), 440 (72%) completed 12-month follow-up. There was no statistically significant difference in PROMIS-PI-SF-8a scores between the 2 groups at 12-month follow-up (-4.1 in the intervention and -3.17 in the usual care groups; between-group difference: mean difference, -0.52 [95% CI, -1.94 to 0.89]; P = .15). At 12 months, opioid discontinuation occurred in 65 of 225 participants (29%) in the intervention group and 15 of 208 participants (7%) in the usual care group (odds ratio, 5.55 [95% CI, 2.80 to 10.99]; absolute difference, 21.7% [95% CI, 14.8% to 28.6%]; P < .001). Serious adverse events occurred in 8% (25/305) of the participants in the intervention group and 5% (16/303) of the participants in the usual care group. The most common serious adverse events were gastrointestinal (2% in the intervention group and 0% in the usual care group) and locomotor/musculoskeletal (2% in the intervention group and 1% in the usual care group). Four people (1%) in the intervention group received additional medical care for possible or probable symptoms of opioid withdrawal (shortness of breath, hot flushes, fever and pain, small intestinal bleed, and an overdose suicide attempt).

Conclusions and Relevance

In people with chronic pain due to nonmalignant causes, compared with usual care, a group-based educational intervention that included group and individual support and skill-based learning significantly reduced patient-reported use of opioids, but had no effect on perceived pain interference with daily life activities.

Trial Registration

isrctn.org Identifier: ISRCTN49470934.

Sickle Cell Trevor Thompson Transition Project (ST3P-UP) protocol for managing care transitions: Methods and rationale

BACKGROUND

Emerging adults with sickle cell disease (EASCD) experience significant challenges transitioning from pediatric to adult care. Acute care utilization increases, quality of life (QOL) declines, with an increased risk of mortality. Currently, there are no practice standards to guide emerging adults through the transition process. We are creating a structured transition education (STE) based program for EASCD by customizing the Six Core Elements (6 CE) of Health Care Transition model and are evaluating the effectiveness of adding peer mentoring (PM).

METHODS

The Sickle Cell Trevor Thompson Transition Project (ST3P-UP) is an ongoing multi-site, cluster randomized clinical trial with a target enrollment of 537 EASCD aged 16 to 25 years in pediatric care. Each site (n = 14) comprises a pediatric clinic, adult clinic, and a sickle cell disease (SCD) community-based organization (CBO). Sites are randomized 1:1 to either STE or STE + PM. EASCDs are followed prospectively for 24 months. Rapid cycle plan-do-study-act quality improvement (QI) methods are used to implement the STE. The primary objective is to compare the effectiveness of STE + PM versus STE only at decreasing the number of acute care visits per year over 24 months. The secondary objectives are to compare overall healthcare utilization and patient-reported QOL outcomes at 24 months.

CONCLUSION

We aim to demonstrate the feasibility of using a QI approach to implement 6 CE-based practice standards at 14 disparate SCD clinical programs to guide EASCD through the transition process. We hypothesize that adding PM to the STE program will improve acute care reliance, QOL, and satisfaction with transition outcomes.

Effectiveness and cost-effectiveness of a personalised self-management intervention for living with long COVID: protocol for the LISTEN randomised controlled trial

BACKGROUND

Individuals living with long COVID experience multiple, interacting and fluctuating symptoms which can have a dramatic impact on daily living. The aim of the Long Covid Personalised Self-managemenT support EvaluatioN (LISTEN) trial is to evaluate effects of the LISTEN co-designed self-management support intervention for non-hospitalised people living with long COVID on participation in routine activities, social participation, emotional well-being, quality of life, fatigue, and self-efficacy. Cost-effectiveness will also be evaluated, and a detailed process evaluation carried out to understand how LISTEN is implemented.

METHODS

The study is a pragmatic randomised effectiveness and cost-effectiveness trial in which a total of 558 non-hospitalised people with long COVID will be randomised to either the LISTEN intervention or usual care. Recruitment strategies have been developed with input from the LISTEN Patient and Public Involvement and Engagement (PPIE) advisory group and a social enterprise, Diversity and Ability, to ensure inclusivity. Eligible participants can self-refer into the trial via a website or be referred by long COVID services. All participants complete a range of self-reported outcome measures, online, at baseline, 6 weeks, and 3 months post randomisation (the trial primary end point). Those randomised to the LISTEN intervention are offered up to six one-to-one sessions with LISTEN-trained intervention practitioners and given a co-designed digital resource and paper-based book. A detailed process evaluation will be conducted alongside the trial to inform implementation approaches should the LISTEN intervention be found effective and cost-effective.

DISCUSSION

The LISTEN trial is evaluating a co-designed, personalised self-management support intervention (the LISTEN intervention) for non-hospitalised people living with long COVID. The design has incorporated extensive strategies to minimise participant burden and maximise access. Whilst the duration of follow-up is limited, all participants are approached to consent for long-term follow-up (subject to additional funding being secured).

TRIAL REGISTRATION

LISTEN ISRCTN36407216. Registered on 27/01/2022.

Randomization, design and analysis for interdependency in aging research: no person or mouse is an island

Investigators traditionally use randomized designs and corresponding analysis procedures to make causal inferences about the effects of interventions, assuming independence between an individual's outcome and treatment assignment and the outcomes of other individuals in the study. Often, such independence may not hold. We provide examples of interdependency in model organism studies and human trials and group effects in aging research and then discuss methodologic issues and solutions. We group methodologic issues as they pertain to (1) single-stage individually randomized trials; (2) cluster-randomized controlled trials; (3) pseudo-cluster-randomized trials; (4) individually randomized group treatment; and (5) two-stage randomized designs. Although we present possible strategies for design and analysis to improve the rigor, accuracy and reproducibility of the science, we also acknowledge real-world constraints. Consequences of nonadherence, differential attrition or missing data, unintended exposure to multiple treatments and other practical realities can be reduced with careful planning, proper study designs and best practices.

Comparison of Prior Setting Methods for Multilevel Model Effect Estimation Based on Small Sample Imbalanced Nested Data in Bayesian Framework

In the fields of education and psychology, nested data with small samples and imbalances are very common. Bauer et al. (2008) first proposed adjusting the traditional multilevel model to analyze the small sample imbalanced nested data (SSIND). In terms of parameter estimation, the Bayesian method shows the possibility of providing unbiased estimation when the sample size is small. This study proposes that the Bayesian method should be used to analyze the SSIND. This study explores the performance of different treatment effects and nesting effects estimation methods in the multilevel model based on the Bayesian method that performs well in the case of small samples, to provide an appropriate and scientific method reference for the subsequent analysis of the model. Two prior setting methods are compared for multilevel model effect estimation based on a small sample of imbalanced nested data in the Bayesian framework. Two prior setting methods are gamma prior setting method and uniform prior setting method. The research results show that when the treatment condition ICC is small (0.05), the bias and RMSE values of the parameter estimation by the gamma prior setting method are larger and the performance is unstable, while the bias and RMSE values of the parameter estimation by the uniform prior setting method are smaller and the performance is relatively stable, so the uniform prior setting method is recommended; when the treatment condition ICC is large (0.15), the bias and RMSE values of the parameter estimation by the uniform prior setting method are larger and the performance is unstable, while the bias and RMSE values of the parameter estimation by the gamma prior setting method are smaller and the performance is relatively stable, so the gamma prior setting method is recommended; when the treatment condition ICC is between 0.05 and 0.15, both prior setting methods have similar effects. Furthermore, when the number of treatment groups is small (8), the gamma prior setting method is recommended; when the number of treatment groups is large (16), the uniform prior setting method is recommended; when the number of treatment groups is between 8 and 16, both prior setting methods have similar effects. Summarily, when we choose which prior setting method to use for the SSIND, we must consider the interaction between the ICC and the number of treatment groups.

Implementation and Evaluation of a Digitally Enabled Precision Public Health Intervention to Reduce Inappropriate Gabapentinoid Prescription: Cluster Randomized Controlled Trial

Background

Digital technologies can enable rapid targeted delivery of audit and feedback interventions at scale. Few studies have evaluated how mode of delivery affects clinical professional behavior change and none have assessed the feasibility of such an initiative at a national scale.

Objective

The aim of this study was to develop and evaluate the effect of audit and feedback by digital versus postal (letter) mode of delivery on primary care physician behavior.

Methods

This study was developed as part of the Veterans’ Medicines Advice and Therapeutics Education Services (MATES) program, an intervention funded by the Australian Government Department of Veterans’ Affairs that provides targeted education and patient-specific audit with feedback to Australian general practitioners, as well as educational material to veterans and other health professionals. We performed a cluster randomized controlled trial of a multifaceted intervention to reduce inappropriate gabapentinoid prescription, comparing digital and postal mode of delivery. All veteran patients targeted also received an educational intervention (postal delivery). Efficacy was measured using a linear mixed-effects model as the average number of gabapentinoid prescriptions standardized by defined daily dose (individual level), and number of veterans visiting a psychologist in the 6 and 12 months following the intervention.

Results

The trial involved 2552 general practitioners in Australia and took place in March 2020. Both intervention groups had a significant reduction in total gabapentinoid prescription by the end of the study period (digital: mean reduction of 11.2%, P=.004; postal: mean reduction of 11.2%, P=.001). We found no difference between digital and postal mode of delivery in reduction of gabapentinoid prescriptions at 12 months (digital: –0.058, postal: –0.058, P=.98). Digital delivery increased initiations to psychologists at 12 months (digital: 3.8%, postal: 2.0%, P=.02).

Conclusions

Our digitally delivered professional behavior change intervention was feasible, had comparable effectiveness to the postal intervention with regard to changes in medicine use, and had increased effectiveness with regard to referrals to a psychologist. Given the logistical benefits of digital delivery in nationwide programs, the results encourage exploration of this mode in future interventions.

Early positive approaches to support for families of young children with intellectual disability: the E-PAtS feasibility RCT

Background

Parents of children with intellectual disability are 1.5–2 times more likely than other parents to report mental health difficulties. There is a lack of clinically effective and cost-effective group well-being interventions designed for family carers of young children with intellectual disability.

Aim

To examine the feasibility of a randomised controlled trial of the clinical effectiveness and cost-effectiveness of the Early Positive Approaches to Support (E-PAtS) intervention.

Design

A feasibility study (including randomisation of families into a two-arm trial), questionnaires to assess the feasibility of proposed outcome measures (including resource use and health-related quality of life) and practitioner/family carer interviews. An additional question was included in an online UK survey of families, conducted by the research team to assess usual practice, and a survey of provider organisations.

Setting

Families recruited from community contexts (i.e. third sector, local authority services, special schools) and self-referral. The E-PAtS intervention was delivered by trained community-based providers.

Participants

Families with at least one child aged 1.5–5 years with an intellectual disability. At least one parent had to have English-language ability (spoken) for E-PAtS programme participation and participants had to provide informed consent.

Interventions

E-PAtS intervention – two caregivers from each family invited to eight 2.5-hour group sessions with usual practice. Usual practice – other support provided to the family, including other parenting support.

Objectives

To assess randomisation willingness/feasibility, recruitment of providers/parents, retention, usual practice, adherence, fidelity and feasibility of proposed outcome measures (including the Warwick–Edinburgh Mental Well-Being Scale as the proposed primary outcome measure, and parent anxiety/depression, parenting, family functioning/relationships, child behavioural/emotional problems and adaptive skills, child and parent quality of life, and family services receipt as the proposed secondary outcome measures).

Results

Seventy-four families (95 carers) were recruited from three sites (with 37 families allocated to the intervention). From referrals, the recruitment rate was 65% (95% confidence interval 56% to 74%). Seventy-two per cent of families were retained at the 12-month follow-up (95% confidence interval 60% to 81%). Exploratory regression analysis showed that the mean Warwick–Edinburgh Mental Well-Being Scale well-being score was 3.96 points higher in the intervention group (95% confidence interval –1.39 to 9.32 points) at 12 months post randomisation. High levels of data completeness were achieved on returned questionnaires. Interviews (n = 25) confirmed that (1) recruitment, randomisation processes and the intervention were acceptable to family carers, E-PAtS facilitators and community staff; (2) E-PAtS delivery were consistent with the logic model; and (3) researchers requesting consent in future for routine data would be acceptable. Recorded E-PAtS sessions demonstrated good fidelity (96% of components present). Adherence (i.e. at least one carer from the family attending five out of eight E-PAtS sessions) was 76%. Health-related quality-of-life and services receipt data were gathered successfully. An online UK survey to assess usual practice (n = 673) showed that 10% of families of young children with intellectual disability received any intervention over 12 months. A provider survey (n = 15) indicated willingness to take part in future research.

Limitations

Obtaining session recordings for fidelity was difficult. Recruitment processes need to be reviewed to improve diversity and strategies are needed to improve primary outcome completion.

Conclusions

Study processes were feasible. The E-PAtS intervention was well received and outcomes for families were positive. A barrier to future organisation participation is funding for intervention costs. A definitive trial to test the clinical effectiveness and cost-effectiveness of E-PAtS would be feasible.

Trial registration

Current Controlled Trials ISRCTN70419473.

Funding

This project was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full in Public Health Research; Vol. 10, No. 2. See the NIHR Journals Library website for further project information.

Effectiveness and cost-effectiveness of a structured social coaching intervention for people with psychosis (SCENE): protocol for a randomised controlled trial

INTRODUCTION

People with psychosis tend to have smaller social networks than both people in the general population and other people with long-term health conditions. Small social networks are associated with poor quality of life. Preliminary evidence suggests that coaching patients to increase their social contacts may be effective. In this study, we assessed whether structured social coaching improves the quality of life of patients with psychosis (primary outcome) compared with an active control group, receiving information on local social activities.

METHODS AND ANALYSIS

A structured social coaching intervention was developed based on the literature and refined through stakeholder involvement. It draws on principles from motivational interviewing, solution focused therapy and structured information giving. It is provided over a 6-month period and can be delivered by a range of different mental health professionals. Its effectiveness and cost-effectiveness are assessed in a randomised controlled trial, compared with an active control group, in which participants are given an information booklet on local social activities. Participants are aged 18 or over, have a primary diagnosis of a psychotic disorder (International Classification of Disease: F20-29) and capacity to provide informed consent. Participants are assessed at baseline and at 6, 12 and 18 months after individual randomisation. The primary outcome is quality of life at 6 months (Manchester Short Assessment of Quality of Life). We hypothesise that the effects on quality of life are mediated by an increase in social contacts. Secondary outcomes are symptoms, social situation and time spent in social activities. Costs and cost-effectiveness analyses will consider service use and health-related quality of life.

ETHICS AND DISSEMINATION

National Health Service REC London Hampstead (19/LO/0088) provided a favourable opinion. Findings will be disseminated through a website, social media, scientific papers and user-friendly reports, in collaboration with a lived experience advisory panel.

TRIAL REGISTRATION NUMBER

ISRCTN15815862.

Primary trabeculectomy versus primary glaucoma eye drops for newly diagnosed advanced glaucoma: TAGS RCT

BACKGROUND

Patients diagnosed with advanced primary open-angle glaucoma are at a high risk of lifetime blindness. Uncertainty exists about whether primary medical management (glaucoma eye drops) or primary surgical treatment (augmented trabeculectomy) provide the best and safest patient outcomes.

OBJECTIVES

To compare primary medical management with primary surgical treatment (augmented trabeculectomy) in patients with primary open-angle glaucoma presenting with advanced disease in terms of health-related quality of life, clinical effectiveness, safety and cost-effectiveness.

DESIGN

This was a two-arm, parallel, multicentre, pragmatic randomised controlled trial.

SETTING

Secondary care eye services.

PARTICIPANTS

Adult patients presenting with advanced primary open-angle glaucoma in at least one eye, as defined by the Hodapp-Parrish-Anderson classification of severe glaucoma.

INTERVENTION

Primary medical treatment - escalating medical management with glaucoma eye drops. Primary trabeculectomy treatment - trabeculectomy augmented with mitomycin C.

MAIN OUTCOME MEASURES

The primary outcome was health-related quality of life measured with the Visual Function Questionnaire-25 at 2 years post randomisation. Secondary outcomes were mean intraocular pressure; EQ-5D-5L; Health Utilities Index 3; Glaucoma Utility Index; cost and cost-effectiveness; generic, vision-specific and disease-specific health-related quality of life; clinical effectiveness; and safety.

RESULTS

A total of 453 participants were recruited. The mean age of the participants was 67 years (standard deviation 12 years) in the trabeculectomy arm and 68 years (standard deviation 12 years) in the medical management arm. Over 65% of participants were male and more than 80% were white. At 24 months, the mean difference in Visual Function Questionnaire-25 score was 1.06 (95% confidence interval -1.32 to 3.43; p = 0.383). There was no evidence of a difference between arms in the EQ-5D-5L score, the Health Utilities Index or the Glaucoma Utility Index. At 24 months, the mean intraocular pressure was 12.40 mmHg in the trabeculectomy arm and 15.07 mmHg in the medical management arm (mean difference -2.75 mmHg, 95% confidence interval -3.84 to -1.66 mmHg; p < 0.001). Fewer types of glaucoma eye drops were required in the trabeculectomy arm. LogMAR visual acuity was slightly better in the medical management arm (mean difference 0.07, 95% confidence interval 0.02 to 0.11; p = 0.006) than in the trabeculectomy arm. There was no evidence of difference in safety between the two arms. A discrete choice experiment updated the utility values for the Glaucoma Utility Index. The within-trial economic analysis found a small increase in the mean EQ-5D-5L score (0.04) and that trabeculectomy has a higher probability of being cost-effective than medical management. The incremental cost of trabeculectomy per quality-adjusted life-year was £45,456. Therefore, at 2 years, surgery is unlikely to be considered cost-effective at a threshold of £20,000 per quality-adjusted life-year. When extrapolated over a patient's lifetime in a model-based analysis, trabeculectomy, compared with medical treatment, was associated with higher costs (average £2687), a larger number of quality-adjusted life-years (average 0.28) and higher incremental cost per quality-adjusted life-year gained (average £9679). The likelihood of trabeculectomy being cost-effective at a willingness-to-pay threshold of £20,000 per quality-adjusted life year gained was 73%.

CONCLUSIONS

Our results suggested that there was no difference between treatment arms in health-related quality of life, as measured with the Visual Function Questionnaire-25 at 24 months. Intraocular pressure was better controlled in the trabeculectomy arm, and this may reduce visual field progression. Modelling over the patient's lifetime suggests that trabeculectomy may be cost-effective over the range of values of society's willingness to pay for a quality-adjusted life-year.

FUTURE WORK

Further follow-up of participants will allow us to estimate the long-term differences of disease progression, patient experience and cost-effectiveness.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN56878850.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 25, No. 72. See the NIHR Journals Library website for further project information.

Managing the difficult airway: A survey of doctors with different seniority in China

ABSTRACT

Although equipment and human resources are vital elements of difficult airway management (DAM). But the approach and practice of DAM are more important. So, we conducted the present survey to address anesthesiologists of different working years in this knowledge gap.This nationwide cross-sectional study was conducted from October 27, 2016 to November 27, 2016. The survey was completed online in New Youth Anesthesia Forum including DAM assessment, anticipated and unanticipated DAM, difficult airway algorithm, use of the front of neck access (FONA) technique and training, DAM outside the operation room, and difficult extubation management.We received 1935 replies (44%). Mouth opening and Mallampati classification were the most common methods to evaluate difficult airways. When suffering from unanticipated difficult airway 63% less than 10 years anesthesiologists (LA) and 65% more than 10 years anesthesiologists (MA) would ask for help after trying 1 to 2 times (P = .000). More than 70% of LA and MA respondents reported preferring cannula cricothyrotomy to deal with emergency airway, 507 (41.6%) MA respondents reported that they used FONA techniques to save patients' lives (P = .000). Nearly 70% respondents worried full stomach when intubated outside operation room and more than 80% respondents selected auscultation to identify the placement. More than 80% respondents had not used Bougie to assist extubation. A 73.2% respondents know ABS algorithm and 96.4% know Chinese airway expert consensus among MA respondents, this was significant to LA respondents (P = .000).The respondents in the LA and MA have a training gap in their evaluation of difficult airways, trained and used FONA emergency skills, facilitated of the airway guidelines at home and abroad. Also, we should provide more airway theory and skill training to our young doctors to advanced airway skills.

Primary trabeculectomy for advanced glaucoma: pragmatic multicentre randomised controlled trial (TAGS)

OBJECTIVE

To determine whether primary trabeculectomy or primary medical treatment produces better outcomes in term of quality of life, clinical effectiveness, and safety in patients presenting with advanced glaucoma.

DESIGN

Pragmatic multicentre randomised controlled trial.

SETTING

27 secondary care glaucoma departments in the UK.

PARTICIPANTS

453 adults presenting with newly diagnosed advanced open angle glaucoma in at least one eye (Hodapp classification) between 3 June 2014 and 31 May 2017.

INTERVENTIONS

Mitomycin C augmented trabeculectomy (n=227) and escalating medical management with intraocular pressure reducing drops (n=226) MAIN OUTCOME MEASURES: Primary outcome: vision specific quality of life measured with Visual Function Questionnaire-25 (VFQ-25) at 24 months.

SECONDARY OUTCOMES

general health status, glaucoma related quality of life, clinical effectiveness (intraocular pressure, visual field, visual acuity), and safety.

RESULTS

At 24 months, the mean VFQ-25 scores in the trabeculectomy and medical arms were 85.4 (SD 13.8) and 84.5 (16.3), respectively (mean difference 1.06, 95% confidence interval -1.32 to 3.43; P=0.38). Mean intraocular pressure was 12.4 (SD 4.7) mm Hg for trabeculectomy and 15.1 (4.8) mm Hg for medical management (mean difference -2.8 (-3.8 to -1.7) mm Hg; P<0.001). Adverse events occurred in 88 (39%) patients in the trabeculectomy arm and 100 (44%) in the medical management arm (relative risk 0.88, 95% confidence interval 0.66 to 1.17; P=0.37). Serious side effects were rare.

CONCLUSION

Primary trabeculectomy had similar quality of life and safety outcomes and achieved a lower intraocular pressure compared with primary medication.

TRIAL REGISTRATION

Health Technology Assessment (NIHR-HTA) Programme (project number: 12/35/38). ISRCTN registry: ISRCTN56878850.

Tailored, psychological intervention for anxiety and/or depression in people with chronic obstructive pulmonary disease (COPD), TANDEM (Tailored intervention for ANxiety and DEpression Management in COPD): statistical analysis plan for a randomised controlled trial

Background

The aim of the TANDEM trial is to evaluate whether a tailored, psychological cognitive behavioural approach intervention, which links into, and optimises the effects of routine pulmonary rehabilitation (PR), leads to a reduction in mild/moderate anxiety and/or depression in people with moderate, severe or very severe chronic obstructive pulmonary disease.

Methods and design

TANDEM is a multi-centre, two-arm, parallel group, pragmatic, individually randomised controlled, superiority trial including an internal pilot. Participants are randomised to receive either the intervention (a tailored psychological intervention plus usual care including referral to PR) or the control (usual care including referral to PR). The designed randomisation ratio is 1.25:1 in favour of the intervention. The multiple-primary outcomes are participant depression and anxiety at 6 months, measured using the Hospital Anxiety and Depression Scale (HADS) depression and anxiety subscales.

Results

This article describes the statistical analysis plan (SAP) for the TANDEM trial. In particular, we describe the general analysis principles, how we will handle missing data, the primary and secondary outcomes and how these will be analysed, sensitivity analyses for the multiple-primary outcomes, and any other analyses and data summaries. The SAP was developed and published prior to completion of follow-up of the last participant.

Trial registration

ISRCTN registry ISRCTN59537391. Registered on 20 March 2017.

Self-management and HeAlth Promotion in Early-stage dementia with e-learning for carers (SHAPE): study protocol for a multi-centre randomised controlled trial

BACKGROUND

With an increasing number of people with dementia worldwide and limited advancement in medical treatments, the call for new and cost-effective approaches is crucial. The utility of self-management has been proven in certain chronic conditions. However, very little work has been undertaken regarding self-management in people with dementia.

METHODS

The SHAPE trial will include 372 people with mild to moderate dementia to evaluate the effectiveness and cost-effectiveness of an educational programme combining approaches of self-management, health promotion, and e-learning for care partners. The study is a multi-site, single-randomised, controlled, single-blinded trial with parallel arms. The intervention arm is compared with treatment as usual. The intervention comprises a 10-week course delivered as group sessions for the participants with dementia. The sessions are designed to develop self-management skills and to provide information on the nature of the condition and the development of healthy behaviours in a supportive learning environment. An e-learning course will be provided for care partners which covers similar and complementary material to that discussed in the group sessions for the participant with dementia.

DISCUSSION

This trial will explore the effect of the SHAPE group intervention on people with mild to moderate dementia in terms of self-efficacy and improvement in key health and mental health outcomes and cost-effectiveness, along with carer stress and knowledge of dementia.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04286139, registered prospectively February 26, 2020, https://clinicaltrials.gov/ct2/show/NCT04286139.

Clustering of continuous and binary outcomes at the general practice level in individually randomised studies in primary care - a review of 10 years of primary care trials

BACKGROUND

In randomised controlled trials, the assumption of independence of individual observations is fundamental to the design, analysis and interpretation of studies. However, in individually randomised trials in primary care, this assumption may be violated because patients are naturally clustered within primary care practices. Ignoring clustering may lead to a loss of power or, in some cases, type I error.

METHODS

Clustering can be quantified by intra-cluster correlation (ICC), a measure of the similarity between individuals within a cluster with respect to a particular outcome. We reviewed 17 trials undertaken by the Department of Primary Care at the University of Southampton over the last ten years. We calculated the ICC for the primary and secondary outcomes in each trial at the practice level and determined whether ignoring practice-level clustering still gave valid inferences. Where multiple studies collected the same outcome measure, the median ICC was calculated for that outcome.

RESULTS

The median intra-cluster correlation (ICC) for all outcomes was 0.016, with interquartile range 0.00-0.03. The median ICC for symptom severity was 0.02 (interquartile range (IQR) 0.01 to 0.07) and for reconsultation with new or worsening symptoms was 0.01 (IQR 0.00, 0.07). For HADS anxiety the ICC was 0.04 (IQR 0.02, 0.05) and for HADS depression was 0.02 (IQR 0.00, 0.05). The median ICC for EQ. 5D-3 L was 0.01 (IQR 0.01, 0.04).

CONCLUSIONS

There is evidence of clustering in individually randomised trials primary care. The non-zero ICC suggests that, depending on study design, clustering may not be ignorable. It is important that this is fully considered at the study design phase.

Challenges in the design, planning and implementation of trials evaluating group interventions

Background

Group interventions are interventions delivered to groups of people rather than to individuals and are used in healthcare for mental health recovery, behaviour change, peer support, self-management and/or health education. Evaluating group interventions in randomised controlled trials (RCTs) presents trialists with a set of practical problems, which are not present in RCTs of one-to-one interventions and which may not be immediately obvious.

Methods

Case-based approach summarising Sheffield trials unit’s experience in the design and implementation of five group interventions. We reviewed participant recruitment and attrition, facilitator training and attrition, attendance at the group sessions, group size and fidelity aspects across five RCTs.

Results

Median recruitment across the five trials was 3.2 (range 1.7–21.0) participants per site per month. Group intervention trials involve a delay in starting the intervention for some participants, until sufficient numbers are available to start a group. There was no evidence that the timing of consent, relative to randomisation, affected post-randomisation attrition which was a matter of concern for all trial teams. Group facilitator attrition was common in studies where facilitators were employed by the health system rather than the by the grant holder and led to the early closure of one trial; research sites responded by training ‘back-up’ and new facilitators. Trials specified that participants had to attend a median of 62.5% (range 16.7%–80%) of sessions, in order to receive a ‘therapeutic dose’; a median of 76.7% (range 42.9%–97.8%) received a therapeutic dose. Across the five trials, 75.3% of all sessions went ahead without the pre-specified ideal group size. A variety of methods were used to assess the fidelity of group interventions at a group and individual level across the five trials.

Conclusion

This is the first paper to provide an empirical basis for planning group intervention trials. Investigators should expect delays/difficulties in recruiting groups of the optimal size, plan for both facilitator and participant attrition, and consider how group attendance and group size affects treatment fidelity.

Trial registration

ISRCTN17993825 registered on 11/10/2016, ISRCTN28645428 registered on 11/04/2012, ISRCTN61215213 registered on 11/05/2011, ISRCTN67209155 registered on 22/03/2012, ISRCTN19447796 registered on 20/03/2014.