Opportunities and challenges of delivering digital clinical trials: lessons learned from a randomised controlled trial of an online behavioural intervention for children and young people

BACKGROUND

Despite being the gold standard of research to determine effectiveness, randomised controlled trials (RCTs) often struggle with participant recruitment, engagement and retention. These issues may be exacerbated when recruiting vulnerable populations, such as participants with mental health issues. We aimed to update understanding of the scope of these problems in trials of health technology and identify possible solutions through reflecting on experiences from an exemplar trial (Online Remote Behavioural Intervention for Tics; ORBIT).

METHOD

We extracted anonymised data on recruitment, retention and requests for more funding and time from trials funded by the largest funder of health technology trials in the UK (the National Institute of Health Research Health Technology Assessment) between 2010 and 2020, and compared these with data from a recent, successful trial (ORBIT). ORBIT aimed to assess the clinical- and cost-effectiveness of blended online and human behavioural therapy for tics in young people. Many of the trial procedures, including recruitment, the intervention and data collection, were undertaken online.

RESULTS

Data were extracted on 51 trials conducted between 2010 and 2020. Sixty per cent of trials failed to reach their original recruitment target and only 44% achieved their follow-up in the specified time frame. In contrast, ORBIT recruited to target and achieved 90% follow-up. We posit that these achievements are related to (a) judicious use of digital technology for trial procedures and (b) adequate numbers of highly trained and motivated trial staff. We provide details of both these to help other research teams plan and cost for successful trials.

CONCLUSION

An approach combining human and online methods may be advantageous in facilitating trial delivery, particularly in paediatric mental health services. Given the importance of successful clinical trials in advancing healthcare delivery and the waste of human and economic resources associated with unsuccessfully delivered trials, it is imperative that trials are appropriately costed and future research focusses on improving trial design and delivery.

TRIAL REGISTRATION

The ORBIT trial is registered with ISRTCN ( ISRCTN70758207 ) Registered on March 20, 2018. and ClinicalTrials.gov ( NCT03483493 ). Registered on March 30, 2018.

Fifty Years of Research on Prenatal Substances: Lessons Learned for the Opioid Epidemic

Current efforts to design research on developmental effects of prenatal opioid exposure can benefit from knowledge gained from 50 years of studies of fetal alcohol and prenatal drug exposures such as cocaine. Scientific advances in neurobiology, developmental psychopathology, infant assessments, genetics, and imaging support the principles of developmental neurotoxicology that guide research in prenatal exposures. Important to research design is accurate assessment of amount, frequency, and timing of exposure which benefits from accurate self-report and biomarkers of exposure. Identifying and control of pre- and postnatal factors that impact development are difficult and dependent on appropriate research design and selection of comparison groups and measurement of confounding, mediating, and moderating variables. Polysubstance exposure has increased due to the number of prescribed and nonprescribed substances used by pregnant women and varying combinations of drugs may have differential effects on the outcome. Multiple experimental and clinical assessments of infant behavior have been developed but predicting outcome before 18-24 months of age remains difficult. With some exceptions, prenatal substance exposure effect sizes have been small, and cognitive and behavioral effects tend to be specific rather than global. Studies require large sample sizes, adequate retention, and support for social services in at-risk samples. The ethical and legal contexts and stigma associated with drug/alcohol use disorder should be considered in order to prevent harm to families in research programs. Recognition of the pervasive use of addictive substances in this nation should lead to broad scientific efforts to understand how substances affect child outcomes and to initiate prevention and intervention where needed.

Overview of Reviews Using the Template for Intervention Description and Replication (TIDieR) as a Measure of Trial Intervention Reporting Quality

OBJECTIVE

To evaluate the quality of descriptions of interventions in health care research reports, based on a synthesis of reviews that used the Template for Intervention Description and Replication (TIDieR) to rate the completeness and quality of intervention reporting.

DESIGN

Overview of published reviews. In a systematic search of the literature, 56 review articles were retrieved that had evaluated 3454 primary studies (index articles) using all or most of the 12 TIDieR items, applied to experimental treatment only or treatment and comparator both, separately. If available, percentages "reported completely" were extracted based on the index article, the index article supplemented by related information, and these 2 supplemented by e-mailing the author. Information on the review's methodology was also extracted.

SETTING

Not applicable.

PARTICIPANTS

Not applicable.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Percentage of primary studies receiving "adequately reported" ratings on each of the 12 TIDieR items.

RESULTS

While for treatment arms TIDieR items 1 (name of treatment) and 2 (why of treatment) are generally judged to be reported adequately, the percentage is between 25% and 75% for most other items and is as low as 10% for item 10 (modifications). Comparators are reported even more poorly. Use of additional publications on a trial increased percentages "reported adequately" marginally; e-mailing resulted in significant increases in completeness of reporting. Rehabilitation trials were reported better than nonrehabilitation trials for some TIDieR items and worse for others.

CONCLUSIONS

Reporting on the interventions and comparators of trials is substandard. More extensive use of supplemental digital content and of versions of TIDieR customized for specific domains of research may improve the situation.

Meta-analysis and Indirect Comparisons: on Methods, Paradigms, and Biologic Treatments for Psoriasis

Meta-analysis offers a way to assess the clinical efficacy of a treatment by combining the results of randomized clinical trials while maintaining randomization; the combined effects, with their confidence intervals, can be represented with a forest plot. The efficacy of several different treatment options can be assessed with either direct or indirect comparisons. Indirect comparisons may be placebo-anchored as well as network meta-analyses (NMA) that use either a frequentist or Bayesian approach, depending on the statistical framework and the definition of probability selected. Indirect comparisons may also adjust for covariates or utilize individual participant data. Bayesian NMA are able to establish a rank order of efficacy based on probabilities or credibility intervals, which can be described by the surface under the cumulative ranking curve(SUCRA). Statistical superiority is demonstrated by pairwise comparisons, which are generally presented in league tables. This review provides clinical practitioners with detailed descriptions of these methods, drawing on examples from recently published NMA that rank the relative efficacy of biologic treatments for moderate to severe psoriasis. According to NMA findings, the four most effective treatments in both the short term (10-16 weeks) and the long term (approximately one year) are, in rank order, risankizumab (first in all studies that include it), brodalumab, guselkumab, and ixekizumab. However, the between-treatment differences are not always significant.

Authors should clearly report how they derived the overall rating when applying AMSTAR 2-a cross-sectional study

OBJECTIVES

A measurement tool to assess systematic reviews (SRs) 2 (AMSTAR 2) allows for deriving the overall confidence in an SR. We investigated how authors derived the overall confidence rating and whether different schemes lead to different results.

STUDY DESIGN AND SETTING

We compared three different schemes (original 7-item scheme, a self-developed 5-item scheme, and the AMSTAR Web site) to derive the overall confidence in AMSTAR 2 using two distinct samples of SRs. Multiple bibliographic databases were searched for articles to analyze how AMSTAR 2 was applied by others.

RESULTS

In both samples (n = 60 and n = 58), the Friedman test revealed a significant difference between the schemes (P < 0.001). The Web site scheme was the least strict one, whereas between the 5-item and 7-item scheme, no differences were found in post hoc analyses. We included 53 publications applying AMSTAR 2 identified in our literature search. Only 37 of them (70%) used the original 7-item scheme. Less than half of them (18 of 37) reported how they derived the overall rating.

CONCLUSION

Authors should clearly report how they have derived the overall rating when applying AMSTAR 2. Reporting should allow for reproducing the overall ratings for editors, peer reviewers, and readers.

Tennis elbow, study protocol for a randomized clinical trial: needling with and without platelet-rich plasma after failure of up-to-date rehabilitation

Background

The conservative management of lateral epicondylitis is known to be a difficult-to-treat annoying condition. A treatment with platelet-rich plasma (PRP) is often performed, but its efficacy remains controversial.

Methods

This study is a single-center, randomized double-blind controlled trial, preceded by a case series. All the 232 planned patients of the case series will undergo an up-to-date comprehensive rehabilitation program, including focused extracorporeal shock waves therapy. This rehabilitation program is expected to have a maximum success rate 75%. It is therefore aimed to allocate a minimum of 58 patients with rehabilitation failure into the 1:1 randomized trial. Stratification is planned on age and lesion pattern. The masking will be quadruple (Participant, Care Provider, Investigator & Outcome Assessor). The patients will undergo an ultrasound (US)-guided needling combined with either PRP (intervention group) or saline (control group). The primary endpoint will be the pain improvement from baseline (month 0) at 3 months on a 0–10 visual analog scale (VAS) during a maximal strength isometric contraction of the extensor carpialis brevis muscle. The main secondary endpoints will include the rehabilitation success rate and improvements from baseline at 3, 6, and 12 months of the following outcomes: (i) Single Assessment Numeric Evaluation (SANE) score, (ii) Patient-Rated Tennis Elbow Evaluation (PRTEE) score, (iii) maximal grip strength on Jamar test, and (iv) the ultrasonographic evaluation of the US of the epicondylar tendons.

Discussion

The study results will provide insight into the effect of PRP as adjuvant therapy to tendon fenestration, and may contribute to identify the best preceding and concomitant rehabilitation protocol.

Trial registration

ClinicalTrials.gov NCT03987256. Registered on 20 August 2019.

Methodological quality of systematic reviews on treatments for osteoporosis: A cross-sectional study

PURPOSE

Systematic reviews (SRs) provide the best evidence on the effectiveness of treatment strategies for osteoporosis. Carefully conducted SRs provide high-quality evidence for supporting decision-making, but the trustworthiness of conclusions can be hampered by limitation in rigor. We aimed to appraise the methodological quality of a representative sample of SRs on osteoporosis treatments in a cross-sectional study.

METHODS

Cochrane Database of Systematic Reviews, EMBASE, MEDLINE, and PsycINFO were searched for SRs on osteoporotic treatments. AMSTAR (A MeaSurement Tool to Assess systematic Reviews) 2 was used to evaluate methodological quality of SRs. Associations between bibliographical characteristics and methodological quality ratings were explored using multivariate regression analyses.

RESULTS

A total of 101 SRs were appraised. Overall, one (1.0%) was rated "high quality", three (3.0%) were rated "moderate quality", eleven (10.9%) were rated "low quality", and eighty-six (85.1%) were rated "critically low quality". Ninety-nine (98.0%) did not explain study design selection, eighty-five (84.2%) did not provide a list of excluded studies (84.2%), and eighty-five (84.2%) did not report funding sources of included studies. SRs published in 2018 or after were associated with higher overall quality [adjusted odds ratio (AOR): 5.48; 95% confidence interval (CI): 1.12-26.89], while SRs focused on pharmacological interventions were associated with lower overall quality [AOR: 0.24; 95% CI: 0.06-0.96].

CONCLUSION

The methodological quality of the included SRs is far from satisfactory. Future reviewers must strengthen rigor by improving literature search comprehensiveness, registering and publishing a priori protocols, and optimising study selection and data extraction. Better transparency in reporting conflicts of interest among reviewers, as well as sources of funding among included primary studies, are also needed.

How Annals of Dermatology Has Improved the Scientific Quality and Ethical Standards of its Articles in the Two-Year Period since October 2018

Annals of Dermatology has not been deposited in PubMed Central (PMC) since October 2018 due to inadequate scientific quality, including the absence of informed consent in three case reports with patients' photos. This study examined the readiness of Annals of Dermatology to be deposited in PMC again by analyzing the 13 issues published from October 2018 to August 2020. The journal's scientific quality and ethical standards were assessed, and adherence to these standards was documented. In total, 259 articles were analyzed for ethical standards, including institutional review board (IRB) approval, an informed consent statement, and disclosure of conflicts of interest. Scientific quality was also checked for each article. Of the 129 original articles or brief reports presenting research on human subjects or human-derived materials, 111 studies received IRB approval and/or obtained informed consent. The other seven studies were data analyses or studies of purchased cultured cells. One study that used a post-circumcision foreskin sample contained no statement describing permission from the patient's family, but the researchers were found to have obtained informed consent. In all 152 case presentations, the authors obtained informed consent. All seven animal experiments received Institutional Animal Care and Use Committee approval. One review article did not disclose conflicts of interest, but this was an editorial error. Two systematic reviews adopted the PRISMA guidelines. In conclusion, the present publication policies, scientific quality, and ethical standards of the journal are top-tier internationally. Annals of Dermatology may be ready to apply to PMC again.

Attempting Randomized Housing First Research in a Community Context: Reflections on Failure

The Housing First (HF) model of permanent supportive housing for individuals experiencing chronic homelessness has a strong evidence base that has largely been driven by researchers in the field of community psychology in partnership with community-based organizations. However, important gaps in the HF literature remain. Implementing rigorous research designs to further the evidence for HF requires immense resources to fund both the housing intervention and the research activities. In the absence of such resources, university-community partnerships may be established to integrate research within business-as-usual services and utilize existing housing units. This first person account presents a "post-mortem" exploration of an attempt to conduct a randomized trial of scattered-site and single-site approaches to HF within a community context from the perspectives of multiple stakeholders involved in the endeavor. Despite strengths of the research collaborative, the project did not come to completion due to a series of both insurmountable and avoidable barriers. Yet, the experience illuminated several potential challenges researchers and housing providers conducting work in this area may encounter, such as ever-changing homeless service system policies that may impact research and organizational procedures. Lessons learned and recommendations for preventing or overcoming systems-level barriers and potential challenges within the university-community partnership are described.

Ethical Issues Relating to Scientific Discovery in Exercise Science

This work aims to present concepts related to ethical issues in conducting and reporting scientific research in a clear and straightforward manner. Considerations around research design including authorship, sound research practices, non-discrimination in subject recruitment, objectivity, respect for intellectual property, and financial interests are detailed. Further, concepts relating to the conducting of research including the competency of the researcher, conflicts of interest, accurately representing data, and ethical practices in human and animal research are presented. Attention pertaining to the dissemination of research including plagiarism, duplicate submission, redundant publication, and figure manipulation is offered. Other considerations including responsible mentoring, respect for colleagues, and social responsibility are set forth. The International Journal of Exercise Science will now require a statement in all subsequent published manuscripts that the authors have complied with each of the ethics statements contained in this work.

The adapted Zelen was a feasible design to trial exercise in myeloma survivors

OBJECTIVES

We used a method rarely seen in cancer behavioral trials to explore methods of overcoming difficulties often seen in randomized controlled trials. We report our experiences of the adapted Zelen design, so that other researchers can consider this approach for behavioral trials.

STUDY DESIGN AND SETTING

The adapted Zelen design was used to explore the effects of exercise on multiple myeloma patients fatigue, quality of life, and physical outcomes. All participants consented to an observational cohort study of lifestyle factors but were unaware of subsequent randomization to remain in cohort only group or be offered an exercise intervention requiring second consent.

RESULTS

There was lower than expected uptake to the exercise offered group (57%), so the length of recruitment increased from 24 to 29 months to ensure power was reached. At enrollment, patients were unaware of the potential increased commitment, and as a result, 62% of participants allocated to the intervention declined because of the extra time/travel commitment required. This emulates clinical settings and suggests improvements in intervention delivery are required. Our findings suggest that the adapted Zelen design may be useful in limiting dropout of controls due to dissatisfaction from group allocation, or contamination of control arm.

CONCLUSION

Future use of this design warrants careful consideration of the study resources and recruitment time frames required but holds potential value in reducing contamination, control group dissatisfaction, and resulting dropout. Adapted Zelen design reduces selection bias and therefore gives clinicians a better understanding of acceptability in clinical settings. Future studies should evaluate control group experiences of the design and formally record contamination throughout the study to confirm its acceptability.

Comparative Analysis of Web of Science and Pubmed Indexed Medical Journals Published in Former Yugoslav Countries

INTRODUCTION

The source of scientific information, methods for their evaluation, and methodology of their use are critical for serious scientific research and publishing of the scientific research results. Certain methodological principles should be inexcusably followed when designing clinical or observational research to avoid bias and presentation of results that do not reflect the truth about the phenomenon that is the object of the study.

AIM

The aim of this study was to compare the methodological quality of clinical trials and observational studies published in medical journals from ex-Yugoslav countries indexed in Web of Science (WoS) and Pubmed/MEDLINE.

METHODS

Clinical studies published in medical journals of ex-Yugoslav countries were retrieved from the WoS and Pubmed database, and the sample for analysis was randomly chosen from the retrieved publications. The rate of the most common errors in the design of clinical/observational studies was established by a careful reading of the sampled publications and their checking against predefined criteria.

RESULTS

Number and percent of the evaluated studies that failed to meet each of the methodological criteria tested, number of the evaluated criteria not satisfied per database and number of studies that satisfied more than 4 criteria were analyzed per database. When explanatory potential of journal impact factor, number of citations, time elapsed from publication and a database where a journal is referred were tested by linear regression in regard to the number of methodological criteria satisfied per study, the linear regression model was obtained by backward deletion method and achieved R2 adjusted of 0.166 (F=13.827, df1 = 2, df2 = 127, p=0.000). The methodological quality of studies was directly related to impact factor of the journals (B = 0.976, 95% confidence interval 0.539 - 1.413, p=0.000) and inversely with the database where a journal is referred (B =-0.444, 95% confidence interval-0.824 - -0.064, p = 0.022). Each additional unit of impact factor increased number of satisfied methodological criteria for about 1, while referring a journal only in WoS decreased number of satisfied criteria for 0.45 points in comparison with journals referred in both WoS and Pubmed/MEDLINE, and for 0.9 points in comparison to journals referred only in MEDLINE.

CONCLUSION

Methodological and scientometric quality of clinical studies published in medical journals from ex-Yugoslav region varies significantly, and the variations are higher in journals referenced only in WoS than in journals referenced in Pubmed/MEDLINE only, or in both Pubmed and Web of Science databases.

Study designs: Part 7 - Systematic reviews

In this series on research study designs, we have so far looked at different types of primary research designs which attempt to answer a specific question. In this segment, we discuss systematic review, which is a study design used to summarize the results of several primary research studies. Systematic reviews often also use meta-analysis, which is a statistical tool to mathematically collate the results of various research studies to obtain a pooled estimate of treatment effect; this will be discussed in the next article.

Mechanisms of early Recurrence in Intracranial Atherosclerotic Disease (MyRIAD): Rationale and design

RATIONALE

Intracranial atherosclerotic disease (ICAD) is the most common cause of ischemic stroke with the highest rate of recurrence, despite aggressive medical management. Diverse mechanisms may be responsible for ICAD-related cerebral ischemia, with potential therapeutic implications. Here we present the rationale, design and methods of the Mechanisms of Early Recurrence in Intracranial Atherosclerotic Disease (MyRIAD) study. The aim of MyRIAD is to determine the mechanisms of stroke in ICAD through physiologic imaging biomarkers that evaluate impaired antegrade flow, poor distal perfusion, abnormal vasoreactivity, artery to artery embolism, and their interaction.

METHODS AND DESIGN

This is a prospective observational study of patients with recently symptomatic (<21 days) ICAD with 50-99% stenosis treated medically and monitored for up to 1 year. An estimated 110 participants are recruited at 10 sites to identify the association between the presence of each mechanism of ischemia and recurrent stroke. The primary outcome is ischemic stroke in the territory of the symptomatic artery. Secondary outcomes include new cerebral infarction on MRI at 6-8 weeks and recurrent TIA in the territory of the symptomatic artery.

DISCUSSION

MyRIAD is positioned to define the role of specific mechanisms of recurrent ischemia in patients with symptomatic ICAD. This knowledge will allow the development and implementation of effective and specific treatments for this condition.

Lessons learned from two randomized controlled trials: CITIES and STOP-DKD

Background

Even well-designed, theoretically driven clinical trials can fall short of achieving the desired clinical outcomes. Our research team had an opportunity to conduct two randomized controlled trials that were enrolling patients in parallel. While both studies were targeting chronic disease management among patients with multiple comorbid conditions, the patient population and settings varied. The studies were the Cardiovascular Intervention Improvement Telemedicine Study (CITIES) and Simultaneous Risk Factor Control Using Telehealth to slow Progression of Diabetic Kidney Disease (STOP-DKD) studies. Both studies had null findings.

Objectives

Our goal is to discuss common design considerations across CITIES and STOP-DKD and potential implications for the design of future randomized controlled trials.

Methods

These were two 1:1 randomized controlled trials with attention control groups that recruited patients from various clinical practices in the Research Triangle area of North Carolina.

Conclusions

We make three recommendations for future studies. First, we assert that it is important to allow for piloting the enrollment process to ensure that it is possible to identify and recruit a patient population that is well aligned with the clinical outcomes of the intervention. Second, analysis plans should be more targeted in their approach and should consider heterogeneity of treatment effects. Third, in order to support the transition of evidence generated from randomized controlled trials into clinical practice, it is important to consider even early stage randomized controlled trials through an implementation science lens.

Trial registration

Simultaneous Risk Factor Control Using Telehealth to slow Progression of Diabetic Kidney Disease (STOP-DKD) NCT01829256; Cardiovascular Intervention Improvement Telemedicine Study NCT01142908.

Association Between Treatment With Apixaban, Dabigatran, Rivaroxaban, or Warfarin and Risk for Osteoporotic Fractures Among Patients With Atrial Fibrillation: A Population-Based Cohort Study

BACKGROUND

It is unclear whether anticoagulant type is associated with the risk for osteoporotic fracture, a deleterious complication of anticoagulants among patients with atrial fibrillation (AF).

OBJECTIVE

To compare the risk for osteoporotic fracture between anticoagulants.

DESIGN

Population-based cohort study.

SETTING

Territory-wide electronic health record database of the Hong Kong Hospital Authority.

PARTICIPANTS

Patients newly diagnosed with AF between 2010 and 2017 who received a new prescription for warfarin or a direct oral anticoagulant (DOAC) (apixaban, dabigatran, or rivaroxaban). Follow-up ended on 31 December 2018.

MEASUREMENTS

Osteoporotic hip and vertebral fractures in anticoagulant users were compared using propensity score-weighted cumulative incidence differences (CIDs).

RESULTS

There were 23 515 patients identified (3241 apixaban users, 6867 dabigatran users, 3866 rivaroxaban users, and 9541 warfarin users). Overall mean age was 74.4 years (SD, 10.8), ranging from 73.1 years (warfarin) to 77.9 years (apixaban). Over a median follow-up of 423 days, 401 fractures were identified (crude event number [weighted rate per 100 patient-years]: apixaban, 53 [0.82]; dabigatran, 95 [0.76]; rivaroxaban, 57 [0.67]; and warfarin, 196 [1.11]). After 24-month follow-up, DOAC use was associated with a lower risk for fracture than warfarin use (apixaban CID, -0.88% [95% CI, -1.66% to -0.21%]; dabigatran CID, -0.81% [CI, -1.34% to -0.23%]; and rivaroxaban CID, -1.13% [CI, -1.67% to -0.53%]). No differences were seen in all head-to-head comparisons between DOACs at 24 months (apixaban vs. dabigatran CID, -0.06% [CI, -0.69% to 0.49%]; rivaroxaban vs. dabigatran CID, -0.32% [CI, -0.84% to 0.18%]; and rivaroxaban vs. apixaban CID, -0.25% [CI, -0.86% to 0.40%]).

LIMITATION

Residual confounding is possible.

CONCLUSION

Among patients with AF, DOAC use may result in a lower risk for osteoporotic fracture compared with warfarin use. Fracture risk does not seem to be altered by the choice of DOAC. These findings may help inform the benefit-risk assessment when choosing between anticoagulants.

PRIMARY FUNDING SOURCE

The University of Hong Kong and University College London Strategic Partnership Fund.

Assessing the quality of meta-analyses in systematic reviews in pharmaceutical research in Iran by 2016: A systematic review

Background: Meta-analyses, like all other studies, may be poorly designed and implemented. This study was designed to determine the quality of meta-analyses in systematic reviews in the field of pharmaceutical research in Iran. Methods: Web of Science Core Collection, EMBASE, Ovid Medline, CINAHL, Scopus, and PubMed were systematically searched on June 4, 2017. The search was limited to the researches in the field of pharmaceutical studies. Based on inclusion criteria, 104 systematic reviews with meta-analysis (SRMA) were selected and assessed using quality assessment tools introduced by Higgins. Results: Participants, experimental interventions, and outcomes were reported in all the articles. Comparator intervention and study design were correctly reported in 103 (99.04%) and 101 (97.12%) articles, respectively. The comprehensive search strategy was available only in 48 articles (46.16%), and there was no evidence of a comprehensive search in 56 articles (53.84%). Risk of bias was investigated in 78 articles (75%). Also, funnel plots were the most commonly used method for reporting the bias in 64 articles (46.42%). Conclusion: In many of the meta-analyses, several items of the tool that represented a high-quality meta-analysis were absent. According to the findings, the comprehensive search and quality assessment were not at an appropriate level. Thus, the importance of reproducibility of information and quality assessment of included studies should be emphasized.

Risk of 30-day mortality and its association with alcohol concentration level among driver victims of motor vehicle crashes: comparison of population- and hospital-based designs

BACKGROUND

Although blood alcohol concentration (BAC) is undoubtedly associated with increased risk of injury among driver victims involved in motor vehicle crashes (MVCs), some studies noted that high BAC was associated with reduced risk of mortality after injury. In addition, most of the previous studies included only injured patients admitted, which may lead to potential selection bias arising from exclusion of those with minor injury and those who died at the accident scene of MVC.

METHOD

The population-based design included 2586 driver victims with BAC equivalent >0 and 10 307 matched controls (BAC equivalent =0) selected from the Police-reported Traffic Accident Registry from 1 July to 31 December 2016 in Taiwan. The hospital-based design comprised a subset sample, which included 517 driver victims with BAC equivalent >0 and 662 with BAC equivalent =0 hospitalised on the same day the MVCs occurred. Conditional logistic regression models with adjustment for potential confounders were used to estimate the ORs and 95% CIs of 30-day mortality associated with BAC equivalent level.

RESULTS

In the population-based design, a positive dose-gradient relationship was observed between BAC equivalent level and 30-day mortality, with a covariate-adjusted OR of 3.77 (95% CI 1.84 to 7.72), 6.19 (95% CI 3.13 to 12.26) and 7.75 (95% CI 4.51 to 13.32) for low, moderate and high BAC equivalent levels, respectively. By contrast, the hospital-based design revealed no significant association between 30-day mortality and alcohol concentration regardless of the BAC equivalent level.

CONCLUSION

The association between BAC equivalent level and short-term mortality could have been overlooked in hospital-based studies that excluded MVC-related deaths outside hospital settings.

Methodological Errors in Clinical Studies Published by Medical Journals of Ex-Yugoslav Countries

INTRODUCTION

Certain methodological principles should be inexcusably followed when designing clinical or observational research to avoid bias and presentation of results that do not reflect the truth about the phenomenon that is the object of the study.

AIM

The aim of this study was to compare the methodological quality of clinical trials and observational studies published in medical journals from ex-Yugoslav countries indexed in Pubmed/MEDLINE.

METHODS

Clinical studies published in medical journals of ex-Yugoslav countries were retrieved from the Pubmed/MEDLINE database, and the sample for analysis was randomly chosen from the retrieved publications. The rate of the most common errors in the design of clinical/observational studies was established by a careful reading of the sampled publications and their checking against predefined criteria.

RESULTS

The studies published in two countries that are now member states of the European Union (Slovenia and Croatia) have significantly higher citation rates, impact factor, and methodological quality scores than studies from other ex-Yugoslav countries. While publications from Croatia show clear improvement trend throughout the last two decades, which is visible also in the last 10 years in Slovenia and Bosnia and Herzegovina, quality of clinical research published in journals from Serbia was stagnating in the same period.

CONCLUSIONS

There are significant differences in methodological quality and scientometric characteristics of clinical research published in medical journals of ex-Yugoslav countries that could be mitigated by more intensive training of clinical researchers in statistics and research design, as well as by more rigorous editorial practices.

Benefits and Harms of Prescription Drugs and Supplements for Treatment of Clinical Alzheimer-Type Dementia

BACKGROUND

Effects of drug treatment of clinical Alzheimer-type dementia (CATD) are uncertain.

PURPOSE

To summarize evidence on the effects of prescription drugs and supplements for CATD treatment.

DATA SOURCES

Electronic bibliographic databases (inception to November 2019), ClinicalTrials.gov (to November 2019), and systematic review bibliographies.

STUDY SELECTION

English-language trials of prescription drug and supplement treatment in older adults with CATD that report cognition, function, global measures, behavioral and psychological symptoms of dementia (BPSD), or harms. Minimum treatment was 24 weeks (≥2 weeks for selected BPSD).

DATA EXTRACTION

Studies with low or medium risk of bias (ROB) were analyzed. Two reviewers rated ROB. One reviewer extracted data; another verified extraction accuracy.

DATA SYNTHESIS

Fifty-five studies reporting non-BPSD outcomes (most ≤26 weeks) and 12 reporting BPSD (most ≤12 weeks) were analyzed. Across CATD severity, mostly low-strength evidence suggested that, compared with placebo, cholinesterase inhibitors produced small average improvements in cognition (median standardized mean difference [SMD], 0.30 [range, 0.24 to 0.52]), no difference to small improvement in function (median SMD, 0.19 [range, -0.10 to 0.22]), no difference in the likelihood of at least moderate improvement in global clinical impression (median absolute risk difference, 4% [range, 2% to 4%]), and increased withdrawals due to adverse events. In adults with moderate to severe CATD receiving cholinesterase inhibitors, low- to insufficient-strength evidence suggested that, compared with placebo, add-on memantine inconsistently improved cognition and improved global clinical impression but not function. Evidence was mostly insufficient about prescription drugs for BPSD and about supplements for all outcomes.

LIMITATION

Most drugs had few trials without high ROB, especially for supplements, active drug comparisons, BPSD, and longer trials.

CONCLUSION

Cholinesterase inhibitors and memantine slightly reduced short-term cognitive decline, and cholinesterase inhibitors slightly reduced reported functional decline, but differences versus placebo were of uncertain clinical importance. Evidence was mostly insufficient on drug treatment of BPSD and on supplements for all outcomes.

PRIMARY FUNDING SOURCE

Agency for Healthcare Research and Quality. (PROSPERO: CRD42018117897).

Accuracy of Biomarker Testing for Neuropathologically Defined Alzheimer Disease in Older Adults With Dementia

BACKGROUND

Biomarker accuracy for Alzheimer disease (AD) is uncertain.

PURPOSE

To summarize evidence on biomarker accuracy for classifying AD in older adults with dementia.

DATA SOURCES

Electronic bibliographic databases (searched from January 2012 to November 2019 for brain imaging and cerebrospinal fluid [CSF] tests and from inception to November 2019 for blood tests), ClinicalTrials.gov (to November 2019), and systematic review bibliographies.

STUDY SELECTION

English-language studies evaluating the accuracy of brain imaging, CSF testing, or blood tests for distinguishing neuropathologically defined AD from non-AD among older adults with dementia. Studies with low or medium risk of bias were analyzed.

DATA EXTRACTION

Two reviewers rated risk of bias. One extracted data; the other verified accuracy.

DATA SYNTHESIS

Fifteen brain imaging studies and 9 CSF studies met analysis criteria. Median sensitivity and specificity, respectively, were 0.91 and 0.92 for amyloid positron emission tomography (PET), 0.89 and 0.74 for ¹⁸F-labeled fluorodeoxyglucose (¹⁸F-FDG) PET, 0.64 and 0.83 for single-photon emission computed tomography, and 0.91 and 0.89 for medial temporal lobe atrophy on magnetic resonance imaging (MRI). Individual CSF biomarkers and ratios had moderate sensitivity (range, 0.62 to 0.83) and specificity (range, 0.53 to 0.69); in the few direct comparisons, β-amyloid 42 (Aβ42)/phosphorylated tau (p-tau) ratio, total tau (t-tau)/Aβ42 ratio, and p-tau appeared more accurate than Aβ42 and t-tau alone. Single studies suggested that amyloid PET, ¹⁸F-FDG PET, and CSF test combinations may add accuracy to clinical evaluation.

LIMITATIONS

Studies were small, biomarker cut points and neuropathologic AD were inconsistently defined, and methods with uncertain applicability to typical clinical settings were used. Few studies directly compared biomarkers, assessed test combinations, evaluated whether biomarkers improved classification accuracy when added to clinical evaluation, or reported harms.

CONCLUSION

In methodologically heterogeneous studies of uncertain applicability to typical clinical settings, amyloid PET, ¹⁸F-FDG PET, and MRI were highly sensitive for neuropathologic AD. Amyloid PET, ¹⁸F-FDG PET, and CSF test combinations may add accuracy to clinical evaluation.

PRIMARY FUNDING SOURCE

Agency for Healthcare Research and Quality. (PROSPERO: CRD42018117897).

COVID-19 and Moral Imperialism in Multinational Clinical Research

A TV debate in April 2020 between two French doctors regarding the benefits of testing a coronavirus vaccine in Africa where there are no masks or treatments available has led to international criticism. This case highlights a problematic ethical double standard in multinational clinical research: trials that would be considered unethical in high income countries (e.g., placebo-controlled where there is an existing treatment) are nonetheless justified in low-and-middle-income countries because the existing standards of care are less (i.e., no access to a treatment). Underlying this ethical double standard in some multinational clinical trials is a moral imperialism and persistent colonialist thinking that must be rejected.

Primary Palliative Care for Emergency Medicine (PRIM-ER): Applying form and function to a theory-based complex intervention

Background

Emergency departments are seeing an increase in acute exacerbations of chronic disease in the older-adult population. The delivery of palliative care in the emergency department can increase goal-concordant care at the end-of-life for this population. New interventions in palliative care for emergency medicine require large, pragmatic, complex health interventions due to the heterogeneous and dynamic environment of emergency departments. These complex interventions must balance fidelity with adaptability, while being rooted in theory, to produce an intervention that can be applied in a variety of contexts.

Methods

Primary Palliative Care for Emergency Medicine (PRIM-ER) is a large, pragmatic, complex health intervention. This paper outlines the conceptual theory-based design as well as the study form and functions of PRIM-ER to exemplify how this complex intervention has balanced fidelity with adaptability.

Results

A form and function matrix was created to highlight the key objectives and tailored intervention components of PRIM-ER. Each intervention component was also linked to one or more elements of the Theory of Planned Behavior to support provider behavior change and the delivery of palliative care services and referrals.

Conclusion

The application of theory and delineation of forms and functions, as well prospective adaptation monitoring of large complex interventions can support the balance of fidelity with adaptability to encourage successful interventions among a variety of clinical environments.

•

PRIM-ER is a quality improvement complex intervention to enhance goal-concordant care in the emergency department.

•

Complex interventions must balance fidelity with adaptability to enable transferability across various contexts..

•

Applying form and function in a theory-based conceptual model supports fidelity and adaptability in complex interventions.

How to choose your research organism

Despite August Krogh's famous admonition that a 'convenient' organism exists for every biological problem, we argue that appeals to 'convenience' are not sufficient to capture reasoning about organism choice. Instead, we offer a detailed analysis based on empirical data and philosophical arguments for a working set of twenty criteria that interact with each other in the highly contextualized judgements that biologists make about organism choice. We propose to think of these decisions as a form of 'differential analysis' where researchers weigh multiple criteria for organismal choice against each other, and often utilize multidimensional refinement processes to finalize their choices. The specific details of any one case make it difficult to draw generalizations or to abstract away from specific research situations. However, this analysis of criteria for organismal choice and how these are related in practice allows us to reflect more generally on what makes a particular organism useful or 'good.'