A systematic review of the quality of reporting in published smoking cessation trials for pregnant women: an explanation for the evidence-practice gap?

Underreporting of the active content of behavioural interventions: a systematic review and meta-analysis of randomised trials of smoking cessation interventions

Despite its importance, underreporting of the active content of experimental and comparator interventions in published literature has not been previously examined for behavioural trials. We assessed completeness and variability in reporting in 142 randomised controlled trials of behavioural interventions for smoking cessation published between 1/1996 and 11/2015. Two coders reliably identified the potential active components of experimental and comparator interventions (activities targeting behaviours key to smoking cessation and qualifying as behaviour change techniques, BCTs) in published, and in unpublished materials obtained from study authors directly. Unpublished materials were obtained for 129/204 (63%) experimental and 93/142 (65%) comparator groups. For those, only 35% (1200/3403) of experimental and 26% (491/1891) of comparator BCTs could be identified in published materials. Reporting quality (#published BCTs/#total BCTs) varied considerably between trials and between groups within trials. Experimental (vs. comparator) interventions were better reported (B(SE) = 0.34 (0.11), p < .001). Unpublished materials were more often obtained for recent studies (B(SE) = 0.093 (0.03), p = .003) published in behavioural (vs. medical) journals (B(SE) = 1.03 (0.41), p = .012). This high variability in underreporting of active content compromises reader's ability to interpret the effects of individual trials, compare and explain intervention effects in evidence syntheses, and estimate the additional benefit of an experimental intervention in other settings.

Interactional skills training in undergraduate medical education: ten principles for guiding future research

BACKGROUND

High-quality healthcare requires practitioners who have technical competence and communication skills. Medical practitioners need interpersonal skills for gathering and transferring information to their patients, in addition to general consultation skills. Appropriate information gathering increases the likelihood of an accurate diagnosis. Transferring information should be performed in a way that promotes patient understanding and increases the probability of adherence to physician recommendations. This applies to: (i) primary prevention such as smoking cessation; (ii) secondary prevention including preparation for potentially threatening interventions; and (iii) tertiary care, including breaking bad news regarding treatment and prognosis.

DISCUSSION

This debate paper delineates factors associated with undergraduate medical communication skills training where robust research is needed. Ten key principles are presented and discussed, which are intended to guide future research in this field and ensure high quality studies with methodological rigour are conducted. The literature on communication skills training for medical school undergraduates continues to grow. A considerable portion of this output is represented by commentaries, descriptive studies or poorly designed interventions. As with any field of healthcare, quality research interventions are required to ensure practice is grounded in high-level evidence.

Contingency Management Versus Psychotherapy for Prenatal Smoking Cessation: A Meta-Analysis of Randomized Controlled Trials

OBJECTIVES

Prenatal smoking is the leading preventable cause of poor obstetric outcomes, yet treatment options are limited. Past reviews of prenatal smoking cessation have often grouped all counseling into a single category, which ignores the fact that psychotherapy is distinct from brief counseling. The objective of this study was to compare the effect sizes of two intensive interventions for prenatal smoking cessation: contingency management (i.e., financial incentives for abstinence) and psychotherapy.

METHODS

A systematic search for randomized controlled trials testing the efficacy of contingency management or psychotherapy was completed using PubMed, PsycINFO, Web of Science, the Cochrane Library, and EMBASE. Independent raters extracted data and assessed trials for risk of bias. Treatment effects were analyzed for three times points: late pregnancy, early postpartum, and late postpartum.

RESULTS

The search yielded 22 studies, and meta-analytic results indicated that interventions (compared with control groups) generally increased the odds of abstinence. Moderator analyses indicated that intervention type (contingency management vs. psychotherapy) accounted for variability in effect sizes. When comparing treatment type, effects of contingency management interventions were significantly greater than those of psychotherapeutic interventions. Although psychotherapy did not affect smoking abstinence, contingency management interventions had significant treatment effects at all three time points.

CONCLUSIONS

Contingency management seems to be a safe and efficacious prenatal smoking cessation treatment. Although psychotherapy alone did not show an effect on prenatal smoking abstinence, future research may seek to combine this approach with contingency management to promote prenatal smoking cessation.

Reporting of Telehealth-Delivered Dietary Intervention Trials in Chronic Disease: Systematic Review

BACKGROUND

Telehealth-delivered dietary interventions are effective for chronic disease management and are an emerging area of clinical practice. However, to apply interventions from the research setting in clinical practice, health professionals need details of each intervention component.

OBJECTIVE

The aim of this study was to evaluate the completeness of intervention reporting in published dietary chronic disease management trials that used telehealth delivery methods.

METHODS

Eligible randomized controlled trial publications were identified through a systematic review. The completeness of reporting of experimental and comparison interventions was assessed by two independent assessors using the Template for Intervention Description and Replication (TIDieR) checklist that consists of 12 items including intervention rationale, materials used, procedures, providers, delivery mode, location, when and how much intervention delivered, intervention tailoring, intervention modifications, and fidelity. Where reporting was incomplete, further information was sought from additional published material and through email correspondence with trial authors.

RESULTS

Within the 37 eligible trials, there were 49 experimental interventions and 37 comparison interventions. One trial reported every TIDieR item for their experimental intervention. No publications reported every item for the comparison intervention. For the experimental interventions, the most commonly reported items were location (96%), mode of delivery (98%), and rationale for the essential intervention elements (96%). Least reported items for experimental interventions were modifications (2%) and intervention material descriptions (39%) and where to access them (20%). Of the 37 authors, 14 responded with further information, and 8 could not be contacted.

CONCLUSIONS

Many details of the experimental and comparison interventions in telehealth-delivered dietary chronic disease management trials are incompletely reported. This prevents accurate interpretation of trial results and implementation of effective interventions in clinical practice.

Quality improvement, implementation, and dissemination strategies to improve mental health care for children and adolescents: a systematic review

BACKGROUND

Some outcomes for children with mental health problems remain suboptimal because of poor access to care and the failure of systems and providers to adopt established quality improvement strategies and interventions with proven effectiveness. This review had three goals: (1) assess the effectiveness of quality improvement, implementation, and dissemination strategies intended to improve the mental health care of children and adolescents; (2) examine harms associated with these strategies; and (3) determine whether effectiveness or harms differ for subgroups based on system, organizational, practitioner, or patient characteristics.

METHODS

Sources included MEDLINE®, the Cochrane Library, PsycINFO, and CINAHL, from database inception through February 17, 2017. Additional sources included gray literature, additional studies from reference lists, and technical experts. Two reviewers selected relevant randomized controlled trials (RCTs) and observational studies, extracted data, and assessed risk of bias. Dual analysis, synthesis, and grading of the strength of evidence for each outcome followed for studies meeting inclusion criteria. We also used qualitative comparative analysis to examine relationships between combinations of strategy components and improvements in outcomes.

RESULTS

We identified 18 strategies described in 19 studies. Eleven strategies significantly improved at least one measure of intermediate outcomes, final health outcomes, or resource use. Moderate strength of evidence (from one RCT) supported using provider financial incentives such as pay for performance to improve the competence with which practitioners can implement evidence-based practices (EBPs). We found inconsistent evidence involving strategies with educational meetings, materials, and outreach; programs appeared to be successful in combination with reminders or providing practitioners with newly collected clinical information. We also found low strength of evidence for no benefit for initiatives that included only educational materials or meetings (or both), or only educational materials and outreach components. Evidence was insufficient to draw conclusions on harms and moderators of interventions.

CONCLUSIONS

Several strategies can improve both intermediate and final health outcomes and resource use. This complex and heterogeneous body of evidence does not permit us to have a high degree of confidence about the efficacy of any one strategy because we generally found only a single study testing each strategy.

TRIAL REGISTRATION

PROSPERO, CRD42015024759 .

Investigating the Adequacy of Intervention Descriptions in Recent Speech-Language Pathology Literature: Is Evidence From Randomized Trials Useable?

PURPOSE

To evaluate the completeness of intervention descriptions in recent randomized controlled trials of speech-language pathology treatments.

METHOD

A consecutive sample of entries on the speechBITE database yielded 129 articles and 162 interventions. Interventions were rated using the Template for Intervention Description and Replication (TIDieR) checklist. Rating occurred at 3 stages: interventions as published in the primary article, secondary locations referred to by the article (e.g., protocol papers, websites), and contact with corresponding authors.

RESULTS

No interventions were completely described in primary publications or after analyzing information from secondary locations. After information was added from correspondence with authors, a total of 28% of interventions was rated as complete. The intervention elements with the most information missing in the primary publications were tailoring and modification of interventions (in 25% and 13% of articles, respectively) and intervention materials and where they could be accessed (18%). Elements that were adequately described in most articles were intervention names (in 100% of articles); rationale (96%); and details of the frequency, session duration, and length of interventions (69%).

CONCLUSIONS

Clinicians and researchers are restricted in the usability of evidence from speech-language pathology randomized trials because of poor reporting of elements essential to the replication of interventions.

Lessons learned from the London Exercise and Pregnant (LEAP) Smokers randomised controlled trial process evaluation: implications for the design of physical activity for smoking cessation interventions during pregnancy

Background

The challenges of delivering interventions for pregnant smokers have been poorly documented. Also, the process of promoting a physical activity intervention for pregnant smokers has not been previously recorded. This study describes the experiences of researchers conducting a randomised controlled trial of physical activity as an aid to smoking cessation during pregnancy and explores how the effectiveness of future interventions could be improved.

Methods

Two focus groups, with independent facilitators, were conducted with six researchers who had enrolled pregnant smokers in the LEAP trial, provided the interventions, and administered the research measures. Topics included recruitment, retention and how the physical activity intervention for pregnant smokers was delivered and how it was adapted when necessary to suit the women. The focus groups were audio-recorded, transcribed verbatim and subjected to thematic analysis.

Results

Five themes emerged related to barriers or enablers to intervention delivery: (1) nature of the intervention; (2) personal characteristics of trial participants; (3) practical issues; (4) researchers’ engagement with participants; (5) training and support needs. Researchers perceived that participants may have been deterred by the intensive and generic nature of the intervention and the need to simultaneously quit smoking and increase physical activity. Women also appeared hampered by pregnancy ailments, social deprivation, and poor mental health. Researchers observed that their status as health professionals was valued by participants but it was challenging to maintain contact with participants. Training and support needs were identified for dealing with pregnant teenagers, participants’ friends and family, and post-natal return to smoking.

Conclusions

Future exercise interventions for smoking cessation in pregnancy may benefit by increased tailoring of the intervention to the characteristics of the women, including their psychological profile, socio-economic background, pregnancy ailments and exercise preferences. Delivering an effective physical activity intervention for smoking cessation in pregnancy may require more comprehensive training for those delivering the intervention, particularly with regard to dealing with teenage smokers and smokers’ friends and family, as well as for avoiding post-natal return to smoking.

Trial registration

ISRCTN48600346, date of registration: 21/07/2008.

Electronic supplementary material

The online version of this article (doi:10.1186/s12889-017-4013-5) contains supplementary material, which is available to authorized users.

Systematic review of the effects of care provided with and without diagnostic clinical prediction rules

BACKGROUND

Diagnostic clinical prediction rules (CPRs) are worthwhile if they improve patient outcomes or provide benefits such as reduced resource use, without harming patients. We conducted a systematic review to assess the effects of diagnostic CPRs on patient and process of care outcomes.

METHODS

We searched electronic databases and a trial registry and performed citation and reference checks, for randomised trials comparing a diagnostic strategy with and without a CPR. Included studies were assessed for risk of bias and similar studies meta-analysed.

RESULTS

Twenty-seven studies evaluating diagnostic CPRs for 14 conditions were included. A clinical management decision was the primary outcome in the majority of studies. Most studies were judged to be at high or uncertain risk of bias on ≥3 of 6 domains. Details of study interventions and implementation were infrequently reported.For suspected Group A Streptococcus throat infection, diagnostic CPRs reduced symptoms (1 study) and antibiotic prescriptions (5 studies, RR 0.86, 95% CI 0.75 to 0.99). For suspected cardiac chest pain, diagnostic strategies incorporating a CPR improved early discharge rates (1 study), decreased objective cardiac testing (1 study) and decreased hospitalisations (1 study). For ankle injuries, Ottawa Ankle Rules reduced radiography when used with clinical examination (1 study) but had no effect on length of stay as a triage test (1 study). For suspected acute appendicitis, CPRs had no effect on rates of perforated appendix (1 study) or the number of non-therapeutic operations (5 studies, RR 0.68, 95% CI 0.43 to 1.08). For suspected pneumonia, CPRs reduced antibiotic prescribing without unfavourable outcomes (3 studies). For children with possible serious bacterial infection, diagnostic CPRs did not improve process of care outcomes (3 studies).

CONCLUSION

There are few randomised trials of diagnostic CPRs, and patient outcomes are infrequently reported. Diagnostic CPRs had a positive effect on process outcomes in some clinical conditions; however, many studies were at unclear or high risk of bias and the results may be context specific. Future studies should seek to detail how the CPR might alter the diagnostic pathway, report effects on both patient and process outcomes, and improve reporting of the study interventions and implementation.

TRIAL REGISTRATION

The protocol for this review was not registered with PROSPERO, the international prospective register of systematic review protocols. The review was conceived and protocol prepared prior to the launch of PROSPERO in February 2011.

Do we really know what they were testing? Incomplete reporting of interventions in randomised trials of upper limb therapies in unilateral cerebral palsy

BACKGROUND

Incomplete reporting of components of interventions limits uptake of evidence into clinical practice.

AIMS

To evaluate the completeness of reporting of research and control interventions in randomised trials of upper limb therapies for children with unilateral cerebral palsy.

METHODS AND PROCEDURES

Sixty randomized trials were included, encompassing 60 research and 68 control interventions. Using the 12-item Template for Intervention Description and Replication (TIDieR) checklist, two reviewers independently rated intervention and control descriptions.

OUTCOMES AND RESULTS

When using 50% of studies as the benchmark, five of the 12 TIDieR items for the research intervention, eight of the 12 items for the control intervention and 11 of 12 items for "usual care" interventions were inadequately reported. Procedures used to deliver the research intervention were adequately reported for 63% of studies. Materials were used in 94% of research interventions, yet only 27% provided details to access/replicate materials. Training materials for interventionists were used in 38% of trials, 10 (17%) had procedure manuals, yet only 3 reported details to access materials. The location where the research intervention was provided was detailed in 65% of studies. Reporting of all items was poorer for the control intervention.

CONCLUSIONS

No study adequately reported all elements on the TIDieR checklist. Details crucial for replication of interventions and interpretation of results were missing. Authors, reviewers, and editors all have a responsibility to improve the quality of intervention reporting in published trials. The TIDieR guide is a potential solution, helping to structure accounts of interventions.

Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi

BACKGROUND

Dissemination and implementation of health care interventions are currently hampered by the variable quality of reporting of implementation research. Reporting of other study types has been improved by the introduction of reporting standards (e.g. CONSORT). We are therefore developing guidelines for reporting implementation studies (StaRI).

METHODS

Using established methodology for developing health research reporting guidelines, we systematically reviewed the literature to generate items for a checklist of reporting standards. We then recruited an international, multidisciplinary panel for an e-Delphi consensus-building exercise which comprised an initial open round to revise/suggest a list of potential items for scoring in the subsequent two scoring rounds (scale 1 to 9). Consensus was defined a priori as 80% agreement with the priority scores of 7, 8, or 9.

RESULTS

We identified eight papers from the literature review from which we derived 36 potential items. We recruited 23 experts to the e-Delphi panel. Open round comments resulted in revisions, and 47 items went forward to the scoring rounds. Thirty-five items achieved consensus: 19 achieved 100% agreement. Prioritised items addressed the need to: provide an evidence-based justification for implementation; describe the setting, professional/service requirements, eligible population and intervention in detail; measure process and clinical outcomes at population level (using routine data); report impact on health care resources; describe local adaptations to the implementation strategy and describe barriers/facilitators. Over-arching themes from the free-text comments included balancing the need for detailed descriptions of interventions with publishing constraints, addressing the dual aims of reporting on the process of implementation and effectiveness of the intervention and monitoring fidelity to an intervention whilst encouraging adaptation to suit diverse local contexts.

CONCLUSIONS

We have identified priority items for reporting implementation studies and key issues for further discussion. An international, multidisciplinary workshop, where participants will debate the issues raised, clarify specific items and develop StaRI standards that fit within the suite of EQUATOR reporting guidelines, is planned.

REGISTRATION

The protocol is registered with Equator: http://www.equator-network.org/library/reporting-guidelines-under-development/#17 .

Provision of antenatal smoking cessation support: a survey with pregnant Aboriginal and Torres Strait Islander women

INTRODUCTION

Guidelines recommend assessment of smoking status, with advice and support for smoking cessation, as a routine and integral part of antenatal care. Approximately 50% of pregnant Australian Aboriginal and Torres Strait Islander women smoke through pregnancy, 3 times the rate of other pregnant Australian women. This study describes smoking cessation assessment and support reported by pregnant Aboriginal and Torres Strait Islander women.

METHODS

Surveys of 261 pregnant Aboriginal and Torres Strait Islander women in New South Wales and the Northern Territory, Australia assessed women's reports of assessment, advice and support for smoking cessation from antenatal providers.

RESULTS

The majority of women (90%, 95% CI = 85, 93) reported being asked their smoking status; 81% (95% CI = 73, 87) of smokers reported being advised to stop smoking and 62% (95% CI = 53, 71) of smokers reported being offered support to quit.

CONCLUSIONS

Despite most pregnant women who smoke reporting advice and support to quit, the persisting high prevalence of smoking suggests that this support is insufficient to overcome the many factors pushing women to smoke. Improving the support provided to women will require empowering the antenatal providers with adequate skills, appropriate resources and effective interventions. Current guidelines are based on research from non-Indigenous populations, as there are no published effective interventions for Indigenous pregnant women. Trials of interventions designed specifically for pregnant Aboriginal and Torres Strait Islander women are urgently needed, as are approaches aimed at reducing uptake of smoking.