Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation

Introducing new point-of-care tests for common infections in publicly funded clinics in South Africa: a qualitative study with primary care clinicians

Broad-spectrum antibiotics are routinely prescribed empirically in the resource-poor settings for suspected acute common infections, which drive antimicrobial resistance. Point-of-care testing (POCT) might increase the appropriateness of decisions about whether and which antibiotic to prescribe, but implementation will be most effective if clinician's perspectives are taken into account.

OBJECTIVES

To explore the perceptions of South African primary care clinicians working in publicly funded clinics about: making antibiotic prescribing decisions for two common infection syndromes (acute cough, urinary tract infection); their experiences of existing POCTs; their perceptions of the barriers and opportunities for introducing (hypothetical) new POCTs.

DESIGN, METHOD, PARTICIPANTS, SETTING

Qualitative semistructured interviews with 23 primary care clinicians (nurses and doctors) at publicly funded clinics in the Western Cape Metro district, South Africa. Data were analysed using thematic analysis.

RESULTS

Clinicians reported that their antibiotic prescribing decisions were influenced by their clinical assessment, patient comorbidities, social factors (eg, access to care) and perceived patient expectations. Their experiences with currently available POCTs were largely positive, and they were optimistic about the potential for new POCTs to: support evidence-based prescribing decisions that might reduce unnecessary antibiotic prescriptions; reduce the need for further investigations; support effective communication with patients, especially when antibiotics were unlikely to be of benefit. Resources and workflow disruption were seen as the main barriers to uptake into routine care.

CONCLUSIONS

Clinicians working in publicly funded clinics in the Western Cape Metro of South Africa saw POCTs as potentially useful for positively addressing both clinical and social drivers of the overprescribing of broad-spectrum antibiotics, but were concerned about the resource implications and disruption of existing patient workflows.

Patients' understanding of cellulitis and views about how best to prevent recurrent episodes: mixed-methods study in primary and secondary care

BACKGROUND

Cellulitis is a common painful infection of the skin and underlying tissues that recurs in approximately one-third of cases. The only proven strategy to reduce the risk of recurrence is long-term, low-dose antibiotics. Given current concerns about antibiotic resistance and the pressure to reduce antibiotic prescribing, other prevention strategies are needed.

OBJECTIVES

To explore patients' views about cellulitis and different ways of preventing recurrent episodes.

METHODS

Adults aged ≥ 18 years with a history of first-episode or recurrent cellulitis were invited through primary care, hospitals and advertising to complete a survey, take part in an interview or both.

RESULTS

Thirty interviews were conducted between August 2016 and July 2017. Two hundred and forty surveys were completed (response rate 17%). Triangulation of quantitative and qualitative data showed that people who have had cellulitis have wide-ranging beliefs about what can cause cellulitis and are often unaware of risk of recurrence or potential strategies to prevent recurrence. Enhanced foot hygiene, applying emollients daily, exercise and losing weight were more popular potential strategies than the use of compression stockings or long-term antibiotics. Participants expressed caution about long-term oral antibiotics, particularly those who had experienced only one episode of cellulitis.

CONCLUSIONS

People who have had cellulitis are keen to know about possible ways to prevent further episodes. Enhanced foot hygiene, applying emollients daily, exercise and losing weight were generally viewed to be more acceptable, feasible strategies than compression or antibiotics, but further research is needed to explore uptake and effectiveness in practice.

The views of children and young people on the use of silk garments for the treatment of eczema: a nested qualitative study within the CLOTHing for the relief of Eczema Symptoms (CLOTHES) randomized controlled trial

Background

Many children suffer with skin diseases but to date most dermatological research has been done ‘on’ rather than ‘with’ children; in this study we actively sought the experiences of children and young people. Atopic eczema (AE) is a chronic, itchy, inflammatory skin condition that affects around 20% of children and can impact on the health and wellbeing of children and their families. The role of specialist clothing in the management of AE is poorly understood.

Objectives

The aim of this study, which was nested in a randomized controlled trial, was to qualitatively examine child participants’ experiences of using silk garments for the treatment of AE.

Methods

Eighteen children aged 5–15 years, who took part in the CLOTHing for the relief of Eczema Symptoms (CLOTHES) trial, participated in age‐appropriate individual interviews or focus groups.

Results

Thematic analysis generated four themes directly related to the silk garments: (i) expectations of the garments; (ii) wearing the garments; (iii) asking if the garments helped; and (iv) thoughts about the garments. The conclusions from this nested qualitative study are that there was some limited improvement in eczema for some children but that the hoped‐for ‘miracle cure’ did not transpire. A mixed picture of knowledge, beliefs and experiences of using the silk garments emerged.

Conclusions

Engaging children in the evaluation of the garments provided first‐hand nuanced insights that enhanced understanding of the CLOTHES study as a whole. This nested study demonstrates that children can and indeed want to be engaged in dermatological research in meaningful ways that add to our understanding of treatment options.

What's already known about this topic?

Eczema affects around 20% of children and can have a detrimental effect on the child and their family.

Adherence with topical treatments is often poor and can lead to treatment failure.

Although children are often end‐users of eczema treatments, they are rarely engaged in research involving these products beyond completing questionnaires.

What does this study add?

Children and young people can be meaningfully engaged in dermatology research and add new dimensions of understanding that would not be gained by proxy data.

Children told us about their expectations of the garments and their views once they had worn them.

The added value of child data lies in enhancing understanding of reasons for adherence and nonadherence, in facilitating interpretation of the trial results, and in ensuring selected objective outcome measures include factors important to children.

What are the clinical implications of the work?

This study illustrates the need to communicate effectively with children and young people to ascertain their thoughts and beliefs about treatment regimens and assess the likelihood of adherence.

Linked Comment: Teasdale. Br J Dermatol 2018; 178:25–26.

Plain language summary available online

Respond to this article

Research on systemic psychology in Latin America: An integrative review with methods and data triangulation

ABSTRACT: This integrative review synthesizes convergent qualitative and quantitative data about the research on systemic psychology in Latin America, in populations without diagnosed morbidity. Eligibility criteria followed PRISMA and PICO protocols. The quality of studies was evaluated with CASP, and the synthesis method was the triangulation of methods and data. With the results from the article content analysis by means of word clouds, it was possible to contrast keywords with emerging categories and to develop a meta-synthesis, including a meta-model of the research on systemic psychology. The search was restricted to Pepsic and Web of Science databases, with a narrow focus on the theme. As the theme is inherently interdisciplinary, potential relevant studies might not have been included.

The feasibility and acceptability of a physical activity intervention for older people with chronic musculoskeletal pain: The iPOPP pilot trial protocol

INTRODUCTION

This pilot trial will inform the design and methods of a future full-scale randomized controlled trial (RCT) and examine the feasibility, acceptability and fidelity of the Increasing Physical activity in Older People with chronic Pain (iPOPP) intervention, a healthcare assistant (HCA)-supported intervention to promote walking in older adults with chronic musculoskeletal pain in a primary care setting.

METHODS AND ANALYSIS

The iPOPP study is an individually randomized, multicentre, three-parallel-arm pilot RCT. A total of 150 participants aged ≥65 years with chronic pain in one or more index sites will be recruited and randomized using random permuted blocks, stratified by general practice, to: (i) usual care plus written information; (ii) pedometer plus usual care and written information; or (iii) the iPOPP intervention. A theoretically informed mixed-methods approach will be employed using semi-structured interviews, audio recordings of the HCA consultations, self-reported questionnaires, case report forms and objective physical activity data collection (accelerometry). Follow-up will be conducted 12 weeks post-randomization. Collection of the quantitative data and statistical analysis will be performed blinded to treatment allocation, and analysis will be exploratory to inform the design and methods of a future RCT. Analysis of the HCA consultation recordings will focus on the use of a checklist to determine the fidelity of the iPOPP intervention delivery, and the interview data will be analysed using a constant comparison approach in order to generate conceptual themes focused around the acceptability and feasibility of the trial, and then mapped to the Theoretical Domains Framework to understand barriers and facilitators to behaviour change. A triangulation protocol will be used to integrate quantitative and qualitative data and findings.

Optimising the quality of antibiotic prescribing in out-of-hours primary care in Belgium: a study protocol for an action research project

INTRODUCTION

Antimicrobial resistance is a major public health threat driven by inappropriate antibiotic use, mainly in general practice and for respiratory tract infections. In Belgium, the quality of general practitioners' (GPs) antibiotic prescribing is low. To improve antibiotic use, we need a better understanding of this quality problem and corresponding interventions. A general practitioners cooperative (GPC) for out-of-hours (OOH) care presents a unique opportunity to reach a large group of GPs and work on quality improvement. Participatory action research (PAR) is a bottom-up approach that focuses on implementing change into daily practice and has the potential to empower practitioners to produce their own solutions to optimise their antibiotic prescribing.

METHODS

This PAR study to improve antibiotic prescribing quality in OOH care uses a mixed methods approach. In a first exploratory phase, we will develop a partnership with a GPC and map the existing barriers and opportunities. In a second phase, we will focus on facilitating change and implementing interventions through PDSA (Plan-Do-Study-Act) cycles. In a third phase, antibiotic prescribing quality outside and antibiotic use during office hours will be evaluated. Equally important are the process evaluation and theory building on improving antibiotic prescribing.

ETHICS

The study protocol was approved by the Ethics Committee of the Antwerp University Hospital/University of Antwerp. PAR unfolds in response to the needs and issues of the stakeholders, therefore new ethics approval will be obtained at each new stage of the research.

DISSEMINATION

Interventions to improve antibiotic prescribing are needed now more than ever and outcomes will be highly relevant for GPCs, GPs in daily practice, national policymakers and the international scientific community.

TRIAL REGISTRATION NUMBER

NCT03082521; Pre-results.

A multidimensional approach to assessing intervention fidelity in a process evaluation of audit and feedback interventions to reduce unnecessary blood transfusions: a study protocol

Background

In England, NHS Blood and Transplant conducts national audits of transfusion and provides feedback to hospitals to promote evidence-based practice. Audits demonstrate 20% of transfusions fall outside guidelines. The AFFINITIE programme (Development & Evaluation of Audit and Feedback INterventions to Increase evidence-based Transfusion practIcE) involves two linked, 2×2 factorial, cluster-randomised trials, each evaluating two theoretically-enhanced audit and feedback interventions to reduce unnecessary blood transfusions in UK hospitals. The first intervention concerns the content/format of feedback reports. The second aims to support hospital transfusion staff to plan their response to feedback and includes a web-based toolkit and telephone support. Interpretation of trials is enhanced by comprehensively assessing intervention fidelity. However, reviews demonstrate fidelity evaluations are often limited, typically only assessing whether interventions were delivered as intended. This protocol presents methods for assessing fidelity across five dimensions proposed by the Behaviour Change Consortium fidelity framework, including intervention designer-, provider- and recipient-levels.

Methods

(1) Design: Intervention content will be specified in intervention manuals in terms of component behaviour change techniques (BCTs). Treatment differentiation will be examined by comparing BCTs across intervention/standard practice, noting the proportion of unique/convergent BCTs. (2) Training: draft feedback reports and audio-recorded role-play telephone support scenarios will be content analysed to assess intervention providers’ competence to deliver manual-specified BCTs. (3) Delivery: intervention materials (feedback reports, toolkit) and audio-recorded telephone support session transcripts will be content analysed to assess actual delivery of manual-specified BCTs during the intervention period. (4) Receipt and (5) enactment: questionnaires, semi-structured interviews based on the Theoretical Domains Framework, and objective web-analytics data (report downloads, toolkit usage patterns) will be analysed to assess hospital transfusion staff exposure to, understanding and enactment of the interventions, and to identify contextual barriers/enablers to implementation. Associations between observed fidelity and trial outcomes (% unnecessary transfusions) will be examined using mediation analyses.

Discussion

If the interventions have acceptable fidelity, then results of the AFFINITIE trials can be attributed to effectiveness, or lack of effectiveness, of the interventions. Hence, this comprehensive assessment of fidelity will be used to interpret trial findings. These methods may inform fidelity assessments in future trials.

Trial registration

ISRCTN 15490813. Registered 11/03/2015

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-016-0528-x) contains supplementary material, which is available to authorized users.

Point-of-care CRP testing in the diagnosis of pneumonia in adults

Respiratory tract infections (RTI) are among the most common acute conditions leading to GP consultations and to antibiotic prescribing in primary care, even though 70% are viral, and many others are minor self-limiting bacterial infections.^1-4 Between 0.5% and 1.1% of adults have community-acquired pneumonia every year in the UK, most of whom are managed in primary care.^4,5 The decision to prescribe antibiotics for an acute RTI in primary care is often based on clinical symptoms, which have low sensitivity and specificity, and high inter-observer variability.^2,4 In primary care, it is very difficult to differentiate between diagnoses without additional tests.⁶ Unnecessary antibiotic prescribing may not aid recovery, exposes patients to potential adverse effects, may encourage repeat attendance and contributes to antibiotic resistance.^2,7 One strategy aiming to reduce antibiotic prescribing in primary care is the use of biomarkers (e.g. C-reactive protein [CRP]).² In the correct clinical context (e.g. in previously healthy people, not those with chronic lung disease) and as an adjunct to clinical assessment, a biomarker may help in the management of an RTI.² In order to be used during the consultation, the results of a biomarker test must be rapidly available (e.g. 'point-of-care' [POC] testing).⁴ POC testing for CRP has recently been recommended as part of a national clinical guideline on the diagnosis and management of pneumonia.⁴ Here, we review the rationale for POC CRP testing and its advantages and disadvantages.