The informal way to success or failure? Findings from a comparative case study on video consultation training and implementation in two Danish hospitals

BACKGROUND

This study evaluated an attempt to implement video consultations through a novel education intervention in telehealth training and implementation in two middle-sized hospitals in Denmark. Three units tested the education intervention along with a regional decision to strengthen multidisciplinary and cross-sectoral collaboration through technology to improve service delivery by making the process more coherent and saving time and resources. This study aims to identify what contextual factors enable workplace learning, skills acquisition, and utilization of new digital skills to use and routinize video consultations in workplace practice.

METHODS

This qualitative case study draws on the principles of the realist evaluation framework using cross-case comparisons to test and refine program theories by exploring the complex and dynamic interaction among context, mechanism, and outcome. The methods in this study include participant observations, document analysis, semi-structured individual interviews, and focus groups. We performed an interpretive cross-case analysis, which explored the context-mechanism-outcome relationship using the guiding question, "What works, for whom, under what circumstances, and why?".

RESULTS

Two broad mechanisms appeared to enable skills acquisition and routinization of video consultations: informal workplace learning and adjusting video consultations to professional judgment. The three units had different approaches to the implementation and training and, as such, had different outcomes. First, the skills acquired in the units differed; therefore, how and with whom they used video consultations varied. Second, video consultation use was more likely to be adjusted to workflows if unit managers were responsive to staff's professional judgments regarding patients, as was evident in all three units.

CONCLUSION

Our study shows that a formal training course alone is insufficient to provide healthcare professionals with the skills needed to use video consultations in workplace practice. Informal workplace learning with support on the spot and continuous follow-up seems to equip healthcare professionals with the skills to use video consultations. Video consultations are more likely to be used confidently if novel workflows are adjusted to health care professionals' knowledge, skills, and judgment and their concerns regarding patient soundness.

Can "realist" randomised controlled trials be genuinely realist?

In this paper, we respond to a paper by Jamal and colleagues published in Trials in October 2015 and take an opportunity to continue the much-needed debate about what applied scientific realism is. The paper by Jamal et al. is useful because it exposes the challenges of combining a realist evaluation approach (as developed by Pawson and Tilley) with the randomised controlled trial (RCT) design.

We identified three fundamental differences that are related to paradigmatic differences in the treatment of causation between post-positivist and realist logic: (1) the construct of mechanism, (2) the relation between mediators and moderators on one hand and mechanisms and contexts on the other hand, and (3) the variable-oriented approach to analysis of causation versus the configurational approach.

We show how Jamal et al. consider mechanisms as observable, external treatments and how their approach reduces complex causal processes to variables. We argue that their proposed RCT design cannot provide a truly realist understanding. Not only does the proposed realist RCT design not deal with the RCT’s inherent inability to “unpack” complex interventions, it also does not enable the identification of the dynamic interplay among the intervention, actors, context, mechanisms and outcomes, which is at the core of realist research. As a result, the proposed realist RCT design is not, as we understand it, genuinely realist in nature.

Understanding the motivation and performance of community health volunteers involved in the delivery of health programmes in Kampala, Uganda: a realist evaluation protocol

INTRODUCTION

The recruitment of community health volunteers to support the delivery of health programmes is a well-established approach in many countries, particularly where health services are not readily available. However, studies on management of volunteers are scarce and current research on human resource management of volunteers faces methodological challenges. This paper presents the protocol of a realist evaluation that aims at identifying the factors influencing the performance of community health volunteers involved in the delivery of a Red Cross immunisation programme in Kampala (Uganda) with a specific focus on motivation.

METHODS AND ANALYSIS

The realist evaluation cycle structures the protocol. To develop the theoretical basis for the evaluation, the authors conducted interviews and reviewed the literature on community health volunteers' performance, management and organisational behaviour. This led to the formulation of the initial programme theory, which links the intervention inputs (capacity-building strategies) to the expected outcomes (positive work behaviour) with mechanisms that point in the direction of drivers of motivation. The contextual elements include components such as organisational culture, resource availability, etc. A case study design will be adopted. We define a case as a Red Cross branch, run by a programme manager, and will select two cases at the district level in Kampala. Mixed methods will be used in data collection, including individual interviews of volunteers, participant observation and document review. The thematic analysis will be based on the initial programme theory and will seek for context-mechanism-outcome configurations. Findings from the two cases will be compared.

DISCUSSION

We discuss the scope for applying realist evaluation and the methodological challenges we encountered in developing this protocol.

ETHICS AND DISSEMINATION

The study was approved by the Ethical Committee at Rennes University Hospital, France. Results will be published in scientific journals, and communicated to respondents and relevant institutions.