Rethinking resistance to ‘big IT’: a sociological study of why and when healthcare staff do not use nationally mandated information and communication technologies

Barriers to and Facilitators of Key Stakeholders Influencing Successful Digital Implementation of Remote Monitoring Solutions: Mixed Methods Analysis

BACKGROUND

Implementation of remote monitoring solutions and digital alerting tools in health care has historically been challenging, despite the impetus provided by the COVID-19 pandemic. To date, a health systems-based approach to systematically describe barriers and facilitators across multiple domains has not been undertaken.

OBJECTIVE

We aimed to undertake a comprehensive mixed methods analysis of barriers and facilitators for successful implementation of remote monitoring and digital alerting tools in complex health organizations.

METHODS

A mixed methods approach using a modified Technology Acceptance Model questionnaire and semistructured interviews mapped to the validated fit among humans, organizations, and technology (HOT-fit) framework was undertaken. Likert frequency responses and deductive thematic analyses were performed.

RESULTS

A total of 11 participants responded to the questionnaire and 18 participants to the interviews. Key barriers and facilitators could be mapped onto 6 dimensions, which incorporated aspects of digitization: system use (human), user satisfaction (human), environment (organization), structure (organization), information and service quality (technology), and system quality (technology).

CONCLUSIONS

The recommendations proposed can enhance the potential for future remote sensing solutions to be more successfully integrated in health care practice, resulting in more successful use of "virtual wards."

TRIAL REGISTRATION

ClinicalTrials.gov NCT05321004; https://www.clinicaltrials.gov/study/NCT05321004.

Researching big IT in the UK National Health Service: A systematic review of theory-based studies

OBJECTIVE

To identify and discuss theory-based studies of large-scale health information technology programs in the UK National Health Service.

MATERIALS AND METHODS

Using the PRISMA systematic review framework, we searched Scopus, PubMed and CINAHL databases from inception to March 2022 for theory-based studies of large-scale health IT implementations. We undertook detailed full-text analyses of papers meeting our inclusion criteria.

RESULTS

Forty-six studies were included after assessment for eligibility, of which twenty-five applied theories from the information systems arena (socio-technical approaches, normalization process theory, user acceptance theories, diffusion of innovation), twelve from sociology (structuration theory, actor-network theory, institutional theory), while nine adopted other theories. Most investigated England's National Program for IT (2002-2011), exploring various technologies among which electronic records predominated. Research themes were categorized into user factors, program factors, process outcomes, clinical impact, technology, and organizational factors. Most research was qualitative, often using a case study strategy with a longitudinal or cross-sectional approach. Data were typically collected through interviews, observation, and document analysis; sampling was generally purposive; and most studies used thematic or related analyses. Theories were generally applied in a superficial or fragmentary manner; and articles frequently lacked detail on how theoretical constructs and relationships aided organization, analysis, and interpretation of data.

CONCLUSION

Theory-based studies of large NHS IT programs are relatively uncommon. As large healthcare programs evolve over a long timeframe in complex and dynamic environments, wider adoption of theory-based methods could strengthen the explanatory and predictive utility of research findings across multiple evaluation studies. Our review has confirmed earlier suggestions for theory selection, and we suggest there is scope for more explicit use of such theoretical constructs to strengthen the conceptual foundations of health informatics research. Additionally, the challenges of large national health informatics programs afford wide-ranging opportunities to test, refine, and adapt sociological and information systems theories.

Access and triage in contemporary general practice: A novel theory of digital candidacy

To access contemporary healthcare, patients must find and navigate a complex socio-technical network of human and digital actors linked in multi-modal pathways. Asynchronous, digitally-mediated triage decisions have largely replaced synchronous conversations between humans. In this paper, we draw on a large qualitative dataset from a multi-site study of remote and digital technologies in general practice to understand widening inequities of access. We theorise our data by bringing together traditional candidacy theory (in particular, concepts of self-assessment, help-seeking, adjudication and negotiation) and socio-technical and technology structuration theories (in particular, concepts of user configuration, articulation, distanciation, disembedding, and recursivity), thus producing a novel theory of digital candidacy. We propose that both human and technological actors (in different ways) embody social structures which affect how they 'act' in social situations. Digital technologies contain inbuilt assumptions about users' capabilities, needs, rights, and skills. Patients' ability to self-assess as sick, access digital platforms, self-advocate, and navigate multiple stages in the pathway, including adapting to and compensating for limitations in the technology, vary widely and are markedly patterned by disadvantage. Not every patient can craft an accurate digital facsimile on which the subsequent adjudication decision will be made; those who create incomplete, flawed or unpersuasive digital facsimiles may be deprioritised or misdirected. Staff who know about such patients may use articulation measures to ensure a personalised and appropriate access package, but they cannot identify or fully mitigate all such cases. The decisions and actions of human and technological agents at the time of an attempt to access care can significantly influence, disrupt, and reconstitute candidacy both immediately and recursively over time, and also recursively shape the system itself. These findings underscore the need for services to be (co-)designed with attention to the exclusionary tendencies of digital technologies and technology-supported processes and pathways.

The importance of rhythms for maintaining consent in diagnostic encounters to detect cervical cancer

Diagnostic encounters can be seen as complex socio-material processes. Drawing on the new materialist ideas of Barad, we studied how an innovative technology became part of the intra-actions between different human and non-human materialities in a cervical cancer diagnostic process. While researching the development of a technology intended to improve cervical cancer detection, we carried out a series of observations of diagnostic encounters involving clinicians, patients and the device in a hospital. The intra-actions between the different materialities had rhythmic properties, repeated activities and timings that varied in intensity, for example, movements, exchanged looks, and talk that helped co-produce the diagnosis and maintain consent. Sadly, the device interfered with the rhythms, undermining the clinicians' desire to adopt it, despite it being more accurate at diagnosing ill health than previous assistive technologies. Studying rhythms as part of diagnostic encounters could help with the design and subsequent integration of novel technologies in healthcare, because they encompass relationships created by human and non-human materialities. Importantly, highlighting the role of rhythms contributes another way diagnostic encounters are co-produced between clinicians and patients, and how they can be disrupted, improving the understanding of how consent is maintained or lost.

Clinical Impact of "Real World Data" and Blockchain on Public Health: A Scoping Review

The digitisation of healthcare has allowed a significant rethinking of the previous clinical protocols, improving their interoperability through substantial standardisation. These technological advances have ensured that data are comparable, as they are obtained from 'reliable' and certified processes; however, there are billions of data that are neither structured nor quality-controlled. They are collectively referred to as 'Real World Data' (RWD). Blockchain (BC) is a procedure with specific characteristics and algorithms that ensure that the stored data cannot be tampered with. Nowadays, there is an increasing need to rethink blockchain in a one-health vision, making it more than just a 'repository' of data and information, but rather an active player in the process of data sharing. In this landscape, several scholars have analysed the potential benefits of BC in healthcare, focusing on the sharing and safety of clinical data and its contact tracing applications. There is limited research on this matter; moreover, there is a strategic interest in managing RWD in a reliable and comparable way, despite the lack of knowledge on this topic. Our work aims to analyse systematically the most impacting literature, highlighting the main aspects of BC within the context of the new digital healthcare, and speculating on the unexpressed potential of RWD.

Beyond Information Provision: Analysis of the Roles of Structure and Agency in COVID-19 Vaccine Confidence in Ethnic Minority Communities

People from Black and Asian backgrounds are more likely to die from COVID-19 but less likely to be vaccinated, threatening to exacerbate health inequalities already experienced by ethnic minority groups. The literature suggests that mistrust rooted in structural inequality (including socioeconomic position and experience of racism) may be a key barrier to COVID-19 vaccine uptake. Understanding and addressing structural inequality is likely to lead to longer-term impacts than information alone. The aim of this study is to draw on health and sociological theories of structure and agency to inform our understanding of how structural factors influence vaccine confidence. We conducted qualitative interviews and focus groups with 22 people from London and the surrounding areas from December 2021 to March 2022. Fourteen participants were members of the public from ethnic minority backgrounds, and seven were professionals working with the public to address concerns and encourage vaccine uptake. Our findings suggest that people from ethnic minority backgrounds make decisions regarding COVID-19 vaccination based on a combination of how they experience external social structures (including lack of credibility and clarity from political authority, neglect by health services, and structural racism) and internal processes (weighing up COVID-19 vaccine harms and benefits and concerns about vaccine development and deployment). We may be able to support knowledge accumulation through the provision of reliable and accessible information, particularly through primary and community care, but we recommend a number of changes to research, policy and practice that address structural inequalities. These include working with communities to improve ethnicity data collection, increasing funding allocation to health conditions where ethnic minority communities experience poorer outcomes, greater transparency and public engagement in the vaccine development process, and culturally adapted research recruitment processes.

Rehabilitation professionals' perspectives and experiences with the use of technologies for violence prevention: a qualitative study

BACKGROUND

There is growing public policy and research interest in the development and use of various technologies for managing violence in healthcare settings to protect the health and well-being of patients and workers. However, little research exists on the impact of technologies on violence prevention, and in particular in the context of rehabilitation settings. Our study addresses this gap by exploring the perceptions and experiences of rehabilitation professionals regarding how technologies are used (or not) for violence prevention, and their perceptions regarding their efficacy and impact.

METHODS

This was a descriptive qualitative study with 10 diverse professionals (e.g., physical therapy, occupational therapy, recreation therapy, nursing) who worked across inpatient and outpatient settings in one rehabilitation hospital. Data collection consisted of semi-structured interviews with all participants. A conventional approach to content analysis was used to identify key themes.

RESULTS

We found that participants used three types of technologies for violence prevention: an electronic patient flagging system, fixed and portable emergency alarms, and cameras. All of these were perceived by participants as being largely ineffective for violence prevention due to poor design features, malfunction, limited resources, and incompatibility with the culture of care. Our analysis further suggests that professionals' perception that these technologies would not prevent violence may be linked to their focus on individual patients, with a corresponding lack of attention to structural factors, including the culture of care and the organizational and physical environment.

CONCLUSIONS

Our findings suggest an urgent need for greater consideration of structural factors in efforts to develop effective interventions for violence prevention in rehabilitation settings, including the design and implementation of new technologies.

Staff experiences of training and delivery of remote home monitoring services for patients diagnosed with COVID-19 in England: A mixed-methods study

OBJECTIVES

Remote home monitoring services for patients at risk of rapid deterioration introduced during the COVID-19 pandemic had important implications for the health workforce. This study explored the nature of 'work' that health care staff in England undertook to manage patients with COVID-19 remotely, how they were supported to deliver these new services, and the factors that influenced delivery of COVID-19 remote home monitoring services for staff.

METHODS

We conducted a rapid mixed-methods evaluation of COVID-19 remote home monitoring services during November 2020 to July 2021 using a cross-sectional survey of a purposive sample of staff involved in delivering the service (clinical leads, frontline delivery staff and those involved in data collection and management) from 28 sites across England. We also conducted interviews with 58 staff in a subsample of 17 sites. Data collection and analysis were carried out in parallel. We used thematic analysis to analyse qualitative data while quantitative survey data were analysed using descriptive statistics.

RESULTS

A total of 292 staff responded to the surveys (39% response rate). We found that prior experience of remote monitoring had some, albeit limited benefit for delivering similar services for patients diagnosed with COVID-19. Staff received a range of locally specific training and clinical oversight along with bespoke materials and resources. Staff reported feeling uncertain about using their own judgement and being reliant on seeking clinical oversight. The experience of transitioning from face-to-face to remote service delivery led some frontline delivery staff to reconsider their professional role, as well as their beliefs around their own capabilities. There was a general perception of staff being able to adapt, acquire new skills and knowledge and they demonstrated a commitment to continuity of care for patients, although there were reports of struggling with the increased accountability and responsibility attached to their adapted roles at times.

CONCLUSIONS

Remote home monitoring models can play an important role in managing a large number of patients for COVID-19 and possibly a range of other conditions. Successful delivery of such service models depends on staff competency and the nature of training received to facilitate effective care and patient engagement.

Exploring the experiences and views of doctors working with Artificial Intelligence in English healthcare; a qualitative study

BACKGROUND

The National Health Service (NHS) aspires to be a world leader of Artificial Intelligence (AI) in healthcare, however, there are several barriers facing translation and implementation. A key enabler of AI within the NHS is the education and engagement of doctors, however evidence suggests that there is an overall lack of awareness of and engagement with AI.

RESEARCH AIM

This qualitative study explores the experiences and views of doctor developers working with AI within the NHS exploring; their role within medical AI discourse, their views on the implementation of AI more widely and how they consider the engagement of doctors with AI technologies may increase in the future.

METHODS

This study involved eleven semi-structured, one-to-one interviews conducted with doctors working with AI in English healthcare. Data was subjected to thematic analysis.

RESULTS

The findings demonstrate that there is an unstructured pathway for doctors to enter the field of AI. The doctors described the various challenges they had experienced during their career, with many arising from the differing demands of operating in a commercial and technological environment. The perceived awareness and engagement among frontline doctors was low, with two prominent barriers being the hype surrounding AI and a lack of protected time. The engagement of doctors is vital for both the development and adoption of AI.

CONCLUSIONS

AI offers big potential within the medical field but is still in its infancy. For the NHS to leverage the benefits of AI, it must educate and empower current and future doctors. This can be achieved through; informative education within the medical undergraduate curriculum, protecting time for current doctors to develop understanding and providing flexible opportunities for NHS doctors to explore this field.

Using the Stay Strong App for the Well-being of Indigenous Australian Prisoners: Feasibility Study

Background

The gap between mental health needs and resources for Aboriginal and Torres Strait Islander people, the Indigenous people of Australia, is most marked in the prison population. Indigenous people are overrepresented in Australian prisons. In prison, this group experiences mental disorders to a greater degree than non-Indigenous prisoners. This group has also been found to experience mental disorder at a higher rate than Indigenous people in the community. In addition to pre-existing determinants of poor mental health, these high prevalence rates may reflect poor engagement in mainstream interventions or the efficacy of available interventions. In community populations, the use of digital mental health resources may help to increase access to well-being support. However, culturally appropriate digital tools have not been available to Indigenous people in prisons. The absence of feasibility and efficacy studies of these tools needs to be addressed.

Objective

The aim of this study is to determine the feasibility of the Stay Strong app as a digital well-being and mental health tool for use by Indigenous people in prison.

Methods

Dual government agency (health and corrective services) precondition requirements of implementation were identified and resolved. This was essential given that the Stay Strong app was to be delivered by an external health agency to Indigenous prisoners. Then, acceptability at a practice level was tested using postuse qualitative interviews with clients and practitioners of the Indigenous Mental Health Intervention Program. All Indigenous Mental Health Intervention Program practitioners (10/37, 27%) and client participants who had completed their second follow-up (review of the Stay Strong app; 27/37, 73%) during the study period were invited to participate.

Results

Owing to the innovative nature of this project, identifying and resolving the precondition requirements of implementation was challenging but provided support for the implementation of the app in practice. Acceptability of the app by clients and practitioners at a practice level was demonstrated, with nine themes emerging across the interviews: satisfaction with the current Stay Strong app, supported client goal setting, increased client self-insight, improved client empowerment, cultural appropriateness, enhanced engagement, ease of use, problems with using an Android emulator, and recommendations to improve personalization.

Conclusions

The Stay Strong Custody Project is a pioneering example of digital mental health tools being implemented within Australian prisons. Using the app within high-security prison settings was found to be feasible at both strategic and practice levels. Feedback from both clients and practitioners supported the use of the app as a culturally safe digital mental health and well-being tool for Aboriginal and Torres Strait Islander people in prison.

Telepsychiatry: learning from the pandemic

This article draws on research and clinical experience to discuss how and when to use video consultations in mental health settings. The appropriateness and impact of virtual consultations are influenced by the patient's clinical needs and social context, as well as by service-level socio-technical and logistical factors.

Achieving Spread, Scale Up and Sustainability of Video Consulting Services During the COVID-19 Pandemic? Findings From a Comparative Case Study of Policy Implementation in England, Wales, Scotland and Northern Ireland

Requirements for physical distancing as a result of COVID-19 and the need to reduce the risk of infection prompted policy supporting rapid roll out of video consulting across the four nations of the UK-England, Northern Ireland, Scotland and Wales. Drawing on three studies of the accelerated implementation and uptake of video consulting across the four nations, we present a comparative and interpretive policy analysis of the spread and scale-up of video consulting during the pandemic. Data include interviews with 59 national level stakeholders, 55 health and social care staff and 30 patients, 20 national documents, responses to a UK-wide survey of NHS staff and analysis of routine activity data. Sampling ensured variations in geography, clinical context and adoption progress across the combined dataset. Comparative analysis was guided by theory on policy implementation and crisis management. The pandemic provided a "burning platform" prompting UK-wide policy supporting the use of video consulting in health care as a critical means of managing the risk of infection and a standard mode of provision. This policy push facilitated interest in video consulting across the UK. There was, however, marked variation in how this was put into practice across the four nations. Pre-existing infrastructure, policies and incentives for video consulting in Scotland, combined with a collaborative system-level approach, a program dedicated to developing video-based services and resourcing and supporting staff to deliver them enabled widespread buy-in and rapid spread. In England, Wales and Northern Ireland, pre-existing support for digital health (e.g., hardware, incentives) and virtual care, combined with reduced regulation and "light touch" procurement managed to override some (but by no means all) cultural barriers and professional resistance to implementing digital change. In Northern Ireland and Wales, limited infrastructure muted spread. In all three countries, significant effort at system level to develop, review and run video consulting programs enabled a substantial number of providers to change their practice, albeit variably across settings. Across all four nations ongoing uncertainty, potential restructuring and tightening of regulations, along with difficulties inherent in addressing inequalities in digital access, raise questions about the longer-term sustainability of changes to-date.

Electronic consultations and economies of scale: a qualitative study of clinician perspectives on scaling up e-consult delivery

OBJECTIVE

To explore Veterans Health Administration clinicians' perspectives on the idea of redesigning electronic consultation (e-consult) delivery in line with a hub-and-spoke (centralized) model.

MATERIALS AND METHODS

We conducted a qualitative study in VA New England Healthcare System (VISN 1). Semi-structured phone interviews were conducted with 35 primary care providers and 38 specialty care providers, including 13 clinical leaders, at 6 VISN 1 sites varying in size, specialist availability, and e-consult volume. Interviews included exploration of the hub-and-spoke (centralized) e-consult model as a system redesign option. Qualitative content analysis procedures were applied to identify and describe salient categories.

RESULTS

Participants saw several potential benefits to scaling up e-consult delivery from a decentralized model to a hub-and-spoke model, including expanded access to specialist expertise and increased timeliness of e-consult responses. Concerns included differences in resource availability and management styles between sites, anticipated disruption to working relationships, lack of incentives for central e-consultants, dedicated staff's burnout and fatigue, technological challenges, and lack of motivation for change.

DISCUSSION

Based on a case study from one of the largest integrated healthcare systems in the United States, our work identifies novel concerns and offers insights for healthcare organizations contemplating a scale-up of their e-consult systems.

CONCLUSIONS

Scaling up e-consults in line with the hub-and-spoke model may help pave the way for a centralized and efficient approach to care delivery, but the success of this transformation will depend on healthcare systems' ability to evaluate and address barriers to leveraging economies of scale for e-consults.

Informing telehealth service delivery for cardiovascular disease management: exploring the perceptions of rural health professionals

Objective To explore the perceptions of rural health professionals who use telehealth services for cardiovascular health care, including the potential role of telehealth in enhancing services for this patient group. Methods Semi-structured interviews were conducted with ten rural health professionals across a range of disciplines, including medicine, nursing and allied health. All study participants were based in the same rural region in New South Wales, Australia. Results Participant responses emphasised the importance of including rural communities in ongoing dialogue to enhance telehealth services for cardiovascular care. Divergent expectations about the purpose of telehealth and unresolved technology issues were identified as factors to be addressed. Rural health professionals highlighted the importance of all stakeholders coming together to overcome barriers and enhance telehealth services in a collaborative manner. Conclusion This study contributes to an evolving understanding of how health professionals based in regional Australia experience telehealth services. Future telehealth research should proceed in collaboration with rural communities, supported by policy that actively facilitates the meaningful inclusion of rural stakeholders in telehealth dialogue. What is known about the topic? Telehealth is frequently discussed as a potential solution to overcome aspects of rural health, such as poor outcomes and limited access to services compared with metropolitan areas. In the context of telehealth and cardiovascular disease (CVD), research that focuses on rural communities is limited, particularly regarding the experiences of these communities with telehealth. What does this paper add? This paper offers insight into how telehealth is experienced by rural health professionals. The paper highlights divergent expectations of telehealth's purpose and unresolved technological issues as barriers to telehealth service delivery. It suggests telehealth services may be enhanced by collaborative approaches that engage multiple stakeholder groups. What are the implications for practitioners? The use and development of telehealth in rural communities requires a collaborative approach that considers the views of rural stakeholders in their specific contexts. To improve telehealth services for people living with CVD in rural communities, it is important that rural stakeholders have opportunities to engage with non-rural clinicians, telehealth developers and policy makers.

The implementation, use and sustainability of a clinical decision support system for medication optimisation in primary care: A qualitative evaluation

Background

The quality and safety of prescribing in general practice is important, Clinical decision support (CDS) systems can be used which present alerts to health professionals when prescribing in order to identify patients at risk of potentially hazardous prescribing. It is known that such computerised alerts may improve the safety of prescribing in hospitals but their implementation and sustainable use in general practice is less well understood. We aimed to understand the factors that influenced the successful implementation and sustained use in primary care of a CDS system.

Methods

Participants were purposively recruited from Clinical Commissioning Groups (CCGs) and general practices in the North West and East Midlands regions of England and from the CDS developers. We conducted face-to-face and telephone-based semi-structured qualitative interviews with staff stakeholders. A selection of participants was interviewed longitudinally to explore the further sustainability 1–2 years after implementation of the CDS system. The analysis, informed by Normalisation Process Theory (NPT), was thematic, iterative and conducted alongside data collection.

Results

Thirty-nine interviews were conducted either individually or in groups, with 33 stakeholders, including 11 follow-up interviews. Eight themes were interpreted in alignment with the four NPT constructs: Coherence (The purpose of the CDS: Enhancing medication safety and improving cost effectiveness; Relationship of users to the technology; Engagement and communication between different stakeholders); Cognitive Participation (Management of the profile of alerts); Collective Action (Prescribing in general practice, patient and population characteristics and engagement with patients; Knowledge);and Reflexive Monitoring (Sustaining the use of the CDS through maintenance and customisation; Learning and behaviour change. Participants saw that the CDS could have a role in enhancing medication safety and in the quality of care. Engagement through communication and support for local primary care providers and management leaders was considered important for successful implementation. Management of prescribing alert profiles for general practices was a dynamic process evolving over time. At regional management levels, work was required to adapt, and modify the system to optimise its use in practice and fulfil local priorities. Contextual factors, including patient and population characteristics, could impact upon the decision-making processes of prescribers influencing the response to alerts. The CDS could operate as a knowledge base allowing prescribers access to evidence-based information that they otherwise would not have.

Conclusions

This qualitative evaluation utilised NPT to understand the implementation, use and sustainability of a widely deployed CDS system offering prescribing alerts in general practice. The system was understood as having a role in medication safety in providing relevant patient specific information to prescribers in a timely manner. Engagement between stakeholders was considered important for the intervention in ensuring prescribers continued to utilise its functionality. Sustained implementation might be enhanced by careful profile management of the suite of alerts in the system. Our findings suggest that the use and sustainability of the CDS was related to prescribers’ perceptions of the relevance of alerts. Shared understanding of the purpose of the CDS between CCGS and general practices particularly in balancing cost saving and safety messages could be beneficial.

Telemedicine for Remote Surgical Guidance in Endoscopic Retrograde Cholangiopancreatography: Mixed Methods Study of Practitioner Attitudes

BACKGROUND

Telemedicine innovations are rarely adopted into routine health care, the reasons for which are not well understood. Teleguidance, a promising service for remote surgical guidance during endoscopic retrograde cholangiopancreatography (ERCP) was due to be scaled up, but there were concerns that user attitudes might influence adoption.

OBJECTIVE

Our objective was to gain a deeper understanding of ERCP practitioners' attitudes toward teleguidance. These findings could inform the implementation process and future evaluations.

METHODS

We conducted semistructured interviews with ERCP staff about challenges during work and beliefs about teleguidance. Theoretical constructs from the technology acceptance model (TAM) guided the thematic analysis. Our findings became input to a 16-item questionnaire, investigating surgeons' beliefs about teleguidance's contribution to performance and factors that might interact with implementation.

RESULTS

Results from 20 interviews with ERCP staff from 5 hospitals were used to adapt a TAM questionnaire, exchanging the standard "Ease of Use" items for "Compatibility and Implementation Climate." In total, 23 ERCP specialists from 15 ERCP clinics responded to the questionnaire: 9 novices (<500 ERCP procedures) and 14 experts (>500 ERCP procedures). The average agreement ratings for usefulness items were 64% (~9/14) among experts and 75% (~7/9) among novices. The average agreement ratings for compatibility items were somewhat lower (experts 64% [~9/14], novices 69% [~6/9]). The averages have been calculated from the sum of several items and therefore, they only approximate the actual values. While 11 of the 14 experts (79%) and 8 of the 9 novices (89%) agreed that teleguidance could improve overall quality and patient safety during ERCP procedures, only 8 of the 14 experts (57%) and 6 of the 9 novices (67%) agreed that teleguidance would not create new patient safety risks. Only 5 of the 14 experts (36%) and 3 of the 9 novices (33%) were convinced that video and image transmission would function well. Similarly, only 6 of the 14 experts (43%) and 6 of the 9 novices (67%) agreed that administration would work smoothly. There were no statistically significant differences between the experts and novices on any of the 16 items (P<.05).

CONCLUSIONS

Both novices and experts in ERCP procedures had concerns that teleguidance might disrupt existing work practices. However, novices were generally more positive toward teleguidance than experts, especially with regard to the possibility of developing technical skills and work practices. While newly trained specialists were the main target for teleguidance, the experts were also intended users. As experts are more likely to be key decision makers, their attitudes may have a greater relative impact on adoption. We present suggestions to address these concerns. We conclude that using the TAM as a conceptual framework can support user-centered inquiry into telemedicine design and implementation by connecting qualitative findings to well-known analytical themes.

Feasibility study for supporting medication adherence for adults with cystic fibrosis: mixed-methods process evaluation

OBJECTIVES

To undertake a process evaluation of an adherence support intervention for people with cystic fibrosis (PWCF), to assess its feasibility and acceptability.

SETTING

Two UK cystic fibrosis (CF) units.

PARTICIPANTS

Fourteen adult PWCF; three professionals delivering adherence support ('interventionists'); five multi-disciplinary CF team members.

INTERVENTIONS

Nebuliser with data recording and transfer capability, linked to a software platform, and strategies to support adherence to nebulised treatments facilitated by interventionists over 5 months (± 1 month).

PRIMARY AND SECONDARY MEASURES

Feasibility and acceptability of the intervention, assessed through semistructured interviews, questionnaires, fidelity assessments and click analytics.

RESULTS

Interventionists were complimentary about the intervention and training. Key barriers to intervention feasibility and acceptability were identified. Interventionists had difficulty finding clinic space and time in normal working hours to conduct review visits. As a result, fewer than expected intervention visits were conducted and interviews indicated this may explain low adherence in some intervention arm participants. Adherence levels appeared to be >100% for some patients, due to inaccurate prescription data, particularly in patients with complex treatment regimens. Flatlines in adherence data at the start of the study were linked to device connectivity problems. Content and delivery quality fidelity were 100% and 60%-92%, respectively, indicating that interventionists needed to focus more on intervention 'active ingredients' during sessions.

CONCLUSIONS

The process evaluation led to 14 key changes to intervention procedures to overcome barriers to intervention success. With the identified changes, it is feasible and acceptable to support medication adherence with this intervention.

TRIAL REGISTRATION NUMBER

ISRCTN13076797; Results.

Covid-19 and the 'new normal': are remote video consultations here to stay?

INTRODUCTION

During the UK Covid-19 lockdown, video consultations (telemedicine) were encouraged. The extent of usage, and to which concerns to earlier implementation were set aside, is unknown; this is worthy of exploration as data becomes available.

SOURCES OF DATA

Sources of data are as follows: published case studies, editorials, news articles and government guidance.

AREAS OF AGREEMENT

Video can be clinically effective, especially where patients cannot attend due to illness or infection risk. Patients are positive, and they can benefit from savings in time and money. Adoption of telemedicine is hindered by a range of known barriers including clinician resistance due to technological problems, disrupted routines, increased workload, decreased work satisfaction and organizational readiness.

AREAS OF CONTROVERSY

Despite policy impetus and successful pilots, telemedicine has not been adopted at scale.

GROWING POINTS

Increased use of telemedicine during the Covid-19 crisis presents opportunities to obtain robust evidence of issues and create service transformation effectively.

AREAS TIMELY FOR DEVELOPING RESEARCH

Examination of telemedicine use during the Covid-19 crisis to ensure that the benefits and usage continue into the post-lockdown, 'new normal' world.

Personalized Medicine, Disruptive Innovation, and "Trailblazer" Guidelines: Case Study and Theorization of an Unsuccessful Change Effort

Policy Points For complex reasons, the promise of "precision medicine" based on molecular pathways remains unrealized for many conditions. Clinical practice guidelines (theoretically, at least) can act as "trailblazers" to introduce tests and treatments that reflect precision medicine discoveries. We describe a detailed case study from the United Kingdom in which such an attempt was (so far) unsuccessful and show how this case provides generalizable lessons. Policymakers should be wary of using clinical practice guidelines as the sole, or even the primary, lever for introducing precision medicine.

CONTEXT

Precision medicine, which addresses underlying molecular mechanisms of disease, depends on new technologies that measure specific biomarkers, leading (it is anticipated) to more accurate diagnosis, patient stratification, and tailored treatment. These technologies can be disruptive-that is, they make possible, and often require, radical changes to clinical practice and service organization-thereby improving quality, safety, or efficiency of care. Clinical practice guidelines may act as "trailblazers," introducing and legitimizing novel technologies and practices.

METHODS

We describe a case study of an attempt by academic researchers to radically change asthma management in the United Kingdom using a precision medicine biomarker (fractional exhaled nitric oxide, FeNO), measured using a portable breath device. We collected a wide-ranging data set that included more than 100 documents, 61 interviews, and 150 hours of ethnographic observation, and we analyzed it using technology-enhanced strong structuration theory (TESST).

FINDINGS

Our study describes a so-far unsuccessful attempt by academic respiratory medicine researchers to pave the way for a precision medicine approach to asthma using a government-endorsed national guideline. These researchers considered asthma management, especially in primary care, to be characterized by overdiagnosis and poor tailoring of treatment; engaged a national guideline development body in an effort to fix this problem; and ensured that the guideline required primary care clinicians to use FeNO technology for diagnosis and monitoring. However, clinicians working outside the tertiary referral centers did not accept, or agree to enact, the vision of precision medicine inscribed in the guideline-for multiple professional, operational, and economic reasons.

CONCLUSIONS

"Trailblazer" guidelines, in which new technologies are recommended, may succeed as catalysts of change only in a limited way for interested individuals and groups. In the absence of a wider program of professionally led and adequately resourced change efforts, such guidelines will lack meaning, legitimacy, and authority among intended users and may be strongly resisted.

Understanding the utilisation of a novel interactive electronic medication safety dashboard in general practice: a mixed methods study

BACKGROUND

Improving medication safety is a major concern in primary care settings worldwide. The Salford Medication safety dASHboard (SMASH) intervention provided general practices in Salford (Greater Manchester, UK) with feedback on their safe prescribing and monitoring of medications through an online dashboard, and input from practice-based trained clinical pharmacists. In this study we explored how staff working in general practices used the SMASH dashboard to improve medication safety, through interactions with the dashboard to identify potential medication safety hazards and their workflow to resolve identified hazards.

METHODS

We used a mixed-methods study design involving quantitative data from dashboard user interaction logs from 43 general practices during the first year of receiving the SMASH intervention, and qualitative data from semi-structured interviews with 22 pharmacists and physicians from 18 practices in Salford.

RESULTS

Practices interacted with the dashboard a median of 12.0 (interquartile range, 5.0-15.2) times per month during the first quarter of use to identify and resolve potential medication safety hazards, typically starting with the most prevalent hazards or those they perceived to be most serious. Having observed a potential hazard, pharmacists and practice staff worked together to resolve that in a sequence of steps (1) verifying the dashboard information, (2) reviewing the patient's clinical records, and (3) deciding potential changes to the patient's medicines. Over time, dashboard use transitioned towards regular but less frequent (median of 5.5 [3.5-7.9] times per month) checks to identify and resolve new cases. The frequency of dashboard use was higher in practices with a larger number of at-risk patients. In 24 (56%) practices only pharmacists used the dashboard; in 12 (28%) use by other practice staff increased as pharmacist use declined after the initial intervention period; and in 7 (16%) there was mixed use by both pharmacists and practice staff over time.

CONCLUSIONS

An online medication safety dashboard enabled pharmacists to identify patients at risk of potentially hazardous prescribing. They subsequently worked with GPs to resolve risks on a case-by-case basis, but there were marked variations in processes between some practices. Workload diminished over time as it shifted towards resolving new cases of hazardous prescribing.

Rethinking the electronic health record through the quadruple aim: time to align its value with the health system

Electronic health records (EHRs) are considered as a powerful lever for enabling value-based health systems. However, many challenges to their use persist and some of their unintended negative impacts are increasingly well documented, including the deterioration of work conditions and quality, and increased dissatisfaction of health care providers. The “quadruple aim” consists of improving population health as well as patient and provider experience while reducing costs. Based on this approach, improving the quality of work and well-being of health care providers could help rethinking the implementation of EHRs and also other information technology-based tools and systems, while creating more value for patients, organizations and health systems.

The NASSS framework for ex post theorisation of technology-supported change in healthcare: worked example of the TORPEDO programme

BACKGROUND

Evaluation of health technology programmes should be theoretically informed, interdisciplinary, and generate in-depth explanations. The NASSS (non-adoption, abandonment, scale-up, spread, sustainability) framework was developed to study unfolding technology programmes in real time-and in particular to identify and manage their emergent uncertainties and interdependencies. In this paper, we offer a worked example of how NASSS can also inform ex post (i.e. retrospective) evaluation.

METHODS

We studied the TORPEDO (Treatment of Cardiovascular Risk in Primary Care using Electronic Decision Support) research programme, a multi-faceted computerised quality improvement intervention for cardiovascular disease prevention in Australian general practice. The technology (HealthTracker) had shown promise in a cluster randomised controlled trial (RCT), but its uptake and sustainability in a real-world implementation phase was patchy. To explain this variation, we used NASSS to undertake secondary analysis of the multi-modal TORPEDO dataset (results and process evaluation of the RCT, survey responses, in-depth professional interviews, videotaped consultations) as well as a sample of new, in-depth narrative interviews with TORPEDO researchers.

RESULTS

Ex post analysis revealed multiple areas of complexity whose influence and interdependencies helped explain the wide variation in uptake and sustained use of the HealthTracker technology: the nature of cardiovascular risk in different populations, the material properties and functionality of the technology, how value (financial and non-financial) was distributed across stakeholders in the system, clinicians' experiences and concerns, organisational preconditions and challenges, extra-organisational influences (e.g. policy incentives), and how interactions between all these influences unfolded over time.

CONCLUSION

The NASSS framework can be applied retrospectively to generate a rich, contextualised narrative of technology-supported change efforts and the numerous interacting influences that help explain its successes, failures, and unexpected events. A NASSS-informed ex post analysis can supplement earlier, contemporaneous evaluations to uncover factors that were not apparent or predictable at the time but dynamic and emergent.

eHealth adoption and use among healthcare professionals in a tertiary hospital in Sub-Saharan Africa: a Qmethodology study

Background

The aim of the study was to explore the viewpoints of healthcare professionals (HCPs) on the adoption and use of eHealth in clinical practice in sub-Saharan Africa (SSA). Information and communication technologies (ICTs) including eHealth provide HCPs the opportunity to provide quality healthcare to their patients while also improving their own clinical practices. Despite this, previous research has identified these technologies have their associated challenges when adopting them for clinical practice. But more research is needed to identify how these eHealth resources influence clinical practice. In addition, there is still little information about adoption and use of these technologies by HCPs inclinical practice in Sub-Saharan Africa.

Method

An exploratory descriptive design was adopted for this study. Thirty-six (36) HCPs (18 nurses and 18 physicians) working in the clinical area in a tertiary health institution in SSA participated in this study. Using Qmethodology, study participants rank-ordered forty-six statementsin relation to their adoption and use of eHealth within their clinical practice.This was analysed using by-person factor analysis and complemented with audio-taped interviews.

Results

The analysis yielded four factors i.e., distinct viewpoints the HCPs hold about adoption and use of eHealth within their clinical practice. These factors include: “Patient-focused eHealth advocates” who use the eHealth because they are motivated by patients and their families preferences; “Task-focused eHealth advocates” use eHealth because it helps them complete clinical tasks; “Traditionalistic-pragmatists” recognise contributions eHealth makes in clinical practice but separate from their routine clinical activities; and the “Tech-focused eHealth advocates” who use the eHealth because they are motivated by the technology itself.

Conclusion

The study shows the equivocal viewpoints that HCPs have about eHealth within their clinical practice. This, in addition to adding to existing literature, will help policymakers/decision makers to consider HCPs views about these technologies prior to implementing an eHealth resource.

Supporting medication adherence for adults with cystic fibrosis: a randomised feasibility study

BACKGROUND

Preventative medication reduces hospitalisations in people with cystic fibrosis (PWCF) but adherence is poor. We assessed the feasibility of a randomised controlled trial of a complex intervention, which combines display of real time adherence data and behaviour change techniques.

METHODS

Design: Pilot, open-label, parallel-group RCT with concurrent semi-structured interviews.

PARTICIPANTS

PWCF at two Cystic Fibrosis (CF) units. Eligible: aged 16 or older; on the CF registry. Ineligible: post-lung transplant or on the active list; unable to consent; using dry powder inhalers.

INTERVENTIONS

Central randomisation on a 1:1 allocation to: (1) intervention, linking nebuliser use with data recording and transfer capability to a software platform, and behavioural strategies to support self-management delivered by trained interventionists (n = 32); or, (2) control, typically face-to-face meetings every 3 months with CF team (n = 32).

OUTCOMES

RCT feasibility defined as: recruitment of ≥ 48 participants (75% of target) in four months (pilot primary outcome); valid exacerbation data available for ≥ 85% of those randomised (future RCT primary outcome); change in % medication adherence; FEV1 percent predicted (key secondaries in future RCT); and perceptions of trial procedures, in semi-structured interviews with intervention (n = 14) and control (n = 5) participants, interventionists (n = 3) and CF team members (n = 5).

RESULTS

The pilot trial recruited to target, randomising 33 to intervention and 31 to control in the four-month period, June-September 2016. At study completion (30th April 2017), 60 (94%; Intervention = 32, Control =28) participants contributed good quality exacerbation data (intervention: 35 exacerbations; control: 25 exacerbation). The mean change in adherence and baseline-adjusted FEV1 percent predicted were higher in the intervention arm by 10% (95% CI: -5.2 to 25.2) and 5% (95% CI -2 to 12%) respectively. Five serious adverse events occurred, none related to the intervention. The mean change in adherence was 10% (95% CI: -5.2 to 25.2), greater in the intervention arm. Interventionists delivered insufficient numbers of review sessions due to concentration on participant recruitment. This left interventionists insufficient time for key intervention procedures. A total of 10 key changes that were made to RCT procedures are summarised.

CONCLUSIONS

With improved research processes and lower monthly participant recruitment targets, a full-scale trial is feasible.

TRIAL REGISTRATION

ISRCTN13076797 . Prospectively registered on 07/06/2016.

Implementing a National Electronic Referral Program: Qualitative Study

BACKGROUND

Electronic referrals or e-referrals can be defined as the electronic transmission of patient data and clinical requests between health service providers. National electronic referral systems have proved challenging to implement due to problems of fit between the technical systems proposed and the existing sociotechnical systems. In seeming contradiction to a sociotechnical approach, the Irish Health Service Executive initiated an incremental implementation of a National Electronic Referral Programme (NERP), with step 1 including only the technical capability for general practitioners to submit electronic referral requests to hospital outpatient departments. The technology component of the program was specified, but any changes required to embed that technology in the existing sociotechnical system were not specified.

OBJECTIVE

This study aimed to theoretically frame the lessons learned from the NERP step 1 on the design and implementation of a national health information technology program.

METHODS

A case study design was employed, using qualitative interviews with key stakeholders of the NERP step 1 (N=41). A theory-driven thematic analysis of the interview data was conducted, using Barker et al's Framework for Going to Full Scale.

RESULTS

The NERP step 1 was broadly welcomed by key stakeholders as the first step in the implementation of electronic referrals-delivering improvements in the speed, completeness of demographic information, and legibility and traceability of referral requests. National leadership and digitalized health records in general practice were critical enabling factors. Inhibiting factors included policy uncertainty about the future organizational structures within which electronic referrals would be implemented; the need to establish a central referral office consistent with these organizational structures; outstanding interoperability issues between the electronic referral solution and hospital patient administration systems; and an anticipated need to develop specialist referral templates for some specialties. A lack of specification of the sociotechnical elements of the NERP step 1 inhibited the necessary testing and refinement of the change package used to implement the program.

CONCLUSIONS

The key strengths of the NERP step 1 are patient safety benefits. The NERP was progressed beyond the pilot stage despite limited resources and outstanding interoperability issues. In addition, a new electronic health unit in Ireland (eHealth Ireland) gained credibility in delivering national health information technology programs. Limitations of the program are its poor integration in the wider policy and quality improvement agenda of the Health Service Executive. The lack of specification of the sociotechnical elements of the program created challenges in communicating the program scope to key stakeholders and restricted the ability of program managers and implementers to test and refine the change package. This study concludes that while the sociotechnical elements of a national health information technology program do not need to be specified in tandem with technical elements, they do need to be specified early in the implementation process so that the change package used to implement the program can be tested and refined.

The potential of alternatives to face-to-face consultation in general practice, and the impact on different patient groups: a mixed-methods case study

Background

There is international interest in the potential role of different forms of communication technology to provide an alternative to face-to-face consultations in health care. There has been considerable rhetoric about the need for general practices to offer consultations by telephone, e-mail or internet video. However, little is understood about how, under what conditions, for which patients and in what ways these approaches may offer benefits to patients and practitioners in general practice.

Objectives

Our objectives were to review existing evidence about alternatives to face-to-face consultation; conduct a scoping exercise to identify the ways in which general practices currently provide these alternatives; recruit eight general practices as case studies for focused ethnographic research, exploring how practice context, patient characteristics, type of technology and the purpose of the consultation interact to determine the impact of these alternatives; and synthesise the findings in order to develop a website resource about the implementation of alternatives to face-to-face consultations and a framework for subsequent evaluation.

Design

Mixed-methods case study.

Setting

General practices in England and Scotland with varied experience of implementing alternatives to face-to-face consultations.

Participants

Patients and practice staff.

Interventions

Alternatives to face-to-face consultations include telephone consultations, e-mail, e-consultations and internet video.

Main outcome measures

How context influenced the implementation and impact of alternatives to the face-to-face consultation; the rationale for practices to introduce alternatives; the use of different forms of consultation by different patient groups; and the intended benefits/outcomes.

Review methods

The conceptual review used an approach informed by realist review, a method for synthesising research evidence regarding complex interventions.

Results

Alternatives to the face-to-face consultation are not in mainstream use in general practice, with low uptake in our case study practices. We identified the underlying rationales for the use of these alternatives and have shown that different stakeholders have different perspectives on what they hope to achieve through the use of alternatives to the face-to-face consultation. Through the observation of real-life use of different forms of alternative, we have a clearer understanding of how, under what circumstances and for which patients alternatives might have a range of intended benefits and potential unintended adverse consequences. We have also developed a framework for future evaluation.

Limitations

The low uptake of alternatives to the face-to-face consultation means that our research participants might be deemed to be early adopters. The case study approach provides an in-depth examination of a small number of sites, each using alternatives in different ways. The findings are therefore hypothesis-generating, rather than hypothesis-testing.

Conclusions

The current low uptake of alternatives, lack of clarity about purpose and limited evidence of benefit may be at odds with current policy, which encourages the use of alternatives. We have highlighted key issues for practices and policy-makers to consider and have made recommendations about priorities for further research to be conducted, before or alongside the future roll-out of alternatives to the face-to-face consultation, such as telephone consulting, e-consultation, e-mail and video consulting.

Future work

We have synthesised our findings to develop a framework and recommendations about future evaluation of the use of alternatives to face-to-face consultations.

Funding details

The National Institute for Health Research Health Services and Delivery Research programme.

Advantages and limitations of virtual online consultations in a NHS acute trust: the VOCAL mixed-methods study

Background

There is much enthusiasm from clinicians, industry and the government to utilise digital technologies and introduce alternatives to face-to-face consultations.

Objective(s)

To define good practice and inform digital technology implementation in relation to remote consultations via Skype™ (Microsoft Corporation, Redmond, WA, USA) and similar technologies.

Design

Multilevel mixed-methods study of remote video consultations (micro level) embedded in an organisational case study (meso level), taking account of the national context and wider influences (macro level).

Setting

Three contrasting clinical settings (Diabetes, Antenatal Diabetes and Cancer Surgery) in a NHS acute trust.

Data collection and analysis

Macro level – interviews with 12 national-level stakeholders combined with document analysis. Meso level – longitudinal organisational ethnography comprising over 300 hours of observations, 24 staff interviews and analysis of 16 documents. Micro level – 30 video-recorded remote consultations; 17 matched audio-recorded face-to-face consultations. Interview and ethnographic data were analysed thematically and theorised using strong structuration theory. Consultations were transcribed verbatim and analysed using the Roter interaction analysis system (RIAS), producing descriptive statistics on different kinds of talk and interaction.

Results

Policy-makers viewed remote video consultations as a way of delivering health care efficiently in the context of rising rates of chronic illness and growing demand for services. However, the reality of establishing such services in a busy and financially stretched NHS acute trust proved to be far more complex and expensive than anticipated. Embedding new models of care took much time and many resources, and required multiple workarounds. Considerable ongoing effort was needed to adapt and align structures, processes and people within clinics and across the organisation. For practical and safety reasons, virtual consultations were not appropriate for every patient or every consultation. By the end of this study, between 2% and 20% of all consultations were being undertaken remotely in participating clinics. Technical challenges in setting up such consultations were typically minor, but potentially prohibitive. When clinical, technical and practical preconditions were met, virtual consultations appeared to be safe and were popular with both patients and staff. Compared with face-to-face consultations, virtual consultations were very slightly shorter, patients did slightly more talking and both parties sometimes needed to make explicit things that typically remained implicit in a traditional encounter. Virtual consultations appeared to work better when the clinician and the patient knew and trusted each other. Some clinicians used Skype adaptively to support ad hoc clinician-initiated and spontaneous patient-initiated encounters. Other clinicians chose not to use the new service model at all.

Conclusions

Virtual consultations appear to be safe, effective and convenient for patients who are preselected by their clinicians as ‘suitable’, but such patients represent a small fraction of clinic workloads. There are complex challenges to embedding virtual consultation services within routine practice in the NHS. Roll-out (across the organisation) and scale-up (to other organisations) are likely to require considerable support.

Limitations

The focus on a single NHS organisation raises questions about the transferability of findings, especially quantitative data on likely uptake rates.

Future research

Further studies on the micro-analysis of virtual consultations and on the spread and scale-up of virtual consulting services are planned.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Analysing the role of complexity in explaining the fortunes of technology programmes: empirical application of the NASSS framework

BACKGROUND

Failures and partial successes are common in technology-supported innovation programmes in health and social care. Complexity theory can help explain why. Phenomena may be simple (straightforward, predictable, few components), complicated (multiple interacting components or issues) or complex (dynamic, unpredictable, not easily disaggregated into constituent components). The recently published NASSS framework applies this taxonomy to explain Non-adoption or Abandonment of technology by individuals and difficulties achieving Scale-up, Spread and Sustainability. This paper reports the first empirical application of the NASSS framework.

METHODS

Six technology-supported programmes were studied using ethnography and action research for up to 3 years across 20 health and care organisations and 10 national-level bodies. They comprised video outpatient consultations, GPS tracking technology for cognitive impairment, pendant alarm services, remote biomarker monitoring for heart failure, care organising software and integrated case management via data warehousing. Data were collected at three levels: micro (individual technology users), meso (organisational processes and systems) and macro (national policy and wider context). Data analysis and synthesis were guided by socio-technical theories and organised around the seven NASSS domains: (1) the condition or illness, (2) the technology, (3) the value proposition, (4) the adopter system (professional staff, patients and lay carers), (5) the organisation(s), (6) the wider (institutional and societal) system and (7) interaction and mutual adaptation among all these domains over time.

RESULTS

The study generated more than 400 h of ethnographic observation, 165 semi-structured interviews and 200 documents. The six case studies raised multiple challenges across all seven domains. Complexity was a common feature of all programmes. In particular, individuals' health and care needs were often complex and hence unpredictable and 'off algorithm'. Programmes in which multiple domains were complicated proved difficult, slow and expensive to implement. Those in which multiple domains were complex did not become mainstreamed (or, if mainstreamed, did not deliver key intended outputs).

CONCLUSION

The NASSS framework helped explain the successes, failures and changing fortunes of this diverse sample of technology-supported programmes. Since failure is often linked to complexity across multiple NASSS domains, further research should systematically address ways to reduce complexity and/or manage programme implementation to take account of it.

The Bright Elusive Butterfly of Value in Health Technology Development Comment on "Providing Value to New Health Technology: The Early Contribution of Entrepreneurs, Investors, and Regulatory Agencies"

The current system of health technology development is characterised by multiple misalignments. The "supply" side (innovation policy-makers, entrepreneurs, investors) and the "demand" side (health policy-makers, regulators, health technology assessment, purchasers) operate under different - and conflicting - logics. The system is less a "pathway" than an unstable ecosystem of multiple interacting sub-systems. "Value" means different things to each of the numerous actors involved. Supply-side dynamics are built on fictions; regulatory checks and balances are designed to assure quality, safety and efficacy, not to ensure that technologies entering the market are either desirable or cost-effective. Assessment of comparative and cost-effectiveness usually comes too late in the process to shape an innovation's development. We offer no simple solutions to these problems, but in the spirit of commencing a much-needed public debate, we suggest some tentative ways forward. First, universities and public research funders should play a more proactive role in shaping the system. Second, the role of industry in forging long-term strategic partnerships for public benefit should be acknowledged (though not uncritically). Third, models of "responsible innovation" and public input to research priority-setting should be explored. Finally, the evidence base on how best to govern inter-sectoral health research partnerships should be developed and applied.

Studying Scale-Up and Spread as Social Practice: Theoretical Introduction and Empirical Case Study

Background

Health and care technologies often succeed on a small scale but fail to achieve widespread use (scale-up) or become routine practice in other settings (spread). One reason for this is under-theorization of the process of scale-up and spread, for which a potentially fruitful theoretical approach is to consider the adoption and use of technologies as social practices.

Objective

This study aimed to use an in-depth case study of assisted living to explore the feasibility and usefulness of a social practice approach to explaining the scale-up of an assisted-living technology across a local system of health and social care.

Methods

This was an individual case study of the implementation of a Global Positioning System (GPS) “geo-fence” for a person living with dementia, nested in a much wider program of ethnographic research and organizational case study of technology implementation across health and social care (Studies in Co-creating Assisted Living Solutions [SCALS] in the United Kingdom). A layered sociological analysis included micro-level data on the index case, meso-level data on the organization, and macro-level data on the wider social, technological, economic, and political context. Data (interviews, ethnographic notes, and documents) were analyzed and synthesized using structuration theory.

Results

A social practice lens enabled the uptake of the GPS technology to be studied in the context of what human actors found salient, meaningful, ethical, legal, materially possible, and professionally or culturally appropriate in particular social situations. Data extracts were used to illustrate three exemplar findings. First, professional practice is (and probably always will be) oriented not to “implementing technologies” but to providing excellent, ethical care to sick and vulnerable individuals. Second, in order to “work,” health and care technologies rely heavily on human relationships and situated knowledge. Third, such technologies do not just need to be adopted by individuals; they need to be incorporated into personal habits and collaborative routines (both lay and professional).

Conclusions

Health and care technologies need to be embedded within sociotechnical networks and made to work through situated knowledge, personal habits, and collaborative routines. A technology that “works” for one individual in a particular set of circumstances is unlikely to work in the same way for another in a different set of circumstances. We recommend the further study of social practices and the application of co-design principles. However, our findings suggest that even if this occurs, the scale-up and spread of many health and care technologies will be neither rapid nor smooth.

Readiness for Delivering Digital Health at Scale: Lessons From a Longitudinal Qualitative Evaluation of a National Digital Health Innovation Program in the United Kingdom

Background

Digital health has the potential to support care delivery for chronic illness. Despite positive evidence from localized implementations, new technologies have proven slow to become accepted, integrated, and routinized at scale.

Objective

The aim of our study was to examine barriers and facilitators to implementation of digital health at scale through the evaluation of a £37m national digital health program: ‟Delivering Assisted Living Lifestyles at Scale” (dallas) from 2012-2015.

Methods

The study was a longitudinal qualitative, multi-stakeholder, implementation study. The methods included interviews (n=125) with key implementers, focus groups with consumers and patients (n=7), project meetings (n=12), field work or observation in the communities (n=16), health professional survey responses (n=48), and cross program documentary evidence on implementation (n=215). We used a sociological theory called normalization process theory (NPT) and a longitudinal (3 years) qualitative framework analysis approach. This work did not study a single intervention or population. Instead, we evaluated the processes (of designing and delivering digital health), and our outcomes were the identified barriers and facilitators to delivering and mainstreaming services and products within the mixed sector digital health ecosystem.

Results

We identified three main levels of issues influencing readiness for digital health: macro (market, infrastructure, policy), meso (organizational), and micro (professional or public). Factors hindering implementation included: lack of information technology (IT) infrastructure, uncertainty around information governance, lack of incentives to prioritize interoperability, lack of precedence on accountability within the commercial sector, and a market perceived as difficult to navigate. Factors enabling implementation were: clinical endorsement, champions who promoted digital health, and public and professional willingness.

Conclusions

Although there is receptiveness to digital health, barriers to mainstreaming remain. Our findings suggest greater investment in national and local infrastructure, implementation of guidelines for the safe and transparent use and assessment of digital health, incentivization of interoperability, and investment in upskilling of professionals and the public would help support the normalization of digital health. These findings will enable researchers, health care practitioners, and policy makers to understand the current landscape and the actions required in order to prepare the market and accelerate uptake, and use of digital health and wellness services in context and at scale.

What do we need to consider when planning, implementing and researching the use of alternatives to face-to-face consultations in primary healthcare?

Objectives

Communications technologies are variably utilised in healthcare. Policymakers globally have espoused the potential benefits of alternatives to face-to-face consultations, but research is in its infancy. The aim of this essay is to provide thinking tools for policymakers, practitioners and researchers who are involved in planning, implementing and evaluating alternative forms of consultation in primary care.

Methods

We draw on preparations for a focussed ethnographic study being conducted in eight general practice settings in the UK, knowledge of the literature, qualitative social science and Cochrane reviews. In this essay we consider different types of patients, and also reflect on how the work, practice and professional identities of different members of staff in primary care might be affected.

Results

Elements of practice are inevitably lost when consultations are no longer face-to-face, and we know little about the impact on core aspects of the primary care relationship. Resistance to change is normal and concerns about the introduction of alternative methods of consultation are often expressed using proxy reasons; for example, concerns about patient safety. Any planning or research in the field of new technologies should be attuned to the potential for unintended consequences.

Conclusions

Implementation of alternatives to the face-to-face consultation is more likely to succeed if approached as co-designed initiatives that start with the least controversial and most promising changes for the practice. Researchers and evaluators should explore actual experiences of the different consultation types amongst patients and the primary care team rather than hypothetical perspectives.

SCALS: a fourth-generation study of assisted living technologies in their organisational, social, political and policy context

INTRODUCTION

Research to date into assisted living technologies broadly consists of 3 generations: technical design, experimental trials and qualitative studies of the patient experience. We describe a fourth-generation paradigm: studies of assisted living technologies in their organisational, social, political and policy context. Fourth-generation studies are necessarily organic and emergent; they view technology as part of a dynamic, networked and potentially unstable system. They use co-design methods to generate and stabilise local solutions, taking account of context.

METHODS AND ANALYSIS

SCALS (Studies in Co-creating Assisted Living Solutions) consists (currently) of 5 organisational case studies, each an English health or social care organisation striving to introduce technology-supported services to support independent living in people with health and/or social care needs. Treating these cases as complex systems, we seek to explore interdependencies, emergence and conflict. We employ a co-design approach informed by the principles of action research to help participating organisations establish, refine and evaluate their service. To that end, we are conducting in-depth ethnographic studies of people's experience of assisted living technologies (micro level), embedded in evolving organisational case studies that use interviews, ethnography and document analysis (meso level), and exploring the wider national and international context for assisted living technologies and policy (macro level). Data will be analysed using a sociotechnical framework developed from structuration theory.

ETHICS AND DISSEMINATION

Research ethics approval for the first 4 case studies has been granted. An important outcome will be lessons learned from individual co-design case studies. We will document the studies' credibility and rigour, and assess the transferability of findings to other settings while also recognising unique aspects of the contexts in which they were generated. Academic outputs will include a cross-case analysis and progress in theory and method of fourth-generation assisted living technology research. We will produce practical guidance for organisations, policymakers, designers and service users.

The importance of values in evidence-based medicine

BACKGROUND

Evidence-based medicine (EBM) has always required integration of patient values with 'best' clinical evidence. It is widely recognized that scientific practices and discoveries, including those of EBM, are value-laden. But to date, the science of EBM has focused primarily on methods for reducing bias in the evidence, while the role of values in the different aspects of the EBM process has been almost completely ignored.

DISCUSSION

In this paper, we address this gap by demonstrating how a consideration of values can enhance every aspect of EBM, including: prioritizing which tests and treatments to investigate, selecting research designs and methods, assessing effectiveness and efficiency, supporting patient choice and taking account of the limited time and resources available to busy clinicians. Since values are integral to the practice of EBM, it follows that the highest standards of EBM require values to be made explicit, systematically explored, and integrated into decision making. Through 'values based' approaches, EBM's connection to the humanitarian principles upon which it was founded will be strengthened.