Improving the normalization of complex interventions: measure development based on normalization process theory (NoMAD): study protocol

BACKGROUND

Understanding implementation processes is key to ensuring that complex interventions in healthcare are taken up in practice and thus maximize intended benefits for service provision and (ultimately) care to patients. Normalization Process Theory (NPT) provides a framework for understanding how a new intervention becomes part of normal practice. This study aims to develop and validate simple generic tools derived from NPT, to be used to improve the implementation of complex healthcare interventions.

OBJECTIVES

The objectives of this study are to: develop a set of NPT-based measures and formatively evaluate their use for identifying implementation problems and monitoring progress; conduct preliminary evaluation of these measures across a range of interventions and contexts, and identify factors that affect this process; explore the utility of these measures for predicting outcomes; and develop an online users' manual for the measures.

METHODS

A combination of qualitative (workshops, item development, user feedback, cognitive interviews) and quantitative (survey) methods will be used to develop NPT measures, and test the utility of the measures in six healthcare intervention settings.

DISCUSSION

The measures developed in the study will be available for use by those involved in planning, implementing, and evaluating complex interventions in healthcare and have the potential to enhance the chances of their implementation, leading to sustained changes in working practices.

Qualitative systematic reviews of treatment burden in stroke, heart failure and diabetes - methodological challenges and solutions

BACKGROUND

Treatment burden can be defined as the self-care practices that patients with chronic illness must perform to respond to the requirements of their healthcare providers, as well as the impact that these practices have on patient functioning and well being. Increasing levels of treatment burden may lead to suboptimal adherence and negative outcomes. Systematic review of the qualitative literature is a useful method for exploring the patient experience of care, in this case the experience of treatment burden. There is no consensus on methods for qualitative systematic review. This paper describes the methodology used for qualitative systematic reviews of the treatment burdens identified in three different common chronic conditions, using stroke as our exemplar.

METHODS

Qualitative studies in peer reviewed journals seeking to understand the patient experience of stroke management were sought. Limitations of English language and year of publication 2000 onwards were set. An exhaustive search strategy was employed, consisting of a scoping search, database searches (Scopus, CINAHL, Embase, Medline & PsycINFO) and reference, footnote and citation searching. Papers were screened, data extracted, quality appraised and analysed by two individuals, with a third party for disagreements. Data analysis was carried out using a coding framework underpinned by Normalization Process Theory (NPT).

RESULTS

A total of 4364 papers were identified, 54 were included in the review. Of these, 51 (94%) were retrieved from our database search. Methodological issues included: creating an appropriate search strategy; investigating a topic not previously conceptualised; sorting through irrelevant data within papers; the quality appraisal of qualitative research; and the use of NPT as a novel method of data analysis, shown to be a useful method for the purposes of this review.

CONCLUSION

The creation of our search strategy may be of particular interest to other researchers carrying out synthesis of qualitative studies. Importantly, the successful use of NPT to inform a coding frame for data analysis involving qualitative data that describes processes relating to self management highlights the potential of a new method for analyses of qualitative data within systematic reviews.

A study of information management in the patient surgical pathway in NHSScotland

We conducted a study of information management processes across the patient surgical pathway in NHSScotland. While the majority of general practitioners (GPs) consider electronic medical records systems as an essential and integral part of their work during the patient consultation, many were not fully satisfied with the functionalities of these systems. A majority of GPs considered that the national eReferral system streamlined referral processes. Almost all GPs reported marked variability in the quality of discharge information. Preoperative processes vary significantly across Scotland, with most services using paper-based systems. Insufficient use is made of information provided through the patient electronic referral leading to a considerable duplication of tasks already performed in primary care. Three health-boards have implemented electronic preoperative information systems. These have transformed clinical practices and facilitated communication and information-sharing among the multi-disciplinary team and within the health-boards. Substantial progress has been made towards improving information transfer and sharing within the surgical pathway in recent years. However, there remains scope for further improvements at the interface between services.

Uncovering treatment burden as a key concept for stroke care: a systematic review of qualitative research

BACKGROUND

Patients with chronic disease may experience complicated management plans requiring significant personal investment. This has been termed 'treatment burden' and has been associated with unfavourable outcomes. The aim of this systematic review is to examine the qualitative literature on treatment burden in stroke from the patient perspective.

METHODS AND FINDINGS

The search strategy centred on: stroke, treatment burden, patient experience, and qualitative methods. We searched: Scopus, CINAHL, Embase, Medline, and PsycINFO. We tracked references, footnotes, and citations. Restrictions included: English language, date of publication January 2000 until February 2013. Two reviewers independently carried out the following: paper screening, data extraction, and data analysis. Data were analysed using framework synthesis, as informed by Normalization Process Theory. Sixty-nine papers were included. Treatment burden includes: (1) making sense of stroke management and planning care, (2) interacting with others, (3) enacting management strategies, and (4) reflecting on management. Health care is fragmented, with poor communication between patient and health care providers. Patients report inadequate information provision. Inpatient care is unsatisfactory, with a perceived lack of empathy from professionals and a shortage of stimulating activities on the ward. Discharge services are poorly coordinated, and accessing health and social care in the community is difficult. The study has potential limitations because it was restricted to studies published in English only and data from low-income countries were scarce.

CONCLUSIONS

Stroke management is extremely demanding for patients, and treatment burden is influenced by micro and macro organisation of health services. Knowledge deficits mean patients are ill equipped to organise their care and develop coping strategies, making adherence less likely. There is a need to transform the approach to care provision so that services are configured to prioritise patient needs rather than those of health care systems.

Factors that promote or inhibit the implementation of e-health systems: an explanatory systematic review

OBJECTIVE

To systematically review the literature on the implementation of e-health to identify: (i) barriers and facilitators to e-health implementation, and (ii) outstanding gaps in research on the subject.

METHODS

MEDLINE, EMBASE, CINAHL, PSYCINFO and the Cochrane Library were searched for reviews published between 1 January 1995 and 17 March 2009. Studies had to be systematic reviews, narrative reviews, qualitative metasyntheses or meta-ethnographies of e-health implementation. Abstracts and papers were double screened and data were extracted on country of origin; e-health domain; publication date; aims and methods; databases searched; inclusion and exclusion criteria and number of papers included. Data were analysed qualitatively using normalization process theory as an explanatory coding framework.

FINDINGS

Inclusion criteria were met by 37 papers; 20 had been published between 1995 and 2007 and 17 between 2008 and 2009. Methodological quality was poor: 19 papers did not specify the inclusion and exclusion criteria and 13 did not indicate the precise number of articles screened. The use of normalization process theory as a conceptual framework revealed that relatively little attention was paid to: (i) work directed at making sense of e-health systems, specifying their purposes and benefits, establishing their value to users and planning their implementation; (ii) factors promoting or inhibiting engagement and participation; (iii) effects on roles and responsibilities; (iv) risk management, and (v) ways in which implementation processes might be reconfigured by user-produced knowledge.

CONCLUSION

The published literature focused on organizational issues, neglecting the wider social framework that must be considered when introducing new technologies.

Cumulative complexity: a functional, patient-centered model of patient complexity can improve research and practice

OBJECTIVE

To design a functional, patient-centered model of patient complexity with practical applicability to analytic design and clinical practice. Existing literature on patient complexity has mainly identified its components descriptively and in isolation, lacking clarity as to their combined functions in disrupting care or to how complexity changes over time.

STUDY DESIGN AND SETTING

The authors developed a cumulative complexity model, which integrates existing literature and emphasizes how clinical and social factors accumulate and interact to complicate patient care. A narrative literature review is used to explicate the model.

RESULTS

The model emphasizes a core, patient-level mechanism whereby complicating factors impact care and outcomes: the balance between patient workload of demands and patient capacity to address demands. Workload encompasses the demands on the patient's time and energy, including demands of treatment, self-care, and life in general. Capacity concerns ability to handle work (e.g., functional morbidity, financial/social resources, literacy). Workload-capacity imbalances comprise the mechanism driving patient complexity. Treatment and illness burdens serve as feedback loops, linking negative outcomes to further imbalances, such that complexity may accumulate over time.

CONCLUSION

With its components largely supported by existing literature, the model has implications for analytic design, clinical epidemiology, and clinical practice.

From theory to 'measurement' in complex interventions: methodological lessons from the development of an e-health normalisation instrument

BACKGROUND

Although empirical and theoretical understanding of processes of implementation in health care is advancing, translation of theory into structured measures that capture the complex interplay between interventions, individuals and context remain limited. This paper aimed to (1) describe the process and outcome of a project to develop a theory-based instrument for measuring implementation processes relating to e-health interventions; and (2) identify key issues and methodological challenges for advancing work in this field.

METHODS

A 30-item instrument (Technology Adoption Readiness Scale (TARS)) for measuring normalisation processes in the context of e-health service interventions was developed on the basis on Normalization Process Theory (NPT). NPT focuses on how new practices become routinely embedded within social contexts. The instrument was pre-tested in two health care settings in which e-health (electronic facilitation of healthcare decision-making and practice) was used by health care professionals.

RESULTS

The developed instrument was pre-tested in two professional samples (N=46; N=231). Ratings of items representing normalisation 'processes' were significantly related to staff members' perceptions of whether or not e-health had become 'routine'. Key methodological challenges are discussed in relation to: translating multi-component theoretical constructs into simple questions; developing and choosing appropriate outcome measures; conducting multiple-stakeholder assessments; instrument and question framing; and more general issues for instrument development in practice contexts.

CONCLUSIONS

To develop theory-derived measures of implementation process for progressing research in this field, four key recommendations are made relating to (1) greater attention to underlying theoretical assumptions and extent of translation work required; (2) the need for appropriate but flexible approaches to outcomes measurement; (3) representation of multiple perspectives and collaborative nature of work; and (4) emphasis on generic measurement approaches that can be flexibly tailored to particular contexts of study.

Integrating telecare for chronic disease management in the community: what needs to be done?

Background

Telecare could greatly facilitate chronic disease management in the community, but despite government promotion and positive demonstrations its implementation has been limited. This study aimed to identify factors inhibiting the implementation and integration of telecare systems for chronic disease management in the community.

Methods

Large scale comparative study employing qualitative data collection techniques: semi-structured interviews with key informants, task-groups, and workshops; framework analysis of qualitative data informed by Normalization Process Theory. Drawn from telecare services in community and domestic settings in England and Scotland, 221 participants were included, consisting of health professionals and managers; patients and carers; social care professionals and managers; and service suppliers and manufacturers.

Results

Key barriers to telecare integration were uncertainties about coherent and sustainable service and business models; lack of coordination across social and primary care boundaries, lack of financial or other incentives to include telecare within primary care services; a lack of a sense of continuity with previous service provision and self-care work undertaken by patients; and general uncertainty about the adequacy of telecare systems. These problems led to poor integration of policy and practice.

Conclusion

Telecare services may offer a cost effective and safe form of care for some people living with chronic illness. Slow and uneven implementation and integration do not stem from problems of adoption. They result from incomplete understanding of the role of telecare systems and subsequent adaption and embeddedness to context, and uncertainties about the best way to develop, coordinate, and sustain services that assist with chronic disease management. Interventions are therefore needed that (i) reduce uncertainty about the ownership of implementation processes and that lock together health and social care agencies; and (ii) ensure user centred rather than biomedical/service-centred models of care.

Understanding patients' experiences of treatment burden in chronic heart failure using normalization process theory

PURPOSE

Our goal was to assess the burden associated with treatment among patients living with chronic heart failure and to determine whether Normalization Process Theory (NPT) is a useful framework to help describe the components of treatment burden in these patients.

METHODS

We performed a secondary analysis of qualitative interview data, using framework analysis, informed by NPT, to determine the components of patient "work." Participants were 47 patients with chronic heart failure managed in primary care in the United Kingdom who had participated in an earlier qualitative study about living with this condition. We identified and examined data that fell outside of the coding frame to determine if important concepts or ideas were being missed by using the chosen theoretical framework.

RESULTS

We were able to identify and describe components of treatment burden as distinct from illness burden using the framework. Treatment burden in chronic heart failure includes the work of developing an understanding of treatments, interacting with others to organize care, attending appointments, taking medications, enacting lifestyle measures, and appraising treatments. Factors that patients reported as increasing treatment burden included too many medications and appointments, barriers to accessing services, fragmented and poorly organized care, lack of continuity, and inadequate communication between health professionals. Patient "work" that fell outside of the coding frame was exclusively emotional or spiritual in nature.

CONCLUSIONS

We identified core components of treatment burden as reported by patients with chronic heart failure. The findings suggest that NPT is a theoretical framework that facilitates understanding of experiences of health care work at the individual, as well as the organizational, level. Although further exploration and patient endorsement are necessary, our findings lay the foundation for a new target for treatment and quality improvement efforts toward patient-centered care.

Exploring public perspectives on e-health: findings from two citizen juries

BACKGROUND

Interest and investment in e-health continue to grow world-wide, but there remains relatively little engagement with the public on this subject, despite calls for more public involvement in health-care planning.

DESIGN

This study used two modified citizen juries to explore barriers and facilitators to e-health implementation and the priorities for future e-health research from the perspective of health service users and lay representatives. Citizen juries bring together a group of people to deliberate over a specific issue. They are given information and invited to 'cross-examine' witnesses during the process.

RESULTS

Jurors were very keen for lay views to be included in e-health development and embraced the citizen jury approach. They agreed unanimously that e-health should be developed and thought it was in many ways inevitable. Although there was much enthusiasm for a health-care system which offered e-health as an option, there was as much concern about what it might mean for patients if implemented inappropriately. E-health was preferred as an enhancement rather than substitute for, existing services. Lack of universal access was seen as a potential barrier to implementation but problems such as lack of computer literacy were seen as a temporary issue. Participants emphasized that e-health research needed to demonstrate both clinical and economic benefits.

CONCLUSION

There was broad support from the citizen juries for the development of e-health, although participants stressed that e-health should enhance, rather than substitute, face-to-face services. One-day citizen juries proved a practical method of public engagement on this subject.

E-health: implementation and evaluation research in Scotland -- a scoping exercise

We searched the National Research Register (NRR) to identify funded research in Scotland (or in collaboration with a Scottish partner) in the area of implementation and evaluation of e-health services. A total of 61 research projects were identified which had been funded since 1 January 1995. These projects shared almost 7 million pound of funding (1 pound is $1.9 or 1.3 euro), the main funding sources being the Scottish Government and the European Union. Based on the projects reviewed, the majority of e-health research in Scotland was being conducted within the communication systems domain. Most of the research was being conducted at a single centre: only 14 studies (23%) were multisite. Future collaboration between these researchers, involving larger scale funding bids, may increase the quantity of e-health implementation and evaluation research.

Understanding factors that inhibit or promote the utilization of telecare in chronic lung disease

OBJECTIVES

To perform a process evaluation of a randomized controlled trial (RCT) of home telecare for the management of acute exacerbations of chronic obstructive pulmonary disease (COPD), using the normalization process model (NPM) as an explanatory framework.

METHODS

Semi-structured interviews were carried out with patients (n = 9) and nurses (n = 11) participating in a RCT. A framework approach to data analysis was used.

RESULTS

The telecare service did not provide an interactional advantage for the nurses providing this service and did not fit with the nurses' views of the most appropriate or preferred use of their skills. The telecare service seemed unlikely to become normalized as part of routine healthcare delivery, because the nursing team lacked confidence that it was a safe way to provide healthcare in this context and it was not perceived as improving efficiency.

DISCUSSION

The NPM effectively mapped onto the study findings and explained those factors that inhibited the routine delivery of COPD services by telecare.

Future patients? Telehealthcare, roles and responsibilities

Increasing use of information and communication technologies is said to be transforming health care. Telehealthcare enables medical consultations to be conducted between patients and health professionals across different locations. Such technologies imply new relationships between patients and health professionals. This study aimed to understand how policy and practice in relation to telehealthcare suggests new conceptualisations of 'the patient'. In-depth semistructured interviews (n = 38) were conducted with key informants from across the UK, known to have involvement or interest in telehealthcare from a variety of perspectives: health professionals (n = 11), patient advocates (n = 7), telemedicine experts (n = 6), policy-makers (n = 4), administrators (n = 4), researchers (n = 3) and technologists (n = 3). Interviews were conducted either in person or over the telephone, and were audio-recorded. Data were analysed thematically with ongoing cross-validation of data interpretation between members of the research team. The results indicated divergent views about the role of the patient, although accounts of patients becoming 'educated self-managers', taking on a more active role in their healthcare, were predominant. Beliefs about the impact of telehealthcare on patients were focused on perceived 'priorities' such as access, location of services, confidentiality and choice; however, there remains little understanding of the trade-offs that patients are willing to make in the context of technologically mediated health care. The results also highlight ideas around how patients relate to technologies; the extent to which technologies might fragment care and medicine in new or unexpected ways, and participation and absence of patients in decision-making about policies and services. The results of this study have important implications for the ways in which relationships between health professionals and patients are managed in practice, and raise important questions for public participation in service development.

Process evaluation for complex interventions in primary care: understanding trials using the normalization process model

BACKGROUND

The Normalization Process Model is a conceptual tool intended to assist in understanding the factors that affect implementation processes in clinical trials and other evaluations of complex interventions. It focuses on the ways that the implementation of complex interventions is shaped by problems of workability and integration.

METHOD

In this paper the model is applied to two different complex trials: (i) the delivery of problem solving therapies for psychosocial distress, and (ii) the delivery of nurse-led clinics for heart failure treatment in primary care.

RESULTS

Application of the model shows how process evaluations need to focus on more than the immediate contexts in which trial outcomes are generated. Problems relating to intervention workability and integration also need to be understood. The model may be used effectively to explain the implementation process in trials of complex interventions.

CONCLUSION

The model invites evaluators to attend equally to considering how a complex intervention interacts with existing patterns of service organization, professional practice, and professional-patient interaction. The justification for this may be found in the abundance of reports of clinical effectiveness for interventions that have little hope of being implemented in real healthcare settings.

Teledermatology in the UK: lessons in service innovation

BACKGROUND

Teledermatology has the potential to revolutionize the delivery of dermatology services by facilitating access to specialist services at a distance. In the U.K. over the previous decade there have been numerous attempts at introducing and using teledermatology; however, the development of teledermatology as routine service provision remains limited.

OBJECTIVES

To identify factors that promote successful use of teledermatology as a part of routine service provision.

METHODS

A longitudinal qualitative study of teledermatology, drawing on data from in-depth semistructured interviews; observations of systems in practice; and public meetings. Data were analysed collectively by the research team using established qualitative analytical techniques to identify key thematic categories. The sample consisted of teledermatology services within the U.K. (n = 12) studied over 8 years (1997-2005). Individual participants (n = 68 interviews) were consultant dermatologists, researchers, teledermatology nurses, administrators, patient advocates, general practitioners and technologists.

RESULTS

The analysis compared services that did or did not become part of routine healthcare practice to identify features that supported the normalization of teledermatology. Requirements for using and integrating teledermatology into practice included: political support; perceived benefit and relative commitment that outweighs effort; pragmatic approaches to proving efficacy and safety; perception of risk as being 'manageable' on the basis of professional judgement; high levels of flexibility in practice (in terms of individuals, technology and organization); and reconceptualizing professional roles.

CONCLUSIONS

Successful implementation of teledermatology as a routine service requires greater understanding of and attention to the interplay between social and technical aspects of teledermatology, and how this is accommodated both by healthcare professionals and the organizations in which they work.

Lessons from the implementation of a home telecare service

We conducted a qualitative evaluation of the introduction of a telenursing service. The service used an analogue videophone linked with a physiological monitoring device, which allowed the transmission of data between the patient's home and the hospital. A researcher kept a detailed diary of day-to-day activity for the first year of the project. Computer software for qualitative data analysis was used to code the text and the analysis followed the principles of constant comparison. The diary entries documented how the commercially available equipment was adapted to suit the organization and content of the nurses' work. The nurses made a number of suggestions to improve the user-friendliness of the equipment. The technology, the existing home care service (the comparison arm of the study) and the randomized controlled trial itself all underwent continuous change. The traditional randomized control design of trial has limitations in this situation, and there is a need for more realistic trial designs.

Factors influencing the evaluation of telehealth interventions: preliminary results from a qualitative study of evaluation projects in the UK

We have carried out a qualitative study of factors that influence the evaluation of telehealth. The study concerned six telehealth projects that are being tracked over two years. In the first 12 months of the study we carried out semistructured interviews and made observations of the participants in the projects. Each case study involved 5-15 subjects, many of whom were interviewed several times. The results indicate that important issues affecting telehealth evaluation include developing and maintaining the technology, reorganization of clinical and administrative duties, professional dynamics, and the difficulty of integrating service provision and evaluation. The findings suggest that the evaluation of telehealth interventions is highly complex, and that this complexity is often underestimated in the design and conduct of evaluation studies.