Diffusion of innovations in service organizations: systematic review and recommendations

This article summarizes an extensive literature review addressing the question, How can we spread and sustain innovations in health service delivery and organization? It considers both content (defining and measuring the diffusion of innovation in organizations) and process (reviewing the literature in a systematic and reproducible way). This article discusses (1) a parsimonious and evidence-based model for considering the diffusion of innovations in health service organizations, (2) clear knowledge gaps where further research should be focused, and (3) a robust and transferable methodology for systematically reviewing health service policy and management. Both the model and the method should be tested more widely in a range of contexts.

A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions

BACKGROUND

Several groups have outlined methodologies for systematic literature reviews of the effectiveness of interventions. The Effective Public Health Practice Project (EPHPP) began in 1998. Its mandate is to provide research evidence to guide and support the Ontario Ministry of Health in outlining minimum requirements for public health services in the province. Also, the project is expected to disseminate the results provincially, nationally, and internationally. Most of the reviews are relevant to public health nursing practice.

AIMS

This article describes four issues related to the systematic literature reviews of the effectiveness of public health nursing interventions: (1) the process of systematically reviewing the literature, (2) the development of a quality assessment instrument, (3) the results of the EPHPP to date, and (4) some results of the dissemination strategies used.

METHODS

The eight steps of the systematic review process including question formulation, searching and retrieving the literature, establishing relevance criteria, assessing studies for relevance, assessing relevant studies for methodological quality, data extraction and synthesis, writing the report, and dissemination are outlined. Also, the development and assessment of content and construct validity and intrarater reliability of the quality assessment questionnaire used in the process are described.

RESULTS

More than 20 systematic reviews have been completed. Content validity was ascertained by the use of a number of experts to review the questionnaire during its development. Construct validity was demonstrated through comparisons with another highly rated instrument. Intrarater reliability was established using Cohen's Kappa. Dissemination strategies used appear to be effective in that professionals report being aware of the reviews and using them in program planning/policymaking decisions.

CONCLUSIONS

The EPHPP has demonstrated the ability to adapt the most current methods of systematic literature reviews of effectiveness to questions related to public health nursing. Other positive outcomes from the process include the development of a critical mass of public health researchers and practitioners who can actively participate in the process, and the work on dissemination has been successful in attracting external funds. A program of research in this area is being developed.

Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition

The gap between research and practice is well documented. We address one of the underlying reasons for this gap: the assumption that effectiveness research naturally and logically follows from successful efficacy research. These 2 research traditions have evolved different methods and values; consequently, there are inherent differences between the characteristics of a successful efficacy intervention versus those of an effectiveness one. Moderating factors that limit robustness across settings, populations, and intervention staff need to be addressed in efficacy studies, as well as in effectiveness trials. Greater attention needs to be paid to documenting intervention reach, adoption, implementation, and maintenance. Recommendations are offered to help close the gap between efficacy and effectiveness research and to guide evaluation and possible adoption of new programs.

Disseminating innovations in health care

Health care is rich in evidence-based innovations, yet even when such innovations are implemented successfully in one location, they often disseminate slowly-if at all. Diffusion of innovations is a major challenge in all industries including health care. This article examines the theory and research on the dissemination of innovations and suggests applications of that theory to health care. It explores in detail 3 clusters of influence on the rate of diffusion of innovations within an organization: the perceptions of the innovation, the characteristics of the individuals who may adopt the change, and contextual and managerial factors within the organization. This theory makes plausible at least 7 recommendations for health care executives who want to accelerate the rate of diffusion of innovations within their organizations: find sound innovations, find and support "innovators," invest in "early adopters," make early adopter activity observable, trust and enable reinvention, create slack for change, and lead by example.

Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges

One of the most critical issues in mental health services research is the gap between what is known about effective treatment and what is provided to consumers in routine care. Concerted efforts are required to advance implementation science and produce skilled implementation researchers. This paper seeks to advance implementation science in mental health services by over viewing the emergence of implementation as an issue for research, by addressing key issues of language and conceptualization, by presenting a heuristic skeleton model for the study of implementation processes, and by identifying the implications for research and training in this emerging field.

An introduction to implementation science for the non-specialist

BACKGROUND

The movement of evidence-based practices (EBPs) into routine clinical usage is not spontaneous, but requires focused efforts. The field of implementation science has developed to facilitate the spread of EBPs, including both psychosocial and medical interventions for mental and physical health concerns.

DISCUSSION

The authors aim to introduce implementation science principles to non-specialist investigators, administrators, and policymakers seeking to become familiar with this emerging field. This introduction is based on published literature and the authors' experience as researchers in the field, as well as extensive service as implementation science grant reviewers. Implementation science is "the scientific study of methods to promote the systematic uptake of research findings and other EBPs into routine practice, and, hence, to improve the quality and effectiveness of health services." Implementation science is distinct from, but shares characteristics with, both quality improvement and dissemination methods. Implementation studies can be either assess naturalistic variability or measure change in response to planned intervention. Implementation studies typically employ mixed quantitative-qualitative designs, identifying factors that impact uptake across multiple levels, including patient, provider, clinic, facility, organization, and often the broader community and policy environment. Accordingly, implementation science requires a solid grounding in theory and the involvement of trans-disciplinary research teams. The business case for implementation science is clear: As healthcare systems work under increasingly dynamic and resource-constrained conditions, evidence-based strategies are essential in order to ensure that research investments maximize healthcare value and improve public health. Implementation science plays a critical role in supporting these efforts.

The technology acceptance model: its past and its future in health care

Increasing interest in end users' reactions to health information technology (IT) has elevated the importance of theories that predict and explain health IT acceptance and use. This paper reviews the application of one such theory, the Technology Acceptance Model (TAM), to health care. We reviewed 16 data sets analyzed in over 20 studies of clinicians using health IT for patient care. Studies differed greatly in samples and settings, health ITs studied, research models, relationships tested, and construct operationalization. Certain TAM relationships were consistently found to be significant, whereas others were inconsistent. Several key relationships were infrequently assessed. Findings show that TAM predicts a substantial portion of the use or acceptance of health IT, but that the theory may benefit from several additions and modifications. Aside from improved study quality, standardization, and theoretically motivated additions to the model, an important future direction for TAM is to adapt the model specifically to the health care context, using beliefs elicitation methods.

The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change

BACKGROUND

Despite growth in implementation research, limited scientific attention has focused on understanding and improving sustainability of health interventions. Models of sustainability have been evolving to reflect challenges in the fit between intervention and context.

DISCUSSION

We examine the development of concepts of sustainability, and respond to two frequent assumptions -'voltage drop,' whereby interventions are expected to yield lower benefits as they move from efficacy to effectiveness to implementation and sustainability, and 'program drift,' whereby deviation from manualized protocols is assumed to decrease benefit. We posit that these assumptions limit opportunities to improve care, and instead argue for understanding the changing context of healthcare to continuously refine and improve interventions as they are sustained. Sustainability has evolved from being considered as the endgame of a translational research process to a suggested 'adaptation phase' that integrates and institutionalizes interventions within local organizational and cultural contexts. These recent approaches locate sustainability in the implementation phase of knowledge transfer, but still do not address intervention improvement as a central theme. We propose a Dynamic Sustainability Framework that involves: continued learning and problem solving, ongoing adaptation of interventions with a primary focus on fit between interventions and multi-level contexts, and expectations for ongoing improvement as opposed to diminishing outcomes over time.

SUMMARY

A Dynamic Sustainability Framework provides a foundation for research, policy and practice that supports development and testing of falsifiable hypotheses and continued learning to advance the implementation, transportability and impact of health services research.

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research

Background While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why.Objective To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2.Methods The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process.Results 143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus.Conclusions GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites.

Evaluating barriers to adopting telemedicine worldwide: A systematic review

Introduction and objective Studies on telemedicine have shown success in reducing the geographical and time obstacles incurred in the receipt of care in traditional modalities with the same or greater effectiveness; however, there are several barriers that need to be addressed in order for telemedicine technology to spread. The aim of this review is to evaluate barriers to adopting telemedicine worldwide through the analysis of published work. Methods The authors conducted a systematic literature review by extracting the data from the Cumulative Index of Nursing and Allied Health Literature (CINAHL) and PubMed (MEDLINE) research databases. The reviewers in this study analysed 30 articles (nine from CINAHL and 21 from Medline) and identified barriers found in the literature. This review followed the checklist from Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2009. The reviewers organized the results into one table and five figures that depict the data in different ways, organized by: barrier, country-specific barriers, organization-specific barriers, patient-specific barriers, and medical-staff and programmer-specific barriers. Results The reviewers identified 33 barriers with a frequency of 100 occurrences through the 30 articles. The study identified the issues with technically challenged staff (11%), followed by resistance to change (8%), cost (8%), reimbursement (5%), age of patient (5%), and level of education of patient (5%). All other barriers occurred at or less than 4% of the time. Discussion and conclusions Telemedicine is not yet ubiquitous, and barriers vary widely. The top barriers are technology-specific and could be overcome through training, change-management techniques, and alternating delivery by telemedicine and personal patient-to-provider interaction. The results of this study identify several barriers that could be eliminated by focused policy. Future work should evaluate policy to identify which one to lever to maximize the results.

Bridging research and practice: models for dissemination and implementation research

CONTEXT

Theories and frameworks (hereafter called models) enhance dissemination and implementation (D&I) research by making the spread of evidence-based interventions more likely. This work organizes and synthesizes these models by (1) developing an inventory of models used in D&I research; (2) synthesizing this information; and (3) providing guidance on how to select a model to inform study design and execution.

EVIDENCE ACQUISITION

This review began with commonly cited models and model developers and used snowball sampling to collect models developed in any year from journal articles, presentations, and books. All models were analyzed and categorized in 2011 based on three author-defined variables: construct flexibility, focus on dissemination and/or implementation activities (D/I), and the socioecologic framework (SEF) level. Five-point scales were used to rate construct flexibility from broad to operational and D/I activities from dissemination-focused to implementation-focused. All SEF levels (system, community, organization, and individual) applicable to a model were also extracted. Models that addressed policy activities were noted.

EVIDENCE SYNTHESIS

Sixty-one models were included in this review. Each of the five categories in the construct flexibility and D/I scales had at least four models. Models were distributed across all levels of the SEF; the fewest models (n=8) addressed policy activities. To assist researchers in selecting and utilizing a model throughout the research process, the authors present and explain examples of how models have been used.

CONCLUSIONS

These findings may enable researchers to better identify and select models to inform their D&I work.

Use of electronic health records in U.S. hospitals

BACKGROUND

Despite a consensus that the use of health information technology should lead to more efficient, safer, and higher-quality care, there are no reliable estimates of the prevalence of adoption of electronic health records in U.S. hospitals.

METHODS

We surveyed all acute care hospitals that are members of the American Hospital Association for the presence of specific electronic-record functionalities. Using a definition of electronic health records based on expert consensus, we determined the proportion of hospitals that had such systems in their clinical areas. We also examined the relationship of adoption of electronic health records to specific hospital characteristics and factors that were reported to be barriers to or facilitators of adoption.

RESULTS

On the basis of responses from 63.1% of hospitals surveyed, only 1.5% of U.S. hospitals have a comprehensive electronic-records system (i.e., present in all clinical units), and an additional 7.6% have a basic system (i.e., present in at least one clinical unit). Computerized provider-order entry for medications has been implemented in only 17% of hospitals. Larger hospitals, those located in urban areas, and teaching hospitals were more likely to have electronic-records systems. Respondents cited capital requirements and high maintenance costs as the primary barriers to implementation, although hospitals with electronic-records systems were less likely to cite these barriers than hospitals without such systems.

CONCLUSIONS

The very low levels of adoption of electronic health records in U.S. hospitals suggest that policymakers face substantial obstacles to the achievement of health care performance goals that depend on health information technology. A policy strategy focused on financial support, interoperability, and training of technical support staff may be necessary to spur adoption of electronic-records systems in U.S. hospitals.

Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review

BACKGROUND

Nowadays more and more clinical guidelines for health care professionals are being developed. However, this does not automatically mean that these guidelines are actually implemented. The aim of this meta-review is twofold: firstly, to gain a better understanding of which factors affect the implementation of guidelines, and secondly, to provide insight into the "state-of-the-art" regarding research within this field.

METHODS

A search of five literature databases and one website was performed to find relevant existing systematic reviews or meta-reviews. Subsequently, a two-step inclusion process was conducted: (1) screening on the basis of references and abstracts and (2) screening based on full-text papers. After that, relevant data from the included reviews were extracted and the methodological quality of the reviews was assessed by using the Quality Assessment Checklist for Reviews.

RESULTS

Twelve systematic reviews met our inclusion criteria. No previous systematic meta-reviews meeting all our inclusion criteria were found. Two of the twelve reviews scored high on the checklist used, indicating only "minimal" or "minor flaws". The other ten reviews scored in the lowest of middle ranges, indicating "extensive" or "major" flaws. A substantial proportion (although not all) of the reviews indicates that effective strategies often have multiple components and that the use of one single strategy, such as reminders only or an educational intervention, is less effective. Besides, characteristics of the guidelines themselves affect actual use. For instance, guidelines that are easy to understand, can easily be tried out, and do not require specific resources, have a greater chance of implementation. In addition, characteristics of professionals - e.g., awareness of the existence of the guideline and familiarity with its content - likewise affect implementation. Furthermore, patient characteristics appear to exert influence: for instance, co-morbidity reduces the chance that guidelines are followed. Finally, environmental characteristics may influence guideline implementation. For example, a lack of support from peers or superiors, as well as insufficient staff and time, appear to be the main impediments.

CONCLUSION

Existing reviews describe various factors that influence whether guidelines are actually used. However, the evidence base is still thin, and future sound research - for instance comparing combinations of implementation strategies versus single strategies - is needed.

Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS)

Mental health provider attitudes toward organizational change have not been well studied. Dissemination and implementation of evidence-based practices (EBPs) into real-world settings represent organizational change that may be limited or facilitated by provider attitudes toward adoption of new treatments, interventions, and practices. A brief measure of mental health provider attitudes toward adoption of EBPs was developed and attitudes were examined in relation to a set of provider individual difference and organizational characteristics.

METHODS

Participants were 322 public sector clinical service workers from 51 programs providing mental health services to children and adolescents and their families.

RESULTS

Four dimensions of attitudes toward adoption of EBPs were identified: (1) intuitive Appeal of EBP, (2) likelihood of adopting EBP given Requirements to do so, (3) Openness to new practices, and (4) perceived Divergence of usual practice with research-based/academically developed interventions. Provider attitudes varied by education level, level of experience, and organizational context.

CONCLUSIONS

Attitudes toward adoption of EBPs can be reliably measured and vary in relation to individual differences and service context. EBP implementation plans should include consideration of mental health service provider attitudes as a potential aid to improve the process and effectiveness of dissemination efforts.

Can Electronic Medical Record Systems Transform Health Care? Potential Health Benefits, Savings, And Costs

To broadly examine the potential health and financial benefits of health information technology (HIT), this paper compares health care with the use of IT in other industries. It estimates potential savings and costs of widespread adoption of electronic medical record (EMR) systems, models important health and safety benefits, and concludes that effective EMR implementation and networking could eventually save more than $81 billion annually--by improving health care efficiency and safety--and that HIT-enabled prevention and management of chronic disease could eventually double those savings while increasing health and other social benefits. However, this is unlikely to be realized without related changes to the health care system.

Expanding global access to radiotherapy

Radiotherapy is a critical and inseparable component of comprehensive cancer treatment and care. For many of the most common cancers in low-income and middle-income countries, radiotherapy is essential for effective treatment. In high-income countries, radiotherapy is used in more than half of all cases of cancer to cure localised disease, palliate symptoms, and control disease in incurable cancers. Yet, in planning and building treatment capacity for cancer, radiotherapy is frequently the last resource to be considered. Consequently, worldwide access to radiotherapy is unacceptably low. We present a new body of evidence that quantifies the worldwide coverage of radiotherapy services by country. We show the shortfall in access to radiotherapy by country and globally for 2015-35 based on current and projected need, and show substantial health and economic benefits to investing in radiotherapy. The cost of scaling up radiotherapy in the nominal model in 2015-35 is US$26·6 billion in low-income countries, $62·6 billion in lower-middle-income countries, and $94·8 billion in upper-middle-income countries, which amounts to $184·0 billion across all low-income and middle-income countries. In the efficiency model the costs were lower: $14·1 billion in low-income, $33·3 billion in lower-middle-income, and $49·4 billion in upper-middle-income countries-a total of $96·8 billion. Scale-up of radiotherapy capacity in 2015-35 from current levels could lead to saving of 26·9 million life-years in low-income and middle-income countries over the lifetime of the patients who received treatment. The economic benefits of investment in radiotherapy are very substantial. Using the nominal cost model could produce a net benefit of $278·1 billion in 2015-35 ($265·2 million in low-income countries, $38·5 billion in lower-middle-income countries, and $239·3 billion in upper-middle-income countries). Investment in the efficiency model would produce in the same period an even greater total benefit of $365·4 billion ($12·8 billion in low-income countries, $67·7 billion in lower-middle-income countries, and $284·7 billion in upper-middle-income countries). The returns, by the human-capital approach, are projected to be less with the nominal cost model, amounting to $16·9 billion in 2015-35 (-$14·9 billion in low-income countries; -$18·7 billion in lower-middle-income countries, and $50·5 billion in upper-middle-income countries). The returns with the efficiency model were projected to be greater, however, amounting to $104·2 billion (-$2·4 billion in low-income countries, $10·7 billion in lower-middle-income countries, and $95·9 billion in upper-middle-income countries). Our results provide compelling evidence that investment in radiotherapy not only enables treatment of large numbers of cancer cases to save lives, but also brings positive economic benefits.

Competency-based postgraduate training: can we bridge the gap between theory and clinical practice?

The introduction of competency-based postgraduate medical training, as recently stimulated by national governing bodies in Canada, the United States, the United Kingdom, The Netherlands, and other countries, is a major advancement, but at the same time it evokes critical issues of curricular implementation. A source of concern is the translation of general competencies into the practice of clinical teaching. The authors observe confusion around the term competency, which may have adverse effects when a teaching and assessment program is to be designed. This article aims to clarify the competency terminology. To connect the ideas behind a competency framework with the work environment of patient care, the authors propose to analyze the critical activities of professional practice and relate these to predetermined competencies. The use of entrustable professional activities (EPAs) and statements of awarded responsibility (STARs) may bridge a potential gap between the theory of competency-based education and clinical practice. EPAs reflect those activities that together constitute the profession. Carrying out most of these EPAs requires the possession of several competencies. The authors propose not to go to great lengths to assess competencies as such, in the way they are abstractly defined in competency frameworks but, instead, to focus on the observation of concrete critical clinical activities and to infer the presence of multiple competencies from several observed activities. Residents may then be awarded responsibility for EPAs. This can serve to move toward competency-based training, in which a flexible length of training is possible and the outcome of training becomes more important than its length.

What drives change? Barriers to and incentives for achieving evidence-based practice

To bridge the gap between scientific evidence and patient care we need an in-depth understanding of the barriers and incentives to achieving change in practice. Various theories and models for change point to a multitude of factors that may affect the successful implementation of evidence. However, the evidence for their value in the field is still limited. When planning complex changes in practice, potential barriers at various levels need to be addressed. Planning needs to take into account the nature of the innovation; characteristics of the professionals and patients involved; and the social, organisational, economic and political context.