Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions

Developing a Tailored eHealth Self-Management Intervention for Patients With Chronic Kidney Disease in China: Intervention Mapping Approach

BACKGROUND

Chronic kidney disease (CKD) is a major public health concern. Adequate self-management skills are vital to reduce CKD burden, optimize patient health outcomes, and control health care expenditures. Using eHealth to support CKD self-management has the potential to promote healthy behaviors and improve health outcomes of patients with CKD. However, knowledge of the implementation of such interventions in general, and in China specifically, is still limited.

OBJECTIVE

This study aims to develop a tailored eHealth self-management intervention for patients with CKD in China based on the Dutch Medical Dashboard (MD) eHealth self-management intervention.

METHODS

We used an intervention mapping approach. In phase 1, a systematic review and 2 qualitative studies were conducted to examine the needs, beliefs, and perceptions of patients with CKD and health care professionals regarding CKD self-management and eHealth interventions. Afterward, key factors gathered from the aforementioned studies were categorized following the 5 domains of the Consolidated Framework for Implementation Research (CFIR). In phase 2, we specified program outcomes, performance objectives, determinants, theory-based methods, and practical strategies. Knowledge obtained from previous results was combined to complement core components of the MD self-management intervention and adapt them for Chinese patients with CKD. Additionally, the CFIR-Expert Recommendations for Implementing Change Matching Tool was pragmatically used to generate a list of potential implementation strategies to address the key factors influencing the implementation of eHealth CKD self-management interventions, and implementation strategies were discussed and finalized with the intervention monitoring group.

RESULTS

An overview of the CFIR domains showed the essential factors influencing the implementation of eHealth CKD self-management interventions in Chinese settings, including "knowledge and beliefs" in the domain "individual characteristics," "quality and advantage of eHealth intervention" in the domain "intervention characteristics," "compatibility" in the domain "inner setting," and "cultural context" in the domain "outer setting." To ensure the effectiveness of the Dutch MD-based self-management intervention, we did not change the core self-management intervention components of MD that underlie its effectiveness, such as self-monitoring. We identified surface-level cultural adaptations involving customizing intervention content, messages, and approaches to the observable cultural characteristics of the local population to enhance the intervention's appeal, receptivity, and feasibility, such as providing video or voice call options to support interactions with health care professionals. Furthermore, the adapted modules such as Knowledge Center and My Self-Monitoring were developed in a mobile health app.

CONCLUSIONS

Our study resulted in the delivery of a culturally tailored, standardized eHealth self-management intervention for patients with CKD in China that has the potential to optimize patients' self-management skills and improve health status and quality of life. Moreover, our study's research approach and results can inform future research on the tailoring and translation of evidence-based, eHealth self-management interventions to various contexts.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04212923; https://classic.clinicaltrials.gov/ct2/show/NCT04212923.

Assessment of Barriers to Referral and Appointment Wait Times for the Evaluation of Spinal Muscular Atrophy (SMA): Findings from a Web-Based Physician Survey

BACKGROUND

Spinal muscular atrophy (SMA) is an autosomal recessive neuromuscular disease characterized by progressive muscle weakness and atrophy. Clinical trial data suggest early diagnosis and treatment are critical. The purpose of this study was to evaluate neurology appointment wait times for newborn screening identified infants, pediatric cases mirroring SMA symptomatology, and cases in which SMA is suspected by the referring physician. Approaches for triaging and expediting referrals in the US were also explored.

METHODS

Cure SMA surveyed healthcare professionals from two cohorts: (1) providers affiliated with SMA care centers and (2) other neurologists, pediatric neurologists, and neuromuscular specialists. Surveys were distributed directly and via Medscape Education, respectively, between July 9, 2020, and August 31, 2020.

RESULTS

Three hundred five total responses were obtained (9% from SMA care centers and 91% from the general recruitment sample). Diagnostic journeys were shorter for infants eventually diagnosed with SMA Type 1 if they were referred to SMA care centers versus general sample practices. Appointment wait times for infants exhibiting "hypotonia and motor delays" were significantly shorter at SMA care centers compared to general recruitment practices (p = 0.004). Furthermore, infants with SMA identified through newborn screening were also more likely to be seen sooner if referred to a SMA care center versus a general recruitment site. Lastly, the majority of both cohorts triaged incoming referrals. The average wait time for infants presenting at SMA care centers with "hypotonia and motor delay" was significantly shorter when initial referrals were triaged using a set of "key emergency words" (p = 0.036).

CONCLUSIONS

Infants directly referred to a SMA care center versus a general sample practice were more likely to experience shorter SMA diagnostic journeys and appointment wait times. Triage guidelines for referrals specific to "hypotonia and motor delay" including use of "key emergency words" may shorten wait times and support early diagnosis and treatment of SMA.

Primary palliative care in low- and middle-income countries: A systematic review and thematic synthesis of the evidence for models and outcomes

BACKGROUND

Serious health-related suffering is predicted to double in low- and middle-income countries by 2060. Primary care offers the best opportunity to meet Universal Health Coverage in an equitable way. Primary palliative care growth should be evidence-based to ensure provision is feasible, acceptable and culturally congruent.

AIM

To identify the current evidence related to primary palliative care and to describe how primary palliative is defined in this setting, dominant typologies of care and meaningful outcome measures in LMICs.

DESIGN

A systematic review and thematic synthesis was conducted. We described the nature, extent and distribution of published literature on primary palliative care in low- and middle-income countries, use thematic synthesis to characterize typologies of primary palliative care and design a process model for care delivery in low- and middle-income countries.

DATA SOURCES

Medline, Psychinfo, Global Health, Embase and CINAHL.

RESULTS

Thirty-five publications were included. Nearly half took place in Asia (n = 16, 45.7%). We identified five dominant typologies of primary palliative care, including delivery in primary care clinics by multidisciplinary healthcare teams and palliative care specialists, in people's homes by healthcare professionals and volunteers and in tertiary healthcare facilities by generalists. We designed a process model for how these models operate within larger health systems and identified barriers and facilitators to implementing primary palliative care in this context.

CONCLUSION

Evidence supporting primary palliative care in low- and middle-income countries is limited, and much of the published literature comes from Asia and southern Africa. Health systems in low- and middle-income countries have unique strengths and needs that affect primary palliative care services that should guide how services evolve to meet future need.

Factors influencing the implementation of early discharge hospital at home and admission avoidance hospital at home: a qualitative evidence synthesis

BACKGROUND

Worldwide there is an increasing demand for Hospital at Home as an alternative to hospital admission. Although there is a growing evidence base on the effectiveness and cost-effectiveness of Hospital at Home, health service managers, health professionals and policy makers require evidence on how to implement and sustain these services on a wider scale.

OBJECTIVES

(1) To identify, appraise and synthesise qualitative research evidence on the factors that influence the implementation of Admission Avoidance Hospital at Home and Early Discharge Hospital at Home, from the perspective of multiple stakeholders, including policy makers, health service managers, health professionals, patients and patients' caregivers. (2) To explore how our synthesis findings relate to, and help to explain, the findings of the Cochrane intervention reviews of Admission Avoidance Hospital at Home and Early Discharge Hospital at Home services.

SEARCH METHODS

We searched MEDLINE, CINAHL, Global Index Medicus and Scopus until 17 November 2022. We also applied reference checking and citation searching to identify additional studies. We searched for studies in any language.

SELECTION CRITERIA

We included qualitative studies and mixed-methods studies with qualitative data collection and analysis methods examining the implementation of new or existing Hospital at Home services from the perspective of different stakeholders.

DATA COLLECTION AND ANALYSIS

Two authors independently selected the studies, extracted study characteristics and intervention components, assessed the methodological limitations using the Critical Appraisal Skills Checklist (CASP) and assessed the confidence in the findings using GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative research). We applied thematic synthesis to synthesise the data across studies and identify factors that may influence the implementation of Hospital at Home.

MAIN RESULTS

From 7535 records identified from database searches and one identified from citation tracking, we included 52 qualitative studies exploring the implementation of Hospital at Home services (31 Early Discharge, 16 Admission Avoidance, 5 combined services), across 13 countries and from the perspectives of 662 service-level staff (clinicians, managers), eight systems-level staff (commissioners, insurers), 900 patients and 417 caregivers. Overall, we judged 40 studies as having minor methodological concerns and we judged 12 studies as having major concerns. Main concerns included data collection methods (e.g. not reporting a topic guide), data analysis methods (e.g. insufficient data to support findings) and not reporting ethical approval. Following synthesis, we identified 12 findings graded as high (n = 10) and moderate (n = 2) confidence and classified them into four themes: (1) development of stakeholder relationships and systems prior to implementation, (2) processes, resources and skills required for safe and effective implementation, (3) acceptability and caregiver impacts, and (4) sustainability of services.

AUTHORS' CONCLUSIONS

Implementing Admission Avoidance and Early Discharge Hospital at Home services requires early development of policies, stakeholder engagement, efficient admission processes, effective communication and a skilled workforce to safely and effectively implement person-centred Hospital at Home, achieve acceptance by staff who refer patients to these services and ensure sustainability. Future research should focus on lower-income country and rural settings, and the perspectives of systems-level stakeholders, and explore the potential negative impact on caregivers, especially for Admission Avoidance Hospital at Home, as this service may become increasingly utilised to manage rising visits to emergency departments.

Remote cognitive assessment in severe mental illness: a scoping review

Many individuals living with severe mental illness, such as schizophrenia, present cognitive deficits and reasoning biases negatively impacting clinical and functional trajectories. Remote cognitive assessment presents many opportunities for advancing research and treatment but has yet to be widely used in psychiatric populations. We conducted a scoping review of remote cognitive assessment in severe mental illness to provide an overview of available measures and guide best practices. Overall, 34 studies (n = 20,813 clinical participants) were reviewed and remote measures, psychometrics, facilitators, barriers, and future directions were synthesized using a logic model. We identified 82 measures assessing cognition in severe mental illness across 11 cognitive domains and four device platforms. Remote measures were generally comparable to traditional versions, though psychometric properties were infrequently reported. Facilitators included standardized procedures and wider recruitment, whereas barriers included imprecise measure adaptations, technology inaccessibility, low patient engagement, and poor digital literacy. Our review identified several remote cognitive measures in psychiatry across all cognitive domains. However, there is a need for more rigorous validation of these measures and consideration of potentially influential factors, such as sex and gender. We provide recommendations for conducting remote cognitive assessment in psychiatry and fostering high-quality research using digital technologies.

Development of an intervention (PICASO) to optimise the palliative care capacity of social workers in Flanders: a study protocol based on phase I of the Medical Research Council framework

INTRODUCTION

An important challenge for future palliative care delivery is the growing number of people with palliative care needs compared with the limited qualified professional workforce. Existing but underused professional potential can further be optimised. This is certainly the case for social work, a profession that fits well in multidisciplinary palliative care practice but whose capacities remain underused. This study aims to optimise the palliative care capacity of social workers in Flanders (Belgium) by the development of a Palliative Care Program for Social Work (PICASO).

METHODS AND ANALYSIS

This protocol paper covers the steps of the development of PICASO, which are based on phase I of the Medical Research Council framework. However, additional steps were added to the original framework to include more opportunities for stakeholder involvement. The development of PICASO follows an iterative approach. First, we will identify existing evidence by reviewing the international literature and describe the problem by conducting quantitative and qualitative research among Flemish social workers. Second, we will further examine practice and identify an appropriate intervention theory by means of expert panels. Third, the process and outcomes will be depicted in a logic model.

ETHICS AND DISSEMINATION

Ethical approval for this study was given by the KU Leuven Social and Societal Ethics Committee (SMEC) on 14 April 2021 (reference number: G-2020-2247-R2(MIN)). Findings will be disseminated through professional networks, conference presentations and publications in scientific journals.

Best practices for interviewing applicants for medical school admissions: a systematic review

INTRODUCTION

Interviews are commonly used to select applicants for medical school, residency, and fellowship. However, interview techniques vary in acceptability, feasibility, reliability, and validity. This systematic review investigated the effectiveness of different interview methods in selecting the best qualified applicants for admission to medical school and developed a logic model to implement best practices for interviewing.

METHODS

Five electronic literature databases were searched for comparative studies related to interviewing in medical schools from inception through February 1, 2021. Inclusion criteria included publications in English that compared different methods of conducting a selection interview in medical schools with a controlled trial design. General study characteristics, measurement methodologies, and outcomes were reviewed. Quality appraisal was performed using the Medical Education Research Study Quality Instrument (MERSQI) and the Oxford Risk of Bias Scale. Based on these findings, a logic model was constructed using content analysis.

RESULTS

Thirteen studies were included. The multiple mini-interview (MMI) was reliable, unbiased, and predicted clinical and academic performance; the virtual MMI increased reliability and lowered costs. For unstructured interviews, blinding interviewers to academic scores reduced bias towards higher scorers; student and faculty interviewers rated applicants similarly. Applicants preferred structured over unstructured interviews. Study quality was above average per the MERSQI, risk of bias was high per the Oxford scale, and between-study heterogeneity was substantial.

DISCUSSION

There were few high-quality studies on interviewing applicants for admission to medical school; the MMI appears to offer a reliable method of interviewing. A logic model can provide a conceptual framework for conducting evidence-based admissions interviews.

Understanding potentially avoidable hospitalisations in a rural Australian setting from the perspectives of patients and health professionals: a qualitative study and logic model

Background

Potentially avoidable hospitalisations (PAHs) are proxy measures of effective primary care at a population level. PAHs are higher in rural and disadvantaged areas. This qualitative study sought a deeper understanding of PAHs for chronic health conditions in a rural context from the perspectives of patients and health professionals, and aimed to develop a logic model for rural health services to identify intervention targets.

Methods

Patients with chronic obstructive pulmonary disease, congestive cardiac failure or type 2 diabetes, admitted to a rural hospital in Australia and local health professionals were invited to participate in interviews in late 2019. Semistructured interviews were recorded, transcribed verbatim and thematically analysed. Themes were mapped against a programme logic model developed in a similar study.

Results

patients and 16 health professionals participated. The logic model encompassed patient level (knowledge, skills, health status), provider level (workforce availability, attributes) and system level (clinical pathways) contexts. These contexts influenced key mechanisms of relationships, continuity of care and capacity to offer services. Outcomes included responsive and timely access to care, improved clinical outcomes and resource use. Themes that did not readily map to the logic model included socioeconomic disadvantage and healthcare costs, which influenced affordability and equity of access.

Conclusion

Patients’ complex health and social circumstance, health service access and unclear care pathways were strong themes associated with PAH in this rural context. Patient, provider and system contexts influencing key mechanisms and outcomes need to be understood when designing solutions to address PAHs in rural settings. Ideally, interventions should address the cost of healthcare alongside interventions to enhance relationships, continuity of care and capacity to offer services.

Interventions to improve obstetric emergency referral decision making, communication and feedback between health facilities in sub-Saharan Africa: A systematic review

Objective

The objective of the study was to review the evidence on interventions to improve obstetric emergency referral decision making, communication and feedback between health facilities in sub‐Saharan Africa (SSA).

Methods

A systematic search of PubMed, Embase, Cochrane Register and CINAHL Plus was conducted to identify studies on obstetric emergency referral in SSA. Studies were included based on pre‐defined eligibility criteria. Details of reported referral interventions were extracted and categorised. The Joanna Biggs Institute Critical Appraisal checklists were used for quality assessment of included studies. A formal narrative synthesis approach was used to summarise findings guided by the WHO's referral system flow.

Results

A total of 14 studies were included, with seven deemed high quality. Overall, 7 studies reported referral decision‐making interventions including training programmes for health facility and community health workers, use of a triage checklist and focused obstetric ultrasound, which resulted in improved knowledge and practice of recognising danger signs for referral. 9 studies reported on referral communication using mobile phones and referral letters/notes, resulting in increased communication between facilities despite telecommunication network failures. Referral decision making and communication interventions achieved a perceived reduction in maternal mortality. 2 studies focused on referral feedback, which improved collaboration between health facilities.

Conclusion

There is limited evidence on how well referral interventions work in sub‐Saharan Africa, and limited consensus regarding the framework underpinning the expected change. This review has led to the proposition of a logic model that can serve as the base for future evaluations which robustly expose the (in)efficiency of referral interventions.

Understanding engagement in digital mental health and wellbeing programs for sub-clinical women in the perinatal period: A Systematic Review without Meta-Analysis (SWiM) (Preprint)

Background

Pregnancy and the postnatal period can be a time of increased psychological distress, which can be detrimental to both the mother and the developing child. Digital interventions are cost-effective and accessible tools to support positive mental health in women during the perinatal period. Although studies report efficacy, a key concern regarding web-based interventions is the lack of engagement leading to drop out, lack of participation, or reduced potential intervention benefits.

Objective

This systematic review aimed to understand the reporting and levels of engagement in studies of digital psychological mental health or well-being interventions administered during the perinatal period. Specific objectives were to understand how studies report engagement across 4 domains specified in the Connect, Attend, Participate, and Enact (CAPE) model, make recommendations on best practices to report engagement in digital mental health interventions (DMHIs), and understand levels of engagement in intervention studies in this area. To maximize the utility of this systematic review, we intended to develop practical tools for public health use: to develop a logic model to reference the theory of change, evaluate the studies using the CAPE framework, and develop a guide for future data collection to enable consistent reporting in digital interventions.

Methods

This systematic review used the Cochrane Synthesis Without Meta-analysis reporting guidelines. This study aimed to identify studies reporting DMHIs delivered during the perinatal period in women with subclinical mood symptoms. A systematic database search was used to identify relevant papers using the Ovid Platform for MEDLINE, PsycINFO, EMBASE, Scopus, Web of Science, and Medical Subject Headings on Demand for all English-language articles published in the past 10 years.

Results

Searches generated a database of 3473 potentially eligible studies, with a final selection of 16 (0.46%) studies grouped by study design. Participant engagement was evaluated using the CAPE framework and comparable variables were described. All studies reported at least one engagement metric. However, the measures used were inconsistent, which may have contributed to the wide-ranging results. There was insufficient reporting for enactment (ie, participants’ real-world use of intervention skills), with only 38% (6/16) of studies clearly recording longer-term practice through postintervention interviews. The logic model proposes ways of conceptualizing and reporting engagement details in DMHIs more consistently in the future.

Conclusions

The perinatal period is the optimal time to intervene with strength-based digital tools to build positive mental health. Despite the growing number of studies on digital interventions, few robustly explore engagement, and there is limited evidence of long-term skill use beyond the intervention period. Our results indicate variability in the reporting of both short- and long-term participant engagement behaviors, and we recommend the adoption of standardized reporting metrics in future digital interventions.

Trial Registration

PROSPERO CRD42020162283; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=162283

Families and Collective Futures: Developing a Program Logic Model for Arts-Based Psychosocial Practice With South African Rural Communities

Aim: This aim of this study is to describe the development of a program logic model to guide arts-based psychosocial practice delivered in rural South African farming communities affected by transgenerational traumas. Background: The rationale for developing a program logic model for arts-based psychosocial practice in South Africa was based on the lack of evidence for effective community arts-based psychosocial interventions for collective trauma, unknown consensus about best practices and the need for developing cogent collective psychosocial practices. Further to this, the aims and benefits of the practice required clarity given the psychosocial complexity of the environment within which the practices for this population are being offered. The logic model offers a valuable resource for practitioners, participants and funders to understand the problem being addressed, how practice is defined, as well as the impact of practice and on intermediate and longer term goals. Methods: The authors used a systematic iterative approach to describe the operationalization of arts-based psychosocial practice. This resulted in the design of the logic model being informed by data from focus groups, an overview of the literature regarding transgerenational trauma in this population, operational policies and organizational documents. The development of the logic model involved actively investigating with practitioners their work with remote farming communities. We thematised practitioners practice constructs to identify salient practice elements and their relationship to perceived benefits and lastly feedback from practitioners and participants following implementation to make adjustments to the logic model. Results: The results were clearly identified in the form of visual mapping using the design of a program logic model. The logic model was divided into 5 parts and was verified by practitioners following implementation. The parts of the program logic model are (Part 1) main presenting problem, (Part 2) operational processes, (Part 3) practice elements, (Part 4) benefits, and impact and (Part 5) review.

Relationships between Child Development at School Entry and Adolescent Health-A Participatory Systematic Review

The relationship between child development and adolescent health, and how this may be modified by socio-economic conditions, is poorly understood. This limits cross-sector interventions to address adolescent health inequality. This review summarises evidence on the associations between child development at school starting age and subsequent health in adolescence and identifies factors affecting associations. We undertook a participatory systematic review, searching electronic databases (MEDLINE, PsycINFO, ASSIA and ERIC) for articles published between November 1990 and November 2020. Observational, intervention and review studies reporting a measure of child development and subsequent health outcomes, specifically weight and mental health, were included. Studies were individually and collectively assessed for quality using a comparative rating system of stronger, weaker, inconsistent or limited evidence. Associations between child development and adolescent health outcomes were assessed and reported by four domains of child development (socio-emotional, cognitive, language and communication, and physical development). A conceptual diagram, produced with stakeholders at the outset of the study, acted as a framework for narrative synthesis of factors that modify or mediate associations. Thirty-four studies were included. Analysis indicated stronger evidence of associations between measures of socio-emotional development and subsequent mental health and weight outcomes; in particular, positive associations between early externalising behaviours and later internalising and externalising, and negative associations between emotional wellbeing and later internalising and unhealthy weight. For all other domains of child development, although associations with subsequent health were positive, the evidence was either weaker, inconsistent or limited. There was limited evidence on factors that altered associations. Positive socio-emotional development at school starting age appears particularly important for subsequent mental health and weight in adolescence. More collaborative research across health and education is needed on other domains of development and on the mechanisms that link development and later health, and on how any relationship is modified by socio-economic context.

Development of a Framework and the Content for a Psychoeducational Internet-Delivered Intervention for Women after Treatment for Gynecological Cancer

The number of women treated for gynecological cancer is increasing. At the same time, the duration of in-patient hospitalization has decreased, and follow-up with its primary focus on early recognition of recurrence does not meet all patients' needs. One method of follow-up may be digital intervention. This study describes the development of a psychoeducational Internet-delivered intervention targeting women's psychosocial needs during the follow-up period after treatment for gynecological cancer. The project consisted of three phases following the UK Medical Research Council Framework guidelines for the development of complex interventions. Phase one identified the evidence in the field, phase two identified the relevant theoretical framework, and phase three included a two-year work process including focus group interviews and think aloud interviews with users. Through the steps of literature review, theoretical framework, and an iterative development process with users and other stakeholders, a six-week program was developed. The program included psychoeducational information, multimedia, exercises, and weekly telephone follow-up with a dedicated nurse. This Internet-delivered intervention can be a novel method for addressing the gap in the provision of follow-up for women after treatment for gynecological cancer.

The Effectiveness of Interventions in Improving Hand Hygiene Compliance: A Meta-Analysis and Logic Model

Background

Despite the availability of various guidelines, rules, and strategies, hand hygiene adherence rates among healthcare workers are reported significantly lower than expected. The aim of this meta-analysis is to determine the most effective interventions to improve hand hygiene and to develop a logic model based on the characteristics of the most effective interventions.

Methods

A literature search was conducted on PubMed, ProQuest, Web of Knowledge, Scopus, Cochrane Library, and ScienceDirect databases up to December 21, 2019, with no time limit. Randomized clinical trials which had designed interventions to improve hand hygiene were reviewed. Data were extracted independently by two authors. All statistical analyses were performed using Comprehensive Meta-Analysis (CMA) software (version 2.0). A random-effects model was used to estimate odds ratios.

Results

Although 14 studies were initially reviewed, only 12 studies entered the meta-analysis, since they had identified percentage rates of hand hygiene compliance. The most effective intervention (odds ratio 18.4, 95% CI (13.6–24.8)) was a multilevel strategy that influenced the determinants of hand hygiene behavior at individual, interpersonal, and organizational levels. Following this, a theory-driven logic model was mapped out to promote hand hygiene, based on situational analysis.

Conclusion

This study suggests that designing integrated interventions based on a multilevel socioecological approach has the greatest potential to improve hand hygiene compliance in healthcare workers. The logical model proposed in this study can thus provide a useful guide for designing and conducting future experimental research.

Is working in later life good for your health? A systematic review of health outcomes resulting from extended working lives

Background

Work, rather than unemployment, is recognised as being good for health, but there may be an age when the benefits are outweighed by adverse impacts. As countries around the world increase their typical retirement age, the potential effect on population health and health inequalities requires scrutiny.

Methods

We carried out a systematic review of literature published since 2011 from developed countries on the health effects of employment in those over 64 years of age. We completed a narrative synthesis and used harvest plots to map the direction and volume of evidence for the outcomes reported. We followed the Preferred Reporting Items for Systematic Reviews (PRISMA) checklist in our methods and reporting.

Results

We identified seventeen relevant studies, which were of cohort or cross-sectional design. The results indicate evidence of beneficial or neutral effects from extended working on overall health status and physical health for many employees, and mixed effects on mental health. The benefits reported however, are most likely to be for males, those working part-time or reducing to part-time, and employees in jobs which are not low quality or low reward.

Conclusions

Extending working life (particularly part time) may have benefits or a neutral effect for some, but adverse effects for others in high demand or low reward jobs. There is the potential for widening health inequalities between those who can choose to reduce their working hours, and those who need to continue working full time for financial reasons. There is a lack of evidence for effects on quality of life, and a dearth of interventions enabling older workers to extend their healthy working life.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-11423-2.

Capturing outcomes of competency-based medical education: The call and the challenge

There is an urgent need to capture the outcomes of the ongoing global implementation of competency-based medical education (CBME). However, the measurement of downstream outcomes following educational innovations, such as CBME is fraught with challenges stemming from the complexities of medical training, the breadth and variability of inputs, and the difficulties attributing outcomes to specific educational elements. In this article, we present a logic model for CBME to conceptualize an impact pathway relating to CBME and facilitate outcomes evaluation. We further identify six strategies to mitigate the challenges of outcomes measurement: (1) clearly identify the outcome of interest, (2) distinguish between outputs and outcomes, (3) carefully consider attribution versus contribution, (4) connect outcomes to the fidelity and integrity of implementation, (5) pay attention to unanticipated outcomes, and (6) embrace methodological pluralism. Embracing these challenges, we argue that careful and thoughtful evaluation strategies will move us forward in answering the all-important question: Are the desired outcomes of CBME being achieved?

Intervention Planning for the Tinnitus E-Programme 2.0, an Internet-Based Cognitive Behavioral Intervention for Tinnitus

Purpose The purpose of this study is to comprehensively describe the intervention planning process for the Tinnitus E-Programme 2.0, an Internet-based cognitive behavioral intervention for tinnitus. Method Theory-, evidence-, and person-based approaches to intervention development were used. In Phase 1, quantitative systematic reviews were used to identify potentially effective intervention techniques and design features. Primary mixed-methods research involving adults with tinnitus explored the acceptability of the first version of the intervention. In Phase 2, person-based guiding principles highlighted key intervention design objectives and features to address needs of the intervention's target group (identified in Phase 1) to maximize its acceptability, feasibility of delivery, and effectiveness. Theory-based "behavioral analysis" and "logic modeling" comprehensively described intervention content and potential mechanisms of action. From this planning work, a prototype intervention was developed. Results The intervention design objectives outlined in the guiding principles were to (a) normalize tinnitus, (b) support users to maintain a regular relaxation practice, (c) minimize the worsening of users' tinnitus sensation, and (d) ensure the intervention is accessible to those with hearing loss. Behavioral analysis and logic modeling identified intervention processes (e.g., illness perceptions, beliefs about consequences, skills, goals) and purported mediators (acceptance of tinnitus, negative thinking, use of the cognitive skills tools for managing negative thoughts, and practicing regular relaxation) hypothesized to facilitate reductions in tinnitus symptom severity. Conclusions The guiding principles highlight key design objectives and features to consider when developing interventions for tinnitus. The logic model offers hypothesized mechanisms of action that can be tested in future process analyses.

Awareness screening and referral patterns among pediatricians in the United States related to early clinical features of spinal muscular atrophy (SMA)

Background

Spinal Muscular Atrophy (SMA), a leading genetic cause of death in infants, is an autosomal recessive neuromuscular disease characterized by progressive muscle weakness and atrophy. While early diagnosis of SMA is critical to modifying disease progression and improving outcomes, serious diagnostic delays persist. There is a need to improve SMA awareness, screening, and referral patterns.

Methods

Two online surveys, developed by Cure SMA for general pediatricians, were distributed by Medscape Education via email (September 2018, n = 300, December 2019, n = 600). The surveys asked about adherence to the American Academy of Pediatrics (AAP) developmental screening and surveillance guidelines, comfort with identification of early signs of neuromuscular disease (NMD), familiarity with SMA, and barriers to timely referral.

Results

In 2018, 70.3% of survey respondents indicated comfort in identifying early signs of NMD and 67.3% noted familiarity with SMA. 52.7% correctly indicated the need for genetic testing to make a definitive diagnosis of SMA, 74.0% meet or exceed developmental screening recommendations, and 52.0% said they would immediately refer to a specialist. In 2019, with a larger sample, 73.0% adhere to developmental screening guidelines, and awareness of the genetic testing requirement for SMA was significantly lower by 7.7% (p < 0.03). Specialist wait times emerged as a barrier to referral, with 64.2% of respondents citing wait times of 1–6 months.

Conclusions

Many pediatricians underutilize developmental screening tools and lack familiarity with diagnostic requirements for SMA. Continuing efforts to expand awareness and remove barriers to timely referral to SMA specialists, including reducing appointment wait times, are needed.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12887-021-02692-2.

Impact of child development at primary school entry on adolescent health-protocol for a participatory systematic review

BACKGROUND

Reducing child health inequalities is a global health priority and evidence suggests that optimal development of knowledge, skills and attributes in early childhood could reduce health risks across the life course. Despite a strong policy rhetoric on giving children the 'best start in life', socioeconomic inequalities in children's development when they start school persist. So too do inequalities in child and adolescent health. These in turn influence health inequalities in adulthood. Understanding how developmental processes affect health in the context of socioeconomic factors as children age could inform a holistic policy approach to health and development from childhood through to adolescence. However, the relationship between child development and early adolescent health consequences is poorly understood. Therefore the aim of this review is to summarise evidence on the associations between child development at primary school starting age (3-7 years) and subsequent health in adolescence (8-15 years) and the factors that mediate or moderate this relationship.

METHOD

A participatory systematic review method will be used. The search strategy will include; searches of electronic databases (MEDLINE, PsycINFO, ASSIA and ERIC) from November 1990 onwards, grey literature, reference searches and discussions with stakeholders. Articles will be screened using inclusion and exclusion criteria at title and abstract level, and at full article level. Observational, intervention and review studies reporting a measure of child development at the age of starting school and health outcomes in early adolescence, from a member country of the Organisation for Economic Co-operation and Development, will be included. The primary outcome will be health and wellbeing outcomes (such as weight, mental health, socio-emotional behaviour, dietary habits). Secondary outcomes will include educational outcomes. Studies will be assessed for quality using appropriate tools. A conceptual model, produced with stakeholders at the outset of the study, will act as a framework for extracting and analysing evidence. The model will be refined through analysis of the included literature. Narrative synthesis will be used to generate findings and produce a diagram of the relationship between child development and adolescent health.

DISCUSSION

The review will elucidate how children's development at the age of starting school is related to subsequent health outcomes in contexts of socioeconomic inequality. This will inform ways to intervene to improve health and reduce health inequality in adolescents. The findings will generate knowledge of cross-sector relevance for health and education and promote inter-sectoral coherence in addressing health inequalities throughout childhood.

PROTOCOL REGISTRATION

This systematic review protocol has been registered with PROSPERO CRD42020210011 .

Evaluating Wellness Interventions for Resident Physicians: A Systematic Review

BACKGROUND

Wellness initiatives implemented by graduate medical education programs can help mitigate burnout in resident physicians.

OBJECTIVE

This systematic review seeks to identify factors that impact the effectiveness of resident wellness interventions and to provide a conceptual framework to guide future interventions.

METHODS

Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, 6 electronic databases were searched in November 2019 using variations of the keywords "resident physicians," "wellness," and "intervention." Peer-reviewed full-text English-language articles on controlled studies were considered for inclusion. The quality of the studies was assessed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) guidelines.

RESULTS

The initial search disclosed 1196 articles, of which 18 studies enrolling 666 resident physicians met inclusion criteria for qualitative review. Interventions using peer support and individual meditation enhanced well-being. Effective wellness interventions also used educational theory to guide program development, surveyed participants to guide intervention design, incorporated programming into existing didactic curricula, and recruited voluntary participants. The quality of most of the included studies was poor (13 of 18, 72%) and could be improved by using standardized wellness assessments supported by validity evidence.

CONCLUSIONS

This systematic review suggests that future resident wellness initiatives should focus on grounding interventions in educational theory, forging consensus on wellness instruments with validity evidence, and examining the impact of initiatives on patient outcomes. A logic model can provide a framework for designing and implementing effective wellness interventions.

The effect of behavioural interventions targeting hand hygiene practices among nurses in high-income hospital settings: a systematic review

BACKGROUND

Hand hygiene is a critical behaviour for infection control but efforts to raise compliance among clinical professionals have been met with mixed success. The aim of this systematic review was to identify the effectiveness of the behaviour change techniques utilised in recent hand hygiene interventions that seek to improve hand hygiene compliance among nurses in hospitals in high-income countries. Nurses are at the frontline of healthcare delivery, and so improving their HH behaviour and thus increasing HHC rates will have a relatively large impact on reducing transmission and preventing healthcare acquired infections.

METHODS

High-quality studies among nurses in high-income countries were surveyed from the scientific literature, following PRISMA guidelines, to identify which kinds of behaviour change mechanisms have been used to effectively increase hand hygiene compliance. Only seven studies met all inclusion criteria. A formal meta-analysis was not conducted due to the heterogeneity of the included studies. Instead, the review analysed studies in line with the Intervention Component Analysis approach to identify which differences in intervention characteristics appear to be important. Analysis proceeded in two steps: first, the Effective Practice and Organization of Care Data Extraction Checklist was used to identify the study design and to describe the intervention, target population, setting, results, outcome measures, and analytic approach. The second step involved inferring the behavioural change techniques used in the complex study interventions. Following coding, logic models were then inferred for each study to identify the Theory of Change behind each intervention. These Theories of Change were then examined for suggestions as to which BCTs were likely to have been responsible for any effectiveness observed.

RESULTS

Goals and planning (to achieve specific ends), comparison of behaviour (to peers or some ideal) and feedback and monitoring (observing and providing feedback about behaviour or outcomes) were the most frequently used behaviour change technique groupings used across studies and within interventions.

CONCLUSION

The complexity of the interventions used and lack of sufficient studies makes assignment of responsibility for behaviour change to specific behaviour change techniques difficult. Delivery channels and activities identified in the study Theories of Change were also highly individualized and so difficult to compare. However, we identified a temporal shift in types of techniques used in these recent studies on HH interventions, as compared with studies from prior to the review period. These newer interventions did not focus on providing access to alcohol-based hand rub or trying to solely encourage administrative support. Instead, they had nurses create goals and plan how to best facilitate HH, compared both individuals' and the group's behaviour to others, and focused on providing feedback.

Developing a behavioural intervention package to identify and amend incorrect penicillin allergy records in UK general practice and subsequently change antibiotic use

OBJECTIVES

To develop a behavioural intervention package to support clinicians and patients to amend incorrect penicillin allergy records in general practice. The intervention aimed to: (1) support clinicians to refer patients for penicillin allergy testing (PAT), (2) support patients to attend for PAT and (3) support clinicians and patients to prescribe or consume penicillin, when indicated, following a negative PAT result.

METHODS

Theory-based, evidence-based and person-based approaches were used in the intervention development. We used evidence from a rapid review, two qualitative studies, and expert consultations with the clinical research team to identify the intervention 'guiding principles' and develop an intervention plan. Barriers and facilitators to the target behaviours were mapped to behaviour change theory in order to describe the proposed mechanisms of change. In the final stage, think-aloud interviews were conducted to optimise intervention materials.

RESULTS

The collated evidence showed that the key barriers to referral of patients by clinicians were limited experience of referral and limited knowledge of referral criteria and PAT. Barriers for patients attending PAT were lack of knowledge of the benefits of testing and lack of motivation to get tested. The key barriers to the prescription and consumption of first-line penicillin following a negative test result were patient and clinician beliefs about the accuracy of PAT and whether taking penicillin was safe. Intervention materials were designed and developed to address these barriers.

CONCLUSIONS

We present a novel behavioural intervention package designed to address the multiple barriers to uptake of PAT in general practice by clinicians and patients. The intervention development details how behaviour change techniques have been incorporated to hypothesise how the intervention is likely to work to help amend incorrect penicillin allergy records. The intervention will go on to be tested in a feasibility trial and randomised controlled trial in England.

Barriers and facilitators to deprescribing in primary care: a systematic review

Background

Managing polypharmacy is a challenge for healthcare systems globally. It is also a health inequality concern as it can expose some of the most vulnerable in society to unnecessary medications and adverse drug-related events. Care for most patients with multimorbidity and polypharmacy occurs in primary care. Safe deprescribing interventions can reduce exposure to inappropriate polypharmacy. However, these are not fully accepted or routinely implemented.

Aim

To identify barriers and facilitators to safe deprescribing interventions for adults with multimorbidity and polypharmacy in primary care.

Design & setting

A systematic review of studies published from 2000, examining safe deprescribing interventions for adults with multimorbidity and polypharmacy.

Method

A search of electronic databases: MEDLINE, Embase, Cumulative Index of Nursing and Allied Health Literature (CINHAL), Cochrane, and Health Management Information Consortium (HMIC) from inception to 26 Feb 2019, using an agreed search strategy. This was supplemented by handsearching of relevant journals, and screening of reference lists and citations of included studies.

Results

In total, 40 studies from 14 countries were identified. Cultural and organisational barriers included: a culture of diagnosing and prescribing; evidence-based guidance focused on single diseases; a lack of evidence-based guidance for the care of older people with multimorbidities; and a lack of shared communication, decision-making systems, tools, and resources. Interpersonal and individual-level barriers included: professional etiquette; fragmented care; prescribers’ and patients’ uncertainties; and gaps in tailored support. Facilitators included: prudent prescribing; greater availability and acceptability of non-pharmacological alternatives; resources; improved communication, collaboration, knowledge, and understanding; patient-centred care; and shared decision-making.

Conclusion

A whole systems, patient-centred approach to safe deprescribing interventions is required, involving key decision-makers, healthcare professionals, patients, and carers.

User-Centered Design of a Mobile Health Intervention to Enhance Exacerbation-Related Self-Management in Patients With Chronic Obstructive Pulmonary Disease (Copilot): Mixed Methods Study

Background

Adequate self-management skills are of great importance for patients with chronic obstructive pulmonary disease (COPD) to reduce the impact of COPD exacerbations. Using mobile health (mHealth) to support exacerbation-related self-management could be promising in engaging patients in their own health and changing health behaviors. However, there is limited knowledge on how to design mHealth interventions that are effective, meet the needs of end users, and are perceived as useful. By following an iterative user-centered design (UCD) process, an evidence-driven and usable mHealth intervention was developed to enhance exacerbation-related self-management in patients with COPD.

Objective

This study aimed to describe in detail the full UCD and development process of an evidence-driven and usable mHealth intervention to enhance exacerbation-related self-management in patients with COPD.

Methods

The UCD process consisted of four iterative phases: (1) background analysis and design conceptualization, (2) alpha usability testing, (3) iterative software development, and (4) field usability testing. Patients with COPD, health care providers, COPD experts, designers, software developers, and a behavioral scientist were involved throughout the design and development process. The intervention was developed using the behavior change wheel (BCW), a theoretically based approach for designing behavior change interventions, and logic modeling was used to map out the potential working mechanism of the intervention. Furthermore, the principles of design thinking were used for the creative design of the intervention. Qualitative and quantitative research methods were used throughout the design and development process.

Results

The background analysis and design conceptualization phase resulted in final guiding principles for the intervention, a logic model to underpin the working mechanism of the intervention, and design requirements. Usability requirements were obtained from the usability testing phases. The iterative software development resulted in an evidence-driven and usable mHealth intervention—Copilot, a mobile app consisting of a symptom-monitoring module, and a personalized COPD action plan.

Conclusions

By following a UCD process, an mHealth intervention was developed that meets the needs and preferences of patients with COPD, is likely to be used by patients with COPD, and has a high potential to be effective in reducing exacerbation impact. This extensive report of the intervention development process contributes to more transparency in the development of complex interventions in health care and can be used by researchers and designers as guidance for the development of future mHealth interventions.

Measures for the integration of health and social care services for long-term health conditions: a systematic review of reviews

Background

As people are living longer with higher incidences of long-term health conditions, there is a move towards greater integration of care, including integration of health and social care services. Integrated care needs to be comprehensively and systematically evaluated if it is to be implemented widely. We performed a systematic review of reviews to identify measures which have been used to assess integrated care across health and social care services for people living with long-term health conditions.

Methods

Four electronic databases (PUBMED; MEDLINE; EMBASE; Cochrane library of systematic reviews) were searched in August 2018 for relevant reviews evaluating the integration of health and social care between 1998 and 2018. Articles were assessed according to apriori eligibility criteria. A data extraction form was utilised to collate the identified measures into five categories.

Results

Of the 18 articles included, system outcomes and process measures were most frequently identified (15 articles each). Patient or carer reported outcomes were identified in 13 articles while health outcomes were reported in 12 articles. Structural measures were reported in nine articles. Challenges to measuring integration included the identification of a wide range of potential impacts of integration, difficulties in comparing findings due to differences in study design and heterogeneity of types of outcomes, and a need for appropriate, robust measurement tools.

Conclusions

Our review revealed no shortage of measures for assessing the structures, processes and outcomes of integrated care. The very large number of available measures and infrequent use of any common set make comparisons between schemes more difficult. The promotion of core measurement sets and stakeholder consultation would advance measurement in this area.

Global eye health and the sustainable development goals: protocol for a scoping review

INTRODUCTION

In 2015, most governments of the world committed to achieving 17 sustainable development goals (SDGs) by the year 2030. Efforts to improve eye health contribute to the advancement of several SDGs, including those not exclusively health-related. This scoping review will summarise the nature and extent of the published literature that demonstrates a link between improved eye health and advancement of the SDGs.

METHODS AND ANALYSIS

Searches will be conducted in MEDLINE, Embase and Global Health for published, peer-reviewed manuscripts, with no time period, language or geographic limits. All intervention and observational studies will be included if they report a link between a change in eye health and (1) an outcome related to one of the SDGs or (2) an element on a pathway between eye health and an SDG (eg, productivity). Two investigators will independently screen titles and abstracts, followed by full-text screening of potentially relevant articles. Reference lists of all included articles will be examined to identify further potentially relevant studies. Conflicts between the two independent investigators will be discussed and resolved with a third investigator. For included articles, data regarding publication characteristics, study details and SDG-related outcomes will be extracted. Results will be synthesised by mapping the extracted data to a logic model, which will be refined through an iterative process during data synthesis.

ETHICS AND DISSEMINATION

As this scoping review will only include published data, ethics approval will not be sought. The findings of the review will be published in an open-access, peer-reviewed journal. A summary of the results will be developed for website posting, stakeholder meetings and inclusion in the ongoing Lancet Global Health Commission on Global Eye Health.

Palliative Care Evidence Review Service (PaCERS): a knowledge transfer partnership

The importance of linking evidence into practice and policy is recognised as a key pillar of a prudent approach to healthcare; it is of importance to healthcare professionals and decision-makers across the world in every speciality. However, rapid access to evidence to support service redesign, or to change practice at pace, is challenging. This is particularly so in smaller specialties such as Palliative Care, where pressured multidisciplinary clinicians lack time and skill sets to locate and appraise the literature relevant to a particular area. Therefore, we have initiated the Palliative Care Evidence Review Service (PaCERS), a knowledge transfer partnership through which we have developed a clear methodology to conduct evidence reviews to support professionals and other decision-makers working in palliative care.

PaCERS methodology utilises modified systematic review methods as there is no agreed definition or an accepted methodology for conducting rapid reviews. This paper describes the stages involved based on our iterative recent experiences and engagement with stakeholders, who are the potential beneficiaries of the research. Uniquely, we emphasise the process and opportunities of engagement with the clinical workforce and policy-makers throughout the review, from developing and refining the review question at the start through to the importance of demonstrating impact. We are faced with the challenge of the trade-off between the timely transfer of evidence against the risk of impacting on rigour. To address this issue, we try to ensure transparency throughout the review process. Our methodology aligns with key principles of knowledge synthesis in defining a process that is transparent, robust and improving the efficiency and timeliness of the review.

Our reviews are clinically or policy driven and, although we use modified systematic review methods, one of the key differences between published review processes and our review process is in our relationship with the requester. This streamlining approach to synthesising evidence in a timely manner helps to inform decisions faced by clinicians and decision-makers in healthcare settings, supporting, at pace, knowledge transfer and mobilisation.

Exploring taught masters education for healthcare practitioners: a systematic review of literature

BACKGROUND

Masters-level education is a key pathway of professional development for healthcare practitioners. Whilst there is evidence that Masters-level education leads to career enhancement, it is unclear how the programme pedagogy contributes to this. The objective was to: (1) examine the programme pedagogies and context that supports learning, and (2) synthesise the outputs, outcomes and impact of Masters-level healthcare programmes.

METHODS

A systematic review was conducted according to the Cochrane Collaboration handbook and is reported in line with PRISMA. Using pre-defined key terms and eligibility criteria, two reviewers independently searched Medline, ERIC, Web of Science, ProQuest, and CINAHL Plus databases from inception to 14th November 2016, reference lists of retrieved articles and selected websites. Data were extracted independently. The Mixed Methods Appraisal Tool was used to assess methodological quality. A Weight of Evidence Framework enabled evaluation of the overall quality of evidence. Data were synthesised using thematic qualitative analysis.

RESULTS

Thirty-five studies were included. All studies were retrospective, evaluated programmes in nursing (n = 19), physiotherapy (n = 6), general and family medicine (n = 4), public health (n = 3), dentistry (n = 1), interdisciplinary (n = 1), and occupational therapy (n = 1). Most studies were rated low in methodological quality, with an overall low to moderate weight of evidence for programmes' outcomes and impact. Pedagogies that promote social participation and knowledge co-construction, reflection, learner-centred approach, relevance and authenticity influenced outcomes and impact.

CONCLUSION(S)

Notwithstanding the low to moderate weight of evidence, the review identified multiple positive outcomes of Master-level education for healthcare practitioners. Whilst the pedagogies that contributed to such positive outcomes were examined in some studies, there is a need to further explore links between programme pedagogy, outputs, outcomes and impact. A cultural approach to evaluation may capture how M-level education drives changes.

Developing a digital intervention for cancer survivors: an evidence-, theory- and person-based approach

This paper illustrates a rigorous approach to developing digital interventions using an evidence-, theory- and person-based approach. Intervention planning included a rapid scoping review that identified cancer survivors' needs, including barriers and facilitators to intervention success. Review evidence (N = 49 papers) informed the intervention's Guiding Principles, theory-based behavioural analysis and logic model. The intervention was optimised based on feedback on a prototype intervention through interviews (N = 96) with cancer survivors and focus groups with NHS staff and cancer charity workers (N = 31). Interviews with cancer survivors highlighted barriers to engagement, such as concerns about physical activity worsening fatigue. Focus groups highlighted concerns about support appointment length and how to support distressed participants. Feedback informed intervention modifications, to maximise acceptability, feasibility and likelihood of behaviour change. Our systematic method for understanding user views enabled us to anticipate and address important barriers to engagement. This methodology may be useful to others developing digital interventions.

A systematic scoping review of asset-based approaches to promote health in communities: development of a framework

Asset-based approaches to health promotion have become increasingly popular as a way to tackle health inequalities by empowering people in more disadvantaged communities to use local resources and increase control over health and its determinants. However, questions remain about how they work in practice. This article presents the findings from a systematic scoping review of the empirical literature on asset-based approaches in communities. The aim was to identify the key elements of asset-based approaches, and how they are operationalised in interventions aimed at promoting health and reducing inequalities in local communities. Four databases were searched (Medline, PsycINFO, CINAHL, ASSIA) and papers were included if they described interventions explicitly adopting an asset-based approach but excluded if limited to asset identification. Thirty articles were included in the review. Data were extracted on the type of assets that the intervention built upon, how assets were mobilised, the expected outcomes and evaluation methods. A framework is presented that synthesises the key characteristics of asset-based interventions to promote health in communities. Three main approaches to mobilising assets were identified in the literature: (A) connecting assets, (B) raising awareness of assets and (C) enabling assets to thrive. It is argued that asset-based approaches to health promotion take a wide variety of forms, making it difficult to anticipate outcomes and to evaluate interventions. The framework presented here can be used to better understand the processes through which asset-based approaches work in practice to promote health and reduce inequalities.

Do we understand the intervention? What complex intervention research can teach us for the evaluation of clinical ethics support services (CESS)

BACKGROUND

Evaluating clinical ethics support services (CESS) has been hailed as important research task. At the same time, there is considerable debate about how to evaluate CESS appropriately. The criticism, which has been aired, refers to normative as well as empirical aspects of evaluating CESS.

MAIN BODY

In this paper, we argue that a first necessary step for progress is to better understand the intervention(s) in CESS. Tools of complex intervention research methodology may provide relevant means in this respect. In a first step, we introduce principles of "complex intervention research" and show how CESS fulfil the criteria of "complex interventions". In a second step, we develop a generic "conceptual framework" for "ethics consultation on request" as standard for many forms of ethics consultation in clinical ethics practice. We apply this conceptual framework to the model of "bioethics mediation" to make explicit the specific structural and procedural elements of this form of ethics consultation on request. In a final step we conduct a comparative analysis of two different types of CESS, which have been subject to evaluation research: "proactive ethics consultation" and "moral case deliberation" and discuss implications for evaluating both types of CESS.

CONCLUSION

To make explicit different premises of implemented CESS interventions by means of conceptual frameworks can inform the search for sound empirical evaluation of CESS. In addition, such work provides a starting point for further reflection about what it means to offer "good" CESS.

Towards greater understanding of implementation during systematic reviews of complex healthcare interventions: the framework for implementation transferability applicability reporting (FITAR)

Background

There have been calls for greater consideration of applicability and transferability in systematic reviews, to improve their usefulness in informing policy and practice. Understanding how evidence is, or is not applicable and transferable to varying local situations and contexts, is a key challenge for systematic review synthesis in healthcare. Assessing applicability and transferability in systematic reviews is reported to be difficult, particularly in reviews of complex interventions. There is a need for exploration of factors perceived to be important by policy-makers, and for further guidance on which items should be reported. In this paper we focus on the process of development of a framework that can be used by systematic reviewers to identify and report data across studies relating to applicability and transferability.

Methods

The framework was developed by scrutinising existing literature on applicability and transferability, examining data during a systematic review of highly complex changes to health service delivery, and was informed by stakeholder engagement. The items of the framework were thus grounded in both data identified during a real review, and stakeholder input. The paper describes examples of data identified using the framework during a review of integrated care interventions, and outlines how it informed analysis and reporting of the review findings.

Results

The Framework for Implementation Transferability Applicability Reporting (FITAR) comprises 44 items which can be used to structure analysis and reporting across studies during systematic reviews of complex interventions. The framework prompts detailed consideration of contextual data during extraction and reporting, within areas of: patient type and populations; type of organisations and systems; financial and commissioning processes; systems leadership elements; features of services; features of the workforce; and finally elements of the interventions/initiatives.

Conclusions

Use of the framework during our review of complex healthcare interventions helped the review team to surface contextual data, which may not be commonly extracted, analysed and reported. Further exploration and evaluation of systems for identifying and reporting these factors during reviews is required.

Electronic supplementary material

The online version of this article (10.1186/s12874-019-0723-y) contains supplementary material, which is available to authorized users.

Advancing complexity science in healthcare research: the logic of logic models

Background

Logic models are commonly used in evaluations to represent the causal processes through which interventions produce outcomes, yet significant debate is currently taking place over whether they can describe complex interventions which adapt to context. This paper assesses the logic models used in healthcare research from a complexity perspective. A typology of existing logic models is proposed, as well as a formal methodology for deriving more flexible and dynamic logic models.

Analysis

Various logic model types were tested as part of an evaluation of a complex Patient Experience Toolkit (PET) intervention, developed and implemented through action research across six hospital wards/departments in the English NHS. Three dominant types of logic model were identified, each with certain strengths but ultimately unable to accurately capture the dynamics of PET. Hence, a fourth logic model type was developed to express how success hinges on the adaption of PET to its delivery settings. Aspects of the Promoting Action on Research Implementation in Health Services (PARIHS) model were incorporated into a traditional logic model structure to create a dynamic “type 4” logic model that can accommodate complex interventions taking on a different form in different settings.

Conclusion

Logic models can be used to model complex interventions that adapt to context but more flexible and dynamic models are required. An implication of this is that how logic models are used in healthcare research may have to change. Using logic models to forge consensus among stakeholders and/or provide precise guidance across different settings will be inappropriate in the case of complex interventions that adapt to context. Instead, logic models for complex interventions may be targeted at facilitators to enable them to prospectively assess the settings they will be working in and to develop context-sensitive facilitation strategies. Researchers should be clear as to why they are using a logic model and experiment with different models to ensure they have the correct type.

Electronic supplementary material

The online version of this article (10.1186/s12874-019-0701-4) contains supplementary material, which is available to authorized users.

A categorisation of problems and solutions to improve patient referrals from primary to specialty care

BACKGROUND

Improving access to specialty care has been identified as a critical issue in the delivery of health services, especially given an increasing burden of chronic disease. Identifying and addressing problems that impact access to specialty care for patients referred to speciality care for non-emergent procedures and how these deficiencies can be managed via health system delivery interventions is important to improve care for patients with chronic conditions. However, the primary-specialty care interface is complex and may be impacted by a variety of potential health services delivery deficiencies; with an equal range of interventions developed to correct them. Consequently, the literature is also diverse and difficult to navigate. We present a narrative review to identify existing literature, and provide a conceptual map that categorizes problems at the primary-specialty care interface with linkages to corresponding interventions aimed at ensuring that patient transitions across the primary-specialty care interface are necessary, appropriate, timely and well communicated.

METHODS

We searched MEDLINE and EMBASE databases from January 1, 2005 until Dec 31, 2014, grey literature and reference lists to identify articles that report on interventions implemented to improve the primary-specialty care interface. Selected articles were categorized to describe: 1) the intervention context, including the deficiency addressed, and the objective of the intervention 2) intervention activities, and 3) intervention outcomes.

RESULTS

We identified 106 articles, producing four categories of health services delivery deficiencies based in: 1) clinical decision making; 2) information management; 3) the system level management of patient flows between primary and secondary care; and 4) quality-of-care monitoring. Interventions were divided into seven categories and fourteen sub-categories based on the deficiencies addressed and the intervention strategies used. Potential synergies and trade-offs among interventions are discussed. Little evidence exists regarding the synergistic and antagonistic interactions of alternative intervention strategies.

CONCLUSION

The categorization acts as an aid in identifying why the primary-specialty care interface may be failing and which interventions may produce improvements. Overlap and interconnectedness between interventions creates potential synergies and conflicts among co-implemented interventions.

Understanding new models of integrated care in developed countries: a systematic review

Background

The NHS has been challenged to adopt new integrated models of service delivery that are tailored to local populations. Evidence from the international literature is needed to support the development and implementation of these new models of care.

Objectives

The study aimed to carry out a systematic review of international evidence to enhance understanding of the mechanisms whereby new models of service delivery have an impact on health-care outcomes.

Design

The study combined rigorous and systematic methods for identification of literature, together with innovative methods for synthesis and presentation of findings.

Setting

Any setting.

Participants

Patients receiving a health-care service and/or staff delivering services.

Interventions

Changes to service delivery that increase integration and co-ordination of health and health-related services.

Main outcome measures

Outcomes related to the delivery of services, including the views and perceptions of patients/service users and staff.

Study design

Empirical work of a quantitative or qualitative design.

Data sources

We searched electronic databases (between October 2016 and March 2017) for research published from 2006 onwards in databases including MEDLINE, EMBASE, PsycINFO, Cumulative Index to Nursing and Allied Health Literature, Science Citation Index, Social Science Citation Index and The Cochrane Library. We also searched relevant websites, screened reference lists and citation searched on a previous review.

Review methods

The identified evidence was synthesised in three ways. First, data from included studies were used to develop an evidence-based logic model, and a narrative summary reports the elements of the pathway. Second, we examined the strength of evidence underpinning reported outcomes and impacts using a comparative four-item rating system. Third, we developed an applicability framework to further scrutinise and characterise the evidence.

Results

We included 267 studies in the review. The findings detail the complex pathway from new models to impacts, with evidence regarding elements of new models of integrated care, targets for change, process change, influencing factors, service-level outcomes and system-wide impacts. A number of positive outcomes were reported in the literature, with stronger evidence of perceived increased patient satisfaction and improved quality of care and access to care. There was stronger UK-only evidence of reduced outpatient appointments and waiting times. Evidence was inconsistent regarding other outcomes and system-wide impacts such as levels of activity and costs. There was an indication that new models have particular potential with patients who have complex needs.

Limitations

Defining new models of integrated care is challenging, and there is the potential that our study excluded potentially relevant literature. The review was extensive, with diverse study populations and interventions that precluded the statistical summary of effectiveness.

Conclusions

There is stronger evidence that new models of integrated care may enhance patient satisfaction and perceived quality and increase access; however, the evidence regarding other outcomes is unclear. The study recommends factors to be considered during the implementation of new models.

Future work

Links between elements of new models and outcomes require further study, together with research in a wider variety of populations.

Study registration

This study is registered as PROSPERO CRD37725.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Intervention planning for the REDUCE maintenance intervention: a digital intervention to reduce reulceration risk among patients with a history of diabetic foot ulcers

OBJECTIVES

To develop a comprehensive intervention plan for the REDUCE maintenance intervention to support people who have had diabetic foot ulcers (DFUs) to sustain behaviours that reduce reulceration risk.

METHODS

Theory-based, evidence-based and person-based approaches to intervention development were used. In phase I of intervention planning, evidence was collated from a scoping review of the literature and qualitative interviews with patients who have had DFUs (n=20). This was used to identify the psychosocial needs and challenges of this population and barriers and facilitators to the intervention's target behaviours: regular foot checking, rapid self-referral in the event of changes in foot health, graded and regular physical activity and emotional management. In phase II, this evidence was combined with expert consultation to develop the intervention plan. Brief 'guiding principles' for shaping intervention development were created. 'Behavioural analysis' and 'logic modelling' were used to map intervention content onto behaviour change theory to comprehensively describe the intervention and its hypothesised mechanisms.

RESULTS

Key challenges to the intervention's target behaviours included patients' uncertainty regarding when to self-refer, physical limitations affecting foot checking and physical activity and, for some, difficulties managing negative emotions. Important considerations for the intervention design included a need to increase patients' confidence in making a self-referral and in using the maintenance intervention and a need to acknowledge that some intervention content might be relevant to only some patients (emotional management, physical activity). The behavioural analysis identified the following processes hypothesised to facilitate long-term behaviour maintenance including increasing patients' skills, self-efficacy, knowledge, positive outcome expectancies, sense of personal control, social support and physical opportunity.

CONCLUSIONS

This research provides a transparent description of the intervention planning for the REDUCE maintenance intervention. It provides insights into potential barriers and facilitators to the target behaviours and potentially useful behaviour change techniques to use in clinical practice.

Searching for the Impact of Participation in Health and Health Research: Challenges and Methods

Internationally, the interest in involving patients and the public in designing and delivering health interventions and researching their effectiveness is increasing. Several systematic reviews of participation in health research have recently been completed, which note a number of challenges in documenting the impact of participation. Challenges include working across stakeholders with different understandings of participation and levels of experience in reviewing; comparing heterogeneous populations and contexts; configuring findings from often thin descriptions of participation in academic papers; and dealing with different definitions of impact. This paper aims to advance methods for systematically reviewing the impact of participation in health research, drawing on recent systematic review guidance. Practical examples for dealing with issues at each stage of a review are provided based on recent experience. Recommendations for improving primary research on participation in health are offered and key points to consider during the review are summarised.

The effects of integrated care: a systematic review of UK and international evidence

BACKGROUND

Healthcare systems around the world have been responding to the demand for better integrated models of service delivery. However, there is a need for further clarity regarding the effects of these new models of integration, and exploration regarding whether models introduced in other care systems may achieve similar outcomes in a UK national health service context.

METHODS

The study aimed to carry out a systematic review of the effects of integration or co-ordination between healthcare services, or between health and social care on service delivery outcomes including effectiveness, efficiency and quality of care. Electronic databases including MEDLINE; Embase; PsycINFO; CINAHL; Science and Social Science Citation Indices; and the Cochrane Library were searched for relevant literature published between 2006 to March 2017. Online sources were searched for UK grey literature, and citation searching, and manual reference list screening were also carried out. Quantitative primary studies and systematic reviews, reporting actual or perceived effects on service delivery following the introduction of models of integration or co-ordination, in healthcare or health and social care settings in developed countries were eligible for inclusion. Strength of evidence for each outcome reported was analysed and synthesised using a four point comparative rating system of stronger, weaker, inconsistent or limited evidence.

RESULTS

One hundred sixty seven studies were eligible for inclusion. Analysis indicated evidence of perceived improved quality of care, evidence of increased patient satisfaction, and evidence of improved access to care. Evidence was rated as either inconsistent or limited regarding all other outcomes reported, including system-wide impacts on primary care, secondary care, and health care costs. There were limited differences between outcomes reported by UK and international studies, and overall the literature had a limited consideration of effects on service users.

CONCLUSIONS

Models of integrated care may enhance patient satisfaction, increase perceived quality of care, and enable access to services, although the evidence for other outcomes including service costs remains unclear. Indications of improved access may have important implications for services struggling to cope with increasing demand.

TRIAL REGISTRATION

Prospero registration number: 42016037725 .

Engagement of stakeholders in the development of a Theory of Change for handwashing and sanitation behaviour change

A Theory of Change (ToC) is an approach to map programmes aimed at inducing change in a specific context, with the goal of increasing their impact. We applied this approach to the specific case of handwashing and sanitation practices in low- and middle-income countries and developed a ToC as part of a systematic review exercise. Different existing sources of information were used to inform the initial draft of the ToC. In addition, stakeholder involvement occurred and peer review took place. Our stakeholders included methodological (ToC/quantitative and qualitative research) and content experts (WASH (Water, Sanitation, Hygiene)/behaviour change), as well as end-users/practitioners, policy-makers and donors. In conclusion, the development of a ToC, and the involvement of stakeholders in its development, was critical in terms of understanding the context in which the promotional programmes are being implemented. We recommend ToC developers to work with stakeholders to create a ToC relevant for practice.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 2: methods for question formulation, searching, and protocol development for qualitative evidence synthesis

This paper updates previous Cochrane guidance on question formulation, searching, and protocol development, reflecting recent developments in methods for conducting qualitative evidence syntheses to inform Cochrane intervention reviews. Examples are used to illustrate how decisions about boundaries for a review are formed via an iterative process of constructing lines of inquiry and mapping the available information to ascertain whether evidence exists to answer questions related to effectiveness, implementation, feasibility, appropriateness, economic evidence, and equity. The process of question formulation allows reviewers to situate the topic in relation to how it informs and explains effectiveness, using the criterion of meaningfulness, appropriateness, feasibility, and implementation. Questions related to complex questions and interventions can be structured by drawing on an increasingly wide range of question frameworks. Logic models and theoretical frameworks are useful tools for conceptually mapping the literature to illustrate the complexity of the phenomenon of interest. Furthermore, protocol development may require iterative question formulation and searching. Consequently, the final protocol may function as a guide rather than a prescriptive route map, particularly in qualitative reviews that ask more exploratory and open-ended questions.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing.

Increasing value and reducing waste by optimizing the development of complex interventions: Enriching the development phase of the Medical Research Council (MRC) Framework

BACKGROUND

In recent years there has been much emphasis on 'research waste' caused by poor question selection, insufficient attention to previous research results, and avoidable weakness in research design, conduct and analysis. Little attention has been paid to the effect of inadequate development of interventions before proceeding to a full clinical trial.

OBJECTIVE

We therefore propose to enrich the development phase of the MRC Framework by adding crucial elements to improve the likelihood of success and enhance the fit with clinical practice METHODS: Based on existing intervention development guidance and synthesis, a comprehensive iterative intervention development approach is proposed. Examples from published reports are presented to illustrate the methodology that can be applied within each element to enhance the intervention design.

RESULTS

A comprehensive iterative approach is presented by combining the elements of the MRC Framework development phase with essential elements from existing guidance including: problem identification, the systematic identification of evidence, identification or development of theory, determination of needs, the examination of current practice and context, modelling the process and expected outcomes leading to final element: the intervention design. All elements are drawn from existing models to provide intervention developers with a greater chance of producing an intervention that is well adopted, effective and fitted to the context.

CONCLUSION

This comprehensive approach of developing interventions will strengthen the internal and external validity, minimize research waste and add value to health care research. In complex interventions in health care research, flaws in the development process immediately impact the chances of success. Knowledge regarding the causal mechanisms and interactions within the intended clinical context is needed to develop interventions that fit daily practice and are beneficial for the end-user.

Intervention planning for a digital intervention for self-management of hypertension: a theory-, evidence- and person-based approach

Background

This paper describes the intervention planning process for the Home and Online Management and Evaluation of Blood Pressure (HOME BP), a digital intervention to promote hypertension self-management. It illustrates how a Person-Based Approach can be integrated with theory- and evidence-based approaches. The Person-Based Approach to intervention development emphasises the use of qualitative research to ensure that the intervention is acceptable, persuasive, engaging and easy to implement.

Methods

Our intervention planning process comprised two parallel, integrated work streams, which combined theory-, evidence- and person-based elements. The first work stream involved collating evidence from a mixed methods feasibility study, a systematic review and a synthesis of qualitative research. This evidence was analysed to identify likely barriers and facilitators to uptake and implementation as well as design features that should be incorporated in the HOME BP intervention. The second work stream used three complementary approaches to theoretical modelling: developing brief guiding principles for intervention design, causal modelling to map behaviour change techniques in the intervention onto the Behaviour Change Wheel and Normalisation Process Theory frameworks, and developing a logic model.

Results

The different elements of our integrated approach to intervention planning yielded important, complementary insights into how to design the intervention to maximise acceptability and ease of implementation by both patients and health professionals. From the primary and secondary evidence, we identified key barriers to overcome (such as patient and health professional concerns about side effects of escalating medication) and effective intervention ingredients (such as providing in-person support for making healthy behaviour changes). Our guiding principles highlighted unique design features that could address these issues (such as online reassurance and procedures for managing concerns). Causal modelling ensured that all relevant behavioural determinants had been addressed, and provided a complete description of the intervention. Our logic model linked the hypothesised mechanisms of action of our intervention to existing psychological theory.

Conclusion

Our integrated approach to intervention development, combining theory-, evidence- and person-based approaches, increased the clarity, comprehensiveness and confidence of our theoretical modelling and enabled us to ground our intervention in an in-depth understanding of the barriers and facilitators most relevant to this specific intervention and user population.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-017-0553-4) contains supplementary material, which is available to authorized users.

Factors that impact on the use of mechanical ventilation weaning protocols in critically ill adults and children: a qualitative evidence-synthesis

BACKGROUND

Prolonged mechanical ventilation is associated with a longer intensive care unit (ICU) length of stay and higher mortality. Consequently, methods to improve ventilator weaning processes have been sought. Two recent Cochrane systematic reviews in ICU adult and paediatric populations concluded that protocols can be effective in reducing the duration of mechanical ventilation, but there was significant heterogeneity in study findings. Growing awareness of the benefits of understanding the contextual factors impacting on effectiveness has encouraged the integration of qualitative evidence syntheses with effectiveness reviews, which has delivered important insights into the reasons underpinning (differential) effectiveness of healthcare interventions.

OBJECTIVES

1. To locate, appraise and synthesize qualitative evidence concerning the barriers and facilitators of the use of protocols for weaning critically-ill adults and children from mechanical ventilation;2. To integrate this synthesis with two Cochrane effectiveness reviews of protocolized weaning to help explain observed heterogeneity by identifying contextual factors that impact on the use of protocols for weaning critically-ill adults and children from mechanical ventilation;3. To use the integrated body of evidence to suggest the circumstances in which weaning protocols are most likely to be used.

SEARCH METHODS

We used a range of search terms identified with the help of the SPICE (Setting, Perspective, Intervention, Comparison, Evaluation) mnemonic. Where available, we used appropriate methodological filters for specific databases. We searched the following databases: Ovid MEDLINE, Embase, OVID, PsycINFO, CINAHL Plus, EBSCOHost, Web of Science Core Collection, ASSIA, IBSS, Sociological Abstracts, ProQuest and LILACS on the 26th February 2015. In addition, we searched: the grey literature; the websites of professional associations for relevant publications; and the reference lists of all publications reviewed. We also contacted authors of the trials included in the effectiveness reviews as well as of studies (potentially) included in the qualitative synthesis, conducted citation searches of the publications reporting these studies, and contacted content experts.We reran the search on 3rd July 2016 and found three studies, which are awaiting classification.

SELECTION CRITERIA

We included qualitative studies that described: the circumstances in which protocols are designed, implemented or used, or both, and the views and experiences of healthcare professionals either involved in the design, implementation or use of weaning protocols or involved in the weaning of critically-ill adults and children from mechanical ventilation not using protocols. We included studies that: reflected on any aspect of the use of protocols, explored contextual factors relevant to the development, implementation or use of weaning protocols, and reported contextual phenomena and outcomes identified as relevant to the effectiveness of protocolized weaning from mechanical ventilation.

DATA COLLECTION AND ANALYSIS

At each stage, two review authors undertook designated tasks, with the results shared amongst the wider team for discussion and final development. We independently reviewed all retrieved titles, abstracts and full papers for inclusion, and independently extracted selected data from included studies. We used the findings of the included studies to develop a new set of analytic themes focused on the barriers and facilitators to the use of protocols, and further refined them to produce a set of summary statements. We used the Confidence in the Evidence from Reviews of Qualitative Research (CERQual) framework to arrive at a final assessment of the overall confidence of the evidence used in the synthesis. We included all studies but undertook two sensitivity analyses to determine how the removal of certain bodies of evidence impacted on the content and confidence of the synthesis. We deployed a logic model to integrate the findings of the qualitative evidence synthesis with those of the Cochrane effectiveness reviews.

MAIN RESULTS

We included 11 studies in our synthesis, involving 267 participants (one study did not report the number of participants). Five more studies are awaiting classification and will be dealt with when we update the review.The quality of the evidence was mixed; of the 35 summary statements, we assessed 17 as 'low', 13 as 'moderate' and five as 'high' confidence. Our synthesis produced nine analytical themes, which report potential barriers and facilitators to the use of protocols. The themes are: the need for continual staff training and development; clinical experience as this promotes felt and perceived competence and confidence to wean; the vulnerability of weaning to disparate interprofessional working; an understanding of protocols as militating against a necessary proactivity in clinical practice; perceived nursing scope of practice and professional risk; ICU structure and processes of care; the ability of protocols to act as a prompt for shared care and consistency in weaning practice; maximizing the use of protocols through visibility and ease of implementation; and the ability of protocols to act as a framework for communication with parents.

AUTHORS' CONCLUSIONS

There is a clear need for weaning protocols to take account of the social and cultural environment in which they are to be implemented. Irrespective of its inherent strengths, a protocol will not be used if it does not accommodate these complexities. In terms of protocol development, comprehensive interprofessional input will help to ensure broad-based understanding and a sense of 'ownership'. In terms of implementation, all relevant ICU staff will benefit from general weaning as well as protocol-specific training; not only will this help secure a relevant clinical knowledge base and operational understanding, but will also demonstrate to others that this knowledge and understanding is in place. In order to maximize relevance and acceptability, protocols should be designed with the patient profile and requirements of the target ICU in mind. Predictably, an under-resourced ICU will impact adversely on protocol implementation, as staff will prioritize management of acutely deteriorating and critically-ill patients.

Health Information Technologies-Academic and Commercial Evaluation (HIT-ACE) methodology: description and application to clinical feedback systems

Background

Health information technologies (HIT) have become nearly ubiquitous in the contemporary healthcare landscape, but information about HIT development, functionality, and implementation readiness is frequently siloed. Theory-driven methods of compiling, evaluating, and integrating information from the academic and commercial sectors are necessary to guide stakeholder decision-making surrounding HIT adoption and to develop pragmatic HIT research agendas. This article presents the Health Information Technologies—Academic and Commercial Evaluation (HIT-ACE) methodology, a structured, theory-driven method for compiling and evaluating information from multiple sectors. As an example demonstration of the methodology, we apply HIT-ACE to mental and behavioral health measurement feedback systems (MFS). MFS are a specific class of HIT that support the implementation of routine outcome monitoring, an evidence-based practice.

Results

HIT-ACE is guided by theories and frameworks related to user-centered design and implementation science. The methodology involves four phases: (1) coding academic and commercial materials, (2) developer/purveyor interviews, (3) linking putative implementation mechanisms to hit capabilities, and (4) experimental testing of capabilities and mechanisms. In the current demonstration, phase 1 included a systematic process to identify MFS in mental and behavioral health using academic literature and commercial websites. Using user-centered design, implementation science, and feedback frameworks, the HIT-ACE coding system was developed, piloted, and used to review each identified system for the presence of 38 capabilities and 18 additional characteristics via a consensus coding process. Bibliometic data were also collected to examine the representation of the systems in the scientific literature. As an example, results are presented for the application of HIT-ACE phase 1 to MFS wherein 49 separate MFS were identified, reflecting a diverse array of characteristics and capabilities.

Conclusions

Preliminary findings demonstrate the utility of HIT-ACE to represent the scope and diversity of a given class of HIT beyond what can be identified in the academic literature. Phase 2 data collection is expected to confirm and expand the information presented and phases 3 and 4 will provide more nuanced information about the impact of specific HIT capabilities. In all, HIT-ACE is expected to support adoption decisions and additional HIT development and implementation research.