Logic model framework for considering the inputs, processes and outcomes of a healthcare organisation-research partnership

Development of the Prevention of Suicide Behaviour in Prisons: Enhancing Access to Therapy (PROSPECT) logic model and implementation strategies

AIMS AND METHOD

This study aimed to develop and articulate a logic model and programme theories for implementing a new cognitive-behavioural suicide prevention intervention for men in prison who are perceived to be at risk of death by suicide. Semi-structured one-to-one interviews with key stakeholders and a combination of qualitative analysis techniques were used to develop programme theories.

RESULTS

Interviews with 28 stakeholders resulted in five programme theories, focusing on: trust, willingness and engagement; readiness and ability; assessment and formulation; practitioner delivering the 'change work' stage of the intervention face-to-face in a prison environment; and practitioner training, integrating the intervention and onward care. Each theory provides details of what contextual factors need to be considered at each stage, and what activities can facilitate achieving the intended outcomes of the intervention, both intermediate and long term.

CLINICAL IMPLICATIONS

The PROSPECT implementation strategy developed from the five theories can be adapted to different situations and environments.

A Framework for Quantifying the Strength of Partnerships between Agricultural Cooperatives and Development Actors: A Case Study in Saudi Arabia

The issue of the agricultural cooperatives' sustainability in developing their businesses is gaining increasing prominence. Building partnerships between development actors and agricultural cooperatives has been considered an effective strategy for supporting financial capital and addressing sustainability issues collectively. Therefore, this study aimed to address the features and strengths of 33 partnerships established between the Beekeeping Cooperative Association in Al-Baha, Saudi Arabia, and other actors between 2016 and 2021. The analysis of the collaborations was based on six criteria: motivations, partnership planning, outputs, governance practices, outcomes, and sustainability of a partnership. Furthermore, we developed a weighted scoring model to control variable selection and submit the strength of each partnership. The findings indicated that most collaborations (45.5%) were signed with the private sector. Furthermore, the honey value chain development was the most frequent reason (69.7%) attracting the partners to engage in the partnerships. Some of the most critical environmental objectives targeted by the partnerships examined were enhancing bee habitat by the diversification of pasture species, management to increase the flowering period, and proper grazing management. All partners achieved their individual goals jointly in 54.5% of the partnerships analyzed. In terms of a partnership's strength, the findings also revealed that only three partnerships (9.1%) were characterized as strong partnerships. This study provides a better understanding of how agricultural cooperatives collaborate with other actors and a basis for assessing the strength of the partnerships. Such information is crucial for developing relevant policies to encourage cooperatives to engage in future sustainability partnerships.

Impact of Point of Care Quality Improvement Training and Coaching on Quality Perceptions of Health Care Workers: Implication for Quality Policy

Background

The quality of infant healthcare service is one of the essential factors in preventing infant mortality. The purpose of the study was to analyze the quality performance in primary healthcare centers (PHC) and hospitals before and after the point of care quality improvement (POCQI) training for Infant Healthcare Services (IHS).

Methods

This is a mixed-method study design with convergence triangulation strategy, conducted at six public PHCs and four hospitals in two districts of West Java Province, Indonesia. One hundred health care workers (HCWs) were involved for quantitative study at baseline and end of intervention. An additional 40 patients participated as informants for qualitative study. Quantitative data analysis was performed by Rasch modeling and independent t-test for all variables, followed by content analysis for qualitative data.

Results

There were significant changes in the variables of POCQI skill (mean diff: 5.14, p=0.001), quality improvement (QI) understanding (mean diff: 1.2; p=0.001), and QI engagement (mean diff: 1.7; p=0.001) in the PHC group. Although there was an increase in process and outcome variables, the changes were not significant. There was a significant change in all variables in the hospital group which were outcome (mean diff: 2.32 (p=0.19); POCQI skill (mean diff: 2.80, p=0.001); process (mean diff: 1.48, p= 0.01); QI understanding (mean diff: 1.01; p=0.01), and QI engagement (mean diff: 1.52; p=0.03). Patient perception in the qualitative study showed that PHCs and Hospitals’ services improved. Moreover, health care workers found they have a better understanding of service quality and created quality changes and improved POCQI steps.

Conclusion

Implementation of POCQI in PHC and hospitals improved the performance of the quality of his, therefore assuring that POCQI is an appropriate approach and tool to be adopted in the policy for strengthening the health system.

Opportunities and Challenges When Using the Electronic Health Record for Practice-Integrated Patient-Facing Interventions: The e-Assist Colon Health Randomized Trial

Background

Even after a physician recommendation, many people remain unscreened for colorectal cancer (CRC). The proliferation of electronic health records (EHRs) and tethered online portals may afford new opportunities to embed patient-facing interventions within clinic workflows and engage patients following a physician recommendation for care. We evaluated the effectiveness of a patient-facing intervention designed to complement physician office-based recommendations for CRC screening.

Design

Using a 2-arm pragmatic, randomized clinical trial, we evaluated the intervention’s effect on CRC screening use as documented in the EHR (primary outcome) and the extent to which the intervention reached the target population. Trial participants were insured, aged 50 to 75 y, with a physician recommendation for CRC screening. Typical EHR functionalities, including patient registries, health maintenance flags, best practice alerts, and secure messaging, were used to support research-related activities and deliver the intervention to enrolled patients.

Results

A total of 1,825 adults consented to trial participation, of whom 78% completed a baseline survey and were exposed to the intervention. Most trial participants (>80%) indicated an intent to be screened on the baseline survey, and 65% were screened at follow-up, with no significant differences by study arm. One-third of eligible patients were sent a secure message. Among those, more than three-quarters accessed study material.

Conclusions

By leveraging common EHR functionalities, we integrated a patient-facing intervention within clinic workflows. Despite practice integration, the intervention did not improve screening use, likely in part due to portal-based interventions not reaching those for whom the intervention may be most effective.

Implications

Embedding patient-facing interventions within the EHR enabled practice integration but may minimize program effectiveness by missing important segments of the patient population.

Highlights

Development of a national health policy logic model to accelerate the integration of oncology and palliative care: a nationwide Delphi survey in Japan

BACKGROUND

Despite recommendations to deliver palliative care to cancer patients and their caregivers, their distress has not been alleviated satisfactorily. National health policies play a pivotal role in achieving a comprehensive range of quality palliative care delivery for the public. However, there is no standardised logic model to appraise the efficacy of these policies. This study aimed to develop a logic model of a national health policy to deliver cancer palliative care and to reach consensus towards specific policy proposals.

METHODS

A draft version of the logic model and specific policy proposals were formulated by the research team and the internal expert panel, and the independent external expert panel evaluated the policy proposals based on the Delphi survey to reach consensus.

RESULTS

The logic model was divided into three major conceptual categories: 'care-delivery at cancer hospitals', 'community care coordination', and 'social awareness of palliative care'. There were 18 and 45 major and minor policy proposals, which were categorised into four groups: requirement of government-designated cancer hospitals; financial support; Basic Plan to Promote Cancer Control Programs; and others. These policy proposals were independently evaluated by 64 external experts and the first to third Delphi round response rates were 96.9-98.4%. Finally, 47 policy proposals reached consensus. The priority of each proposal was evaluated within the four policy groups.

CONCLUSIONS

A national health policy logic model was developed to accelerate the provision of cancer palliative care. Further research is warranted to verify the study design to investigate the efficacy of the logic model.

International, national and local trends in the spread of COVID-19: a geographic view of COVID-19 spread and the role to be played by coproduction

BACKGROUND

COVID-19, a respiratory disease caused by the SARS-CoV-2 virus, emerged in 2019 and led to a worldwide pandemic in 2020. The COVID-19 pandemic has been a massive natural experiment in the formation of mitigation strategies to prevent cases and to provide effective healthcare for those afflicted. Regional differences in the impact of the pandemic on morbidity and mortality have been driven by political and regional differences in the coproduction of public health and social policy. We explored the United States (US) experience of COVID-19 for trends and correlations with other nations and also at the national, regional, state and local levels.

OBJECTIVE

To identify geographic and temporal trends in the spread of COVID-19 in the United States.

METHODS

Population data on COVID-19 cases and mortality were acquired on a daily basis from multiple publicly available databases, including the New York Times and Johns Hopkins University. At each geographic level (national, state and county), geographic entities' reported cases were evaluated for correlations using linear least-squares methods to identify patterns of correlation in the cases independent of scale. We evaluated for two specific characteristics: (i) the nature of the curvature of the line linking across percentile scores, ranging from concave to convex and (ii) the area under this curve, indicating how effectively a selected region (nation, state and county) is linked to its entire containing unit (world, country and state). We used this approach to identify three distinct COVID behavior phenotypes, each of which consisted of a number of states in the USA.

RESULTS

We found that COVID activity in the USA follows a unique trend compared to other countries and that within the USA during the first year of the pandemic, three initial COVID phenotypes emerged: (i) the metropolitan outbreak (early outbreak phenotype); (ii) the regional outbreak (summer peak phenotype) and (iii) trans-regional outbreak (fall/winter peak phenotype), which, taken in sum, represent the overall USA national trend. Each phenotype has specific behavioral characteristics and is composed of a cluster of different states experiencing different conditions.

CONCLUSION

Our findings suggest a new opportunity for public health strategy in the pandemic, namely to apply targeted public health approaches to address the specific needs of each phenotype. In the future, we should create databases that capture key health and hardship data elements at the smallest geographic level possible and use these to track trends, predict the future and apply targeted coproduction approaches to more effectively and efficiently safeguard population health, economic vitality and social well-being.

A realist evaluation of a collaborative model to support research co-production in long-term care settings in England: the ExCHANGE protocol

BACKGROUND

Collaborative working between academic institutions and those who provide health and social care has been identified as integral in order to produce acceptable, relevant, and timely research, and for outputs to be useful and practical to implement. The ExCHANGE Collaboration aims to bring together researchers and people working, living in and visiting care homes to build capacity, share and mobilise knowledge, and identify key areas for future research. This paper describes an embedded, formative, realist and theory-driven evaluation which aims to gather information about how successful the ExCHANGE Collaboration is perceived to be in achieving its aims. An existing realist programme theory from the literature - Closer Collaboration - will be supplemented by two substantive theories: Co-production and Knowledge Brokering. This will result in an initial programme theory which will be tested by this formative evaluation to refine understanding of how the ExCHANGE Collaboration works.

METHODS

The evaluation will employ mixed qualitative methods, including: analysis of documents such as feedback forms, Knowledge Broker journal/diary, event attendance records, risk and issues logs and other relevant paperwork gathered as part of project delivery; observations of events/activities; and interviews with care home providers and staff, care home residents, residents' family members, and researchers who are involved in the project (both project design/delivery, and also attendance or involvement in project activities/events). Framework Analysis will be used to interpret the data collected; analysis will be strategic, by focusing on particular key areas of importance in the developing theory of how the ExCHANGE Collaboration might achieve change.

RESULTS

The results of this study are expected to be published in 2022.

DISCUSSION

This evaluation will investigate how successful the ExCHANGE Collaboration is perceived to be in achieving its aims, in what way, in which contexts, and how this may differ for those involved. It will do this by testing an initial programme theory about how the collaboration works, for whom, under which circumstances, and in what way. Findings will be shared through written publication, an end of project learning event for those involved/interested in the project, and a lay summary to be made publically available.

Conceptualizing researchers' perspectives on involving professionals in research: a group concept mapping study

BACKGROUND

Researchers have shown an increased interest in involving professionals from outside academia in research projects. Professionals are often involved in research on ageing and health when the purpose is to address the gap between research and practice. However, there is a need to acquire more knowledge about what the involvement might lead to by exploring researchers' experiences of involving professionals in research on ageing and health and developing conceptual areas. Therefore, the aim of this study was to identify conceptual areas of professionals' involvement in research on ageing and health, from the perspective of researchers themselves.

METHODS

Group concept mapping, a participatory and mixed method, was used to conceptualize areas. Researchers with experience of involving professionals in research projects on ageing and health participated in qualitative data collection through brainstorming sessions (n = 26), and by sorting statements (n = 27). They then took part in quantitative data collection, where they rated statements according to how much a statement strengthened research (n = 26) and strengthened practice (n = 24). Data were analysed using multidimensional scaling analysis and hierarchical cluster analysis. In addition, a qualitative analysis of the latent meaning of the cluster map was conducted.

RESULTS

Analysis of the sorting stage generated five clusters illustrating conceptual areas of professionals' involvement in research projects on ageing and health. The five clusters are as follows: complex collaboration throughout the research process; adaptation of research to different stakeholders, mutual learning through partnership; applicable and sustainable knowledge; legitimate research on ageing and health. The qualitative latent meaning of the cluster map showed two themes: the process of involvement and the outcome of involvement. A positive strong correlation (0.87) was found between the rating of strengthened research and practice.

CONCLUSIONS

This study reveals conceptual areas on a comprehensive and illustrative map which contributes to the understanding of professionals' involvement in research on ageing and health. A conceptual basis for further studies is offered, where the aim is to investigate the processes and outcomes entailed in involving professionals in research on ageing and health. The study also contributes to the development of instruments and theories for optimizing the involvement of professionals in research.

Pharmaceutical industry, academia and people with experience of mental illness as partners in research: a need for ethical guidance

Background: Several social and policy developments have led to research partnerships in mental health research, which depart from traditional research models. One form of such partnerships is among Research institutions, Industry (pharmaceutical and biotech) and People with lived experience of mental illness (RIPs) in the NIHR services. There are several benefits but also challenges in such partnerships. An ethics-based approach to anticipating and addressing such problems is lacking. Given the expansion of RIPs in treatment development for mental health illness, guidance to support ethical and effective collaborations in NIHR-funded mental health research is essential. Methods: To develop a moral framework for evaluating the ethics of RIPs, we systematically searched PubMed for peer-reviewed literature discussing good practices in research partnerships. Searches were also conducted in websites of known organizations supporting patient engagement with industry in mental health research and in the references of short-listed articles. Following application of exclusion criteria, remaining articles were critically examined and summarised to synthesise principles for ethical RIPs and inform clear guidance and practices. Results: Critical analysis and synthesis of the short-listed articles highlighted the need for two sets of principles to guide ethical RIPs: principles for (a) RIPs as a trustworthy enterprise and (b) fair RIPs. We discuss the application of these principles in problem-solving strategies that can support best practice in establishing fair and effective research partnerships among research institutions, industry and people with lived experience of mental illness in the NIHR services. Conclusions: Ethical guidance is needed to prevent and address challenges in RIPs and to promote the scientific and social benefits of these new research partnership models in mental health research in the NIHR services. We show how the proposed moral framework can guide research partners in designing, sustaining and assessing ethical and effective mental health research collaborations.

Seeding Structures for a Community of Practice Focused on Transient Ischemic Attack (TIA): Implementing Across Disciplines and Waves

BACKGROUND

The Community of Practice (CoP) model represents one approach to address knowledge management to support effective implementation of best practices.

OBJECTIVE

We sought to identify CoP developmental strategies within the context of a national quality improvement project focused on improving the quality for patients receiving acute transient ischemic attack (TIA) care.

DESIGN

Stepped wedge trial.

PARTICIPANTS

Multidisciplinary staff at six Veterans Affairs medical facilities.

INTERVENTIONS

To encourage site implementation of a multi-component quality improvement intervention, the trial included strategies to improve the development of a CoP: site kickoff meetings, CoP conference calls, and an interactive website (the "Hub").

APPROACH

Mixed-methods evaluation included data collected through a CoP attendance log; semi-structured interviews with site participants at 6 months (n = 32) and 12 months (n = 30), and CoP call facilitators (n = 2); and 22 CoP call debriefings.

KEY RESULTS

The critical seeding structures that supported the cultivation of the CoP were the kickoffs which fostered relationships (key to the community element of CoPs) and provided the evidence base relevant to TIA care (key to the domain element of CoPs). The Hub provided the forum for sharing quality improvement plans and other tools which were further highlighted during the CoP calls (key to the practice element of CoPs). CoP calls were curated to create a positive context around participants' work by recognizing team successes. In addition to improving care at their local facilities, the community created a shared set of tools which built on their collective knowledge and could be shared within and outside the group.

CONCLUSIONS

The PREVENT CoP advanced the mission of the learning healthcare system by successfully providing a forum for shared learning. The CoP was grown through seeding structures that included kickoffs, CoP calls, and the Hub. A CoP expands upon the learning collaborative implementation strategy as an effective implementation practice.

Pharmaceutical industry, academia and people with experience of mental illness as partners in research: a need for ethical guidance

Background: Several social and policy developments have led to research partnerships in mental health research, which depart from traditional research models. One form of such partnerships is among research institutions, industry (pharmaceutical and biotech) and people with lived experience of mental illness (RIPs). There are several benefits but also ethical challenges in RIPs. An ethics-based approach to anticipating and addressing such ethical issues in mental health research is lacking. Given the expansion of RIPs in treatment development for mental health illness, guidance to support ethical and trustworthy collaborative mental health research projects is essential. Methods: To develop a moral framework for evaluating the ethics of RIPs, we systematically searched PubMed for peer-reviewed literature discussing good practices in research partnerships. Searches were also conducted in websites of known organizations supporting patient engagement with industry in mental health research and in the references of short-listed articles. Following application of exclusion criteria, remaining articles were critically examined and summarised to synthesise principles for ethically acceptable RIPs and inform clear guidance and practices. Results: Critical analysis and synthesis of the short-listed articles highlighted the need for two sets of principles to guide ethical RIPs: principles for (a) RIPs as a trustworthy enterprise (e.g. public accountability, transparency) and (b) fair RIPs (e.g. effective governance, respect). We discuss the application of these principles in problem-solving strategies that can support best practice in establishing fair and successful mental health research partnerships among research institutions, industry and people with lived experience of mental illness. Conclusions: Ethical guidance is needed to prevent and address challenges in RIPs and to promote the scientific and social benefits of these new research partnership models in mental health research. We show how the proposed moral framework can guide research partners in designing, sustaining and assessing ethical and trustworthy collaborative mental health research projects.

Evaluating stakeholder involvement in building a decision support tool for NHS health checks: co-producing the WorkHORSE study

Background

Stakeholder engagement is being increasingly recognised as an important way to achieving impact in public health. The WorkHORSE (Working Health Outcomes Research Simulation Environment) project was designed to continuously engage with stakeholders to inform the development of an open access modelling tool to enable commissioners to quantify the potential cost-effectiveness and equity of the NHS Health Check Programme.

An objective of the project was to evaluate the involvement of stakeholders in co-producing the WorkHORSE computer modelling tool and examine how they perceived their involvement in the model building process and ultimately contributed to the strengthening and relevance of the modelling tool.

Methods

We identified stakeholders using our extensive networks and snowballing techniques. Iterative development of the decision support modelling tool was informed through engaging with stakeholders during four workshops. We used detailed scripts facilitating open discussion and opportunities for stakeholders to provide additional feedback subsequently. At the end of each workshop, stakeholders and the research team completed questionnaires to explore their views and experiences throughout the process.

Results

30 stakeholders participated, of which 15 attended two or more workshops. They spanned local (NHS commissioners, GPs, local authorities and academics), third sector and national organisations including Public Health England.

Stakeholders felt valued, and commended the involvement of practitioners in the iterative process. Major reasons for attending included: being able to influence development, and having insight and understanding of what the tool could include, and how it would work in practice. Researchers saw the process as an opportunity for developing a common language and trust in the end product, and ensuring the support tool was transparent. The workshops acted as a reality check ensuring model scenarios and outputs were relevant and fit for purpose.

Conclusions

Computational modellers rarely consult with end users when developing tools to inform decision-making. The added value of co-production (continuing collaboration and iteration with stakeholders) enabled modellers to produce a “real-world” operational tool. Likewise, stakeholders had increased confidence in the decision support tool’s development and applicability in practice.