Developing a framework to evaluate knowledge into action interventions

Ensuring best practice in genomics education: A theory- and empirically informed evaluation framework

Implementation of genomic medicine into healthcare requires a workforce educated through effective educational approaches. However, ascertaining the impact of genomics education activities or resources is limited by a lack of evaluation and inconsistent descriptions in the literature. We aim to support those developing genomics education to consider how best to capture evaluation data that demonstrate program outcomes and effectiveness within scope. Here, we present an evaluation framework that is adaptable to multiple settings for use by genomics educators with or without education or evaluation backgrounds. The framework was developed as part of a broader program supporting genomic research translation coordinated by the Australian Genomics consortium. We detail our mixed-methods approach involving an expert workshop, literature review and iterative expert input to reach consensus and synthesis of a new evaluation framework for genomics education. The resulting theory-informed and evidence-based framework encompasses evaluation across all stages of education program development, implementation and reporting, and acknowledges the critical role of stakeholders and the effects of external influences.

Creation of a globally informed and locally relevant KMC implementation model for population-impact in Amhara, Ethiopia

AIM

As part of a multi-country implementation trial, we tested a regionally specific model of kangaroo mother care (KMC). Effective KMC was defined as ≥8 h of newborn-caregiver skin-to-skin contact daily plus exclusive breast feeding. The study was designed to achieve ≥80+% effective KMC coverage at the population level.

METHODS

The Amhara KMC model was designed using global evidence, formative research in the region and input from government officials, clinicians, newborn families and global scientists. We optimised the initial model using continuous quality improvement with process feedback, outcome measurement and collaborative re-design. Outcomes from the evaluation period are reported.

RESULTS

At discharge, the final model resulted in a median of 16 h per day of skin-to-skin contact with 63% effective KMC coverage. Fifty-three percent sustained effective KMC to 7 days post-discharge.

CONCLUSIONS

It is possible to achieve high coverage (63%), high-quality KMC at public hospitals without prior KMC services using government-owned, multisectoral collaborative design. Targeted co-design, real-time data and customisation of KMC interventions with input from impacted stakeholders was critical in achieving high coverage and sustained quality.

Can co-created knowledge mobilisation interventions alter and enhance mindlines to improve childhood eczema care? A UK-based Social Impact Framework evaluation

OBJECTIVE

To evaluate the impact of using knowledge mobilisation interventions to alter and enhance mindlines and improve childhood eczema care.

DESIGN

The eczema mindlines study involved three stages: (1) mapping and confirming eczema mindlines, (2) intervention development and delivery and (3) analysis of intervention impact. The focus of this paper is on stage 3. Data analysis was guided by the Social Impact Framework to address the questions: (1) what is the impact of this study on individuals and groups? (2) what changes in behaviour and practice have occurred due to their involvement? (3) what mechanisms have enabled these impacts or changes to occur? and (4) what are the recommendations and questions arising from this research?

SETTINGS

A deprived inner-city neighbourhood in central England and national/international settings.

PARTICIPANTS

Patients, practitioners and wider community members exposed to the interventions locally, nationally and internationally.

RESULTS

Data revealed tangible multi-level, relational and intellectual impacts. Mechanisms supporting impact included: simplicity and consistency of messages adapted to audience, flexibility, opportunism and perseverance, personal interconnectivity and acknowledgement of emotion. Co-created knowledge mobilisation strategies to alter and enhance mindlines mediated through knowledge brokering were effective in producing tangible changes in eczema care practice and self-management and in 'mainstreaming' childhood eczema in positive way across communities. These changes cannot be directly attributed to the knowledge mobilisation interventions, however, the evidence points to the significant contribution made.

CONCLUSION

Co-created knowledge mobilisation interventions offer a valuable method of altering and enhancing eczema mindlines across lay-practitioner-wider society boundaries. The Social Impact Framework provides comprehensive method of understanding and documenting the complex web of impact occurring as a result of knowledge mobilisation. This approach is transferable to managing other long-term conditions.

Frameworks for selecting appropriate rural sanitation technology options in low- and middle-income countries: a critical review

Several rural technology options exist on the sanitation market with different characteristics, yet project failures in some developing countries were attributable to inappropriate technology choices. Frameworks that are used to select sanitation technology options (hard copy, computer programmes) were developed by researchers and project implementers. They vary in design and application as there is no standard format. This appears to create a gap between science and practice. Frameworks should have some key elements needed to select appropriate sanitation technologies. We evaluated 12 available frameworks (2000-2019) used to select sanitation technologies in rural communities of low- and middle-income countries against 22 assessment criteria derived from literature. Criteria that were not fully addressed by some of the reviewed frameworks (scores of 8-50%) included equity, sanitation demand, sanitation behaviour change, ongoing contact, replicability, framework limitations, personnel selection and flexibility. Addressing such limitations may assist in future framework development.

Knowledge Management Evaluation in British Higher Education Partnerships

The purpose of this research is to encourage higher education institutions working in partnerships to evaluate the development of partnerships not only on the basis of financial indicators but take into consideration the newly created knowledge as a result of social capital, monitoring and reviewing and continuing professional development of staff. The empirical data were collected through a survey instrument originally used for a PhD study. This research study provides a better understanding of the knowledge management evaluation stage of partnership development. Findings point out that although embedded knowledge management practices support social capital development, it is expected that higher education institutions could exploit their available knowledge to a greater extent in order to improve their impact on social capital in the context of partnership development. Research findings suggest that evaluation frameworks implemented and controlled by higher education institutions regulatory and governing bodies would benefit from particular inclusion within “assessment of performance” of Higher Education partnerships that specifically consider the social impact of partnership ventures. Knowledge management is a developing theme within academia, and findings imply that executives within higher education are committed to include knowledge management training in CPD strategies, as this not only benefits higher education institutions but will also benefit higher education partnership development. In terms of originality and value, this paper straightens the critical importance of knowledge management evaluation as part of the last stage of partnership development in order to advance in the understanding of the benefits deriving from higher education institutions partnerships. Students, scholars and practitioners of knowledge management can gather a range of insights pointed at performance and knowledge creation within a partnership context.