1
|
Nisselle A, Terrill B, Janinski M, Martyn M, Jordan H, Kaunein N, Metcalfe S, Gaff C. Ensuring best practice in genomics education: A theory- and empirically informed evaluation framework. Am J Hum Genet 2024; 111:1497-1507. [PMID: 38959883 PMCID: PMC11339609 DOI: 10.1016/j.ajhg.2024.06.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 06/12/2024] [Accepted: 06/13/2024] [Indexed: 07/05/2024] Open
Abstract
Implementation of genomic medicine into healthcare requires a workforce educated through effective educational approaches. However, ascertaining the impact of genomics education activities or resources is limited by a lack of evaluation and inconsistent descriptions in the literature. We aim to support those developing genomics education to consider how best to capture evaluation data that demonstrate program outcomes and effectiveness within scope. Here, we present an evaluation framework that is adaptable to multiple settings for use by genomics educators with or without education or evaluation backgrounds. The framework was developed as part of a broader program supporting genomic research translation coordinated by the Australian Genomics consortium. We detail our mixed-methods approach involving an expert workshop, literature review and iterative expert input to reach consensus and synthesis of a new evaluation framework for genomics education. The resulting theory-informed and evidence-based framework encompasses evaluation across all stages of education program development, implementation and reporting, and acknowledges the critical role of stakeholders and the effects of external influences.
Collapse
Affiliation(s)
- Amy Nisselle
- Australian Genomics Health Alliance, Melbourne, VIC, Australia; Genomics in Society, Murdoch Children's Research Institute, Melbourne, VIC, Australia; Department of Paediatrics, The University of Melbourne, Melbourne, VIC, Australia.
| | - Bronwyn Terrill
- Australian Genomics Health Alliance, Melbourne, VIC, Australia; Genomics in Society, Murdoch Children's Research Institute, Melbourne, VIC, Australia
| | - Monika Janinski
- Australian Genomics Health Alliance, Melbourne, VIC, Australia; Genomics in Society, Murdoch Children's Research Institute, Melbourne, VIC, Australia
| | - Melissa Martyn
- Genomics in Society, Murdoch Children's Research Institute, Melbourne, VIC, Australia; Department of Paediatrics, The University of Melbourne, Melbourne, VIC, Australia; Melbourne Genomics Health Alliance, Melbourne, VIC, Australia
| | - Helen Jordan
- Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, VIC, Australia
| | - Nadia Kaunein
- Australian Genomics Health Alliance, Melbourne, VIC, Australia; Genomics in Society, Murdoch Children's Research Institute, Melbourne, VIC, Australia; Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, VIC, Australia; Melbourne Dental School, The University of Melbourne, Melbourne, VIC, Australia
| | - Sylvia Metcalfe
- Australian Genomics Health Alliance, Melbourne, VIC, Australia; Genomics in Society, Murdoch Children's Research Institute, Melbourne, VIC, Australia; Department of Paediatrics, The University of Melbourne, Melbourne, VIC, Australia
| | - Clara Gaff
- Australian Genomics Health Alliance, Melbourne, VIC, Australia; Genomics in Society, Murdoch Children's Research Institute, Melbourne, VIC, Australia; Department of Paediatrics, The University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
2
|
Gobezayehu AG, Lijalem M, Endalamaw LA, Mohammad H, Beyene T, Mekonnen TB, Abay GG, Sibley LM, Cranmer JN. Creation of a globally informed and locally relevant KMC implementation model for population-impact in Amhara, Ethiopia. Acta Paediatr 2023; 112 Suppl 473:42-55. [PMID: 36544262 DOI: 10.1111/apa.16587] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 10/11/2022] [Accepted: 11/03/2022] [Indexed: 12/24/2022]
Abstract
AIM As part of a multi-country implementation trial, we tested a regionally specific model of kangaroo mother care (KMC). Effective KMC was defined as ≥8 h of newborn-caregiver skin-to-skin contact daily plus exclusive breast feeding. The study was designed to achieve ≥80+% effective KMC coverage at the population level. METHODS The Amhara KMC model was designed using global evidence, formative research in the region and input from government officials, clinicians, newborn families and global scientists. We optimised the initial model using continuous quality improvement with process feedback, outcome measurement and collaborative re-design. Outcomes from the evaluation period are reported. RESULTS At discharge, the final model resulted in a median of 16 h per day of skin-to-skin contact with 63% effective KMC coverage. Fifty-three percent sustained effective KMC to 7 days post-discharge. CONCLUSIONS It is possible to achieve high coverage (63%), high-quality KMC at public hospitals without prior KMC services using government-owned, multisectoral collaborative design. Targeted co-design, real-time data and customisation of KMC interventions with input from impacted stakeholders was critical in achieving high coverage and sustained quality.
Collapse
|
3
|
Cowdell F, Lax S, Van Onselen J, Pendleton R. Can co-created knowledge mobilisation interventions alter and enhance mindlines to improve childhood eczema care? A UK-based Social Impact Framework evaluation. BMJ Open 2023; 13:e065557. [PMID: 37076153 PMCID: PMC10124191 DOI: 10.1136/bmjopen-2022-065557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/21/2023] Open
Abstract
OBJECTIVE To evaluate the impact of using knowledge mobilisation interventions to alter and enhance mindlines and improve childhood eczema care. DESIGN The eczema mindlines study involved three stages: (1) mapping and confirming eczema mindlines, (2) intervention development and delivery and (3) analysis of intervention impact. The focus of this paper is on stage 3. Data analysis was guided by the Social Impact Framework to address the questions: (1) what is the impact of this study on individuals and groups? (2) what changes in behaviour and practice have occurred due to their involvement? (3) what mechanisms have enabled these impacts or changes to occur? and (4) what are the recommendations and questions arising from this research? SETTINGS A deprived inner-city neighbourhood in central England and national/international settings. PARTICIPANTS Patients, practitioners and wider community members exposed to the interventions locally, nationally and internationally. RESULTS Data revealed tangible multi-level, relational and intellectual impacts. Mechanisms supporting impact included: simplicity and consistency of messages adapted to audience, flexibility, opportunism and perseverance, personal interconnectivity and acknowledgement of emotion. Co-created knowledge mobilisation strategies to alter and enhance mindlines mediated through knowledge brokering were effective in producing tangible changes in eczema care practice and self-management and in 'mainstreaming' childhood eczema in positive way across communities. These changes cannot be directly attributed to the knowledge mobilisation interventions, however, the evidence points to the significant contribution made. CONCLUSION Co-created knowledge mobilisation interventions offer a valuable method of altering and enhancing eczema mindlines across lay-practitioner-wider society boundaries. The Social Impact Framework provides comprehensive method of understanding and documenting the complex web of impact occurring as a result of knowledge mobilisation. This approach is transferable to managing other long-term conditions.
Collapse
Affiliation(s)
- Fiona Cowdell
- Faculty of Health, Education and Life Sciences, Birmingham City University, Birmingham, UK
| | - Stephanie Lax
- Centre of Evidence Based Dermatology, University of Nottingham, Nottingham, UK
| | | | | |
Collapse
|
4
|
Kanda A, Ncube EJ, Voyi K. Frameworks for selecting appropriate rural sanitation technology options in low- and middle-income countries: a critical review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL HEALTH RESEARCH 2022; 32:2324-2336. [PMID: 34420432 DOI: 10.1080/09603123.2021.1963685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 07/29/2021] [Indexed: 06/13/2023]
Abstract
Several rural technology options exist on the sanitation market with different characteristics, yet project failures in some developing countries were attributable to inappropriate technology choices. Frameworks that are used to select sanitation technology options (hard copy, computer programmes) were developed by researchers and project implementers. They vary in design and application as there is no standard format. This appears to create a gap between science and practice. Frameworks should have some key elements needed to select appropriate sanitation technologies. We evaluated 12 available frameworks (2000-2019) used to select sanitation technologies in rural communities of low- and middle-income countries against 22 assessment criteria derived from literature. Criteria that were not fully addressed by some of the reviewed frameworks (scores of 8-50%) included equity, sanitation demand, sanitation behaviour change, ongoing contact, replicability, framework limitations, personnel selection and flexibility. Addressing such limitations may assist in future framework development.
Collapse
Affiliation(s)
- Artwell Kanda
- Faculty of Health Sciences, School of Health Systems and Public Health, University of Pretoria, Pretoria, South Africa
| | - Esper Jacobeth Ncube
- Faculty of Health Sciences, School of Health Systems and Public Health, University of Pretoria, Pretoria, South Africa
| | - Kuku Voyi
- Faculty of Health Sciences, School of Health Systems and Public Health, University of Pretoria, Pretoria, South Africa
| |
Collapse
|
5
|
Bamber C, Elezi E. Knowledge Management Evaluation in British Higher Education Partnerships. JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT 2020. [DOI: 10.1142/s0219649220500057] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The purpose of this research is to encourage higher education institutions working in partnerships to evaluate the development of partnerships not only on the basis of financial indicators but take into consideration the newly created knowledge as a result of social capital, monitoring and reviewing and continuing professional development of staff. The empirical data were collected through a survey instrument originally used for a PhD study. This research study provides a better understanding of the knowledge management evaluation stage of partnership development. Findings point out that although embedded knowledge management practices support social capital development, it is expected that higher education institutions could exploit their available knowledge to a greater extent in order to improve their impact on social capital in the context of partnership development. Research findings suggest that evaluation frameworks implemented and controlled by higher education institutions regulatory and governing bodies would benefit from particular inclusion within “assessment of performance” of Higher Education partnerships that specifically consider the social impact of partnership ventures. Knowledge management is a developing theme within academia, and findings imply that executives within higher education are committed to include knowledge management training in CPD strategies, as this not only benefits higher education institutions but will also benefit higher education partnership development. In terms of originality and value, this paper straightens the critical importance of knowledge management evaluation as part of the last stage of partnership development in order to advance in the understanding of the benefits deriving from higher education institutions partnerships. Students, scholars and practitioners of knowledge management can gather a range of insights pointed at performance and knowledge creation within a partnership context.
Collapse
Affiliation(s)
| | - Enis Elezi
- Teesside University Business School, Middlesbrough TS1 3BZ, UK
| |
Collapse
|