Evidence use in decision-making on introducing innovations: a systematic scoping review with stakeholder feedback

Improving accessibility to radiotherapy services in Cali, Colombia: cross-sectional equity analyses using open data and big data travel times from 2020

In this study, we evaluated and forecasted the cumulative opportunities for residents to access radiotherapy services in Cali, Colombia, while accounting for traffic congestion, using a new people-centred methodology with an equity focus. Furthermore, we identified 1-2 optimal locations where new services would maximise accessibility. We utilised open data and publicly available big data. Cali is one of South America's cities most impacted by traffic congestion.

METHODOLOGY

Using a people-centred approach, we tested a web-based digital platform developed through an iterative participatory design. The platform integrates open data, including the location of radiotherapy services, the disaggregated sociodemographic microdata for the population and places of residence, and big data for travel times from Google Distance Matrix API. We used genetic algorithms to identify optimal locations for new services. We predicted accessibility cumulative opportunities (ACO) for traffic ranging from peak congestion to free-flow conditions with hourly assessments for 6-12 July 2020 and 23-29 November 2020. The interactive digital platform is openly available.

PRIMARY AND SECONDARY OUTCOMES

We present descriptive statistics and population distribution heatmaps based on 20-min accessibility cumulative opportunities (ACO) isochrones for car journeys. There is no set national or international standard for these travel time thresholds. Most key informants found the 20-min threshold reasonable. These isochrones connect the population-weighted centroid of the traffic analysis zone at the place of residence to the corresponding zone of the radiotherapy service with the shortest travel time under varying traffic conditions ranging from free-flow to peak-traffic congestion levels. Additionally, we conducted a time-series bivariate analysis to assess geographical accessibility based on economic stratum. We identify 1-2 optimal locations where new services would maximize the 20-min ACO during peak-traffic congestion.

RESULTS

Traffic congestion significantly diminished accessibility to radiotherapy services, particularly affecting vulnerable populations. For instance, urban 20-min ACO by car dropped from 91% of Cali's urban population within a 20-min journey to the service during free-flow traffic to 31% during peak traffic for the week of 6-12 July 2020. Percentages represent the population within a 20-min journey by car from their residence to a radiotherapy service. Specific ethnic groups, individuals with lower educational attainment, and residents on the outskirts of Cali experienced disproportionate effects, with accessibility decreasing to 11% during peak traffic compared to 81% during free-flow traffic for low-income households. We predict that strategically adding sufficient services in 1-2 locations in eastern Cali would notably enhance accessibility and reduce inequities. The recommended locations for new services remained consistent in both of our measurements.These findings underscore the significance of prioritising equity and comprehensive care in healthcare accessibility. They also offer a practical approach to optimising service locations to mitigate disparities. Expanding this approach to encompass other transportation modes, services, and cities, or updating measurements, is feasible and affordable. The new approach and data are particularly relevant for planning authorities and urban development actors.

Dynamic measurements of geographical accessibility considering traffic congestion using open data: a cross-sectional assessment for haemodialysis services in Cali, Colombia

Background

Many cities with traffic congestion lack accessibility assessments accounting for traffic congestion and equity considerations but have disaggregated georeferenced municipal-level open data on health services, populations, and travel times big data. We convened a multistakeholder intersectoral collaborative group that developed a digital, web-based platform integrating open and big data to derive dynamic spatial-temporal accessibility measurements (DSTAM) for haemodialysis services. We worked with stakeholders and data scientists and considered people's places of residence, service locations, and travel time to the service with the shortest travel time. Additionally, we predicted the impacts of strategically introducing haemodialysis services where they optimise accessibility.

Methods

Cross-sectional analyses of DSTAM, accounting for traffic congestion, were conducted using a web-based platform. This platform integrated traffic analysis zones, public census and health services datasets, and Google Distance Matrix API travel-time data. Predictive and prescriptive analytics identified optimal locations for new haemodialysis services and estimated improvements. Primary outcomes included the percentage of residents within a 20-min car drive of a haemodialysis service during peak and free-flow traffic congestion. Secondary outcomes focused on optimal locations to maximise accessibility with new services and potential improvements. Findings were disaggregated by sociodemographic characteristics, providing an equity perspective. The study in Cali, Colombia, used geographic and disaggregated sociodemographic data from the adjusted 2018 Colombian census. Predicted travel times were obtained for two weeks in 2020.

Findings

There were substantial traffic variations. Congestion reduced accessibility, especially among marginalised groups. For 6-12 July, free-flow and peak-traffic accessibility rates were 95.2% and 45.0%, respectively. For 23-29 November, free-flow and peak traffic accessibility rates were 89.1% and 69.7%. The locations where new services would optimise accessibility had slight variation and would notably enhance accessibility and health equity.

Interpretation

Establishing haemodialysis services in targeted areas has significant potential benefits. By increasing accessibility, it would enhance urban health and equity.

Funding

No external or institutional funding was received.

Defining a malaria diagnostic pathway from innovation to adoption: Stakeholder perspectives on data and evidence gaps

Malaria, a major global health concern, requires effective diagnostic tools for patient care, disease control, and elimination. The pathway from concept to the adoption of diagnostic products is complex, involving multiple steps and stakeholders. To map this process, our study introduces a malaria-specific diagnostic pathway, synthesising existing frameworks with expert insights. Comprising six major stages and 31 related activities, the pathway retains the core stages from existing frameworks and integrates essential malaria diagnostic activities, such as WHO prequalification processes, global stakeholder involvement, and broader health systems considerations. To understand the scope and availability of evidence guiding the activities along this pathway, we conducted an online survey with 113 participants from various stages of the malaria diagnostic pathway. The survey assessed perceptions on four critical attributes of evidence: clear requirements, alignment with user needs, accuracy and reliability, and public and free availability. It also explored the types of evidence used and the challenges and potential solutions related to evidence generation and use. Respondents reported using a broad range of formal and informal data sources. Findings indicated differing levels of agreement on the attributes across pathway stages, with notable challenges in the Approvals and Manufacturing stage and consistent concerns regarding the public availability of data/evidence. The study offers valuable insights for optimising evidence generation and utilisation across the malaria diagnostic pathway. It highlights the need for enhanced stakeholder collaboration, improved data availability, and increased funding to support effective evidence generation, sharing, and use. We propose actionable solutions, including the use of public data repositories, progressive data sharing policies, open-access publishing, capacity-building initiatives, stakeholder engagement forums, and innovative funding solutions. The developed framework and study insights have broader applications, offering a model adaptable for other diseases, particularly for neglected tropical diseases, which face similar diagnostic challenges.

The usage of data in NHS primary care commissioning: a realist evaluation

BACKGROUND

To improve health outcomes and address mounting costs pressures, policy-makers have encouraged primary care commissioners in the British National Health Service (NHS) to increase the usage of data in decision-making. However, there exists limited research on this topic. In this study, we aimed to understand how and why primary care commissioners use data (i.e. quantitative, statistical information) to inform commissioning, and what outcomes this leads to.

METHODS

A realist evaluation was completed to create context-mechanism-outcome configurations (CMOs) relating to the contexts influencing the usage of data in primary care commissioning. Using a realist logic of analysis and drawing on substantive theories, we analysed qualitative content from 30 interviews and 51 meetings (51 recordings and 19 accompanying meeting minutes) to develop CMOs. Purposive sampling was used to recruit interviewees from diverse backgrounds.

RESULTS

Thirty-five CMOs were formed, resulting in an overarching realist programme theory. Thirteen CMOs were identical and 3 were truncated versions of those formed in an existing realist synthesis on the same topic. Seven entirely new CMOs, and 12 refined and enhanced CMOs vis-à-vis the synthesis were created. The findings included CMOs containing contexts which facilitated the usage of data, including the presence of a data champion and commissioners' perceptions that external providers offered new skillsets and types of data. Other CMOs included contexts presenting barriers to using data, such as data not being presented in an interoperable way with consistent definitions, or financial pressures inhibiting commissioners' abilities to make evidence-based decisions.

CONCLUSIONS

Commissioners are enthusiastic about using data as a source of information, a tool to stimulate improvements, and a warrant for decision-making. However, they also face considerable challenges when using them. There are replicable contexts available to facilitate commissioners' usage of data, which we used to inform policy recommendations. The findings of this study and our recommendations are pertinent in light of governments' increasing commitment to data-driven commissioning and health policy-making.

The usage of data in NHS primary care commissioning: a realist review

BACKGROUND

Primary care has been described as the 'bedrock' of the National Health Service (NHS) accounting for approximately 90% of patient contacts but is facing significant challenges. Against a backdrop of a rapidly ageing population with increasingly complex health challenges, policy-makers have encouraged primary care commissioners to increase the usage of data when making commissioning decisions. Purported benefits include cost savings and improved population health. However, research on evidence-based commissioning has concluded that commissioners work in complex environments and that closer attention should be paid to the interplay of contextual factors and evidence use. The aim of this review was to understand how and why primary care commissioners use data to inform their decision making, what outcomes this leads to, and understand what factors or contexts promote and inhibit their usage of data.

METHODS

We developed initial programme theory by identifying barriers and facilitators to using data to inform primary care commissioning based on the findings of an exploratory literature search and discussions with programme implementers. We then located a range of diverse studies by searching seven databases as well as grey literature. Using a realist approach, which has an explanatory rather than a judgemental focus, we identified recurrent patterns of outcomes and their associated contexts and mechanisms related to data usage in primary care commissioning to form context-mechanism-outcome (CMO) configurations. We then developed a revised and refined programme theory.

RESULTS

Ninety-two studies met the inclusion criteria, informing the development of 30 CMOs. Primary care commissioners work in complex and demanding environments, and the usage of data are promoted and inhibited by a wide range of contexts including specific commissioning activities, commissioners' perceptions and skillsets, their relationships with external providers of data (analysis), and the characteristics of data themselves. Data are used by commissioners not only as a source of evidence but also as a tool for stimulating commissioning improvements and as a warrant for convincing others about decisions commissioners wish to make. Despite being well-intentioned users of data, commissioners face considerable challenges when trying to use them, and have developed a range of strategies to deal with 'imperfect' data.

CONCLUSIONS

There are still considerable barriers to using data in certain contexts. Understanding and addressing these will be key in light of the government's ongoing commitments to using data to inform policy-making, as well as increasing integrated commissioning.

Attitudes, awareness, and perceptions of general public and pharmacists toward the extended community pharmacy services and drive-thru pharmacy services: a systematic review

BACKGROUND

Several extended and newly added pharmacy services were evaluated in different countries. This review aims to provide a summary of studies on attitudes, awareness, or perceptions toward various extended and drive-thru pharmacy services at community settings among pharmacists and the general public.

METHODS

To find qualitative and descriptive quantitative studies, that reported on the attitudes, awareness, or perceptions of the general public and pharmacists toward the practice of any extended community pharmacy service and drive-thru pharmacy services in a community setting and conducted from March 2012 to March 2022. Researchers used databases such as Embase, Medline PubMed, Scopus, Web of Science, and Science Direct. The reviewers extracted data independently using the PRISMA checklist.

RESULTS

There were 55 studies found according to the inclusion criteria. Various extended pharmacy services (EPS) and drive-thru pharmacy services were noted in the community setting. Pharmaceutical care services and healthcare promotion services were the noticeable performed extended services. There were positive perceptions and attitudes toward extended and drive-thru pharmacy services among pharmacists and the public. However, some factors, such as lack of time and shortage of staff, affect the practice of those services.

CONCLUSION

Understanding the major concerns toward the provision of extended and drive-thru community pharmacy services and improving pharmacists' skills through more training programs to provide such services efficiently. In the future, more reviews for EPS practice barriers are recommended to faceup all concerns and find standardized guidelines by stakeholders and organizations for efficient EPS practices.

EIDM training as a key intervention among researchers to enhance research uptake and policy engagement: an evaluation study

In the past decade, the field of Evidence Informed Decision Making (EIDM) has been evolving faster than before. This shows a need for capacity enhancement amongst evidence producers and evidence users in EIDM training. Through the Enhance DELTAS programme, led by the African Institute for Development Policy (AFIDEP), we provided research uptake and policy engagement training, mentorship and webinars to awardees of the Developing Excellence in Leadership, Training and Science (DELTAS) Africa initiative, led by the African Academy of Sciences (AAS). Two workshops were offered to individual early career DELTAS researchers in policy engagement and evidence uptake, referred to as ENHD101, and among research leaders to enhance institutional capacity on policy engagement and evidence uptake, (ENHD102). Overall, over the eight months’ period of training, mentorship and webinars, the programme attracted 31 early career researchers and 20 research leaders. Following the programme, the early career researchers understood the importance of EIDM for better health policies and programmes. In addition, the team appreciated the complexities of the policymaking processes as they developed the policy engagement strategy for their research. The utilisation of the EIDM knowledge was reflected during the mentorship with policy briefs as end product. For research leaders, they appreciated their role in strengthening capacity for EIDM in decision-making spaces. Although during the programme none of the research leaders participated in strengthening capacity for EIDM, the team anticipated improving in the area in the long run. In addition, the research leaders developed and implemented institutional strategies for policy engagement and research uptake through use of social media to influence policymakers. In conclusion, the project supported capacity building of African researchers in EIDM. It was evident that enhancing knowledge and skills on EIDM through an integrated approach to include training, mentorship, and webinars demonstrated enhanced capacity for policy engagement and evidence uptake.

Impact of the COVID-19 on the Health System and Healthcare Workers: A Systematic Review

Context: The coronavirus disease 2019 (COVID-19) pandemic has affected all sectors of life. The health system and healthcare workers also have been affected by the COVID-19 pandemic. Healthcare workers (HCWs) have faced major challenges in working in the hospitals due to COVID-19 pandemic. There is a need to provide evidence regarding challenges to working during the COVID-19 pandemic, specifically in developing countries. Objectives: The objective of this study was to evaluate the effect of the COVID-19 pandemic on health professionals and the health system. Methods: Ten studies conducted from January 1, 2020, to December 31, 2021were included in this review. Common search terms were impact, health, healthcare, providers, abuses, burden, and system. Different databases, such as Scopus, Web of Science, PubMed, and Google Scholar, were used. Data extraction was performed following the PRISMA recommendations. Results: The results of the systematic review showed that the hospitalization rate and numbers of out-patients have increased, leading to imposing a burden on the health system and healthcare workers (HCWs). A serious type of disease may need hospitalization and ventilatory support. The quality of healthcare institutions is unique and complex. HCWs, in their routine activities, face diverse challenges. The unexpected development of the COVID-19 pandemic was a great challenge faced by the health system and health professionals. Conclusions: The pandemic has altered the healthcare system and healthcare practice with innovative workplaces and social challenges confronted by the HCWs.

Digital smartphone intervention to recognise and manage early warning signs in schizophrenia to prevent relapse: the EMPOWER feasibility cluster RCT

BACKGROUND

Relapse is a major determinant of outcome for people with a diagnosis of schizophrenia. Early warning signs frequently precede relapse. A recent Cochrane Review found low-quality evidence to suggest a positive effect of early warning signs interventions on hospitalisation and relapse.

OBJECTIVE

How feasible is a study to investigate the clinical effectiveness and cost-effectiveness of a digital intervention to recognise and promptly manage early warning signs of relapse in schizophrenia with the aim of preventing relapse?

DESIGN

A multicentre, two-arm, parallel-group cluster randomised controlled trial involving eight community mental health services, with 12-month follow-up.

SETTINGS

Glasgow, UK, and Melbourne, Australia.

PARTICIPANTS

Service users were aged > 16 years and had a schizophrenia spectrum disorder with evidence of a relapse within the previous 2 years. Carers were eligible for inclusion if they were nominated by an eligible service user.

INTERVENTIONS

The Early signs Monitoring to Prevent relapse in psychosis and prOmote Wellbeing, Engagement, and Recovery (EMPOWER) intervention was designed to enable participants to monitor changes in their well-being daily using a mobile phone, blended with peer support. Clinical triage of changes in well-being that were suggestive of early signs of relapse was enabled through an algorithm that triggered a check-in prompt that informed a relapse prevention pathway, if warranted.

MAIN OUTCOME MEASURES

The main outcomes were feasibility of the trial and feasibility, acceptability and usability of the intervention, as well as safety and performance. Candidate co-primary outcomes were relapse and fear of relapse.

RESULTS

We recruited 86 service users, of whom 73 were randomised (42 to EMPOWER and 31 to treatment as usual). Primary outcome data were collected for 84% of participants at 12 months. Feasibility data for people using the smartphone application (app) suggested that the app was easy to use and had a positive impact on motivations and intentions in relation to mental health. Actual app usage was high, with 91% of users who completed the baseline period meeting our a priori criterion of acceptable engagement (> 33%). The median time to discontinuation of > 33% app usage was 32 weeks (95% confidence interval 14 weeks to ∞). There were 8 out of 33 (24%) relapses in the EMPOWER arm and 13 out of 28 (46%) in the treatment-as-usual arm. Fewer participants in the EMPOWER arm had a relapse (relative risk 0.50, 95% confidence interval 0.26 to 0.98), and time to first relapse (hazard ratio 0.32, 95% confidence interval 0.14 to 0.74) was longer in the EMPOWER arm than in the treatment-as-usual group. At 12 months, EMPOWER participants were less fearful of having a relapse than those in the treatment-as-usual arm (mean difference -4.29, 95% confidence interval -7.29 to -1.28). EMPOWER was more costly and more effective, resulting in an incremental cost-effectiveness ratio of £3041. This incremental cost-effectiveness ratio would be considered cost-effective when using the National Institute for Health and Care Excellence threshold of £20,000 per quality-adjusted life-year gained.

LIMITATIONS

This was a feasibility study and the outcomes detected cannot be taken as evidence of efficacy or effectiveness.

CONCLUSIONS

A trial of digital technology to monitor early warning signs that blended with peer support and clinical triage to detect and prevent relapse is feasible.

FUTURE WORK

A main trial with a sample size of 500 (assuming 90% power and 20% dropout) would detect a clinically meaningful reduction in relapse (relative risk 0.7) and improvement in other variables (effect sizes 0.3-0.4).

TRIAL REGISTRATION

This trial is registered as ISRCTN99559262.

FUNDING

This project was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 27. See the NIHR Journals Library website for further project information. Funding in Australia was provided by the National Health and Medical Research Council (APP1095879).

A systems thinking approach to understanding youth active recreation

Background

Active recreation contributes to child and adolescent physical activity, however, factors affecting uptake are poorly understood at the systems level. The aims of this study were: (1) to use systems analysis methods to understand youth active recreation in Victoria, Australia, (ii) identify potential system leverage points to enhance active recreation, and (iii) explore stakeholder views of systems analysis methods for informing practice and policy decision-making.

Methods

Phase 1: Umbrella review of systematic reviews (2013–2018), synthesising evidence for correlates, determinants and intervention evidence for promoting active recreation. Phase 2: Development of three systems models (ActorMap and two ActivMaps), depicting active recreation actors/organisations, correlates, determinants and intervention evidence. Phase 3: Development of causal loop diagrams (CLDs) and identification of leverage points based on the Action Scales Model. Phase 4: Model feedback via stakeholder interviews (n = 23; 16 organisations).

Results

From the literature, 93 correlates and determinants, and 49 intervention strategies were associated with child and adolescent active recreation; the majority located at a social or individual level. Ten potential system leverage points were identified in the CLDs, which differed for pre-schoolers versus children and adolescents. Only time outdoors (an event leverage point) emerged for all age groups. Changes to the built and natural environment (i.e., land use planning, urban design) as a complete domain was a key structural leverage point for influencing active recreation in children and adolescents. Subject matter experts and stakeholder interviews identified 125 actors operating across seven hierarchical active recreation system levels in Victoria. Stakeholder interviews identified 12 areas for future consideration and recommendations for practice/policy influence.

Conclusions

Our findings underscore the need for dynamic models of system behaviour in active recreation, and to capture stakeholder influence as more than a transactional role in evidence generation and use. Effective responses to youth inactivity require a network of interventions that target specific leverage points across the system. Our models illustrate areas that may have the greatest system-level impact, such as changes to the built and natural environment, and they provide a tool for policy, appraisal, advocacy, and decision-making within and outside of government.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-022-01292-2.

Barriers and facilitators of use of analytics for strategic health and care decision-making: a qualitative study of senior health and care leaders' perspectives

OBJECTIVE

This study investigated the barriers and facilitators that senior leaders' experience when using knowledge generated from the analysis of administrative health or care records ('analytics') to inform strategic health and care decision-making.

SETTING

One London-based sustainability and transformation partnership (STP) in England, as it was on the cusp of forming an integrated care system (ICS).

PARTICIPANTS

20 senior leaders, including health and social care commissioners, public health leads and health providers. Participants were eligible for inclusion if they were a senior leader of a constituent organisation of the STP and involved in using analytics to make decisions for their own organisations or health and care systems.

DESIGN

Semi-structured interviews conducted between January 2020 and March 2020 and analysed using the framework method to generate common themes.

RESULTS

Organisational fragmentation hindered use of analytics by creating siloed data systems, barriers to data sharing and different organisational priorities. Where trusted and collaborative relationships existed between leaders and analysts, organisational barriers were circumvented and access to and support for analytics facilitated. Trusted and collaborative relationships between individual leaders of different organisations also aided cross-organisational priority setting, which was a key facilitator of strategic health and care decision-making and use of analytics. Data linked across health and care settings were viewed as an enabler of use of analytics for decision-making, while concerns around data quality often stopped analytics use as a part of decision-making, with participants relying more so on expert opinion or intuition.

CONCLUSIONS

The UK Governments' 2021 White Paper set out aspirations for data to transform care. While necessary, policy changes to facilitate data sharing across organisations will be insufficient to realise this aim. Better integration of organisations with aligned priorities could support and sustain cross-organisational relationships between leaders and analysts, and leaders of different organisations, to facilitate use of analytics in decision-making.

Family-Assisted Severity of Illness Monitoring for Hospitalized Children in Low-Resource Settings-A Two-Arm Interventional Feasibility Study

INTRODUCTION

Pediatric mortality remains unacceptably high in many low-resource settings, with inpatient deaths often associated with delayed recognition of clinical deterioration. The Family-Assisted Severe Febrile Illness ThERapy (FASTER) tool has been developed for caregivers to assist in monitoring their hospitalized children and alert clinicians. This study evaluates feasibility of implementation by caregivers and clinicians.

METHODS

Randomized controlled feasibility study at Kenyatta National Hospital, Kenya. Children hospitalized with acute febrile illness with caregivers at the bedside for 24 h were enrolled. Caregivers were trained using the FASTER tool. The primary outcome was the frequency of clinician reassessments between intervention (FASTER) and standard care arms. Poisson regression with random intercept for grouping by patient was used, adjusting for admission pediatric early warning score, age, gender. Secondary outcomes included survey assessments of clinician and caregiver experiences with FASTER.

RESULTS

One hundred and fifty patient/caregiver pairs were enrolled, 139 included in the analysis, 74 in the intervention, 65 in the control arm. Patients' median age was 0.9 (range 0.2-10) and 1.1 years (range 0.2-12) in intervention vs. control arms. The most common diagnoses were pneumonia (80[58%]), meningitis (58[38%]) and malaria (34 [24%]). 134 (96%) caregivers were patients' mothers. Clinician visits/hour increased with patients' illness severity in both arms, but without difference in frequency between arms (point estimate for difference -0.9%, p = 0.97). Of the 16 deaths, 8 (four/arm) occurred within 2 days of enrollment. Forty clinicians were surveyed, 33 (82%) reporting that FASTER could improve outcomes of very sick children in low-resource settings; 26 (65%) rating caregivers as able to adequately capture patients' severity of illness. Of 70 caregivers surveyed, 63 (90%) reported that FASTER training was easy to understand; all (100%) agreed that the intervention would improve care of hospitalized children and help identify sick children in their community.

DISCUSSION

We observed no difference in recorded frequency of clinician visits with FASTER monitoring. However, the tool was rated positively by caregivers and clinicians., Implementation appears feasible but requires optimization. These feasibility data may inform a larger trial powered to measure morbidity and mortality outcomes to determine the utility of FASTER in detecting and responding to clinical deterioration in low-resource settings.

CLINICAL TRIAL REGISTRATION

ClinicalTrials.gov, identifier: NCT03513861.

Mapping and Visualization of Cancer Research in Indonesia: A Scientometric Analysis

Introduction

The incidence of cancer and its prevalence are increasing in Indonesia. It is crucial to ensure national cancer policies are evidence-based and promote research. While cancer research is being conducted across Indonesia, the extent and focus of research activities are not known, with no existing synthesis of the cancer research landscape. We seek to address this gap by characterising trends in the extent and types of cancer research conducted in Indonesia.

Methods

Scientometric study using descriptive analyses to determine annual growth patterns in publications across all cancer research literature from Indonesia. We developed a classification system for both research type and study design which was applied to all included publications. A visualisation software tool (VOSviewer) was used to explore the geographical distribution of research activity. The Wilcoxon rank-sum test was used to determine the influence of international collaboration on the impact factor of journals in which articles were published.

Results

We retrieved 1773 cancer-related articles published by Indonesia-affiliated authors from 1961 to 2020, with notable year-on-year increases in the annual total number of published articles since 2015. Most articles (84.0%) were published by authors affiliated with institutions on Java Island. The most commonly published article type was basic research and discovery science (28.8%), using a one-group analytical study design (28.8%). International collaboration was significantly correlated with a higher h-index of the journal in which research was published (P < .0001, r = .317).

Conclusion

An increase in the number and range of topics explored in cancer-related publications over time was identified. The summary of the current corpus of cancer-related research for Indonesia can be used to direct the development of the national cancer control plan alongside informing the national cancer research strategy. Our novel and feasible scientometric approach can be used to direct future national and regional mapping of cancer research.

Exploring how key performance indicators influence nursing and midwifery practice: A mixed-methods study

AIMS

To scope the key performance indicators (KPIs) used in nursing and midwifery across the United Kingdom and Republic of Ireland and explore how they influence practice in healthcare organizations.

DESIGN

The study adopted a sequential, exploratory mixed-methods design.

METHODS

Phase 1 incorporated a multiple-choice questionnaire completed by 77 Directors of Nursing recruited using voluntary response sampling. In phase 2, 35 nurses and midwives who were working at executive, senior manager and clinical levels, participated in semi-structured interviews. Data collection of both phases was conducted from January 2016 to October 2016.

FINDINGS

Quantitative data revealed over 100 nursing and midwifery-specific KPIs. National requirements were a deciding factor in KPI selection, while clinical involvement was mainly through data collection. Respondents stated that they used patient experience KPIs, but only one was assessed as valid. Thematic analysis identified two themes: The leadership challenge (including 'voiceless in the national conversation', 'aligning KPIs in the practice context' and 'listening to those who matter'); and taking action (including 'establishing ownership and engaging staff', 'checks and balances' and 'closing the loop').

CONCLUSION

The large volume of KPI measurement taking place makes meaningful evaluation of performance and quality of care difficult, both in and across organizations. Nurses and midwives require enhanced knowledge of the nature and purpose of KPIs, as evidence gained from KPI data collection is insufficient to lead to improvements in practice. A practice context that encourages collective leadership, where multiple sources of evidence are gathered and everyone is included in KPI evaluation and subsequent decision-making, is key.

IMPACT

This study adds to the body of evidence on KPI understanding. It informs the future effective management of indicators that will facilitate the delivery of meaningful care and reduce the cost, time and effort invested in the implementation of KPIs and data management.

The use of molecular biomarker tests: an interview study with healthcare providers about a molecular biomarker test for prostate cancer

Aim: Investigate why healthcare providers are not always willing to use molecular biomarker tests, even though they promise to personalize disease diagnosis and treatment. Materials & methods: We interviewed 20 Dutch urological healthcare providers to ascertain why they used or did not use SelectMDx, a biomarker test for prostate cancer. Results: Whether and how it was used differed from the developers' expectations, because users and nonusers disagreed about its perceived advantages; the scientific and clinical evidence; the advantages of MRI; and the value of PCA3 testing. Financial issues and the absence of SelectMDx in professional guidelines and hospital care pathways also hampered its use. Conclusion: Eliciting users' and nonusers' views is important to better understand how biomarker tests can be embedded in clinical practice.

Nursing Leadership and COVID-19: Defining the Shadows and Leading Ahead of the Data

The COVID-19 pandemic overwhelmed health care systems and exposed major gaps in preparedness and response plans. The crisis challenged nurse leaders to develop and implement novel care delivery plans while preventing disease transmission to patients and staff. COVID-19 required nurse leaders to make decisions in an environment of conflicting data and directives. The authors share essential nurse leader competencies vital to the development and support of thriving nurse leaders. As crises persist and future challenges arise, nurse leaders can leverage these essential competencies to successfully drive engagement, lead ahead of consensus, and define the shadows of limited, incomplete, and conflicting data.

Communication vs evidence: What hinders the outreach of science during an infodemic? A narrative review

Background

The COVID-19 pandemic is placing significant pressure on national and international health organizations and the measures taken to combat it are having many impacts beyond health. At the same time, misleading communication practices and what has been called an “infodemic” by the World Health Organization have been hampering the uptake of coronavirus-related scientific information. Moreover, public awareness about the dangers of the infodemic remains poor, and misinformation may lead to hazardous behaviours. We therefore analysed factors potentially undermining communication of scientific evidence and proposed strategies to counteract this phenomenon.

Methods

We sought official academic and institutional publications of any type, published in English and analyzed their approaches to communication used during the pandemic.

Results

The factors that might undermine appropriate communication include but are not limited to (a) the exponential increase of COVID-19-related publications, often including biases in the peer-review and editorial process; (b) the role of traditional media; (c) politicization of the virus; and (d) the impact of social media. We argue that evidence synthesis and knowledge translation are useful tools to communicate accurate scientific evidence to decision-makers.

Conclusion

Clear and concise messages in this form can help decision-makers to interpret data correctly, take consequent actions, and avoid being compromised by low-quality or even misleading information.

Systematic review of experiences and perceptions of key actors and organisations at multiple levels within health systems internationally in responding to COVID-19

BACKGROUND

COVID-19 has presented challenges to healthcare systems and healthcare professionals internationally. After one year of the pandemic, the initial evidence on health system responses begins to consolidate, and there is a need to identify and synthesise experiences of responding to COVID-19 among healthcare professionals and other health system stakeholders. This systematic review of primary qualitative studies depicts the experiences and perceptions of organisations and actors at multiple levels of health systems internationally in responding to COVID-19.

METHODS

Six main databases of biomedical information, public health and health administration research were searched over the period October 1, 2019, to October 21, 2020. Information extracted from included studies was analysed thematically.

RESULTS

Thirty-four studies were eligible for data extraction. Nine of those studies, of lower methodological quality, were removed from the thematic analysis of study results. Considering the professional level experiences, predominant themes of the studies consisted of the new roles and responsibilities of healthcare workers, burnout and distress, recognition of ´unseen´ healthcare workers, and positive changes and emergent solutions amid the crisis. Organisational level findings of the studies included provision of psychological support, COVID-19 as "catalyst" for change, and exercise of more "open" leadership by managers and health authorities. Continuous training, regulation of working conditions, providing supportive resources, coordinating a diversity of actors, and reviewing and updating regulations were roles identified  at the local health system level.

CONCLUSIONS

The experiences of frontline healthcare workers have been the focus of attention of the majority of primary qualitative studies as of October 2020. However, organisational and wider system level studies indicate that some responses to COVID-19 have been characterised by increased emphasis on coordination activities by local health system actors, making service adaptations at pace, and reliance on expanded roles of front-line workers. The need for theory-informed qualitative studies was identified at the organisational level.

TRIAL REGISTRATION

CRD42020202875.

Clinicians' opinions on recommending aspirin to prevent colorectal cancer to Australians aged 50-70 years: a qualitative study

OBJECTIVES

Australian guidelines recommend all adults aged 50-70 years old without existing contraindications consider taking low-dose aspirin (100-300 mg per day) for at least 2.5 years to reduce their risk of developing colorectal cancer. We aimed to explore clinicians' practices, knowledge, opinions, and barriers and facilitators to the implementation of these new guidelines.

METHODS

Semistructured interviews were conducted with clinicians to whom the new guidelines may be applicable (Familial Cancer Clinic staff (geneticists, oncologists and genetic counsellors), gastroenterologists, pharmacists and general practitioners (GPs)). The Consolidated Framework for Implementation Research (CFIR) underpinned the development of the interview guide. Coding was inductive and themes were developed through consensus between the authors. Emerging themes were mapped onto the CFIR domains: characteristics of the intervention, outer setting, inner setting, individual characteristics and process.

RESULTS

Sixty-four interviews were completed between March and October 2019. Aspirin was viewed as a safe and cheap option for cancer prevention. GPs were considered by all clinicians as the most important health professionals for implementation of the guidelines. Cancer Council Australia, as a trusted organisation, was an important facilitator to guideline adoption. Uncertainty about aspirin dosage and perceived strength of the evidence, precise wording of the recommendation, previous changes to guidelines about aspirin and conflicting findings from trials in older populations were barriers to implementation.

CONCLUSION

Widespread adoption of these new guidelines could be an important strategy to reduce the incidence of bowel cancer, but this will require more active implementation strategies focused on primary care and the wider community.

TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry (ACTRN12620001003965).

Qualitative analysis of the coordination of major system change within the Colombian health system in response to COVID-19: study protocol

BACKGROUND

Coronavirus (COVID-19) is posing a major and unprecedented challenge to health service planning and delivery across health systems internationally. This nationally funded study is analysing the response of the Colombian health system to the COVID-19 pandemic, drawing on qualitative case studies of three local health systems within the country. The approach will be informed by the concept of 'major system change'-or coordinated change among a variety of healthcare organizations and other relevant stakeholders- to identify processes that both enable and inhibit adaptation of health services to the challenges presented by COVID-19. The study will collect information on capacity 'bottlenecks' as well as successful practices and forms of innovation that have emerged locally, which have the potential for being 'scaled up' across Colombia's health services.

METHODS/DESIGN

This qualitative study will be undertaken in two phases. In the first, up to 30 stakeholder interviews will be conducted to ascertain immediate challenges and opportunities for improvement in response to COVID-19 that can be shared in a timely way with health service leaders to inform health service planning. The stakeholders will include planning, provider and intermediary organizations within the health system at the national level. In the second, up to 60 further interviews will be conducted to develop in-depth case studies of three local health systems at the metropolitan area level within Colombia. The interview data will be supplemented with documentary analysis and, where feasible, non-participant observation of planning meetings.

DISCUSSION

The study's findings will aid evaluation of the relevance of the concept of major system change in a context of 'crisis' decision-making and contribute to international lessons on improving health systems' capacity to respond to COVID-19 and future pandemics. Study findings will be shared among various stakeholders in the Colombian healthcare system in a formative and timely way in order to inform healthcare planning in response to COVID-19 and future pandemics. Conducting the study at a time of COVID-19 raises a number of practical issues (including physical distancing and pressure on health services) which have been anticipated in the study design and research team's ways of working.

Problems and Promises of Introducing the Magnetic Resonance Imaging Linear Accelerator Into Routine Care: The Case of Prostate Cancer

The new radiotherapy high field, 1.5 Tesla MRI-guided linear accelerator (MR-Linac) is being clinically introduced. Sensing and evaluating opportunities and barriers at an early stage will facilitate its eventual scale-up. This study investigates the opportunities and barriers to the implementation of MR-Linac into prostate cancer care based on 43 semi-structured interviews with Dutch oncology care professionals, hospital and division directors, patients, payers and industry. The analysis was guided by the Non-adoption, Abandonment, Scale-up, Spread, and Sustainability framework of new medical technologies and services. Opportunities included: the acquirement of (1) advanced MRI-guided radiotherapy technology with (2) the potential for improved patient outcomes and (3) economic benefits, as well as (4) professional development and (5) a higher hospital quality profile. Barriers included: (1) technical complexities, (2) substantial staffing and structural investments, (3) the current lack of empirical evidence of clinical benefits, (4) professional silos, and (5) the presence of patient referral patterns. While our study confirms the expected technical and clinical prospects from the literature, it also reveals economic, organizational, and socio-political challenges.

Overcoming Challenges with the Adoption of Point-of-Care Testing: From Technology Push and Clinical Needs to Value Propositions

Major technical challenges often prevent developers from producing new point-of-care technologies that deliver the required clinical performance in the intended settings of use. But even when devices meet clinical requirements, they can fail to be adopted and successfully implemented. Adoption barriers occur when decision makers do not understand the "value proposition" of new technologies. Current discussions of value in the context of point-of-care testing focus predominantly on the intended use and performance of the device from the manufacturer's point-of-view. However, the perspective of potential adopters in determining whether new devices provide value is also important, as is the opinion of all stakeholders who will be impacted. Incorporating value concepts into decisions made across the full development-to-adoption continuum can increase the likelihood that point-of-care testing will have the desired impact on health care delivery and patient outcomes. This article discusses how various approaches to technology development impact adoption and compares the characteristics of these approaches to emerging value concepts. It also provides an overview of value initiatives and tools that are being developed to support the evaluation of value propositions. These are presented for a range of technology adoption decision contexts, with particular applicability to point-of-care testing. Expanding the focus of research to address gaps in both the creation and evaluation of value propositions is imperative in order for value concepts to positively influence the adoption of point-of-care testing.

Defining Coordinated Care for People with Rare Conditions: A Scoping Review

Introduction:

To coordinate care effectively for rare conditions, we need to understand what coordinated care means. This review aimed to define coordinated care and identify components of coordinated care within the context of rare diseases; by drawing on evidence from chronic conditions.

Methods:

A systematic scoping review. We included reviews that reported or defined and outlined components of coordinated care for chronic or rare conditions. Thematic analysis was used to develop a definition and identify components or care coordination. Stakeholder consultations (three focus groups with patients, carers and healthcare professionals with experience of rare conditions) were held to further explore the relevance of review findings for rare conditions.

Results:

We included 154 reviews (n = 139 specific to common chronic conditions, n = 3 specific to rare conditions, n = 12 both common/rare conditions). A definition of coordination was developed. Components were identified and categorised by those that: may need to be coordinated, inform how to coordinate care, have multiple roles, or that contextualise coordination.

Conclusions:

Coordinated care is multi-faceted and has both generic and context-specific components. Findings outline many ways in which care may be coordinated for both rare and common chronic conditions. Findings can help to develop and eventually test different ways of coordinating care for people with rare and common chronic conditions.

The Relevant Perspective of Economic Evaluations Informing Local Decision Makers: An Exploration in Weight Loss Services

Since 2013, obesity services in the UK National Health Service (NHS) have focused on a tiered structure, with tiers 3 (specialist weight management services) and 4 (primarily bariatric surgery) commissioned by Clinical Commissioning Groups (CCGs) and widely reported as cost effective and recommended by national guidelines. However, CCGs have been reluctant to fully conform to the guidance. We explore how the different evaluative perspective of those generating evidence from local decision makers has contributed to this failure of the CCGs to provide services considered cost effective. We explore four elements where the conventional economic evaluation framework, as applied by the National Institute for Health and Care Excellence (NICE), differ from the reality faced by local decision makers: the cost-effectiveness threshold, the implications of decision uncertainty and budgetary excess, the valuation of future costs and outcomes, and the scope of included costs. We argue that the failure of the conventional framework to reflect the reality faced by local decision makers is rendering much of the existing literature and guidance inappropriate to the key commissioners. Our analysis demonstrates that it is not reasonable to assume that the framework of economic evaluation used to inform national guidance applies to local decision makers, such as in the commissioning of weight loss services. This failure is likely to apply to the majority of cases where evidence is generated to inform national decision makers but commissioning is at a local level.

Implementation of artificial intelligence (AI) applications in radiology: hindering and facilitating factors

Objective

The objective was to identify barriers and facilitators to the implementation of artificial intelligence (AI) applications in clinical radiology in The Netherlands.

Materials and methods

Using an embedded multiple case study, an exploratory, qualitative research design was followed. Data collection consisted of 24 semi-structured interviews from seven Dutch hospitals. The analysis of barriers and facilitators was guided by the recently published Non-adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework for new medical technologies in healthcare organizations.

Results

Among the most important facilitating factors for implementation were the following: (i) pressure for cost containment in the Dutch healthcare system, (ii) high expectations of AI’s potential added value, (iii) presence of hospital-wide innovation strategies, and (iv) presence of a “local champion.” Among the most prominent hindering factors were the following: (i) inconsistent technical performance of AI applications, (ii) unstructured implementation processes, (iii) uncertain added value for clinical practice of AI applications, and (iv) large variance in acceptance and trust of direct (the radiologists) and indirect (the referring clinicians) adopters.

Conclusion

In order for AI applications to contribute to the improvement of the quality and efficiency of clinical radiology, implementation processes need to be carried out in a structured manner, thereby providing evidence on the clinical added value of AI applications.

Key Points

• Successful implementation of AI in radiology requires collaboration between radiologists and referring clinicians.

• Implementation of AI in radiology is facilitated by the presence of a local champion.

• Evidence on the clinical added value of AI in radiology is needed for successful implementation.

Electronic supplementary material

The online version of this article (10.1007/s00330-020-06946-y) contains supplementary material, which is available to authorized users.

Understanding decisions to scale up: a qualitative case study of three health service intervention evaluations

OBJECTIVE

Efforts to scale up evidence-based health care interventions are seen as a key strategy to address complex health system challenges. However, scale-up efforts have shown significant variability. We address the gap between scale-up theory and practice by exploring the socio-cultural factors at play in the evaluation and scale-up of three interventions within the clinical field.

METHODS

A qualitative multiple case study was conducted to characterize the evaluation and scale-up efforts of three interventions. We interviewed 18 participants, including clinicians and researchers across the three cases. Using Pierre Bourdieu's concepts of field and capital as a theoretical lens, we conducted a thematic analysis of the data.

RESULTS

Despite the espoused goals of ensuring that health service interventions are always based on high-quality evidence within the clinical field, this study demonstrates that the outcomes of the evaluations are not the only factor in the decision to engage in scale-up efforts. Important socio-cultural factors also come into play. Bourdieu uses the term capital to refer to the resources that agents compete for and with their acquisition, accumulate power and/or social standing. The type of evidence valued in the clinical field and the ability to leverage capital in demonstrating that value are also important factors.

CONCLUSIONS

Determining if an intervention is effective and should be scaled up is more complex in practice than described in the literature. Efforts are needed to explicitly include the role of social processes in the current frameworks guiding scaling-up efforts.

Factors Influencing Uptake of Changes to Clinical Preventive Guidelines

BACKGROUND

Despite widespread recognition that adherence to clinical preventive guidelines improves patient outcomes, clinicians struggle to implement guideline changes in a timely manner. Multiple factors influence guideline adoption and effective implementation. However, few studies evaluate their collective and inter-related effects. This qualitative study provides a comprehensive picture of the interplay between multiple factors on uptake of new or changed preventive guidelines.

METHODS

Semistructured interviews conducted in 2018 with a diverse sample of clinicians and practice leaders sought to understand patient, clinician, practice, health system, environment, and guideline factors of influence. An immersion-crystallization approach was used to identify emergent themes.

RESULTS

Interviewees expressed motivation to adhere to guidelines but also valued sharing decisions with patients. Personal biases and fears affected both clinician and patient guideline adoption. Practices facilitated implementation through workflow optimization and encouraging a culture of evidence-based practice while a key health system function was to maintain electronic health record alerts. More traditional environmental factors, such as insurance coverage or transportation, were less of a barrier to guideline adoption and implementation than the influence of media and specialists. Various specific guideline characteristics also affected ease of adoption and implementation. Different settings expressed greater health system, practice, or clinician-centric approaches to guideline implementation.

CONCLUSIONS

Guideline uptake is influenced by a complex interplay of multiple levels of factors including the patient, clinician, practice, health system, environment, and guideline levels. Comprehensively understanding all levels of influence for each specific clinical setting may help to determine the optimal intervention(s) for improving uptake of evidence-based guidelines.

Review of 128 quality of care mechanisms: A framework and mapping for health system stewards

Health system stewards have the critical task to identify quality of care deficiencies and resolve underlying system limitations. Despite a growing evidence-base on the effectiveness of certain mechanisms for improving quality of care, frameworks to facilitate the oversight function of stewards and the use of mechanisms to improve outcomes remain underdeveloped. This review set out to catalogue a wide range of quality of care mechanisms and evidence on their effectiveness, and to map these in a framework along two dimensions: (i) governance subfunctions; and (ii) targets of quality of care mechanisms. To identify quality of care mechanisms, a series of searches were run in Health Systems Evidence and PubMed. Additional grey literature was reviewed. A total of 128 quality of care mechanisms were identified. For each mechanism, searches were carried out for systematic reviews on their effectiveness. These findings were mapped in the framework defined. The mapping illustrates the range and evidence for mechanisms varies and is more developed for some target areas such as the health workforce. Across the governance sub-functions, more mechanisms and with evidence of effectiveness are found for setting priorities and standards and organizing and monitoring for action. This framework can support system stewards to map the quality of care mechanisms used in their systems and to uncover opportunities for optimization backed by systems thinking.

Translating academic research into guidance to support healthcare improvement: how should guidance development be reported?

Background

There is interest internationally in improving the uptake of research evidence to inform health care quality and safety. This article focusses on guidance development from research studies as one method for improving research uptake. While we recognise that implementation strategies on the ´demand´ side for encouraging the uptake of research are important, e.g. knowledge brokers and university-practice collaborations, this article focusses on the ´production´ aspect of how guidance development is reported and the consequent influence this may have on end-users´ receptivity to evidence, in addition to other demand-side processes.

Main text

The article considers the following question: how is guidance developed and what are the implications for reporting? We address this question by reviewing examples of guidance development reporting from applied health research studies, then describe how we produced guidance for a national study of evidence use in decision-making on adopting innovations. The starting point for reflecting on our experiences is a vignette of the guidance ´launch´ event at a national conference.

Conclusions

Implications for reporting guidance development and supporting improvement are discussed. These include the need to (a) produce reporting standards for the production of guidance to match reporting standards for other research methods, (b) acknowledge the ´informal´ or emergent aspects of producing guidance and its role within a wider knowledge mobilization strategy, (c) consider guidance development from projects as part of a wider knowledge mobilization strategy, and (d) encourage a receptive environment for guidance development and use, including researcher training, durable funding to support impact, and closer relations between research and practice.

Protocol for a pilot randomised controlled trial evaluating feasibility and acceptability of cognitive remediation group therapy compared with mutual aid group therapy for people ageing with HIV-associated neurocognitive disorder (HAND) in Toronto, Canada

INTRODUCTION

HIV-associated neurocognitive disorder (HAND) may affect 30%-50% of people ageing with HIV. HAND may increase stress and anxiety, and impede coping. Psychosocial group therapy may ameliorate HAND's symptoms, yet the ideal intervention is unclear. This protocol outlines a pilot randomised controlled trial (RCT)-designed using community-based participatory research-to pilot cognitive remediation group therapy (CRGT) against an active comparator.

METHODS AND ANALYSIS

This is a pilot, parallel design, two-arm RCT that will recruit participants diagnosed with the mild neurocognitive disorder form of HAND from a neurobehavioural research unit at a tertiary care hospital in Toronto, Canada. Eligibility criteria include age ≥40 years, known HIV status for 5+ years, English fluency, able to consent and able to attend 8 weeks of group therapy. Eligible participants will be randomised to one of two treatment arms, each consisting of eight-session group interventions delivered once weekly at 3 hours per session. Arm 1 (novel) is CRGT, combining mindfulness-based stress reduction with brain training activities. Arm 2 (active control) is mutual aid group therapy. The primary outcomes are feasibility, measured by proportions of recruitment and completion, and acceptability, determined by a satisfaction questionnaire. The secondary outcome is intervention fidelity, where content analysis will be used to assess facilitator session reports. A between-group analysis will be conducted on exploratory outcomes of stress, anxiety, coping and use of intervention activities that will be collected at three time points.

ETHICS AND DISSEMINATION

Ethical approval was obtained from the Research Ethics Boards of St. Michael's Hospital and the University of Toronto. Findings will be disseminated through peer-reviewed publications, conference presentations and community reporting. This study could provide insight into design (eg, recruitment, measures) and intervention considerations (eg, structure, content) for a larger trial to lessen the burden of cognitive decline among people ageing with HIV.

TRIAL REGISTRATION NUMBER

NCT03483740; Pre-results.

The role of scientific evidence in decisions to adopt complex innovations in cancer care settings: a multiple case study in Nova Scotia, Canada

Background

Health care delivery and outcomes can be improved by using innovations (i.e., new ideas, technologies, and practices) supported by scientific evidence. However, scientific evidence may not be the foremost factor in adoption decisions and is rarely sufficient. The objective of this study was to examine the role of scientific evidence in decisions to adopt complex innovations in cancer care.

Methods

Using an explanatory, multiple case study design, we examined the adoption of complex innovations in five purposively sampled cases in Nova Scotia, Canada. Data were collected via documents and key informant interviews. Data analysis involved an in-depth analysis of each case, followed by a cross-case analysis to develop theoretically informed, generalizable knowledge on the role of scientific evidence in innovation adoption that may be applied to similar settings and contexts.

Results

The analyses identified key concepts alongside important caveats and considerations. Key concepts were (1) scientific evidence underpinned the adoption process, (2) evidence from multiple sources informed decision-making, (3) decision-makers considered three key issues when making decisions, and (4) champions were essential to eventual adoption. Caveats and considerations related to the presence of urgent problems and short-term financial pressures and minimizing risk.

Conclusions

The findings revealed the different types of issues decision-makers consider while making these decisions and why different sources of evidence are needed in these processes. Future research should examine how different types of evidence are legitimized and why some types are prioritized over others.

Electronic supplementary material

The online version of this article (10.1186/s13012-019-0859-5) contains supplementary material, which is available to authorized users.

Lessons learned from Evidence-Informed Decision-Making in Nutrition & Health (EVIDENT) in Africa: a project evaluation

Background

Evidence-informed Decision-making in Nutrition and Health (EVIDENT) is an international partnership that seeks to identify information needs in nutrition and health in Africa and build local capacity in knowledge management to help translate the best available evidence into context-appropriate recommendations aligned to the priorities of decision-makers. This study evaluates the extent to which EVIDENT achieved its intended activities, documents the lessons learned and draws on these lessons learned to inform future activities of EVIDENT, as well as in evidence-informed decision-making (EIDM) in nutrition overall.

Methods

Purposive and snowball sampling were used to identify participants that were either directly or indirectly involved with EVIDENT. An analytical framework of five key elements was developed to guide data collection from EVIDENT’s documentation, in-depth interviews (n = 20), online surveys (n = 26) and a participatory discussion. Interviews were transcribed verbatim and coded in NVivo 11, using deductive thematic content analysis and a phenomenological approach. Online surveys were analysed using Stata 14. Data were triangulated to address both objectives under each element of the analytical framework.

Results

EVIDENT succeeded in establishing a collaborative partnership, within which it delivered four short courses in EIDM. This capacity complemented case study activities in four partner African countries where EIDM processes were implemented and assessed. Identified barriers to these processes included little experience in EIDM, difficulties in engaging stakeholders, challenging local environments (e.g. donor influence, bureaucracy, inaccessibility to scientific research, poor internet connectivity), and limited time and funding. However, EVIDENT activities were driven by a local need for EIDM, a sheer interest and commitment to the cause, and the opportunity for the Global North and South to work together and build relationships. Future activities of EVIDENT, and EIDM in nutrition overall, should focus on sustained capacity-building in EIDM processes, leadership and functional skills across the Global South, investment in stakeholder engagement, context-specific EIDM, enhanced communication and linking, and strengthening relationships with existing stakeholder organisations.

Conclusions

In its first 3 years, EVIDENT developed and strengthened partnership, capacity and visibility on EIDM in Africa. Innovative and long-term capacity-building, dedicated leadership, further stakeholder engagement and sustainable financing, are needed for future activities of EVIDENT and EIDM in nutrition.

Electronic supplementary material

The online version of this article (10.1186/s12961-019-0413-6) contains supplementary material, which is available to authorized users.

Comparing the old to the new: A comparison of similarities and differences of the accreditation standards of the chiropractic council on education-international from 2010 to 2016

Background

Chiropractic programs are accredited and monitored by regional Councils on Chiropractic Education (CCE). The CCE-International has historically been a federation of regional CCEs charged with harmonising world standards to produce quality chiropractic educational programs. The standards for accreditation periodically undergo revision. We conducted a comparison of the CCE-International 2016 Accreditation Standards with the previous version, looking for similarities and differences, expecting to see some improvements.

Method

The CCE-International current (2016) and previous versions (2010) were located and downloaded. Word counts were conducted for words thought to reflect content and differences between standards. These were tabulated to identify similarities and differences. Interpretation was made independently followed by discussion between two researchers.

Results

The 2016 standards were nearly 3 times larger than the previous standards. The 2016 standards were created by mapping and selection of common themes from member CCEs' accreditation standards and not through an evidence-based approach to the development and trialling of accreditation standards before implementation. In 2010 chiropractors were expected to provide attention to the relationship between the structural and neurological aspects of the body in health and disease. In 2016 they should manage mechanical disorders of the musculoskeletal system. Many similarities between the old and the new standards were found. Additions in 2016 included a hybrid model of accreditation founded on outcomes-based assessment of education and quality improvement. Both include comprehensive competencies for a broader role in public health. Omissions included minimal faculty qualifications and the requirement that students should be able to critically appraise scientific and clinical knowledge. Another omission was the requirement for chiropractic programs to be part of a not-for-profit educational entity. There was no mention of evidence-based practice in either standards but the word 'evidence-informed' appeared once in the 2016 standards.

Conclusions

Some positive changes have taken place, such as having bravely moved towards the musculoskeletal model, but on the negative side, the requirement to produce graduates skilled at dealing with scientific texts has been removed. A more robust development approach including better transparency is needed before implementation of CCE standards and evidence-based concepts should be integrated in the programs. The CCE-International should consider the creation of a recognition of excellence in educational programs and not merely propose minimal standards.