Operational research as implementation science: definitions, challenges and research priorities

Impact of targeted drug administration and intermittent preventive treatment for forest goers using artesunate-pyronaridine to control malaria outbreaks in Cambodia

INTRODUCTION

The national malaria programme of Cambodia targets the rapid elimination of all human malaria by 2025. As clinical cases decline to near-elimination levels, a key strategy is the rapid identification of malaria outbreaks triggering effective action to interrupt local transmission. We report a comprehensive, multipronged management approach in response to a  2022 Plasmodium falciparum outbreak in Kravanh district, western Cambodia.

METHODS

The provincial health department of Pursat in conjunction with the Center for Parasitology, Entomology and Malaria Control (CNM) identified villages where transmission was occurring using clinical records, and initiated various interventions, including the distribution of insecticide-treated bed nets, running awareness campaigns, and implementing fever screening with targeted drug administration. Health stations were set up at forest entry points, and later, targeted drug administrations with artesunate-pyronaridine (Pyramax) and intermittent preventive treatment for forest goers (IPTf) were implemented in specific village foci. Data related to adherence and adverse events from IPTf and TDA were collected. The coverage rates of interventions were calculated, and local malaria infections were monitored.

RESULTS

A total of 942 individuals were screened through active fever surveillance in villages where IPTf and TDA were conducted. The study demonstrated high coverage and adherence rates in the targeted villages, with 92% (553/600) coverage in round one and 65% (387/600) in round two. Adherence rate was 99% (551/553) in round one and 98% (377/387) in round two. The study found that forest goers preferred taking Pyramax over repeated testing consistent with the coverage rates: 92% in round one compared to 65% in round two. All individuals reachable through health stations or mobile teams reported complete IPTf uptake. No severe adverse events were reported. Only six individuals reported mild adverse events, such as loss of energy, fever, abdominal pain, diarrhoea, and muscle aches. Two individuals attributed their symptoms to heavy alcohol intake following prophylaxis.

CONCLUSIONS

The targeted malaria outbreak response demonstrated high acceptability, safety, and feasibility of the selected interventions. Malaria transmission was rapidly controlled using the available community resources. This experience suggests the effectiveness of the programmatic response for future outbreaks.

Development of a framework for the collaborative adaptation of service models for child and family health in diverse settings (CASCADES)

The impact of health service access disparities has significant implications for society. The importance of addressing health and social inequities is never more critical than in the early years of a child's life. Despite advances in healthcare implementation, there is a lack of an evidence-based framework to specifically guide the adaptation of child and family health (CFH) service models for different community contexts. This paper describes the development of a framework for the adaptation of community-based CFH service models. Drawing on the findings of an integrative review and Delphi study, Participatory Action Research was used to test the framework, resulting in the Framework for Collaborative Adaptation of Service Models for Child and Family Health in Diverse Settings (CASCADES). The Framework uses the analogy of a waterfall to represent the iterative process of collecting information to inform each step. The framework supports a collaborative co-design approach to build a comprehensive understanding of the target community to inform the adaptation and evaluation of evidence-based interventions appropriate to the local context. The ultimate aim is to enable the delivery of services that are contextually relevant for local communities and provide greater access to effective, accessible services to support children and their families.

Does a GP service package matter in addressing the absence of health management by the occupational population? A modelling study

OBJECTIVE

To assess the influence of supply and demand factors on the contract behavior of occupational populations with general practitioner (GP) teams.

METHODS

We employed a system dynamics approach to assess and predict the effect of the general practitioner service package (GPSP) and complementary incentive policies on the contract rate for 2015-2030. First, the GPSP is designed to address the unique needs of occupational populations, enhancing the attractiveness of GP contracting services, including three personalized service contents tailored to demand-side considerations: work-related disease prevention (WDP), health education & counseling (HEC), and health-care service (HCS). Second, the complementary incentive policies on the supply-side included income incentives (II), job title promotion (JTP), and education & training (ET). Considering the team collaboration, the income distribution ratio (IDR) was also incorporated into supply-side factors.

FINDINGS

The contract rate is predicted to increase to 57.8% by 2030 after the GPSP intervention, representing a 15.4% increase on the non-intervention scenario. WDP and HEC have a slightly higher (by 2%) impact on the contract rate than that from HCS. Regarding the supply-side policies, II have a more significant impact on the contract rate than JTP and ET by 3-5%. The maximum predicted contract rate of 75.2% is expected by 2030 when the IDR is 0.5, i.e., the GP receives 50% of the contract income and other members share 50%.

CONCLUSION

The GP service package favorably increased the contract rate among occupational population, particularly after integrating the incentive policies. Specifically, for a given demand level, the targeted content of the package enhanced the attractiveness of contract services. On the supply side, the incentive policies boost GPs' motivation, and the income distribution motivated other team members.

A systematic review of simulation methods applied to cancer care services

There is significant potential for Operational Research to support improvements in care services for cancer patients. In this systematic review, we examine computer simulation techniques used in supporting hospital-based cancer care, the type of problems addressed, the quality of the model and implementation, and the impact on patients. We identified 51 papers distributed between four problem types: patient flow/pathway modelling, scheduling, cost analysis, and resource allocation. Discrete Event Simulation was the most common simulation technique. Nearly two-thirds of the papers involved some form of engagement with clinicians or hospital managers: studies that did not reported fewer successful implementations. We discuss the reported benefits and limitations of applying simulation techniques to cancer care. Papers often highlighted opportunities to reduce hospital costs or waiting times, while a common limitation was a lack of, or limited, data. Stakeholder involvement throughout the project may mitigate obstacles and result in lasting policy changes.

Expanding the roles of community health workers to sustain programmes during malaria elimination: a meeting report on operational research in Southeast Asia

In Southeast Asia malaria elimination is targeted by 2030. Cambodia aims to achieve this by 2025, driven in large part by the urgent need to control the spread of artemisinin-resistant falciparum malaria infections. Rapid elimination depends on sustaining early access to diagnosis and effective treatment. In much of Cambodia, rapid elimination will rely on a village malaria worker (VMW) network. Yet as malaria declines and is no longer a common cause of febrile illness, VMWs may become less popular with febrile patients, as VMWs do not diagnose or treat other conditions at present. There is a risk that VMWs become inactive and malaria rebounds before the complete interruption of transmission is achieved.During 2021-23 a large-scale operational research study was conducted in western Cambodia to explore how a VMW network could be sustained by including health activities that cover non-malarial illnesses to encourage febrile patients to continue to attend. 105 VMWs received new rapid diagnostic tests (including dengue antigen-antibody and combined malaria/C-reactive protein tests), were trained in electronic data collection, and attended health education packages on hygiene and sanitation, disease surveillance and first aid, management of mild illness, and vaccination and antenatal care.In August 2023 the National Malaria Control Programme of Cambodia convened a stakeholder meeting in Battambang, Cambodia. Findings from the study were reviewed in the context of current malaria elimination strategies. The discussions informed policy options to sustain the relevance of the VMW network in Cambodia, and the potential for its integration with other health worker networks. This expansion could ensure VMWs remain active and relevant until malaria elimination is accomplished.

Village malaria workers for the community-based management of vivax malaria

In Cambodia, malaria cases are on a trajectory towards the goal of malaria elimination by 2025. Vivax malaria is difficult to eliminate because of hypnozoites that can cause relapse. Primaquine, an 8-aminoquinoline, clears hypnozoites but requires testing for glucose-6-phosphate dehydrogenase (G6PD) deficiency. Routine primaquine treatment of vivax malaria has recently been implemented in Cambodia in which Village Malaria Workers (VMWs) diagnose vivax malaria by rapid diagnostic test and refer patients to health centres for G6PD testing and further treatment. Patients are referred back to the VMWs for monitoring adverse symptoms and treatment adherence. This article explores how VMWs' roles might be optimized for the community-based management of vivax malaria. With sufficient training and supervision, the role of VMWs might be expanded to include G6PD testing, making referral to the health centre superfluous. Community-based management of vivax malaria could increase the coverage of radical cure and accelerate vivax malaria elimination.

An operations research approach to automated patient scheduling for eye care using a multi-criteria decision support tool

Inefficient management of resources and waiting lists for high-risk ophthalmology patients can contribute to sight loss. The aim was to develop a decision support tool which determines an optimal patient schedule for ophthalmology patients. Our approach considers available booking slots as well as patient-specific factors. Using standard software (Microsoft Excel and OpenSolver), an operations research approach was used to formulate a mathematical model. Given a set of patients and clinic capacities, the model objective was to schedule patients efficiently depending on eyecare measure risk factors, referral-to-treatment times and targets, patient locations and slot availabilities over a pre-defined planning horizon. Our decision support tool can feedback whether or not a patient is scheduled. If a patient is scheduled, the tool determines the optimal date and location to book the patients' appointments, with a score provided to show the associated value of the decisions made. Our dataset from 519 patients showed optimal prioritization based on location, risk of serious vision loss/damage and the referral-to-treatment time. Given the constraints of available slots, managers can input hospital-specific parameters such as demand and capacity into our model. The model can be applied and implemented immediately, without the need for additional software, to generate an optimized patient schedule.

Scale up and strengthening of comprehensive emergency obstetric and newborn care in Tanzania

Introduction

In Tanzania, inadequate access to comprehensive emergency obstetric and newborn care (CEmONC) services is the major bottleneck for perinatal care and results in high maternal and perinatal mortality. From 2015 to 2019, the Accessing Safe Deliveries in Tanzania project was implemented to study how to improve access to CEmONC services in underserved rural areas.

Methods

A five-year longitudinal cohort study was implemented in seven health centres (HCs) and 21 satellite dispensaries in Morogoro region. Five of the health centres received CEmONC interventions and two served as controls. Forty-two associate clinicians from the intervention HCs were trained in teams for three months in CEmONC and anaesthesia. Managers of 20 intervention facilities, members of the district and regional health management teams were trained in leadership and management. Regular supportive supervision was conducted.

Results

Interventions resulted in improved responsibility and accountability among managers. In intervention HCs, the mean monthly deliveries increased from 183 (95% CI 174–191) at baseline (July 2014 –June 2016) to 358 (95% CI 328–390) during the intervention period (July 2016 –June 2019). The referral rate to district hospitals in intervention HCs decreased from 6.0% (262/4,392) with 95% CI 5.3–6.7 at baseline to 4.0% (516/12,918) with 95% CI 3.7–4.3 during the intervention period while it increased in the control group from 0.8% (48/5,709) to 1.5% (168/11,233). The obstetric case fatality rate decreased slightly from 1.5% (95% CI 0.6–3.1) at baseline to 1.1% (95% CI 0.7–1.6) during the intervention period (not statistically significant). Active engagement strategies and training in leadership and management resulted in uptake and improvement of CEmONC and anaesthesia curricula, and contributed to scale up of CEmONC at health centre level in the country.

Conclusions

Integration of leadership and managerial capacity building, with CEmONC-specific interventions was associated with health systems strengthening and improved quality of services.

Rapid-cycle systems modeling to support evidence-informed decision-making during system-wide implementation

Background

To “model and simulate change” is an accepted strategy to support implementation at scale. Much like a power analysis can inform decisions about study design, simulation models offer an analytic strategy to synthesize evidence that informs decisions regarding implementation of evidence-based interventions. However, simulation modeling is under-utilized in implementation science. To realize the potential of simulation modeling as an implementation strategy, additional methods are required to assist stakeholders to use models to examine underlying assumptions, consider alternative strategies, and anticipate downstream consequences of implementation. To this end, we propose Rapid-cycle Systems Modeling (RCSM)—a form of group modeling designed to promote engagement with evidence to support implementation. To demonstrate its utility, we provide an illustrative case study with mid-level administrators developing system-wide interventions that aim to identify and treat trauma among children entering foster care.

Methods

RCSM is an iterative method that includes three steps per cycle: (1) identify and prioritize stakeholder questions, (2) develop or refine a simulation model, and (3) engage in dialogue regarding model relevance, insights, and utility for implementation. For the case study, 31 key informants were engaged in step 1, a prior simulation model was adapted for step 2, and six member-checking group interviews (n = 16) were conducted for step 3.

Results

Step 1 engaged qualitative methods to identify and prioritize stakeholder questions, specifically identifying a set of inter-related decisions to promote implementing trauma-informed screening. In step 2, the research team created a presentation to communicate key findings from the simulation model that addressed decisions about programmatic reach, optimal screening thresholds to balance demand for treatment with supply, capacity to start-up and sustain screening, and availability of downstream capacity to provide treatment for those with indicated need. In step 3, member-checking group interviews with stakeholders documented the relevance of the model results to implementation decisions, insight regarding opportunities to improve system performance, and potential to inform conversations regarding anticipated implications of implementation choices.

Conclusions

By embedding simulation modeling in a process of stakeholder engagement, RCSM offers guidance to realize the potential of modeling not only as an analytic strategy, but also as an implementation strategy.

Closing the know-do gap for child health: UNICEF's experiences from embedding implementation research in child health and nutrition programming

UNICEF operates in 190 countries and territories, where it advocates for the protection of children’s rights and helps meet children’s basic needs to reach their full potential. Embedded implementation research (IR) is an approach to health systems strengthening in which (a) generation and use of research is led by decision-makers and implementers; (b) local context, priorities, and system complexity are taken into account; and (c) research is an integrated and systematic part of decision-making and implementation. By addressing research questions of direct relevance to programs, embedded IR increases the likelihood of evidence-informed policies and programs, with the ultimate goal of improving child health and nutrition.

This paper presents UNICEF’s embedded IR approach, describes its application to challenges and lessons learned, and considers implications for future work.

From 2015, UNICEF has collaborated with global development partners (e.g. WHO, USAID), governments and research institutions to conduct embedded IR studies in over 25 high burden countries. These studies focused on a variety of programs, including immunization, prevention of mother-to-child transmission of HIV, birth registration, nutrition, and newborn and child health services in emergency settings. The studies also used a variety of methods, including quantitative, qualitative and mixed-methods.

UNICEF has found that this systematically embedding research in programs to identify implementation barriers can address concerns of implementers in country programs and support action to improve implementation. In addition, it can be used to test innovations, in particular applicability of approaches for introduction and scaling of programs across different contexts (e.g., geographic, political, physical environment, social, economic, etc.). UNICEF aims to generate evidence as to what implementation strategies will lead to more effective programs and better outcomes for children, accounting for local context and complexity, and as prioritized by local service providers. The adaptation of implementation research theory and practice within a large, multi-sectoral program has shown positive results in UNICEF-supported programs for children and taking them to scale.

Tuberculosis Scientific Conferences in Peru: Sharing local evidence for local decisions

Introduction

International conferences on tuberculosis (TB) have been held since the 19th century. In Peru, the TB Scientific Conferences have been held annually in Lima since 2013 as a means of developing a national TB research network and setting the stage for researchers and institutions to present and share new findings from studies conducted in Peru.

Methods

Systematization of information on speakers and presentations from TB Scientific Conferences in Peru. Presentation files and official agendas for the conferences from 2013 to 2019 were obtained from the Tuberculosis Prevention and Control Directorate's website.

Results

A total of 426 scientific presentations have been delivered by 230 speakers, with a steady annual increase. 37.1% of the talks were given by female speakers. To date, 61.4% of the research presented has been published. Out of all the studies, 10.9% (30/275) were part of international, multicentric research projects. Main research lines were epidemiology (40.1%), drug-resistance (29.6%) and treatment (22.1%).

Conclusions

TB Scientific Conferences serve as a platform to share region-specific TB evidence between local stakeholders (health officials, academics, and others) who aim to facilitate the implementation of measures with the goal of reducing the national gaps towards the End TB Strategy goals.

Variation in referral rates to emergency departments and inpatient services from a GP out of hours service and the potential impact of alternative staffing models

Introduction

Out of hours (OOHs) primary care is a critical component of the acute care system overnight and at weekends. Referrals from OOH services to hospital will add to the burden on hospital assessment in the ED and on-call specialties.

Methods

We studied the variation in referral rates (to the ED and direct specialty admission) of individual clinicians working in the Oxfordshire, UK OOH service covering a population of 600 000 people. We calculated the referral probability for each clinician over a 13-month period of practice (1 December 2014 to 31 December 2015), stratifying by clinician factors and location and timing of assessment. We used Simul8 software to determine the range of hospital referrals potentially due to variation in clinician referral propensity.

Results

Among the 119 835 contacts with the service, 5261 (4.4%) were sent directly to the ED and 3474 (3.7%) were admitted directly to specialties. More referrals were made to ED by primary care physicians if they did not work in the local practices (5.5% vs 3.5%, p=0.011). For clinicians with >1000 consultations, percentage of patients referred varied from 1% to 21% of consultations. Simulations where propensity to refer was made less extreme showed a difference in maximum referrals of 50 patients each week.

Conclusions

There is substantial variation in clinician referral rates from OOHs primary care to the acute hospital setting. The number of patients referred could be influenced by this variation in clinician behaviour. Referral propensity should be studied including casemix adjustment to determine if interventions targeting such behaviour are effective.

Implementation Science to Respond to the COVID-19 Pandemic

The COVID-19 pandemic continues to expand globally, requiring massive public health responses from national and local governments. These bodies have taken heterogeneous approaches to their responses, including when and how to introduce and enforce evidence-based interventions-such as social distancing, hand-washing, personal protective equipment (PPE), and testing. In this commentary, we reflect on opportunities for implementation science to contribute meaningfully to the COVID-19 pandemic response. We reflect backwards on missed opportunities in emergency preparedness planning, using the example of PPE stockpiling and supply management; this planning could have been strengthened through process mapping with consensus-building, microplanning with simulation, and stakeholder engagement. We propose current opportunities for action, focusing on enhancing the adoption, fidelity, and sustainment of hand washing and social distancing; we can combine qualitative data, policy analysis, and dissemination science to inform agile and rapid adjustment to social marketing strategies to enhance their penetration. We look to future opportunities to enhance the integration of new evidence in decision-making, focusing on serologic and virologic testing systems; we can leverage simulation and other systems engineering modeling to identify ideal system structures. Finally, we discuss the ways in which the COVID-19 pandemic challenges implementation science to become more rapid, rigorous, and nimble in its approach, and integrate with public health practice. In summary, we articulate the ways in which implementation science can inform, and be informed by, the COVID-19 pandemic, looking backwards, proposing actions for the moment, and approaches for the future.

Computer simulation of dementia care demand heterogeneity using hybrid simulation methods: improving population-level modelling with individual patient decline trajectories

OBJECTIVES

The aim of the study was to model dementia prevalence and outcomes within an ageing population using a novel hybrid simulation model that simultaneously takes population-level and patient-level perspectives to better inform dementia care service planning, taking into account severity progression variability.

STUDY DESIGN

This is a simulation study.

METHODS

We developed a hybrid computer simulation combining different methods to best represent population and individual dementia dynamics. Individual patient outcomes are aggregated into three progression rate types to report the effects of severity progression variability and intervention benefits.

RESULTS

Fast progression of dementia severity is associated with higher annual care cost and short overall survival duration. Those patients are more likely to develop moderate to severe symptoms more quickly, highlighting a need for more urgent provision of appropriate care services. Slower severity progression is associated with lower annual care costs, but longer survival requires higher overall financial provision. Although lifestyle interventions reduce overall care costs, treatment and lifestyle intervention benefits are modest at the population level.

CONCLUSIONS

Individual variation of dementia decline is an important factor to include in planning adequate levels of care services and to ensure timely and appropriate service availability. Hybrid simulation models provide useful insights at the population and individual level, supporting effective decision-making.

Integrating HIV, syphilis, malaria and anaemia point-of-care testing (POCT) for antenatal care at dispensaries in western Kenya: discrete-event simulation modelling of operational impact

BACKGROUND

Despite WHO advocating for an integrated approach to antenatal care (ANC), testing coverage for conditions other than HIV remains low and women are referred to distant laboratories for testing. Using point-of-care tests (POCTs) at peripheral dispensaries could improve access to testing and timely treatment. However, the effect of providing additional services on nurse workload and client wait times are unknown. We use discrete-event simulation (DES) modelling to understand the effect of providing four point-of-care tests for ANC on nurse utilization and wait times for women seeking maternal and child health (MCH) services.

METHODS

We collected detailed time-motion data over 20 days from one high volume dispensary in western Kenya during the 8-month implementation period (2014-2015) of the intervention. We constructed a simulation model using empirical arrival distributions, activity durations and client pathways of women seeking MCH services. We removed the intervention from the model to obtain wait times, length-of-stay and nurse utilization rates for the baseline scenario where only HIV testing was offered for ANC. Additionally, we modelled a scenario where nurse consultations were set to have minimum durations for sufficient delivery of all WHO-recommended services.

RESULTS

A total of 183 women visited the dispensary for MCH services and 14 of these women received point-of-care testing (POCT). The mean difference in total waiting time was 2 min (95%CI: < 1-4 min, p = 0.026) for MCH women when integrated POCT was given, and 9 min (95%CI: 4-14 min, p < 0.001) when integrated POCT with adequate ANC consult times was given compared to the baseline scenario. Mean length-of-stay increased by 2 min (95%CI: < 1-4 min, p = 0.015) with integrated POCT and by 16 min (95%CI: 10-21 min, p < 0.001) with integrated POCT and adequate consult times compared to the baseline scenario. The two nurses' overall daily utilization in the scenario with sufficient minimum consult durations were 72 and 75%.

CONCLUSION

The intervention had a modest overall impact on wait times and length-of-stay for women seeking MCH services while ensuring pregnant women received essential diagnostic testing. Nurse utilization rates fluctuated among days: nurses experienced spikes in workload on some days but were under-utilized on the majority of days. Overall, our model suggests there was sufficient time to deliver all WHO's required ANC activities and offer integrated testing for ANC first and re-visits with the current number of healthcare staff. Further investigations on improving healthcare worker, availability, performance and quality of care are needed. Delivering four point-of-care tests together for ANC at dispensary level would be a low burden strategy to improve ANC.

Cascade Analysis: An Adaptable Implementation Strategy Across HIV and Non-HIV Delivery Platforms

BACKGROUND

Cascades have been used to characterize sequential steps within a complex health system and are used in diverse disease areas and across prevention, testing, and treatment. Routine data have great potential to inform prioritization within a system, but are often inaccessible to frontline health care workers (HCWs) who may have the greatest opportunity to innovate health system improvement.

METHODS

The cascade analysis tool (CAT) is an Excel-based, simple simulation model with an optimization function. It identifies the step within a cascade that could most improve the system. The original CAT was developed for HIV treatment and the prevention of mother-to-child transmission of HIV.

RESULTS

CAT has been adapted 7 times: to a mobile application for prevention of mother-to-child transmission; for hypertension screening and management and for mental health outpatient services in Mozambique; for pediatric and adolescent HIV testing and treatment, HIV testing in family planning, and cervical cancer screening and treatment in Kenya; and for naloxone distribution and opioid overdose reversal in the United States. The main domains of adaptation have been technical-estimating denominators and structuring steps to be binary sequential steps-as well as logistical-identifying acceptable approaches for data abstraction and aggregation, and not overburdening HCW.

DISCUSSION

CAT allows for prompt feedback to HCWs, increases HCW autonomy, and allows managers to allocate resources and time in an equitable manner. CAT is an effective, feasible, and acceptable implementation strategy to prioritize areas most requiring improvement within complex health systems, although adaptations are being currently evaluated.

A mathematical model for designing networks of C-Reactive Protein point of care testing

One approach to improving antibiotic stewardship in primary care may be to support all General Practitioners (GPs) to have access to point of care C-Reactive Protein tests to guide their prescribing decisions in patients presenting with symptoms of lower respiratory tract infection. However, to date there has been no work to understand how clinical commissioning groups might approach the practicalities of system-wide implementation. We aimed to develop an accessible service delivery modelling tool that, based on open data, could generate a layout of the geographical distribution of point of care facilities that minimised the cost and travel distance for patients across a given region. We considered different implementation models where point of care tests were placed at either GP surgeries, pharmacies or both. We analysed the trade-offs between cost and travel found by running the model under different configurations and analysing the model results in four regions of England (two urban, two rural). Our model suggests that even under assumptions of short travel distances for patients (e.g. under 500m), it is possible to achieve a meaningful reduction in the number of necessary point of care testing facilities to serve a region by referring some patients to be tested at nearby GP surgeries or pharmacies. In our test cases pharmacy-led implementation models resulted in some patients having to travel long distances to obtain a test, beyond the desired travel limits. These results indicate that an efficient implementation strategy for point of care tests over a geographic region, potentially building on primary care networks, might lead to significant cost reduction in equipment and associated personnel training, maintenance and quality control costs; as well as achieving fair access to testing facilities.

Implementation of simulation modelling to improve service planning in specialist orthopaedic and neurosurgical outpatient services

BACKGROUND

Advanced physiotherapist-led services have been embedded in specialist orthopaedic and neurosurgical outpatient departments across Queensland, Australia, to ameliorate capacity constraints. Simulation modelling has been used to inform the optimal scale and professional mix of services required to match patient demand. The context and the value of simulation modelling in service planning remain unclear. We aimed to examine the adoption, context and costs of using simulation modelling recommendations to inform service planning.

METHODS

Using an implementation science approach, we undertook a prospective, qualitative evaluation to assess the use of discrete event simulation modelling recommendations for service re-design and to explore stakeholder perspectives about the role of simulation modelling in service planning. Five orthopaedic and neurosurgical services in Queensland, Australia, were selected to maximise variation in implementation effectiveness. We used the consolidated framework for implementation research (CFIR) to guide the facilitation and analysis of the stakeholder focus group discussions. We conducted a prospective costing analysis in each service to estimate the costs associated with using simulation modelling to inform service planning.

RESULTS

Four of the five services demonstrated adoption by inclusion of modelling recommendations into proposals for service re-design. Four CFIR constructs distinguished and two CFIR constructs did not distinguish between high versus mixed implementation effectiveness. We identified additional constructs that did not map onto CFIR. The mean cost of implementation was AU$34,553 per site (standard deviation = AU$737).

CONCLUSIONS

To our knowledge, this is the first time the context of implementing simulation modelling recommendations in a health care setting, using a validated framework, has been examined. Our findings may provide valuable insights to increase the uptake of healthcare modelling recommendations in service planning.

Making Smarter Decisions Faster: Systems Engineering to Improve the Global Public Health Response to HIV

PURPOSE OF REVIEW

This review offers an operational definition of systems engineering (SE) as applied to public health, reviews applications of SE in the field of HIV, and identifies opportunities and challenges of broader application of SE in global health.

RECENT FINDINGS

SE involves the deliberate sequencing of three steps: diagnosing a problem, evaluating options using modeling or optimization, and providing actionable recommendations. SE includes diverse tools (from process improvement to mathematical modeling) applied to decisions at various levels (from local staffing decisions to planning national-level roll-out of new interventions). Contextual factors are crucial to effective decision-making, but there are gaps in understanding global decision-making processes. Integrating SE into pre-service training and translating SE tools to be more accessible could increase utilization of SE approaches in global health. SE is a promising, but under-recognized approach to improve public health response to HIV globally.

A Study of the Impact of Screening for Poly-Victimization in Juvenile Justice: The Rocky Road to a Successful Investigation in the Real World

Poly-victimization during formative developmental periods represents an important focus for screening and assessment in settings and populations in which interpersonal violence is pervasive. This article describes the multistage evolution of a research project designed to empirically test a poly-victimization enhancement of a widely used and validated behavioral health screening tool for youth using retrospective and prospective archival juvenile justice system outcome data. Several operational and methodological revisions to the project's design and procedures were necessitated by barriers that arose as a result of unforeseen shifts in the host juvenile justice system's policies and personnel. The present report describes real-world challenges that face investigators working in public sector systems, and highlights the key role of establishing long-term collaborative professional relationships with personnel at all levels in those systems based on providing services and evaluation data that meet the system's core goals, responsibilities, and mission. Also highlighted are the methodological and logistical adaptations needed to successfully accomplish a project's internal objectives while striking a balance between flexibility in operational and methodological tactics on one hand, and adherence to ethical, conceptual/clinical, and methodological principles on the other hand.

Improving the production of applied health research findings: insights from a qualitative study of operational research

BACKGROUND

Knowledge produced through applied health research is often of a form not readily accessible to or actionable by policymakers and practitioners, which hinders its implementation. Our aim was to identify research activities that can support the production of knowledge tailored to inform policy and practice. To do this, we studied an operational research approach to improving the production of applied health research findings.

METHODS

A 2-year qualitative study was conducted of the operational research contribution to a multidisciplinary applied health research project that was successful in rapidly informing national policy. Semi-structured interviews (n = 20) were conducted with all members of the project's research team and advisory group (patient and health professional representatives and academics). These were augmented by participant (> 150 h) and non-participant (> 15 h) observations focusing on the process and experience of attempting to support knowledge production. Data were analysed thematically using QSR NVivo software.

RESULTS

Operational research performed a knowledge mediation role shaped by a problem-focused approach and an intent to perform those tasks necessary to producing readily implementable knowledge but outwith the remit of other disciplinary strands of the project. Three characteristics of the role were found to support this: engaging and incorporating different perspectives to improve services by capturing a range of health professional and patient views alongside quantitative and qualitative research evidence; rendering data meaningful by creating and presenting evidence in forms that are accessible to and engage different audiences, enabling them to make sense of it for practical use; and maintaining perceived objectivity and rigour by establishing credibility, perceived neutrality and confidence in the robustness of the research in order to unite diverse professionals in thinking creatively about system-wide service improvement.

CONCLUSIONS

Our study contributes useful empirical insights about knowledge mediation activities within multidisciplinary applied health research projects that support the generation of accessible, practice-relevant and actionable knowledge. Incorporating such activities, or a dedicated role, for mediating knowledge production within such projects could help to enhance the uptake of research findings into routine healthcare and warrants further consideration.

A facility location model for analysis of current and future demand for sexual health services

In this paper we address the clinic location selection problem for a fully integrated Sexual Health Service across Hampshire. The service provides outpatient services for Genito-Urinary Medicine, contraceptive and reproductive health, sexual health promotion and a sexual assault referral centre. We aim to assist the planning of sexual health service provision in Hampshire by conducting a location analysis using both current and predicted patient need. We identify the number of clinic locations required and their optimal geographic location that minimise patient travel time. To maximise the chances of uptake of results we validate the developed simple algorithm with an exact method as well as three well-known, but complex meta-heuristics. The analysis was conducted using car travel and public transport times. Two scenarios were considered: current clinic locations only; and anywhere within Hampshire. The results show that the clinic locations could be reduced from 28 to 20 and still keep 90% of all patient journeys by public transport (e.g. by bus or train) to a clinic within 30 minutes. The number of clinics could be further reduced to 8 if the travel time is based on car travel times within 15 minutes. Results from our simple solution method compared favourably to the exact solution as well as the complex meta-heuristics.

Architectural frameworks: defining the structures for implementing learning health systems

Background

The vision of transforming health systems into learning health systems (LHSs) that rapidly and continuously transform knowledge into improved health outcomes at lower cost is generating increased interest in government agencies, health organizations, and health research communities. While existing initiatives demonstrate that different approaches can succeed in making the LHS vision a reality, they are too varied in their goals, focus, and scale to be reproduced without undue effort. Indeed, the structures necessary to effectively design and implement LHSs on a larger scale are lacking. In this paper, we propose the use of architectural frameworks to develop LHSs that adhere to a recognized vision while being adapted to their specific organizational context. Architectural frameworks are high-level descriptions of an organization as a system; they capture the structure of its main components at varied levels, the interrelationships among these components, and the principles that guide their evolution. Because these frameworks support the analysis of LHSs and allow their outcomes to be simulated, they act as pre-implementation decision-support tools that identify potential barriers and enablers of system development. They thus increase the chances of successful LHS deployment.

Discussion

We present an architectural framework for LHSs that incorporates five dimensions—goals, scientific, social, technical, and ethical—commonly found in the LHS literature. The proposed architectural framework is comprised of six decision layers that model these dimensions. The performance layer models goals, the scientific layer models the scientific dimension, the organizational layer models the social dimension, the data layer and information technology layer model the technical dimension, and the ethics and security layer models the ethical dimension. We describe the types of decisions that must be made within each layer and identify methods to support decision-making.

Conclusion

In this paper, we outline a high-level architectural framework grounded in conceptual and empirical LHS literature. Applying this architectural framework can guide the development and implementation of new LHSs and the evolution of existing ones, as it allows for clear and critical understanding of the types of decisions that underlie LHS operations. Further research is required to assess and refine its generalizability and methods.