Developing a questionnaire to evaluate an automated audit & feedback intervention: a Rand-modified Delphi method

BACKGROUND

Audit and feedback (A&F) is a widely used implementation strategy to evaluate and improve medical practice. The optimal design of an A&F system is uncertain and structured process evaluations are currently lacking. This study aimed to develop and validate a questionnaire to evaluate the use of automated A&F systems.

METHODS

Based on the Clinical Performance Feedback Intervention Theory (CP-FIT) and the REFLECT-52 (REassessing audit & Feedback interventions: a tooL for Evaluating Compliance with suggested besT practices) evaluation tool a questionnaire was designed for the purpose of evaluating automated A&F systems. A Rand-modified Delphi method was used to develop the process evaluation and obtain validation. Fourteen experts from different domains in primary care consented to participate and individually scored the questions on a 9-point Likert scale. Afterwards, the questions were discussed in a consensus meeting. After approval, the final questionnaire was compiled.

RESULTS

A 34-question questionnaire composed of 57 items was developed and presented to the expert panel. The consensus meeting resulted in a selection of 31 questions, subdivided into 43 items. A final list of 30 questions consisting of 42 items was obtained.

CONCLUSION

A questionnaire consisting of 30 questions was drawn up for the assessment and improvement of automated A&F systems, based on CP-FIT and REFLECT-52 theory and approved by experts. Next steps will be piloting and implementation of the questionnaire.

Kenya's Experience: Factors Enabling and Impeding the COVID-19 Response

This case study describes the country-level response to the COVID-19 pandemic in Kenya between February 2020 and May 2021. We organize the presentation of COVID-19 response strategies across the five stages of (a) engagement, (b) assessment, (c) planning, (d) action/implementation, and (e) evaluation. We describe the participatory monitoring and evaluation (M&E) process implemented in collaboration with the WHO Regional Office for Africa Monitoring and Evaluation Team. The M&E system was used to organize and make sense of emerging data regarding specific response activities and changing COVID incidence. We share the results of that collaborative sensemaking, with particular attention to our analysis of the factors that facilitated and those that impeded our pandemic response. We conclude with lessons learned and practical implications from Kenya's experience to help guide future country-level responses to rapidly changing public health crises.

Systematic review: What is the impact of triage implementation on clinical outcomes and process measures in low- and middle-income country emergency departments?

INTRODUCTION

Triage is widely regarded as an essential function of emergency care (EC) systems, especially in resource-limited settings. Through a systematic search and review of the literature, we investigated the effect of triage implementation on clinical outcomes and process measures in low- and middle-income country (LMIC) emergency departments (EDs).

METHODS

Structured searches were conducted using MEDLINE, CENTRAL, EMBASE, CINAHL, and Global Health. Eligible articles identified through screening and full-text review underwent risk-of-bias assessment using the Newcastle-Ottawa Scale. The quality of evidence for each effect measure was summarized using GRADE.

RESULTS

Among 10,394 articles identified through the search strategy, 58 underwent full-text review and 16 were included in the final synthesis. All utilized pre-/postintervention methods and a majority were single center. Effect measures included mortality, waiting time, length of stay, admission rate, and patient satisfaction. Of these, ED mortality and time to clinician assessment were evaluated most frequently. The majority of studies using these outcomes identified a positive effect, namely a reduction in deaths and waiting time among patients presenting for EC. The quality of the evidence was moderate for these measures but low or very low for all other outcomes and process indicators.

CONCLUSIONS

There is moderate quality of evidence supporting an association between the introduction of triage and a reduction in deaths and waiting time. Although the available data support the value of triage in LMIC EDs, the risk of confounding and publication bias is significant. Future studies will benefit from more rigorous research methods.

Pericardial Effusion Detection on Post-Mortem Computed Tomography Images Using Convolutional Neural Networks

Pericardial effusion can be a sign of significant underlying diease and, in some cases, may lead to death. Post-mortem computed tomography (PMCT) is a well-established tool to assist death investigation processes in the forensic setting. In practice, the scarcity of well-trained radiologists is a challenge in processing raw whole-body PMCT images for pericardial effusion detection. In this work, we propose a Pericardial Effusion Automatic Detection (PEAD) framework to automatically process raw whole-body PMCT images to filter out the irrelevant images with heart organ absent and focus on pericardial effusion detection. In PEAD, the standard convolutional neural network architectures of VGG and ResNet are carefully modified to fit the specific characteristics of PMCT images. The experimental results prove the effectiveness of the proposed framework and modified models. The modified VGG and ResNet models achieved superior detection accuracy than the standard architecture with reduced processing speed.

The symptom to assessment pathway for suspected chronic limb-threatening ischaemia (CLTI) affects quality of care: a process mapping exercise

BACKGROUND

Delays in the pathway from first symptom to treatment of chronic limb-threatening ischaemia (CLTI) are associated with worse mortality and limb loss outcomes. This study examined the processes used by vascular services to provide urgent care to patients with suspected CLTI referred from the community.

METHODS

Vascular surgery units from various regions in England were invited to participate in a process mapping exercise. Clinical and non-clinical staff at participating units were interviewed, and process maps were created that captured key staff and structures used to create processes for referral receipt, triage and assessment at the units.

RESULTS

Twelve vascular units participated, and process maps were created after interviews with 45 participants. The units offered multiple points of access for urgent referrals from general practitioners and other community clinicians. Triage processes were varied, with units using different mixes of staff (including medical staff, podiatrists and s) and this led to processes of varying speed. The organisation of clinics to provide slots for 'urgent' patients was also varied, with some adopting hot clinics, while others used dedicated slots in routine clinics. Service organisation could be further complicated by separate processes for patients with and without diabetes, and because of the organisation of services regionally into vascular networks that had arterial and non-arterial centres.

CONCLUSIONS

For referred patients with symptoms of CLTI, the points of access, triage and assessment processes used by vascular units are diverse. This reflects the local context and ingenuity of vascular units but can lead to complex processes. It is likely that benefits might be gained from simplification.

How much convergence exists between registered process measures and patient reported experience measures? A study on Catalan primary healthcare

The use of quality measures is important for transparency and the continuous improvement of performance. However, we do not know enough about the relationship between registered process measures and patient reported experience measures (PREMs) in primary healthcare. Recent studies point to areas of convergence that run contrary anticipated trends. This is a relevant question for healthcare management and governments as their position is stronger when system's guidelines and targets also matter to patients or, vice versa, when patient-centered measures are used to develop new process measures. Our aim is to study both type of measures, their logic and their level of convergence. We also assess the relationship between PREMs, patients' demographic characteristics and area socioeconomic level. We estimated pairwise correlations with patient experience aggregated at the health-center level and a series of multilevel regression models to assess the adjusted effect of four registered process measures on ratings of patient experience at the patient level. We use patient experience as measured by survey data, two composite quality indices and two single indicators regularly computed by the Catalan Health Service. Continuity of care with the same doctor and accessibility are positively associated with patient experience. No relationship was observed in the index created to measure quality of assistance. The index measuring the quality of prescriptions was positively associated with patient experience but only when analyzed separately. We conclude that registered process measures and PREMs are not entirely independent, hence improvements of the management side have the potential to impact patient experience.

An "Engage to Sustain" Intervention to Improve Process Performance Measures in Ambulatory Care

In ambulatory care, monitoring process performance measures (PPMs) is essential to meet regulatory requirements, establish targets for care, seek reimbursement, and evaluate patient care responsibilities. We implemented a comprehensive program, "Engage to Sustain," for licensed practical nurses (LPNs) and certified medical assistants (CMAs) to practice at the top of their licensure/certification. Screening rates for 4 key PPMs (depression screening, fall risk screening, and tobacco use screening and counseling) markedly increased following this intervention across 18 ambulatory departments with more than 2 million patient visits. These results suggest that shifting responsibilities for patient screening from physicians and advanced practitioners to LPNs and CMAs may improve screening rates.

Improving personalised care, through the development of a service evaluation tool to assess, understand and monitor delivery

Systematically implementing personalised care has far reaching benefits to individuals, communities and health and social care systems. If done well, personalised care can result in better health outcomes and experiences, more efficient use of health services and reduced health inequalities. Despite these known benefits, implementation of personalised care has been slow. Evaluation is an important step towards achieving the ambition of universally delivered personalised care. There are currently few comprehensive assessments or tools that are designed to understand the implementation of personalised care at a service or system level, or the cultural, practical and behavioural factors influencing this. The aim of this paper is to describe the development and testing of a system-wide evaluation tool. The tool offers a process through which healthcare systems can better understand the current delivery of personalised care and the factors influencing this. With a focus on implementation, the development of the tool was informed by the Consolidated Framework for Implementation Research, and its content is structured using behaviour change theory (COM-B Theory of Behaviour Change Model). The tool consists of four mirrored surveys, which were developed using an iterative exploratory design. This included a series of testing cycles, in which its structure and content were continually refined. To date, it has been used by 24 clinical services, involving 397 service users, 313 front-line practitioners, 73 service managers and 40 commissioners. These services have used the evaluation process to initiate quality improvement, targeted at one of the more aspects of personalised care. The use of the COM-B model increases the likelihood of those improvements being sustained, through identification of the core factors that enable or limit personalised care behaviours among healthcare staff. We have shown this process to be applicable in a wide range of settings, thus it potentially has broad applicability as a tool for cultural change and quality improvement. The next stage of this work will focus on implementation and evaluation, to fully understand if and how the tool can be used to drive improvements in personalised care delivery.

Assessment of the Psychosocial Care Center multidisciplinary team from users' and family members' perspective

OBJECTIVES

to assess the multidisciplinary team of a Psychosocial Care Center I from users' and family members' perspective.

METHODS

an evaluative study, anchored in the fourth generation evaluation theoretical-methodological framework, carried out in a Psychosocial Care Center I, from September 2021 to March 2022. Eleven users and 06 family members participated. Data were collected through non-participant observation, individual interviews and negotiation sessions, and analyzed using the Constant Comparative Method, using the MAXQDA software.

RESULTS

the team develops its care based on individual and collective care, with integrated and complementary work by professionals. They seek to facilitate treatment initiation and continuation, considering health needs and offering support, understanding and guidance to users and their families.

FINAL CONSIDERATIONS

the multidisciplinary team's work is based on the psychosocial paradigm, which can qualify care and strengthen the service role in the mental health network.

Truth of Colorectal Enhanced Recovery Programs: Process Measure Compliance in 151 Hospitals

BACKGROUND

Commonly cited studies have reported substantial improvements (defined as >20%) in process measure compliance after implementation of colorectal enhanced recovery programs (ERPs). However, hospitals have anecdotally reported difficulties in achieving similar improvement gains. This study evaluates improvement uniformity among 151 hospitals exposed to an 18-month implementation protocol for 6 colorectal ERP process measures (oral antibiotics, mechanical bowel preparation, multimodal pain control, early mobilization, early liquid intake, and early solid intake).

STUDY DESIGN

One hundred fifty-one hospitals implemented a colorectal ERP with pathway, educational and supporting materials, and data capture protocols; 906 opportunities existed for process compliance improvement across the cohort (151 hospitals × 6 process measures). However, 240 opportunities were excluded due to high starting compliance rates (ie compliance >80%) and 3 opportunities were excluded because compliance rates were recorded for fewer than 2 cases. Thus, 663 opportunities for improvement across 151 hospitals were studied.

RESULTS

Of 663 opportunities, minimal improvement (0% to 20% increase in compliance) occurred in 52% of opportunities, substantial improvement (>20% increase in compliance) in 20%, and worsening compliance occurred in 28%. Of the 6 processes, multimodal pain control and use of oral antibiotics improved the most.

CONCLUSIONS

Contrary to published ERP literature, the majority of study hospitals had difficulty improving process compliance with 80% of the opportunities not achieving substantial improvement. This discordance between ERP implementation success rates reported in the literature and what is observed in a large sample could reflect differences in hospitals' culture or characteristics, or a publication bias. Attention needs to be directed toward improving ERP adoption across the spectrum of hospital types.

Relationships Between EHR-Based Audit Log Data and Physician Burnout and Clinical Practice Process Measures

OBJECTIVE

To explore the relationship of electronic health record (EHR)-based audit log data with physician burnout and clinical practice process measures.

METHODS

From September 4 to October 7, 2019, we surveyed physicians in a larger academic medical department and matched responses to August 1 through October 31, 2019, EHR-based audit log data. Multivariable regression analysis evaluated the relationship between log data and burnout and the interrelationship between log data and turnaround time for In Basket messages and percentage of encounters closed within 24 hours.

RESULTS

Of the 537 physicians surveyed, 413 (77%) responded. On multivariable analysis, number of In Basket messages received per day (each additional message: odds ratio, 1.04 [95% CI, 1.02 to 1.07]; P<.001) and time spent in the EHR outside scheduled patient care (each additional hour: odds ratio, 1.01 [95% CI, 1.00 to 1.02]; P=.04) were associated with burnout. Time spent doing In Basket work (each additional minute: parameter estimate, -0.11 [95% CI, -0.19 to -0.03]; P=.01) and in the EHR outside scheduled patient care (each additional hour: parameter estimate, 0.04 [95% CI, 0.01 to 0.06]; P=.002) were associated with turnaround time (days per message) for In Basket messages. None of the variables explored were independently associated with percentage of encounters closed within 24 hours.

CONCLUSION

Electronic health record-based audit log data of workload relate to odds of burnout and responsiveness to patient-related inquiries and results. Further study is needed to determine whether interventions that reduce the number of and time spent doing In Basket messages or time spent in the EHR outside scheduled patient care reduce physician burnout and improve clinical practice process measures.

Design and Implementation of a Chain-Type Direct Push Drilling Rig for Contaminated Sites

For sites where volatile organic compounds are present, the direct push method, in combination with other sensors for investigation, is a powerful method. The investigation process is an integrated drilling and sensing process, but the trajectory of the probe carrying the sensor is ambiguous. This paper explores and introduces the application of a chain-type direct push drilling rig by designing and building a chain-type direct push miniature drilling rig. This rig allows for indoor experimental studies of direct push trajectories. The chain-type direct push drilling model is proposed based on the mechanism of chain transmission. The drilling rig provides a steady direct thrust through the chain, which is driven by a hydraulic motor. In addition, the drilling tests and results described prove that the chain could be applied to direct push drilling. The chain-type direct push drilling rig can drill to a depth of 1940 mm in single-pass and up to 20,000 mm in multiple passes. The test results also indicate that it drills a total length of 462.461 mm and stops after 87.545 s of operation. The machine can provide a drilling angle of 0-90° and keep the borehole angle fluctuating within 0.6° with the characteristics of strong adjustability, flexibility, continuity, stability, and low disturbance, which is of great value and significance for studying the drilling trajectory of direct push tools and obtaining more accurate investigation data.

The Validity of the SEEV Model as a Process Measure of Situation Awareness: The Example of a Simulated Endotracheal Intubation

OBJECTIVE

In the context of anesthesiology, we investigated whether the salience effort expectancy value (SEEV) model fit is associated with situation awareness and perception scores.

BACKGROUND

The distribution of visual attention is important for situation awareness-that is, understanding what is going on-in safety-critical domains. Although the SEEV model has been suggested as a process situation awareness measure, the validity of the model as a predictor of situation awareness has not been tested.

METHOD

In a medical simulation, 31 senior and 30 junior anesthesiologists wore a mobile eye tracker and induced general anesthesia into a simulated patient. When inserting a breathing tube into the mannequin's trachea (endotracheal intubation), the scenario included several clinically relevant events for situation awareness and general events in the environment. Both were assessed using direct awareness measures.

RESULTS

The overall SEEV model fit was good with no difference between junior and senior anesthesiologists. Overall, the situation awareness scores were low. As expected, the SEEV model fits showed significant positive correlations with situation awareness level 1 scores.

CONCLUSION

The SEEV model seems to be suitable as a process situation awareness measure to predict and investigate the perception of changes in the environment (situation awareness level 1). The situation awareness scores indicated that anesthesiologists seem not to perceive the environment well during endotracheal intubation.

APPLICATION

The SEEV model fit can be used to capture and assess situation awareness level 1. During endotracheal intubation, anesthesiologists should be supported by technology or staff to notice changes in the environment.

Shared decision making process measures and patient problems

OBJECTIVES

Purposeful SDM posits four modes of shared decision making (SDM). The use of each mode depends on the type of problem of care that is being addressed. We sought to identify how current observer-based SDM measures apply to each mode of Purposeful SDM.

METHODS

Four coders, working independently, evaluated 192 items pertaining to 12 observer-based SDM process measures. They classified the items into 6 themes that vary across Purposeful SDM modes and then into one of the four modes (weighing, negotiating, problem-solving, developing insight). Disagreements were resolved by consensus.

RESULTS

The items were classified as pertaining to the following themes: problem (28), roles/participation (84), options (62), preferences (21), decision (15), and evaluation (6). They were then classified as pertaining particularly to the SDM modes of weighing (54), negotiating (5), problem-solving (0), and developing insight (0) modes, with 191 items applying broadly to all modes of Purposeful SDM.

CONCLUSIONS

Observer-based SDM measures describe behaviors pertinent to all modes but lack items sensitive to behaviors particular to some modes of SDM.

PRACTICE IMPLICATIONS

New or revised observer-based measures of the SDM process could help estimate the extent to which the appropriate SDM mode is being used to address the patient's problem.

Time to OR for patients with abdominal gunshot wounds: A potential process measure to assess the quality of trauma care?

BACKGROUND

Abdominal gunshot wounds (GSWs) require rapid assessment and operative intervention to reduce the risk of death and complications. We sought to determine if time to the operating room (OR) might be a useful process measure for the assessment of trauma care quality. We evaluated the facility benchmark time to OR for patients with serious injury and whether this was associated with lower rates of complications and mortality.

METHODS

We evaluated time to OR for adult patients with an abdominal GSW presenting in shock to American College of Surgeons Trauma Quality Improvement Program centers from 2015 to 2020. We calculated the 75th percentile time to the OR for each center and characterized centers as average, slow, or fast. We compared patient and facility characteristics across outlier status, as well as risk-adjusted complications and mortality using hierarchical multivariable logistic regression models.

RESULTS

There were 4,027 patients in 230 centers that met the inclusion criteria. Mortality was 28%. There were 61 (27%) fast and 52 (23%) slow centers. The median time for slow centers was 83 minutes (68-94 minutes) compared with fast centers, 35 minutes (32-38 minutes). Injury Severity Score and emergency department vital signs were similar across centers. Fast hospitals had higher total case volumes, more cases per surgeon, and were more likely to be Level I centers. Patients cared for in these centers had similar risk-adjusted rates of complications and mortality.

CONCLUSION

Time to OR for patients with abdominal GSWs and shock might be a useful process measure to evaluate rapid decision making and OR access. Surgeon and center experience as measured by annual case volumes, coupled with a rapid surgical response required through Level I trauma center standards might be contributory. There was no association between outlier status and complications or mortality suggesting other factors apart from time to the OR are of greater significance.

LEVEL OF EVIDENCE

Therapeutic/care management, Level IV.

Use of Theoretical Frameworks in the Development and Testing of Palliative Care Interventions

CONTEXT

Palliative care (PC) research has grown over the last 20 years. Yet, the causal components and pathways of PC interventions remain unclear.

OBJECTIVES

To document the prevalence and application of theoretical frameworks in developing and testing PC interventions.

METHODS

We conducted a secondary analysis of previously published systematic reviews of PC randomized clinical trials. Trials were evaluated for explicit mention of a theoretical framework, process or delivery model, or clinical practice guideline that supported the development of the intervention. We used a structured data extraction form to document study population, outcomes, and whether and how authors used a theoretical framework, process/delivery model, or clinical practice guideline. We applied an adapted coding scheme to evaluate use of theoretical frameworks.

RESULTS

We reviewed 85 PC trials conducted between 1984 and 2021. Thirty-eight percent (n = 32) of trials explicitly mentioned a theoretical framework, process or delivery model, or clinical practice guideline as a foundation for the intervention design. Only nine trials included a theoretical framework, while the remaining 23 cited a process/delivery model or clinical practice guideline.

CONCLUSION

Most PC trials do not cite a theoretical foundation for their intervention design. Future work should focus on developing and validating new theoretical frameworks and modifying existing theories and models to better explain the mechanisms of the variety of PC interventions.

Learning From England's Best Practice Tariff: Process Measure Pay-for-Performance Can Improve Hip Fracture Outcomes

OBJECTIVE

The objective of this study was to evaluate England's Best Practice Tariff (BPT) and consider potential implications for Medicare patients should the US adopt a similar plan.

SUMMARY BACKGROUND DATA

Since the beginning of the Affordable Care Act, Medicare has renewed efforts to improve the outcomes of older adults through introduction of an expanding set of alternative-payment models. Among trauma patients, recommended arrangements met with mixed success given concerns about the heterogeneous nature of trauma patients and resulting outcome variation. A novel approach taken for hip fractures in England could offer a viable alternative.

METHODS

Linear regression, interrupted time-series, difference-in-difference, and counterfactual models of 2000 to 2016 Medicare (US), HES-APC (England) death certificate-linked claims (≥65 years) were used to: track US hip fracture trends, look at changes in English hip fracture trends before-and-after BPT implementation, compare changes in US-versus-English mortality, and estimate total/theoretical lives saved.

RESULTS

A total of 806,036 English and 3,221,109 US hospitalizations were included. After BPT implementation, England's 30-day mortality decreased by 2.6 percentage-points (95%CI: 1.7-3.5) from a baseline of 9.9% (relative reduction 26.3%). 90- and 365-day mortality decreased by 5.6 and 5.4 percentage-points. 30/90/365-day readmissions also declined with a concurrent shortening of hospital length-of-stay. From 2000 to 2016, US outcomes were stagnant (P > 0.05), resulting in an inversion of the countries' mortality and >38,000 potential annual US lives saved.

CONCLUSIONS

Process measure pay-for-performance led to significant improvements in English hip fracture outcomes. As efforts to improve US older adult health continue to increase, there are important lessons to be learned from a successful initiative like the BPT.

Using a Developmental Approach to Evaluation Capacity Building in Home Visiting

The Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program, administered by the Health Resources and Service Administration in collaboration with the Administration for Children and Families, provides evidence-based home visiting services across 50 states, the District of Columbia, and five U.S. territories. MIECHV invests in comprehensive technical assistance (TA) to support and build the capacity of awardees to conduct rigorous evaluations of their programs. Throughout the course of the evaluation process, awardees received TA from the Design Options for Home Visiting Evaluation project. Between 2011 and 2020, over 173 state-led evaluations have been conducted. Individual technical assistance (TA) modalities included conference calls, emails, interactive and individualized webinars, developing and sharing resources, and involvement of content experts. When issues and challenges were identified across multiple awardees, Design Options for Home Visiting Evaluation (DOHVE) delivered targeted group TA to awardees with common needs that may benefit from peer-to-peer learning. When cross-cutting issues and challenges were identified, DOHVE used universal approaches such as webinars and guidance documents that were made available to all awardees.Through the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program, efforts have been taken to promote awardee capacity by targeting all phases of the evaluation process, including planning, implementing, and disseminating findings and providing TA that is responsive and tailored to meet awardee-specific needs. This approach enabled DOHVE to support MIECHV awardees in expanding knowledge of their programs and the evidence base on home visiting. Lessons learned from TA provision highlight the importance of developing feasible plans and providing ongoing support during implementation.

Adaptation of the Measure of Processes of Care for the Evaluation of Family-Centeredness of Services in India

OBJECTIVE

This study aims to (1) adapt the Measure of Processes of Care (MPOC-20) for use in India and (2) evaluate family-centered services for children with disabilities and their caregivers in an urban Indian context.

METHODS

In this cross-sectional observational study, we translated the MPOC-20 into Hindi. Caregivers of children diagnosed with developmental disabilities who read and/or understood Hindi and had received services for ≥6 months were recruited. The psychometric properties of the Hindi MPOC-20 were assessed using factor analysis followed by reliability analyses. The Hindi MPOC-20 was used to assess caregiver perceptions about the family-centeredness of services delivered between October 2016 and February 2017 at Ummeed Child Development Center.

RESULTS

Of the 170 eligible children, 141 (83%) comprised the study sample. Most were boys (66%) with a median age of 67 months. Factor analyses yielded a 4-factor scale with items loading differently from the original measure. The resulting Hindi MPOC-20 had acceptable to good internal consistency (Cronbach's alpha of scales: 0.71-0.86). On the Hindi MPOC-20, Respectful and Coordinated Care, Enabling Partnership, and Providing Specific Information were identified as strengths and Providing General Information as a relative limitation of the service by caregivers across different income and education groups.

CONCLUSION

The Hindi MPOC-20 shows acceptable psychometric properties for use with caregivers of children with disabilities in India. The availability of Hindi MPOC-20 paves the way for the assessment of the family-centeredness of services in India and provides a roadmap for adaptations in other low- and middle-income countries.

[Implementation of a WeChat small program assisted process assessment system in "Experiment of Inorganic Chemistry" for Biological Engineering undergraduates]

The convenience of "no installation, available at your fingertips" of the WeChat small program makes it unique in the application of mobile terminal auxiliary experimental teaching. In order to optimize the assessment system and improve the quality and outcomes of experimental teaching, a self-designed WeChat small program was used to assist the development of the process assessment system. This system was applied to the teaching practice of "Experiment of Inorganic Chemistry" course for the first-year undergraduates majored in Biological Engineering, with the aim to promote teaching and learning by assessment. The results showed that course scores of the students who used this small program were superior to the control group and the correlation between the process assessment and final examination results was significant. These results indicated the WeChat small program assisted process assessment could effectively improve the learning outcomes of students, enable them to grasp the knowledge of Experiment of Inorganic Chemistry efficiently. The results of the questionnaire for the teachers and students also showed a high recognition of the WeChat small program assisted teaching.

Comparative investigation of acetaminophen degradation in aqueous solution by UV/Chlorine and UV/H2O2 processes: Kinetics and toxicity assessment, process feasibility and products identification

The degradation of acetaminophen (ACM) was comparatively studied by UV/chlorine and UV/H₂O₂ systems. An apparent reduction in the removal rate was observed above the optimum pH levels of 7.0 and 3.0 in UV/chlorine and UV/H₂O₂ processes, respectively. The relative contribution of each oxidizing agent in ACM removal using the two advanced oxidation processes (AOPs) was evaluated. Even though hydroxyl radicals, with the contribution percentage of 90.1%, were determined as the primary oxidizing species in ACM removal using the UV/H₂O₂ process, reactive chlorine species (RCS), with 43.8% of contribution percentage, were also found to play a pivotal role in ACM removal using the UV/chlorine process. For instance, dichlorine radical (Cl₂^•-) showed an acceptable contribution percentage of 32.2% in the degradation of ACM by the UV/chlorine process. The rate of ACM degradation significantly rose to 99.9% and 75.6%, as higher amounts of oxidants were used in the UV/chlorine and UV/H₂O₂ processes, respectively, within 25 min. The introduction of HCO₃^- ions and humic acid remarkably decreased the rate of ACM degradation in both techniques used in this study. The presence of NO₃^- and Cl^- ions did not considerably affect the removal rate in the UV/chlorine process. The acute toxicity analysis revealed that a more pronounced reduction in the ACM solution toxicity could be achieved by the UV/H₂O₂ process compared to the UV/chlorine process, which should be ascribed to the formation of chlorinated products in the UV/chlorine treatment. Eventually, plausible oxidation pathways were proposed for each process.

The Influence of the COVID-19 Pandemic on ICU Organization, Care Processes, and Frontline Clinician Experiences: A Qualitative Study

BACKGROUND

The COVID-19 pandemic resulted in unprecedented adjustments to ICU organization and care processes globally.

RESEARCH QUESTIONS

Did hospital emergency responses to the COVID-19 pandemic differ depending on hospital setting? Which strategies worked well to mitigate strain as perceived by intensivists?

STUDY DESIGN AND METHODS

Between August and November 2020, we carried out semistructured interviews of intensivists from tertiary and community hospitals across six regions in the United States that experienced early or large surges of COVID-19 patients, or both. We identified themes of hospital emergency responses using the four S framework of acute surge planning: space, staff, stuff, system.

RESULTS

Thirty-three intensivists from seven tertiary and six community hospitals participated. Clinicians across both settings believed that canceling elective surgeries was helpful to increase ICU capabilities and that hospitals should establish clearly defined thresholds at which surgeries are limited during future surge events. ICU staff was the most limited resource; staff shortages were improved by the use of tiered staffing models, just-in-time training for non-ICU clinicians, designated treatment teams, and deployment of trainees. Personal protective equipment (PPE) shortages and reuse were widespread, causing substantial distress among clinicians; hands-on PPE training was helpful to reduce clinicians' anxiety. Transparency and involvement of frontline clinicians as stakeholders were important components of effective emergency responses and helped to maintain trust among staff.

INTERPRETATION

We identified several strategies potentially to mitigate strain as perceived by intensivists working in both tertiary and community hospital settings. Our study also demonstrated the importance of trust and transparency between frontline staff and hospital leadership as key components of effective emergency responses during public health crises.

Using Process Evaluation Results to Compare Peer and Adult Leader Delivery of the PAWS (Peer-Education about Weight Steadiness) Club Program

To date, there is limited published literature on process evaluation of adolescent health promotion programs. In this paper, we describe the methods and results of PAWS Club process evaluation over 2 years of implementation to compare the effectiveness of delivery by peer and adult leaders. PAWS (Peer-education About Weight Steadiness) Club was a 12-week healthy lifestyle program, delivered to 6th and 7th graders by peer and adult educators, using cluster randomized controlled design. Peer educators were 8th graders in the program schools and adult educators were staff/teachers in the program schools. Trained university students filled out fidelity logs at each session led by peer and adult educators to assess program delivery. The fidelity logs included questions to collect information about the number of participants, duration of the session, percent of activities completed, and if lessons started on time, lesson objectives were clearly stated, lesson objectives were emphasized, demonstrations were visible to participants, all activities were completed, the leader was familiar with lessons, the leader maintained an appropriate pace, the leader kept participants on track, and the leader asked if participants had any questions. Adult educators had a higher mean performance for all questions compared to peer leaders. Significant differences were observed for emphasizing lesson objectives (p = 0.005), making demonstrations visible to participants (p = 0.031), being familiar with the lesson plan (p = 0.000), maintaining an appropriate pace (p = 0.000), keeping participants on track (p = 0.000), and asking if participants had any questions (p = 0.000). Significance was set at p < 0.05. Findings from the current study have implications for designing and conducting a process evaluation of complex healthy lifestyle programs with adolescents in schools. Additional training of peer educators may be needed to enhance program delivery.

Impact of the WHO Surgical Safety Checklist Relative to Its Design and Intended Use: A Systematic Review and Meta-Meta-Analysis

BACKGROUND

The aim of this study was to identify what parts of the World Health Organization Surgical Safety Checklist (WHO SSC) are working, what can be done to make it more effective, and to determine if it achieved its intended effect relative to its design and intended use.

STUDY DESIGN

We conducted a qualitative thematic analysis and meta-meta-analyses of findings in WHO SSC systematic reviews following Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines.

RESULTS

Twenty systematic reviews were included for qualitative thematic analysis. Narrative information was coded in 4 primary areas with a focus on impact of the WHO SSC. Four themes-Clinical Outcomes, Process Measures, Team Dynamics and Communication, and Safety Culture-pertained directly to the aims or purposes behind the development of the SSC. The other 2 themes-Efficiency and Workload involved in using the checklist and Checklist Impact on Institutional Practices-are associated with SSC use, but were not focal areas considered during its development. Included in the 20 systematic reviews were 24 unique observational cohort studies that reported pre-post data on a total of 18 clinical outcomes. Mortality, morbidity, surgical site infection, pneumonia, unplanned return to the operating room, urinary tract infection, blood loss requiring transfusion, unplanned intubation, and sepsis favored the use of the WHO SSC. Deep vein thrombosis was the only postoperative outcome assessed that did not favor use of the WHO SSC.

CONCLUSIONS

The WHO SSC positively impacts the things it was explicitly designed to address and does not positively impact things it was not explicitly designed for.

Evaluation of an interactive web-based programme on relapse management for people with multiple sclerosis (POWER@MS2): study protocol for a process evaluation accompanying a randomised controlled trial

INTRODUCTION

Process evaluations accompanying complex interventions examine the implementation process of the underlying intervention, identify mechanisms of impact and assess contextual factors. This paper presents the protocol for a process evaluation conducted alongside the randomised controlled trial POWER@MS2. The trial comprises the evaluation of a web-based complex intervention on relapse management in 188 people with multiple sclerosis conducted in 20 centres. The web-based intervention programme focuses on relapse treatment decision making and includes a decision aid, a nurse-led webinar and an online chat. With the process evaluation presented here, we aim to assess participants' responses to and interactions with the intervention to understand how and why the intervention produces change.

METHODS AND ANALYSIS

A mixed methods design is used to explore the acceptance of the intervention as well as its use and impact on participants. Participants are people with multiple sclerosis, neurologists, nurses and stakeholders. Quantitative semistandardised evaluation forms will be collected throughout the study. Qualitative semistructured telephone interviews will be conducted at the end of the study with selected participants, especially people with multiple sclerosis and neurologists. Quantitative data will be collected and analysed descriptively. Based on the results, the qualitative interviews will be conducted and analysed thematically, and the results will be merged in a joint display table.

ETHICS AND DISSEMINATION

The process evaluation has received ethical approval from the Ethical Committee of the University of Lübeck (reference 19-024). Findings will be disseminated in peer-reviewed journals, at conferences, meetings and on relevant patient websites.

TRIAL REGISTRATION NUMBER

NCT04233970.

Autotrophic nitrogen removal for decentralized treatment of ammonia-rich industrial textile wastewater: process assessment, stabilization and modelling

Digital textile printing (DTP) is a game-changer technology that is rapidly expanding worldwide. On the other hand, process wastewater is rich in ammoniacal and organic nitrogen, resulting in relevant issues for discharge into sewer system and treatment in centralized plants. The present research is focused on the assessment of the partial nitritation/anammox process in a single-stage granular sequencing batch reactor for on-site decentralized treatment. The technical feasibility of the process was assessed by treating wastewater from five DTP industries in a laboratory-scale reactor, in one case investigating long-term process stabilization. While experimental results indicated nitrogen removal efficiencies up to about 70%, complying with regulations on discharge in sewer system, these data were used as input for process modelling, whose successful parameter calibration was carried out. The model was applied to the simulation of two scenarios: (i) the current situation of a DTP company, in which wastewater is discharged into the sewer system and treated in a centralized plant, (ii) the modified situation in which on-site decentralized treatment for DTP wastewater is implemented. The second scenario resulted in significant improvements, including reduced energy consumption (- 15%), reduced greenhouse gases emission, elimination of external carbon source for completing denitrification at centralized WWTP and reduced sludge production (- 25%).

Review of the current empirical literature on using videoconferencing to deliver individual psychotherapies to adults with mental health problems

PURPOSE

The COVID-19 pandemic has resulted in a widespread adoption of videoconferencing as a communication medium in mental health service delivery. This review considers the empirical literature to date on using videoconferencing to deliver psychological therapy to adults presenting with mental health problems.

METHOD

Papers were identified via search of relevant databases. Quantitative and qualitative data were extracted and synthesized on uptake, feasibility, outcomes, and participant and therapist experiences.

RESULTS

Videoconferencing has an established evidence base in the delivery of cognitive behavioural therapies for post-traumatic stress disorder and depression, with prolonged exposure, cognitive processing therapy, and behavioural activation non-inferior to in-person delivery. There are large trials reporting efficacy for health anxiety and bulimia nervosa compared with treatment-as-usual. Initial studies show applicability of cognitive behavioural therapies for other anxiety and eating disorders and obsessive-compulsive spectrum disorders, but there has yet to be study of use in severe and complex mental health problems. Therapists may find it more difficult to judge non-verbal behaviour, and there may be initial discomfort while adapting to videoconferencing, but client ratings of the therapeutic alliance are similar to in-person therapy, and videoconferencing may have advantages such as being less confronting. There may be useful opportunities for videoconferencing in embedding therapy delivery within the client's own environment.

CONCLUSIONS

Videoconferencing is an accessible and effective modality for therapy delivery. Future research needs to extend beyond testing whether videoconferencing can replicate in-person therapy delivery to consider unique therapeutic affordances of the videoconferencing modality.

PRACTITIONER POINTS

Videoconferencing is an efficacious means of delivering behavioural and cognitive therapies to adults with mental health problems. Trial evidence has established it is no less efficacious than in-person therapy for prolonged exposure, cognitive processing therapy, and behavioural activation. While therapists report nonverbal feedback being harder to judge, and clients can take time to adapt to videoconferencing, clients rate the therapeutic alliance and satisfaction similarly to therapy in-person. Videoconferencing provides opportunities to integrate therapeutic exercises within the person's day-to-day environment.

Quality improvement at times of crisis

Making rapid change during covid-19 has lessons for how to improve healthcare, argue Amar Shah and colleagues

Family Talk versus usual services in improving child and family psychosocial functioning in families with parental mental illness (PRIMERA-Promoting Research and Innovation in Mental hEalth seRvices for fAmilies and children): study protocol for a randomised controlled trial

BACKGROUND

Parental mental illness is common and can lead to dependent children incurring a high risk of developing mental disorders, physical illness, and impaired educational and occupational outcomes. Family Talk is one of the better known interventions designed to prevent the intergenerational transmission of mental illness. However, its evidence base is small, with few robust independent randomised controlled trials, and no associated process or cost evaluations. The PRIMERA (Promoting Research and Innovation in Mental hEalth seRvices for fAmilies and children) research programme involves a mixed method evaluation of Family Talk which is being delivered in mental health settings in Ireland to improve child and family psychosocial functioning in families with parental mental illness.

METHODS

The study comprises a multi-centre, randomised controlled trial (RCT), with nested economic and process evaluations, to assess the clinical and cost-effectiveness and implementation mechanisms of Family Talk compared to usual services. The study is being conducted in 15 adult and child mental health settings in Ireland. Families with a parent with mental illness, and children aged 5-18 years (n = 144 families) will be randomised to either the 7-session Family Talk programme (n = 96) or to standard care (n = 48) using a 2:1 allocation ratio. The primary outcomes are child psychosocial functioning and family functioning. Secondary outcomes are as follows: understanding and experience of parental mental illness, parental mental health, child and parental resilience, partner wellbeing and service utilisation. Blind assessments will take place at pre-intervention and at 6- and 12-month follow-up.

DISCUSSION

Given the prevalence and burden of intergenerational mental illness, it is imperative that prevention through evidence-based interventions becomes a public health priority. The current study will provide an important contribution to the international evidence base for Family Talk whilst also helping to identify key implementation lessons in the scaling up of Family Talk, and other similar interventions, within routine mental health settings.

TRIAL REGISTRATION

ISRCTN Registry, ISRCTN13365858 . Registered 5th February 2019.

Process evaluation of enhancing primary health care for non-communicable disease management in Malaysia: Uncovering the fidelity & feasibility elements

BACKGROUND

In combating the increasing trend of non-communicable diseases (NCDs) over the last two decades in the country, the Ministry of Health Malaysia developed the Enhanced Primary Health Care (EnPHC) initiative to improve care management across different levels of the public service delivery network. An evaluation research component was embedded to explore the implementation issues in terms of fidelity, feasibility, adaptation and benefit of the initiative's components which were triage, care coordination, screening, risk management and referral system.

METHODS

A mixed methods study was conducted at 20 participating EnPHC clinics in Johor and Selangor, two months after the intervention was initiated. Data collected from self-reported forms and a structured observation checklist were descriptively analysed. In-depth interviews were also conducted with 20 participants across the clinics selected to clarify any information gaps observed in each clinic, and data were thematically analysed.

RESULTS

Evaluation showed that all components of EnPHC intervention had been successfully implemented except for the primary triage counter and visit checklist. The challenges were mainly discovered in terms of human resource and physical structure. Although human resource was a common implementation challenge across all interventions, clinic-specific issues could still be identified. Among the adaptive measures taken were task sharing among staff and workflow modification to match the clinic's capacity. Despite the challenges, early benefits of implementation were highlighted especially in terms of service outcomes.

CONCLUSIONS

The evaluation study disclosed issues of human resource and physical infrastructure when a supplementary intervention is implemented. To successfully achieve a scaled-up PHC service delivery model based on comprehensive management of NCDs patient-centred care, the adaptive measures in local clinic context highlight the importance of collaboration between good organisational process and good clinical practice and process.

Acetaminophen degradation by a synergistic peracetic acid/UVC-LED/Fe(II) advanced oxidation process: Kinetic assessment, process feasibility and mechanistic considerations

Application of peracetic acid (PAA) in Advanced Oxidation Processes (AOPs) has seen an increase in the last few years. In this study, PAA/UVC-LED/transition metal was used to degrade acetaminophen (ACT) in an aqueous solution. Amongst tested transition metals (Fe, Cu, Co, Mn, Ag), Fe(II) demonstrated the highest efficiency. The effect of pH, PAA dosage, initial concentration of ACT and Fe(II) concentration was investigated on ACT removal. More than 95% removal efficiency was obtained in 30 min employing pH = 5.0, PAA 4 mM and 0.5 mM Fe(II) (k_app = 0.0993 min^-1). Scavenging experiments highlighted the contribution of oxygen-centered radicals; however, the dominant mechanism is hydroxyl radical-induced, while the superoxide radicals had a negligible role. The effect of anions in water showed that carbonate, (dihydrogen) phosphate and nitrite ions had a strong inhibitory effect, while a neutral effect was observed by sulfate, nitrate and chloride ions. Seven intermediates of ACT oxidation were determined and the ACT degradation pathway by the PAA/UVC-LED/Fe(II) is presented. The efficacy of the PAA/UVC-LED/Fe(II) process was also verified for the degradation of other contaminants of emerging concern and disinfection of fecal indicator microorganisms in real matrix (secondary WW). In conclusion, the studied PAA/UVC-LED/Fe(II) process opens a new perspective as a promising application of advanced oxidation for the degradation of organic pollutants.

Implementation and Process of a COVID-19 Contact Tracing Initiative: Leveraging Health Professional Students to Extend the Workforce During a Pandemic

Background

The Centers for Disease Control and Prevention recommends aggressive contact tracing to control the COVID-19 pandemic. In this work, we (1) describe the development of a COVID-19 contact tracing initiative that includes medical, nursing, and public health students, and is led by clinicians and infectious disease epidemiologists within our health system, and, (2) articulate process steps for contact tracing including workflows and telephone scripts, and, (3) highlight the key challenges and strategies to overcome these challenges.

Methods

A single academic institution-based contact tracing initiative was rapidly scaled to 110 health professional students, four physicians, two epidemiologists, and a research team. Following training, students called patients who were COVID-19 positive and the individuals they were in contact with to ensure proper isolation and quarantine measures. Students also assisted those who faced barriers to quarantine.

Implications

In total, between March 24 and May 28 – this initiative completed contact tracing for 536 confirmed cases, which resulted in the identification of 953 contacts. We aim to disseminate this process, including telephone scripts and workflow, to other health systems for use in their initiatives to respond to the COVID-19 pandemic and future public health emergencies.

Barriers and Facilitators to Implementing Attachment-based Family Therapy into a Child Welfare Setting: A Qualitative Process Evaluation

Child welfare systems (CWSs) worldwide show increased interest in adopting empirically informed clinical strategies to increase treatment effectiveness. Many empirically supported treatments (ESTs) exist, but little is known about EST implementation barriers and facilitators in CWS. This study explored CWS providers' experiences of implementing attachment-based family therapy (ABFT) in home-based services of the Flemish CWS (in Belgium). Sixteen CWS providers (twelve counselors and four supervisors) involved in three home-based services were interviewed. The Consolidated Framework for Implementation Research (CFIR) was used to guide collection, coding, and analysis of interview data. Findings revealed that implementation success was related to ABFT's fit with the CWS's mission, philosophy, and existing practices. CWS providers' belief in the compatibility between ABFT and CWS increased investment in implementation efforts and persistence to overcome challenges and setbacks. Some barriers pertained to the learning of ABFT and some barriers pertained to systems level challenges such as lack of leadership and support, poor coordination with referral sources and other youth care partners, and lack of policy support. For successful expansion of ESTs into CWS settings, various barriers at multiple systemic levels need to be addressed.

The impact of continuous quality improvement on coverage of antenatal HIV care tests in rural South Africa: Results of a stepped-wedge cluster-randomised controlled implementation trial

BACKGROUND

Evidence for the effectiveness of continuous quality improvement (CQI) in resource-poor settings is very limited. We aimed to establish the effects of CQI on quality of antenatal HIV care in primary care clinics in rural South Africa.

METHODS AND FINDINGS

We conducted a stepped-wedge cluster-randomised controlled trial (RCT) comparing CQI to usual standard of antenatal care (ANC) in 7 nurse-led, public-sector primary care clinics-combined into 6 clusters-over 8 steps and 19 months. Clusters randomly switched from comparator to intervention on pre-specified dates until all had rolled over to the CQI intervention. Investigators and clusters were blinded to randomisation until 2 weeks prior to each step. The intervention was delivered by trained CQI mentors and included standard CQI tools (process maps, fishbone diagrams, run charts, Plan-Do-Study-Act [PDSA] cycles, and action learning sessions). CQI mentors worked with health workers, including nurses and HIV lay counsellors. The mentors used the standard CQI tools flexibly, tailored to local clinic needs. Health workers were the direct recipients of the intervention, whereas the ultimate beneficiaries were pregnant women attending ANC. Our 2 registered primary endpoints were viral load (VL) monitoring (which is critical for elimination of mother-to-child transmission of HIV [eMTCT] and the health of pregnant women living with HIV) and repeat HIV testing (which is necessary to identify and treat women who seroconvert during pregnancy). All pregnant women who attended their first antenatal visit at one of the 7 study clinics and were ≥18 years old at delivery were eligible for endpoint assessment. We performed intention-to-treat (ITT) analyses using modified Poisson generalised linear mixed effects models. We estimated effect sizes with time-step fixed effects and clinic random effects (Model 1). In separate models, we added a nested random clinic-time step interaction term (Model 2) or individual random effects (Model 3). Between 15 July 2015 and 30 January 2017, 2,160 participants with 13,212 ANC visits (intervention n = 6,877, control n = 6,335) were eligible for ITT analysis. No adverse events were reported. Median age at first booking was 25 years (interquartile range [IQR] 21 to 30), and median parity was 1 (IQR 0 to 2). HIV prevalence was 47% (95% CI 42% to 53%). In Model 1, CQI significantly increased VL monitoring (relative risk [RR] 1.38, 95% CI 1.21 to 1.57, p < 0.001) but did not improve repeat HIV testing (RR 1.00, 95% CI 0.88 to 1.13, p = 0.958). These results remained essentially the same in both Model 2 and Model 3. Limitations of our study include that we did not establish impact beyond the duration of the relatively short study period of 19 months, and that transition steps may have been too short to achieve the full potential impact of the CQI intervention.

CONCLUSIONS

We found that CQI can be effective at increasing quality of primary care in rural Africa. Policy makers should consider CQI as a routine intervention to boost quality of primary care in rural African communities. Implementation research should accompany future CQI use to elucidate mechanisms of action and to identify factors supporting long-term success.

TRIAL REGISTRATION

This trial is registered at ClinicalTrials.gov under registration number NCT02626351.

Ambulatory quality, special health care needs, and emergency department or hospital use for US children

OBJECTIVE

This study examined family-reported ambulatory care quality and its association with emergency department and hospital utilization, and how these relationships differed across levels of medical complexity.

DATA SOURCES

The 2006-2013 Medical Expenditure Panel Survey (MEPS).

STUDY DESIGN

Secondary analysis of MEPS data. Variables fitting the National Quality Measures Clearinghouse clinical quality measures domain framework were selected. Exploratory factor analysis grouped ambulatory quality into 12 access, experience, or process measures. Weighted negative binomial regression stratified by health status identified associations between ambulatory quality and ED visits or hospitalizations.

DATA COLLECTION

41,497 children ≤18 years were included. The 5-item special health care needs (SHCN) screener categorized health status as complex, less complex, or no SHCN.

PRINCIPAL FINDINGS

Weighted SHCN proportions were 1.6 Percent complex, 18.2 Percent less complex, and 80.0 Percent no SHCN. Mean ED visits were 130 and 335 visits/1000 children/year for no/ complex SHCN, respectively. Mean hospitalizations were 20 and 175 hospitalizations/1000 children/year for no/complex SHCN, respectively. ED visits were associated with 8 of 12 quality measures for no/less complex SHCN. For example, usually/always receiving needed care right away was associated with 22 Percent lower ED visit rate (95% CI 0.64-0.96). Hospitalizations were associated with 4 of 12 quality measures for less complex SHCN. In complex SHCN, associations between ambulatory quality and ED/hospital use were weak and inconsistent.

CONCLUSIONS

Ambulatory quality may best predict ED and hospital use for children with no or less complex SHCN. Whether and how ambulatory care predicts emergency and hospital care in complex SHCN remains an important question.

Healthcare system approach to managing COVID-19 in a metropolitan community in Kentucky

The novel coronavirus disease 2019 (COVID-19) pandemic emerged in Wuhan, China in December 2019 and has subsequently escalated exponentially worldwide. As this virus has never been experienced previously, it poses a significant challenge to healthcare systems who are poorly equipped to handle the large number of gravely ill patients who seek medical attention. Additionally, treating providers are placing their own lives at risk due to the lack of adequate personal protective equipment. We are reporting the proactive measures that were implemented at our healthcare system in a metropolitan community in Kentucky to address COVID-19. The primary goal was to maintain a safe environment for providers, staff, and patients. Three key strategies were incorporated at our healthcare system, including.

"I really want people to use our work to be safe"…Using participatory research to develop a safety intervention for adults with intellectual disability

People with intellectual disability experience disproportionately high rates of interpersonal violence (IPV) due, in part, to disability-related risks that often can be minimized through targeted intervention. In this article, we describe using an academic and community participatory research approach to develop and test the feasibility of an accessible IPV prevention program for people with intellectual disability. The Safety Class, which is an interactive, structured, eight-session, weekly face-to-face group program, was found feasible for implementation in an efficacy study. Working in partnership with the intellectual disability community through all phases of the project helps ensure the relevance, inclusion, and accessibility of The Safety Class.

Protocol for the process evaluation of the Promoting Activity, Independence and Stability in Early Dementia (PrAISED), following changes required by the COVID-19 pandemic

INTRODUCTION

The Promoting Activity, Independence and Stability in Early Dementia (PrAISED) randomised controlled trial (RCT) is evaluating a home-based, face-to-face, individually tailored, activity and exercise programme for people living with dementia. Social distancing requirements following the COVID-19 pandemic necessitated rapid changes to intervention delivery.

METHODS AND ANALYSIS

A mixed-methods process evaluation will investigate how the changes were implemented and the impact that these have on participants' experience. An implementation study will investigate how the intervention was delivered during the pandemic. A study on the mechanisms of impact and context will investigate how these changes were experienced by the PrAISED participants, their carers and the therapists delivering the intervention. The study will commence in May 2020.

ETHICS AND DISSEMINATION

The PrAISED RCT and process evaluation have received ethical approval number 18/YH/0059. The PrAISED process evaluation will enable us to understand how distancing and isolation affected participants, their activity and exercise routines and whether the therapy programme could be continued with remote support. This will be valuable both in explaining trial results and also contribute to understanding and designing new ways of delivering home-based services and rehabilitation interventions for people with dementia and their carers.

TRIAL REGISTRATION NUMBER

ISRCTN15320670; Pre-results.

A work system analysis of the medication administration process in a Norwegian nursing home ward

Nursing home patients often have multiple diagnoses and a high prevalence of polypharmacy and are at risk of experiencing adverse drug events. The study aims to explore the dynamic interactions of stakeholders and work system elements in the medication administration process in a nursing home ward. Data were collected using observations and interviews. A deductive content analysis led to a SEIPS-based process map and an accompanying work system analysis. The study increases knowledge of the complexity of the medication administration process by portraying the dynamic interactions between the major stakeholders in the work system, and the temporal flow of the activities involved. Secondly, it identifies facilitators and barriers in the work system linked to the medication administration process. Most barriers and facilitators are associated with the work system elements - tools & technology, organisation and tasks - and occur early in the medication administration process.

Evaluating process fidelity during the implementation of Group Antenatal Care in Mexico

BACKGROUND

CenteringPregnancy (CP) is a group antenatal care (G-ANC) model that has proven beneficial for mothers and their newborns. We conducted a feasibility study beginning in 2016 as part of the Mexican effort to implement G-ANC locally. This study reports on fidelity to the essential elements of CP during its implementation in Mexico.

METHODS

We collected prospective data using a standardized checklist at four primary-care centers that implemented our adapted G-ANC model. We performed a descriptive analysis of fidelity to 28 processes per G-ANC session (71 sessions made up of 10 groups and 129 women across 4 health centers). We calculated fidelity to each process as a proportion with 95% confidence intervals. We present overall results and stratified by health center and by facilitation team.

RESULTS

Overall fidelity to the G-ANC intervention was 82%, with variability by health center (78-88%). The elements with the highest fidelity were having space for activities such as checking vital signs, conversation in a circle, and medical check-ups (100% each) and the element with the lowest fidelity was using music to enhance privacy (27.3%). Fidelity was not significantly different by center.

CONCLUSIONS

Our study suggests good model fidelity during the implementation of G-ANC in Mexico. Our findings also contribute useful information about where to focus efforts in the future to maintain and improve G-ANC model fidelity.

Modified Anesthesia Protocol for Electroconvulsive Therapy Permits Reduction in Aerosol-Generating Bag-Mask Ventilation during the COVID-19 Pandemic

INTRODUCTION

Electroconvulsive therapy (ECT) is a critical procedure in psychiatric treatment, but as typically delivered involves the use of bag-mask ventilation (BMV), which during the COVID-19 pandemic exposes patients and treatment staff to potentially infectious aerosols.

OBJECTIVE

To demonstrate the utility of a modified anesthesia protocol for ECT utilizing preoxygenation by facemask and withholding the use of BMV for only those patients who desaturate during the apneic period.

METHODS

This chart review study analyzes patients who were treated with ECT using both the traditional and modified anesthesia protocols.

RESULTS

A total of 106 patients were analyzed, of whom 51 (48.1%) required BMV using the new protocol. Of clinical factors, only patient BMI was significantly associated with the requirement for BMV. Mean seizure duration reduced from 52.0 ± 22.4 to 46.6 ± 17.1 s, but seizure duration was adequate in all cases. No acute physical, respiratory, or psychiatric complications occurred during treatment.

CONCLUSIONS

A modified anesthesia protocol reduces the use of BMV by more than 50%, while retaining adequate seizure duration.

Understanding implementation success: protocol for an in-depth, mixed-methods process evaluation of a cluster randomised controlled trial testing methods to improve detection of Lynch syndrome in Australian hospitals

INTRODUCTION

In multisite intervention trials, implementation success often varies widely across settings. Process evaluations are crucial to interpreting trial outcomes and understanding contextual factors and causal chains necessary for successful implementation. Lynch syndrome is a hereditary cancer predisposition conferring an increased risk of colorectal, endometrial and other cancer types. Despite systematic screening protocols to identify Lynch syndrome, the condition remains largely underdiagnosed. The Hide and Seek Project ('HaSP') is a cluster randomised controlled trial determining the effectiveness of two approaches to improving Lynch syndrome detection at eight Australian hospital networks. To enhance widespread implementation of optimal Lynch syndrome identification, there is a need to understand not only what works, but also why, in what contexts, and at what costs. Here we describe an in-depth investigation of factors influencing successful implementation of procedures evaluated in the HaSP trial.

METHODS AND ANALYSIS

A mixed-methods, theory-driven process evaluation will be undertaken in parallel to the HaSP trial. Data will include: interviews of Implementation Leads and Lynch syndrome stakeholders, pre-post implementation questionnaires, audio analysis of meetings and focus groups, observation of multidisciplinary team meetings, fidelity checklists and project log analysis. Results will be triangulated and coded, drawing on the Theoretical Domains Framework, Consolidated Framework for Implementation Research and Proctor's implementation outcomes.

ETHICS AND DISSEMINATION

Use of a theory-based process evaluation will enhance interpretation and generalisability of HaSP trial findings, and contribute to the implementation research field by furthering understanding of the conditions necessary for implementation success. Ethical approval has been granted and results will be disseminated via publications in peer-reviewed journals and conference presentations. At trial completion, key findings will be fed back to sites to enable refinement of intervention strategies, both in the context of Lynch syndrome and for the possible generalisability of intervention components in other genetic and broader clinical specialties.

HASP TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry (Identifier: ACTRN12618001072202). Registered 27 June 2018. http://www.ANZCTR.org.au/ACTRN12618001072202.aspx.

Parent reports of sun safety communication and behaviour for students in a randomised trial on a school policy implementation intervention

OBJECTIVE

Schools are an important setting for skin cancer prevention. An intervention for implementation of school sun safety policy, Sun Safety Schools (SSS), was evaluated.

METHODS

Primary schools (n=118) in California school districts that had already adopted a sun safety policy were enrolled in a study with a randomised controlled design. Half of the schools were randomised to SSS intervention (N=58). Parents completed an online post-test.

RESULTS

More parents in intervention schools received information about sun safety (mean=26.3%, sd=3.1%, p=0.017) and children more frequently wore sun-protective clothing when not at school (mean=2.93, sd=0.03, p=0.033) than in control schools (mean=18.0%, sd=2.5%; mean=2.83, sd=0.03, respectively). In schools where principals reported implementing sun safety practices, parents reported that children spent less time outdoors at midday (mean=14.78 hours, sd=0.25, p=0.033) and fewer were sunburned (mean=12.7%, sd=1.1%, p=0.009) than in non-implementing schools (M=16.3 hours, sd=0.67; mean=21.2%, sd=3.8%, respectively). Parents who received sun safety information (mean=3.08, sd=0.04, p=0.008) reported more child sun protection than parents not receiving information (mean=2.96, sd=0.02).

CONCLUSIONS

A school district sun protection policy and support for implementation increased dissemination of sun safety information to parents and student sun safety. Implications for public health: Technical assistance for sun safety policies may increase sun protection of children.

Building an Expanded Therapeutic Alliance: A Task Analysis with Families Trapped in Parental-Adolescent Conflict

Parental-adolescent conflict is part of the normal developmental cycle of families, but when it occurs in a dysfunctional way, it is associated with the appearance of various harmful conditions for the family system and for the adolescent in particular. Family therapy is one of the main options for psychotherapeutic intervention in these cases and has ample evidence of its effectiveness. The success of this intervention is conditioned to the construction of an adequate therapeutic alliance with the family, but the process of this task has not been clarified yet. The present study is a task analysis, the purpose of which was to create a heuristic model of how an expanded alliance may be built in these kinds of cases. The model was revised and improved from the intensive analysis of six cases. The resulting model can be a useful guide for family therapists in that it describes the specific client and therapist behaviors involved in balancing the alliance, as well as the potential obstacles and suggested ways to resolve them.

The Cultural Adaptation of a Transition Program for Latino Families of Youth with Autism Spectrum Disorder

During the transition to adulthood, effective and culturally relevant supports are critical for families of youth with autism spectrum disorder (ASD). There is a dearth of documented program development and research on supports for Spanish-speaking Latino families during this life stage. The present work describes the cultural adaptation process of an evidence-based transition program for Latino families of youth with ASD. A model of the actions necessary to meaningfully conduct a cultural adaptation in this context is described. After implementing the culturally adapted program titled Juntos en la Transición with five Spanish-speaking families, parents reported high social validity of the program through surveys and interviews. The cultural adaptation process followed in this work is important for the further development of programs that address the transition needs of Latino youth with ASD and their families. Our impressions may also be useful to those who aim to develop culturally sensitive and ecologically valid multifamily group intervention programs for families from cultural and linguistic minority groups.

A Snapshot of RTI Implementation a Decade Later: New Picture, Same Story

Response to intervention (RTI) has evolved from its first decade of implementation. Because states guide and regulate policy and practice at the state and local education agency levels, it is important to understand their critical role in RTI implementation. A systematic review of all 50 state education agency websites was conducted to provide an updated "snapshot" of states' interpretation of RTI a decade after IDEA regulations were finalized. Findings revealed substantive progress towards developing approaches to systematic supports to students, with a major trend in adoption of multi-tiered system of support (MTSS) models. Findings also documented continued variation in how states are communicating about tiered systems on such matters as the roles of tiered systems in schoolwide prevention frameworks, meeting special education requirements, and aligning multiple systems within schools. Implications for special education services for students with learning disabilities are discussed.

Implementation of an interactive organ donation education program for Dutch lower-educated students: a process evaluation

BACKGROUND

As organ donation registration rates remain low, especially among lower-educated people, it is important to support this group in making their registration decision. To prepare lower-educated students in the Netherlands for making a well-informed decision, an interactive educational program was developed. We aim to understand both the (quality of) implementation as well as to contextualize the effects of this program in a lower-educated school setting.

METHODS

The process evaluation was part of a Cluster Randomized Controlled Trial, in which 11 schools for Intermediate Vocational Education throughout the Netherlands participated. Teachers who taught a course on Citizenship delivered three intervention elements (i.e. video fragments and discussion, quizzes with tailored feedback and an exercise filling out a registration form) to their students. Implementation was assessed by interviews with teachers, questionnaires from students, logbooks from teachers and user data from Google Analytics.

RESULTS

The program was well received and implemented, but on-the-spot adaptations were made by teachers to fit their students better. Within the lower-educated target group, differences between students are high in terms of active participation, reading abilities, knowledge and attention span. The program fit well within their regular teaching activities, but the topic of organ donation is not always prioritized by teachers.

CONCLUSIONS

We see opportunities to disseminate the program on a larger scale and reach a group that has been neglected in organ donation education before. Within the program, there are possibilities to increase the effectiveness of the program, such as alternative delivery methods for the elements with a lot of text, the addition of booster sessions and guidelines for teachers to adapt the program to students of different levels within Intermediate Vocational Education. Moreover, in order to have an impact on a national level, strategies need to be employed to reach high numbers of students and, therefore, support on a higher level is needed (both within schools and at policy level).

TRIAL REGISTRATION

Dutch Trial Register, NTR6771. Prospectively registered on 24 October 2017.