Understanding the processes underpinning IMPlementing IMProved Asthma self-management as RouTine (IMP2ART) in primary care: study protocol for a process evaluation within a cluster randomised controlled implementation trial

BACKGROUND

Providing supported self-management for people with asthma can reduce the burden on patients, health services and wider society. Implementation, however, remains poor in routine clinical practice. IMPlementing IMProved Asthma self-management as RouTine (IMP2ART) is a UK-wide cluster randomised implementation trial that aims to test the impact of a whole-systems implementation strategy, embedding supported asthma self-management in primary care compared with usual care. To maximise opportunities for sustainable implementation beyond the trial, it is necessary to understand how and why the IMP2ART trial achieved its clinical and implementation outcomes.

METHODS

A mixed-methods process evaluation nested within the IMP2ART trial will be undertaken to understand how supported self-management was implemented (or not) by primary care practices, to aid interpretation of trial findings and to inform scaling up and sustainability. Data and analysis strategies have been informed by mid-range and programme-level theory. Quantitative data will be collected across all practices to describe practice context, IMP2ART delivery (including fidelity and adaption) and practice response. Case studies undertaken in three to six sites, supplemented by additional interviews with practice staff and stakeholders, will be undertaken to gain an in-depth understanding of the interaction of practice context, delivery, and response. Synthesis, informed by theory, will combine analyses of both qualitative and quantitative data. Finally, implications for the scale up of asthma self-management implementation strategies to other practices in the UK will be explored through workshops with stakeholders.

DISCUSSION

This mixed-methods, theoretically informed, process evaluation seeks to provide insights into the delivery and response to a whole-systems approach to the implementation of supported self-management in asthma care in primary care. It is underway at a time of significant change in primary care in the UK. The methods have, therefore, been developed to be adaptable to this changing context and to capture the impact of these changes on the delivery and response to research and implementation processes.

Implementation of supplemental physiotherapy following hip fracture surgery: a protocol for the process evaluation of a randomised controlled trial

BACKGROUND

Patient outcomes following low-trauma hip fracture are suboptimal resulting in increased healthcare costs and poor functional outcomes at 1 year. Providing early and intensive in-hospital physiotherapy could help improve patient outcomes and reduce costs following hip fracture surgery. The HIP fracture Supplemental Therapy to Enhance Recovery (HIPSTER) trial will compare usual care physiotherapy to intensive in-hospital physiotherapy for patients following hip fracture surgery. The complex environments in which the intervention is implemented present unique contextual challenges that may impact intervention effectiveness. This study aims to complete a process evaluation to identify barriers and facilitators to implementation and explore the patient, carer and clinician experience of intensive therapy following hip fracture surgery.

METHODS AND ANALYSIS

The process evaluation is embedded within a two-arm randomised, controlled, assessor-blinded trial recruiting 620 participants from eight Australian hospitals who have had surgery for a hip fracture sustained via a low-trauma injury. A theory-based mixed method process evaluation will be completed in tandem with the HIPSTER trial. Patient and carer semi-structured interviews will be completed at 6 weeks following hip fracture surgery. The clinician experience will be explored through online surveys completed pre- and post-implementation of intensive therapy and mapped to domains of the Theoretical Domains Framework (TDF). Translation and behaviour change success will be assessed using the Reach Effectiveness-Adoption Implementation Maintenance (RE-AIM) framework and a combination of qualitative and quantitative data collection methods. These data will assist with the development of an Implementation Toolkit aiding future translation into practice.

DISCUSSION

The embedded process evaluation will help understand the interplay between the implementation context and the intensive therapy intervention following surgery for low-trauma hip fracture. Understanding these mechanisms, if effective, will assist with transferability into other contexts and wider translation into practice.

TRIAL REGISTRATION

ACTRN 12622001442796.

Process evaluation of a pragmatic feasibility trial on smokeless tobacco cessation intervention delivered in dental hospitals

BACKGROUND

Article 14 of the WHO 'Framework Convention on Tobacco Control' recommends, that all oral healthcare providers provide support for tobacco cessation, to all patients. Despite evidence on the effectiveness of tobacco cessation interventions in dental settings, implementation remains low in most high-burden countries like Pakistan. A pragmatic pilot trial of a dentist-delivered behavioural support intervention for smokeless tobacco (ST) cessation, was conducted in dental hospitals in Pakistan. This paper presents the findings of the process evaluation of the trial.

METHODS

A mixed-method process evaluation of a multi-centre randomised control pilot trial of dentist-delivered behavioural support intervention ST cessation was conducted. The intervention included three sessions namely: pre-quit, quit and post-quit sessions. The process evaluation involved: semi-structured interviews with trial participants (n = 26, of which dental patients were n = 13 and participating dentists were n = 13 conducted from June-August 2022); and fidelity assessment of audio recordings of the intervention sessions (n = 29). The framework approach was used to thematically analyse the interview data.

RESULTS

Overall the trial procedures were well accepted, however, young patients expressed uneasiness over revealing their ST use status. The intervention was received positively by dentists and patients. Dentists identified some challenges in delivering behavioural support to their patients. Of these, some were related to the contents of the intervention whereas, others were related to the logistics of delivering the intervention in a clinical setting (such as workload and space). Acceptability of the intervention resources was overall low amongst young patients as they did not take the intervention resources home due to fear of their family members finding out about their ST use. The intervention was successful in achieving the intended impact (in those who engaged with the intervention), i.e., change in the patients' ST use behaviour. Giving up ST with the aid of behavioural support also had an unintended negative effect i.e., the use of harmful substances (cannabis, cigarettes) to give up ST use. Patients' satisfaction with their dental treatment seemed to influence the intervention outcome.

CONCLUSION

While there are many variables to consider, but for the participants of this study, behavioural support for abstinence delivered through dentists during routine dental care, appears to be an acceptable and practical approach in helping patients give up ST use, in a country like Pakistan, where negligible support is offered to ST users.

A process evaluation of the NIDUS-Professional dementia training intervention for UK homecare workers

INTRODUCTION

This process evaluation was conducted in parallel to the randomised controlled feasibility trial of NIDUS-Professional, a manualised remote dementia training intervention for homecare workers (HCWs), delivered alongside an individualised intervention for clients living with dementia and their family carers (NIDUS-Family). The process evaluation reports on: (i) intervention reach, dose and fidelity; (ii) contexts influencing agency engagement and (iii) alignment of findings with theoretical assumptions about how the intervention might produce change.

METHODS

We report proportions of eligible HCWs receiving any intervention (reach), number of sessions attended (dose; attending ≥4/6 main sessions was predefined as adhering), intervention fidelity and adherence of clients and carers to NIDUS-Family (attending all 6-8 planned sessions). We interviewed HCWs, managers, family carers and facilitators. We integrated and thematically analysed, at the homecare agency level, qualitative interview and intervention recording data.

RESULTS

32/141 (23%) of eligible HCWs and 7/42 (17%) of family carers received any intervention; most who did adhered to the intervention (89% and 71%). Intervention fidelity was high. We analysed interviews with 20/44 HCWs, 3/4 managers and 3/7 family carers, as well as intervention recordings involving 32/44 HCWs. All agencies reported structural challenges in supporting intervention delivery. Agencies with greater management buy-in had higher dose and reach. HCWs valued NIDUS-Professional for enabling group reflection and peer support, providing practical, actionable care strategies and increasing their confidence as practitioners.

CONCLUSION

NIDUS-Professional was valued by HCWs. Agency management, culture and priorities were key barriers to implementation; we discuss how to address these in a future trial.

Developing a questionnaire to evaluate an automated audit & feedback intervention: a Rand-modified Delphi method

BACKGROUND

Audit and feedback (A&F) is a widely used implementation strategy to evaluate and improve medical practice. The optimal design of an A&F system is uncertain and structured process evaluations are currently lacking. This study aimed to develop and validate a questionnaire to evaluate the use of automated A&F systems.

METHODS

Based on the Clinical Performance Feedback Intervention Theory (CP-FIT) and the REFLECT-52 (REassessing audit & Feedback interventions: a tooL for Evaluating Compliance with suggested besT practices) evaluation tool a questionnaire was designed for the purpose of evaluating automated A&F systems. A Rand-modified Delphi method was used to develop the process evaluation and obtain validation. Fourteen experts from different domains in primary care consented to participate and individually scored the questions on a 9-point Likert scale. Afterwards, the questions were discussed in a consensus meeting. After approval, the final questionnaire was compiled.

RESULTS

A 34-question questionnaire composed of 57 items was developed and presented to the expert panel. The consensus meeting resulted in a selection of 31 questions, subdivided into 43 items. A final list of 30 questions consisting of 42 items was obtained.

CONCLUSION

A questionnaire consisting of 30 questions was drawn up for the assessment and improvement of automated A&F systems, based on CP-FIT and REFLECT-52 theory and approved by experts. Next steps will be piloting and implementation of the questionnaire.

Kenya's Experience: Factors Enabling and Impeding the COVID-19 Response

This case study describes the country-level response to the COVID-19 pandemic in Kenya between February 2020 and May 2021. We organize the presentation of COVID-19 response strategies across the five stages of (a) engagement, (b) assessment, (c) planning, (d) action/implementation, and (e) evaluation. We describe the participatory monitoring and evaluation (M&E) process implemented in collaboration with the WHO Regional Office for Africa Monitoring and Evaluation Team. The M&E system was used to organize and make sense of emerging data regarding specific response activities and changing COVID incidence. We share the results of that collaborative sensemaking, with particular attention to our analysis of the factors that facilitated and those that impeded our pandemic response. We conclude with lessons learned and practical implications from Kenya's experience to help guide future country-level responses to rapidly changing public health crises.

Systematic review: What is the impact of triage implementation on clinical outcomes and process measures in low- and middle-income country emergency departments?

INTRODUCTION

Triage is widely regarded as an essential function of emergency care (EC) systems, especially in resource-limited settings. Through a systematic search and review of the literature, we investigated the effect of triage implementation on clinical outcomes and process measures in low- and middle-income country (LMIC) emergency departments (EDs).

METHODS

Structured searches were conducted using MEDLINE, CENTRAL, EMBASE, CINAHL, and Global Health. Eligible articles identified through screening and full-text review underwent risk-of-bias assessment using the Newcastle-Ottawa Scale. The quality of evidence for each effect measure was summarized using GRADE.

RESULTS

Among 10,394 articles identified through the search strategy, 58 underwent full-text review and 16 were included in the final synthesis. All utilized pre-/postintervention methods and a majority were single center. Effect measures included mortality, waiting time, length of stay, admission rate, and patient satisfaction. Of these, ED mortality and time to clinician assessment were evaluated most frequently. The majority of studies using these outcomes identified a positive effect, namely a reduction in deaths and waiting time among patients presenting for EC. The quality of the evidence was moderate for these measures but low or very low for all other outcomes and process indicators.

CONCLUSIONS

There is moderate quality of evidence supporting an association between the introduction of triage and a reduction in deaths and waiting time. Although the available data support the value of triage in LMIC EDs, the risk of confounding and publication bias is significant. Future studies will benefit from more rigorous research methods.

Pericardial Effusion Detection on Post-Mortem Computed Tomography Images Using Convolutional Neural Networks

Pericardial effusion can be a sign of significant underlying diease and, in some cases, may lead to death. Post-mortem computed tomography (PMCT) is a well-established tool to assist death investigation processes in the forensic setting. In practice, the scarcity of well-trained radiologists is a challenge in processing raw whole-body PMCT images for pericardial effusion detection. In this work, we propose a Pericardial Effusion Automatic Detection (PEAD) framework to automatically process raw whole-body PMCT images to filter out the irrelevant images with heart organ absent and focus on pericardial effusion detection. In PEAD, the standard convolutional neural network architectures of VGG and ResNet are carefully modified to fit the specific characteristics of PMCT images. The experimental results prove the effectiveness of the proposed framework and modified models. The modified VGG and ResNet models achieved superior detection accuracy than the standard architecture with reduced processing speed.

The symptom to assessment pathway for suspected chronic limb-threatening ischaemia (CLTI) affects quality of care: a process mapping exercise

BACKGROUND

Delays in the pathway from first symptom to treatment of chronic limb-threatening ischaemia (CLTI) are associated with worse mortality and limb loss outcomes. This study examined the processes used by vascular services to provide urgent care to patients with suspected CLTI referred from the community.

METHODS

Vascular surgery units from various regions in England were invited to participate in a process mapping exercise. Clinical and non-clinical staff at participating units were interviewed, and process maps were created that captured key staff and structures used to create processes for referral receipt, triage and assessment at the units.

RESULTS

Twelve vascular units participated, and process maps were created after interviews with 45 participants. The units offered multiple points of access for urgent referrals from general practitioners and other community clinicians. Triage processes were varied, with units using different mixes of staff (including medical staff, podiatrists and s) and this led to processes of varying speed. The organisation of clinics to provide slots for 'urgent' patients was also varied, with some adopting hot clinics, while others used dedicated slots in routine clinics. Service organisation could be further complicated by separate processes for patients with and without diabetes, and because of the organisation of services regionally into vascular networks that had arterial and non-arterial centres.

CONCLUSIONS

For referred patients with symptoms of CLTI, the points of access, triage and assessment processes used by vascular units are diverse. This reflects the local context and ingenuity of vascular units but can lead to complex processes. It is likely that benefits might be gained from simplification.

How much convergence exists between registered process measures and patient reported experience measures? A study on Catalan primary healthcare

The use of quality measures is important for transparency and the continuous improvement of performance. However, we do not know enough about the relationship between registered process measures and patient reported experience measures (PREMs) in primary healthcare. Recent studies point to areas of convergence that run contrary anticipated trends. This is a relevant question for healthcare management and governments as their position is stronger when system's guidelines and targets also matter to patients or, vice versa, when patient-centered measures are used to develop new process measures. Our aim is to study both type of measures, their logic and their level of convergence. We also assess the relationship between PREMs, patients' demographic characteristics and area socioeconomic level. We estimated pairwise correlations with patient experience aggregated at the health-center level and a series of multilevel regression models to assess the adjusted effect of four registered process measures on ratings of patient experience at the patient level. We use patient experience as measured by survey data, two composite quality indices and two single indicators regularly computed by the Catalan Health Service. Continuity of care with the same doctor and accessibility are positively associated with patient experience. No relationship was observed in the index created to measure quality of assistance. The index measuring the quality of prescriptions was positively associated with patient experience but only when analyzed separately. We conclude that registered process measures and PREMs are not entirely independent, hence improvements of the management side have the potential to impact patient experience.

The France PCI registry: Design, methodology and key findings

BACKGROUND

Obstructive coronary artery disease is the main cause of death worldwide. By tracking events and gaining feedback on patient management, the most relevant information is provided to public health services to further improve prognosis.

AIMS

To create an inclusive and accurate registry of all percutaneous coronary intervention (PCI) procedures performed in France, to assess and improve the quality of care and create research incentives. Also, to describe the methodology of this French national registry of interventional cardiology, and present early key findings.

METHODS

The France PCI registry is a multicentre observational registry that includes consecutive patients undergoing coronary angiography and/or PCI. The registry was set up to provide online data analysis and structured reports of PCI activity, including process of care measures and assessment of risk-adjusted outcomes in all French PCI centres that are willing to participate. More than 150 baseline data items, describing demographic status, PCI indications and techniques, and in-hospital and 1-year outcomes, are captured into local reporting software by medical doctors and local research technicians, with subsequent encryption and internet transfer to central data servers. Annual activity reports and scoring tools available on the France PCI website enable users to benchmark and improve clinical practices. External validation and consistency assessments are performed, with feedback of data completeness to centres.

RESULTS

Between 01 January 2014 and 31 December 2022, participating centres increased from six to 47, and collected 364,770 invasive coronary angiograms and 176,030 PCIs, including 54,049 non-ST-segment elevation myocardial infarction cases and 31,631 ST-segment elevation myocardial infarction cases. Fifteen studies stemming from the France PCI registry have already been published.

CONCLUSIONS

This fully electronic, daily updated, high-quality, low-cost, national registry is sustainable, and is now expanding. Merging with medicoeconomic databases and nested randomized scientific studies are ongoing steps to expand its scientific potential.

An "Engage to Sustain" Intervention to Improve Process Performance Measures in Ambulatory Care

In ambulatory care, monitoring process performance measures (PPMs) is essential to meet regulatory requirements, establish targets for care, seek reimbursement, and evaluate patient care responsibilities. We implemented a comprehensive program, "Engage to Sustain," for licensed practical nurses (LPNs) and certified medical assistants (CMAs) to practice at the top of their licensure/certification. Screening rates for 4 key PPMs (depression screening, fall risk screening, and tobacco use screening and counseling) markedly increased following this intervention across 18 ambulatory departments with more than 2 million patient visits. These results suggest that shifting responsibilities for patient screening from physicians and advanced practitioners to LPNs and CMAs may improve screening rates.

Improving personalised care, through the development of a service evaluation tool to assess, understand and monitor delivery

Systematically implementing personalised care has far reaching benefits to individuals, communities and health and social care systems. If done well, personalised care can result in better health outcomes and experiences, more efficient use of health services and reduced health inequalities. Despite these known benefits, implementation of personalised care has been slow. Evaluation is an important step towards achieving the ambition of universally delivered personalised care. There are currently few comprehensive assessments or tools that are designed to understand the implementation of personalised care at a service or system level, or the cultural, practical and behavioural factors influencing this. The aim of this paper is to describe the development and testing of a system-wide evaluation tool. The tool offers a process through which healthcare systems can better understand the current delivery of personalised care and the factors influencing this. With a focus on implementation, the development of the tool was informed by the Consolidated Framework for Implementation Research, and its content is structured using behaviour change theory (COM-B Theory of Behaviour Change Model). The tool consists of four mirrored surveys, which were developed using an iterative exploratory design. This included a series of testing cycles, in which its structure and content were continually refined. To date, it has been used by 24 clinical services, involving 397 service users, 313 front-line practitioners, 73 service managers and 40 commissioners. These services have used the evaluation process to initiate quality improvement, targeted at one of the more aspects of personalised care. The use of the COM-B model increases the likelihood of those improvements being sustained, through identification of the core factors that enable or limit personalised care behaviours among healthcare staff. We have shown this process to be applicable in a wide range of settings, thus it potentially has broad applicability as a tool for cultural change and quality improvement. The next stage of this work will focus on implementation and evaluation, to fully understand if and how the tool can be used to drive improvements in personalised care delivery.

Assessment of the Psychosocial Care Center multidisciplinary team from users' and family members' perspective

OBJECTIVES

to assess the multidisciplinary team of a Psychosocial Care Center I from users' and family members' perspective.

METHODS

an evaluative study, anchored in the fourth generation evaluation theoretical-methodological framework, carried out in a Psychosocial Care Center I, from September 2021 to March 2022. Eleven users and 06 family members participated. Data were collected through non-participant observation, individual interviews and negotiation sessions, and analyzed using the Constant Comparative Method, using the MAXQDA software.

RESULTS

the team develops its care based on individual and collective care, with integrated and complementary work by professionals. They seek to facilitate treatment initiation and continuation, considering health needs and offering support, understanding and guidance to users and their families.

FINAL CONSIDERATIONS

the multidisciplinary team's work is based on the psychosocial paradigm, which can qualify care and strengthen the service role in the mental health network.

Truth of Colorectal Enhanced Recovery Programs: Process Measure Compliance in 151 Hospitals

BACKGROUND

Commonly cited studies have reported substantial improvements (defined as >20%) in process measure compliance after implementation of colorectal enhanced recovery programs (ERPs). However, hospitals have anecdotally reported difficulties in achieving similar improvement gains. This study evaluates improvement uniformity among 151 hospitals exposed to an 18-month implementation protocol for 6 colorectal ERP process measures (oral antibiotics, mechanical bowel preparation, multimodal pain control, early mobilization, early liquid intake, and early solid intake).

STUDY DESIGN

One hundred fifty-one hospitals implemented a colorectal ERP with pathway, educational and supporting materials, and data capture protocols; 906 opportunities existed for process compliance improvement across the cohort (151 hospitals × 6 process measures). However, 240 opportunities were excluded due to high starting compliance rates (ie compliance >80%) and 3 opportunities were excluded because compliance rates were recorded for fewer than 2 cases. Thus, 663 opportunities for improvement across 151 hospitals were studied.

RESULTS

Of 663 opportunities, minimal improvement (0% to 20% increase in compliance) occurred in 52% of opportunities, substantial improvement (>20% increase in compliance) in 20%, and worsening compliance occurred in 28%. Of the 6 processes, multimodal pain control and use of oral antibiotics improved the most.

CONCLUSIONS

Contrary to published ERP literature, the majority of study hospitals had difficulty improving process compliance with 80% of the opportunities not achieving substantial improvement. This discordance between ERP implementation success rates reported in the literature and what is observed in a large sample could reflect differences in hospitals' culture or characteristics, or a publication bias. Attention needs to be directed toward improving ERP adoption across the spectrum of hospital types.

Relationships Between EHR-Based Audit Log Data and Physician Burnout and Clinical Practice Process Measures

OBJECTIVE

To explore the relationship of electronic health record (EHR)-based audit log data with physician burnout and clinical practice process measures.

METHODS

From September 4 to October 7, 2019, we surveyed physicians in a larger academic medical department and matched responses to August 1 through October 31, 2019, EHR-based audit log data. Multivariable regression analysis evaluated the relationship between log data and burnout and the interrelationship between log data and turnaround time for In Basket messages and percentage of encounters closed within 24 hours.

RESULTS

Of the 537 physicians surveyed, 413 (77%) responded. On multivariable analysis, number of In Basket messages received per day (each additional message: odds ratio, 1.04 [95% CI, 1.02 to 1.07]; P<.001) and time spent in the EHR outside scheduled patient care (each additional hour: odds ratio, 1.01 [95% CI, 1.00 to 1.02]; P=.04) were associated with burnout. Time spent doing In Basket work (each additional minute: parameter estimate, -0.11 [95% CI, -0.19 to -0.03]; P=.01) and in the EHR outside scheduled patient care (each additional hour: parameter estimate, 0.04 [95% CI, 0.01 to 0.06]; P=.002) were associated with turnaround time (days per message) for In Basket messages. None of the variables explored were independently associated with percentage of encounters closed within 24 hours.

CONCLUSION

Electronic health record-based audit log data of workload relate to odds of burnout and responsiveness to patient-related inquiries and results. Further study is needed to determine whether interventions that reduce the number of and time spent doing In Basket messages or time spent in the EHR outside scheduled patient care reduce physician burnout and improve clinical practice process measures.

Design and Implementation of a Chain-Type Direct Push Drilling Rig for Contaminated Sites

For sites where volatile organic compounds are present, the direct push method, in combination with other sensors for investigation, is a powerful method. The investigation process is an integrated drilling and sensing process, but the trajectory of the probe carrying the sensor is ambiguous. This paper explores and introduces the application of a chain-type direct push drilling rig by designing and building a chain-type direct push miniature drilling rig. This rig allows for indoor experimental studies of direct push trajectories. The chain-type direct push drilling model is proposed based on the mechanism of chain transmission. The drilling rig provides a steady direct thrust through the chain, which is driven by a hydraulic motor. In addition, the drilling tests and results described prove that the chain could be applied to direct push drilling. The chain-type direct push drilling rig can drill to a depth of 1940 mm in single-pass and up to 20,000 mm in multiple passes. The test results also indicate that it drills a total length of 462.461 mm and stops after 87.545 s of operation. The machine can provide a drilling angle of 0-90° and keep the borehole angle fluctuating within 0.6° with the characteristics of strong adjustability, flexibility, continuity, stability, and low disturbance, which is of great value and significance for studying the drilling trajectory of direct push tools and obtaining more accurate investigation data.

The Validity of the SEEV Model as a Process Measure of Situation Awareness: The Example of a Simulated Endotracheal Intubation

OBJECTIVE

In the context of anesthesiology, we investigated whether the salience effort expectancy value (SEEV) model fit is associated with situation awareness and perception scores.

BACKGROUND

The distribution of visual attention is important for situation awareness-that is, understanding what is going on-in safety-critical domains. Although the SEEV model has been suggested as a process situation awareness measure, the validity of the model as a predictor of situation awareness has not been tested.

METHOD

In a medical simulation, 31 senior and 30 junior anesthesiologists wore a mobile eye tracker and induced general anesthesia into a simulated patient. When inserting a breathing tube into the mannequin's trachea (endotracheal intubation), the scenario included several clinically relevant events for situation awareness and general events in the environment. Both were assessed using direct awareness measures.

RESULTS

The overall SEEV model fit was good with no difference between junior and senior anesthesiologists. Overall, the situation awareness scores were low. As expected, the SEEV model fits showed significant positive correlations with situation awareness level 1 scores.

CONCLUSION

The SEEV model seems to be suitable as a process situation awareness measure to predict and investigate the perception of changes in the environment (situation awareness level 1). The situation awareness scores indicated that anesthesiologists seem not to perceive the environment well during endotracheal intubation.

APPLICATION

The SEEV model fit can be used to capture and assess situation awareness level 1. During endotracheal intubation, anesthesiologists should be supported by technology or staff to notice changes in the environment.

Shared decision making process measures and patient problems

OBJECTIVES

Purposeful SDM posits four modes of shared decision making (SDM). The use of each mode depends on the type of problem of care that is being addressed. We sought to identify how current observer-based SDM measures apply to each mode of Purposeful SDM.

METHODS

Four coders, working independently, evaluated 192 items pertaining to 12 observer-based SDM process measures. They classified the items into 6 themes that vary across Purposeful SDM modes and then into one of the four modes (weighing, negotiating, problem-solving, developing insight). Disagreements were resolved by consensus.

RESULTS

The items were classified as pertaining to the following themes: problem (28), roles/participation (84), options (62), preferences (21), decision (15), and evaluation (6). They were then classified as pertaining particularly to the SDM modes of weighing (54), negotiating (5), problem-solving (0), and developing insight (0) modes, with 191 items applying broadly to all modes of Purposeful SDM.

CONCLUSIONS

Observer-based SDM measures describe behaviors pertinent to all modes but lack items sensitive to behaviors particular to some modes of SDM.

PRACTICE IMPLICATIONS

New or revised observer-based measures of the SDM process could help estimate the extent to which the appropriate SDM mode is being used to address the patient's problem.

Time to OR for patients with abdominal gunshot wounds: A potential process measure to assess the quality of trauma care?

BACKGROUND

Abdominal gunshot wounds (GSWs) require rapid assessment and operative intervention to reduce the risk of death and complications. We sought to determine if time to the operating room (OR) might be a useful process measure for the assessment of trauma care quality. We evaluated the facility benchmark time to OR for patients with serious injury and whether this was associated with lower rates of complications and mortality.

METHODS

We evaluated time to OR for adult patients with an abdominal GSW presenting in shock to American College of Surgeons Trauma Quality Improvement Program centers from 2015 to 2020. We calculated the 75th percentile time to the OR for each center and characterized centers as average, slow, or fast. We compared patient and facility characteristics across outlier status, as well as risk-adjusted complications and mortality using hierarchical multivariable logistic regression models.

RESULTS

There were 4,027 patients in 230 centers that met the inclusion criteria. Mortality was 28%. There were 61 (27%) fast and 52 (23%) slow centers. The median time for slow centers was 83 minutes (68-94 minutes) compared with fast centers, 35 minutes (32-38 minutes). Injury Severity Score and emergency department vital signs were similar across centers. Fast hospitals had higher total case volumes, more cases per surgeon, and were more likely to be Level I centers. Patients cared for in these centers had similar risk-adjusted rates of complications and mortality.

CONCLUSION

Time to OR for patients with abdominal GSWs and shock might be a useful process measure to evaluate rapid decision making and OR access. Surgeon and center experience as measured by annual case volumes, coupled with a rapid surgical response required through Level I trauma center standards might be contributory. There was no association between outlier status and complications or mortality suggesting other factors apart from time to the OR are of greater significance.

LEVEL OF EVIDENCE

Therapeutic/care management, Level IV.

Use of Theoretical Frameworks in the Development and Testing of Palliative Care Interventions

CONTEXT

Palliative care (PC) research has grown over the last 20 years. Yet, the causal components and pathways of PC interventions remain unclear.

OBJECTIVES

To document the prevalence and application of theoretical frameworks in developing and testing PC interventions.

METHODS

We conducted a secondary analysis of previously published systematic reviews of PC randomized clinical trials. Trials were evaluated for explicit mention of a theoretical framework, process or delivery model, or clinical practice guideline that supported the development of the intervention. We used a structured data extraction form to document study population, outcomes, and whether and how authors used a theoretical framework, process/delivery model, or clinical practice guideline. We applied an adapted coding scheme to evaluate use of theoretical frameworks.

RESULTS

We reviewed 85 PC trials conducted between 1984 and 2021. Thirty-eight percent (n = 32) of trials explicitly mentioned a theoretical framework, process or delivery model, or clinical practice guideline as a foundation for the intervention design. Only nine trials included a theoretical framework, while the remaining 23 cited a process/delivery model or clinical practice guideline.

CONCLUSION

Most PC trials do not cite a theoretical foundation for their intervention design. Future work should focus on developing and validating new theoretical frameworks and modifying existing theories and models to better explain the mechanisms of the variety of PC interventions.

Learning From England's Best Practice Tariff: Process Measure Pay-for-Performance Can Improve Hip Fracture Outcomes

OBJECTIVE

The objective of this study was to evaluate England's Best Practice Tariff (BPT) and consider potential implications for Medicare patients should the US adopt a similar plan.

SUMMARY BACKGROUND DATA

Since the beginning of the Affordable Care Act, Medicare has renewed efforts to improve the outcomes of older adults through introduction of an expanding set of alternative-payment models. Among trauma patients, recommended arrangements met with mixed success given concerns about the heterogeneous nature of trauma patients and resulting outcome variation. A novel approach taken for hip fractures in England could offer a viable alternative.

METHODS

Linear regression, interrupted time-series, difference-in-difference, and counterfactual models of 2000 to 2016 Medicare (US), HES-APC (England) death certificate-linked claims (≥65 years) were used to: track US hip fracture trends, look at changes in English hip fracture trends before-and-after BPT implementation, compare changes in US-versus-English mortality, and estimate total/theoretical lives saved.

RESULTS

A total of 806,036 English and 3,221,109 US hospitalizations were included. After BPT implementation, England's 30-day mortality decreased by 2.6 percentage-points (95%CI: 1.7-3.5) from a baseline of 9.9% (relative reduction 26.3%). 90- and 365-day mortality decreased by 5.6 and 5.4 percentage-points. 30/90/365-day readmissions also declined with a concurrent shortening of hospital length-of-stay. From 2000 to 2016, US outcomes were stagnant (P > 0.05), resulting in an inversion of the countries' mortality and >38,000 potential annual US lives saved.

CONCLUSIONS

Process measure pay-for-performance led to significant improvements in English hip fracture outcomes. As efforts to improve US older adult health continue to increase, there are important lessons to be learned from a successful initiative like the BPT.

Using a Developmental Approach to Evaluation Capacity Building in Home Visiting

The Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program, administered by the Health Resources and Service Administration in collaboration with the Administration for Children and Families, provides evidence-based home visiting services across 50 states, the District of Columbia, and five U.S. territories. MIECHV invests in comprehensive technical assistance (TA) to support and build the capacity of awardees to conduct rigorous evaluations of their programs. Throughout the course of the evaluation process, awardees received TA from the Design Options for Home Visiting Evaluation project. Between 2011 and 2020, over 173 state-led evaluations have been conducted. Individual technical assistance (TA) modalities included conference calls, emails, interactive and individualized webinars, developing and sharing resources, and involvement of content experts. When issues and challenges were identified across multiple awardees, Design Options for Home Visiting Evaluation (DOHVE) delivered targeted group TA to awardees with common needs that may benefit from peer-to-peer learning. When cross-cutting issues and challenges were identified, DOHVE used universal approaches such as webinars and guidance documents that were made available to all awardees.Through the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program, efforts have been taken to promote awardee capacity by targeting all phases of the evaluation process, including planning, implementing, and disseminating findings and providing TA that is responsive and tailored to meet awardee-specific needs. This approach enabled DOHVE to support MIECHV awardees in expanding knowledge of their programs and the evidence base on home visiting. Lessons learned from TA provision highlight the importance of developing feasible plans and providing ongoing support during implementation.

Adaptation of the Measure of Processes of Care for the Evaluation of Family-Centeredness of Services in India

OBJECTIVE

This study aims to (1) adapt the Measure of Processes of Care (MPOC-20) for use in India and (2) evaluate family-centered services for children with disabilities and their caregivers in an urban Indian context.

METHODS

In this cross-sectional observational study, we translated the MPOC-20 into Hindi. Caregivers of children diagnosed with developmental disabilities who read and/or understood Hindi and had received services for ≥6 months were recruited. The psychometric properties of the Hindi MPOC-20 were assessed using factor analysis followed by reliability analyses. The Hindi MPOC-20 was used to assess caregiver perceptions about the family-centeredness of services delivered between October 2016 and February 2017 at Ummeed Child Development Center.

RESULTS

Of the 170 eligible children, 141 (83%) comprised the study sample. Most were boys (66%) with a median age of 67 months. Factor analyses yielded a 4-factor scale with items loading differently from the original measure. The resulting Hindi MPOC-20 had acceptable to good internal consistency (Cronbach's alpha of scales: 0.71-0.86). On the Hindi MPOC-20, Respectful and Coordinated Care, Enabling Partnership, and Providing Specific Information were identified as strengths and Providing General Information as a relative limitation of the service by caregivers across different income and education groups.

CONCLUSION

The Hindi MPOC-20 shows acceptable psychometric properties for use with caregivers of children with disabilities in India. The availability of Hindi MPOC-20 paves the way for the assessment of the family-centeredness of services in India and provides a roadmap for adaptations in other low- and middle-income countries.