Exploring the barriers to rigorous monitoring and evaluation of health systems strengthening activities: qualitative evidence from international development partners

The number of health systems strengthening (HSS) programs has increased in the last decade. However, a limited number of studies providing robust evidence for the value and impact of these programs are available. This study aims to identify knowledge gaps and challenges that impede rigorous monitoring and evaluation (M&E) of HSS, and to ascertain the extent to which these efforts are informed by existing technical guidance. Interviews were conducted with HSS advisors at United States Agency for International Development-funded missions as well as senior M&E advisors at implementing partner and multilateral organizations. Findings showed that mission staff do not use existing technical resources, either because they do not know about them or do not find them useful. Barriers to rigorous M&E included a lack suitable of indicators, data limitations, difficulty in demonstrating an impact on health, and insufficient funding and resources. Consensus and collaboration between international health partners and local governments may mitigate these challenges. Copyright © 2016 John Wiley & Sons, Ltd.

Putting Management Capacity Building at the Forefront of Health Systems Strengthening: Comment on "Management Matters: A Leverage Point for Health Systems Strengthening in Global Health"

The current limited focus on management in global health activities is highly problematic given the amounts of financial and human resources that are pouring into health system strengthening interventions and the complexity of clinical operations across settings. By ensuring that public health and healthcare practitioners in domestic and international settings receive management training in their educational programs and that we build management capacity among individuals already in the health workforce, we can begin to prepare for more effective health systems strengthening efforts. Rigorous evaluation of health systems strengthening and the impact of management capacity building is crucial to building evidence for the field.

What Matters in Recruiting Public Health Employees: Considerations for Filling Workforce Gaps

We examined factors that influence the decision to join the public health workforce. In this cross-sectional study, we used 2010 secondary data representing 6939 public health workers. Factors influencing the decision to take jobs in public health were significantly associated with specific previous employment settings. Respondents generally rated organizational factors as more influential than personal factors in terms of their decision to work in governmental public health. Leaders should consider tailoring recruitment efforts to maximize job uptake and enhance the potential for long-term retention.

Analyzing Determinants of Hospitals’ Accountable Care Organizations Participation

Accountable care organizations (ACOs) are rapidly being implemented across the United States, but little is known about what environmental and organizational factors are associated with hospital participation in ACOs. Using resource dependency theory, this study examines external environmental characteristics and organizational characteristics that relate to hospital participation in Medicare ACOs. Results indicate hospitals operating in more munificent environments (as measured by income per capita: β = 0.00002, p < .05) and more competitive environments (as measured by Health Maintenance Organization penetration: β = 1.86, p < .01) are more likely to participate in ACOs. Organizational characteristics including hospital ownership, health care system membership, electronic health records implementation, hospital type, percentage of Medicaid inpatient discharge, and number of nursing home beds per 1,000 population over 65 are also related to ACO participation. Should the anticipated benefits of ACOs be realized, findings from this study can guide strategies to encourage hospitals that have not gotten involved in ACOs.

Local Public Health Department Characteristics Associated With Likelihood to Participate in National Accreditation

OBJECTIVES

We examined factors associated with completing, initiating, or intending to pursue voluntary national accreditation among local health departments (LHDs).

METHODS

We examined National Association of County and City Health Officials 2010 and 2013 profile data in a pooled cross-sectional design with bivariate and multivariable regression analyses. We conducted individual multivariable models with interest in accreditation and likely to accredit as outcome variables, comparing changes between 2010 and 2013.

RESULTS

LHDs with formal quality improvement programs are significantly more likely to have initiated or completed the accreditation process (odds ratio [OR] = 7.99; confidence interval [CI] = 1.79, 35.60), to be likely to accredit (OR = 2.41; CI = 1.65, 3.50), or to report an interest in accreditation (OR = 2.32; CI = 1.67, 3.20). Interest was lower among LHDs in 2013 than in 2010 (OR = 0.56; CI = 0.41, 0.77); however, there was no difference regarding being likely to accredit. LHDs with a high number of full-time equivalent employees were more likely to indicate being likely to accredit or interest in accreditation.

CONCLUSIONS

Quality improvement may facilitate the accreditation process or be a proxy measure for an unmeasurable LHD attribute that predicts accreditation.

State barriers to appropriating public health emergency response funds during the 2009 H1N1 response

OBJECTIVES

We examined state-specific administrative barriers to allocating 2009 H1N1 influenza public health emergency response (PHER) funds.

METHODS

We conducted a qualitative review of PHER grants management reports to identify and code barriers reported by states in allocating funds. Using linear regression, we examined the relationship between the percentage of funds allocated and each individual barrier and, separately, the cumulative effect of multiple barriers.

RESULTS

States reported 6 barrier types, including regulatory issues (n = 14, or 28%), contracting issues (n = 14, or 28%), purchasing issues (n = 6, or 12%), legislative issues (n = 5, or 10%), staffing issues (n = 5, or 10%), and issues transferring funds between state and local health departments (n = 4, or 8%). In multivariate models, having experienced a purchasing barrier was associated with a significant decrease in PHER allocation (B = -26.4; P = .018). Separately, the cumulative effect of having 3 barriers was associated with a decrease in PHER allocation (B = -16.0; P = .079).

CONCLUSIONS

Purchasing barriers were associated with delayed use of PHER funds. Moreover, the cumulative effect of any 3 barriers hampered the allocation of funds. Understanding barriers to using funds can inform future funding guidance for improved efficiency of response efforts.

Deciphering the Imperative: Translating Public Health Quality Improvement into Organizational Performance Management Gains

With the launching of the national public health accreditation program under the auspices of the Public Health Accreditation Board (PHAB), health department momentum around quality improvement adoption has accelerated. Domain 9 of the PHAB standards (one of 12 domains) focuses on evaluation and improvement of performance and is acting as a strong driver for quality improvement and performance management implementation within health departments. Widespread adoption of quality improvement activities in public health trails that in other US sectors. Several performance management models have received broad acceptance, including models among government and nonprofits. A model specifically for public health has been developed and is presented herein. All models in current use reinforce customer focus; streamlined, value-added processes; and strategic alignment. All are structured to steer quality improvement efforts toward organizational priorities, ensuring that quality improvement complements performance management. High-performing health departments harness the synergy of quality improvement and performance management, providing powerful tools to achieve public health strategic imperatives.

Factors related to health information exchange participation and use

This study examines factors facilitating and delaying participation and use of the Health Information Exchange (HIE) in Louisiana. Semi-structured qualitative interviews were conducted with health care representatives throughout the state. Findings suggest that Meaningful Use requirements are a critical factor influencing the decision to participate in the HIE, specifically the mandate that hospitals be able to electronically transfer summary of care documents. Creating buy-in within a few large hospital networks legitimized the HIE and hastened interest in those markets. Fees charged by electronic health record (EHR) vendors to develop HIE interfaces have been prohibitive. Funding from the federal incentive program is intended to offset the costs associated with EHR implementation and increase the likelihood that HIEs can provide value to the population; however, costs and time delays of EHR interface development may be key barriers to fully integrated HIEs. State HIEs may benefit from targeted involvement of state health care leaders who can champion the potential value of the HIE.

Impact of Alabama's immigration law on access to health care among Latina immigrants and children: implications for national reform

We conducted in-depth interviews in May to July 2012 to evaluate the effect of Alabama's 2011 omnibus immigration law on Latina immigrants and their US- and foreign-born children's access to and use of health services. The predominant effect of the law on access was a reduction in service availability. Affordability and acceptability of care were adversely affected because of economic insecurity and women's increased sense of discrimination. Nonpregnant women and foreign-born children experienced the greatest barriers, but pregnant women and mothers of US-born children also had concerns about accessing care. The implications of restricting access to health services and the potential impact this has on public health should be considered in local and national immigration reform discussions.

Relationship between food safety and critical violations on restaurant inspections: an empirical investigation of bacterial pathogen content

While various safety control measures exist within the U.S. food system, foodborne illness remains a costly and persistent problem. The purpose of the study described here was to examine the relationship between violations of critical restaurant inspection items ("critical items") and food safety as measured by the bacterial load of illness-causing pathogens. Specifically, the authors' study looked at bacterial pathogens present in foods of two groups of restaurants, those that consistently scored poorly on critical items as compared to restaurants that performed superiorly in the same types of evaluation in Jefferson County, Alabama. Laboratory analyses indicated that 35.7% of the foods tested had detectable levels of Staphylococcus aureus, but no difference occurred between the two groups of restaurants. No other bacterial pathogens were found in any of the tested samples. A total of 45.2% of the food samples were received outside of recommended temperatures. Findings draw attention to the ongoing need to improve temperature control and hygienic practices, specifically handwashing practices, in restaurants.

A taxonomy of state public health preparedness units: an empirical examination of organizational structure

OBJECTIVE

State public health preparedness units (SPHPUs) were developed in response to federal funding to improve response to disasters: a responsibility that had not traditionally been within the purview of public health. The SPHPUs were created within the existing public health organizational structure, and their placement may have implications for how the unit functions, how communication takes place, and ultimately how well the key responsibilities are performed. This study empirically identifies a taxonomy of similarly structured SPHPUs and examines whether this structure is associated with state geographic, demographic, and threat-vulnerability characteristics.

DESIGN

Data representing each SPHPU were extracted from publically available sources, including organizational charts and emergency preparedness plans for 2009. A cross-sectional segmentation analysis was conducted of variables representing structural attributes.

SETTING AND PARTICIPANTS

Fifty state public health departments.

MAIN OUTCOME MEASURES

Variables representing "span of control" and "hierarchal levels" were extracted from organizational charts. Structural "complexity" and "centralization" were extracted from state emergency preparedness documents and other secondary sources.

RESULTS

On average, 6.6 people report to the same manager as the SPHPU director; 2.1 levels separate the SPHPU director from the state health officer; and a mean of 13.5 agencies collaborate with SPHPU during a disaster. Despite considerable variability in how SPHPUs had been structured, results of the cluster and principal component analysis identified 7 similarly structured groups. Neither the taxonomic groups nor the individual variables representing structure were found to be associated with state characteristics, including threat vulnerabilities.

CONCLUSIONS

Our finding supports the hypothesis that SPHPUs are seemingly inadvertently (eg, not strategically) organized. This taxonomy provides the basis for which future research can examine how SPHPU structure relates to performance measures and preparedness strategies.

Text messaging in health care: a systematic review of impact studies

BACKGROUND

Studies suggest text messaging is beneficial to health care; however, no one has synthesized the overall evidence on texting interventions. In response to this need, we conducted a systematic review of the impacts of text messaging in health care.

METHODS

PubMed database searches and subsequent reference list reviews sought English-language, peer-reviewed studies involving text messaging in health care. Commentaries, conference proceedings, and feasibilities studies were excluded. Data was extracted using an article coding sheet and input into a database for analysis.

RESULTS

Of the 61 papers reviewed, 50 articles (82%) found text messaging had a positive effect on the primary outcome. Average sample sizes in articles reporting positive findings (n=813) were significantly larger than those that did not find a positive impact (n=178) on outcomes (p = 0.032). Articles were categorized into focal groups as follows: 27 articles (44.3%) investigated the impact of texting on disease management, 24 articles (39.3%) focused texting's impact to public health related outcomes, and 10 articles (16.4%) examined texting and its influence on administrative processes. Articles in focal groups differed by the purpose of the study, direction of the communication, and where they were published, but not in likelihood of reporting a positive impact from texting.

CONCLUSIONS

Current evidence indicates that text messaging health care interventions are largely beneficial clinically, in public health related uses, and in terms of administrative processes. However, despite the promise of these findings, literature gaps exist, especially in primary care settings, across geographic regions and with vulnerable populations.

EHR adoption among doctors who treat the elderly

OBJECTIVES

The purpose of this study is to examine Electronic Health Record (EHR) adoption among Florida doctors who treat the elderly. This analysis contributes to the EHR adoption literature by determining if doctors who disproportionately treat the elderly differ from their counterparts with respect to the utilization of an important quality-enhancing health information technology application.

METHODS

This study is based on a primary survey of a large, statewide sample of doctors practising in outpatient settings in Florida. Logistic regression analysis was used to determine whether doctors who treat a high volume of elderly (HVE) patients were different with respect to EHR adoption.

RESULTS

Our analyses included responses from 1724 doctors. In multivariate analyses controlling for doctor age, training, computer sophistication, practice size and practice setting, HVE doctors were significantly less likely to adopt EHR. Specifically, compared with their counterparts, HVE doctors were observed to be 26.7% less likely to be utilizing an EHR system (OR=0.733, 95% CI 0.547-0.982). We also found that doctor age is negatively related to EHR adoption, and practice size and doctor computer savvy-ness is positively associated.

CONCLUSIONS

Despite the fact that EHR adoption has improved in recent years, doctors in Florida who serve the elderly are less likely to adopt EHRs. As long as HVE doctors are adopting EHR systems at slower rates, the elderly patients treated by these doctors will be at a disadvantage with respect to potential benefits offered by this technology.