Understanding Post-occupancy Evaluation Processes for Public Healthcare Facilities in Australia and Aotearoa New Zealand

OBJECTIVE

The following research paper seeks to explore how post-occupancy evaluations (POEs) are undertaken in the nine health jurisdictions across Australia and Aotearoa New Zealand and investigate if the process can be strengthened to better inform healthcare design and investment.

BACKGROUND

Healthcare expenditure in both nations is increasing, and the rigorous evaluation of healthcare facilities can provide evidence to improve their return on investment. A POE is a research method used to undertake this analysis, usually 12 months after a facility has been occupied. There is limited information available about how POEs are undertaken in each jurisdiction, and there has never been research conducted to understand these processes across the region.

METHODS

Focus groups were conducted with participants from the government health organization in each jurisdiction to collect qualitative data regarding various aspects of POE processes and barriers to undertaking POEs.

RESULTS

Only five of the nine jurisdictions undertake POEs on healthcare facilities (with varied frequencies), and there is no standardized framework in use. However, every jurisdiction does undertake a "benefits realization" process. There is limited involvement of external consultants in POEs or benefits realization processes. POE benchmarks should be established at project commencement, and POE results should then inform future projects. Top-down support is required for POEs to occur.

CONCLUSIONS

The primary conclusion is that strengthening any evaluation process requires a nuanced approach in each jurisdiction to account for their unique context and challenges. Regular rigorous evaluations are required to feed results into the Australasian Health Facility Guidelines and encourage innovative facility design.

Readiness-Based Implementation of Electronic Health Records: A Survey of Jordanian Nurses

Electronic health record (EHR) implementation is expanding worldwide to achieve the benefits of that technology, but it is reported in the literature as a "disruptive" change to the work environment in which all health-care workers need to be ready for the change, to enhance adoption and harvest the benefits. Jordan has rolled out a national EHR system. This study explored EHR implementation readiness, levels of realizing the benefits of EHR, and adoption among Jordanian nurses, using a self-report questionnaire at nine governmental hospitals in Jordan. A total of 462 registered nurses participated in the study. Results showed that nurses have moderate levels of readiness for EHR implementation, but higher levels of EHR benefits realization and adoption. All health-care workers' readiness for EHR implementation must be assessed regularly before, during, and after EHR implementation. Readiness-based roll-out can be used as a strategy in implementing EHR systems. Introducing a large-scale change management program is recommended to assess readiness, guide roll-out plans, enhance EHR implementation readiness, improve benefits realization, and increase EHR adoption levels, to help move health-care systems into the digital era.

Benefits realization management in the context of a national digital transformation initiative in English provider organizations

Background

The Global Digital Exemplar (GDE) Programme is a national initiative to promote digitally enabled transformation in English provider organizations. The Programme applied benefits realization management techniques to promote and demonstrate transformative outcomes. This work was part of an independent national evaluation of the GDE Programme.

Aims

We explored how benefits realization management was approached and conceptualized in the GDE Programme.

Methods

We conducted a series of 36 longitudinal case studies of provider organizations participating in the GDE Programme, 12 of which were in depth. Data collection included a combination of 628 interviews (with implementation staff in provider organizations, national programme management staff, and suppliers), 499 documents (of national and local implementation plans and lessons learned), and 190 nonparticipant observations (of national and local programme management meetings to develop insights into the broader context of benefits realization activities, tensions arising, and how these were negotiated). Data were coded drawing on a sociotechnical framework developed in related work and thematically analyzed, initially within and then across cases, with the help of NVivo 11 software.

Results

Most stakeholders broadly agreed with the rationale of benefits realization in the GDE Programme to show due diligence that public money was appropriately spent, and to develop an evidence base supporting the value of digitally enabled transformation. Differing national and local reporting purposes, however, created tensions. Central requirements, for progress reporting and tracking high-level benefits, had limited perceived local value and were seen to impose an unnecessary burden on provider organizations. This was accentuated by the lack of harmonization of reporting requirements to different stakeholders (which differed in content and timing). There were tensions between the desire for early evidence of outcomes and the slow processes of infrastructural change (which created problems of attribution of benefits to causes as benefits emerged gradually and over long timeframes), and also between reporting immediately visible local changes and showing how these flowed through to high level organization wide benefits (eg, in terms of health outcomes or cost savings/return on investment). The attempt to fulfill these diverging agendas and informational needs within a single reporting tool had limited success. These difficulties were mitigated by efforts to simplify reporting requirements and to support targeted collection of key national outcome measures. Although progress was hampered by an initial lack of benefits realization expertise in provider organizations, some providers subsequently retained these skills for their own change management purposes.

Conclusions

There is a need to recognize the limitations and cost of benefits realization management practices in the context of healthcare digitalization where benefits may materialize over long timeframes and in unanticipated ways. Although diverse stakeholder information needs may create tensions, prior agreement about rationales for collecting information and a targeted approach to tracking local and high-level benefits may enhance local relevance, reduce perceived reporting burdens, and improve acceptance/effectiveness. A single integrated reporting mechanism is unlikely to fulfill both national and local requirements.

Using Digital Health to Support Best Practices: Impact of MRI Ordering Guidelines Embedded Within an Electronic Referral Solution

BACKGROUND

Between 2003 and 2012, the number of MRIs performed in Canada more than doubled to 1.7 million [1]. According to a 2010 Health Council of Canada report nearly 30% of MRIs were inappropriately ordered [2]. The use of diagnostic imaging referral guidelines has been shown to improve the appropriateness of imaging orders [3, 4].

OBJECTIVES

To identify the number of unnecessary pre-consult MRIs ordered for patients with knee pain. As well, the impact that new evidence-based clinical decision support (DS) guidelines embedded within the referral form has had on the number of unnecessary MRIs was investigated.

METHODS

This study employed a retrospective design approach. Charts of all knee pain patients over the age of 55 who were referred for consultation to the 5 participating orthopedic surgeons during the study period were reviewed by three medical students.

RESULTS

270 patient charts were included in this study. MRI was ordered for 60 patients with only 56.7% having had a prior X-ray. Of the 60 ordered MRIs, 50 (84%) were considered inappropriate, while only 10 (16%) were appropriate. Our results were compared to previous results of a quality improvement study implemented at the same clinic. A substantial reduction of 12% in the number of pre-consult MRIs and a 5% increase in the number of ordered X-rays before consultation was demonstrated.

CONCLUSION

This work highlights the impact of including DS tools within an electronic referral form to support clinical best practices.

The Connecting South West Ontario (cSWO) Benefits Model: An Approach for the Collaborative Capture of Value of Electronic Health Records and Enabling Technology

This paper explains the benefits model developed and deployed by the connecting South West Ontario (cSWO) program. The cSWO approach is founded on the principles of enabling clinical and organizational value and the recognition that enabling requires a collaborative approach that can include several perspectives. We describe our approach which is aimed at creating a four-part harmony between change management and adoption, best practice research and quality indicators, data analytics and clinical value production.