Implementing a web-based oncology protocol system in Australia: evaluation of the first 3 years of operation

Oncology Nurses' Experiences of Using Health Information Systems in the Delivery of Cancer Care in a Range of Care Settings: A Systematic Integrative Review

OBJECTIVES

This systematic review aimed to identify oncology nurses' experiences of using health information systems (HIS) in the delivery of cancer care.

DATA SOURCES

The electronic databases searched included CINAHL, MEDLINE (EBSCO host), SCOPUS, Web of Science Core Collection, Google Scholar, OVID, and ProQuest Central (using advanced search strategy) and hand searching of reference lists of the included articles and relevant systematic reviews. Studies published in English language were examined.

CONCLUSION

Twenty-six studies were included. Three themes emerged: (1) the transparency and application of the nursing process within HIS, (2) HIS enhancing and facilitating communication between nurses and patients, and (3) the impact of HIS on the elements of person-centered care. Nurses' experiences with HIS were overall positive. However, digital systems do not fully capture all elements of the nursing processes; this was confirmed in this review, through the nurses' lens. Most studies used HIS for symptom reporting and monitoring within non-inpatient settings and largely biomedical and lack insight into the person-centeredness and overall holistic care.

IMPLICATIONS FOR NURSING PRACTICE

There are evidently varied views of HIS adoption across the globe. HIS can improve health-related quality of life and symptom burden, including self-reporting of symptoms among patients. However, there is a need for ongoing high-quality research, and clearer reporting than is evident in the current 26 studies, to fully understand the impact of HIS within the nursing processes and patient outcomes across all specialty cancer fields.

Exploring the role of professional identity in the implementation of clinical decision support systems-a narrative review

BACKGROUND

Clinical decision support systems (CDSSs) have the potential to improve quality of care, patient safety, and efficiency because of their ability to perform medical tasks in a more data-driven, evidence-based, and semi-autonomous way. However, CDSSs may also affect the professional identity of health professionals. Some professionals might experience these systems as a threat to their professional identity, as CDSSs could partially substitute clinical competencies, autonomy, or control over the care process. Other professionals may experience an empowerment of the role in the medical system. The purpose of this study is to uncover the role of professional identity in CDSS implementation and to identify core human, technological, and organizational factors that may determine the effect of CDSSs on professional identity.

METHODS

We conducted a systematic literature review and included peer-reviewed empirical studies from two electronic databases (PubMed, Web of Science) that reported on key factors to CDSS implementation and were published between 2010 and 2023. Our explorative, inductive thematic analysis assessed the antecedents of professional identity-related mechanisms from the perspective of different health care professionals (i.e., physicians, residents, nurse practitioners, pharmacists).

RESULTS

One hundred thirty-one qualitative, quantitative, or mixed-method studies from over 60 journals were included in this review. The thematic analysis found three dimensions of professional identity-related mechanisms that influence CDSS implementation success: perceived threat or enhancement of professional control and autonomy, perceived threat or enhancement of professional skills and expertise, and perceived loss or gain of control over patient relationships. At the technological level, the most common issues were the system's ability to fit into existing clinical workflows and organizational structures, and its ability to meet user needs. At the organizational level, time pressure and tension, as well as internal communication and involvement of end users were most frequently reported. At the human level, individual attitudes and emotional responses, as well as familiarity with the system, most often influenced the CDSS implementation. Our results show that professional identity-related mechanisms are driven by these factors and influence CDSS implementation success. The perception of the change of professional identity is influenced by the user's professional status and expertise and is improved over the course of implementation.

CONCLUSION

This review highlights the need for health care managers to evaluate perceived professional identity threats to health care professionals across all implementation phases when introducing a CDSS and to consider their varying manifestations among different health care professionals. Moreover, it highlights the importance of innovation and change management approaches, such as involving health professionals in the design and implementation process to mitigate threat perceptions. We provide future areas of research for the evaluation of the professional identity construct within health care.

Evaluation of implementation of risk management guidelines for carriers of pathogenic variants in mismatch repair genes: a nationwide audit of familial cancer clinics

INTRODUCTION

This nationwide study assessed the impact of Lynch syndrome-related risk management guidelines on clinicians' recommendations of risk management strategies to carriers of pathogenic variants in mismatch repair genes and the extent to which carriers took up strategies in concordance with guidelines.

MATERIALS AND METHODS

Clinic files of 464 carriers (with and without colorectal cancer) were audited for carriers who received their genetic testing results in July 2008-July 2009 (i.e. before guideline release), July 2010-July 2011 and July 2012-July 2013 (both after guideline release) at 12 familial cancer clinics (FCCs) to ascertain the extent to which carriers were informed about risk management in accordance with guidelines. All carriers captured by the audit were invited to participate in interviews; 215 were interviewed to assess adherence to recommended risk management guidelines.

RESULTS

The rates of documentation in clinic files increased significantly from pre- to post-guideline for only two out of eight risk management strategies. The strategies with the highest compliance of carriers post-guidelines were: uptake of one or two-yearly colonoscopy (87%), followed by hysterectomy to prevent endometrial cancer (68%), aspirin as risk-reducing medication (67%) and risk-reducing salpingo-oophorectomy (63%). Interrater reliability check for all guidelines showed excellent agreement (k statistics = 0.89).

CONCLUSION

These results indicate that there is scope to further increase provision of advice at FCCs to ensure that all carriers receive recommendations about evidence-based risk management. A multi-pronged behaviour change and implementation science approach tailored to specific barriers is likely to be needed to achieve optimal clinician behaviours and outcomes for carriers.

Impact of national guidelines on use of BRCA1/2 germline testing, risk management advice given to women with pathogenic BRCA1/2 variants and uptake of advice

Background

This nationwide study assessed the impact of nationally agreed cancer genetics guidelines on use of BRCA1/2 germline testing, risk management advice given by health professionals to women with pathogenic BRCA1/2 variants and uptake of such advice by patients.

Methods

Clinic files of 883 women who had initial proband screens for BRCA1/2 pathogenic variants at 12 familial cancer clinics between July 2008–July 2009 (i.e. before guideline release), July 2010–July 2011 and July 2012–July 2013 (both after guideline release) were audited to determine reason given for genetic testing. Separately, the clinic files of 599 female carriers without a personal history of breast/ovarian cancer who underwent BRCA1/2 predictive genetic testing and received their results pre- and post-guideline were audited to ascertain the risk management advice given by health professionals. Carriers included in this audit were invited to participate in a telephone interview to assess uptake of advice, and 329 agreed to participate.

Results

There were no significant changes in the percentages of tested patients meeting at least one published indication for genetic testing - 79, 77 and 78% of files met criteria before guideline, and two-, and four-years post-guideline, respectively (χ = 0.25, p = 0.88). Rates of documentation of post-test risk management advice as per guidelines increased significantly from pre- to post-guideline for 6/9 risk management strategies. The strategies with the highest compliance amongst carriers or awareness post-release of guidelines were annual magnetic resonance imaging plus mammography in women 30–50 years (97%) and annual mammography in women > 50 years (92%). Of women aged over 40 years, 41% had a risk-reducing bilateral mastectomy. Amongst women aged > 40 years, 75% had a risk-reducing salpingo-oophorectomy. Amongst women who had not had a risk-reducing bilateral mastectomy, only 6% took risk-reducing medication. Fear of side-effects was cited as the main reasons for not taking these medicines by 73% of women.

Conclusions

Guidelines did not change the percentages of tested patients meeting genetic testing criteria but improved documentation of risk management advice by health professionals. Effective approaches to enhance compliance with guidelines are needed to improve risk management and quality of care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13053-021-00180-3.

Barriers and facilitators to clinical information seeking: a systematic review

OBJECTIVE

The study sought to identify barriers to and facilitators of point-of-care information seeking and use of knowledge resources.

MATERIALS AND METHODS

We searched MEDLINE, Embase, PsycINFO, and Cochrane Library from 1991 to February 2017. We included qualitative studies in any language exploring barriers to and facilitators of point-of-care information seeking or use of electronic knowledge resources. Two authors independently extracted data on users, study design, and study quality. We inductively identified specific barriers or facilitators and from these synthesized a model of key determinants of information-seeking behaviors.

RESULTS

Forty-five qualitative studies were included, reporting data derived from interviews (n = 26), focus groups (n = 21), ethnographies (n = 6), logs (n = 4), and usability studies (n = 2). Most studies were performed within the context of general medicine (n = 28) or medical specialties (n = 13). We inductively identified 58 specific barriers and facilitators and then created a model reflecting 5 key determinants of information-seeking behaviors: time includes subthemes of time availability, efficiency of information seeking, and urgency of information need; accessibility includes subthemes of hardware access, hardware speed, hardware portability, information restriction, and cost of resources; personal skills and attitudes includes subthemes of computer literacy, information-seeking skills, and contextual attitudes about information seeking; institutional attitudes, cultures, and policies includes subthemes describing external individual and institutional information-seeking influences; and knowledge resource features includes subthemes describing information-seeking efficiency, information content, information organization, resource familiarity, information credibility, information currency, workflow integration, compatibility of recommendations with local processes, and patient educational support.

CONCLUSIONS

Addressing these determinants of information-seeking behaviors may facilitate clinicians' question answering to improve patient care.

Context as a Facilitator of the Implementation of Evidence-based Nursing: A Meta-synthesis

Nurses have numerous difficulties in implementing science due to obstacles related to the work context. The aim is to explore the work-context-related facilitators of the application of evidence in clinical practice by nursing professionals. Qualitative meta-synthesis of primary studies on nurses' experiences of work-context-related facilitators, as defined by the Promoting Action on Research Implementation in Health Services model. Using the Qualitative Appraisal and Review Instrument of the Joanna Briggs Institute. Of the total 57 primary research articles included, an explanatory model of the facilitating factors related to the work context was generated on the basis of four general categories: institutional support (leadership), multidisciplinary support (teamwork and communication), culture of improving quality of care (nursing professionals' attitudes towards change) and use of research (valuing research). Action can be taken on the facilitating factors of the evidence-based practice application in nursing clinical environments, providing resources and motivation from the organization.

E-health tools in oncology nursing: Perceptions of nurses and contributions to patient care and advanced practice

As oncology nurses confront a rapidly evolving field with increased workplace pressure, the integration of evidence-based connected health platforms within practice presents promise. This study explores nurses' perceptions regarding the utility of e-health tools, with a focus on the Oncology Interactive Navigator (OIN^TM), as a potential contributor to their practice and interactions with patients. Focus groups with oncology nurses were conducted at two time points: prior to exposure to the OIN^TM (T1, n=8) and four weeks post unrestricted tool access (T2, n=7). Using qualitative constant comparison analysis, three themes emerged: (1) Key factors driving e-health use are multidimensional and evolving; (2) Dual role of e-health in meeting patient needs and supporting practice; (3) E-health as a catalyst for professional development and networking. E-health is appealing to oncology nurses, as it serves to advance practice and support patient care. Future research should explore best practices for optimal clinical implementation among all stakeholders involved.

Breast and ovarian cancer referrals to the ACT Genetic Service: are we meeting guidelines?

BACKGROUND

The ACT Genetic Service at The Canberra Hospital evaluates the genetic risk of individuals for inherited diseases, and provides counselling and genetic testing where appropriate.

AIM

To evaluate the current referral practice for patients with a personal and/or family history of breast and/or ovarian cancer, and to assess whether these referrals are made according to eviQ cancer referral guidelines.

METHODS

A retrospective clinical audit of patients seen by the ACT Genetic Service for evaluation of genetic risk of breast and/or ovarian cancer between 1 January 2013 and 30 June 2015. Statistical analysis included Chi-squared and Poisson distribution tests.

RESULTS

Of the 711 patients referred during the 30-month period, 671 were seen by the service. The number of patients seen increased steadily over the time period, as did waiting times. The majority of referrals were made by general practitioners (403/711; 57%) and oncologists (172/711; 24%). Of note, 300 of 711 (42%) of all referrals made to the service during this time period did not meet eviQ referral guidelines. Patients who met guidelines for referral were more likely both to be offered genetic testing and to have a positive result.

CONCLUSION

Demand on the ACT Genetic Service increased over the time period assessed. As a significant proportion of patients did not meet eviQ cancer referral guidelines, it is worth reviewing the referral process in order to optimise utility of this limited resource.

Adoption of e-health technology by physicians: a scoping review

OBJECTIVE

The goal of this scoping review was to summarize the current literature identifying barriers and opportunities that facilitate adoption of e-health technology by physicians.

DESIGN

Scoping review.

SETTING

MEDLINE, EMBASE, and PsycINFO databases as provided by Ovid were searched from their inception to July 2015. Studies captured by the search strategy were screened by two reviewers and included if the focus was on barriers and facilitators of e-health technology adoption by physicians.

RESULTS

Full-text screening yielded 74 studies to be included in the scoping review. Within those studies, eleven themes were identified, including cost and liability issues, unwillingness to use e-health technology, and training and support.

CONCLUSION

Cost and liability issues, unwillingness to use e-health technology, and training and support were the most frequently mentioned barriers and facilitators to the adoption of e-health technology. Government-level payment incentives and privacy laws to protect health information may be the key to overcome cost and liability issues. The adoption of e-health technology may be facilitated by tailoring to the individual physician's knowledge of the e-health technology and the use of follow-up sessions for physicians and on-site experts to support their use of the e-health technology. To ensure the effective uptake of e-health technologies, physician perspectives need to be considered in creating an environment that enables the adoption of e-health strategies.

Implementing a user-driven online quality improvement toolkit for cancer care

PURPOSE

Peer-to-peer collaboration within integrated health systems requires a mechanism for sharing quality improvement lessons. The Veterans Health Administration (VA) developed online compendia of tools linked to specific cancer quality indicators. We evaluated awareness and use of the toolkits, variation across facilities, impact of social marketing, and factors influencing toolkit use.

METHODS

A diffusion of innovations conceptual framework guided the collection of user activity data from the Toolkit Series SharePoint site and an online survey of potential Lung Cancer Care Toolkit users.

RESULTS

The VA Toolkit Series site had 5,088 unique visitors in its first 22 months; 5% of users accounted for 40% of page views. Social marketing communications were correlated with site usage. Of survey respondents (n = 355), 54% had visited the site, of whom 24% downloaded at least one tool. Respondents' awareness of the lung cancer quality performance of their facility, and facility participation in quality improvement collaboratives, were positively associated with Toolkit Series site use. Facility-level lung cancer tool implementation varied widely across tool types.

CONCLUSION

The VA Toolkit Series achieved widespread use and a high degree of user engagement, although use varied widely across facilities. The most active users were aware of and active in cancer care quality improvement. Toolkit use seemed to be reinforced by other quality improvement activities. A combination of user-driven tool creation and centralized toolkit development seemed to be effective for leveraging health information technology to spread disease-specific quality improvement tools within an integrated health care system.

How do medical doctors use a web-based oncology protocol system? A comparison of Australian doctors at different levels of medical training using logfile analysis and an online survey

BACKGROUND

Electronic decision support is commonplace in medical practice. However, its adoption at the point-of-care is dependent on a range of organisational, patient and clinician-related factors. In particular, level of clinical experience is an important driver of electronic decision support uptake. Our objective was to examine the way in which Australian doctors at different stages of medical training use a web-based oncology system (http://www.eviq.org.au).

METHODS

We used logfiles to examine the characteristics of eviQ registrants (2009-2012) and patterns of eviQ use in 2012, according to level of medical training. We also used a web-based survey to evaluate the way doctors at different levels of medical training use the online system and to elicit perceptions of the system's utility in oncology care.

RESULTS

Our study cohort comprised 2,549 eviQ registrants who were hospital-based medical doctors across all levels of training. 65% of the cohort used eviQ in 2012, with 25% of interns/residents, 61% of advanced oncology trainees and 47% of speciality-qualified oncologists accessing eviQ in the last 3 months of 2012. The cohort accounted for 445,492 webhits in 2012. On average, advanced trainees used eviQ up to five-times more than other doctors (42.6 webhits/month compared to 22.8 for specialty-qualified doctors and 7.4 webhits/month for interns/residents). Of the 52 survey respondents, 89% accessed eviQ's chemotherapy protocols on a daily or weekly basis in the month prior to the survey. 79% of respondents used eviQ at least weekly to initiate therapy and to support monitoring (29%), altering (35%) or ceasing therapy (19%). Consistent with the logfile analysis, advanced oncology trainees report more frequent eviQ use than doctors at other stages of medical training.

CONCLUSIONS

The majority of the Australian oncology workforce are registered on eviQ. The frequency of use directly mirrors the clinical role of doctors and attitudes about the utility of eviQ in decision-making. Evaluations of this kind generate important data for system developers and medical educators to drive improvements in electronic decision support to better meet the needs of clinicians. This end-user focus will optimise the uptake of systems which will translate into improvements in processes of care and patient outcomes.

Uptake of a web-based oncology protocol system: how do cancer clinicians use eviQ cancer treatments online?

Background

The use of computerized systems to support evidence-based practice is commonplace in contemporary medicine. Despite the prolific use of electronic support systems there has been relatively little research on the uptake of web-based systems in the oncology setting. Our objective was to examine the uptake of a web-based oncology protocol system (http://www.eviq.org.au) by Australian cancer clinicians.

Methods

We used web-logfiles and Google Analytics to examine the characteristics of eviQ registrants from October 2009-December 2011 and patterns of use by cancer clinicians during a typical month.

Results

As of December 2011, there were 16,037 registrants; 85% of whom were Australian health care professionals. During a typical month 87% of webhits occurred in standard clinical hours (08:00 to 18:00 weekdays). Raw webhits were proportional to the size of clinician groups: nurses (47% of Australian registrants), followed by doctors (20%), and pharmacists (14%). However, pharmacists had up to three times the webhit rate of other clinical groups. Clinicians spent five times longer viewing chemotherapy protocol pages than other content and the protocols viewed reflect the most common cancers: lung, breast and colorectal.

Conclusions

Our results demonstrate eviQ is used by a range of health professionals involved in cancer treatment at the point-of-care. Continued monitoring of electronic decision support systems is vital to understanding how they are used in clinical practice and their impact on processes of care and patient outcomes.

eviQ cancer treatments online: how does the web-based protocol system fare in a comprehensive quality assessment?

AIMS

There have been few evaluations of the quality of computerized decision support tools in medical oncology despite their widespread use in clinical practice. In this article, we provide an in-depth quality assessment of eviQ, an Australian web-based protocol system.

METHODS

We used the Appraisal of Guidelines for Research and Evaluation (AGREE-II) instrument to examine the quality of eviQ chemotherapy protocols across six domains: scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, editorial independence and overall quality rating. Domain scores were categorized as high quality (scores of >70%), moderate quality (30-70%), and low quality (<30%).

RESULTS

eviQ was rated highly with respect to articulating its scope and purpose, clarity of presentation, applicability and on the overall rating item (scores of 72-80%). Domains addressing the involvement of stakeholders in the development process and the rigor with which protocols were developed were of moderate quality (scores of 34-37%) and the management of editorial independence and conflict of interest issues were rated in the low quality range (22%).

CONCLUSION

Our evaluation demonstrated the eviQ protocol system is generally of high quality. However, we identified a number of areas in which eviQ could improve either its development processes or the means by which these processes are communicated to end-users. This research represents the first comprehensive evaluation of oncology protocols and paves the way for continued quality assurance research to ensure that these tools meet their objective of facilitating evidence-based medicine, standardizing treatment and, ultimately, improving patient outcomes.

The quality of web-based oncology guidelines and protocols: how do international sites stack up?

BACKGROUND

The Internet is a popular medium for disseminating information relevant to oncology practitioners. Despite the widespread use of web-based guidelines and protocols, the quality of these resources has not been evaluated. This study addresses this gap.

METHODS

The Appraisal of Guidelines for Research and Evaluation (AGREE-II) instrument was used to assess the quality of breast and sarcoma guidelines and protocols according to six independent domains. The oncology resources were selected from eight websites developed for healthcare settings in North America, the United Kingdom, Europe, and Australia.

RESULTS

Mean quality scores across domains were highly variable for both guidelines (29-73%) and protocols (31-71%). Guidelines scored highly in terms of articulating their Scope and Purpose (72.6 ± 11.2%) but poorly with respect to Applicability in clinical practice (29.0 ± 17.3%). Protocols scored highly on Clarity of Presentation (70.6 ± 17.6%) but poorly in terms of the processes used to synthesise underlying evidence, develop, and update recommendations (30.8 ± 20.0%).

CONCLUSION

Our evaluation provides a quick reference tool for clinicians about the strengths and limitations of oncology resources across several major websites. Further, it supports resource developers in terms of where to direct efforts to enhance guideline and protocol development processes or the communication of these processes to end-users.

The effects of on-screen, point of care computer reminders on processes and outcomes of care

BACKGROUND

The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.

OBJECTIVES

To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.

SEARCH STRATEGY

We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.

SELECTION CRITERIA

Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.

MAIN RESULTS

Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).

AUTHORS' CONCLUSIONS

Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.