Examining the Functionality of the DeLone and McLean Information System Success Model as a Framework for Synthesis in Nursing Information and Communication Technology Research:

Implementation of artificial intelligence Chatbot in peritoneal dialysis nursing care: Experience from a Taiwan medical center

PURPOSE

Coronavirus disease pandemic makes high requirements in delivering remote and efficient communication, and patient education. Because of the increases of digital and social media applications in Taiwan, we aim to apply Artificial Intelligence of LINE Chatbot to improve the self-care ability of patients undergoing peritoneal dialysis.

MATERIALS AND METHODS

We conducted the project since 1 May 2021 to 30 April 2022. We designed an automatically replied Chatbot system, and divided into six scopes of interaction interfaces, including peritoneal dialysis technique operation video, clinical reminder, home caring, hospital registration service, dietary guideline, and Automatic Peritoneal dialysis guidance. We surveyed patients' satisfaction with the LINE Chatbot 3 months later by the Likert 1-5 score-based questionnaire and the higher score indicated higher satisfaction.

RESULTS

There were 440 patients who joined the PD AI Chatbot study and use the Chatbot, but the satisfaction questionnaire recovery rate was only 297 patients. We found that 91.7% of participants agreed 'Overall satisfaction with patient intelligent Chatbot application'. More than 4 points accounted for 86.6%. We traced every click in each section of the Chatbot and explored the potential scenario patients face. The Chatbot statistically significant reduced infection rate of exit site and tunnel infection before using (p = .049 and .024). Furthermore, peritonitis rate decreased from 0.93 to 0.8/100 patient month after using Artificial Intelligence technique. Peritoneal dialysis Artificial Intelligence Chatbot had similar effect with face-to-face education.

CONCLUSION

The innovative Chatbot allowed delivering remote and digital information's to improve patients' self-care ability. Peritoneal dialysis patients were highly recognized and satisfied with the tools. It deserves to further explore the long-term impact of Artificial Intelligence Chatbot in peritoneal dialysis care.

A Comparison of Two Cross-Sectional Studies on Successful Model of Introducing Nursing Information System in a Regional Teaching Hospital in Taiwan

Nursing information system introduction is an important measure for hospital nursing departments to promote the clinical practice of nursing with both efficiency and quality. A comparison of two cross-sectional study designs was adopted, and the information systems success model, as proposed by DeLone and McLean (2003), was used to explore the effectiveness of the six dimensions of system quality, information quality, service quality, use, user satisfaction, and net benefits at 6 and 12 months after the introduction launch of the nursing information system in hospitals. Multiple regression analysis was used across the two cross-sectional studies. The research results found that the nursing information system conformed to the information systems success model, and half a year to 1 year after the introduction of the nursing information system, use affected the nursing information system net benefits via the mediator variable of user satisfaction; however, the effect of full mediation changed to partial mediation effect with time. The research results can be used as a reference for hospitals and nursing administrators for the newly developed nursing information system.

Clinical Nurse Specialists' Perceptions of a Mental Health Patient Portal

PURPOSE

The purposes of this study were to explore clinical nurse specialists' views of the potential influence of a mental health portal on nursing practice and to identify portal implementation strategies.

METHODS

A qualitative descriptive approach was used. Semistructured interviews were conducted with 5 clinical nurse specialists. Two independent coders conducted an inductive content analysis of the transcribed interviews to generate codes describing patterns in the data to identify originating themes.

RESULTS

The content analysis uncovered the following 4 themes: (1) implementation strategies, (2) nurse likelihood to recommend, (3) impact on nursing practice, and (4) perceived influence on patients.

CONCLUSION

Direct care nurses may benefit from education and coaching on how to document in the record using patient-centered language that is understandable to patients who may be reading it. In addition, the use of patient portals should be designed to fit into nurses' existing clinical workflows. Finally, more research is needed to identify the benefits and unintended consequences of patient portals within a mental health context.

Nurses' Satisfaction With Using Nursing Information Systems From Technology Acceptance Model and Information Systems Success Model Perspectives: A Reductionist Approach

Nursing information systems can enhance nursing practice and the efficiency and quality of administrative affairs within the nursing department and thus have been widely considered for implementation. Close alignment of human-computer interaction can advance optimal clinical performance with the use of information systems. However, a lack of introduction of the concept of alignment between users' perceptions and technological functionality has caused dissatisfaction, as shown in the existing literature. This study provides insight into the alignment between nurses' perceptions and how technological functionality affects their satisfaction with Nursing Information System use through a reductionist perspective of alignment. This cross-sectional study collected data from 531 registered nurses in Taiwan. The results indicated that "perceived usefulness in system quality alignment," "perceived usefulness in information quality alignment," "perceived ease of use in system quality alignment," "perceived ease of use in information quality alignment," and "perceived ease of use in service quality alignment" have significantly affected nurses' satisfaction with Nursing Information System use. However, "perceived usefulness in service quality alignment" had no significant effect on nurses' satisfaction. This study also provides some meaningful implications for theoretical and practical aspects of design.

14 Years longitudinal evaluation of clinical information systems acceptance: The HEGP case

CONTEXT

Meaningful use and end-user satisfaction are two major components of the success of a clinical information system (CIS). The purpose of this study was to longitudinally measure and analyze the CIS use and satisfaction determinants in a multi-professional group at the Georges Pompidou university hospital (HEGP) in Paris.

METHODS

From the different evaluation surveys performed at HEGP, three periods were considered corresponding to 4, 8 and over 10 years after the first CIS deployment in 2000, respectively. Six acceptance dimensions were considered: CIS quality (CISQ), facilitating conditions (FC), perceived usefulness (PU), confirmation of expectations (CE), use, and global satisfaction (GS). Relationships between these constructs were tested through multiple regressions analysis and structural equation modeling (SEM).

RESULTS

Responses were obtained from 298, 332, and 448 users for the three periods considered. CIS acceptance dimensions progressively and significantly increased over time. Significant differences between professions were observed with an initial low PU among medical staff. In the early deployment phase, GS appeared to be determined by CIS use, CISQ and PU (R(2)=.53 in SEM). In the very late post-adoption phase, GS was strongly determined by CISQ, CE, and PU (R(2)=.86 in SEM) and was no longer associated with CIS use.

CONCLUSION

Acceptance models should be adapted to the phase of deployment of a CIS and integrate end-users' individual characteristics. Progressive reduction over time of the positive relationships between CIS use and satisfaction could possibly be considered as a maturity indicator of CIS deployment. These observations validate the introduction in post-adoption models of a continuance intention dimension.

Nurse acceptance of electronic health record technology: a literature review

Electronic health records are now being installed globally in healthcare organisations in an effort to provide a more efficient and safer healthcare environment. Regardless of the tremendous amount of attention paid to this area now, the benefits of the technology are often not fully realised. This may be the result of healthcare administrators not being able to implement electronic health records effectively due to inadequate user acceptance of the technology by the largest group of healthcare professionals – nurses. Using the technology acceptance model and the DeLone and McLean model for information system success, the authors have reviewed the published studies that have applied these models to both nurses and electronic health records. Results of the literature review suggest that a modification of the models may provide a better explanation of nurses’ acceptance of electronic health records.

Feasibility of an eHealth application "OncoKompas" to improve personalized survivorship cancer care

Purpose

The purpose of this study was to investigate the feasibility of an online self-management application (OncoKompas) among cancer survivors. In OncoKompas, cancer survivors can monitor their quality of life (QOL) via participant reported outcomes (PROs) (“Measure”), which is followed by automatically generated individually tailored feedback (“Learn”) and personalized advice on supportive care services (“Act”).

Methods

A pretest–posttest design was used, conducting a survey before providing access to OncoKompas, and 2 weeks after, followed by an interview by a nurse. Adoption was defined as the percentage of cancer survivors that agreed to participate in the study and returned the T0 questionnaire. Implementation was defined as the percentage of participants that actually used OncoKompas as intended (T1). General satisfaction was assessed based on the mean score of three study-specific questions: (1) general impression of OncoKompas, (2) the user-friendliness, and (3) the ability to use OncoKompas without assistance (10-point Likert scales). Furthermore, satisfaction was measured with the Net Promotor Scale (NPS).

Results

OncoKompas was feasible with an adoption grade of 64 %, an implementation grade of 75–91 %, a mean satisfaction score of 7.3, and a positive NPS (1.9). Sociodemographic and clinical factors and QOL were not associated with satisfaction. Several facilitators and barriers related to the feasibility of OncoKompas were identified.

Conclusion

OncoKompas is considered feasible, but has to be further improved. In order to enhance feasibility and increase satisfaction, we have to balance the time it takes to use OncoKompas, measurement precision, and tailoring towards personalized advices.

An importance-performance analysis of hospital information system attributes: A nurses' perspective

PURPOSE

Health workers have numerous concerns about hospital IS (HIS) usage. Addressing these concerns requires understanding the system attributes most important to their satisfaction and productivity. Following a recent HIS implementation, our objective was to identify priorities for managerial intervention based on user evaluations of the performance of the HIS attributes as well as the relative importance of these attributes to user satisfaction and productivity outcomes.

PROCEDURES

We collected data along a set of attributes representing system quality, data quality, information quality, and service quality from 154 nurse users. Their quantitative responses were analysed using the partial least squares approach followed by an importance-performance analysis. Qualitative responses were analysed using thematic analysis to triangulate and supplement the quantitative findings.

MAIN FINDINGS

Two system quality attributes (responsiveness and ease of learning), one information quality attribute (detail), one service quality attribute (sufficient support), and three data quality attributes (records complete, accurate and never missing) were identified as high priorities for intervention.

CONCLUSIONS

Our application of importance-performance analysis is unique in HIS evaluation and we have illustrated its utility for identifying those system attributes for which underperformance is not acceptable to users and therefore should be high priorities for intervention.

Bringing technology to the bedside: using smartphones to improve interprofessional communication

The purpose of this project was to evaluate the impact of using Smartphones at the bedside on the quality of interprofessional communication and measure the response time between nurses and physicians compared with the usual paging device. Smartphones were provided to nurses and physicians on a 26-bed medical unit during a 2-month study period. Data were collected using Nurse-Physician Communication Questionnaires and Time and Motion data collection tools. Baseline data gathered from a convenience sample of general medicine nurses (n=61) and physicians (n=44) indicated that both nurses and physicians were dissatisfied with the current one-way paging devices and were frequently interrupted during patient care (P=.000). Postimplementation data suggested that the use of Smartphones significantly reduced patient interruptions (P=.021), allowed nurses to stay with patients (P=.002), and reduced wait times for a returned call (P=.001). Nurse travel time to answer a telephone call and time spent on hold by nurses and physicians also decreased by 100% from a range of 8 to 79 minutes down to 0 minutes. Staff reported improvement in quality of communication, and significant workflow efficiency was noted. Further research on the impact on patient safety and satisfaction is needed and other nursing units should consider implementing Smartphones within their medical centers.

Modeling antecedents of electronic medical record system implementation success in low-resource setting hospitals

BACKGROUND

With the increasing implementation of Electronic Medical Record Systems (EMR) in developing countries, there is a growing need to identify antecedents of EMR success to measure and predict the level of adoption before costly implementation. However, less evidence is available about EMR success in the context of low-resource setting implementations. Therefore, this study aims to fill this gap by examining the constructs and relationships of the widely used DeLone and MacLean (D&M) information system success model to determine whether it can be applied to measure EMR success in those settings.

METHODS

A quantitative cross sectional study design using self-administered questionnaires was used to collect data from 384 health professionals working in five governmental hospitals in Ethiopia. The hospitals use a comprehensive EMR system since three years. Descriptive and structural equation modeling methods were applied to describe and validate the extent of relationship of constructs and mediating effects.

RESULTS

The findings of the structural equation modeling shows that system quality has significant influence on EMR use (β = 0.32, P < 0.05) and user satisfaction (β = 0.53, P < 0.01); information quality has significant influence on EMR use (β = 0.44, P < 0.05) and user satisfaction (β = 0.48, P < 0.01) and service quality has strong significant influence on EMR use (β = 0.36, P < 0.05) and user satisfaction (β = 0.56, P < 0.01). User satisfaction has significant influence on EMR use (β = 0.41, P < 0.05) but the effect of EMR use on user satisfaction was not significant. Both EMR use and user satisfaction have significant influence on perceived net-benefit (β = 0.31, P < 0.01; β = 0.60, P < 0.01), respectively. Additionally, computer literacy was found to be a mediating factor in the relationship between service quality and EMR use (P < 0.05) as well as user satisfaction (P < 0.01). Among all the constructs, user satisfaction showed the strongest effect on perceived net-benefit of health professionals.

CONCLUSION

EMR implementers and managers in developing countries are in urgent need of implementation models to design proper implementation strategies. In this study, the constructs and relationships depicted in the updated D&M model were found to be applicable to assess the success of EMR in low resource settings. Additionally, computer literacy was found to be a mediating factor in EMR use and user satisfaction of health professionals. Hence, EMR implementers and managers in those settings should give priority in improving service quality of the hospitals like technical support and infrastructure; providing continuous basic computer trainings to health professionals; and give attention to the system and information quality of the systems they want to implement.

The Relationship between User Satisfaction, System Attributes and the Motivating Potential of System Use

User satisfaction (US) is an important information systems success measure. This paper contributes to our understanding of US in workplace settings by conceptualizing US as resulting from user evaluations of both the attribute level performance of the system and its impacts on the motivating potential of their work. Data was collected from a sample of 154 nurses in a regional public hospital in South Africa who are users of an integrated hospital information system. The authors considered that use of the system has implications for the motivating potential of work through its impacts on skill variety, task identity, significance, autonomy, and work performance. Their results show that a system's impact on motivating potential is significant for US. Moreover, system quality, information quality, and user support attributes of the IS have significant direct effects on US as well as indirect effects through motivating potential. A high performing system is thus important for US as it provides a platform to increase the motivating potential of work.

Technology and its ethics in nursing and caring journals: An integrative literature review

BACKGROUND

Over the past 20 years, the impact of technology has increased significantly in health care. The diversity of technology is growing and its knowledge scattered. The concept of technology is ambiguous in caring and nursing sciences and its ethics remains unidentified.

AIM

To find evidence on how the concept of technology and its ethics are defined in caring and nursing sciences and practice. The purpose of this study is to describe and summarize the concept of technology and its ethics in the past nursing and caring literature.

METHOD

The integrative literature review of the past nursing and caring literature. The data were collected from caring and nursing journal articles from 2000 to 2013 focusing on technology and its ethics.The results were summarized and themed.

RESULTS

Technology as a concept has three implications. First, technology is devices and products, including ICT and advanced, simple and assistive technology. Second, technology refers to a process consisting of methods for helping people. Third, technology as a service indicates the production of care by technology. The ethics of technology has not been established as a guiding principle. Some studies excluded ethical reflection completely. Many studies discussed the ethics of technology as benefits such as improved communication and symptoms management, and the simple use of e-health services whilst others remained critical presenting ethical problems such as unwillingness and the inability to use technology, or conflicts with human aspects or questions of inequality.

CONCLUSION

In conclusion, this study indicates that technology as a concept is described diversely. The relation between technology and ethics is not a truism. Despite some evidence, more is needed to promote ethical care when using technology.

Impact of doctors' resistance on success of drug utilization review system

OBJECTIVES

The drug utilization review (DUR) system, which checks any conflict event of medications, contributes to improve patient safety. One of the important barriers in its adoption is doctors' resistance. This study aimed to analyze the impacts of doctors' resistance on the success of the DUR system.

METHODS

This study adopted an augmented the DeLone and McLean Information System (D&M IS) Success Model (2003), which used doctors' resistance as a socio-technological measure. This study framework is the same as that of the D&M IS Success Model in that it is based on qualities, such as system, information, and services. The major difference is that this study excluded the variable 'use' because it was not statistically significant for mandatory systems. A survey of doctors who used computers to enter prescriptions was conducted at a Korean tertiary hospital in February 2012.

RESULTS

This study is very meaningful in that it is the first study to explore the success factors of the DUR system associated with doctors' resistance. Doctors' resistance to the DUR system was not statistically associated with user usefulness, whereas it affected user satisfaction.

CONCLUSIONS

The results indicate that doctors still complain of discomfort in using the DUR system in the outpatient clinical setting, even though they admit that it contributes to patient safety. To mitigate doctors' resistance and raise user satisfaction, more opinions from doctors regarding the DUR system have to be considered and have to be reflected in the system.

How patients want to engage with their personal health record: a qualitative study

OBJECTIVE

To assess factors related to use and non-use of a sophisticated interactive preventive health record (IPHR) designed to promote uptake of 18 recommended clinical preventive services; little is known about how patients want to use or be engaged by such advanced information tools.

DESIGN

Descriptive and interpretive qualitative analysis of transcripts and field notes from focus groups of the IPHR users and of patients who were invited but did not use the IPHR (non-users). Grounded theory techniques were then applied via an editing approach for key emergent themes.

SETTING

Primary care patients in eight practices of the Virginia Ambulatory Care Outcomes Research Network (ACORN).

PARTICIPANTS

Three focus groups involved a total of 14 IPHR users and two groups of non-users totalled 14 participants.

OUTCOMES/RESULTS

For themes identified (relevance, trust and functionality) participants indicated that endorsement and use of the IPHR by their personal clinician was vital. In particular, participants' comments linked the IPHR use to: (1) integrating the IPHR into current care, (2) promoting effective patient-clinician encounters and communication and (3) their confidence in the accuracy, security and privacy of the information.

CONCLUSIONS

In addition to patients' stated desires for advanced functionality and information accuracy and privacy, successful adoption of the IPHRs by primary care patients depends on such technology's relevance, and on its promotion via integration with primary care practices' processes and the patient-clinician relationship. Accordingly, models of technological success and adoption, when applied to primary care, may need to include the patient-clinician relationship and practice workflow. These findings are important for healthcare providers, the information technology industry and policymakers who share an interest in encouraging patients to use personal health records.

TRIAL REGISTRATION

Clinicaltrials.gov identifier: NCT00589173.