A quantitative analysis of the impact of a computerised information system on nurses' clinical practice using a realistic evaluation framework

Impacts of technology implementation on nurses' work motivation, engagement, satisfaction and well-being: A realist review

AIM

To examine current literature for causal explanations on how, why and under what circumstances, implementation of a new hospital electronic medical record system or similar technology impacts nurses' work motivation, engagement, satisfaction or well-being.

BACKGROUND

Implementation of new technology, such as electronic medical record systems, affects nurses and their work, workflows and inter-personal interactions in healthcare settings. Multiple individual and organisational-level factors can affect technology adoption by nurses and may have negative consequences for nurses and patient safety.

DESIGN

Five-step realist review method and Realist And Meta-narrative Evidence Syntheses: Evolving Standards checklist was used to guide this review. Eight initial theories (programme theories) were used as the basis to explore, examine and refine literature from a range of sources.

DATA SOURCES

Literature from five databases (APA PsycInfo, CINAHL, Embase, IEEE Xplore and MEDLINE Complete) and grey literature (from 1 January 2000 to 31 October 2021) were systematically searched and retrieved on 4 November 2021.

RESULTS

In all, 8980 records were screened at the title and abstract level, of which 1027 full texts were screened and 10 were included in the review. Seven studies assessed concepts in both pre- and post-technology implementation. Most common contexts related to knowledge, rationale and skills to use new technology. Mechanisms that impacted nurses or nursing care delivery included: nurses' involvement in technology implementation processes; nurses' perceptions, understanding and limitations of technology impact(s) on patient care delivery; social supports; skills; implementation attitude and hardware. Work satisfaction was the most frequently examined outcome. An analysis led to nine final programme theories (including two original, six revised and one new programme theory).

CONCLUSION

Nurses must be informed about the rationale for new technology and have the knowledge and skills for its use. Understanding nurses' work motivation and attitudes related to technology adoption in the workplace can support work engagement, satisfaction and well-being.

IMPLICATIONS FOR THE PROFESSION

Complex contexts and mechanisms play a role in nurses' work motivation, engagement, satisfaction and well-being with the implementation of new technology into healthcare settings.

RELEVANCE TO CLINICAL PRACTICE

Nurses, their work and workflows are all influenced by the implementation of new technologies (such as electronic medical records), which in turn has consequences for patient safety and quality of care.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

PROSPERO REGISTRATION NUMBER

CRD42020131875 (https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=131875).

Methods in realist evaluation: A mapping review

Realist evaluation is becoming increasingly popular as an evaluation methodology. Its main objective is to uncover the mechanisms that lead to observed outcomes following an intervention and the contextual conditions that enabled this. The focus is on explaining why, for whom and in what circumstances an intervention works. It is a theory-driven approach and is explicitly method neutral, meaning that both quantitative and qualitative data collection methods can be used to unearth the underlying mechanisms that cause the intervention outcomes. In this review, we aim to map the methods used in realist evaluation studies, to draw lessons from the findings and to reflect on ways forward. We found that qualitative methods and interviews specifically are most commonly used in realist evaluations; that theory is often absent behind the methods and sampling techniques used; and that more innovative methods remain underexplored. We conclude the review by proposing four ways forward: (1) developing realist surveys, (2) exploring the relevance of innovative methods, (3) increasing the attention paid to sampling procedures and (4) strengthening the theory-driven nature of method. We believe that these four action points can strengthen the practice of realist evaluation and its outcomes.

Investigation the success rate of hospital information system (HIS): Development of a questionnaire and case study

INTRODUCTION AND OBJECTIVES

The implantation of hospital information systems (HISs) has grown dramatically in recent years. Understanding the success rate of HIS is key in health organizations. In this study, a validated questionnaire for HISs evaluation based on the Information System Success Model (ISSM) has been provided. In addition, the HIS success rate was determined.

MATERIALS AND METHODS

The current study was conducted at one of the largest teaching hospitals in eastern Iran. The 44-items questionnaire was developed for data gathering. The questionnaire covered ISSM dimensions, which include analysis of quality system, quality of information, quality service, system use, usefulness, satisfaction, and net benefits. Content validity, constructs validity, and reliability of the ISSM questionnaire was measured. HIS success rate has been determined and categorized based on users' perspective as follows: appropriate (75%≤HIS success rate), moderate (50%≤HIS success rate<75%), low coverage (25%≤HIS success rate<50%), and poor (coverage rate<25%).

RESULTS

In total, 253 users participated in the study. The ISSM questionnaire was validated by an expert panel with CVI: 85.12% and CVR: 88.22%. The overall Cronbach's alpha value of the instrument was determined as 92.2%. Nine factors with eigenvalues greater than 1.00 were identified, jointly accounting for 66.91% of the total variance. The value of KMO was.866 showed that the sample size was adequate for factor analysis. The highly significant Bartlett's test (p<0.000) indicated that variables were correlated and the factor analysis was appropriate. Our results demonstrated that the total mean of HIS success was "moderate" base on the users' point of view.

CONCLUSIONS

The findings of the current study, provide valuable scientific evidence for key affecting factors on hospital EHR in Iran as a developing country.

Investigating Evaluation Frameworks for Electronic Health Record: A Literature Review

BACKGROUND: There are various electronic health records (EHRs) evaluation frameworks with multiple dimensions and numerous sets of evaluation measures, while the coverage rate of evaluation measures in a common framework varies in different studies. AIM: This study provides a literature review of the current EHR evaluation frameworks and a model for measuring the coverage rate of evaluation measures in EHR frameworks. METHODS: The current study was a comprehensive literature review and a critical appraisal study. The study was conducted in three phases. In Phase 1, a literature review of EHR evaluation frameworks was conducted. In Phase 2, a three-level hierarchical structure was developed, which includes three aspects, 12 dimensions, and 110 evaluation measures. Subsequently, evaluation measures in the identified studies were categorized based on the hierarchical structure. In Phase 3, relative frequency (RF) of evaluation measures in different dimensions and aspects for each of the identified studies were determined and categorized as follows: Appropriate, moderate, and low coverage. RESULTS: Out of a total of 8276 retrieved articles, 62 studies were considered relevant. The RF range in the second and third level of the hierarchical structure was between 8.6%–91.94% and 0.2%–61%, respectively. “Ease of use” and “system quality” were the most frequent evaluation measure and dimension. Our results indicate that identified studies cover at least one and at most nine evaluation dimensions and current evaluation frameworks focus more on the technology aspect. Almost in all identified studies, evaluation measures related to the technology aspect were covered. However, evaluation measures related to human and organization aspects were covered in 68% and 84% of the identified studies, respectively. CONCLUSION: In this study, we systematically reviewed all literature presenting any type of EHR evaluation framework and analyzed and discussed their aspects and features. We believe that the findings of this study can help researchers to review and adopt the EHR evaluation frameworks for their own particular field of usage.

Usability of electronic patient record systems: Instrument validation study conducted for hospitals in Germany

In Germany and elsewhere, few hospital electronic patient record usability surveys are available. Moreover, there seems to be a complete lack of validated instruments in the respective literature. Hence, this study’s purpose is to validate a scale for measuring the usability of hospital electronic patient record systems. The data used for the study’s analyses (n = 949) were originally obtained during the German national initiative ‘Hospital IT User Questionnaire’. In the course of the study, reliability and exploratory factor analyses were conducted and psychometric tests showed a reliable, valid and suitable instrument. Descriptive data analysis suggests a generally low user perception and variances hint at a high potential for future improvements. To our knowledge, this study shows that a general inventory (subscales from the IsoMetrics inventory) can be applied to measuring hospital electronic patient record usability as well. The validated instrument can be used to inform healthcare providers, decision makers and politicians of a given state of usability, discrepancies between different hospitals or systems providers, and serve as a basis for improvements.

Evaluation frameworks in health services: An integrative review of use, attributes and elements

AIMS AND OBJECTIVE

To synthesise the evidence on the use of evaluation frameworks by nurses and midwives in research designed to improve healthcare services and practice. A secondary aim was to identify the attributes and elements of evaluation frameworks.

BACKGROUND

Evaluation is an integral component of any initiative to improve outcomes or change clinical practice. Yet often an evaluation may not yield the information required to sustain or integrate an initiative into practice. Evaluation frameworks can support effective evaluations, but there is a lack of consensus regarding elements and attributes of frameworks that support use.

METHODS

We undertook an integrative review to synthesise the use of evaluation frameworks in practice guided by the Preferred Reporting Items for Systematic review and Meta-Analysis flow diagram and checklist 2009 (Supporting Information File 4). The protocol was registered with PROSPERO (CRD42018087033). A broad range of electronic databases were systematically searched using keywords.

FINDINGS

Twenty-five papers were included from a diverse range of clinical areas and across high-, middle- and low-income nations. Twenty of the research projects had used nine existing frameworks, and five had developed an evaluation specific to an initiative. Frameworks supported the processes of evaluation and made them more meaningful by simplifying a complex process (providing structure and guidance for the evaluation processes); identifying and including stakeholders; explaining reasons for outcomes; generating transferable lessons; and identifying the mechanisms driving or inhibiting change.

CONCLUSION

Nurses and midwives reported that frameworks were useful in undertaking evaluations. Each framework had positive attributes and missing or confusing elements. When undertaking an evaluation, it is pertinent to review the elements and attributes of a framework to ensure it includes evaluation measures that are relevant to specific projects.

RELEVANCE TO CLINICAL PRACTICE

Nurses are actively involved in evaluation of clinical practice. This review identifies important elements to consider when choosing a framework for evaluation.

Development of an Evaluation Framework for Health Information Systems (DIPSA)

Introduction:

Use of Integrated Health Information Systems (IHIS) for the provision of healthcare services benefits both healthcare professionals and patients, while requiring continuous evaluation and upgrading to fully support its role.

Aim:

The main purpose of the study was to develop an evaluation framework for hospitals utilizing IHIS, within the three main areas identified as Human factor, Technology and Organization.

Material and methods:

The questionnaire consisted of 43 questions, with 17 questions (related to categories procedures, system quality and satisfaction), 25 questions (related to categories, safety and collaboration) and 1 question related to accessibility to the system (within the category system quality). Three open questions were added to evaluate users’ perception on what was needed for the improvement of health services in their respective hospitals for all 3 variables being evaluated. The open questions were included to allow participants to express their opinion in a more detailed setting. A database was developed, and the data were processed and analyzed.

Results:

Factor analysis formed 5 categories for the evaluation framework. Cronbach’s alpha coefficient was found in all categories to be above > 0.85.

Conclusion:

Evaluation frameworks can be designed, developed and implemented by using different methodologies. For an evaluation framework to be effective it should be designed and implemented based on the aims and purpose of the research and the specific needs of the particular healthcare setting or hospital. Considering the categories satisfaction, collaboration, safety, system quality, procedures, and by using Likert scale and open questions in the current study, DIPSA can provide a holistic image of IHIS by evaluating any hospital system.

Understanding the implementation and adoption of an information technology intervention to support medicine optimisation in primary care: qualitative study using strong structuration theory

OBJECTIVES

Using strong structuration theory, we aimed to understand the adoption and implementation of an electronic clinical audit and feedback tool to support medicine optimisation for patients in primary care.

DESIGN

This is a qualitative study informed by strong structuration theory. The analysis was thematic, using a template approach. An a priori set of thematic codes, based on strong structuration theory, was developed from the literature and applied to the transcripts. The coding template was then modified through successive readings of the data.

SETTING

Clinical commissioning group in the south of England.

PARTICIPANTS

Four focus groups and five semi-structured interviews were conducted with 18 participants purposively sampled from a range of stakeholder groups (general practitioners, pharmacists, patients and commissioners).

RESULTS

Using the system could lead to improved medication safety, but use was determined by broad institutional contexts; by the perceptions, dispositions and skills of users; and by the structures embedded within the technology. These included perceptions of the system as new and requiring technical competence and skill; the adoption of the system for information gathering; and interactions and relationships that involved individual, shared or collective use. The dynamics between these external, internal and technological structures affected the adoption and implementation of the system.

CONCLUSIONS

Successful implementation of information technology interventions for medicine optimisation will depend on a combination of the infrastructure within primary care, social structures embedded in the technology and the conventions, norms and dispositions of those utilising it. Future interventions, using electronic audit and feedback tools to improve medication safety, should consider the complexity of the social and organisational contexts and how internal and external structures can affect the use of the technology in order to support effective implementation.

Understanding the implementation and adoption of a technological intervention to improve medication safety in primary care: a realist evaluation

Background

Monitoring for potentially hazardous prescribing is increasingly important to improve medication safety. Healthcare information technology can be used to achieve this aim, for example by providing access to prescribing data through surveillance of patients’ electronic health records. The aim of our study was to examine the implementation and adoption of an electronic medicines optimisation system that was intended to facilitate clinical audit in primary care by identifying patients at risk of an adverse drug event. We adopted a sociotechnical approach that focuses on how complex social, organisational and institutional factors may impact upon the use of technology within work settings.

Methods

We undertook a qualitative realist evaluation of the use of an electronic medicines optimisation system in one Clinical Commissioning Group in England. Five semi-structured interviews, four focus groups and one observation were conducted with a range of stakeholders. Consistent with a realist evaluation methodology, the analysis focused on exploring the links between context, mechanism and outcome to explain the ways the intervention might work, for whom and in what circumstances.

Results

Using the electronic medicines optimisation system could lead to a number of improved patient safety outcomes including pre-emptively reviewing patients at risk of adverse drug events. The effective use of the system depended upon engagement with the system, the flow of information between different health professionals centrally placed at the Clinical Commissioning Group and those locally placed at individual general practices, and upon variably adapting work practices to facilitate the use of the system. The use of the system was undermined by perceptions of ownership, lack of access, and lack of knowledge and awareness.

Conclusions

The use of an electronic medicines optimisation system may improve medication safety in primary care settings by identifying those patients at risk of an adverse drug event. To fully realise the potential benefits for medication safety there needs to be better utilisation across primary care and with a wider range of stakeholders. Engaging with all potential stakeholders and users prior to implementation of such systems might allay perceptions that the system is owned centrally and increase knowledge of the potential benefits.

Health information systems evaluation frameworks: A systematic review

BACKGROUND

Evaluation of health information systems (HISs) is complicated because of the complex nature of the health care domain. Various studies have proposed different frameworks to reduce the complexity in the assessment of these systems. The aim of these frameworks is to provide a set of guidelines for the evaluation of the adequacy of health care information systems.

OBJECTIVE

This paper aims to analyse studies on the evaluation of HISs by applying a content, context and process (CCP) framework to address the 'who', 'what', 'how', 'when', and 'why' of the evaluation processes used. This will allow for a better understanding of the relative strengths and weaknesses of various HISs evaluation frameworks, and will pave the way for developing a more complete framework for HISs.

METHOD

A systematic literature review on HIS evaluation studies was undertaken to identify the currently available HIS evaluation frameworks. Five academic databases were selected to conduct this systematic literature review.

RESULTS

Most of the studies only address some, but not all, of the five main questions, i.e. the who, what, how, when, why, and that there was a lack of consensus in the way these questions were addressed. The critical role of context was also largely neglected in these studies.

CONCLUSIONS

Evaluation of HISs is complex. The health care domain is highly context sensitive and in order to have a complete assessment of HISs, consideration of contextual factors is necessary. Specifically, to have the right set of criteria to measure the 'what', the answer to the 'who' of the evaluation is necessary.

The concept of mechanism from a realist approach: a scoping review to facilitate its operationalization in public health program evaluation

BACKGROUND

Public health interventions are complex by nature, and their evaluation requires unpacking their intervention logic and their interactions with open social systems. By focusing on the interrelationships between context, mechanism, and outcome, Pawson and Tilley's realist approach appears a promising innovation for public health-related evaluation works. However, and as expected of any methodological innovation, this approach is being constructed gradually by answering the multiple challenges to its operationalization that fall in its path. One of these challenges, users of this approach agree on, is the necessity of clarifying its key concept of mechanism.

METHOD

We first collected the definitions of mechanism from published works of Pawson and colleagues. Secondly, a scoping review was conducted to identify the ones quoted by users of the realist approach for evaluating public health interventions (1997-2012). We then appraised the clarity and precision of this concept against the three dimensions defined by Daigneault and Jacobs "term, sense and referent."

RESULTS

Of the 2344 documents identified in the scoping review, 49 documents were included. Term: Users of the realist approach use adjectives qualifying the term mechanism that were not specifically endorsed by Pawson and colleagues. Sense: None of the attributes stated by Pawson and colleagues has been listed in all of the documents analyzed, and some contributions clarified its attributes. Referent: The concept of mechanism within a realist approach can be ascribed to theory-based evaluation, complex social interventions, and critical realism.

CONCLUSION

This review led us to reconsider the concept of mechanism within the realist approach by confronting the theoretical stance of its proponents to the practical one of its users. This resulted in a clearer, more precise definition of the concept of mechanism which may in turn trigger further improvements in the way the realist approach is applied in evaluative practice in public health and potentially beyond. A mechanism is hidden but real, is an element of reasoning and reactions of agents in regard to the resources available in a given context to bring about changes through the implementation of an intervention, and evolves within an open space-time and social system of relationships.

A realist analysis of hospital patient safety in Wales: applied learning for alternative contexts from a multisite case study

Background

Hospital patient safety is a major social problem. In the UK, policy responses focus on the introduction of improvement programmes that seek to implement evidence-based clinical practices using the Model for Improvement, Plan-Do-Study-Act cycle. Empirical evidence that the outcomes of such programmes vary across hospitals demonstrates that the context of their implementation matters. However, the relationships between features of context and the implementation of safety programmes are both undertheorised and poorly understood in empirical terms.

Objectives

This study is designed to address gaps in conceptual, methodological and empirical knowledge about the influence of context on the local implementation of patient safety programmes.

Design

We used concepts from critical realism and institutional analysis to conduct a qualitative comparative-intensive case study involving 21 hospitals across all seven Welsh health boards. We focused on the local implementation of three focal interventions from the 1000 Lives+patient safety programme: Improving Leadership for Quality Improvement, Reducing Surgical Complications and Reducing Health-care Associated Infection. Our main sources of data were 160 semistructured interviews, observation and 1700 health policy and organisational documents. These data were analysed using the realist approaches of abstraction, abduction and retroduction.

Setting

Welsh Government and NHS Wales.

Participants

Interviews were conducted with 160 participants including government policy leads, health managers and professionals, partner agencies with strategic oversight of patient safety, advocacy groups and academics with expertise in patient safety.

Main outcome measures

Identification of the contextual factors pertinent to the local implementation of the 1000 Lives+patient safety programme in Welsh NHS hospitals.

Results

An innovative conceptual framework harnessing realist social theory and institutional theory was produced to address challenges identified within previous applications of realist inquiry in patient safety research. This involved the development and use of an explanatory intervention–context–mechanism–agency–outcome (I-CMAO) configuration to illustrate the processes behind implementation of a change programme. Our findings, illustrated by multiple nested I-CMAO configurations, show how local implementation of patient safety interventions are impacted and modified by particular aspects of context: specifically, isomorphism, by which an intervention becomes adapted to the environment in which it is implemented; institutional logics, the beliefs and values underpinning the intervention and its source, and their perceived legitimacy among different groups of health-care professionals; and the relational structure and power dynamics of the functional group, that is, those tasked with implementing the initiative. This dynamic interplay shapes and guides actions leading to the normalisation or the rejection of the patient safety programme.

Conclusions

Heightened awareness of the influence of context on the local implementation of patient safety programmes is required to inform the design of such interventions and to ensure their effective implementation and operationalisation in the day-to-day practice of health-care teams. Future work is required to elaborate our conceptual model and findings in similar settings where different interventions are introduced, and in different settings where similar innovations are implemented.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Prioritizing factors influencing nurses' satisfaction with hospital information systems: a fuzzy analytic hierarchy process approach

Our aim was to use the fuzzy analytic hierarchy process approach to prioritize the factors that influence nurses' satisfaction with a hospital information system. First, we reviewed the related literature to identify and select possible factors. Second, we developed an analytic hierarchy process framework with three main factors (quality of services, of systems, and of information) and 22 subfactors. Third, we developed a questionnaire based on pairwise comparisons and invited 10 experienced nurses who were identified through snowball sampling to rate these factors. Finally, we used Chang's fuzzy extent analysis method to compute the weights of these factors and prioritize them. We found that information quality was the most important factor (58%), followed by service quality (22%) and then system quality (19%). In conclusion, although their weights were not similar, all factors were important and should be considered in evaluating nurses' satisfaction.

Predictors for assessing electronic messaging between nurses and general practitioners as a useful tool for communication in home health care services: a cross-sectional study

Background

Nurses providing home health care services are dependent on access to patient information and communicating with general practitioners (GPs) to deliver safe and effective health care to patients. Information and communication technology (ICT) systems are viewed as powerful tools for this purpose. In Norway, a standardized electronic messaging (e-messaging) system is currently being established in health care.

Objective

The aim of this study was to explore home health care nurses’ assessments of the utility of the e-messaging system for communicating with GPs and identify elements that influence the assessment of e-messaging as a useful communication tool.

Methods

The data were collected using a self-developed questionnaire based on variables identified by focus group interviews with home health care nurses (n=425) who used e-messaging and existing research. Data were analyzed using logistic regression analyses.

Results

Over two-thirds (425/632, 67.2%) of the home health care nurses returned the questionnaire. A high proportion (388/399, 97.2%) of the home health care nurses who returned the questionnaire found the e-messaging system to be a useful tool for communication with GPs. The odds of reporting that e-messaging was a useful tool were over five times higher (OR 5.1, CI 2.489-10.631, P<.001) if the nurses agreed or strongly agreed that e-messaging was easy to use. The odds of finding e-messaging easy to use were nearly seven times higher (OR 6.9, CI 1.713-27.899, P=.007) if the nurses did not consider the system functionality poor. If the nurses had received training in the use of e-messaging, the odds were over six times higher (OR 6.6, CI 2.515-17.437, P<.001) that they would consider e-messaging easy to use. The odds that a home health care nurse would experience e-messaging as easy to use increased as the full-time equivalent percentage of the nurses increased (OR 1.032, CI 1.001-1.064, P=.045).

Conclusions

This study has shown that technical (ease of use and system functionality), organizational (training), and individual (full-time equivalent percentage) elements had an impact on home health care nurses’ assessments of using e-messaging to communicate with GPs. By identifying these elements, it is easier to determine which interventions are the most important for the development and implementation of ICT systems in home health care services.

The SMART personalised self-management system for congestive heart failure: results of a realist evaluation

BACKGROUND

Technology has the potential to provide support for self-management to people with congestive heart failure (CHF). This paper describes the results of a realist evaluation of the SMART Personalised Self-Management System (PSMS) for CHF.

METHODS

The PSMS was used, at home, by seven people with CHF. Data describing system usage and usability as well as questionnaire and interview data were evaluated in terms of the context, mechanism and outcome hypotheses (CMOs) integral to realist evaluation.

RESULTS

The CHF PSMS improved heart failure related knowledge in those with low levels of knowledge at baseline, through providing information and quizzes. Furthermore, participants perceived the self-regulatory aspects of the CHF PSMS as being useful in encouraging daily walking. The CMOs were revised to describe the context of use, and how this influences both the mechanisms and the outcomes.

CONCLUSIONS

Participants with CHF engaged with the PSMS despite some technological problems. Some positive effects on knowledge were observed as well as the potential to assist with changing physical activity behaviour. Knowledge of CHF and physical activity behaviour change are important self-management targets for CHF, and this study provides evidence to direct the further development of a technology to support these targets.

The impacts of second generation e-prescribing usability on community pharmacists outcomes

BACKGROUND

The results from past studies about the effects of second-generation e-prescribing systems on community pharmacists' outcomes and practices are inconclusive, and the claims of effectiveness and efficiency of such systems have not been supported in all studies. There is a strong need to study the factors that lead to positive outcomes for the users of these systems.

OBJECTIVE

This paper intends to bridge the above gaps by empirically examining the impacts of user interface usability on the community pharmacists' outcomes.

METHODS

A quantitative survey research method was used and the data was collected from the community pharmacists, who use an e-prescribing system. Data from 152 questionnaires collected in a national survey were used to for the study. Partial Least Squares (PLS) path modeling was used to examine scale reliability, validity and hypotheses.

RESULTS

The scale was found to test well for reliability and validity. Examining the hypotheses illustrated that ease of use (P < 0.01, t = 5.79) and information quality (P < 0.01, t = 6.24) of an e-prescribing system improved pharmacists' outcomes (including communication, facilitation of care, reduction of workload and medical errors) while ease of use of the system was influenced by user interface consistency (P < 0.01, t = 7.35) and system error prevention (P < 0.01, t = 5.29).

CONCLUSION

To improve community pharmacists' outcomes and practices, the ease of use, information quality, consistency and error prevention features of e-prescribing systems should be improved. It was found that information quality had a stronger impact on the outcomes and hence improving the quality of the generated information would have higher impacts on users' outcomes.

Knowledge and attitudes of nurses in community health centres about electronic medical records

BACKGROUND

Nurses in primary healthcare record data for the monitoring and evaluation of diseases and services. Information and communications technology (ICT) can improve quality in healthcare by providing quality medical records. However, worldwide, the majority of health ICT projects have failed. Individual user acceptance is a crucial factor in successful ICT implementation.

OBJECTIVES

The aim of this study is to explore nurses' knowledge, attitudes and perceptions regarding ICT so as to inform the future implementation of electronic medical record (EMR) systems.

METHODS

A qualitative design was used. Semi-structured interviews were undertaken with nurses at three community health centres (CHCs) in the King Sabata Dalyindyebo Local Municipality. The interview guide was informed by the literature on user acceptance of ICT. Interviews were recorded and analysed using content analysis.

RESULTS

Many nurses knew about health ICT and articulated clearly the potential benefits of an EMR such as fewer errors, more complete records, easier reporting and access to information. They thought that an EMR system would solve the challenges they identified with the current paper-based record system, including duplication of data, misfiling, lack of a chronological patient record, excessive time in recording and reduced time for patient care. For personal ICT needs, approximately half used cellphone Internet-based services and computers.

CONCLUSIONS

In this study, nurses identified many challenges with the current recording methods. They thought that an EMR should be installed at CHCs. Their knowledge about EMR, positive attitudes to ICT and personal use of ICT devices increase the likelihood of successful EMR implementation at CHCs.

Development and initial evaluation of the Clinical Information Systems Success Model (CISSM)

PURPOSE

Most clinical information systems (CIS) today are technically sound, but the number of successful implementations of these systems is low. The purpose of this study was to develop and test a theoretically based integrated CIS Success Model (CISSM) from the nurse perspective.

METHODS

Model predictors of CIS success were taken from existing research on information systems acceptance, user satisfaction, use intention, user behavior and perceptions, as well as clinical research. Data collected online from 234 registered nurses in four hospitals were used to test the model. Each nurse had used the Cerner Power Chart Admission Health Profile for at least 3 months.

RESULTS

Psychometric testing and factor analysis of the 23-item CISSM instrument established its construct validity and reliability. Initial analysis showed nurses' satisfaction with and dependency on CIS use predicted their perceived CIS use Net Benefit. Further analysis identified Social Influence and Facilitating Conditions as other predictors of CIS user Net Benefit. The level of hospital CIS integration may account for the role of CIS Use Dependency in the success of CIS.

CONCLUSIONS

Based on our experience, CISSM provides a formative as well as summative tool for evaluating CIS success from the nurse's perspective.

Quality of human-computer interaction--results of a national usability survey of hospital-IT in Germany

Background

Due to the increasing functionality of medical information systems, it is hard to imagine day to day work in hospitals without IT support. Therefore, the design of dialogues between humans and information systems is one of the most important issues to be addressed in health care. This survey presents an analysis of the current quality level of human-computer interaction of healthcare-IT in German hospitals, focused on the users' point of view.

Methods

To evaluate the usability of clinical-IT according to the design principles of EN ISO 9241-10 the IsoMetrics Inventory, an assessment tool, was used. The focus of this paper has been put on suitability for task, training effort and conformity with user expectations, differentiated by information systems. Effectiveness has been evaluated with the focus on interoperability and functionality of different IT systems.

Results

4521 persons from 371 hospitals visited the start page of the study, while 1003 persons from 158 hospitals completed the questionnaire. The results show relevant variations between different information systems.

Conclusions

Specialised information systems with defined functionality received better assessments than clinical information systems in general. This could be attributed to the improved customisation of these specialised systems for specific working environments. The results can be used as reference data for evaluation and benchmarking of human computer engineering in clinical health IT context for future studies.

Comparing four softwares based on ISO 9241 part 10

Evaluation of Iran’s HIS (hospital Information System) ergonomic quality using IsoMetric 9241 part 10 and compared results of that evaluation with results of ergonomic quality evaluation other softwares which evaluated by IsoMetric 9241 part 10. This research study was conducted in two stages. In the first stage, the researchers evaluated the HIS of 13 hospitals in Iran using ISO 9241 part 10, and in the second stage, they compared the evaluation results with the following softwares: a) IS-H*med (evaluated by Hamborg et al. 2004) b) SAP-HR (evaluated by Gruber 2000) c) Microsoft Word for Windows, Version 2 (evaluated by Gediga et al. 1999). For first stage used usability questionnaire called IsoMetrics which is based on the international standard ISO 9241 Part 10. This questionnaire is including 75 items based on the seven principles. Data analyzed using SPSS and Excel. The comparison between HIS and IS-H*med reveal that the former is significantly more usable than the latter in terms of all IsoMetrics sales. The HIS also proved to be significantly more applicable than SAP-HR in terms of such IsoMetrics scales as “suitability for task,” “suitability for learning”, “Error tolerance” and “learning ability”. However, HIS was found to be significantly less usable than Microsoft Word. The results of the study show that compared with the mentioned three softwares, Iran’s hospital information system enjoys an average ergonomic quality. Therefore, it is recommended that the users’ comments and expectations be considered more when information systems are designed and developed.