An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit)

Digital adherence technologies for the management of tuberculosis therapy: mapping the landscape and research priorities

Poor medication adherence may increase rates of loss to follow-up, disease relapse and drug resistance for individuals with active tuberculosis (TB). While TB programmes have historically used directly observed therapy (DOT) to address adherence, concerns have been raised about the patient burden, ethical limitations, effectiveness in improving treatment outcomes and long-term feasibility of DOT for health systems. Digital adherence technologies (DATs)-which include feature phone-based and smartphone-based technologies, digital pillboxes and ingestible sensors-may facilitate more patient-centric approaches for monitoring adherence, though available data are limited. Depending on the specific technology, DATs may help to remind patients to take their medications, facilitate digital observation of pill-taking, compile dosing histories and triage patients based on their level of adherence, which can facilitate provision of individualised care by TB programmes to patients with varied levels of risk. Research is needed to understand whether DATs are acceptable to patients and healthcare providers, accurate for measuring adherence, effective in improving treatment outcomes and impactful in improving health system efficiency. In this article, we describe the landscape of DATs that are being used in research or clinical practice by TB programmes and highlight priorities for research.

A model for predicting utilization of mHealth interventions in low-resource settings: case of maternal and newborn care in Kenya

Background

In low-resource settings, there are numerous socioeconomic challenges such as poverty, inadequate facilities, shortage of skilled health workers, illiteracy and cultural barriers that contribute to high maternal and newborn deaths. To address these challenges, there are several mHealth projects particularly in Sub-Sahara Africa seeking to exploit opportunities provided by over 90% rate of mobile penetration. However, most of these interventions have failed to justify their value proposition to inspire utilization in low-resource settings.

Methods

This study proposes a theoretical model named Technology, Individual, Process-Fit (TIPFit) suitable for user-centred evaluation of intervention designs to predict utilization of mHealth products in low-resource settings. To investigate the predictive power of TIPFit model, we operationalized its latent constructs into variables used to predict utilization of an mHealth prototype called mamacare. The study employed single-group repeated measures quasi-experiment in which a random sample of 79 antenatal and postnatal patients were recruited from a rural hospital. During the study conducted between May and October 2014, the treatment involved sending and receiving SMS alerts on vital signs, appointments, safe delivery, danger signs, nutrition, preventive care and adherence to medication.

Results

Measurements taken during the study were cleaned and coded for analysis using statistical models like Partial Least Squares (PLS), Repeated Measures Analysis of Variance (RM-ANOVA), and Bonferroni tests. After analyzing 73 pretest responses, the model predicted 80.2% fit, and 63.9% likelihood of utilization. However, results obtained from initial post-test taken after three months demonstrated 69.1% fit, and utilization of 50.5%. The variation between prediction and the actual outcome necessitated improvement of mamacare based on feedback obtained from users. Three months later, we conducted the second post-test that recorded further drop in fit from 69.1 to 60.3% but utilization marginally improved from 50.5 to 53.7%.

Conclusions

Despite variations between the pretest and post-test outcomes, the study demonstrates that predictive approach to user-centred design offers greater flexibility in aligning design attributes of an mHealth intervention to fulfill user needs and expectations. These findings provide a unique contribution for decision makers because it is possible to prioritize investments among competing digital health projects.

Electronic supplementary material

The online version of this article (10.1186/s12911-018-0649-z) contains supplementary material, which is available to authorized users.

Taxonomic framework for factors influencing ERMS adoption in organisations of higher professional education

An electronic records management system (ERMS) is tightly linked with most of the daily activities of educational organisations and leads to enhance their performance and decision-making. The aim of this article is to identify the significant factors that could influence the ERMS adoption in higher professional education (HPE). The methodology of this article started with identifying the factors through theory analysis and literature and also recommended by experts. Technology–organisation–environment (TOE) theory was used for factor classification. Qualitative approach was used through the interview with experts to validate and verify the proposed framework. This article presents the results of a study which identifies the issues involved in the utilisation and adoption of ERMS. More than 100 previous works and six well-known theories were critically reviewed to identify the main factors for successful ERMS adoption in different areas with the aim of proposing a taxonomic framework that can depict and identify the main factors that have an impact on the success of ERMS adoption. The proposed framework includes 11 factors categorised into three dimensions. The framework is validated and verified by experts. The adoption factors identified here provide a sound theoretical basis for research to understand, support and facilitate the adoption of ERMS to HPE benefit. The proposed framework could help to improve educational outcomes and the successful implementation of ERMS.

A Pragmatic Application of the RE-AIM Framework for Evaluating the Implementation of Physical Activity as a Standard of Care in Health Systems

Introduction

Exercise is Medicine (EIM) is an initiative that seeks to integrate physical activity assessment, prescription, and patient referral as a standard in patient care. Methods to assess this integration have lagged behind its implementation.

Purpose and Objectives

The purpose of this work is to provide a pragmatic framework to guide health care systems in assessing the implementation and impact of EIM.

Evaluation Methods

A working group of experts from health care, public health, and implementation science convened to develop an evaluation model based on the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework. The working group aimed to provide pragmatic guidance on operationalizing EIM across the different RE-AIM dimensions based on data typically available in health care settings.

Results

The Reach of EIM can be determined by the number and proportion of patients that were screened for physical inactivity, received brief counseling and/or a physical activity prescription, and were referred to physical activity resources. Effectiveness can be assessed through self-reported changes in physical activity, cardiometabolic biometric factors, incidence/burden of chronic disease, as well as health care utilization and costs. Adoption includes assessing the number and representativeness of health care settings that adopt any component of EIM, and Implementation involves assessing the extent to which health care teams implement EIM in their clinic. Finally, Maintenance involves assessing the long-term effectiveness (patient level) and sustained implementation (clinic level) of EIM in a given health care setting.

Implications for Public Health

The availability of a standardized, pragmatic, evaluation framework is critical in determining the impact of implementing EIM as a standard of care across health care systems.

Service Oriented Architecture (SOA) Implementation

Using a multiple case studies and surveys, this article finds that factors essential to successful Service Oriented Architecture (SOA) implementations include establishing effective SOA governance, establishing SOA registries, starting with a small project, collaboration between business and IT units, strengthening trust among business units, and training. This article also explores business and IT motivations for SOA implementation and the benefits realized from this implementation. The findings from this article can provide a guidance for practitioners on the successful implementation of SOA.

Understanding the Essence of Caring from the Lived Experiences of Filipino Informatics Nurses

Caring is considered a unique concept in nursing because it subsumes all intrinsic attributes of nursing as a human helping discipline. Scholars have argued that caring is usually seen as an encounter between nurses and patients, but how about nurses with minimal or absent nurse-patient encounters, like informatics nurses? In this study, we explored the meaning of the phenomenon of caring to present lived experiences of caring, namely caring as actions of coming in between; caring as expressed within embodied relations; and caring and the path traversed by informatics nurses. The informatics nurse-cyborg-patient triad speaks of Filipino informatics nurses’ insightful understanding of the phenomenon of caring.

Improving quality of care through patient-reported outcome measures (PROMs): expert interviews using the NHS PROMs Programme and the Swedish quality registers for knee and hip arthroplasty as examples

BACKGROUND

Patient reported outcome measures (PROMs) have been integrated in national quality registries or specific national monitoring initiatives to inform the improvement of quality of care on a national scale. However there are many unanswered questions, such as: how these systems are set up, whether they lead to improved quality of care, which stakeholders use the information once it is available. The aim of this study was to examine supporting and hindering factors relevant to integrating patient-reported outcome measures (PROMs) in selected health information systems (HIS) tailored toward improving quality of care across the entire health system.

METHODS

First, a systematic search and review was conducted to outline previously identified factors relevant to the integration of PROMs in the selected HIS. A social network analysis was performed to identify networks of experts in these systems. Second, expert interviews were conducted to discuss and elaborate on the identified factors. Directive content analysis was applied using a HIS Evaluation Framework as the frame of reference. This framework is structured into four components: Organization, Human, Technology, and Net benefits.

RESULTS

The literature review revealed 37 papers for the NHS PROMs Programme and 26 papers for the SHPR and SKAR: Five networks of researchers were identified for the NHS PROMs Programme and 1 for the SHPR and SKAR. Seven experts related to the NHS PROMs Programme and 3 experts related to the SKAR and SHPR participated in the study. The main themes which revealed in relation to Organization were Governance and Capacity building; to Human: Reporting and Stakeholder Engagement; to Technology: the Selection and Collection of PROMs and Data linkage. In relation to Net benefits, system-specific considerations are presented.

CONCLUSION

Both examples succeeded in integrating PROMs into HIS on a national scale. The lack of an established standard on what change PROMs should be achieved by an intervention limits their usefulness for monitoring quality of care. Whether the PROMs data collected within these systems can be used in routine clinical practice is considered a challenge in both countries.

Evaluation of the USE IT-questionnaire for the Evaluation of the Adoption of Electronic Patient Records by Healthcare Professionals

Background: A combined quantitative and qualitative socio-technical approach is applied in two evaluation studies of electronic patient records (EPR). In these studies the focus was on factors influencing the adoption of the EPR by care providers.

Objective: The research approach is based on the USE IT-model. In addition to the USE IT-interview model, the USE IT-questionnaire is presented and evaluated in order to pre sent a valid and useful integrated approach for the evaluation of IT-adoption in healthcare.

Methods: The USE IT-questionnaire was evaluated by applying a principal component analysis of the quantitative results in two cases (n = 222), and by comparison of the resulting factors with the determinants of the USE IT-model.

Results: The factor analysis of the USE IT-questionnaire resulted in six valid factors: 1. Task support satisfaction, 2. Interface satisfaction, 3. Compatibility, 4. Collaboration, 5. Learnability, and 6. Accessibility. The questions about resources did not combine into a factor.

Conclusion: The detailed questions of the questionnaire lead to decomposition of the constructs Task support satisfaction and Ease of use into factors. The construct Task support satisfaction which was supposed to measure relevance was decomposed in two factors measuring relevance and two factors measuring micro-requirements.

Health Services Research Evaluation Principles

Background: Our forthcoming national experiment in increased health information technology (HIT) adoption funded by the American Recovery and Reinvestment Act of 2009 will require a comprehensive approach to evaluating HIT. The quality of evaluation studies of HIT to date reveals a need for broader evaluation frameworks that limits the generalizability of findings and the depth of lessons learned.

Objective: Develop an informatics evaluation framework for health information technology (HIT) integrating components of health services research (HSR) evaluation and informatics evaluation to address identified shortcomings in available HIT evaluation frameworks.

Method: A systematic literature review updated and expanded the exhaustive review by Ammenwerth and deKeizer (AdK). From retained studies, criteria were elicited and organized into classes within a framework. The resulting Health Information Technology Research-based Evaluation Framework (HITREF) was used to guide clinician satisfaction survey construction, multi-dimensional analysis of data, and interpretation of findings in an evaluation of a vanguard community health care EHR.

Results: The updated review identified 128 electronic health record (EHR) evaluation studies and seven evaluation criteria not in AdK: EHR Selection/Development/Training; Patient Privacy Concerns; Unintended Consequences/ Benefits; Functionality; Patient Satisfaction with EHR; Barriers/Facilitators to Adoption; and Patient Satisfaction with Care. HITREF was used productively and was a complete evaluation framework which included all themes that emerged.

Conclusions: We can recommend to future EHR evaluators that they consider adding a complete, research-based HIT evaluation framework, such as HITREF, to their evaluation tools suite to monitor HIT challenges as the federal government strives to increase HIT adoption.

Availability and quality of routine morbidity data: review of studies in South Africa

Objectives

Routine health information systems (RHISs) provide data that are vital for planning and monitoring individual health. Data from RHISs could also be used for purposes for which they were not originally intended, provided that the data are of sufficient quality. For example, morbidity data could be used to inform burden of disease estimations, which serve as important evidence to prioritize interventions and promote health. The objective of this study was to identify and assess published quantitative assessments of data quality related to patient morbidity in RHISs in use in South Africa.

Materials and Methods

We conducted a review of literature published between 1994 and 2014 that assessed the quality of data in RHISs in South Africa. World Health Organization (WHO) data quality components were used as the assessment criteria.

Results

Of 420 references identified, 11 studies met the inclusion criteria. The studies were limited to tuberculosis and HIV. No study reported more than 3 WHO data quality components or provided a quantitative assessment of quality that could be used for burden of disease estimation.

Discussion

The included studies had limited geographical focus and evaluated different source data at different levels of the information system. All studies reported poor data quality.

Conclusion

This review confirmed concerns about the quality of data in RHISs, and highlighted the need for a comprehensive evaluation of the quality of patient-level morbidity data in RHISs in South Africa.

Development of an Evaluation Framework for Health Information Systems (DIPSA)

Introduction:

Use of Integrated Health Information Systems (IHIS) for the provision of healthcare services benefits both healthcare professionals and patients, while requiring continuous evaluation and upgrading to fully support its role.

Aim:

The main purpose of the study was to develop an evaluation framework for hospitals utilizing IHIS, within the three main areas identified as Human factor, Technology and Organization.

Material and methods:

The questionnaire consisted of 43 questions, with 17 questions (related to categories procedures, system quality and satisfaction), 25 questions (related to categories, safety and collaboration) and 1 question related to accessibility to the system (within the category system quality). Three open questions were added to evaluate users’ perception on what was needed for the improvement of health services in their respective hospitals for all 3 variables being evaluated. The open questions were included to allow participants to express their opinion in a more detailed setting. A database was developed, and the data were processed and analyzed.

Results:

Factor analysis formed 5 categories for the evaluation framework. Cronbach’s alpha coefficient was found in all categories to be above > 0.85.

Conclusion:

Evaluation frameworks can be designed, developed and implemented by using different methodologies. For an evaluation framework to be effective it should be designed and implemented based on the aims and purpose of the research and the specific needs of the particular healthcare setting or hospital. Considering the categories satisfaction, collaboration, safety, system quality, procedures, and by using Likert scale and open questions in the current study, DIPSA can provide a holistic image of IHIS by evaluating any hospital system.

Comprehensive overview of computer-based health information tailoring: a scoping review protocol

INTRODUCTION

Tailoring health information to the needs of individuals has become an important part of modern health communications. Tailoring has been addressed by researchers from different disciplines leading to the emergence of a wide range of approaches, making the newcomers confused. In order to address this, a comprehensive overview of the field with the indications of research gaps, tendencies and trends will be helpful. As a result, a systematic protocol was outlined to conduct a scoping review within the field of computer-based health information tailoring.

METHODS AND ANALYSIS

This protocol is based on the York's five-stage framework outlined by Arksey and O'Malley. A field-specific structure was defined as a basis for undertaking each stage. The structure comprised three main aspects: system design, information communication and evaluation. Five leading databases were searched: PubMed, Scopus, Science Direct, EBSCO and IEEE and a broad search strategy was used with less strict inclusion criteria to cover the breadth of evidence. Theoretical frameworks were used to develop the data extraction form and a rigorous approach was introduced to identify the categories from data. Several explanatory-descriptive methods were considered to analyse the data, from which some were proposed to be employed for the first time in scoping studies.

ETHICS AND DISSEMINATION

This study investigates the breadth and depth of existing literature on computer-tailoring and as a secondary analysis, does not require ethics approval. We anticipate that the results will identify research gaps and novel ideas for future studies and provide direction to combine methods from different disciplines. The research findings will be submitted for publication to relevant peer-reviewed journals and conferences targeting health promotion and patient education.

The International Classification of Functioning, Disability and Health (ICF) in Electronic Health Records. A Systematic Literature Review

BACKGROUND

The International Classification of Functioning, Disability and Health (ICF) is the World Health Organization's standard for describing health and health-related states. Examples of how the ICF has been used in Electronic Health Records (EHRs) have not been systematically summarized and described yet.

OBJECTIVES

To provide a systematic review of peer-reviewed literature about the ICF's use in EHRs, including related challenges and benefits.

METHODS

Peer-reviewed literature, published between January 2001 and July 2015 was retrieved from Medline^®, CINAHL^®, Scopus^®, and ProQuest^® Social Sciences using search terms related to ICF and EHR concepts. Publications were categorized according to three groups: Requirement specification, development and implementation. Information extraction was conducted according to a qualitative content analysis method, deductively informed by the evaluation framework for Health Information Systems: Human, Organization and Technology-fit (HOT-fit).

RESULTS

Of 325 retrieved articles, 17 publications were included; 4 were categorized as requirement specification, 7 as development, and 6 as implementation publications. Information regarding the HOT-fit evaluation framework was summarized. Main benefits of using the ICF in EHRs were its unique comprehensive perspective on health and its interdisciplinary focus. Main challenges included the fact that the ICF is not structured as a formal terminology as well as the need for a reduced number of ICF codes for more feasible and practical use.

CONCLUSION

Different approaches and technical solutions exist for integrating the ICF in EHRs, such as combining the ICF with other existing standards for EHR or selecting ICF codes with natural language processing. Though the use of the ICF in EHRs is beneficial as this review revealed, the ICF could profit from further improvements such as formalizing the knowledge representation in the ICF to support and enhance interoperability.

End-user support for primary care electronic medical records: a qualitative case study of users' needs, expectations and realities

Support is considered an important factor for realizing the benefits of health information technology (HIT) but there is a dearth of research on the topic of support, especially in primary care. We conducted a qualitative multiple case study of 4 family health teams (FHTs) and one family health organization (FHO) in Ontario, Canada in an attempt to gain insight into users' expectations and needs, and the realities of end-user support for primary care electronic medical records (EMRs). Data were collected by semi-structured interviews, documents review, and observation of training sessions. The analysis highlights the important role of on-site information technology (IT) staff and super-users in liaising with various stakeholders to solve technical problems and providing hardware and functional ('how to') support; the local development of data support practices to ensure consistent documentation; and the gaps that exist in users' and support personnel's understanding of each other's work processes.

Data journeys: Identifying social and technical barriers to data movement in large, complex organisations

Managers in complex organisations often have to make decisions on whether new software developments are worth undertaking or not. Such decisions are hard to make, especially at an enterprise level. Both costs and risks are regularly underestimated, despite the existence of a plethora of software and systems engineering methodologies aimed at predicting and controlling them. Our objective is to help managers and stakeholders of large, complex organisations (like the National Health Service in the UK) make better informed decisions on the costs and risks of planned new software systems that will reuse or extend their existing information infrastructure. We analysed case studies describing new software developments undertaken by providers of health care services in the UK, looking for common points of risk and high cost. The results highlighted the movement of data within and between organisations as a key factor. Data movement can be hindered by numerous technical barriers, but also by other challenges arising from social aspects of the organisation. These latter aspects are often harder to predict, and are ignored by many of the more common software engineering methodologies. In this paper, we propose data journey modelling, a new method aiming to predict places of high cost and risk when existing data needs to move to a new development. The method is lightweight and combines technical and social aspects, but relies only on information that is likely to be already known to key stakeholders, or will be cheap to acquire. To assess the effectiveness of our method, we conducted a retrospective evaluation in an NHS Foundation Trust hospital. Using the method, we were able to predict most of the points of high cost/risk that the hospital staff had identified, along with several other possible directions that the staff did not identify for themselves, but agreed could be promising.

Perceptions about data-informed decisions: an assessment of information-use in high HIV-prevalence settings in South Africa

Background

Information-use is an integral component of a routine health information system and essential to influence policy-making, program actions and research. Despite an increased amount of routine data collected, planning and resource-allocation decisions made by health managers for managing HIV programs are often not based on data. This study investigated the use of information, and barriers to using routine data for monitoring the prevention of mother-to-child transmission of HIV (PMTCT) programs in two high HIV-prevalence districts in South Africa.

Methods

We undertook an observational study using a multi-method approach, including an inventory of facility records and reports. The performance of routine information systems management (PRISM) diagnostic ‘Use of Information’ tool was used to assess the PMTCT information system for evidence of data use in 57 health facilities in two districts. Twenty-two in-depth interviews were conducted with key informants to investigate barriers to information use in decision-making. Participants were purposively selected based on their positions and experience with either producing PMTCT data and/or using data for management purposes. We computed descriptive statistics and used a general inductive approach to analyze the qualitative data.

Results

Despite the availability of mechanisms and processes to facilitate information-use in about two-thirds of the facilities, evidence of information-use (i.e., indication of some form of information-use in available RHIS reports) was demonstrated in 53% of the facilities. Information was inadequately used at district and facility levels to inform decisions and planning, but was selectively used for reporting and monitoring program outputs at the provincial level. The inadequate use of information stemmed from organizational issues such as the lack of a culture of information-use, lack of trust in the data, and the inability of program and facility managers to analyze, interpret and use information.

Conclusions

Managers’ inability to use information implied that decisions for program implementation and improving service delivery were not always based on data. This lack of data use could influence the delivery of health care services negatively. Facility and program managers should be provided with opportunities for capacity development as well as practice-based, in-service training, and be supported to use information for planning, management and decision-making.

Perceptions about data-informed decisions: an assessment of information-use in high HIV-prevalence settings in South Africa

BACKGROUND

Information-use is an integral component of a routine health information system and essential to influence policy-making, program actions and research. Despite an increased amount of routine data collected, planning and resource-allocation decisions made by health managers for managing HIV programs are often not based on data. This study investigated the use of information, and barriers to using routine data for monitoring the prevention of mother-to-child transmission of HIV (PMTCT) programs in two high HIV-prevalence districts in South Africa.

METHODS

We undertook an observational study using a multi-method approach, including an inventory of facility records and reports. The performance of routine information systems management (PRISM) diagnostic 'Use of Information' tool was used to assess the PMTCT information system for evidence of data use in 57 health facilities in two districts. Twenty-two in-depth interviews were conducted with key informants to investigate barriers to information use in decision-making. Participants were purposively selected based on their positions and experience with either producing PMTCT data and/or using data for management purposes. We computed descriptive statistics and used a general inductive approach to analyze the qualitative data.

RESULTS

Despite the availability of mechanisms and processes to facilitate information-use in about two-thirds of the facilities, evidence of information-use (i.e., indication of some form of information-use in available RHIS reports) was demonstrated in 53% of the facilities. Information was inadequately used at district and facility levels to inform decisions and planning, but was selectively used for reporting and monitoring program outputs at the provincial level. The inadequate use of information stemmed from organizational issues such as the lack of a culture of information-use, lack of trust in the data, and the inability of program and facility managers to analyze, interpret and use information.

CONCLUSIONS

Managers' inability to use information implied that decisions for program implementation and improving service delivery were not always based on data. This lack of data use could influence the delivery of health care services negatively. Facility and program managers should be provided with opportunities for capacity development as well as practice-based, in-service training, and be supported to use information for planning, management and decision-making.

Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies

BACKGROUND

Many promising technological innovations in health and social care are characterized by nonadoption or abandonment by individuals or by failed attempts to scale up locally, spread distantly, or sustain the innovation long term at the organization or system level.

OBJECTIVE

Our objective was to produce an evidence-based, theory-informed, and pragmatic framework to help predict and evaluate the success of a technology-supported health or social care program.

METHODS

The study had 2 parallel components: (1) secondary research (hermeneutic systematic review) to identify key domains, and (2) empirical case studies of technology implementation to explore, test, and refine these domains. We studied 6 technology-supported programs-video outpatient consultations, global positioning system tracking for cognitive impairment, pendant alarm services, remote biomarker monitoring for heart failure, care organizing software, and integrated case management via data sharing-using longitudinal ethnography and action research for up to 3 years across more than 20 organizations. Data were collected at micro level (individual technology users), meso level (organizational processes and systems), and macro level (national policy and wider context). Analysis and synthesis was aided by sociotechnically informed theories of individual, organizational, and system change. The draft framework was shared with colleagues who were introducing or evaluating other technology-supported health or care programs and refined in response to feedback.

RESULTS

The literature review identified 28 previous technology implementation frameworks, of which 14 had taken a dynamic systems approach (including 2 integrative reviews of previous work). Our empirical dataset consisted of over 400 hours of ethnographic observation, 165 semistructured interviews, and 200 documents. The final nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) framework included questions in 7 domains: the condition or illness, the technology, the value proposition, the adopter system (comprising professional staff, patient, and lay caregivers), the organization(s), the wider (institutional and societal) context, and the interaction and mutual adaptation between all these domains over time. Our empirical case studies raised a variety of challenges across all 7 domains, each classified as simple (straightforward, predictable, few components), complicated (multiple interacting components or issues), or complex (dynamic, unpredictable, not easily disaggregated into constituent components). Programs characterized by complicatedness proved difficult but not impossible to implement. Those characterized by complexity in multiple NASSS domains rarely, if ever, became mainstreamed. The framework showed promise when applied (both prospectively and retrospectively) to other programs.

CONCLUSIONS

Subject to further empirical testing, NASSS could be applied across a range of technological innovations in health and social care. It has several potential uses: (1) to inform the design of a new technology; (2) to identify technological solutions that (perhaps despite policy or industry enthusiasm) have a limited chance of achieving large-scale, sustained adoption; (3) to plan the implementation, scale-up, or rollout of a technology program; and (4) to explain and learn from program failures.

The International Classification of Functioning, Disability and Health (ICF) in Electronic Health Records. A Systematic Literature Review

BACKGROUND

The International Classification of Functioning, Disability and Health (ICF) is the World Health Organization's standard for describing health and health-related states. Examples of how the ICF has been used in Electronic Health Records (EHRs) have not been systematically summarized and described yet.

OBJECTIVES

To provide a systematic review of peer-reviewed literature about the ICF's use in EHRs, including related challenges and benefits.

METHODS

Peer-reviewed literature, published between January 2001 and July 2015 was retrieved from Medline^®, CINAHL^®, Scopus^®, and ProQuest^® Social Sciences using search terms related to ICF and EHR concepts. Publications were categorized according to three groups: Requirement specification, development and implementation. Information extraction was conducted according to a qualitative content analysis method, deductively informed by the evaluation framework for Health Information Systems: Human, Organization and Technology-fit (HOT-fit).

RESULTS

Of 325 retrieved articles, 17 publications were included; 4 were categorized as requirement specification, 7 as development, and 6 as implementation publications. Information regarding the HOT-fit evaluation framework was summarized. Main benefits of using the ICF in EHRs were its unique comprehensive perspective on health and its interdisciplinary focus. Main challenges included the fact that the ICF is not structured as a formal terminology as well as the need for a reduced number of ICF codes for more feasible and practical use.

CONCLUSION

Different approaches and technical solutions exist for integrating the ICF in EHRs, such as combining the ICF with other existing standards for EHR or selecting ICF codes with natural language processing. Though the use of the ICF in EHRs is beneficial as this review revealed, the ICF could profit from further improvements such as formalizing the knowledge representation in the ICF to support and enhance interoperability.

Personalized Consent Flow in Contemporary Data Sharing for Medical Research: A Viewpoint

BACKGROUND

Health data personally collected by individuals with wearable devices and smartphones is becoming an important data source for healthcare, but also for medical research.

OBJECTIVE

To describe a new consent model that allows people to control their personally collected health data and determine to what extent they want to share these for research purposes.

METHODS

We developed, in close collaboration with patients, researchers, healthcare professionals, privacy experts, and an accredited Medical Ethical Review Committee, an innovative concept called "personalized consent flow" within a research platform connected to a personal health record. The development was an iterative process with informal meetings, semistructured interviews, and surveys. The final concept of the personalized consent flow was reviewed by patients and improved and approved by the same patients in a focus group.

RESULTS

This concept could result in optimal control for individual users, since they will answer questions about how they will share data. Furthermore, it enables users to collect data for specific studies and add expiration dates to their data. This work facilitates further discussion about dynamic and personalized consent. A pilot study with the personalized consent model is currently being carried out.

Waste in health information systems: a systematic review

Purpose

The purpose of this paper is to discuss a systematic review on waste identification related to health information systems (HIS) in Lean transformation.

Design/methodology/approach

A systematic review was conducted on 19 studies to evaluate Lean transformation and tools used to remove waste related to HIS in clinical settings.

Findings

Ten waste categories were identified, along with their relationships and applications of Lean tool types related to HIS. Different Lean tools were used at the early and final stages of Lean transformation; the tool selection depended on the waste characteristic. Nine studies reported a positive impact from Lean transformation in improving daily work processes. The selection of Lean tools should be made based on the timing, purpose and characteristics of waste to be removed.

Research limitations/implications

Overview of waste and its category within HIS and its analysis from socio-technical perspectives enabled the identification of its root cause in a holistic and rigorous manner.

Practical implications

Understanding waste types, their root cause and review of Lean tools could subsequently lead to the identification of mitigation approach to prevent future error occurrence.

Originality/value

Specific waste models for HIS settings are yet to be developed. Hence, the identification of the waste categories could guide future implementation of Lean transformations in HIS settings.

Green IT/IS investments evaluation within the aviation industry

Purpose

The purpose of this paper is to utilize the existing theories and knowledge surrounding information systems (IS) evaluation and Green information technology (IT)/IS investments to develop a conceptual model for helping decision makers to overcome and reduce the impacts from Green IT/IS investment related to cost overruns or under-optimized budgets.

Design/methodology/approach

The paper is discursive, based on the analysis and synthesis of literature pertaining to IS evaluation, Green IT/IS adoption and Sustainable/Green/CSR within an aviation context. Gaps in the preceding research have been identified, and a conceptual model is proposed. Additionally, further research and a methodology are suggested.

Findings

The paper proposes a conceptual model that can identify factors including external factors derived from institutional theory, internal organizational factors, and a list of indirect costs associated with Green IT/IS investments for an aviation organization.

Research limitations/implications

As a conceptual paper, the study is limited to literature, identifying gaps, and proposing a model. The paper recommends further empirical validation of the proposed conceptual model.

Practical implications

The conceptual model is helpful for decision makers within the aviation industry to enhance their understanding of the identification and management of indirect costs within the aviation context, which results in effective management of Green IT/IS indirect costs.

Originality/value

The paper fills gaps in the knowledge of IS evaluation, Green IT/IS adoption/evaluation within aviation context through helping decision makers to understand, identify, and manage the associated indirect costs.

Health information systems evaluation frameworks: A systematic review

BACKGROUND

Evaluation of health information systems (HISs) is complicated because of the complex nature of the health care domain. Various studies have proposed different frameworks to reduce the complexity in the assessment of these systems. The aim of these frameworks is to provide a set of guidelines for the evaluation of the adequacy of health care information systems.

OBJECTIVE

This paper aims to analyse studies on the evaluation of HISs by applying a content, context and process (CCP) framework to address the 'who', 'what', 'how', 'when', and 'why' of the evaluation processes used. This will allow for a better understanding of the relative strengths and weaknesses of various HISs evaluation frameworks, and will pave the way for developing a more complete framework for HISs.

METHOD

A systematic literature review on HIS evaluation studies was undertaken to identify the currently available HIS evaluation frameworks. Five academic databases were selected to conduct this systematic literature review.

RESULTS

Most of the studies only address some, but not all, of the five main questions, i.e. the who, what, how, when, why, and that there was a lack of consensus in the way these questions were addressed. The critical role of context was also largely neglected in these studies.

CONCLUSIONS

Evaluation of HISs is complex. The health care domain is highly context sensitive and in order to have a complete assessment of HISs, consideration of contextual factors is necessary. Specifically, to have the right set of criteria to measure the 'what', the answer to the 'who' of the evaluation is necessary.

Understanding latent structures of clinical information logistics: A bottom-up approach for model building and validating the workflow composite score

BACKGROUND AND PURPOSE

Clinical information logistics is a construct that aims to describe and explain various phenomena of information provision to drive clinical processes. It can be measured by the workflow composite score, an aggregated indicator of the degree of IT support in clinical processes. This study primarily aimed to investigate the yet unknown empirical patterns constituting this construct. The second goal was to derive a data-driven weighting scheme for the constituents of the workflow composite score and to contrast this scheme with a literature based, top-down procedure. This approach should finally test the validity and robustness of the workflow composite score.

METHODS

Based on secondary data from 183 German hospitals, a tiered factor analytic approach (confirmatory and subsequent exploratory factor analysis) was pursued. A weighting scheme, which was based on factor loadings obtained in the analyses, was put into practice.

RESULTS

We were able to identify five statistically significant factors of clinical information logistics that accounted for 63% of the overall variance. These factors were "flow of data and information", "mobility", "clinical decision support and patient safety", "electronic patient record" and "integration and distribution". The system of weights derived from the factor loadings resulted in values for the workflow composite score that differed only slightly from the score values that had been previously published based on a top-down approach.

CONCLUSION

Our findings give insight into the internal composition of clinical information logistics both in terms of factors and weights. They also allowed us to propose a coherent model of clinical information logistics from a technical perspective that joins empirical findings with theoretical knowledge. Despite the new scheme of weights applied to the calculation of the workflow composite score, the score behaved robustly, which is yet another hint of its validity and therefore its usefulness.

A literature review for large-scale health information system project planning, implementation and evaluation

Information technology is perceived as a potential panacea for healthcare organisations to manage pressure to improve services in the face of increased demand. However, the implementation and evaluation of health information systems (HIS) is plagued with problems and implementation shortcomings and failures are rife. HIS implementation is complex and relies on organisational, structural, technological, and human factors to be successful. It also requires reflective, nuanced, multidimensional evaluation to provide ongoing feedback to ensure success. This article provides a comprehensive review of the literature about evaluating and implementing HIS, detailing the challenges and recommendations for both evaluators and healthcare organisations. The factors that inhibit or promote successful HIS implementation are identified and effective evaluation strategies are described with the goal of informing teams evaluating complex HIS.

e-Vita: design of an innovative approach to COPD disease management in primary care through eHealth application

BACKGROUND

COPD is a highly complex disease to manage as patients show great variation in symptoms and limitations in daily life. In the last decade self-management support of COPD has been introduced as an effective method to improve quality and efficiency of care, and to reduce healthcare costs. Despite the urge to change the organisation of health care and the potential of eHealth to support this, large-scale implementation in daily practice remains behind, especially in the Netherlands.

METHODS/DESIGN

We designed a multilevel study, called e-Vita, to investigate different organisational implementation methods of a self-management web portal to support and empower patients with COPD in three different primary care settings. Using a parallel cohort design, the clinical effects of the web portal will be assessed using an interrupted times series (ITS) study design and measured according to changes in health status with the Clinical COPD Questionnaire (CCQ). The different implementations and net benefits of self-management through eHealth on clinical outcomes will be evaluated from human, organisational, and technical perspectives.

DISCUSSION

To our knowledge this is the first study to combine different study designs that enable simultaneous investigation of clinical effects, as well as effects of different organisational implementation methods whilst controlling for confounding effects of the organisational characteristics. We hypothesize that an implementation with higher levels of personal assistance, and integrated in an existing care program will result in increased use of and satisfaction with the platform, thereby increasing health status and diminishing exacerbation and hospitalisation.

TRIAL REGISTRATION NUMBER

NTR4098 (31-07-2013).

e-Vita: design of an innovative approach to COPD disease management in primary care through eHealth application

Background

COPD is a highly complex disease to manage as patients show great variation in symptoms and limitations in daily life. In the last decade self-management support of COPD has been introduced as an effective method to improve quality and efficiency of care, and to reduce healthcare costs. Despite the urge to change the organisation of health care and the potential of eHealth to support this, large-scale implementation in daily practice remains behind, especially in the Netherlands.

Methods/Design

We designed a multilevel study, called e-Vita, to investigate different organisational implementation methods of a self-management web portal to support and empower patients with COPD in three different primary care settings. Using a parallel cohort design, the clinical effects of the web portal will be assessed using an interrupted times series (ITS) study design and measured according to changes in health status with the Clinical COPD Questionnaire (CCQ). The different implementations and net benefits of self-management through eHealth on clinical outcomes will be evaluated from human, organisational, and technical perspectives.

Discussion

To our knowledge this is the first study to combine different study designs that enable simultaneous investigation of clinical effects, as well as effects of different organisational implementation methods whilst controlling for confounding effects of the organisational characteristics. We hypothesize that an implementation with higher levels of personal assistance, and integrated in an existing care program will result in increased use of and satisfaction with the platform, thereby increasing health status and diminishing exacerbation and hospitalisation.

Trial registration

NTR4098 (31-07-2013)

Critical Factors Influencing Decision to Adopt Human Resource Information System (HRIS) in Hospitals

The aim of this research is to explore factors influencing the management decisions to adopt human resource information system (HRIS) in the hospital industry of Bangladesh-an emerging developing country. To understand this issue, this paper integrates two prominent adoption theories-Human-Organization-Technology fit (HOT-fit) model and Technology-Organization-Environment (TOE) framework. Thirteen factors under four dimensions were investigated to explore their influence on HRIS adoption decisions in hospitals. Employing non-probability sampling method, a total of 550 copies of structured questionnaires were distributed among HR executives of 92 private hospitals in Bangladesh. Among the respondents, usable questionnaires were 383 that suggesting a valid response rate of 69.63%. We classify the sample into 3 core groups based on the HRIS initial implementation, namely adopters, prospectors, and laggards. The obtained results specify 5 most critical factors i.e. IT infrastructure, top management support, IT capabilities of staff, perceived cost, and competitive pressure. Moreover, the most significant dimension is technological dimension followed by organisational, human, and environmental among the proposed 4 dimensions. Lastly, the study found existence of significant differences in all factors across different adopting groups. The study results also expose constructive proposals to researchers, hospitals, and the government to enhance the likelihood of adopting HRIS. The present study has important implications in understanding HRIS implementation in developing countries.

Clinical Information Systems - From Yesterday to Tomorrow

OBJECTIVES

To review the history of clinical information systems over the past twenty-five years and project anticipated changes to those systems over the next twenty-five years.

METHODS

Over 250 Medline references about clinical information systems, quality of patient care, and patient safety were reviewed. Books, Web resources, and the author's personal experience with developing the HELP system were also used.

RESULTS

There have been dramatic improvements in the use and acceptance of clinical computing systems and Electronic Health Records (EHRs), especially in the United States. Although there are still challenges with the implementation of such systems, the rate of progress has been remarkable. Over the next twenty-five years, there will remain many important opportunities and challenges. These opportunities include understanding complex clinical computing issues that must be studied, understood and optimized. Dramatic improvements in quality of care and patient safety must be anticipated as a result of the use of clinical information systems. These improvements will result from a closer involvement of clinical informaticians in the optimization of patient care processes.

CONCLUSIONS

Clinical information systems and computerized clinical decision support have made contributions to medicine in the past. Therefore, by using better medical knowledge, optimized clinical information systems, and computerized clinical decision, we will enable dramatic improvements in both the quality and safety of patient care in the next twenty-five years.

Opportunities and challenges for implementing cost accounting systems in the Kenyan health system

BACKGROUND

Low- and middle-income countries need to sustain efficiency and equity in health financing on their way to universal health care coverage. However, systems meant to generate quality economic information are often deficient in such settings. We assessed the feasibility of streamlining cost accounting systems within the Kenyan health sector to illustrate the pragmatic challenges and opportunities.

DESIGN

We reviewed policy documents, and conducted field observations and semi-structured interviews with key informants in the health sector. We used an adapted Human, Organization and Technology fit (HOT-fit) framework to analyze the components and standards of a cost accounting system.

RESULTS

Among the opportunities for a viable cost accounting system, we identified a supportive broad policy environment, political will, presence of a national data reporting architecture, good implementation experience with electronic medical records systems, and the availability of patient clinical and resource use data. However, several practical issues need to be considered in the design of the system, including the lack of a framework to guide the costing process, the lack of long-term investment, the lack of appropriate incentives for ground-level staff, and a risk of overburdening the current health management information system.

CONCLUSION

To facilitate the implementation of cost accounting into the health sector, the design of any proposed system needs to remain simple and attuned to the local context.

Evaluating Health Information Systems Using Ontologies

BACKGROUND

There are several frameworks that attempt to address the challenges of evaluation of health information systems by offering models, methods, and guidelines about what to evaluate, how to evaluate, and how to report the evaluation results. Model-based evaluation frameworks usually suggest universally applicable evaluation aspects but do not consider case-specific aspects. On the other hand, evaluation frameworks that are case specific, by eliciting user requirements, limit their output to the evaluation aspects suggested by the users in the early phases of system development. In addition, these case-specific approaches extract different sets of evaluation aspects from each case, making it challenging to collectively compare, unify, or aggregate the evaluation of a set of heterogeneous health information systems.

OBJECTIVES

The aim of this paper is to find a method capable of suggesting evaluation aspects for a set of one or more health information systems-whether similar or heterogeneous-by organizing, unifying, and aggregating the quality attributes extracted from those systems and from an external evaluation framework.

METHODS

On the basis of the available literature in semantic networks and ontologies, a method (called Unified eValuation using Ontology; UVON) was developed that can organize, unify, and aggregate the quality attributes of several health information systems into a tree-style ontology structure. The method was extended to integrate its generated ontology with the evaluation aspects suggested by model-based evaluation frameworks. An approach was developed to extract evaluation aspects from the ontology that also considers evaluation case practicalities such as the maximum number of evaluation aspects to be measured or their required degree of specificity. The method was applied and tested in Future Internet Social and Technological Alignment Research (FI-STAR), a project of 7 cloud-based eHealth applications that were developed and deployed across European Union countries.

RESULTS

The relevance of the evaluation aspects created by the UVON method for the FI-STAR project was validated by the corresponding stakeholders of each case. These evaluation aspects were extracted from a UVON-generated ontology structure that reflects both the internally declared required quality attributes in the 7 eHealth applications of the FI-STAR project and the evaluation aspects recommended by the Model for ASsessment of Telemedicine applications (MAST) evaluation framework. The extracted evaluation aspects were used to create questionnaires (for the corresponding patients and health professionals) to evaluate each individual case and the whole of the FI-STAR project.

CONCLUSIONS

The UVON method can provide a relevant set of evaluation aspects for a heterogeneous set of health information systems by organizing, unifying, and aggregating the quality attributes through ontological structures. Those quality attributes can be either suggested by evaluation models or elicited from the stakeholders of those systems in the form of system requirements. The method continues to be systematic, context sensitive, and relevant across a heterogeneous set of health information systems.

Searching for a Role of Nursing Personnel in Developing Landscape of Ehealth: Factors Determining Attitudes toward Key Patient Empowering Applications

Introduction

Nurses may play an important role in the delivery of medical services based on the use of ehealth tools. Nevertheless, their taking an active role in an ehealth environment depends on their possessing the appropriate skills and mindset. The main objective of this paper was to assess nurses’ opinions and to analyze the predictors of their acceptance of ehealth features relevant to patient empowerment with a strong focus on chronic care.

Methods

A survey was conducted among nurses from hospital centers of south-eastern Poland based on a questionnaire designed to assess their attitudes toward the ehealth domain. The predictors of the nurses’ acceptance of ehealth usage within specific contexts were assessed with uni- and multivariate logistic regression.

Results

An analysis was performed on data from 648 questionnaires retained after a quality check. The duration of Internet use was consistently related to higher acceptance of ehealth applications and more certainty regarding the reliability of health-related information available on the Internet. Nurses from urban medical centers were more skeptical about the use of specific ehealth solutions.

Conclusion

Previous experience in using information technologies is the main factor influencing the acceptance of specific ehealth solutions relevant for care provided to patients suffering from chronic conditions.

Conceptual Models in Health Informatics Research: A Literature Review and Suggestions for Development

BACKGROUND

Contributing to health informatics research means using conceptual models that are integrative and explain the research in terms of the two broad domains of health science and information science. However, it can be hard for novice health informatics researchers to find exemplars and guidelines in working with integrative conceptual models.

OBJECTIVES

The aim of this paper is to support the use of integrative conceptual models in research on information and communication technologies in the health sector, and to encourage discussion of these conceptual models in scholarly forums.

METHODS

A two-part method was used to summarize and structure ideas about how to work effectively with conceptual models in health informatics research that included (1) a selective review and summary of the literature of conceptual models; and (2) the construction of a step-by-step approach to developing a conceptual model.

RESULTS

The seven-step methodology for developing conceptual models in health informatics research explained in this paper involves (1) acknowledging the limitations of health science and information science conceptual models; (2) giving a rationale for one's choice of integrative conceptual model; (3) explicating a conceptual model verbally and graphically; (4) seeking feedback about the conceptual model from stakeholders in both the health science and information science domains; (5) aligning a conceptual model with an appropriate research plan; (6) adapting a conceptual model in response to new knowledge over time; and (7) disseminating conceptual models in scholarly and scientific forums.

CONCLUSIONS

Making explicit the conceptual model that underpins a health informatics research project can contribute to increasing the number of well-formed and strongly grounded health informatics research projects. This explication has distinct benefits for researchers in training, research teams, and researchers and practitioners in information, health, and other disciplines.

Critical factors influencing physicians' intention to use computerized clinical practice guidelines: an integrative model of activity theory and the technology acceptance model

Background

With the widespread use of information communication technologies, computerized clinical practice guidelines are developed and considered as effective decision supporting tools in assisting the processes of clinical activities. However, the development of computerized clinical practice guidelines in Taiwan is still at the early stage and acceptance level among major users (physicians) of computerized clinical practice guidelines is not satisfactory. This study aims to investigate critical factors influencing physicians’ intention to computerized clinical practice guideline use through an integrative model of activity theory and the technology acceptance model.

Methods

The survey methodology was employed to collect data from physicians of the investigated hospitals that have implemented computerized clinical practice guidelines. A total of 505 questionnaires were sent out, with 238 completed copies returned, indicating a valid response rate of 47.1 %. The collected data was then analyzed by structural equation modeling technique.

Results

The results showed that attitudes toward using computerized clinical practice guidelines (γ = 0.451, p < 0.001), organizational support (γ = 0.285, p < 0.001), perceived usefulness of computerized clinical practice guidelines (γ = 0.219, p < 0.05), and social influence (γ = 0.213, p < 0.05) were critical factors influencing physicians’ intention to use computerized clinical practice guidelines, and these factors can explain 68.6 % of the variance in intention to use computerized clinical practice guidelines.

Conclusions

This study confirmed that some subject (human) factors, environment (organization) factors, tool (technology) factors mentioned in the activity theory should be carefully considered when introducing computerized clinical practice guidelines. Managers should pay much attention on those identified factors and provide adequate resources and incentives to help the promotion and use of computerized clinical practice guidelines. Through the appropriate use of computerized clinical practice guidelines, the clinical benefits, particularly in improving quality of care and facilitating the clinical processes, will be realized.

Anticipating mismatches of HIT investments: Developing a viability-fit model for e-health services

OBJECTIVES

Albeit massive investments in the recent years, the impact of health information technology (HIT) has been controversial and strongly disputed by both research and practice. While many studies are concerned with the development of new or the refinement of existing measurement models for assessing the impact of HIT adoption (ex post), this study presents an initial attempt to better understand the factors affecting viability and fit of HIT and thereby underscores the importance of also having instruments for managing expectations (ex ante).

METHODS

We extend prior research by undertaking a more granular investigation into the theoretical assumptions of viability and fit constructs. In doing so, we use a mixed-methods approach, conducting qualitative focus group discussions and a quantitative field study to improve and validate a viability-fit measurement instrument.

RESULTS

Our findings suggest two issues for research and practice. First, the results indicate that different stakeholders perceive HIT viability and fit of the same e-health services very unequally. Second, the analysis also demonstrates that there can be a great discrepancy between the organizational viability and individual fit of a particular e-health service.

CONCLUSION

The findings of this study have a number of important implications such as for health policy making, HIT portfolios, and stakeholder communication.

Business Modeling to Implement an eHealth Portal for Infection Control: A Reflection on Co-Creation With Stakeholders

Background

It is acknowledged that the success and uptake of eHealth improve with the involvement of users and stakeholders to make technology reflect their needs. Involving stakeholders in implementation research is thus a crucial element in developing eHealth technology. Business modeling is an approach to guide implementation research for eHealth. Stakeholders are involved in business modeling by identifying relevant stakeholders, conducting value co-creation dialogs, and co-creating a business model. Because implementation activities are often underestimated as a crucial step while developing eHealth, comprehensive and applicable approaches geared toward business modeling in eHealth are scarce.

Objective

This paper demonstrates the potential of several stakeholder-oriented analysis methods and their practical application was demonstrated using Infectionmanager as an example case. In this paper, we aim to demonstrate how business modeling, with the focus on stakeholder involvement, is used to co-create an eHealth implementation.

Methods

We divided business modeling in 4 main research steps. As part of stakeholder identification, we performed literature scans, expert recommendations, and snowball sampling (Step 1). For stakeholder analyzes, we performed “basic stakeholder analysis,” stakeholder salience, and ranking/analytic hierarchy process (Step 2). For value co-creation dialogs, we performed a process analysis and stakeholder interviews based on the business model canvas (Step 3). Finally, for business model generation, we combined all findings into the business model canvas (Step 4).

Results

Based on the applied methods, we synthesized a step-by-step guide for business modeling with stakeholder-oriented analysis methods that we consider suitable for implementing eHealth.

Conclusions

The step-by-step guide for business modeling with stakeholder involvement enables eHealth researchers to apply a systematic and multidisciplinary, co-creative approach for implementing eHealth. Business modeling becomes an active part in the entire development process of eHealth and starts an early focus on implementation, in which stakeholders help to co-create the basis necessary for a satisfying success and uptake of the eHealth technology.

Modeling antecedents of electronic medical record system implementation success in low-resource setting hospitals

BACKGROUND

With the increasing implementation of Electronic Medical Record Systems (EMR) in developing countries, there is a growing need to identify antecedents of EMR success to measure and predict the level of adoption before costly implementation. However, less evidence is available about EMR success in the context of low-resource setting implementations. Therefore, this study aims to fill this gap by examining the constructs and relationships of the widely used DeLone and MacLean (D&M) information system success model to determine whether it can be applied to measure EMR success in those settings.

METHODS

A quantitative cross sectional study design using self-administered questionnaires was used to collect data from 384 health professionals working in five governmental hospitals in Ethiopia. The hospitals use a comprehensive EMR system since three years. Descriptive and structural equation modeling methods were applied to describe and validate the extent of relationship of constructs and mediating effects.

RESULTS

The findings of the structural equation modeling shows that system quality has significant influence on EMR use (β = 0.32, P < 0.05) and user satisfaction (β = 0.53, P < 0.01); information quality has significant influence on EMR use (β = 0.44, P < 0.05) and user satisfaction (β = 0.48, P < 0.01) and service quality has strong significant influence on EMR use (β = 0.36, P < 0.05) and user satisfaction (β = 0.56, P < 0.01). User satisfaction has significant influence on EMR use (β = 0.41, P < 0.05) but the effect of EMR use on user satisfaction was not significant. Both EMR use and user satisfaction have significant influence on perceived net-benefit (β = 0.31, P < 0.01; β = 0.60, P < 0.01), respectively. Additionally, computer literacy was found to be a mediating factor in the relationship between service quality and EMR use (P < 0.05) as well as user satisfaction (P < 0.01). Among all the constructs, user satisfaction showed the strongest effect on perceived net-benefit of health professionals.

CONCLUSION

EMR implementers and managers in developing countries are in urgent need of implementation models to design proper implementation strategies. In this study, the constructs and relationships depicted in the updated D&M model were found to be applicable to assess the success of EMR in low resource settings. Additionally, computer literacy was found to be a mediating factor in EMR use and user satisfaction of health professionals. Hence, EMR implementers and managers in those settings should give priority in improving service quality of the hospitals like technical support and infrastructure; providing continuous basic computer trainings to health professionals; and give attention to the system and information quality of the systems they want to implement.

Classification of antecedents towards safety use of health information technology: A systematic review

OBJECTIVES

This paper provides a systematic review of safety use of health information technology (IT). The first objective is to identify the antecedents towards safety use of health IT by conducting systematic literature review (SLR). The second objective is to classify the identified antecedents based on the work system in Systems Engineering Initiative for Patient Safety (SEIPS) model and an extension of DeLone and McLean (D&M) information system (IS) success model.

METHODS

A systematic literature review (SLR) was conducted from peer-reviewed scholarly publications between January 2000 and July 2014. SLR was carried out and reported based on the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement. The related articles were identified by searching the articles published in Science Direct, Medline, EMBASE, and CINAHL databases. Data extracted from the resultant studies included are to be analysed based on the work system in Systems Engineering Initiative for Patient Safety (SEIPS) model, and also from the extended DeLone and McLean (D&M) information system (IS) success model.

RESULTS

55 articles delineated to be antecedents that influenced the safety use of health IT were included for review. Antecedents were identified and then classified into five key categories. The categories are (1) person, (2) technology, (3) tasks, (4) organization, and (5) environment. Specifically, person is attributed by competence while technology is associated to system quality, information quality, and service quality. Tasks are attributed by task-related stressor. Organisation is related to training, organisation resources, and teamwork. Lastly, environment is attributed by physical layout, and noise.

CONCLUSIONS

This review provides evidence that the antecedents for safety use of health IT originated from both social and technical aspects. However, inappropriate health IT usage potentially increases the incidence of errors and produces new safety risks. The review cautions future implementation and adoption of health IT to carefully consider the complex interactions between social and technical elements propound in healthcare settings.

Health Information System in Primary Health Care: The Challenges and Barriers from Local Providers' Perspective of an Area in Iran

Background:

Health information system (HIS) has been utilized for collecting, processing, storing, and transferring the required information for planning and decision-making at different levels of health sector to provide quality services. In this study, in order to provide high-quality HIS, primary health care (PHC) providers’ perspective on current challenges and barriers were investigated.

Methods:

This study was carried out with a qualitative approach using semi-structured audiotaped focus group discussions (FGDs). One FGD was conducted with 13 Behvarz and health technicians as front-line workers and the other with 16 personnel including physicians, statisticians, and health professionals working in health centers of the PHC network in KUMS. The discussions were transcribed and then analyzed using the framework analysis method.

Results:

The identified organizational challenges were categorized into two groups: HIS structure and the current model of PHC in urban areas. Furthermore, the structural challenges were classified into HIS management structure (information systems resources, including human, supplies, and organizational rules) and information process.

Conclusions:

The HIS works effectively and efficiently when there are a consistency and integrity between the human, supplies, and process aspects. Hence, multifaceted interventions including strengthening the organizational culture to use the information in decisions, eliminating infrastructural obstacles, appointing qualified staff and more investment for service delivery at urban areas are the most fundamental requirements of high-quality HIS in PHC.

Prioritizing factors influencing nurses' satisfaction with hospital information systems: a fuzzy analytic hierarchy process approach

Our aim was to use the fuzzy analytic hierarchy process approach to prioritize the factors that influence nurses' satisfaction with a hospital information system. First, we reviewed the related literature to identify and select possible factors. Second, we developed an analytic hierarchy process framework with three main factors (quality of services, of systems, and of information) and 22 subfactors. Third, we developed a questionnaire based on pairwise comparisons and invited 10 experienced nurses who were identified through snowball sampling to rate these factors. Finally, we used Chang's fuzzy extent analysis method to compute the weights of these factors and prioritize them. We found that information quality was the most important factor (58%), followed by service quality (22%) and then system quality (19%). In conclusion, although their weights were not similar, all factors were important and should be considered in evaluating nurses' satisfaction.

Electronic health records: critical success factors in implementation

Introduction:

EHR implementation results in the improved quality of care, customer-orientation and timely access to complete information. Despite the potential benefits of EHR, its implementation is a difficult and complex task whose success depends on many factors. The purpose of this research is indeed to identify the key success factors of EHR.

Method and materials:

This is a cross-sectional survey conducted with participation of 340 work forces from different types of job from Hospitals of TUMS in 2014. Data were collected using a self-structured questionnaire which was estimated as both reliable and valid. The data were analyzed by SPSS software descriptive statistics and analytical statistics.

Results:

58.2% of respondents were female and their mean age and work experience were 37.7 and 11.2 years, respectively and most respondents (52.5%) was bachelor. In terms of job, the maximum rate was related to nursing (33 %) and physician (21 %). the main category of critical success factors in Implementation EHRs, the highest rate related to Project Management (4.62) and lowest related to Organizational factors (3.98).

Conclusion:

success in implementation EHRs requirement more centralization to project management and human factors. Therefore must be Creating to EHR roadmap implementation, establishment teamwork to participation of end-users and select prepare leadership, users obtains sufficient training to use of system and also prepare support from maintain and promotion system.