Usability testing of bed information management system: A think-aloud method

Not considering the usability in designing clinical information systems causes problems in human–computer interaction and patient dissatisfaction. Therefore, in this study, the usability of the bed information management system (BIMS) was examined by think-aloud method. This cross-sectional study was conducted on the BIMS in 50 noneducational hospitals. Participants consisted of three groups including users, facilitators, and technical support. To carry out the study, a scenario consisting of four tasks was designed. Three researchers analyzed the recorded files to identify the usability problems and their severity. The mean time of the evaluation process was 20:33 ± 4:47 s. The total number of the problems identifies by users was 80 cases. Data entry and layout problems with 38 (48%) and 33 (41%) cases were the most frequently found problems, respectively. About 61% and 55% of the data entry and layout problems had a minor severity (Severity 2), respectively. Furthermore, 43 (54%) cases of the problems were resolved by the users and 32 (40%) cases by the facilitator assistance. This study showed that a large number of the problems were due to the system poor design. Furthermore, by increasing the users’ level of knowledge about the system, it is possible to enhance user-system interaction. It is recommended that before designing and implementing a system, the system should be evaluated for usability, and the users should be educated in clinical information systems.

Comprehensive overview of computer-based health information tailoring: a systematic scoping review

OBJECTIVES

To explore the scope of the published literature on computer-tailoring, considering both the development and the evaluation aspects, with the aim of identifying and categorising main approaches and detecting research gaps, tendencies and trends.

SETTING

Original researches from any country and healthcare setting.

PARTICIPANTS

Patients or health consumers with any health condition regardless of their specific characteristics.

METHOD

A systematic scoping review was undertaken based on the York's five-stage framework outlined by Arksey and O'Malley. Five leading databases were searched: PubMed, Scopus, Science Direct, EBSCO and IEEE for articles published between 1990 and 2017. Tailoring concept was investigated for three aspects: system design, information delivery and evaluation. Both quantitative (ie, frequencies) and qualitative (ie, theme analysis) methods have been used to synthesis the data.

RESULTS

After reviewing 1320 studies, 360 articles were identified for inclusion. Two main routes were identified in tailoring literature including public health research (64%) and computer science research (17%). The most common facets used for tailoring were sociodemographic (73 %), target behaviour status (59%) and psycho-behavioural determinants (56%), respectively. The analysis showed that only 13% of the studies described the tailoring algorithm they used, from which two approaches revealed: information retrieval (12%) and natural language generation (1%). The systematic mapping of the delivery channel indicated that nearly half of the articles used the web (57%) to deliver the tailored information; printout (19%) and email (10%) came next. Analysis of the evaluation approaches showed that nearly half of the articles (53%) used an outcome-based approach, 44% used process evaluation and 3% assessed cost-effectiveness.

CONCLUSIONS

This scoping review can inform researchers to identify the methodological approaches of computer tailoring. Improvements in reporting and conduct are imperative. Further research on tailoring methodology is warranted, and in particular, there is a need for a guideline to standardise reporting.

Usability evaluation of obstetrics and gynecology information system using cognitive walkthrough method

Background and aim

Obstetrics and gynecology information system is a critical component of the HIS in social security organization health centers. The objective of this study was to evaluate the usability of this system using the cognitive walkthrough method. Also, the present study provided a detailed formal description of how the cognitive usability evaluation can be applied and reported for a health care information system.

Methods

This study was conducted at the Mashhad University of Medical Sciences' usability lab from March 2016 to June 2017. A two-phase approach was used to conduct the cognitive walkthrough evaluation: preparatory and evaluation. The preparation was done in three stages: first, we investigated users' capabilities and background knowledge through a semi-structured interview. Second, the evaluation scenario was developed based on the most common tasks in routine workflow of users. Finally, each task was broken down into sequences of actions. In the evaluation phase, three usability experts independently assessed each action using a four-item checklist. Problems were categorized thematically and were reported from three different perspectives: Question-based, Task-based, and Evaluator-based. The data were then analyzed to understand the contribution of each task, along with its mean severity score.

Results

Evaluators' responses were compared and any conflict was resolved in an expert panel. A total of 116 usability problems were identified based on the consensus of the evaluators. Inadequate system feedback was found to be the main source of 43% of the problems, and resulted in users confusion.

Conclusion

Since the system was evaluated in its pilot implementation phase, there was an opportunity to prevent future potential usability problems. The use of a mixed quantitative and qualitative approach in this usability study provided a more comprehensive perspective of the system problems. This study provided a detailed description of conducting CW usability evaluation which can be used as a practical guide for future studies.

Comprehensive overview of computer-based health information tailoring: a scoping review protocol

INTRODUCTION

Tailoring health information to the needs of individuals has become an important part of modern health communications. Tailoring has been addressed by researchers from different disciplines leading to the emergence of a wide range of approaches, making the newcomers confused. In order to address this, a comprehensive overview of the field with the indications of research gaps, tendencies and trends will be helpful. As a result, a systematic protocol was outlined to conduct a scoping review within the field of computer-based health information tailoring.

METHODS AND ANALYSIS

This protocol is based on the York's five-stage framework outlined by Arksey and O'Malley. A field-specific structure was defined as a basis for undertaking each stage. The structure comprised three main aspects: system design, information communication and evaluation. Five leading databases were searched: PubMed, Scopus, Science Direct, EBSCO and IEEE and a broad search strategy was used with less strict inclusion criteria to cover the breadth of evidence. Theoretical frameworks were used to develop the data extraction form and a rigorous approach was introduced to identify the categories from data. Several explanatory-descriptive methods were considered to analyse the data, from which some were proposed to be employed for the first time in scoping studies.

ETHICS AND DISSEMINATION

This study investigates the breadth and depth of existing literature on computer-tailoring and as a secondary analysis, does not require ethics approval. We anticipate that the results will identify research gaps and novel ideas for future studies and provide direction to combine methods from different disciplines. The research findings will be submitted for publication to relevant peer-reviewed journals and conferences targeting health promotion and patient education.

Design, Implementation, and Evaluation of Self-Describing Diabetes Medical Records: A Pilot Study

Background

Each patient’s medical record consists of data specific to that patient and is therefore an appropriate source to adapt educational information content.

Objectives

This study aimed to design and implement an information provision system based on the medical records of diabetic patients and to investigate the attitudes of users toward using this product.

Methods

The study was organized into three phases: need analysis, design and implementation, and final evaluation. The aim of the need analysis phase was to investigate the questioning behavior of the patient in the real-world context. The design and implementation phase consisted of four stages: determining the minimum dataset for diabetes medical records, collecting and validating content, designing and implementing a diabetes electronic medical record system, and data entry. Evaluating the final system was done based on the constructs of the technology acceptance model in the two dimensions of perceived usefulness and perceived ease of use. A semistructured interview was used for this purpose.

Results

Three main categories were extracted for the patient’s perceived usefulness of the system: raising the self-awareness and knowledge of patients, improving their self-care, and improving doctor-patient interaction. Both patients and physicians perceived the personalized sense of information as a unique feature of the application and believed that this feature could have a positive effect on the patient’s motivation for learning and using information in practice. Specialists believed that providing personal feedback on the patient’s lab test results along with general explanations encourages the patients to read the content more precisely. Moreover, accessing medical records and helpful notes was a new and useful experience for the patients.

Conclusions

One of the key perceived benefits of providing tailored information in the context of medical records was raising patient awareness and knowledge. The results obtained from field observations and interviews have shown that patients were ready to accept the system and had a positive attitude when it was put into practice. The findings related to user attitude can be used as a guideline to design the next phase of the research (ie, investigation of system effectiveness on patient outcomes).

A Personalized Adviser-Interpreter System for Monitoring Diabetic Patients' Weight Loss

Diabetes and obesity are chronic diseases that need continuous follow-up. Analysis of the large volumes of patient data collected over time is time consuming and effortful for the physician. Automatic data abstraction and providing a summary of important events in the patient's follow-up history saves the physician's time and helps in making more informed decisions. The purpose of this study was to design an interpreter system that generates a tailored textual report about patients' adherence to a therapeutic regimen. The system has been designed in three phases: determining report structure, interpreting data, and generating textual-graphical reports for the patient and physician. The output report was evaluated by 12 diabetes nutrition specialists and eight diabetic patients. We used a questionnaire and a semi-structured interview approach to assess the quality of the report in terms of content validity, understandability, and practicality.