1
|
Tsui L, Huang Y, Lei Y, Wang J. Optimizing short-term in-class process evaluation: analyzing the effectiveness of teaching interventions in pharmaceutical education using repeated measures analysis. BMC MEDICAL EDUCATION 2024; 24:765. [PMID: 39014442 PMCID: PMC11253344 DOI: 10.1186/s12909-024-05754-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 07/08/2024] [Indexed: 07/18/2024]
Abstract
BACKGROUND The assessment of the effectiveness of teaching interventions in enhancing students' understanding of the Pharmaceutical Care Network Europe (PCNE) Classification System is crucial in pharmaceutical education. This is especially true in regions like China, where the integration of the PCNE system into undergraduate teaching is limited, despite its recognized benefits in addressing drug-related problems in clinical pharmacy practice. Therefore, this study aimed to evaluate the effectiveness of teaching interventions in improving students' understanding of the PCNE Classification System in pharmaceutical education. METHODS Undergraduate pharmacy students participated in a series of sessions focused on the PCNE system, including lectures (t1), case analyses (t2), and practical implementation (t3). The levels of understanding were evaluated using time-course questionnaires. Initially, paired samples t-Tests were used to compare understanding levels between different time points. Subsequently, Repeated Measures Analysis (RMA) was employed. Pearson correlation analysis was conducted to examine the relationship between understanding levels and the usability and likelihood of using the PCNE system, as reported in the questionnaires. RESULTS The paired samples t-Tests indicated insignificant differences between t2 and t3, suggesting limited improvement following the practical implementation of the PCNE system. However, RMA revealed significant time effects on understanding levels in effective respondents and the focused subgroup without prior experience (random intercept models: all p < 0.001; random slope models: all p < 0.001). These results confirmed the effectiveness of all three teaching interventions. Pearson correlation analysis demonstrated significant positive correlations between understanding levels and the usability and likelihood of using the PCNE system at all examined time points. This finding highlighted the reliability of the understanding levels reported in the questionnaires. The homework scores were used as external calibration standards, providing robust external validation of the questionnaire's validity. CONCLUSION The implementation of RMA provided robust evidence of the positive impact of time on understanding levels. This affirmed the effectiveness of all teaching interventions in enhancing students' comprehension of the PCNE Classification System. By utilizing RMA, potential errors inherent in common statistical methods, such as t-Tests, were mitigated. This ensured a more comprehensive and accurate assessment of the effectiveness of the teaching interventions.
Collapse
Affiliation(s)
- Leo Tsui
- School of Pharmacy, Shanghai University of Medicine and Health Sciences, Shanghai, 201318, China.
| | - Yule Huang
- School of Pharmacy, Shanghai University of Medicine and Health Sciences, Shanghai, 201318, China
| | - Yihan Lei
- School of Pharmacy, Shanghai University of Medicine and Health Sciences, Shanghai, 201318, China
| | - Jin Wang
- School of Pharmacy, Shanghai University of Medicine and Health Sciences, Shanghai, 201318, China
| |
Collapse
|
2
|
Martínez-Gaitero C, Dennerlein SM, Dobrowolska B, Fessl A, Moreno-Martínez D, Herbstreit S, Peffer G, Cabrera E. Connecting Actors With the Introduction of Mobile Technology in Health Care Practice Placements (4D Project): Protocol for a Mixed Methods Study. JMIR Res Protoc 2024; 13:e53284. [PMID: 38329786 PMCID: PMC10884912 DOI: 10.2196/53284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 11/12/2023] [Accepted: 11/23/2023] [Indexed: 02/09/2024] Open
Abstract
BACKGROUND The learning process in clinical placements for health care students is a multifaceted endeavor that engages numerous actors and stakeholders, including students, clinical tutors, link teachers, and academic assessors. Successfully navigating this complex process requires the implementation of tasks and mentorships that are synchronized with educational and clinical processes, seamlessly embedded within their respective contexts. Given the escalating number of students and the rising demand for health care services from the general population, it becomes imperative to develop additional tools that support the learning process. These tools aim to simplify day-to-day clinical practice, allowing a concentrated focus on value-based activities. This paper introduces a project funded by the European Commission that involves 5 European countries. The project's objective is to comprehensively outline the entire process of development and ultimately implement mobile technology in practice placements. The project tackles the existing gap by constructing tailored mobile apps designed for students, teachers, tutors, and supervisors within each participating organization. This approach leverages practice-based learning, mobile technology, and technology adoption to enhance the overall educational experience. OBJECTIVE This study aims to introduce mobile technology in clinical practice placements with the goal of facilitating and enhancing practice-based learning. The objective is to improve the overall effectiveness of the process for all stakeholders involved. METHODS The "4D in the Digitalization of Learning in Practice Placement" (4D Project) will use a mixed methods research design, encompassing 3 distinct study phases: phase 1 (preliminary research), which incorporates focus groups and a scoping review, to define the problem, identify necessities, and analyze contextual factors; phase 2 (collaborative app development), which involves researchers and prospective users working together to cocreate and co-design tailored apps; and phase 3, which involves feasibility testing of these mobile apps within practice settings. RESULTS The study's potential impact will primarily focus on improving communication and interaction processes, fostering connections among stakeholders in practice placements, and enhancing the assessment of training needs. The literature review and focus groups will play a crucial role in identifying barriers, facilitators, and factors supporting the integration of mobile technology in clinical education. The cocreation process of mobile learning apps will reveal the core values and needs of various stakeholders, including students, teachers, and health care professionals. This process also involves adapting and using mobile apps to meet the specific requirements of practice placements. A pilot study aimed at validating the app will test and assess mobile technology in practice placements. The study will determine results related to usability and design, learning outcomes, student engagement, communication among stakeholders, user behavior, potential issues, and compliance with regulations. CONCLUSIONS Health care education, encompassing disciplines such as medicine, nursing, midwifery, and others, confronts evolving challenges in clinical training. Essential to addressing these challenges is bridging the gap between health care institutions and academic settings. The introduction of a new digital tool holds promise for empowering health students and mentors in effectively navigating the intricacies of the learning process. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/53284.
Collapse
Affiliation(s)
| | | | - Beata Dobrowolska
- Faculty of Health Sciences, Medical University of Lublin, Lublin, Poland
| | - Angela Fessl
- Institute of Interactive Systems and Data Science, Graz University of Technology, Graz, Austria
- Know-Center GmbH, Graz, Austria
| | - Daniel Moreno-Martínez
- Germans Trias i Pujol Research Institute, Hospital Germans Trias i Pujol Institut Català de la Salut, Badalona, Spain
| | | | | | | |
Collapse
|
3
|
Strandell‐Laine C, Haapa T, Timonen L, Suikkala A. The role of the teacher and learning in clinical practicum scales: A psychometric testing of the Finnish versions. Nurs Open 2023; 10:7201-7208. [PMID: 37608623 PMCID: PMC10563433 DOI: 10.1002/nop2.1968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 03/04/2023] [Accepted: 08/02/2023] [Indexed: 08/24/2023] Open
Abstract
AIM To test the psychometric properties of the further developed Role of the Teacher (Tc2) and the new Learning in Clinical Practicum (LCP) scales in a sample of Finnish healthcare students. DESIGN Psychometrical testing of the Tc2 and LCP scales. METHODS A sample consisting of 1133 healthcare students completed the further developed Tc2 scale and the new LCP scale between January and June 2020. Statistical data analysis was performed using explorative factor analysis and Cronbach's alpha coefficient. The STROBE checklist for cross-sectional studies was applied in reporting. RESULTS Both the further developed Tc2 and the new LCP scales were shown to be valid and reliable. Explorative factor analysis confirmed a two-factor solution for the Tc2 scale with a 76.3% explained variance and a one-factor solution for the LCP scale with a 58.0% explained variance. The scales' internal consistency reliabilities were high (0.9).
Collapse
Affiliation(s)
- Camilla Strandell‐Laine
- Lovisenberg Diaconal University CollegeOsloNorway
- Novia University of Applied SciencesTurkuFinland
- Department of Nursing ScienceUniversity of TurkuTurkuFinland
| | - Toni Haapa
- Lovisenberg Diaconal University CollegeOsloNorway
- Helsinki University and Helsinki University HospitalHelsinkiFinland
| | - Leena Timonen
- Helsinki University and Helsinki University HospitalHelsinkiFinland
| | - Arja Suikkala
- Department of Nursing ScienceUniversity of TurkuTurkuFinland
- Diaconia University of Applied SciencesHelsinkiFinland
| |
Collapse
|
4
|
Bakker CJ, Wyatt TH, Breth MC, Gao G, Janeway LM, Lee MA, Martin CL, Tiase VL. Nurses' Roles in mHealth App Development: Scoping Review. JMIR Nurs 2023; 6:e46058. [PMID: 37847533 PMCID: PMC10618897 DOI: 10.2196/46058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Revised: 08/15/2023] [Accepted: 09/01/2023] [Indexed: 10/18/2023] Open
Abstract
BACKGROUND Although mobile health (mHealth) apps for both health consumers and health care providers are increasingly common, their implementation is frequently unsuccessful when there is a misalignment between the needs of the user and the app's functionality. Nurses are well positioned to help address this challenge. However, nurses' engagement in mHealth app development remains unclear. OBJECTIVE This scoping review aims to determine the extent of the evidence of the role of nurses in app development, delineate developmental phases in which nurses are involved, and to characterize the type of mHealth apps nurses are involved in developing. METHODS We conducted a scoping review following the 6-stage methodology. We searched 14 databases to identify publications on the role of nurses in mHealth app development and hand searched the reference lists of relevant publications. Two independent researchers performed all screening and data extraction, and a third reviewer resolved any discrepancies. Data were synthesized and grouped by the Software Development Life Cycle phase, and the app functionality was described using the IMS Institute for Healthcare Informatics functionality scoring system. RESULTS The screening process resulted in 157 publications being included in our analysis. Nurses were involved in mHealth app development across all stages of the Software Development Life Cycle but most frequently participated in design and prototyping, requirements gathering, and testing. Nurses most often played the role of evaluators, followed by subject matter experts. Nurses infrequently participated in software development or planning, and participation as patient advocates, research experts, or nurse informaticists was rare. CONCLUSIONS Although nurses were represented throughout the preimplementation development process, nurses' involvement was concentrated in specific phases and roles.
Collapse
Affiliation(s)
- Caitlin J Bakker
- Dr John Archer Library, University of Regina, Regina, SK, Canada
| | - Tami H Wyatt
- College of Nursing, University of Tennessee Knoxville, Knoxville, TN, United States
| | - Melissa Cs Breth
- Clinical Quality Informatics, The Joint Commission, Oakbrook Terrace, IL, United States
| | - Grace Gao
- School of Nursing, St. Catherine University, St Paul, MN, United States
- National Veterans Affairs Quality Scholars Program, Joseph Maxwell Cleland Atlanta Veterans Affairs Medical Center, Atlanta, GA, United States
| | - Lisa M Janeway
- Northwestern Medicine, Chicago, IL, United States
- Oak Point University, Oak Brook, IL, United States
| | - Mikyoung A Lee
- College of Nursing, Texas Woman's University, Dallas, TX, United States
| | - Christie L Martin
- School of Nursing, University of Minnesota, Minneapolis, MN, United States
| | - Victoria L Tiase
- Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, United States
| |
Collapse
|
5
|
Huang H, Yin H, Xu W, Wang Q, Xiao M, Zhao Q. Design, Development, and Evaluation of the Blood Collection Management Workstation. Risk Manag Healthc Policy 2022; 15:2015-2022. [PMID: 36341474 PMCID: PMC9635477 DOI: 10.2147/rmhp.s384866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 10/18/2022] [Indexed: 11/22/2022] Open
Abstract
Purpose To design and develop a blood collection management workstation with high usability to reduce the risk of preanalytical errors and improve patient safety. Methods A five-phase mobile application development lifecycle model (MADLC) and experience-based co-design (EBCD) were used for design and development. Subsequently, the blood collection management workstation was evaluated using the Chinese System Usability Scale (SUS) in a general ward setting from January to June 2021. Results It was used on 2593 in-patients who underwent phlebotomy with 12,378 tubes being labeled. The rate of errors and meantime for blood sampling were decreased compared with the same period in the previous year. A total of 14 nurses agreed to participate in the evaluation, and the overall raw SUS score was 69.26 ± 10.39, which indicated above average results. Conclusion The blood collection management workstation has shown the potential to decrease errors and improve working efficiency in a clinical setting. The study also identified some weaknesses, which will be amended in the future.
Collapse
Affiliation(s)
- Huanhuan Huang
- Department of Nursing, the First Affiliated Hospital of Chongqing Medical University, Chongqing, People’s Republic of China
| | - Huimei Yin
- Department of Neurology, the First Affiliated Hospital of Chongqing Medical University, Chongqing, People’s Republic of China
| | - Wenxin Xu
- Department of Nursing, the First Affiliated Hospital of Chongqing Medical University, Chongqing, People’s Republic of China
| | - Qi Wang
- Department of Medical Informatics, the First Affiliated Hospital of Chongqing Medical University, Chongqing, People’s Republic of China
| | - Mingzhao Xiao
- Department of Urology, Urologist, the First Affiliated Hospital of Chongqing Medical University, Chongqing, People’s Republic of China
| | - Qinghua Zhao
- Department of Nursing, the First Affiliated Hospital of Chongqing Medical University, Chongqing, People’s Republic of China
| |
Collapse
|
6
|
Johnson SG, Potrebny T, Larun L, Ciliska D, Olsen NR. Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review. JMIR MEDICAL EDUCATION 2022; 8:e38259. [PMID: 35767323 PMCID: PMC9280458 DOI: 10.2196/38259] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 06/02/2022] [Accepted: 06/05/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND Mobile devices can provide extendable learning environments in higher education and motivate students to engage in adaptive and collaborative learning. Developers must design mobile apps that are practical, effective, and easy to use, and usability testing is essential for understanding how mobile apps meet users' needs. No previous reviews have investigated the usability of mobile apps developed for health care education. OBJECTIVE The aim of this scoping review is to identify usability methods and attributes in usability studies of mobile apps for health care education. METHODS A comprehensive search was carried out in 10 databases, reference lists, and gray literature. Studies were included if they dealt with health care students and usability of mobile apps for learning. Frequencies and percentages were used to present the nominal data, together with tables and graphical illustrations. Examples include a figure of the study selection process, an illustration of the frequency of inquiry usability evaluation and data collection methods, and an overview of the distribution of the identified usability attributes. We followed the Arksey and O'Malley framework for scoping reviews. RESULTS Our scoping review collated 88 articles involving 98 studies, mainly related to medical and nursing students. The studies were conducted from 22 countries and were published between 2008 and 2021. Field testing was the main usability experiment used, and the usability evaluation methods were either inquiry-based or based on user testing. Inquiry methods were predominantly used: 1-group design (46/98, 47%), control group design (12/98, 12%), randomized controlled trials (12/98, 12%), mixed methods (12/98, 12%), and qualitative methods (11/98, 11%). User testing methods applied were all think aloud (5/98, 5%). A total of 17 usability attributes were identified; of these, satisfaction, usefulness, ease of use, learning performance, and learnability were reported most frequently. The most frequently used data collection method was questionnaires (83/98, 85%), but only 19% (19/98) of studies used a psychometrically tested usability questionnaire. Other data collection methods included focus group interviews, knowledge and task performance testing, and user data collected from apps, interviews, written qualitative reflections, and observations. Most of the included studies used more than one data collection method. CONCLUSIONS Experimental designs were the most commonly used methods for evaluating usability, and most studies used field testing. Questionnaires were frequently used for data collection, although few studies used psychometrically tested questionnaires. The usability attributes identified most often were satisfaction, usefulness, and ease of use. The results indicate that combining different usability evaluation methods, incorporating both subjective and objective usability measures, and specifying which usability attributes to test seem advantageous. The results can support the planning and conduct of future usability studies for the advancement of mobile learning apps in health care education. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/19072.
Collapse
Affiliation(s)
- Susanne Grødem Johnson
- Faculty of Health and Function, Western Norway University of Applied Sciences, Bergen, Norway
| | - Thomas Potrebny
- Faculty of Health and Function, Western Norway University of Applied Sciences, Bergen, Norway
| | - Lillebeth Larun
- Division of Health Services, Norwegian Institute of Public Health, Oslo, Norway
| | - Donna Ciliska
- Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada
| | - Nina Rydland Olsen
- Faculty of Health and Function, Western Norway University of Applied Sciences, Bergen, Norway
| |
Collapse
|
7
|
Strandell-Laine C, Salminen L, Blöndal K, Fuster P, Hourican S, Koskinen S, Leino-Kilpi H, Löyttyniemi E, Stubner J, Truš M, Suikkala A. The nurse teacher's pedagogical cooperation with students, the clinical learning environment and supervision in clinical practicum: a European cross-sectional study of graduating nursing students. BMC MEDICAL EDUCATION 2022; 22:509. [PMID: 35765065 PMCID: PMC9241303 DOI: 10.1186/s12909-022-03445-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Accepted: 05/05/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND A supportive clinical practicum experience may enhance the successful transition and socialization to working life of graduating nursing students. Nurse teachers have the main responsibility of supporting and guiding nursing students with their pedagogical expertise during the students' clinical practicum. Thus, the clinical role of nurse teachers is seen as an essential part of a high-quality clinical practicum. Nursing students appreciate the nurse teacher's cooperation with students, but it is often reported to be unattainable. The aim of this study was to explore and compare graduating nursing students' experiences of the nurse teacher's pedagogical cooperation with students, the clinical learning environment and supervision in their final clinical practicum, and to analyze factors associated with these experiences in six European countries. METHODS A cross-sectional comparative international survey design was used. The modified Clinical Learning Environment, Supervision and Nurse Teacher (CLES+T) Scale, with a new subscale measuring the nurse teacher's pedagogical cooperation with students, was used. A convenience sample of graduating nursing students in Finland, Germany, Iceland, Ireland, Lithuania and Spain completed the online survey in 2018-2019. The data were analyzed using a Chi-Square test, Pearson's correlation coefficients, and linear models. RESULTS A total of 1796 (response rate 49%) nursing students completed the survey. Overall, students had positive experiences of the nurse teacher's pedagogical cooperation, the clinical learning environment and supervision in their final clinical practicum. Students in Spain had the most positive experiences. Educational background factors appeared to be associated with the students' experiences of the nurse teacher's pedagogical cooperation with students, the clinical learning environment and supervision. The relationships between the subscale Nurse teacher's pedagogical cooperation with students and the Clinical Learning Environment and Supervision Scale were perceived as weak to strong depending on the country. CONCLUSIONS This study reveals that nurse teachers play an essential role in supporting and guiding nursing students' final clinical practicum. In this light, researchers, educators, and leaders should collaborate seamlessly between educational institutions and healthcare organizations to establish the nurse teachers' pedagogical cooperation role within the clinical learning environment.
Collapse
Affiliation(s)
- Camilla Strandell-Laine
- Department of Nursing Science, University of Turku, 20014, Turku, Finland.
- Novia University of Applied Sciences, Turku, Finland.
- Lovisenberg Diaconal University College, Oslo, Norway.
| | - Leena Salminen
- Department of Nursing Science, University of Turku, 20014, Turku, Finland
- Turku University Hospital, Turku, Finland
| | - Katrín Blöndal
- Surgical Services Landspitali - The National University Hospital of Iceland, Reykjavik, Iceland
- Faculty of Nursing, University of Iceland, Reykjavik, Iceland
| | - Pilar Fuster
- Department of Nursing, Faculty of Medicine and Health Sciences, Universitat Internacional de Catalunya, Barcelona, Spain
| | - Susan Hourican
- School of Nursing, Psychotherapy & Community, Dublin City University, Dublin, Ireland
| | - Sanna Koskinen
- Department of Nursing Science, University of Turku, 20014, Turku, Finland
| | - Helena Leino-Kilpi
- Department of Nursing Science, University of Turku, 20014, Turku, Finland
- Turku University Hospital, Turku, Finland
| | | | - Juliane Stubner
- Martin Luther University Halle-Wittenberg, Halle (Saale), Germany
| | - Marija Truš
- Department of Nursing, Faculty of Health Sciences, Klaipeda University, Klaipėda, Lithuania
| | - Arja Suikkala
- Department of Nursing Science, University of Turku, 20014, Turku, Finland
- Diaconia University of Applied Sciences, Helsinki, Finland
| |
Collapse
|
8
|
Promoting the health and wellbeing of children: A feasibility study of a digital tool among professionals. PLoS One 2022; 17:e0265355. [PMID: 35316279 PMCID: PMC8939777 DOI: 10.1371/journal.pone.0265355] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Accepted: 03/01/2022] [Indexed: 11/19/2022] Open
Abstract
The foundations of children’s health and wellbeing are laid in early childhood. A gamified app (EmpowerKids tool) was designed to support professionals to have discussions with 6- to 12-year-olds from low-income families about their health and wellbeing. The aim of this feasibility study was to evaluate the usability and acceptability of the tool from the perspective of professionals in social, health and education settings. The study was conducted using a one-group post-test-only design. The usability data were collected using System Usability Scale and the acceptability data were collected using an open-ended questionnaire distributed to professionals (n = 24) in Estonia, Finland and Latvia. The data were collected during two phases. The tool was modified further on the basis of the results. The total usability scores were 82/100 (first testing) and 84/100 (second testing), indicating excellent usability. The answers related to acceptability were divided into four categories: suitability for the context; satisfaction and quality; attractiveness; modification needs. The professionals perceived that the tool helped them to build an overall picture of a child’s health and wellbeing, and to gain information about the child’s individual needs. The requirements for modification detected during the first testing were mostly related to difficulties with textual expressions and graphics. No major modification requirements were expressed during the second testing. The tool is considered feasible and may be used by professionals from different settings to support children’s health and wellbeing. Further studies are needed to evaluate the effectiveness of the tool from the perspective of child outcomes.
Collapse
|
9
|
González Aguña A, Fernández Batalla M, Arias Baelo C, Monsalvo San Macario E, Gonzalo de Diego B, Santamaría García JM. Usability Evaluation by Nurses of a Knowledge-Based System of Care Plans for People Hospitalized by COVID-19. Comput Inform Nurs 2021; 40:186-200. [PMID: 34570005 DOI: 10.1097/cin.0000000000000830] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
The aim of this study is to analyze the usability by nurses of the Knowledge-Based System "Diagnostics care for COVID-19." A convenience sample of 16 nurses was selected, among hospital workers and external experts. The group was divided into three subgroups intentionally to obtain different usability perspectives. Usability was evaluated by the System Usability Scale questionnaire. The participants completed the questionnaire on general usability, data inputs, and information output, after completing a minimum of 12 care plans. The first subgroup used real cases and the "think aloud" technique, the second simulated cases from the same hospital, and the third subgroup performed the external simulation. The highest scores were obtained in data inputs (94.38-97.50); and the lowest, in general usability (90.00-95.00). The subgroup of external experts scored the highest (93.13-95.63), and the first subgroup, which carried out real cases, gave the lowest score (90.00-94.38). The "think aloud" technique found an improvement in including more diagnoses and being able to carry out several plans for one person at the same time. The usability obtained was "excellent" in all subgroups and questionnaires, although the application showed limitations related to its characteristics imposed in the requirements specification.
Collapse
Affiliation(s)
- Alexandra González Aguña
- Author Affiliations: Henares University Hospital (Ms González Aguña) and Torres de la Alameda Health Center (Dr Fernández Batalla), Community of Madrid Health Service, Research Group MISKC, University of Alcalá; Quality Management Unit, Gregorio Marañón Hospital, Community of Madrid Health Service (Ms Arias Baelo); and La Garena Health Center (Mr Monsalvo San Macario) and Meco Health Center (Ms Gonzalo de Diego and Dr Santamaría García), Community of Madrid Health Service, Research Group MISKC, University of Alcalá, Spain
| | | | | | | | | | | |
Collapse
|
10
|
Weaver MS, Lukowski J, Wichman B, Navaneethan H, Fisher AL, Neumann ML. Human Connection and Technology Connectivity: A Systematic Review of Available Telehealth Survey Instruments. J Pain Symptom Manage 2021; 61:1042-1051.e2. [PMID: 33068709 PMCID: PMC7556265 DOI: 10.1016/j.jpainsymman.2020.10.010] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 10/03/2020] [Accepted: 10/09/2020] [Indexed: 12/20/2022]
Abstract
CONTEXT The current upsurge in telehealth use in palliative and hospice care warrants consideration of patient, family caregiver, and interdisciplinary palliative perspectives on telehealth modality and communication experiences. Currently, telehealth experiences and encounters are being described but not yet extensively evaluated by palliative care teams. OBJECTIVES To locate survey instruments available to assess telehealth interactions, to determine the content and constructs covered by the available instruments, and to describe the patient populations previously surveyed by the existing instruments. METHODS This study and its reporting followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines with the protocol registered in The International Prospective Register of Systematic Reviews. Three databases were searched with over 3100 articles analyzed for use of a telehealth survey instrument. RESULTS Twelve telehealth communication assessment instruments were identified with a mean length of 20 questions, primarily Likert-scale responses with one inclusive of free text and one qualitative inquiry survey. Three inquired only into modality, four queried communication, and five studied both modality and communication experience. Existing telehealth survey instruments are unidirectional in exploring patient or family experience, with two inclusive of provider perspectives. Participant demographics are notably underreported in telehealth experience studies with a frank lack of diversity in ethnic/racial, geographic, age, educational, and income representativeness in current telehealth survey instrument respondents. CONCLUSION Palliative care teams may consider familiarity with telehealth survey instrument as an essential component to progress from description of telehealth use to evaluation of telehealth encounters. Current survey instrument outcome reports do not represent inclusivity or diversity, although telehealth is now being clinically applied across settings.
Collapse
Affiliation(s)
- Meaghann S Weaver
- Division of Pediatric Palliative Care, Department of Pediatrics, Children's Hospital and Medical Center, Omaha, Nebraska, USA.
| | - Joe Lukowski
- Division of Pediatric Palliative Care, Department of Pediatrics, Children's Hospital and Medical Center, Omaha, Nebraska, USA
| | - Brittany Wichman
- Division of Pediatric Palliative Care, Department of Pediatrics, Children's Hospital and Medical Center, Omaha, Nebraska, USA
| | - Hema Navaneethan
- Division of Pediatric Palliative Care, Department of Pediatrics, Children's Hospital and Medical Center, Omaha, Nebraska, USA
| | - Alfred L Fisher
- Division of Geriatrics, Gerontology, and Palliative Care, Department of Internal Medicine, University of Nebraska Medical Center, Omaha, Nebraska, USA
| | - Marie L Neumann
- Division of Pediatric Palliative Care, Department of Pediatrics, Children's Hospital and Medical Center, Omaha, Nebraska, USA
| |
Collapse
|