Conceptual Framework to Evaluate Health Care Professionals' Satisfaction in Utilizing Telemedicine

The Store-and-Forward Telemedicine Service User-satisfaction Questionnaire: Development and validation of a questionnaire to monitor and assess health care providers' experiences

INTRODUCTION

With wider adoption of store-and-forward telemedicine accelerating, particularly post-coronavirus disease 2019, it is essential to understand health care providers' (HCPs) satisfaction with digital solutions offered by telemedicine organizations to (continuously) guarantee service quality. We developed the Store-and-Forward Telemedicine Service User-satisfaction Questionnaire to monitor and assess HCPs' experiences with contracted telemedicine organizations.

METHODS

Questionnaire construction (phase 1) consisted of exploratory literature search on validated telemedicine satisfaction questionnaires, a telemedicine domain and human factors expert focus group, stakeholder focus group (customer service employee and telemedicine account managers), and two pre-testing rounds among 18 HCPs. The pilot questionnaire (phase 2) was sent to 2179 HCPs for validity and reliability assessment.

RESULTS

Phase 1: Two validated questionnaires (73 items overall) were used as input for Store-and-Forward Telemedicine Service User-satisfaction Questionnaire. Revisions resulted in 61 items. Phase 2: the pilot 61-item Store-and-Forward Telemedicine Service User-satisfaction Questionnaire instrument was completed by 181 of 2179 invited HCPs. Forty-one mandatory items of the pilot Store-and-Forward Telemedicine Service User-satisfaction Questionnaire rated on a 5-point Likert scale were included in psychometric analyses and resulted in six reliable scales: training, communication, organization policy and strategy, interaction platform, usage platform, and working conditions.

DISCUSSION

The Store-and-Forward Telemedicine Service User-satisfaction Questionnaire is a reliable and valid questionnaire for measuring HCPs' satisfaction with store-and-forward telemedicine services as part of a continuous quality improvement cycle. Reimbursement questions were excluded due to low response. As adoption of telemedicine may be impeded by financial compensation issues, this requires consideration in future telemedicine questionnaires. Store-and-Forward Telemedicine Service User-satisfaction Questionnaire including video consultation items is needed to monitor also synchronous services as these expanded in the coronavirus disease 2019 pandemic.

APRNs' perception of telehealth use

BACKGROUND

The COVID-19 pandemic resulted in a significant increase in the use of telehealth. Although advanced practice registered nurses (APRNs) play an essential role in improving healthcare accessibility, including the provision of telehealth, for many individuals, few studies examining provider perceptions of telehealth have included APRN participants.

METHODS

This article describes a quantitative, descriptive study involving a survey administered electronically to a convenience sample of APRNs from one state.

RESULTS

Seventy-five APRN participants completed the survey, with NPs comprising nearly 90% of the sample. On average, surveyed APRNs had been conducting telehealth visits for 2.57 years. Most participants were able to develop or maintain rapport with new or established patients using telehealth and felt that their patients were satisfied by these visits. More than one-third of participants reported that new patients seen via telehealth received somewhat worse care than patients seen face to face, and one-quarter reported that established patients seen via telehealth received somewhat worse care.

CONCLUSION

Although some concerns exist, overall, APRNs' perceptions of the use of telehealth were positive, with most wishing to continue providing care via telehealth in the future. This study adds to the literature on providers' perceptions of telehealth by describing the APRN viewpoint.

Teleallergy: Where Have We Been and Where Are We Going?

Telemedicine uptake in allergy/immunology was slow before the coronavirus disease 2019 pandemic, but has accelerated since. This review examines where telemedicine has been in allergy/immunology and where it is headed in the future. Focus is placed on patient, physician, and health care professional satisfaction with telemedicine, capacity to expand access to allergy/immunology care, cost considerations, the regulatory environment, and future applications of telemedicine including adherence monitoring, wearable biosensors, artificial intelligence, and machine learning addressed.

Transitioning to virtual ambulatory care during the COVID-19 pandemic: a qualitative study of faculty and resident physician perspectives

BACKGROUND

The COVID-19 pandemic resulted in a rapid shift from in-person to virtual care delivery for many medical specialties across Canada. The purpose of this study was to explore the lived experiences of resident physicians and faculty related to teaching, learning and assessment during ambulatory virtual care encounters within the competency-based medical education model.

METHODS

In this qualitative phenomenological study, we recruited resident physicians (postgraduate year [PGY] 1-5 trainees) and faculty from the Departments of Surgery and Medicine at Queen's University, Ontario, via purposive sampling. Participants were not required to have exposure to virtual care. Interviews were conducted from September 2020 to March 2021 by 1 researcher, and 2 researchers conducted focus groups via Zoom to explore participants' experiences with the transition to virtual care. These were audio-recorded and transcribed verbatim; qualitative data were analyzed thematically.

RESULTS

There were 18 male and 19 female participants; 20 were resident physicians and 17 were faculty; 19 were from the Department of Surgery and 18 from the Department of Medicine. All faculty participants had participated in virtual care during ambulatory care; 2 PGY-1 residents in surgery had not actively participated in virtual care, although they had participated in clinics where faculty were using virtual care. The mean age of faculty participants was 38 (standard deviation [SD] 8.6) years, and the mean age of resident physicians was 29 (SD 5.4) years. Overall, 28 interviews and 4 focus groups (range 2-3 participants per group) were conducted, and 4 themes emerged: teaching and learning, assessment, logistical considerations, and suggestions. Barriers to teaching included the lack of direct observations and teaching time, and barriers to assessment included an absence of specific Entrustable Professional Activities (EPAs) and feedback focused on virtual care-related competencies. Logistical challenges included lack of technological infrastructure, insufficient private office space and administrative burdens. Both resident physicians and faculty did not foresee virtual care limiting resident physicians' ability to progress within competency-based medical education. Benefits of virtual care included increased accessibility to patients for follow-up visits, for disclosing patients' results and for out-of-town visits. Suggestions included faculty development, improved access to technology and space, educational guidelines for conducting virtual care encounters, and development of virtual care-specific competencies and EPAs.

INTERPRETATION

In the postgraduate program we studied, virtual care imposed substantial barriers on teaching, learning and assessment during the first year of the COVID-19 pandemic. Adapting to new circumstances such as virtual care with suggestions from resident physicians and faculty may help to ensure the continuity of postgraduate medical education throughout the COVID-19 pandemic.

Patient and family experience with telemedicine and in-person pediatric and obstetric ambulatory encounters throughout 2020, during the COVID-19 epidemic: the distance effect

BACKGROUND

Telemedicine has grown significantly in recent years, mainly during the COVID-19 pandemic, and there has been a growing body of literature on the subject. Another topic that merits increased attention is differences in patient and family experience between telehealth and in-person visits. To our team's knowledge, this is the first study evaluating pediatric and obstetrics outpatients experience with telemedicine and in-person visit types in an academic maternal and children's hospital, and its correlation with geographic distance from the medical center throughout 2020, during the COVID-19 crisis.

METHODS

We aim to evaluate and compare patients' telemedicine and in-person experience for ambulatory encounters based on survey data throughout 2020, during the COVID-19 pandemic, with particular focus on the influence of distance of the patient's home address from the medical facility. A total of 9,322 patient experience surveys from ambulatory encounters (6,362 in-person and 2,960 telemedicine), in a maternal and children's hospital during 2020 were included in this study. The percentage of patients who scored the question "Likelihood to recommend practice" with a maximum 5/5 (top box) score was used to evaluate patient experience. The k-means model was used to create distance clusters, and statistical t-tests were conducted to compare mean distances and Top Box values between telemedicine and in-person models. Logistic regression analysis was used to evaluate the correlation between Top Box scores and patients' distance to the hospital.

RESULTS

Top Box likelihood to recommend percentages for in-person and telemedicine were comparable (in-person = 81.21%, telemedicine = 81.70%, p-value = 0.5624). Mean distance from the hospital was greater for telemedicine compared to in-person patients (in-person = 48.89 miles, telemedicine = 61.23 miles, p-value < 0.01). Patients who live farther displayed higher satisfaction scores regardless of the visit type (p-value < 0.01).

CONCLUSIONS

There is a direct relationship between the family experience and the distance from the considered medical center, during year 2020, i.e., patients who live farther from the hospital record higher Top Box proportion for "Likelihood to Recommend" than patients who live closer to the medical center, regardless of the approach, in-person or telemedicine.

Healthcare professionals' perception and satisfaction with mental health tele-medicine during the COVID-19 outbreak: A real-world experience in telepsychiatry

BACKGROUND

The use of telemedicine is increasingly being implemented, showing numerous benefits over other methods. A good example of this is the use of telemedicine following the breakdown caused by the COVID-19 pandemic. Previous experiences with telemedicine (TM) have not been significantly explored in relation to the professionals' own perspectives.

OBJECTIVE

Identify and explore the perceptions and interests of mental health professionals who have performed TM during the period of pandemia.

METHODS

A questionnaire on mental health professionals' perceptions of and satisfaction of TM, the Font Roja Work Satisfaction Questionnaire, was adapted and used. Data collected included 112 Psychiatric Service professionals who conducted TM in March 2020, after the country had been under lockdown for 10 weeks. Over 12.000 medical consultations were carried out by the phone, showing an overwhelming response to this method.

RESULTS

High levels of satisfaction were recorded amongst professionals. TM would function as a complement to the traditional system of face-to-face visits (n-112, f-109, 96.5%). Only 9.7% (f-11) believed that digital or virtual interventions would completely replace face-to-face visits. 60.8% did not consider this monotonous work. The older the health workers were, the more satisfied they felt during their follow-up telephone consultation. The greater the previous experience, the more satisfaction was shown. There were gender differences: female mental health workers reported a greater level of comfort.

CONCLUSION

TM can be implemented with less effort, but it requires time, methods, and resources to be managed. Satisfaction among professionals is high, especially among those with more clinical experience. Patient satisfaction must be contrasted against this.

Experience and perspectives of users and non-users of the Ask your pharmacist teleconsultation platform

Background

There is a growing trend concerning the use of information and communication technologies (ICT) for seeking health-related information such as information on medications and side effects. However, people looking online for health information cannot always judge the credibility of the information.

Objective(s)

This study aimed to describe patients' and pharmacists' experience using an asynchronous teleconsultation platform entitled “Ask Your Pharmacist” (AYP) and gather their perspectives and those of various healthcare and social services professionals providing primary care.

Methods

We performed semi-structured individual interviews over the telephone with patients having used the platform, pharmacists providing teleconsultation services on the platform, and various professionals delivering healthcare and psychosocial services to ambulatory patients. The questions explored specific themes, such as the perceived utility and impacts of the platform. We transcribed the interviews and performed a content analysis.

Results

We interviewed eight patients, six AYP pharmacists, and 15 healthcare and social services professionals. Participants perceived that the platform was simple to use and accessible. They also perceived that AYP promoted the visibility and the value of pharmacists' services. Some constraints were also shared, notably regarding questions requiring immediate attention or about complex situations.

Conclusions

The experience and perspectives of users and non-users of the AYP platform are mostly positive, but concerns were also raised regarding patients' safety. Results suggest that AYP could be a complementary tool to offer to ambulatory patients for simple, general and non-urgent problems.

A Review of Patient and Provider Satisfaction with Telemedicine

Purpose of Review

The purpose of this review is to describe the determinants of satisfaction with telemedicine (TM) and how they compare with in-person visits from both the perspective of patients and of providers.

Recent Findings

The use of TM will expand only if patients and providers are at least as satisfied with it as they are with in-person visits. Since deviations from expected care can result in reduced satisfaction regardless of the quality of the visit or objective medical outcomes, it is important to understand and to help form those expectations when possible. Patients consistently report 95–100% satisfaction rate with TM when compared with in-person appointments. They tend to cite the convenience of decreased travel times and costs as the main drivers for satisfaction with TM. Providers tend to be satisfied with TM if they have input into its development, there is administrative support, the technology is reliable and easy to use, and if there is adequate reimbursement for its use.

Summary

Satisfaction with TM is necessary for adoption of this new technology. To improve satisfaction it is important to consider factors that drive it both for patients and for providers.