Patient evaluation of a virtual visit program for adults with congenital heart disease

A review of questionnaires used for the assessment of telemedicine

INTRODUCTION

Telemedicine is the exchange of medical information from one site to another via electronic communications with the goal of improving a patient's clinical health status. Prior studies have identified the absence of a standardized assessment tool for evaluating telemedicine encounters. This study aims to collect and to analyze questionnaires used for the assessment of audiovisual telemedicine encounters from a patient perspective and aims to identify reasons driving the use of self-developed questionnaires.

METHODS

We conducted a systematic search in PubMed for studies that used survey questionnaires to assess synchronous audiovisual telemedicine encounters from 2016 to 2021. We categorized questionnaires used into validated and non-validated types, and for each of them, collected questions, response format, author, year, specialty, and country of publication.

RESULTS AND DISCUSSION

We analyzed a total of 71 articles. We found that only 16 studies used three validated questionnaires. The remaining 55 studies used non-validated questionnaires. Non-validated questionnaires had a high variability in length and used Likert scales, binary responses, multiple choice, and open-ended answers. We found only eight studies in which the authors gave a reason for resorting to designing their own questionnaires. This review reveals insufficient standardized survey questionnaires to be used for the assessment of audiovisual telemedicine encounters. Future research initiatives should focus on developing a standardized and validated instrument well accepted by researchers.

Effectiveness of and preference for a picture-based home office ergonomics assessment compared to a traditional in-person office ergonomics assessment: A case study from a Canadian University during the COVID-19 pandemic

During the COVID-19 pandemic, telework best practices decreased in importance compared to the need for social distancing. It is important that ergonomics assessments for home office workstations are equally as effective as assessment for traditional offices to maintain teleworker wellbeing. The purpose of this case study is to compare a remote, picture-based, home office assessment to a traditional, in-person, office assessment for employees of one Canadian University. Intraclass Correlation Coefficients (ICCs) and Bland-Altman Analyses (BAAs) revealed that the two methods provide repeatable results, with good agreement. Feedback from the participants suggested that picture-based assessments were as effective as in-person assessments; but that picture-based assessments could be improved with video conferencing to discuss findings and ask follow-up questions. Participants found value in remote assessments and, while they preferred in-person assessments, picture-based assessments are suitable when needed as they allow for many assessments to be completed without violating social distancing restrictions.

Experiences and Attitudes Toward Telemedicine in an Adult Congenital Heart Disease Clinic: Lessons Learned from the COVID-19 Pandemic

The coronavirus disease 2019 (COVID-19) pandemic has driven a broader adoption of telemedicine (TM). We aim to describe adult congenital heart disease (ACHD) patient experiences with TM and explore factors associated with positive attitude toward future TM visits. This is a cross-sectional, single-center study in an outpatient ACHD clinic from February to June, 2022. Between-group comparisons were made using Wilcoxon-Rank Sum, Chi-Square, or Fisher-Exact tests. Univariate logistic regression was performed for variables that could correlate with a "positive" attitude toward future TM visits. Significance was determined using an alpha level of 0.05. Of 262 patients (median age 33 years, 55% female, 81% White), 115 (44%) had a prior TM visit and 110 (96%) reported a positive experience. There were 64 (24%) with a positive attitude toward future TM visits. Concerns include lack of cardiac testing and limited quality of visit. Patients with visits every 3-6 months (Odds Ratio [OR] 2.44; p < 0.01) and prior TM visit (OR 1.89; p = 0.03) had higher odds of a positive attitude toward future TM, whereas males had lower odds (OR 0.53; p = 0.04). Age, annual income, disease complexity, distance from clinic, and employment status were not associated. There is high rate of satisfaction with TM among ACHD patients but only one-quarter indicated interest in using TM in the future. Factors associated with interest in TM visits are identified, and together with patient feedback, can be used to understand potential role of TM for the ACHD population in the post-pandemic era.

Translating Value Across Telehealth Stakeholders: A Rapid Review of Telehealth Measurement Evidence and a New Policy Framework to Guide Telehealth Researchers

Introduction: The surge in virtual care during the pandemic was accompanied by an increase in telehealth data of interest to policy stakeholders and other health care decision makers. However, these data often require substantial preprocessing and targeted analyses to be usable. By deliberately evaluating telehealth services with stakeholder perspectives in mind, telehealth researchers can more effectively inform clinical and policy decision making. Objective: To examine existing literature on telehealth measurement and evaluation and develop a new policy-oriented framework to guide telehealth researchers. Materials and Methods: A systematic rapid review of literature on telehealth measurement and evaluation was conducted by two independent reviewers in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. The findings were analyzed and applied to the Supporting Pediatric Research on Outcomes and Utilization of Telehealth Evaluation and Measurement (STEM) Framework through the lens of key health care delivery decision makers to create a STEM Policy Framework Results: An initial search yielded 2,324 peer-reviewed articles and gray literatyre from 2012 to 2022, of which 56 met inclusion criteria. These measured and evaluated telehealth access (41.5%), quality (32.1%), cost (15.1%), experience (5.7%), and utilization (5.7%), consistent with the STEM Framework domains, but there was no universal approach. The STEM Policy Framework focuses this literature by describing data measures for each domain from the perspectives of five stakeholders. Conclusions: Literature describing measurement and evaluation approaches for telehealth is limited and not standardized, with few considering policy stakeholder perspectives. With this proposed STEM Policy Framework, we aim to improve this body of literature and support researchers seeking to inform telehealth policy through their work.

Collaborative Intelligence to catalyze the digital transformation of healthcare

Collaborative intelligence reflects the promise and limits of leveraging artificial intelligence (AI) technologies in clinical care. It involves the use of advanced analytics and computing power with an understanding that humans bear responsibility for the accuracy, completeness and any inherent bias found in the training data. Clinicians benefit from using this technology to address increased complexity and information overload, support continuous care and optimized resource allocation, and to enact efforts to eradicate disparities in health care access and quality. This requires active clinician engagement with the technology, a general understanding of how the machine produced its insight, the limitations of the algorithms, and the need to screen datasets for bias. Importantly, by interacting, the clinician and the analytics will create trust based on the clinician's critical thinking skills leveraged to discern value of machine outputs within clinical context. Utilization of collaborative intelligence should be staged with the level of understanding and evidence. It is particularly well suited to low-complexity non-urgent care and to identifying individuals at rising risk within a population. Clinician involvement in algorithm development and the amassing of evidence to support safety and efficacy will propel adoption. Utilization of collaborative intelligence represents the natural progression of health care innovation, and if thoughtfully constructed and equitably deployed, holds the promise to decrease clinician burden and improve access to care.

Patient and provider experience with virtual care in a large, ambulatory care hospital in Ontario, Canada during the COVID-19 pandemic: An observational study (Preprint)

Background

Virtual care use increased during the COVID-19 pandemic. The impact of that shift on patient and provider experiences is unclear.

Objective

We evaluated patient and provider experiences with virtual visits across an academic, ambulatory hospital in Toronto, Canada and assessed predictors of positive experience with virtual care.

Methods

Survey data were analyzed from consenting patients who attended at least one virtual visit (video or telephone) and from consenting providers who delivered at least one virtual visit. Distributions for demographic variables and responses to survey questions are reported, with statistical significance assessed using chi-square tests and t tests. Ordinal logistic regression analysis was used to identify any patient predictors of responses.

Results

During the study period, 253 patients (mean age 45.1, SD 15.6 years) completed 517 video visit surveys, and 147 patients (mean age 41.6, SD 16.4 years) completed 209 telephone visit surveys. A total of 75 and 94 providers completed the survey in June 2020 and June 2021, respectively. On a scale from 1 to 10 regarding likelihood to recommend virtual care to others, fewer providers rated a score of 8 or above compared with patients (providers: 62/94, 66% for video and 49/94, 52% for telephone; patients: 415/517, 80% for video and 150/209, 72% for telephone). Patients of non-White ethnicity had lower odds of rating a high score of 9 or 10 compared with White patients (odds ratio 0.52, 95% CI 0.28-0.99).

Conclusions

Patient experiences with virtual care were generally positive, but provider experiences were less so. Findings suggest potential differences in patient experience by ethnicity, warranting further investigation into equity concerns with virtual care.

Clinician Preferences for Current and Planned Future Use of Telemedicine

Introduction: Many clinicians and patients tried telemedicine for the first time during the COVID-19 pandemic. In a prior survey, we found that clinicians who were adaptable and willing to incorporate technology into their clinical practice are more likely to utilize telemedicine. Seeking factors associated with current and future use of telemedicine, and identifying its relative advantages and drawbacks, may help determine the role of telemedicine after the pandemic. Questions/Purposes: We asked (1) which demographic factors and personal preferences are associated with current and planned future use of telemedicine, (2) what factors are associated with telemedicine utilization, and (3) what are clinician-reported advantages and disadvantages of telemedicine? Materials and Methods: Approximately 750 clinicians within a national multispecialty hospital group were invited to complete an online survey assessing telemedicine use and preferences, self-reported technology proficiency, and personal characteristics. A total of 284 clinicians started the survey, and 259 complete responses were analyzed using bivariate analysis and multivariable regression. Results: More frequent current telemedicine use was associated with being a nonsurgeon clinician, not primarily practicing in an inpatient setting, preferring either telemedicine or having no preference for discussing sensitive topics, and greater self-reported technological proficiency. Planned future telemedicine use was associated with greater self-reported troubleshoot ability and less desire for a hands-on physical examination. Clinicians reported that the top benefits of telemedicine are decreased barriers for patients and convenience for clinicians, and disadvantages are technical difficulties for both patients and clinicians. Conclusions: Telemedicine continues to be widely utilized by clinicians, particularly those who are confident in their ability to examine patients over video, and who can troubleshoot issues that arise on the platform. With continued reimbursement, telemedicine is likely to remain a convenient and effective method of caring for patients.