Experience with low-cost telemedicine in three different settings. Recommendations based on a proposed framework for network performance evaluation

Use of provider-to-provider telemedicine in Kenya during the COVID-19 pandemic

Introduction

According to the World Health Organization (WHO), about 90 percent of countries continue to report COVID-related disruptions to their health systems. The use of telemedicine has been especially common among high-income countries to safely deliver and access health services where enabling infrastructure like broadband connectivity is more widely available than low- and middle-income countries (LMICs). The Addis Clinic implements a provider-to-provider (P2P) asynchronous telemedicine model in Kenya. We sought to examine the use of the P2P telemedicine platform during the second year of COVID-19.

Methods

To assess sustainability, we compared the data for two 12-month calendar periods (period A = year 2020, and period B = year 2021). To examine performance, we compared the data for two different 12-month periods (period C = pandemic period of February 2021 to January 2022, and period D = baseline period of February 2019 to January 2020).

Results

Sustainability of the P2P telemedicine platform was maintained during the pandemic with increased activity levels from 2,604 cases in 2020 to 3,525 cases in 2021. There was an average of 82 specialists and 5.9 coordinators during 2020, and an average of 81 specialists and 6.0 coordinators during 2021. During 2020, there were 444 cases per coordinator, and 587 cases per coordinator in 2021(P = 0.078). During 2020, there were 32 cases per specialist, and 43 cases per specialist in 2021(P = 0.068). Performance decreased with 99 percent of cases flagged as "answered" during the baseline period (period D), and 75 percent of cases flagged as "answered" during the pandemic period (period C).

Conclusion

Results suggest that despite a decline in certain sustainability and performance indicators, The Addis Clinic was able to sustain a very high level of activity during the second year of the pandemic, as shown by the continued use of the system. Furthermore, despite some of the infrastructure challenges present in LMICs, the P2P telemedicine platform was a viable option for receiving clinical recommendations from medical experts located remotely. As health systems in LMICs grapple with the effects of the pandemic, it is worthwhile to consider the use of telemedicine to deliver essential health services.

A scoping review of the use of e-learning and e-consultation for healthcare workers in low- and middle-income countries and their potential complementarity

OBJECTIVE

Although the provision of e-learning (EL) training for healthcare workers (HCWs) and provider-to-HCW e-consultation (EC) is considered useful for health outcomes, research on their joint use is limited. This scoping review aimed to create an overview of what is currently known in the literature about the use and implementation of EC and EL by HCWs in LMICs and to answer the question of whether there is evidence of complementarity.

MATERIALS AND METHODS

Scientific databases were searched and peer-reviewed papers were reviewed systematically according to predefined inclusion/exclusion criteria. Data were extracted including the study focus (EC/EL), year of publication, geographical location, target population, target disease(s) under study, type(s) of study outcomes, and article type.

RESULTS

A total of 3051 articles were retrieved and screened for eligibility, of which 96 were kept for analysis. Of these, only 3 addressed both EL and EC; 54 studies addressed EL; and 39 addressed EC. Most studies looked at gain in knowledge/skills usability, efficiency, competence, and satisfaction of HCW, or barriers/challenges to implementation. Descriptive studies focused on the application of EL or EC for targeting specific health conditions. Factors contributing to the success of EC or EL networks were institutional anchoring, multiple partnership, and capacity building of local experts.

CONCLUSIONS

Our review found an important gap in the literature in relation to the complementary role of EL and EC for HCWs in LMICs evidenced by outcome measures. There is an important role for national and international academic institutions, learned medical societies, and networks to support regional experts in providing EL and EC for added value that will help the clinical performance of HCWs and improve health outcomes.

What do emergency medicine and burns specialists from resource constrained settings expect from mHealth-based diagnostic support? A qualitative study examining the case of acute burn care

BACKGROUND

Traumatic injury is a serious global health burden, particularly in low- and middle-income countries where medical care often lacks resources and expertise. In these contexts, diagnostic telemedicine could prove a cost effective tool, yet it remains largely underused here, and knowledge on its potential impact is limited. Particularly scarce is the view of the expert user physicians, and how they themselves relate to this technology.

METHODS

This qualitative study investigated tele-experts' (n = 15) views on the potential for image based teleconsultation to be integrated in trauma and emergency care services. A semi-structured interview guide was used to gather data concerning an mHealth app for burns diagnostics in the acute care setting, in the Western Cape, South Africa. Questions examined challenges and opportunities in user acceptance and outcomes, in specific case management and in the wider healthcare system. Resulting data were subject to qualitative content analysis.

RESULTS

Experts perceived remote diagnostic support through mHealth as linking directly to several key ideas in medicine, including barriers to care, medical culture and hierarchy, and medical ethics within a society. Ideas running through the data pertained to the widening and narrowing of inherent gaps in the healthcare system, and the formalisation of processes, practices and relationships, effected by the introduction of an app. Wide consensus was stated on positive outcomes such as increased education opportunities, improved professional relationships and a better ability to advise and diagnose, all further facilitated through greater ease of access. The belief was that these could achieve a narrowing of systemic divides within healthcare, although it was acknowledged that the possibility to induce the opposite effect also arose. Differing opinions were voiced relating to the involvement of allied health professionals and feedback.

CONCLUSION

Experts see several aspects to an mHealth app for remote diagnostic support which could enhance provision of trauma and emergency care in a resource poor setting, relating to reduced delays, streamlined care and improved outcomes. Attention is also drawn, however, to specifics of the environment which would demand further and careful consideration for success - time pressure, intensity and the wide range of subspecialties to be considered.

Expectations of medical specialists about image-based teleconsultation - A qualitative study on acute burns in South Africa

BACKGROUND

Image-based teleconsultation between medical experts and healthcare staff at remote emergency centres can improve the diagnosis of conditions which are challenging to assess. One such condition is burns. Knowledge is scarce regarding how medical experts perceive the influence of such teleconsultation on their roles and relations to colleagues at point of care.

METHODS

In this qualitative study, semi-structured interviews were conducted with 15 medical experts to explore their expectations of a newly developed App for burns diagnostics and care prior to its implementation. Purposive sampling included male and female physicians at different stages of their career, employed at different referral hospitals and all potential future tele-experts in remote teleconsultation using the App. Positioning theory was used to analyse the data.

RESULTS

The experts are already facing changes in their diagnostic practices due to the informal use of open access applications like WhatsApp. Additional changes are expected when the new App is launched. Four positions of medical experts were identified in situations of diagnostic advice, two related to patient flow-clinical specialist and gatekeeper-and two to point of care staff-educator and mentor. The experts move flexibly between the positions during diagnostic practices with remote colleagues. A new position in relation to previous research on medical roles-the mentor-came to light in this setting. The App is expected to have an important educational impact, streamline the diagnostic process, improve both triage and referrals and be a more secure option for remote diagnosis compared to current practices. Verbal communication is however expected to remain important for certain situations, in particular those related to the mentor position.

CONCLUSION

The quality and security of referrals are expected to be improved through the App but the medical experts see less potential for conveying moral support via the App during remote consultations. Experts' reflections on remote consultations highlight the embedded social and cultural dimensions of implementing new technology.

Changes in User Perceptions of a Telemedicine System Over Time: From Initial Implementation to Everyday Use

BACKGROUND

Benefits associated with telemedicine are contingent upon positive user perceptions. Despite this, research on user perceptions of telemedicine remains limited.

INTRODUCTION

Usability approaches offer a robust way to assess user perceptions, but have rarely been applied in telemedicine. In this study, a usability approach was employed to examine how user perceptions toward a telemedicine system changed over the course of everyday use.

MATERIALS AND METHODS

A telemedicine system was introduced to a hospital in the home service. Ten mobile nurses completed the System Usability Scale (SUS) after initial use, then again after 18 months of everyday use. Results were compared. Analysis included Bangor et al.'s (2009) adjective rating scale.

RESULTS

The initial SUS mean was 83 (standard deviation [SD] = 7.98), indicating "excellent" usability. After 18 months, the SUS mean was 64.38, indicating "OK" usability (SD = 14.25, p < 0.05, 95% confidence interval [CI]). Over time, users had lower desire to use the system frequently (p < 0.05, 95% CI), found it more complex (p < 0.05, 95% CI), and perceived greater inconsistency in its design (p < 0.05, 95% CI).

DISCUSSION

Considered with existing evidence, our usability findings indicate that a temporary period of positive user perceptions occurs when new telemedicine systems are used for the first few months. This fades with everyday use, with design inconsistency and perceived complexity becoming more noticeable. Although other factors such as user satisfaction and efficiency may also contribute, further studies are needed for confirmation.

CONCLUSIONS

User perceptions of telemedicine vary with time. To help maximize the benefits and longevity of telemedicine systems, responding to intermittent user appraisal is desirable.

Rapid Deployment of International Tele-Intensive Care Unit Services in War-Torn Syria

The conflict in Syria has created the largest humanitarian emergency of the twenty-first century. The 4-year Syrian conflict has destroyed hospitals and severely reduced the capacity of intensive care units (ICUs) and on-site intensivists. The crisis has triggered attempts from abroad to support the medical care of severely injured and acutely ill civilians inside Syria, including application of telemedicine. Within the United States, tele-ICU programs have been operating for more than a decade, albeit with high start-up costs and generally long development times. With the benefit of lessons drawn from those domestic models, the Syria Tele-ICU program was launched in December 2012 to manage the care of ICU patients in parts of Syria by using inexpensive, off-the-shelf video cameras, free social media applications, and a volunteer network of Arabic-speaking intensivists in North America and Europe. Within 1 year, 90 patients per month in three ICUs were receiving tele-ICU services. At the end of 2015, a network of approximately 20 participating intensivists was providing clinical decision support 24 hours per day to five civilian ICUs in Syria. The volunteer clinicians manage patients at a distance of more than 6,000 miles, separated by seven or eight time zones between North America and Syria. The program is implementing a cloud-based electronic medical record for physician documentation and a medication administration record for nurses. There are virtual chat rooms for patient rounds, radiology review, and trainee teaching. The early success of the program shows how a small number of committed physicians can use inexpensive equipment spawned by the Internet revolution to support from afar civilian health care delivery in a high-conflict country.

Promoting Sustainable Regional Health Care in Japan

To supply sustainable health care to cancer patients, it is important to continuously deliver appropriate information regarding community health care resources and to develop an accessible medical system. We developed an information-sharing system using geographical data called the “Resource Map for Community Cooperation in Cancer Care” ( http://cancerqa.scchr.jp/shizuoka/ganmap/ ). This system is based on registered public data available in Shizuoka Prefecture and provides the user with information concerning more than 7,000 medically related facilities (e.g., hospitals, clinics, and pharmacies). The system’s information database was derived from existing official regional data. After a probation period, we identified three factors that promote Information technology (IT) system usage for sustainable health care management: (1) visual presentation of information and usability, (2) information management, and (3) contribution to social innovation.

Experience with Quality Assurance in Two Store-and-Forward Telemedicine Networks

Despite the increasing use of telemedicine around the world, little has been done to incorporate quality assurance (QA) into these operations. The purpose of the present study was to examine the feasibility of QA in store-and-forward teleconsulting using a previously published framework. During a 2-year study period, we examined the feasibility of using QA tools in two mature telemedicine networks [Médecins Sans Frontières (MSF) and New Zealand Teledermatology (NZT)]. The tools included performance reporting to assess trends, automated follow-up of patients to obtain outcomes data, automated surveying of referrers to obtain user feedback, and retrospective assessment of randomly selected cases to assess quality. In addition, the senior case coordinators in each network were responsible for identifying potential adverse events from email reports received from users. During the study period, there were 149 responses to the patient follow-up questions relating to the 1241 MSF cases (i.e., 12% of cases), and there were 271 responses to the follow-up questions relating to the 639 NZT cases (i.e., 42% of cases). The collection of user feedback reports was combined with the collection of patient follow-up data, thus producing the same response rates. The outcomes data suggested that the telemedicine advice proved useful for the referring doctor in the majority of cases and was likely to benefit the patient. The user feedback was overwhelmingly positive, over 90% of referrers in the two networks finding the advice received to be of educational benefit. The feedback also suggested that the teleconsultation had provided cost savings in about 20% of cases, either to the patient/family, or to the hospital/clinic treating the patient. Various problems were detected by regular monitoring, and certain adverse events were identified from email reports by the users. A single aberrant quality reading was detected by using a process control chart. The present study demonstrates that a QA program is feasible in store-and-forward telemedicine, and shows that it was useful in two different networks, because certain problems were detected (and then solved) that would not have been identified until much later. It seems likely that QA could be used much more widely in telemedicine generally to benefit patient care.

Evaluation Framework for Telemedicine Using the Logical Framework Approach and a Fishbone Diagram

Objectives

Technological advances using telemedicine and telehealth are growing in healthcare fields, but the evaluation framework for them is inconsistent and limited. This paper suggests a comprehensive evaluation framework for telemedicine system implementation and will support related stakeholders' decision-making by promoting general understanding, and resolving arguments and controversies.

Methods

This study focused on developing a comprehensive evaluation framework by summarizing themes across the range of evaluation techniques and organized foundational evaluation frameworks generally applicable through studies and cases of diverse telemedicine. Evaluation factors related to aspects of information technology; the evaluation of satisfaction of service providers and consumers, cost, quality, and information security are organized using the fishbone diagram.

Results

It was not easy to develop a monitoring and evaluation framework for telemedicine since evaluation frameworks for telemedicine are very complex with many potential inputs, activities, outputs, outcomes, and stakeholders. A conceptual framework was developed that incorporates the key dimensions that need to be considered in the evaluation of telehealth implementation for a formal structured approach to the evaluation of a service. The suggested framework consists of six major dimensions and the subsequent branches for each dimension.

Conclusions

To implement telemedicine and telehealth services, stakeholders should make decisions based on sufficient evidence in quality and safety measured by the comprehensive evaluation framework. Further work would be valuable in applying more comprehensive evaluations to verify and improve the comprehensive framework across a variety of contexts with more factors and participant group dimensions.

What's Past is Prologue: A Scoping Review of Recent Public Health and Global Health Informatics Literature

OBJECTIVE

To categorize and describe the public health informatics (PHI) and global health informatics (GHI) literature between 2012 and 2014.

METHODS

We conducted a semi-systematic review of articles published between January 2012 and September 2014 where information and communications technologies (ICT) was a primary subject of the study or a main component of the study methodology. Additional inclusion and exclusion criteria were used to filter PHI and GHI articles from the larger biomedical informatics domain. Articles were identified using MEDLINE as well as personal bibliographies from members of the American Medical Informatics Association PHI and GHI working groups.

RESULTS

A total of 85 PHI articles and 282 GHI articles were identified. While systems in PHI continue to support surveillance activities, we identified a shift towards support for prevention, environmental health, and public health care services. Furthermore, articles from the U.S. reveal a shift towards PHI applications at state and local levels. GHI articles focused on telemedicine, mHealth and eHealth applications. The development of adequate infrastructure to support ICT remains a challenge, although we identified a small but growing set of articles that measure the impact of ICT on clinical outcomes.

DISCUSSION

There is evidence of growth with respect to both implementation of information systems within the public health enterprise as well as a widening of scope within each informatics discipline. Yet the articles also illuminate the need for more primary research studies on what works and what does not as both searches yielded small numbers of primary, empirical articles.

CONCLUSION

While the body of knowledge around PHI and GHI continues to mature, additional studies of higher quality are needed to generate the robust evidence base needed to support continued investment in ICT by governmental health agencies.

Teledermatology in Low-Resource Settings: The MSF Experience with a Multilingual Tele-Expertise Platform

Introduction: In 2010, Médecins Sans Frontières (MSF) launched a tele-expertise system to improve the access to specialized clinical support for its field health workers. Among medical specialties, dermatology is the second most commonly requested type of tele-expertise. The aim of the present study was to review all MSF teledermatology cases in the first 4 years of operation. Our hypothesis was that the review would enable the identification of key areas for improvement in the current MSF teledermatology system.

Methods: We carried out a retrospective analysis of all dermatology cases referred by MSF field doctors through the MSF platform from April 2010 until February 2014. We conducted a quantitative and qualitative analysis based on a survey sent to all referrers and specialists involved in these cases.

Results: A total of 65 clinical cases were recorded by the system and 26 experts were involved in case management. The median delay in providing the first specialist response was 10.2 h (IQR 3.7–21.1). The median delay in allocating a new case was 0.96 h (IQR 0.26–3.05). The three main countries of case origin were South Sudan (29%), Ethiopia (12%), and Democratic Republic of Congo (10%). The most common topics treated were infectious diseases (46%), inflammatory diseases (25%), and genetic diseases (14%). One-third of users completed the survey. The two main issues raised by specialists and/or referrers were the lack of feedback about patient follow-up and the insufficient quality of clinical details and information supplied by referrers.

Discussion: The system clearly delivered a useful service to referrers because the workload rose steadily during the 4-year study period. Nonetheless, user surveys and retrospective analysis suggest that the MSF teledermatology system can be improved by providing guidance on best practice, using pre-filled referral forms, following-up the cases after teleconsultation, and establishing standards for clinical photography.

Assessing the Quality of Teleconsultations in a Store-And-Forward Telemedicine Network - Long-Term Monitoring Taking into Account Differences between Cases

We have previously proposed a method for assessing the quality of individual teleconsultation cases; this paper proposes an additional step to allow the long-term monitoring of quality. The basic scenario is a teleconsultation system (aka an e-referral system or a tele-expertise system) where the referrer posts a question about a clinical case, the question is relayed to an appropriate expert, and the chosen expert provides an answer. The people running this system want assurances that it is stable, i.e., they want routine quality assurance information about the “output” from the “process.” This requires two things. It needs a method of assessing the quality of individual patient consultations. And it needs a method for taking into account differences between patients, so that these quality assessments can be compared longitudinally. Building on the previously proposed methodology, the present paper proposes two techniques for measuring the difficulty posed by a particular teleconsultation. The first is an indirect method, similar to a willingness to pay economic estimation. The second is a direct method. Using these two methods with real data from a telemedicine network showed that the first method was feasible, but did not produce useful results in a pilot trial. The second method, while more laborious, was also feasible and did produce useful results. Thus, when output quality is measured, an allowance can be made for the characteristics of the case submitted. This means that fluctuations in output quality can be attributed to variations in the process (network) or to variations in the raw materials (queries submitted to the network). Long-term quality assurance should assist those providing telemedicine services in low-resource settings to ensure that the services are operated effectively and efficiently, despite the constraints and complexities of the environment.

Combining continuing education with expert consultation via telemedicine in Cambodia

Telemedicine has the potential to increase access to both clinical consultation and continuing medical education in Cambodia. We present a Cambodian surgical centre's experience with a collaboration in which complicated orthopaedic cases were presented to a panel of consultants using free online videoconferencing software, providing a combined opportunity for both continuing education and the enhancement of patient care. Effects of the case conference on patient care were examined via a retrospective review and clinician perspectives were elicited via a qualitative survey. The case conference altered patient care in 69% of cases. All Cambodian staff reported learning from the conference and 78% reported changes in their care for patients not presented at the conference. Real-time videoconferencing between consultants in the developed world and physicians in a developing country may be an effective, low-cost and easily replicable means of combining direct benefits to patient care with continuing medical education.

Comparative performance of seven long-running telemedicine networks delivering humanitarian services

Seven long-running telemedicine networks were surveyed. The networks provided humanitarian services (clinical and educational) in developing countries, and had been in operation for periods of 5–15 years. The number of experts serving each network ranged from 15 to 513. The smallest network had a total of 10 requesters and the largest one had more than 500 requesters. The networks operated in nearly 60 countries. The seven networks managed a total of 1857 cases in 2011, i.e. an average of 265 cases per year per network. There was a significant growth in total activity, amounting to 100.3 cases per year during the 15 year study period. In 2011, network activity was 50–700 teleconsultations per network. There were clear differences in the patterns of activity, with some networks managing an increasing caseload, and others managing a slowly reducing caseload. The seven networks had published a total of 44 papers listed in Medline which summarized the evidence resulting from the delivery of services by telemedicine. There was a dearth of information about clinical and cost-effectiveness. Nevertheless, the services were widely appreciated by referring doctors, considered to be clinically useful, and there were indications that clinical outcomes for telemedicine patients were often improved. Despite a lack of formal evidence, the present study suggests that telemedicine can provide clinically useful services in developing countries.

Long-running telemedicine networks delivering humanitarian services: experience, performance and scientific output

OBJECTIVE

To summarize the experience, performance and scientific output of long-running telemedicine networks delivering humanitarian services.

METHODS

Nine long-running networks--those operating for five years or more--were identified and seven provided detailed information about their activities, including performance and scientific output. Information was extracted from peer-reviewed papers describing the networks' study design, effectiveness, quality, economics, provision of access to care and sustainability. The strength of the evidence was scored as none, poor, average or good.

FINDINGS

The seven networks had been operating for a median of 11 years (range: 5-15). All networks provided clinical tele-consultations for humanitarian purposes using store-and-forward methods and five were also involved in some form of education. The smallest network had 15 experts and the largest had more than 500. The clinical caseload was 50 to 500 cases a year. A total of 59 papers had been published by the networks, and 44 were listed in Medline. Based on study design, the strength of the evidence was generally poor by conventional standards (e.g. 29 papers described non-controlled clinical series). Over half of the papers provided evidence of sustainability and improved access to care. Uncertain funding was a common risk factor.

CONCLUSION

Improved collaboration between networks could help attenuate the lack of resources reported by some networks and improve sustainability. Although the evidence base is weak, the networks appear to offer sustainable and clinically useful services. These findings may interest decision-makers in developing countries considering starting, supporting or joining similar telemedicine networks.