Optimizing Telehealth: Leveraging Key Performance Indicators for Enhanced TeleHealth and Digital Healthcare Outcomes (Telemechron Study)

Over the past decade, the use of telehealth has garnered increasing attention. The focus on quality aspects has seen significant growth in tandem with the telehealth expansion. Having useful indicators in this area is becoming increasingly strategic for fully integrating the technology into the health domain. These indicators can help monitor and evaluate the quality of telehealth services, guiding improvements and ensuring that these digital solutions meet the necessary standards for effective healthcare delivery. The purpose of this study is to analyze Key performance indicators (KPIs) in telehealth within institutional websites and the scientific dissemination world by means of a narrative review. A narrative review was proposed with these two specific points of view based on a standardized checklist and a quality control procedure for including scientific papers in the analysis. Results from scientific studies emphasize KPIs such as patient outcomes, operational efficiency, technical reliability, and cost-effectiveness. These include measures like improvements in condition management, patient satisfaction, consultation numbers, waiting times, and cost savings. Institutional documents from entities like the WHO also show diverse perspectives, focusing on equitable access, clinical excellence, patient prioritization, response times, and patient and staff satisfaction. The findings suggest that adopting a comprehensive set of KPIs and continuously monitoring and evaluating telehealth services can enhance their effectiveness, efficiency, and equity, ultimately improving healthcare outcomes and accessibility.

Joint and Functional Examinations in the Orthopaedic and Traumatological Video Consultation - What is Currently Possible?

BACKGROUND

In the context of the COVID-19 pandemic, video consultations have gained importance in orthopaedic and traumatological departments. In current literature, different adaptations of classic joint and functional examinations have been described for the virtual examination.

METHODOLOGY

A systematic review of current literature on adaptations for the virtual joint and functional examination in orthopaedics and trauma surgery was performed over PubMed (January 2010 to April 2021). The identified examination methods were then summarised systematically according to body region and pathology. Each examination was then described in detail and depicted in an exemplary picture.

RESULTS

In total 17 articles were identified and included in the analysis. Most of the examinations employed classical examination methods which were adapted so that they could be performed by the patient independently. Everyday items were described as supporting tools. In five publications, orthopaedic examinations performed in video consultations were compared to the classical examination. Results of functional examinations showed less agreement with results of classical orthopaedic examinations when compared to inspection and ROM-testing.

CONCLUSION

Current literature offers a substantial repertoire of examination options that can be used in the orthopaedic and traumatological video consultation. The reported examinations are mostly oriented to classical orthopaedic examinations. In future digital examinations have to be validated and possibly further adapted in future.

Investigating Digital Patient-Reported Outcome Measures in Patient-Centered Diabetes Specialist Outpatient Care (DigiDiaS): Protocol for a Multimethod Prospective Observational Study

BACKGROUND

Living with type 1 diabetes is challenging, and to support self-management, repeated consultations in specialist outpatient care are often required. The emergence of new digital solutions has revolutionized how health care services can be patient centered, providing unprecedented opportunities for flexible, high-quality care. However, there is a lack of studies exploring how the use of digital patient-reported outcome measures (PROMs) for flexible specialist care affects diabetes self-management. To provide new knowledge on the relevance of using PROMs in standard care, we have designed a multimethod prospective study.

OBJECTIVE

The overall aim of this protocol is to describe our prospective multimethod observational study designed to investigate digital PROMs in a routine specialist outpatient setting for flexible patient-centered diabetes care (DigiDiaS).

METHODS

This protocol outlines the design of a multimethod prospective observational cohort study that includes data from electronic health records, self-reported questionnaires, clinical consultation field observations, and individual in-depth interviews with patients and diabetes health care personnel. All patients with type 1 diabetes at a designated outpatient clinic were invited to participate and use the digital PROM implemented in clinical care. Both users and nonusers of the digital PROM were eligible for the prospective study, allowing for a comparison of the two groups. Data were collected at baseline and after 12 months, including self-management as the primary outcome assessed using the Patient Activation Measure, along with the secondary outcomes of digital health literacy, quality of life, health economy, and clinical variables such as glycated hemoglobin.

RESULTS

The digital solution was implemented for routine clinical care in the department in November 2021, and data collection for the prospective study started in October 2022. As of September 6, 2023, 84.6% (186/220) of patients among those in the digital PROM and 15.5% (34/220) of patients among the nonusers have consented to participate. We expect the study to have enough participants by the autumn of 2023. With 1 year of follow-up, the results are expected by spring 2025.

CONCLUSIONS

In conclusion, a multimethod prospective observational cohort study can offer valuable insights into the relevance, effectiveness, and acceptability of digital tools using PROMs in diabetes specialist care. Such knowledge is crucial for achieving broad and successful implementation and use of these tools in a large diabetes outpatient clinic.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52766.

Factors Influencing Nursing Student Learning During Clinical Placements: A Modified Delphi Study

BACKGROUND

Factors identified as important to nursing student clinical learning include the environment, the clinical facilitator, and student human factors.

METHOD

A modified Delphi study generated clinical nurse educators' expert consensus of the importance of factors that influence student learning during clinical placements. Short-answer questions exploring facilitation of learning were also provided.

RESULTS

Thirty-four nurse educators participated in the first round, and 17 nurse educators participated in the second round. Final consensus of at least 80% agreement was reached for all factors. Enablers of student learning included a positive workplace culture, student attitude, and clear communication between facilitator and student. Barriers to student learning included lack of time for teaching, short placement duration, and poor student and facilitator attitude.

CONCLUSION

Further investigation is needed on how these factors are addressed during placements including a review of the quality of resources provided to students and clinical facilitators for student learning. [J Nurs Educ. 2023;62(6):333-341.].

Auditing the Audits: A Systematic Review on Different Procedures in Telemedicine

Telemedicine is a process of delivering health care using information and communication technologies. Audit and feedback (A&F) constitute a systematic intervention that is aimed at collecting data, which are subsequently compared with reference standards and then returned to health care operators through feedback meetings. The aim of this review is to analyse different audit procedures on and by mean of telemedicine services and to identify a practice that is more effective than the others. Systematic searches were performed in three databases evaluating studies focusing on clinical audits performed on and by means of telemedicine systems. Twenty-five studies were included in the review. Most of them focused on telecounselling services with an audit and a maximum duration of one year. Recipients of the audit were telemedicine systems and service users (general practitioners, referring doctors, and patients). Data resulting from the audit were inherent to the telemedicine service. The overall data collected concerned the number of teleconsultations, service activity, reasons for referral, response times, follow-up, reasons why treatment was not completed, technical issues, and other information specific to each telemedicine service. Only two of the considered studies dealt with organizational aspects, and of these, only one analysed communicative aspects. The complexity and heterogeneity of the treatments and services provided meant that no index of uniformity could be identified. Certainly, some audits were performed in an overlapping manner in the different studies, and these show that although attention is often paid to workers' opinions, needs, and issues, little interest was shown in communicative/organizational and team dynamics. Given the importance and influence that communication has in teamwork and care settings, an audit protocol that takes into account intra- and extra-team communication processes could be essential to improving the well-being of operators and the quality of the service provided.

Measuring the Success of a Project ECHO Implementation: Results from an International e-Delphi Study

There is an increasing global need for organisations to utilise high-quality telementoring models to support workforce development and mentorship. Project ECHO is a validated telementoring model that has been adopted by over 700 organisations globally across multiple sectors. To date there is no consolidated list of success indicators by which organisational teams can assess or benchmark their implementation of Project ECHO across sectors. An e-Delphi methodology was adopted to facilitate a comprehensive means of identifying indicators that could be used to assess the implementations of Project ECHO globally. This paper presents a consolidated framework of indicators that support teams to assess their implementation of Project ECHO. These indicators have been derived by an international panel of experts across the healthcare, education, and university sectors. The final framework identified 54 distinct indicators across four domains: (1) spoke participant engagement, (2) ECHO Hub/teleECHO Network design and operation, (3) ECHO Hub team engagement and (4) Local Impact. This paper highlights that Project ECHO implementation indicators can vary between being dynamic, static, and iterative, depending on the phase of implementation. These findings are significant because they are generalisable to any organisation/sector implementing Project ECHO or similar telementoring models.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-022-00050-7.

Model for ASsessing the value of Artificial Intelligence in medical imaging (MAS-AI)

Objectives

Artificial intelligence (AI) is seen as a major disrupting force in the future healthcare system. However, the assessment of the value of AI technologies is still unclear. Therefore, a multidisciplinary group of experts and patients developed a Model for ASsessing the value of AI (MAS-AI) in medical imaging. Medical imaging is chosen due to the maturity of AI in this area, ensuring a robust evidence-based model.

Methods

MAS-AI was developed in three phases. First, a literature review of existing guides, evaluations, and assessments of the value of AI in the field of medical imaging. Next, we interviewed leading researchers in AI in Denmark. The third phase consisted of two workshops where decision makers, patient organizations, and researchers discussed crucial topics for evaluating AI. The multidisciplinary team revised the model between workshops according to comments.

Results

The MAS-AI guideline consists of two steps covering nine domains and five process factors supporting the assessment. Step 1 contains a description of patients, how the AI model was developed, and initial ethical and legal considerations. In step 2, a multidisciplinary assessment of outcomes of the AI application is done for the five remaining domains: safety, clinical aspects, economics, organizational aspects, and patient aspects.

Conclusions

We have developed an health technology assessment-based framework to support the introduction of AI technologies into healthcare in medical imaging. It is essential to ensure informed and valid decisions regarding the adoption of AI with a structured process and tool. MAS-AI can help support decision making and provide greater transparency for all parties.

Assessing Face Validity of the HexCom Model for Capturing Complexity in Clinical Practice: A Delphi Study

Capturing complexity is both a conceptual and a practical challenge in palliative care. The HexCom model has proved to be an instrument with strong reliability and to be valid for describing the needs and strengths of patients in home care. In order to explore whether it is also perceived to be helpful in enhancing coordinated and patient-centred care at a practical level, a methodological study was carried out to assess the face validity of the model. In particular, a Delphi method involving a group of 14 experts representing the full spectrum of healthcare professionals involved in palliative care was carried out. The results show that there is a high level of agreement, with a content validity index-item greater than 0.92 both with regard to the complexity model and the HexCom-Red, HexCom-Basic, and the HexCom-Clin instruments, and higher than 0.85 regarding the HexCom-Figure and the HexCom-Patient instruments. This consensus confirms that the HexCom model and the different instruments that are derived from it are valued as useful tools for a broad range of healthcare professional in coordinately capturing complexity in healthcare practice.

The influencing factors of Harbin (China) residents' satisfaction with municipal solid waste treatment

China is experiencing an enormous increase in municipal household solid waste (MHSW) generation and is facing multiple problems associated with the treatment of MHSW. This paper analyses factors affecting residents' satisfaction with MHSW treatment performance. Six factors were identified by the Delphi method: (a) pick-up frequency by waste collection vehicles, (b) fund supply situation, (c) charging standard for waste treatment, (d) waste bin arrangement, (e) laws and regulations, (f) publicity and education. We examine the significance of these six influencing factors, estimating binary logistic regression models. Data for this study are derived from the survey responses of 469 households in Harbin, one of the largest cities in northeast China. The results indicate that 'pick-up frequency by waste collection vehicles' is ranked the first and most important determinant of Harbin residents' satisfaction with MHSW treatment; this is closely followed by 'publicity and education'. The third and fourth significant influencing factors, respectively, are 'fund supply situation' and 'charging standard for waste treatment'. The last two factors are 'laws and regulations' and 'waste bin arrangement'. By understanding the influence of various factors on residents' satisfaction, this study aims to help in designing an effective waste management system to reduce the cost of MHSW management, and to raise the residents' satisfaction with municipal solid waste treatment. Based on the research findings, we advocate that establishing a reasonable waste transport (pick-up) system as well as strengthening publicity and education of waste management are key to improving residents' satisfaction with the MHSW treatment performance.

Online Guide for Electronic Health Evaluation Approaches: Systematic Scoping Review and Concept Mapping Study

BACKGROUND

Despite the increase in use and high expectations of digital health solutions, scientific evidence about the effectiveness of electronic health (eHealth) and other aspects such as usability and accuracy is lagging behind. eHealth solutions are complex interventions, which require a wide array of evaluation approaches that are capable of answering the many different questions that arise during the consecutive study phases of eHealth development and implementation. However, evaluators seem to struggle in choosing suitable evaluation approaches in relation to a specific study phase.

OBJECTIVE

The objective of this project was to provide a structured overview of the existing eHealth evaluation approaches, with the aim of assisting eHealth evaluators in selecting a suitable approach for evaluating their eHealth solution at a specific evaluation study phase.

METHODS

Three consecutive steps were followed. Step 1 was a systematic scoping review, summarizing existing eHealth evaluation approaches. Step 2 was a concept mapping study asking eHealth researchers about approaches for evaluating eHealth. In step 3, the results of step 1 and 2 were used to develop an "eHealth evaluation cycle" and subsequently compose the online "eHealth methodology guide."

RESULTS

The scoping review yielded 57 articles describing 50 unique evaluation approaches. The concept mapping study questioned 43 eHealth researchers, resulting in 48 unique approaches. After removing duplicates, 75 unique evaluation approaches remained. Thereafter, an "eHealth evaluation cycle" was developed, consisting of six evaluation study phases: conceptual and planning, design, development and usability, pilot (feasibility), effectiveness (impact), uptake (implementation), and all phases. Finally, the "eHealth methodology guide" was composed by assigning the 75 evaluation approaches to the specific study phases of the "eHealth evaluation cycle."

CONCLUSIONS

Seventy-five unique evaluation approaches were found in the literature and suggested by eHealth researchers, which served as content for the online "eHealth methodology guide." By assisting evaluators in selecting a suitable evaluation approach in relation to a specific study phase of the "eHealth evaluation cycle," the guide aims to enhance the quality, safety, and successful long-term implementation of novel eHealth solutions.

Online Guide for Electronic Health Evaluation Approaches: Systematic Scoping Review and Concept Mapping Study

BACKGROUND

Despite the increase in use and high expectations of digital health solutions, scientific evidence about the effectiveness of electronic health (eHealth) and other aspects such as usability and accuracy is lagging behind. eHealth solutions are complex interventions, which require a wide array of evaluation approaches that are capable of answering the many different questions that arise during the consecutive study phases of eHealth development and implementation. However, evaluators seem to struggle in choosing suitable evaluation approaches in relation to a specific study phase.

OBJECTIVE

The objective of this project was to provide a structured overview of the existing eHealth evaluation approaches, with the aim of assisting eHealth evaluators in selecting a suitable approach for evaluating their eHealth solution at a specific evaluation study phase.

METHODS

Three consecutive steps were followed. Step 1 was a systematic scoping review, summarizing existing eHealth evaluation approaches. Step 2 was a concept mapping study asking eHealth researchers about approaches for evaluating eHealth. In step 3, the results of step 1 and 2 were used to develop an "eHealth evaluation cycle" and subsequently compose the online "eHealth methodology guide."

RESULTS

The scoping review yielded 57 articles describing 50 unique evaluation approaches. The concept mapping study questioned 43 eHealth researchers, resulting in 48 unique approaches. After removing duplicates, 75 unique evaluation approaches remained. Thereafter, an "eHealth evaluation cycle" was developed, consisting of six evaluation study phases: conceptual and planning, design, development and usability, pilot (feasibility), effectiveness (impact), uptake (implementation), and all phases. Finally, the "eHealth methodology guide" was composed by assigning the 75 evaluation approaches to the specific study phases of the "eHealth evaluation cycle."

CONCLUSIONS

Seventy-five unique evaluation approaches were found in the literature and suggested by eHealth researchers, which served as content for the online "eHealth methodology guide." By assisting evaluators in selecting a suitable evaluation approach in relation to a specific study phase of the "eHealth evaluation cycle," the guide aims to enhance the quality, safety, and successful long-term implementation of novel eHealth solutions.

[Telemedicine projects in rural areas of Germany. A systematic evaluation with the "Model for Assessment of Telemedicine"]

BACKGROUND

The term telemedicine describes the delivery of healthcare services through the use of information and communication technologies in a situation where the actors are at different locations. While telemedical applications are piloted in research projects in Germany, they have rarely become part of everyday care. In order to find indications as to why the transfer of knowledge into practice has so far been slow, it is necessary to examine telemedical projects for aspects of implementation science.

METHODS

A systematic search looking for telemedical projects in Germany was conducted in the electronic databases PubMed, Web of Science and ACM Digital Library using a complex search strategy. The criteria and domains of the Model for Assessment of Telemedicine (MAST) were used to evaluate the publications.

RESULTS

A total of 336 publications were identified, 16 of which were ultimately included in the analysis. Much of the work deals with stroke and the implementation of telemedicine networks. The analysis according to MAST shows that most publications omit essential considerations.

CONCLUSION

Publications on telemedical projects are often characterized by unsystematic approaches. The MAST instrument identifies areas where the approaches to telemedical projects could be extended in the future to ensure the sustainability and feasibility of these prototypical telemedical applications.

The Service User Technology Acceptability Questionnaire: Psychometric Evaluation of the Norwegian Version

Background

When developing a mobile health app, users’ perception of the technology should preferably be evaluated. However, few standardized and validated questionnaires measuring acceptability are available.

Objective

The aim of this study was to assess the validity of the Norwegian version of the Service User Technology Acceptability Questionnaire (SUTAQ).

Methods

Persons with type 2 diabetes randomized to the intervention groups of the RENEWING HEALTH study used a diabetes diary app. At the one-year follow-up, participants in the intervention groups (n=75) completed the self-reported instrument SUTAQ to measure the acceptability of the equipment. We conducted confirmatory factor analysis for evaluating the fit of the original five-factor structure of the SUTAQ.

Results

We confirmed only 2 of the original 5 factors of the SUTAQ, perceived benefit and care personnel concerns.

Conclusions

The original five-factor structure of the SUTAQ was not confirmed in the Norwegian study, indicating that more research is needed to tailor the questionnaire to better reflect the Norwegian setting. However, a small sample size prevented us from drawing firm conclusions about the translated questionnaire.

A Scoping Review of Economic Evaluations Alongside Randomised Controlled Trials of Home Monitoring in Chronic Disease Management

Many countries have considered telemedicine and home monitoring of patients as a solution to the demographic challenges that health-care systems face. However, reviews of economic evaluations of telemedicine have identified methodological problems in many studies as they do not comply with guidelines. The aim of this study was to examine economic evaluations alongside randomised controlled trials of home monitoring in chronic disease management and hereby to explore the resources included in the programme costs, the types of health-care utilisation that change as a result of home monitoring and discuss the value of economic evaluation alongside randomised controlled trials of home monitoring on the basis of the studies identified. A scoping review of economic evaluations of home monitoring of patients with chronic disease based on randomised controlled trials and including information on the programme costs and the costs of equipment was carried out based on a Medline (PubMed) search. Nine studies met the inclusion criteria. All studies include both costs of equipment and use of staff, but there is large variation in the types of equipment and types of tasks for the staff included in the costs. Equipment costs constituted 16-73% of the total programme costs. In six of the nine studies, home monitoring resulted in a reduction in primary care or emergency contacts. However, in total, home monitoring resulted in increased average costs per patient in six studies and reduced costs in three of the nine studies. The review is limited by the small number of studies found and the restriction to randomised controlled trials, which can be problematic in this area due to lack of blinding of patients and healthcare professionals and the difficulty of implementing organisational changes in hospital departments for the limited period of a trial. Furthermore, our results may be based on assessments of older telemedicine interventions.

The Model for Assessment of Telemedicine (MAST): A scoping review of empirical studies

The evaluation of telemedicine can be achieved using different evaluation models or theoretical frameworks. This paper presents a scoping review of published studies which have applied the Model for Assessment of Telemedicine (MAST). MAST includes pre-implementation assessment (e.g. by use of participatory design), followed by multidisciplinary assessment, including description of the patients and the application and assessment of safety, clinical effectiveness, patient perspectives, economic aspects organisational aspects and socio-cultural, legal and ethical aspects. Twenty-two studies met the inclusion criteria and were included in the review. In this article, research design and methods used in the multidisciplinary assessment are described, strengths and weaknesses are analysed, and recommendations for future research are presented.