Early Patient-Centered Outcomes Research Experience With the Use of Telehealth to Address Disparities: Scoping Review

Building Statewide Quality Improvement Capacity to Improve Cardiovascular Care and Health Equity: Lessons from the Tennessee Heart Health Network

DRIVING FORCES

Many states with high rates of cardiovascular disease (CVD) lack statewide quality improvement (QI) infrastructure (for example, resources, leadership, community) to address relevant health needs of the population. Academic health centers are well positioned to play a central role in addressing this deficiency. This article describes early experience and lessons learned in building statewide QI infrastructure through the Tennessee Heart Health Network (Network).

APPROACH

A statewide, multistakeholder network composed of primary care practices (PCPs), health systems, health plans, QI organizations, patients, and academic institutions was led by the University of Tennessee Health Science Center (UTHSC), an academic health center, to improve cardiovascular health by supporting dissemination and implementation of patient-centered outcomes research (PCOR) evidence-based interventions in primary care. PCPs were required to select and implement at least one of three interventions (health coaching, tailored health-related text messaging, and pharmacist-physician collaboration).

OUTCOMES AND KEY INSIGHTS

Thirty statewide organizational partners joined the Network in year one, including 18 health systems representing 77 PCPs (30.0% of 257 potentially eligible PCPs identified) with approximately 300,000 patients. The organizational partners share EHRs for the ongoing tracking and reporting of key health metrics, including hypertension control and delivery of tobacco cessation counseling. Of the 77 PCPs, 62 continue participation after year two (80.5% retention). Main barriers to participation and reasons for discontinuing participation included reluctance to share data and changes in leadership at the health system level. These 62 PCPs selected the following interventions to implement: health coaching (41.9%), tailored health-related text messages (48.4%), and pharmacist-physician collaboration (40.3%).

CONCLUSION AND WHAT'S NEXT

Academic health centers have broad reach and high acceptability by diverse stakeholders. Tennessee's experience illustrates how academic health centers can serve as platforms for building a statewide infrastructure for disseminating, implementing, and sustaining QI interventions at the practice level. Assessment of Network impact is ongoing.

Telehealth as a Strategy for Health Equity: A Scoping Review of Telehealth in India During and Following the COVID-19 Pandemic for People with Disabilities

Introduction: Telehealth in India is growing rapidly and represents a strategy to promote affordable, inclusive, timely and safe access to healthcare. Yet there is a risk that telehealth increases inequity due to the digital divide and existing poor health literacy. Methods: A scoping review was conducted to explore use of telehealth in India during and following the COVID-19 pandemic by people with disabilities to inform strategies to increase equity of telehealth for people with disabilities. Of 1966 studies from the initial search in four databases and three specific telehealth journals, 20 sources met the inclusion criteria, limited to a focus on physical disability in India. Results: Findings showed examples of how people with disabilities can exercise increased control in the timing of appointments, convenience of receiving services from home and not having to travel to clinics or hospitals, and platform preference through tools and applications already familiar to them. Carers and families of people with disabilities were described as highly valued stakeholders with important roles in the uptake and effectiveness of telehealth for people with disabilities. The identified benefits of telehealth resulted in high levels of user satisfaction due to increased control and convenience, however, systemic barriers for accessibility remain. Conclusion: This review suggested that if telehealth is not designed intentionally to change the status quo for people with disabilities and prioritize equity, then the benefits may not be sustainable. Recommendations for telehealth India are provided, based on both findings from the literature and analysis of results.

An Infrastructure Framework for Remote Patient Monitoring Interventions and Research

Remote patient monitoring (RPM) enables clinicians to maintain and adjust their patients' plan of care by using remotely gathered data, such as vital signs, to proactively make medical decisions about a patient's care. RPM interventions have been touted as a means to improve patient care and well-being while reducing costs and resource needs within the health care ecosystem. However, multiple interworking components must be successfully implemented for an RPM intervention to yield the desired outcomes, and the design and key driver of each component can vary depending on the medical context. This viewpoint and perspective paper presents a 4-component RPM infrastructure framework based on a synthesis of existing literature and practice related to RPM. Specifically, these components are identified and considered: (1) data collection, (2) data transmission and storage, (3) data analysis, and (4) information presentation. Interaction points to consider between components include transmission, interoperability, accessibility, workflow integration, and transparency. Within each of the 4 components, questions affecting research and practice emerge that can affect the outcomes of RPM interventions. This framework provides a holistic perspective of the technologies involved in RPM interventions and how these core elements interact to provide an appropriate infrastructure for deploying RPM in health systems. Further, it provides a common vocabulary to compare and contrast RPM solutions across health contexts and may stimulate new research and intervention opportunities.

Demographic Disparities in Drive Times to the Nearest Audiologist in the United States

PURPOSE

Audiological services are underused, possibly because patients need to drive long distances to see a provider. In this study, we measured the association of drive times to the nearest audiologist with population density, income, ethnicity, race, and distance to the nearest audiology graduate program.

METHOD

Drive times for each census block group to the nearest audiologist were measured using census data, the National Provider Identifier Registry, and a geographic analyzing tool called ArcGIS for all block groups within the United States. The association between drive times and population density, income, ethnicity, race, and audiology program distance was evaluated with a population density-matched case-control study and multiple linear regression analyses.

RESULTS

Approximately 5.29 million Americans need to drive at least 1 hr to visit their closest audiologist. The 10% most rural-dwelling Americans drive an average of 33.8 min. The population density-matched case-control study demonstrated that percent below poverty, percent identifying as Hispanic, and travel times to the nearest audiology program were all significantly higher in census block groups with high drive times to the nearest audiologist. An average of 7.96% of individuals in census block groups with low drive times identified as Hispanic, but 18.8% identified as Hispanic in high drive time groups. The multiple linear regression showed that the effect of demographics and distance to the nearest audiology program was highest in rural areas. In both analyses, adjusting for poverty did not drastically change the effect of percent identifying as Hispanic on drive times.

CONCLUSIONS

Long drive times restrict access to audiological care for those who live in rural areas. This restriction disproportionately affects those in rural areas who identify as Hispanic or have low income.

Patient-Centered Adult Cardiovascular Care: A Scientific Statement From the American Heart Association

Patient-centered care is gaining widespread acceptance by the medical and lay communities and is increasingly recognized as a goal of high-quality health care delivery. Patient-centered care is based on ethical principles and aims at establishing a partnership between the health care team and patient, family member, or both in the care planning and decision-making process. Patient-centered care involves providing respectful care by tailoring management decisions to patients' beliefs, preferences, and values. A collaborative care approach can enhance patient engagement, foster shared decision-making that aligns with patient values and goals, promote more personalized and effective cardiovascular care, and potentially improve patient outcomes. The objective of this scientific statement is to inform health care professionals and stakeholders about the role and impact of patient-centered care in adult cardiovascular medicine. This scientific statement describes the background and rationale for patient-centered care in cardiovascular medicine, provides insight into patient-oriented medication management and patient-reported outcome measures, highlights opportunities and strategies to overcome challenges in patient-centered care, and outlines knowledge gaps and future directions.

Rural Patients' Experiences with Synchronous Video Telehealth in the United States: A Scoping Review

Background: Telehealth can help increase rural health care access. To ensure this modality is accessible for rural patients, it is necessary to understand rural patients' experiences with telehealth. Objectives of this scoping review were to explore how rural patients' telehealth experiences have been measured, assess relevant research, and describe rural telehealth patient experiences. Methods: We searched five databases for articles published from 2016 through 2022. Primary research reports assessing rural adult patient experiences with synchronous video telehealth in the United States in any clinical area were included. Data collected pertained to study characteristics and patient experience assessment characteristics and outcomes. Quality of included studies was assessed using the Quality Assessment with Diverse Studies tool. Review findings were presented in a narrative synthesis. Results: There were 740 articles identified for screening, and 24 met review inclusion criteria. Most studies (70%, n = 16) assessed rural telehealth patient experience using questionnaires; studies employed interviews (n = 11) alone or in combination with surveys. The majority of surveys were study developed and not validated. Quantitative patient experience outcomes fell under categories of patient satisfaction, telehealth care characteristics, patient-provider rapport, technology elements, and access. Qualitative themes were most often presented as telehealth benefits or facilitators, and drawbacks or barriers. Conclusions: Available research indicates positive patient experiences with rural telehealth services. However, study weaknesses limit generalizability of findings. Future research should apply established definitions for participant rurality and clearly group samples by rurality. Efforts should be made to use validated telehealth patient experience measures.

Sociodemographic Differences in the Impacts of Video-Enabled Tablets on Psychotherapy Usage Among Veterans

OBJECTIVE

To examine potential health disparities due to a broad reliance on telehealth during the COVID-19 pandemic, the authors studied the impact of video-enabled tablets provided by the U.S. Department of Veterans Affairs (VA) on psychotherapy usage among rural versus urban, Black versus White, and female versus male veterans.

METHODS

Psychotherapy usage trends before and after onset of the COVID-19 pandemic were examined among veterans with at least one mental health visit in 2019 (63,764 tablet recipients and 1,414,636 nonrecipients). Adjusted difference-in-differences and event study analyses were conducted to compare psychotherapy usage among tablet recipients and nonrecipients (March 15, 2020-December 31, 2021) 10 months before and after tablet issuance. Analyses were stratified by rurality, sex, and race.

RESULTS

Adjusted analyses demonstrated that tablet receipt was associated with increases in psychotherapy visit frequency in every patient group studied (rural, 27.4%; urban, 24.6%; women, 30.5%; men, 24.4%; Black, 20.8%; White, 28.1%), compared with visits before tablet receipt. Compared with men, women had statistically significant tablet-associated psychotherapy visit increases (video visits, 1.2 per year; all modalities, 1.0 per year).

CONCLUSIONS

VA-issued tablets led to increased psychotherapy usage for all groups examined, with similar increases found for rural versus urban and Black versus White veterans and higher increases for women versus men. Eliminating barriers to Internet access or device ownership may improve mental health care access among underserved or historically disadvantaged populations. VA's tablet program offers insights to inform policy makers' and health systems' efforts to bridge the digital divide.

The Impact of Telehealth Expansion on Health Care Utilization, Access, and Outcomes During the Pandemic: A Systematic Review

Introduction: The COVID-19 pandemic brought unprecedented change to the health care industry, including a large and rapid shift to providing care through telehealth technologies. Although the expansion of telehealth services was successful in continuing to provide patients with care while preventing the spread of disease, it is less clear how patient sociodemographic characteristics influenced telehealth use during this time. This study aims to systematically review the published literature on demographic differences in telehealth access, utilization, and health outcomes among a variety of adult patient types in the United States. Methods: Litcovid, PubMed, Web of Science, and MEDLINE databases were searched, resulting in a final sample of n = 32 studies. Results: Results found that studies could be categorized as addressing at least one of eight different areas of inquiry: sociodemographic differences in telehealth use (1) during and (2) before the pandemic, telehealth use versus nonuse (3) during and (4) before the pandemic, (5) telehealth modality, (6) satisfaction with telehealth, (7) outcomes associated with telehealth use, and (8) perceived or actual access to telehealth services. Discussion: Findings are robust across included studies with respect to racial, age, and socioeconomic differences in telehealth utilization and health outcomes, reflecting sociodemographic differences in health care access, utilization, and outcomes more broadly that persist despite this expansion of telehealth services owing to COVID-19. Additional findings across studies are summarized and areas for future research are discussed.

Determinants of non-attendance at face-to-face and telemedicine ophthalmic consultations

BACKGROUND/AIMS

Evaluation of telemedicine care models has highlighted its potential for exacerbating healthcare inequalities. This study seeks to identify and characterise factors associated with non-attendance across face-to-face and telemedicine outpatient appointments.

METHODS

A retrospective cohort study at a tertiary-level ophthalmic institution in the UK, between 1 January 2019 and 31 October 2021. Logistic regression modelled non-attendance against sociodemographic, clinical and operational exposure variables for all new patient registrations across five delivery modes: asynchronous, synchronous telephone, synchronous audiovisual and face to face prior to the pandemic and face to face during the pandemic.

RESULTS

A total of 85 924 patients (median age 55 years, 54.4% female) were newly registered. Non-attendance differed significantly by delivery mode: (9.0% face to face prepandemic, 10.5% face to face during the pandemic, 11.7% asynchronous and 7.8%, synchronous during pandemic). Male sex, greater levels of deprivation, a previously cancelled appointment and not self-reporting ethnicity were strongly associated with non-attendance across all delivery modes. Individuals identifying as black ethnicity had worse attendance in synchronous audiovisual clinics (adjusted OR 4.24, 95% CI 1.59 to 11.28) but not asynchronous. Those not self-reporting their ethnicity were from more deprived backgrounds, had worse broadband access and had significantly higher non-attendance across all modes (all p<0.001).

CONCLUSION

Persistent non-attendance among underserved populations attending telemedicine appointments highlights the challenge digital transformation faces for reducing healthcare inequalities. Implementation of new programmes should be accompanied by investigation into the differential health outcomes of vulnerable populations.

Self-Measured Blood Pressure-Guided Pharmacotherapy: A Systematic Review and Meta-Analysis of United States-Based Telemedicine Trials

BACKGROUND

The optimal approach to implementing telemedicine hypertension management in the United States is unknown.

METHODS

We examined telemedicine hypertension management versus the effect of usual clinic-based care on blood pressure (BP) and patient/clinician-related heterogeneity in a systematic review/meta-analysis. We searched United States-based randomized trials from Medline, Embase, CENTRAL, CINAHL, PsycINFO, Compendex, Web of Science Core Collection, Scopus, and 2 trial registries. We used trial-level differences in BP and its control rate at ≥6 months using random-effects models. We examined heterogeneity in univariable metaregression and in prespecified subgroups (clinicians leading pharmacotherapy [physician/nonphysician], self-management support [pharmacist/nurse], White versus non-White patient predominant trials [>50% patients/trial], diabetes predominant trials [≥25% patients/trial], and White patient predominant but not diabetes predominant trials versus both non-White and diabetes patient predominant trials].

RESULTS

Thirteen, 11, and 7 trials were eligible for systolic and diastolic BP difference and BP control, respectively. Differences in systolic and diastolic BP and BP control rate were -7.3 mm Hg (95% CI, -9.4 to -5.2), -2.7 mm Hg (-4.0 to -1.5), and 10.1% (0.4%-19.9%), respectively, favoring telemedicine. Greater BP reduction occurred in trials where nonphysicians led pharmacotherapy, pharmacists provided self-management support, White patient predominant trials, and White patient predominant but not diabetes predominant trials, with no difference by diabetes predominant trials.

CONCLUSIONS

Telemedicine hypertension management is more effective than clinic-based care in the United States, particularly when nonphysicians lead pharmacotherapy and pharmacists provide self-management support. Non-White patient predominant trials achieved less BP reduction. Equity-conscious, locally informed adaptation of telemedicine interventions is needed before wider implementation.

Patient Experiences with and Preferences for Telemedicine Relative to In-Person Care During the COVID-19 Pandemic

Introduction: Although telemedicine emerged during the COVID-19 pandemic as a critical mode of health care delivery, there may be differences in the perceived ease of patient-clinician communication and quality of care for telemedicine versus in-person visits, as well as variation in perceptions across patient subgroups. We examined patients' experiences with and preferences for telemedicine relative to in-person care, based on their most recent visit. Methods: We conducted a survey of 2,668 adults in a large academic health care system in November 2021. The survey captured patients' reasons for their most recent visit, perceptions on patient-clinician communication and quality of care, and attitudes toward telemedicine versus in-person care. Results: Among respondents, 552 (21%) had a telemedicine visit. Patients with telemedicine and in-person visits had similar agreement on ease of patient-clinician communication and perceived quality of the visit on average. However, for individuals 65 years of age or older, men, and those not needing urgent care, telemedicine was associated with worse perceptions of patient-clinician communication (65 years of age or older: adjusted odds ratio [aOR], 0.51; 95% confidence interval [CI], 0.31-0.85; men: aOR, 0.50; 95% CI, 0.31-0.81; urgent care: aOR 0.67; 95% CI, 0.49-0.91) and lower perceived quality (65 years of age or older, aOR 0.51; 95% CI, 0.30-0.86; men: 0.51; 95% CI, 0.32-0.83; urgent care: aOR 0.68; 95% CI, 0.49-0.93). Conclusion: Patient-perceived quality of care and patient-clinician communication were similar for telemedicine and in-person visits overall. However, among men, older adults, and those not seeking urgent care, patients using telemedicine had lower perceptions of patient-clinician communication and quality.

Mental health service users' experiences of telehealth interventions facilitated during the COVID-19 pandemic and their relevance to nursing: An integrative review

WHAT THIS PAPER ADDS TO EXISTING KNOWLEDGE?: Service users report telehealth interventions to be useful in terms of access and convenience however, a preference for face-to-face interventions remains. Nurses are using telehealth interventions in clinical practice however, further research is necessary in this area as the evidence of their involvement is limited. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: This paper highlights the use of telehealth interventions should augment rather than replace face-to-face care provision.

ABSTRACT

INTRODUCTION: The Covid-19 pandemic saw the swift implementation of physical and social distancing that impacted the way in which mental health services were facilitated. Consequently, telehealth/e-health interventions are increasing in use.

AIM

This integrative review aims to explore existing literature regarding mental health service users' experiences of telehealth interventions facilitated through the COVID-19 pandemic, to determine the visibility of nursing involvement in the facilitation of telehealth interventions and to use these experiences to inform nursing practice.

METHOD

A methodical search of eight (n = 8) academic databases was undertaken using CINAHL, SCOPUS, EMBASE, PsycINFO, Web of Science, Cochrane, MEDLINE and Academic Search Complete between January 2020 and January 2022.

RESULTS

A total of 5133 papers were screened by title and abstract of which (n = 77) progressed for full-text screening. Five (n = 5) papers met the inclusion criteria for this review and results were mapped onto the four meta-paradigms of nursing: person; where the findings discuss the acceptability of telehealth interventions; environment; where the findings highlight barriers and facilitators to the use of telehealth interventions; health; where the findings discuss staff time and logistical issues relating to telehealth interventions and nursing; where the findings centre around the therapeutic relationship.

DISCUSSION

This review highlights there is a paucity of direct evidence relating to nursing involvement in the facilitation of telehealth interventions. However, there are benefits to the use of telehealth interventions that include increased access to services, less perceived stigma and increased engagement which are relevant to nursing practice. A lack of individual contact and concerns relating to infrastructure indicates a fondness for face-to-face interventions remains high.

IMPLICATIONS FOR PRACTICE

There is a need for further research on the role of the nurse in the facilitation of telehealth interventions, specific interventions used and outcomes of such interventions.

Determinants of Telehealth Technologies in a Rural Population

Background: Telehealth's applicability may be limited for vulnerable populations including rural communities. While broadband access is a known barrier to telehealth use, other factors may influence a person's ability or preference to use telehealth. Objective/Purpose: To compare characteristics of telehealth users versus nontelehealth users in a rural health care network. Methods: We surveyed a stratified random sample of 500 adult patients in August 2021 about telehealth use. We used descriptive statistics to compare characteristics of telehealth users with nontelehealth users. Telehealth was defined in three different ways as follows: (1) phone or video visit, (2) video visit, and (3) patient portal use. Results: Mean age of the 206 respondents was 60 years, 60.7% were female, 60.4% had some college education; 84.9% had home internet, and 73.3% used the internet independently. Video telehealth use was independently associated with younger age (<65), having some college education, being married/partnered, and being enrolled in Medicaid. When telehealth included a phone option, disability was positively associated with telehealth use, and living in a rural town versus metropolitan/micropolitan area was negatively associated with telehealth use. Being younger, married/partnered, and having some college education were significantly associated with patient portal use. Conclusion: Videoconferencing and patient portal use pose barriers to those who are older and have less education. However, these barriers disappear when telehealth is available through telephone.

Cancer survivors with sub-optimal patient-centered communication before and during the early COVID-19 pandemic

OBJECTIVES

Patient-Centered Communication (PCC) is an essential element of patient-centered cancer care. Thus, this study aimed to examine the prevalence of and factors associated with optimal PCC among cancer survivors during COVID-19, which has been less studied.

METHODS

We used national survey (Health Information National Trends Survey) among cancer survivors (n = 2579) to calculate the prevalence (%) of optimal PCC in all 6 PCC domains and overall (mean) by time (before COVID-19, 2017-19 vs. COVID-19, 2020). Multivariable logistic regressions were performed to explore the associations of sociodemographic (age, birth gender, race/ethnicity, income, education, usual source of care), and health status (general health, depression/anxiety symptoms, time since diagnosis, cancer type) factors with optimal PCC.

RESULTS

The prevalence of optimal PCC decreased during COVID-19 overall, with the greatest decrease in managing uncertainty (7.3%). Those with no usual source of care (odd ratios, ORs =1.53-2.29), poor general health (ORs=1.40-1.66), depression/anxiety symptoms (ORs=1.73-2.17) were less likely to have optimal PCC in most domains and overall PCC.

CONCLUSIONS

We observed that the decreased prevalence of optimal PCC, and identified those with suboptimal PCC during COVID-19.

PRACTICE IMPLICATIONS

More efforts to raise awareness and improve PCC are suggested, including education and guidelines, given the decreased prevalence during this public health emergency.

Heterogeneity of the Effect of Telemedicine Hypertension Management Approach on Blood Pressure: A Systematic Review and Meta-analysis of US-based Clinical Trials

Background

Telemedicine management of hypertension (TM-HTN) uses home blood pressure (BP) to guide pharmacotherapy and telemedicine-based self-management support (SMS). Optimal approach to implementing TM-HTN in the US is unknown.

Methods

We conducted a systematic review and a meta-analysis to examine the effect of TM-HTN vs. usual clinic-based care on BP and assessed heterogeneity by patient- and clinician-related factors. We searched US-based randomized clinical trials among adults from Medline, Embase, CENTRAL, CINAHL, PsycInfo, and Compendex, Web of Science Core Collection, Scopus, and two trial registries to 7/7/2023. Two authors extracted, and a third author confirmed data. We used trial-level differences in systolic BP (SBP), diastolic BP (DBP) and BP control rate at ≥6 months using random-effects models. We examined heterogeneity of effect in univariable meta-regression and in pre-specified subgroups [clinicians leading pharmacotherapy (physician vs. non-physician), SMS (pharmacist vs. nurse), White vs. non-White patient predominant trials (>50% patients/trial), diabetes predominant trials (≥25% patients/trial) and in trials that have majority of both non-White patients and patients with diabetes vs. White patient predominant but not diabetes predominant trials.

Results

Thirteen, 11 and 7 trials were eligible for SBP, DBP and BP control, respectively. Differences in SBP, DBP and BP control rate were -7.3 mmHg (95% CI: - 9.4, -5.2), -2.7 mmHg (-4.0, -1.5) and 10.1% (0.4%, 19.9%), respectively, favoring TM-HTN. More BP reduction occurred in trials with non-physician vs. physician led pharmacotherapy (9.3/4.0 mmHg vs. 4.9/1.1 mmHg, P<0.01 for both SBP/DBP), pharmacist vs. nurses provided SMS (9.3/4.1 mmHg vs. 5.6/1.0 mmHg, P=0.01 for SBP, P<0.01 for DBP), and White vs. non-White patient predominant trials (9.3/4.0 mmHg vs. 4.4/1.1 mmHg, P<0.01 for both SBP/DBP), with no difference by diabetes predominant trials. Lower BP reduction occurred in both diabetes and non-White patient predominant trials vs. White patient predominant but not diabetes predominant trials (4.5/0.9 mmHg vs. 9.5/4.2 mmHg, P<0.01 for both SBP/DBP).

Conclusions

TM-HTN is more effective than clinic-based care in the US, particularly when non-physician led pharmacotherapy and pharmacist provided SMS. Non-White patient predominant trials seemed to achieve lesser BP reduction. Equity conscious, locally informed adaptation of TM-HTN is needed before wider implementation.

Clinical Perspective

What Is New?: In this systematic review and meta-analysis of US-based clinical trials, we found that telemedicine management of hypertension (TM-HTN) was more effective in reducing and controlling blood pressure (BP) compared with clinic based hypertension (HTN) care.The BP reduction was more evident when pharmacotherapy was led by non-physician compared with physicians and HTN self-management support was provided by clinical pharmacists compared with nurses,Non-White patient predominant trials achieved lesser BP reductions than White patient predominant trials.What Are the Clinical Implications?: Before wider implementation of TM-HTN intervention in the US, locally informed adaptation, such as optimizing the team-based HTN care approach, can provide more effective BP control.Without equity focused tailoring, TM-HTN intervention implemented as such can exacerbate inequities in BP control among non-White patients in the US.

Substance use disorder treatment and technology access among people who use drugs in rural areas of the United States: A cross-sectional survey

PURPOSE

To evaluate how technology access affected substance use disorder (SUD) treatment prior to COVID-19 for people who use drugs in rural areas.

METHODS

The Rural Opioid Initiative (January 2018-March 2020) was a cross-sectional study of people with prior 30-day injection drug or nonprescribed opioid use from rural areas of 10 states. Using multivariable mixed-effect regression models, we examined associations between participant technology access and SUD treatment.

FINDINGS

Of 3,026 participants, 71% used heroin and 76% used methamphetamine. Thirty-five percent had no cell phone and 10% had no prior 30-day internet use. Having both a cell phone and the internet was associated with increased days of medication for opioid use disorder (MOUD) use (aIRR 1.29 [95% CI 1.11-1.52]) and a higher likelihood of SUD counseling in the prior 30 days (aOR 1.28 [95% CI 1.05-1.57]). Lack of cell phone was associated with decreased days of MOUD (aIRR 0.77 [95% CI 0.66-0.91]) and a lower likelihood of prior 30-day SUD counseling (aOR 0.77 [95% CI 0.62-0.94]).

CONCLUSIONS

Expanding US rural SUD treatment engagement via telemedicine may require increased cell phone and mobile network access.

Patient Use, Experience, and Satisfaction With Telehealth in an Australian Population (Reimagining Health Care): Web-Based Survey Study

BACKGROUND

The COVID-19 pandemic triggered a rapid scale-up of telehealth services in Australia as a means to provide continued care through periods of physical restrictions. The factors that influence engagement in telehealth remain unclear.

OBJECTIVE

The purpose of this study is to understand the experience of Australian people who engaged in a telehealth consultation during the pandemic period (2020-2021) and the demographic factors that influence engagement.

METHODS

A web-based survey was distributed to Australians aged over 18 years that included 4 questions on frequency and type of clinical consultation, including with a general practitioner (GP), specialist, allied health, or nurse; 1 question on the experience of telehealth; and 2 questions on the quality of and satisfaction with telehealth. Statistical analysis included proportion of responses (of positive responses where a Likert scale was used) and regression analyses to determine the effect of demographic variables.

RESULTS

Of the 1820 participants who completed the survey, 88.3% (1607/1820) had engaged in a health care consultation of some type in the previous 12 months, and 69.3% (1114/1607) of those had used telehealth. The most common type of consultation was with a GP (959/1114, 86.1%). Older people were more likely to have had a health care consultation but less likely to have had a telehealth consultation. There was no difference in use of telehealth between metropolitan and nonmetropolitan regions; however, people with a bachelor's degree or above were more likely to have used telehealth and to report a positive experience. A total of 87% (977/1114) of participants agreed or strongly agreed that they had received the information they required from their consultation, 71% (797/1114) agreed or strongly agreed that the outcome of their consultation was the same as it would have been face-to-face, 84% (931/1114) agreed or strongly agreed that the doctor or health care provider made them feel comfortable, 83% (924/1114) agreed or strongly agreed that the doctor or health care provider was equally as knowledgeable as providers they have seen in person; 57% (629/1114) of respondents reported that they would not have been able to access their health consultation if it were not for telehealth; 69% (765/1114) of respondents reported that they were satisfied with their telehealth consultation, and 60% (671/1114) reported that they would choose to continue to use telehealth in the future.

CONCLUSIONS

There was a relatively high level of engagement with telehealth over the 12 months leading up to the study period, and the majority of participants reported a positive experience and satisfaction with their telehealth consultation. While there was no indication that remoteness influenced telehealth usage, there remains work to be done to improve access to older people and those with less than a bachelor's degree.

A National Perspective of Telemedicine Use and Direct Medical Costs: Who Uses It and How Much It Costs

BACKGROUND

Telemedicine has the potential to reduce medical costs among health systems. However, there is a limited understanding of the use of telemedicine and its association with direct medical costs.

OBJECTIVES

Using nationally representative data, we investigated telemedicine use and the associated direct medical costs among respondents overall and stratified by medical provider type and patient insurance status.

RESEARCH DESIGN, SUBJECTS, AND MEASURES

We used the 2020 Medical Expenditure Panel Survey full-year consolidated file, and outpatient department (OP) and office-based (OB) medical provider event files. Outcomes included total and out-of-pocket costs per visit for OP and OB. The primary independent variable was a binary variable indicating visits made through any telemedicine modality. We used multivariable generalized linear models and 2-part models, adjusting for types of providers and care, patient characteristics, and survey design.

RESULTS

Among total OP (n = 2938) and OB (n = 20,204) visits, 47.6% and 24.7% of visits, respectively were made through telemedicine. For OP, telemedicine visits were associated with lower total costs (average marginal effect: -$228; 95% confidence interval -$362, -$95) and out-of-pocket costs for all visits and for visits to specialists and to nurse practitioners or physicians assistants. For OB, telemedicine visits were associated with lower total costs, but not with lower out-of-pocket costs, for visits to primary care physicians or nurse practitioners or physician assistants, and for visits by Medicare patients.

CONCLUSION

Telemedicine was associated with lower direct medical costs. Its potential for cost curbing should be proactively identified and integrated into clinical practice and health policy design.

The Clinical Laboratory Is an Integral Component to Health Care Delivery : An Expanded Representation of the Total Testing Process

OBJECTIVES

Developing an expanded representation of the total testing process that includes contemporary elements of laboratory practice can be useful to understanding and optimizing testing workflows across clinical laboratory and patient care settings.

METHODS

Published literature and meeting reports were used by the coauthors to inform the development of the expanded representation of the total testing process and relevant examples describing its uses.

RESULTS

A visual representation of the total testing process was developed and contextualized to patient care scenarios using a number of examples covering the detection of blood culture contamination, use of next-generation sequencing, and pharmacogenetic testing.

CONCLUSIONS

The expanded representation of the total testing process can serve as a model and framework to document and improve the use of clinical testing within the broader context of health care delivery. This representation recognizes increased engagement among clinical laboratory professionals with patients and other health care providers as essential to making informed decisions. The increasing use of data is highlighted as important to ensuring quality, appropriate test utilization, and sustaining an efficient workflow across clinical laboratory and patient care settings. Maintaining a properly resourced and competent workforce is also featured as an essential component to the testing process.

Perceived Impact of Digital Health Maturity on Patient Experience, Population Health, Health Care Costs, and Provider Experience: Mixed Methods Case Study

BACKGROUND

Health care organizations understand the importance of new technology implementations; however, the best strategy for implementing successful digital transformations is often unclear. Digital health maturity assessments allow providers to understand the progress made toward technology-enhanced health service delivery. Existing models have been criticized for their lack of depth and breadth because of their technology focus and neglect of meaningful outcomes.

OBJECTIVE

We aimed to examine the perceived impacts of digital health reported by health care staff employed in health care organizations across a spectrum of digital health maturity.

METHODS

A mixed methods case study was conducted. The digital health maturity of public health care systems (n=16) in Queensland, Australia, was examined using the quantitative Digital Health Indicator (DHI) self-assessment survey. The lower and upper quartiles of DHI scores were calculated and used to stratify sites into 3 groups. Using qualitative methods, health care staff (n=154) participated in interviews and focus groups. Transcripts were analyzed assisted by automated text-mining software. Impacts were grouped according to the digital maturity of the health care worker's facility and mapped to the quadruple aims of health care: improved patient experience, improved population health, reduced health care cost, and enhanced provider experience.

RESULTS

DHI scores ranged between 78 and 193 for the 16 health care systems. Health care systems in the high-maturity category (n=4, 25%) had a DHI score of ≥166.75 (the upper quartile); low-maturity sites (n=4, 25%) had a DHI score of ≤116.75 (the lower quartile); and intermediate-maturity sites (n=8, 50%) had a DHI score ranging from 116.75 to 166.75 (IQR). Overall, 18 perceived impacts were identified. Generally, a greater number of positive impacts were reported in health care systems of higher digital health maturity. For patient experiences, higher maturity was associated with maintaining a patient health record and tracking patient experience data, while telehealth enabled access and flexibility across all digital health maturity categories. For population health, patient journey tracking and clinical risk mitigation were reported as positive impacts at higher-maturity sites, and telehealth enabled health care access and efficiencies across all maturity categories. Limited interoperability and organizational factors (eg, strategy, policy, and vision) were universally negative impacts affecting health service delivery. For health care costs, the resource burden of ongoing investments in digital health and a sustainable skilled workforce was reported. For provider experiences, the negative impacts of poor usability and change fatigue were universal, while network and infrastructure issues were negative impacts at low-maturity sites.

CONCLUSIONS

This is one of the first studies to show differences in the perceived impacts of digital maturity of health care systems at scale. Higher digital health maturity was associated with more positive reported impacts, most notably in achieving outcomes for the population health aim.

A Primer for Understanding and Utilizing Telesupervision with Healthcare Trainees

Clinical supervision remains a core component of healthcare education. While traditionally conducted face-to-face, the use of telesupervision, or supervision from a distance via technology, has exhibited rapid expansion across healthcare specialties. Although the literature has showcased preliminary empirical support for various methods of implementing telesupervision, limited consolidated works detail the real-world utility and considerations for healthcare supervisors. To address this gap, the current brief discussion aims to provide a primer for the use of telesupervision through a detailing of considerations relevant to telesupervisor practices, including methods of providing telesupervision, the known benefits associated with telesupervision, differences and challenges of telesupervision as compared to face-to-face methods, qualities of effective telesupervisors, and training considerations to foster the effective qualities.

Rates of Primary Care and Integrated Mental Health Telemedicine Visits Between Rural and Urban Veterans Affairs Beneficiaries Before and After the Onset of the COVID-19 Pandemic

IMPORTANCE

Telemedicine can increase access to care, but uptake has been low among people living in rural areas. The Veterans Health Administration initially encouraged telemedicine uptake in rural areas, but telemedicine expansion efforts have broadened since the COVID-19 pandemic.

OBJECTIVE

To examine changes over time in rural-urban differences in telemedicine use for primary care and for mental health integration services among Veterans Affairs (VA) beneficiaries.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study examined 63.5 million primary care and 3.6 million mental health integration visits across 138 VA health care systems nationally from March 16, 2019, to December 15, 2021. Statistical analysis took place from December 2021 to January 2023.

EXPOSURES

Health care systems with most clinic locations designated as rural.

MAIN OUTCOMES AND MEASURES

For every system, monthly visit counts for primary care and mental health integration specialties were aggregated from 12 months before to 21 months after pandemic onset. Visits were categorized as in person or telemedicine, including video. A difference-in-difference approach was used to examine associations in visit modality by health care system rurality and pandemic onset. Regression models also adjusted for health care system size as well as relevant patient characteristics (eg, demographic characteristics, comorbidities, broadband internet access, and tablet access).

RESULTS

The study included 63 541 577 primary care visits (6 313 349 unique patients) and 3 621 653 mental health integration visits (972 578 unique patients) (6 329 124 unique patients among the cohort; mean [SD] age, 61.4 [17.1] years; 5 730 747 men [90.5%]; 1 091 241 non-Hispanic Black patients [17.2%]; and 4 198 777 non-Hispanic White patients [66.3%]). In fully adjusted models for primary care services before the pandemic, rural VA health care systems had higher proportions of telemedicine use than urban ones (34% [95% CI, 30%-38%] vs 29% [95% CI, 27%-32%]) but lower proportions of telemedicine use than urban health care systems after pandemic onset (55% [95% CI, 50%-59%] vs 60% [95% CI, 58%-62%]), signifying a 36% reduction in the odds of telemedicine use (odds ratio [OR], 0.64; 95% CI, 0.54-0.76). The rural-urban telemedicine gap was even larger for mental health integration (OR, 0.49; 95% CI, 0.35-0.67) than for primary care services. Few video visits occurred across rural and urban health care systems (unadjusted percentages: before the pandemic, 2% vs 1%; after the pandemic, 4% vs 8%). Nonetheless, there were rural-urban divides for video visits in both primary care (OR, 0.28; 95% CI, 0.19-0.40) and mental health integration services (OR, 0.34; 95% CI, 0.21-0.56).

CONCLUSIONS AND RELEVANCE

This study suggests that, despite initial telemedicine gains at rural VA health care sites, the pandemic was associated with an increase in the rural-urban telemedicine divide across the VA health care system. To ensure equitable access to care, the VA health care system's coordinated telemedicine response may benefit from addressing rural disparities in structural capacity (eg, internet bandwidth) and from tailoring technology to encourage adoption among rural users.

'Without support CALD patients will be left behind': A mixed-methods exploration of culturally and linguistically diverse (CALD) client perspectives of telehealth and those of their healthcare providers

INTRODUCTION

The rapid adoption of telehealth during the global pandemic has the potential to widen disparities for culturally and linguistically diverse (CALD) consumers. We explored the perspectives and experiences of CALD consumers accessing telehealth during the global pandemic and those of their healthcare providers.

METHODS

A multistakeholder mixed-methods study involving two parallel samples comprising consumer-participants (n = 56) and healthcare provider-participants (n = 81). Multicultural consumer-participants, recruited from consecutive referrals to Health Language Services for telehealth support, were assisted to complete two surveys (before and after their clinical telehealth appointment) in their preferred language. A purposive sample of consumer-participants was interviewed to understand their perceived barriers and enablers of successful telehealth consultations. Simultaneously, all healthcare providers within the local health district were eligible to participate in an online survey if they had provided telehealth care to a consumer during the recruitment period. Closed-ended responses were descriptively summarised, while open-ended responses and interview transcripts were analysed thematically.

RESULTS

Despite 86% of consumer-participants inexperienced with telehealth, 80% achieved a successful appointment with a healthcare provider. Consumer perceptions were shaped by cultural and diagnostic concepts of legitimacy, in the context of known accessibility and technology literacy challenges. Healthcare provider perspectives were less favourable towards telehealth, with equity of healthcare delivery a major concern.

DISCUSSION

Our findings highlight unintended consequences arising from a rapid transition to telehealth. Adopting collaborative approaches to the design and implementation of telehealth is imperative to mitigate health inequities faced by CALD communities and maximise their opportunity to realise potential health benefits associated with telehealth.

The facilitators and barriers of mHealth adoption and use among people with a low socio-economic position: A scoping review

Background

Despite the fact that 95% of the global population has a mobile phone, the adoption of mHealth lags among people with a low socio-economic position (SEP). As they face health risks and many barriers in the traditional offline healthcare system, mHealth has an important role. Therefore, it is important to understand the factors that promote and impede mHealth adoption among people with a lower SEP.

Objective

The current study aims to provide an overview of what is known about the facilitators and barriers to the adoption and use of autonomous mHealth applications among people with low SEP.

Methods

A PRISMA scoping review in which the scientific databases PubMed, Web of Science, PsychInfo and SocINDEX were searched in the period of March 2017 to March 2022.

Results

Of the 1827 indexed papers, 13 papers were included in the review. In these papers, 30 factors have been identified as promoting or hindering the adoption of autonomous mHealth applications among low SEP people.

Conclusions

Thirty factors were found to facilitate or impede mHealth adoption among people with a low SEP, categorised into intrapersonal, interpersonal, community, ecological and app specific levels. Factors are assumed to be interrelated. The relationship between traditional (offline) care and digital care appeared to be of particular interest as the current study revealed that face-to-face contact is a prerequisite of mHealth adoption among people with low SEP. Therefore, a well-structured cosmopolitan system of stakeholders has been recommended.

Trial registration

This study was registered in OSF (https://doi.org/10.17605/OSF.IO/ATU9D).

Trends in telehealth use among a cohort of rural patients during the COVID-19 pandemic

Objective

Rural populations faced unique challenges to healthcare access during the COVID-19 pandemic. This analysis assesses trends in digital health technology use at the onset of the pandemic and describes digital health behaviors among a cohort of patients within a rural integrated healthcare network throughout the first 3 years of the pandemic.

Methods

We used data from both the electronic health record (EHR) and a patient survey. EHR data was used to longitudinally assess change over time in patient portal use and telehealth visits. Survey responses were used to provide additional context.

Results

Telehealth appointments peaked in the first quarter of 2020 at 28% of all office visits, before leveling off to 8-10% in 2022. Women and those younger than 65 were more likely to have participated in telehealth appointments. Active patient portal users increased from 34.1% in January 2019 to 63.7% in January 2022. There were no differences noted in portal use trends based on rurality.

Conclusions

Our findings corroborate previous research, as well as add context regarding digital health technology use throughout the COVID pandemic in a rural patient population. Future research must focus on understanding constraints to digital health expansion in order to continue providing safe, equitable care.

Patients' opinions on participation in patient-centered outcomes research in community pharmacies: A qualitative study

BACKGROUND

Patient-centered outcomes research (PCOR) often brings patient voices, thoughts, and opinions into the research process, allowing patients to have a say in the research process from project inception to dissemination of results. Community pharmacy teams are well-situated to engage patients in their own health and in research, given their trusting relationships with patients and access in communities.

OBJECTIVE

To gather patients' opinions on participation in PCOR at their local community pharmacy.

METHODS

Four regional focus groups representing western, central, northeastern, and southeastern Pennsylvania were conducted. A single community pharmacy in each region recruited patients to participate in each focus group. A focus group discussion guide was developed and reviewed by a Stakeholder Advisory Board that consisted patients, pharmacists, and researchers. Questions focused on patients' relationships with their pharmacy and pharmacist, perceptions of research occurring at their local pharmacy, and patient engagement methods. Focus group sessions were audio-recorded, transcribed verbatim, and independently coded by 2 investigators. Coding discrepancies were reconciled through discussion, and a qualitative inductive thematic analysis was conducted by the research team.

RESULTS

A total of 44 patients participated in one of 4 focus groups. Patients provided insights into what would make them more likely to participate in PCOR at their local community pharmacy. Four themes emerged from the discussions: (1) Understanding the impact to one's health or community affects participation; (2) Patients prefer to schedule research activities at times outside of prescription pick-up or drop-off; (3) Trusted relationships can be leveraged for recruitment; and (4) Face-to-face engagement is preferred for participant recruitment.

CONCLUSION

Patients want to engage in research in a way that is respectful of their time and matters to them. Strong patient-pharmacist relationships are essential for patient engagement in and acceptance of PCOR opportunities in community pharmacies. Community pharmacies may be rich locations to engage patients in PCOR.

Telemedicine in community shelters: possibilities to improve chronic care among people experiencing homelessness in Hungary

BACKGROUND

Digital health has expanded during the COVID-19 pandemic, while the exclusion of vulnerable populations with limited access to these technologies widens the gap to receive proper care. There is very little data available on the feasibility of telemedicine solutions regarding the chronic care of homeless persons.

METHODS

In our study, 75 participants experiencing homelessness were recruited from four social institutions in Budapest, Hungary. The telecare pilot service consisted of six online consultations with a physician and was available in shelters biweekly. Self-developed questionnaires were used after every online session on the originating and remote sites as well, while a follow-up study was also completed among patients after four to six months of pilot closure. Parameters as frequencies, averages, and percentage distributions were analyzed and two linear regression models were built on explaining the doctors' and patients' overall rating of visits.

RESULTS

During the pilot, 92.2% (n = 415) of originally planned visits were delivered and 55 clients (73.3%) attended the full program. Both the patients' and physicians' overall satisfaction was very high (4.52 and 4.79, respectively, on a 5-point Likert scale) and the patients' overall rating remained similarly high during the follow-up. Comparing the first and sixth visits, physicians reported significant improvements in almost all aspects. The linear regression models proved that confidence in the patients' assessment and diagnosis had the most prominent effect on the physicians' overall rating, while ease of use and lack of communication gaps influenced positively the patients' rating.

CONCLUSION

The results suggest that telehealth services represent a promising tool to ensure better care continuity while using shelter infrastructure and on-site assistance might reduce the digital exclusion of people experiencing homelessness.

Appropriate Use of Telehealth Visits in Endocrinology: Policy Perspective of the Endocrine Society

OBJECTIVE

This work aims to guide clinicians practicing endocrinology in the use of telehealth (synchronous patient-clinician visits conducted over video or telephone) for outpatient care.

PARTICIPANTS

The Endocrine Society convened a 9-member panel of US endocrinologists with expertise in telehealth clinical care, telehealth operations, patient-centered care, health care delivery research, and/or evidence-based medicine.

EVIDENCE

The panel conducted a literature search to identify studies published since 2000 about telehealth in endocrinology. One member extracted a list of factors affecting the quality of endocrine care via telehealth from the extant literature. The panel grouped these factors into 5 domains: clinical, patient, patient-clinician relationship, clinician, and health care setting and technology.

CONSENSUS PROCESS

For each domain, 2 or 3 members drew on existing literature and their expert opinions to draft a section examining the effect of the domain's component factors on the appropriateness of telehealth use within endocrine practice. Appropriateness was evaluated in the context of the 6 Institute of Medicine aims for health care quality: patient-centeredness, equity, safety, effectiveness, timeliness, and efficiency. The panel held monthly virtual meetings to discuss and revise each domain. Two members wrote the remaining sections and integrated them with the domains to create the full policy perspective, which was reviewed and revised by all members.

CONCLUSIONS

Telehealth has become a common care modality within endocrinology. This policy perspective summarizes the factors determining telehealth appropriateness in various patient care scenarios. Strategies to increase the quality of telehealth care are offered. More research is needed to develop a robust evidence base for future guideline development.

Coronavirus disease pandemic and adolescent substance use

PURPOSE OF REVIEW

Substance use is common in adolescence and has distinct developmental, cognitive, and health consequences. Over the last 2 years, the coronavirus disease 2019 pandemic has isolated adolescents, disrupted typical developmental milestones, and caused pervasive stress and anxiety. Healthcare providers can help by recognizing and addressing these effects on adolescent mental health and substance use. This update reviews the immediate effects of the pandemic on adolescent substance use, potential future implications, and opportunities to use new strategies to improve care for adolescents with problematic use.

RECENT FINDINGS

Initial findings suggest that fewer teens started using substances during the pandemic. This was likely influenced by stay at home orders that reduced opportunities for social use. However, increased time at home was not beneficial for all adolescents. Furthermore, adolescents who used substances prepandemic, experienced material hardship, or reported higher pandemic-related stress tended to intensify substance use during this time.

SUMMARY

The adverse effects of pandemic isolation, anxiety, and developmental disruption will likely have consequences for adolescent substance use for many years to come. To comprehensively address adolescent health, healthcare providers can be sensitive to these realities and use existing screening and brief intervention strategies to address use. Innovative telehealth strategies that allow for the expansion of substance use treatment offer promising opportunities to improve care for adolescents with substance use disorder.

A multi-stakeholder approach is needed to reduce the digital divide and encourage equitable access to telehealth

Since the COVID-19 pandemic onset, there has been exponential growth in the uptake of telehealth, globally. However, evidence suggests that people living in lower socioeconomic areas, cultural and linguistically diverse communities, people with disabilities, and with low health literacy are less likely to receive telehealth services. These population groups have disproportionately higher health needs and face additional barriers to healthcare access. Barriers that reduce access to telehealth further exacerbate existing gaps in care delivery. To improve equity of access to telehealth, we need to reduce the digital divide through a multi-stakeholder approach. This article proposes practical steps to reduce the digital divide and encourage equitable access to telehealth. Enabling more equitable access to telehealth requires improvements in digital health literacy, workforce training in clinical telehealth, co-design of new telehealth-enabled models of care, change management, advocacy for culturally appropriate services, and sustainable funding models.

Doctoring from home: Physicians' perspectives on the advantages of remote care delivery during the COVID-19 pandemic

Background

During the COVID-19 pandemic, stay-at-home orders as well as shortages of personal protective equipment forced primary care physicians (PCPs) to transition rapidly from in-person visits to telehealth. While telehealth expanded extensively in a short period of time, research about the consequences of the shift to remote care is lacking. The objective of this qualitative study was to examine how telehealth benefited PCPs and their patients during the COVID-19 pandemic.

Methods

From July to August 2020, semi-structured interviews were conducted with 20 PCPs associated with a single academic medical center to examine their perspectives about delivering care remotely during the COVID-19 pandemic. All interviews were recorded, transcribed verbatim, coded, and analyzed using deductive thematic analysis.

Results

PCPs identified several benefits of remote care delivery for both physicians and patients. They indicated that (1) patients were reassured that they could receive safe and timely care, (2) remote visits were convenient for patients, (3) patients were comfortable receiving care at home, and (4) video visits enhanced patient- and family-centered care during the COVID-19 pandemic. Participants also noted that (1) telehealth accommodated working from home, (2) physicians were equitably reimbursed for telehealth visits, and that (3) telehealth promoted physician work-life balance.

Conclusions

Our data provides preliminary evidence that PCPs and their patients had positive experiences with remote care during the early months of the COVID-19 pandemic. Physicians identified opportunities by which telehealth could enhance the delivery of patient-centered care by allowing them to see patients’ home environments and to engage family members and caregivers during telehealth visits. More research is needed to understand how to sustain these benefits beyond the global COVID-19 pandemic and ensure patients’ needs are met.