1
|
Reynolds TL, Cobb JG, Steitz BD, Ancker JS, Rosenbloom ST. The State-of-the-Art of Patient Portals: Adapting to External Factors, Addressing Barriers, and Innovating. Appl Clin Inform 2023; 14:654-669. [PMID: 37611795 PMCID: PMC10446914 DOI: 10.1055/s-0043-1770901] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Accepted: 05/26/2023] [Indexed: 08/25/2023] Open
Abstract
BACKGROUND AND OBJECTIVE Recent external factors-the 21st Century Cures Act and the coronavirus disease 2019 (COVID-19) pandemic-have stimulated major changes in the patient portal landscape. The objective of this state-of-the-art review is to describe recent developments in the patient portal literature and to identify recommendations and future directions for the design, implementation, and evaluation of portals. METHODS To focus this review on salient contemporary issues, we elected to center it on four topics: (1) 21st Century Cures Act's impact on patient portals (e.g., Open Notes); (2) COVID-19's pandemic impact on portals; (3) proxy access to portals; and (4) disparities in portal adoption and use. We conducted targeted PubMed searches to identify recent empirical studies addressing these topics, used a two-part screening process to determine relevance, and conducted thematic analyses. RESULTS Our search identified 174 unique papers, 74 were relevant empirical studies and included in this review. Among these papers, we identified 10 themes within our four a priori topics, including preparing for and understanding the consequences of increased patient access to their electronic health information (Cures Act); developing, deploying, and evaluating new virtual care processes (COVID-19); understanding current barriers to formal proxy use (proxy access); and addressing disparities in portal adoption and use (disparities). CONCLUSION Our results suggest that the recent trends toward understanding the implications of immediate access to most test results, exploring ways to close gaps in portal adoption and use among different sub-populations, and finding ways to leverage portals to improve health and health care are the next steps in the maturation of patient portals and are key areas that require more research. It is important that health care organizations share their innovative portal efforts, so that successful measures can be tested in other contexts, and progress can continue.
Collapse
Affiliation(s)
- Tera L. Reynolds
- Department of Information Systems, University of Maryland, Baltimore County, Baltimore, Maryland, United States
| | - Jared Guthrie Cobb
- Vanderbilt University Medical Center, Nashville, Tennessee, United States
| | - Bryan D. Steitz
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| | - Jessica S. Ancker
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| | - S. Trent Rosenbloom
- Vanderbilt University Medical Center, Nashville, Tennessee, United States
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
- Department of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, United States
- Department of Pediatrics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
| |
Collapse
|
2
|
Brands MR, Gouw SC, Beestrum M, Cronin RM, Fijnvandraat K, Badawy SM. Patient-Centered Digital Health Records and Their Effects on Health Outcomes: Systematic Review. J Med Internet Res 2022; 24:e43086. [PMID: 36548034 PMCID: PMC9816956 DOI: 10.2196/43086] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 11/14/2022] [Accepted: 11/15/2022] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND eHealth tools such as patient portals and personal health records, also known as patient-centered digital health records, can engage and empower individuals with chronic health conditions. Patients who are highly engaged in their care have improved disease knowledge, self-management skills, and clinical outcomes. OBJECTIVE We aimed to systematically review the effects of patient-centered digital health records on clinical and patient-reported outcomes, health care utilization, and satisfaction among patients with chronic conditions and to assess the feasibility and acceptability of their use. METHODS We searched MEDLINE, Cochrane, CINAHL, Embase, and PsycINFO databases between January 2000 and December 2021. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. Eligible studies were those evaluating digital health records intended for nonhospitalized adult or pediatric patients with a chronic condition. Patients with a high disease burden were a subgroup of interest. Primary outcomes included clinical and patient-reported health outcomes and health care utilization. Secondary outcomes included satisfaction, feasibility, and acceptability. Joanna Briggs Institute critical appraisal tools were used for quality assessment. Two reviewers screened titles, abstracts, and full texts. Associations between health record use and outcomes were categorized as beneficial, neutral or clinically nonrelevant, or undesired. RESULTS Of the 7716 unique publications examined, 81 (1%) met the eligibility criteria, with a total of 1,639,556 participants across all studies. The most commonly studied diseases included diabetes mellitus (37/81, 46%), cardiopulmonary conditions (21/81, 26%), and hematology-oncology conditions (14/81, 17%). One-third (24/81, 30%) of the studies were randomized controlled trials. Of the 81 studies that met the eligibility criteria, 16 (20%) were of high methodological quality. Reported outcomes varied across studies. The benefits of patient-centered digital health records were most frequently reported in the category health care utilization on the "use of recommended care services" (10/13, 77%), on the patient-reported outcomes "disease knowledge" (7/10, 70%), "patient engagement" (13/28, 56%), "treatment adherence" (10/18, 56%), and "self-management and self-efficacy" (10/19, 53%), and on the clinical outcome "laboratory parameters," including HbA1c and low-density lipoprotein (LDL; 16/33, 48%). Beneficial effects on "health-related quality of life" were seen in only 27% (4/15) of studies. Patient satisfaction (28/30, 93%), feasibility (15/19, 97%), and acceptability (23/26, 88%) were positively evaluated. More beneficial effects were reported for digital health records that predominantly focus on active features. Beneficial effects were less frequently observed among patients with a high disease burden and among high-quality studies. No unfavorable effects were observed. CONCLUSIONS The use of patient-centered digital health records in nonhospitalized individuals with chronic health conditions is potentially associated with considerable beneficial effects on health care utilization, treatment adherence, and self-management or self-efficacy. However, for firm conclusions, more studies of high methodological quality are required. TRIAL REGISTRATION PROSPERO (International Prospective Register of Systematic Reviews) CRD42020213285; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=213285.
Collapse
Affiliation(s)
- Martijn R Brands
- Department of Pediatric Hematology, Emma Children's Hospital, Amsterdam Reproduction & Development, Public Health, Amsterdam UMC location University of Amsterdam, Amsterdam, Netherlands
| | - Samantha C Gouw
- Department of Pediatric Hematology, Emma Children's Hospital, Amsterdam Reproduction & Development, Public Health, Amsterdam UMC location University of Amsterdam, Amsterdam, Netherlands
| | - Molly Beestrum
- Galter Health Sciences Library at Northwestern University, Chicago, IL, United States
| | - Robert M Cronin
- Department of Medicine, The Ohio State University, Columbus, OH, United States
| | - Karin Fijnvandraat
- Department of Pediatric Hematology, Emma Children's Hospital, Amsterdam Reproduction & Development, Public Health, Amsterdam UMC location University of Amsterdam, Amsterdam, Netherlands
- Department of Molecular Cellular Hemostasis, Sanquin Research and Landsteiner Laboratory, Amsterdam, Netherlands
| | - Sherif M Badawy
- Department of Pediatrics, Feinberg School of Medicine, Northwestern University, Chicago, IL, United States
- Division of Hematology, Oncology, and Stem Cell Transplant, Ann and Robert H Lurie Children's Hospital of Chicago, Chicago, IL, United States
| |
Collapse
|
3
|
Thompson CM, Pulido MD, Babu S, Zenzola N, Chiu C. Communication between persons with multiple sclerosis and their health care providers: A scoping review. PATIENT EDUCATION AND COUNSELING 2022; 105:3341-3368. [PMID: 35927111 DOI: 10.1016/j.pec.2022.07.013] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2022] [Revised: 06/30/2022] [Accepted: 07/19/2022] [Indexed: 06/15/2023]
Abstract
OBJECTIVES This study undertakes a scoping review of research about communication between persons with MS and their health care providers. DESIGN PubMed, PsycInfo, Communication Source, Socindex, Sociological Abstracts, Cinahl, and Proquest Dissertations and Theses were used to identify studies since each database's inception. Research team members engaged in study selection, coding for communication issues, and data extraction for descriptive information. RESULTS Of the 419 empirical articles identified, 175 were included. Codes represented all elements of ecological and pathway models, emphasizing emerging technologies for facilitating communication, uncertainty and anxiety for persons with MS, and communication issues surrounding diagnosis, information seeking, and decision making. CONCLUSION This review synthesizes and organizes influences on communication, communication processes, and health outcomes of communication for persons with MS and their providers. Findings extend the ecological model with illness context and the pathway model with communication breakdowns and provider outcomes. PRACTICE IMPLICATIONS Health care providers should consider the complexity of communication when interacting with persons with MS, including the larger context in which it occurs, communication processes and their purposes, and short-term and long-term consequences of interactions. Ecological and pathway models can be frameworks for developing educational materials, as they succinctly capture key communication issues and outcomes.
Collapse
Affiliation(s)
- Charee M Thompson
- Department of Communication, University of Illinois, Urbana-Champaign, Urbana, USA.
| | - Manuel D Pulido
- Department of Communication, University of Illinois, Urbana-Champaign, Urbana, USA
| | - Sara Babu
- Department of Communication, University of Illinois, Urbana-Champaign, Urbana, USA
| | - Nicole Zenzola
- Department of Communication, University of Illinois, Urbana-Champaign, Urbana, USA
| | - Chungyi Chiu
- Department of Kinesiology and Community Health, University of Illinois, Urbana-Champaign, Urbana, USA
| |
Collapse
|
4
|
Spreadbury JH, Young A, Kipps CM. A Comprehensive Literature Search of Digital Health Technology Use in Neurological Conditions: Review of Digital Tools to Promote Self-management and Support. J Med Internet Res 2022; 24:e31929. [PMID: 35900822 PMCID: PMC9377435 DOI: 10.2196/31929] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2021] [Revised: 03/13/2022] [Accepted: 05/19/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND The use of digital health technology to promote and deliver postdiagnostic care in neurological conditions is becoming increasingly common. However, the range of digital tools available across different neurological conditions and how they facilitate self-management are unclear. OBJECTIVE This review aims to identify digital tools that promote self-management in neurological conditions and to investigate their underlying functionality and salient clinical outcomes. METHODS We conducted a search of 6 databases (ie, CINAHL, EMBASE, MEDLINE, PsycINFO, Web of Science, and the Cochrane Review) using free text and equivalent database-controlled vocabulary terms. RESULTS We identified 27 published articles reporting 17 self-management digital tools. Multiple sclerosis (MS) had the highest number of digital tools followed by epilepsy, stroke, and headache and migraine with a similar number, and then pain. The majority were aimed at patients with a minority for carers. There were 5 broad categories of functionality promoting self-management: (1) knowledge and understanding; (2) behavior modification; (3) self-management support; (4) facilitating communication; and (5) recording condition characteristics. Salient clinical outcomes included improvements in self-management, self-efficacy, coping, depression, and fatigue. CONCLUSIONS There now exist numerous digital tools to support user self-management, yet relatively few are described in the literature. More research is needed to investigate their use, effectiveness, and sustainability, as well as how this interacts with increasing disability, and their integration within formal neurological care environments.
Collapse
Affiliation(s)
- John Henry Spreadbury
- Faculty of Medicine, University of Southampton, University Hospital Southampton NHS Foundation Trust, Southampton, United Kingdom.,Clinical Experimental Sciences, Faculty of Medicine, University of Southampton, Southampton, United Kingdom
| | - Alex Young
- Clinical Experimental Sciences, Faculty of Medicine, University of Southampton, Southampton, United Kingdom
| | - Christopher Myles Kipps
- Clinical Experimental Sciences, Faculty of Medicine, University of Southampton, Southampton, United Kingdom.,Wessex Neurological Centre, University Hospital Southampton NHS Foundation Trust, Southampton, United Kingdom
| |
Collapse
|
5
|
Bevens W, Weiland TJ, Gray K, Neate SL, Nag N, Simpson-Yap S, Reece J, Yu M, Jelinek GA. The Feasibility of a Web-Based Educational Lifestyle Program for People With Multiple Sclerosis: A Randomized Controlled Trial. Front Public Health 2022; 10:852214. [PMID: 35570898 PMCID: PMC9092338 DOI: 10.3389/fpubh.2022.852214] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Accepted: 04/06/2022] [Indexed: 12/21/2022] Open
Abstract
Background Modifiable lifestyle factors are important to aid people with multiple sclerosis in the self-management of their disease. Current self-management programs are limited by their face-to-face mode of delivery but there is immense potential with the internet to deliver these programs effectively. Objective The aims of this study are to assess the feasibility of a digitalized educational lifestyle self-management program for people with MS. Methods In this randomized controlled trial, people with MS were randomly allocated to participate in a 6-week tailored web-based educational lifestyle program or 6-week generic standard-care educational course, and were blinded to their allocation. Participants were recruited through multiple sclerosis (MS) Societies in four countries: Australia, New Zealand, Canada, and the United States. The primary outcome was to assess acceptability of the program defined as percentage completion of all modules at 6-weeks post-course commencement. Secondary outcomes included evaluating participant responses to the follow-up survey across three domains: accessibility, learnability, and desirability. Results Thirty-five participants from Australia, Canada, New Zealand, and the US completed the baseline survey and were randomized. Four participants were deemed ineligible due to incomplete baseline data; therefore, nine out of 15 and eight out of 16 participants completed 100% of the course in the intervention and standard-care arm courses, respectively. Conclusions This study found that this web-based educational lifestyle program is a feasible means of delivering educational content to people with MS via the internet according to our a priori targets of >40% of participants in the intervention arm, and >25% in the control arm to completing 100% of the course. It is therefore appropriate to evaluate this intervention further in a large, randomized controlled trial. Trial registration This study was prospectively registered with the Australian New Zealand Clinical Trials Registry (ID: ACTRN12621000245897).
Collapse
Affiliation(s)
- William Bevens
- Neuroepidemiology Unit, Melbourne School of Population and Global Health, The University of Melbourne, Carlton, VIC, Australia
| | - Tracey J Weiland
- Neuroepidemiology Unit, Melbourne School of Population and Global Health, The University of Melbourne, Carlton, VIC, Australia
| | - Kathleen Gray
- Centre for Digital Transformation of Health, The University of Melbourne, Parkville, VIC, Australia
| | - Sandra L Neate
- Neuroepidemiology Unit, Melbourne School of Population and Global Health, The University of Melbourne, Carlton, VIC, Australia
| | - Nupur Nag
- Neuroepidemiology Unit, Melbourne School of Population and Global Health, The University of Melbourne, Carlton, VIC, Australia
| | - Steve Simpson-Yap
- Neuroepidemiology Unit, Melbourne School of Population and Global Health, The University of Melbourne, Carlton, VIC, Australia.,Menzies Institute for Medical Research, University of Tasmania, Hobart, TAS, Australia
| | - Jeanette Reece
- Neuroepidemiology Unit, Melbourne School of Population and Global Health, The University of Melbourne, Carlton, VIC, Australia
| | - Maggie Yu
- Neuroepidemiology Unit, Melbourne School of Population and Global Health, The University of Melbourne, Carlton, VIC, Australia
| | - George A Jelinek
- Neuroepidemiology Unit, Melbourne School of Population and Global Health, The University of Melbourne, Carlton, VIC, Australia
| |
Collapse
|
6
|
Khalil N, Aungst A, Casady L, Allison K, Fiascki R, Curbelo C, Maldonado J, Robertson D. Multiple Sclerosis and MyChart Messaging: A Retrospective Chart Review Evaluating Its Use. Int J MS Care 2022; 24:271-274. [PMID: 36545652 PMCID: PMC9749828 DOI: 10.7224/1537-2073.2020-101] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
BACKGROUND Understanding patterns of MyChart (Epic Systems Corporation) messaging has the potential to alter clinical practice. However, because most research evaluating its use has been conducted in limited contexts, utilization patterns in patients with multiple sclerosis (MS) remain unclear. We characterized factors associated with high rates of MyChart messaging for patients with MS at an academic outpatient clinic. METHODS We performed a retrospective cross-sectional analysis of 439 patients in our center's database. Inclusion criteria were 1 or more clinic visits and MS diagnosis. We extracted demographic data, disease-specific characteristics, and MyChart messaging information. RESULTS Of the patients in the database, 324 (74%) were MyChart users. MyChart users were more often younger (mean ± SD age, 50.1 ± 12.6 vs 55.0 ± 13.7 years; P < .001), had shorter mean ± SD duration since diagnosis (11.9 ± 8.3 vs 15.8 ± 10.8 years; P = .0013), had lower mean ± SD Patient-Determined Disease Steps scale scores (2.8 ± 2.3 vs 3.5 ± 2.5; P = .0107), and were more likely to be using high-efficacy disease-modifying therapies (χ2 1,323 = 6.7; P = .009). Messaging rates correlated positively with total number of unique medications (R = 0.17; P = .003) and negatively with age (R = -0.11; P = .018). CONCLUSIONS Although previous research has implicated arm-hand disability and impaired vision as barriers to patient portal use, these findings suggest the relationship between MS-specific disease burden and MyChart utilization is also a function of underlying medical complexity beyond physical disability. These data may serve as groundwork for investigations in other disease-specific settings and for quality improvement research to mitigate these high rates in at-risk patients to optimize provider time investment, clinic productivity, and patient safety and minimize health care provider burnout.
Collapse
Affiliation(s)
- Nadia Khalil
- From the Department of Neurology, Morsani College of Medicine, University of South Florida, Tampa, FL, USA (NK, AA, LC, KA, RF, CC, JM, DR)
| | - Angela Aungst
- From the Department of Neurology, Morsani College of Medicine, University of South Florida, Tampa, FL, USA (NK, AA, LC, KA, RF, CC, JM, DR)
| | - Lise Casady
- From the Department of Neurology, Morsani College of Medicine, University of South Florida, Tampa, FL, USA (NK, AA, LC, KA, RF, CC, JM, DR)
| | - Kevin Allison
- From the Department of Neurology, Morsani College of Medicine, University of South Florida, Tampa, FL, USA (NK, AA, LC, KA, RF, CC, JM, DR)
| | - Ryann Fiascki
- From the Department of Neurology, Morsani College of Medicine, University of South Florida, Tampa, FL, USA (NK, AA, LC, KA, RF, CC, JM, DR)
| | - Christian Curbelo
- From the Department of Neurology, Morsani College of Medicine, University of South Florida, Tampa, FL, USA (NK, AA, LC, KA, RF, CC, JM, DR)
| | - Janice Maldonado
- From the Department of Neurology, Morsani College of Medicine, University of South Florida, Tampa, FL, USA (NK, AA, LC, KA, RF, CC, JM, DR)
| | - Derrick Robertson
- From the Department of Neurology, Morsani College of Medicine, University of South Florida, Tampa, FL, USA (NK, AA, LC, KA, RF, CC, JM, DR)
| |
Collapse
|
7
|
Cloosterman S, Wijnands I, Huygens S, Wester V, Lam KH, Strijbis E, den Teuling B, Versteegh M. The Potential Impact of Digital Biomarkers in Multiple Sclerosis in The Netherlands: An Early Health Technology Assessment of MS Sherpa. Brain Sci 2021; 11:1305. [PMID: 34679370 PMCID: PMC8534078 DOI: 10.3390/brainsci11101305] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Revised: 09/22/2021] [Accepted: 09/26/2021] [Indexed: 11/16/2022] Open
Abstract
(1) Background: Monitoring of Multiple Sclerosis (MS) with eHealth interventions or digital biomarkers provides added value to the current care path. Evidence in the literature is currently scarce. MS sherpa is an eHealth intervention with digital biomarkers, aimed at monitoring symptom progression and disease activity. To show the added value of digital biomarker-based eHealth interventions to the MS care path, an early Health Technology Assessment (eHTA) was performed, with MS sherpa as an example, to assess the potential impact on treatment switches. (2) Methods: The eHTA was performed according to the Dutch guidelines for health economic evaluations. A decision analytic MS model was used to estimate the costs and benefits of MS standard care with and without use of MS sherpa, expressed in incremental cost-effectiveness ratios (ICERs) from both societal and health care perspectives. The efficacy of MS sherpa on early detection of active disease and the initiation of a treatment switch were modeled for a range of assumed efficacy (5%, 10%, 15%, 20%). (3) Results: From a societal perspective, for the efficacy of 15% or 20%, MS sherpa became dominant, which means cost-saving compared to the standard of care. MS sherpa is cost-effective in the 5% and 10% scenarios (ICERs EUR 14,535 and EUR 4069, respectively). From the health care perspective, all scenarios were cost-effective. Sensitivity analysis showed that increasing the efficacy of MS sherpa in detecting active disease early leading to treatment switches be the most impactful factor in the MS model. (4) Conclusions: The results indicate the potential of eHealth interventions to be cost-effective or even cost-saving in the MS care path. As such, digital biomarker-based eHealth interventions, like MS sherpa, are promising cost-effective solutions in optimizing MS disease management for people with MS, by detecting active disease early and helping neurologists in decisions on treatment switch.
Collapse
Affiliation(s)
- Sonja Cloosterman
- Orikami Digital Health Products, Ridderstraat 29, 6511 TM Nijmegen, The Netherlands; (I.W.); (B.d.T.)
| | - Inez Wijnands
- Orikami Digital Health Products, Ridderstraat 29, 6511 TM Nijmegen, The Netherlands; (I.W.); (B.d.T.)
| | - Simone Huygens
- Institute for Medical Technology Assessment (iMTA), Erasmus University of Rotterdam, Burgemeester Oudlaan 50, 3062 PA Rotterdam, The Netherlands; (S.H.); (V.W.); (M.V.)
| | - Valérie Wester
- Institute for Medical Technology Assessment (iMTA), Erasmus University of Rotterdam, Burgemeester Oudlaan 50, 3062 PA Rotterdam, The Netherlands; (S.H.); (V.W.); (M.V.)
- Erasmus School for Health Policy & Management, Erasmus University of Rotterdam, Burgemeester Oudlaan 50, 3062 PA Rotterdam, The Netherlands
| | - Ka-Hoo Lam
- Department of Neurology, MS Center Amsterdam, Amsterdam University Medical Centers, Location VUmc, De Boelelaan, 1117 HV Amsterdam, The Netherlands; (K.-H.L.); (E.S.)
| | - Eva Strijbis
- Department of Neurology, MS Center Amsterdam, Amsterdam University Medical Centers, Location VUmc, De Boelelaan, 1117 HV Amsterdam, The Netherlands; (K.-H.L.); (E.S.)
| | - Bram den Teuling
- Orikami Digital Health Products, Ridderstraat 29, 6511 TM Nijmegen, The Netherlands; (I.W.); (B.d.T.)
| | - Matthijs Versteegh
- Institute for Medical Technology Assessment (iMTA), Erasmus University of Rotterdam, Burgemeester Oudlaan 50, 3062 PA Rotterdam, The Netherlands; (S.H.); (V.W.); (M.V.)
| |
Collapse
|
8
|
Haase R, Voigt I, Scholz M, Schlieter H, Benedict M, Susky M, Dillenseger A, Ziemssen T. Profiles of eHealth Adoption in Persons with Multiple Sclerosis and Their Caregivers. Brain Sci 2021; 11:brainsci11081087. [PMID: 34439706 PMCID: PMC8392753 DOI: 10.3390/brainsci11081087] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 08/07/2021] [Accepted: 08/16/2021] [Indexed: 01/03/2023] Open
Abstract
(1) Background: Persons with multiple sclerosis (pwMS) are often characterized as ideal adopters of new digital healthcare trends, but it is worth thinking about whether and which pwMS will be targeted and served by a particular eHealth service like a patient portal. With our study, we wanted to explore needs and barriers for subgroups of pwMS and their caregivers when interacting with eHealth services in care and daily living. (2) Methods: This study comprises results from two surveys: one collecting data from pwMS and their relatives (as informal caregivers) and another one providing information on the opinions and attitudes of healthcare professionals (HCPs). Data were analyzed descriptively and via generalized linear models. (3) Results: 185 pwMS, 25 informal caregivers, and 24 HCPs in the field of MS participated. Nine out of ten pwMS used information technology on a daily base. Individual impairments like in vision and cognition resulted in individual needs like the desire to actively monitor their disease course or communicate with their physician in person. HCPs reported that a complete medication overview, additional medication information, overview of future visits and a reminder of medication intake would be very helpful eHealth features for pwMS, while they themselves preferred features organizing and enriching future visits. (4) Conclusions: A closer look at the various profiles of eHealth adoption in pwMS and their caregivers indicated that there is a broad and robust enthusiasm across several subgroups that does not exclude anyone in general, but constitutes specific areas of interest. For pwMS, the focus was on eHealth services that connect previously collected information and make them easily accessible and understandable.
Collapse
Affiliation(s)
- Rocco Haase
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
- Correspondence:
| | - Isabel Voigt
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
| | - Maria Scholz
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
| | - Hannes Schlieter
- Faculty of Business and Economics, Technical University of Dresden, 01062 Dresden, Germany; (H.S.); (M.B.); (M.S.)
| | - Martin Benedict
- Faculty of Business and Economics, Technical University of Dresden, 01062 Dresden, Germany; (H.S.); (M.B.); (M.S.)
| | - Marcel Susky
- Faculty of Business and Economics, Technical University of Dresden, 01062 Dresden, Germany; (H.S.); (M.B.); (M.S.)
| | - Anja Dillenseger
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
| | - Tjalf Ziemssen
- Center of Clinical Neuroscience, Department of Neurology, University Hospital Carl Gustav Carus, Technical University of Dresden, 01307 Dresden, Germany; (I.V.); (M.S.); (A.D.); (T.Z.)
| |
Collapse
|
9
|
Rahn AC, Riemann-Lorenz K, Alegiani A, Pust GEA, van de Roemer A, Schmitz L, Vettorazzi E, Köpke S, Heesen C. Comprehension of confidence intervals in audio-visual patient information materials for people with multiple sclerosis (COCO-MS): A web-based randomised controlled, parallel group trial. PATIENT EDUCATION AND COUNSELING 2021; 104:1132-1139. [PMID: 33054984 DOI: 10.1016/j.pec.2020.09.035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Revised: 09/22/2020] [Accepted: 09/23/2020] [Indexed: 06/11/2023]
Abstract
OBJECTIVES To evaluate patient information materials on confidence intervals (CIs) in multiple sclerosis to be used with patient decision aids. METHODS Web-based randomised controlled parallel group trial with four study arms. Participants were equally allocated to one of three versions of audio-visual patient information or to a standard written information (arm IV). In the short version (arm III), CIs were explained without using an example, in the other two versions examples were used (arm I and arm II). The examples are based on an apple farmer who wants to estimate the average weight of his apples (arm I) and to test a treatment against worms (arm II). Primary endpoint was comprehension of CIs, assessed with a six-item multiple-choice questionnaire. RESULTS 855 of 1068 (80 %) randomised participants completed the survey (71 % arm I, 73 % arm II, 87 % arm III, 90 % arm IV). The median of correctly answered questions on CIs was 4 out of 6 questions in arms I and II and 5 out of 6 questions in arm III. Compared to the standard information (arm IV), all the other arms scored better on the comprehension questionnaire (ANOVA, p ≤ 0.003). CONCLUSIONS Information about CIs can be presented comprehensibly. High scores and a high rate of completers indicate that the short version is the favourable one. PRACTICE IMPLICATIONS Information materials on CIs should be used alongside absolute risk reductions in patient decision aids to enhance the interpretation of study results.
Collapse
Affiliation(s)
- Anne C Rahn
- Institute of Neuroimmunology and Multiple Sclerosis (INIMS), University Medical Center Hamburg-Eppendorf, Hamburg, Germany; Department of Health Services Research, Carl von Ossietzky University Oldenburg, Oldenburg, Germany.
| | - Karin Riemann-Lorenz
- Institute of Neuroimmunology and Multiple Sclerosis (INIMS), University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Anna Alegiani
- Department of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Gesa E A Pust
- Institute of Neuroimmunology and Multiple Sclerosis (INIMS), University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | | | - Leonie Schmitz
- Department of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Eik Vettorazzi
- Department of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Sascha Köpke
- Institute of Nursing Science, University of Cologne, Cologne, Germany
| | - Christoph Heesen
- Institute of Neuroimmunology and Multiple Sclerosis (INIMS), University Medical Center Hamburg-Eppendorf, Hamburg, Germany; Department of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
10
|
Martini M, Bragazzi NL. Googling for Neurological Disorders: From Seeking Health-Related Information to Patient Empowerment, Advocacy, and Open, Public Self-Disclosure in the Neurology 2.0 Era. J Med Internet Res 2021; 23:e13999. [PMID: 30946019 PMCID: PMC8088864 DOI: 10.2196/13999] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Revised: 04/04/2019] [Accepted: 04/04/2019] [Indexed: 02/06/2023] Open
Abstract
Since its introduction, the internet has played a major role in reshaping patient-physician communication and interactions, having fostered a shift from a paternalistic to a patient-centered model. Because of its dynamic nature, the internet has been used as a platform to not only disseminate knowledge—favored by improved access to an increasing wealth of available resources—but also to spread advocacy and awareness, contribute to fund-raising, and facilitate open, public self-disclosure of one’s own disease, thus eliminating any taboo and reducing the stigma associated with it. The era of Medicine 2.0 is characterized by openness, collaboration, participation, and social networking. The current situation is completely different from the time when Lorenzo Odone’s parents, after his diagnosis of adrenoleukodystrophy, decided to attend medical school in order to collect information about a devastating, unknown disease and had to contend with medical authorities at that establishment to convince them of the alleged effectiveness and safety of their discovered therapeutics. Orphan and rare neurological diseases have currently received recognition on web-based resources. However, while the intention is not to ridicule Odone’s family legacy and the “complicated lessons” they have reported, some issues should be carefully addressed by health authorities, such as the reputability, reliability, and accuracy of material available on the internet and prevention of the dissemination of material that could instill illusions and unjustified hopes in individuals seeking medical treatment. Neurologists should be aware of such digital resources, participate in web-based activities, and recommend select high-quality websites to their patients.
Collapse
Affiliation(s)
- Mariano Martini
- Department of Health Sciences, School of Public Health, University of Genoa, Genoa, Italy
| | - Nicola Luigi Bragazzi
- Department of Health Sciences, School of Public Health, University of Genoa, Genoa, Italy.,Laboratory for Industrial and Applied Mathematics, Department of Mathematics and Statistics, York University, Toronto, ON, Canada
| |
Collapse
|
11
|
Development and evaluation of an interactive web-based decision-making programme on relapse management for people with multiple sclerosis (POWER@MS2)-study protocol for a randomised controlled trial. Trials 2021; 22:139. [PMID: 33583424 PMCID: PMC7882468 DOI: 10.1186/s13063-021-05059-1] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Accepted: 01/20/2021] [Indexed: 11/26/2022] Open
Abstract
Introduction Multiple sclerosis is a chronic inflammatory, degenerative disease of the central nervous system manifesting at first with relapses in about 85% of cases. In Germany, intravenous therapy with high-dose corticosteroids is the treatment standard of acute relapses. The treatment leads to a faster reduction of symptoms in about 25 of 100 treated patients but has no proven long-term benefits over placebo treatment. Intravenous treatment is not superior to oral treatment. Therefore, informed decisions on relapse management are required. An earlier randomised controlled trial showed that evidence-based patient information and education on relapse management leads to more informed decisions and more relapses not treated or treated with oral corticosteroids. This study aims to evaluate whether a web-based relapse management programme will positively change relapse management and strengthen autonomy in people with multiple sclerosis. Methods The pragmatic double-blind randomised controlled trial is accompanied by a mixed-methods process evaluation and a health economic evaluation and follows the UK Medical Research Council guidance on developing and evaluating complex interventions. A total of 188 people with possible or relapsing-remitting multiple sclerosis with ≥ 1 relapse within the last year and/or ≥ 2 relapses within the last 2 years will be recruited and randomised using blocks. The intervention group receives a web- and dialogue-based decision aid on relapse management, a nurse-led webinar and access to a monitored chat forum. The control group receives standard information, which will be made available via the same online platform as the intervention. The primary endpoint is the proportion of relapses not treated or treated with oral corticosteroids. Key secondary endpoints are the annualised relapse rate, decision-making, empowerment, quality of life and cost-effectiveness. Facilitators and barriers will be assessed by mixed-methods process evaluation measures. The study ends when 81 relapses have been documented or after 24 months of observation per individual patient. Analyses will follow the intention-to-treat principle. Discussion We hypothesise that the intervention will enhance patient empowerment and have a positive impact on patients’ relapse management. Trial registration ClinicalTrials.govNCT04233970. Registered on 18 January 2020
Collapse
|
12
|
Electronic Health Interventions in the Case of Multiple Sclerosis: From Theory to Practice. Brain Sci 2021; 11:brainsci11020180. [PMID: 33540640 PMCID: PMC7913051 DOI: 10.3390/brainsci11020180] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 01/26/2021] [Accepted: 01/28/2021] [Indexed: 02/06/2023] Open
Abstract
(1) Background: eHealth interventions play a growing role in shaping the future healthcare system. The integration of eHealth interventions can enhance the efficiency and quality of patient management and optimize the course of treatment for chronically ill patients. In this integrative review, we discuss different types of interventions, standards and advantages of quality eHealth approaches especially for people with multiple sclerosis (pwMS). (2) Methods: The electronic databases PubMed, Cochrane and Web of Science were searched to identify potential articles for eHealth interventions in pwMS; based on 62 articles, we consider different ways of implementing health information technology with various designs. (3) Results: There already exist some eHealth interventions for single users with a single-use case, interventions with a social setting, as well as eHealth interventions that integrate various single and social interventions and even those that may be used additionally for complex use cases. A key determinant of consumer acceptance is a high-quality user-centric design for healthcare practitioners and pwMS. In pwMS, the different neurological disabilities should be considered, and particular attention must be paid to the course of the treatment and the safety processes of each treatment option. (4) Conclusion: Depending on the field of application and the respective users, interventions are designed for single, social, integrated or complex use. In order to be accepted by their target group, interventions must be beneficial and easy to use.
Collapse
|
13
|
Niazkhani Z, Toni E, Cheshmekaboodi M, Georgiou A, Pirnejad H. Barriers to patient, provider, and caregiver adoption and use of electronic personal health records in chronic care: a systematic review. BMC Med Inform Decis Mak 2020; 20:153. [PMID: 32641128 PMCID: PMC7341472 DOI: 10.1186/s12911-020-01159-1] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2020] [Accepted: 06/22/2020] [Indexed: 11/21/2022] Open
Abstract
Background Electronic personal health records (ePHRs) are defined as electronic applications through which individuals can access, manage, and share health information in a private, secure, and confidential environment. Existing evidence shows their benefits in improving outcomes, especially for chronic disease patients. However, their use has not been as widespread as expected partly due to barriers faced in their adoption and use. We aimed to identify the types of barriers to a patient, provider, and caregiver adoption/use of ePHRs and to analyze their extent in chronic disease care. Methods A systematic search in Medline, PubMed, Science Direct, Cumulative Index to Nursing and Allied Health Literature (CINAHL), the Cochrane Central Register of Controlled Trials, and the Institute of Electrical and Electronics Engineers (IEEE) database was performed to find original studies assessing barriers to ePHR adoption/use in chronic care until the end of 2018. Two researchers independently screened and extracted data. We used the PHR adoption model and the Unified Theory of Acceptance and Use of Technology to analyze the results. The Mixed Methods Appraisal Tool (MMAT) version 2018 was used to assess the quality of evidence in the included studies. Results Sixty publications met our inclusion criteria. Issues found hindering ePHR adoption/use in chronic disease care were associated with demographic factors (e.g., patient age and gender) along with key variables related to health status, computer literacy, preferences for direct communication, and patient’s strategy for coping with a chronic condition; as well as factors related to medical practice/environment (e.g., providers’ lack of interest or resistance to adopting ePHRs due to workload, lack of reimbursement, and lack of user training); technological (e.g., concerns over privacy and security, interoperability with electronic health record systems, and lack of customized features for chronic conditions); and chronic disease characteristics (e.g., multiplicities of co-morbid conditions, settings, and providers involved in chronic care). Conclusions ePHRs can be meaningfully used in chronic disease care if they are implemented as a component of comprehensive care models specifically developed for this care. Our results provide insight into hurdles and barriers mitigating ePHR adoption/use in chronic disease care. A deeper understating of the interplay between these barriers will provide opportunities that can lead to an enhanced ePHR adoption/use.
Collapse
Affiliation(s)
- Zahra Niazkhani
- Nephrology and Kidney Transplant Research Center, Urmia University of Medical Sciences, Urmia, Iran.,Department of Health Information Technology, Urmia University of Medical Sciences, Urmia, Iran
| | - Esmaeel Toni
- Department of Health Information Technology, Urmia University of Medical Sciences, Urmia, Iran.,Student Research Committee, Urmia University of Medical Sciences, Urmia, Iran
| | - Mojgan Cheshmekaboodi
- Office for Disease Registry and Health Outcomes, Urmia University of Medical Sciences, Urmia, Iran
| | - Andrew Georgiou
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Habibollah Pirnejad
- Department of Health Information Technology, Urmia University of Medical Sciences, Urmia, Iran. .,Patient Safety Research Center, Urmia University of Medical Sciences, Urmia, Iran. .,Erasmus School of Health Policy & Management (ESHPM), Erasmus University Rotterdam, Rotterdam, The Netherlands.
| |
Collapse
|
14
|
O'Donnell JM, Jelinek GA, Gray KM, De Livera A, Brown CR, Neate SL, O'Kearney EL, Taylor KL, Bevens W, Weiland TJ. Therapeutic utilization of meditation resources by people with multiple sclerosis: insights from an online patient discussion forum. Inform Health Soc Care 2020; 45:374-384. [PMID: 32508186 DOI: 10.1080/17538157.2020.1755975] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
We aimed to describe website traffic and qualitatively analyze an e-health community discussion forum. Participants in this study were people affected by multiple sclerosis visiting the Overcoming Multiple Sclerosis (OMS) website. This mixed methods study combined descriptive analysis of website traffic over 7 years and 1 month, and qualitative analysis of 1 week of posts in the meditation topic, coded into theme groups using qualitative thematic analysis. There were 166 meditation topics posted with 21,530 initial views of primary post and 785 sub-post responses. Meditation posts and sub-posts received 368,713 replies. Number of views increased from 4,684 in 2011 to over 80,000 in 2017, a considerably greater rate of increase than overall traffic. Qualitative analysis of posts on the meditation forum identified themes of barriers and enablers to utilization of meditation resources. Enablement themes dominated, observed across six of the seven theme groups with various forms of positive social and emotional support to learn and practice meditation. One theme, negative emotion, was identified as a barrier. The OMS peer-to-peer patient online discussion forum serves important functions in encouraging, educating and enabling its growing online community. Our analysis may help improve and innovate online support for lifestyle management in many chronic diseases.
Collapse
Affiliation(s)
- Jodi Millicent O'Donnell
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia.,School of Allied Health, Australian Catholic University , Fitzroy, Australia
| | - George Alexander Jelinek
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia
| | - Kathleen Mary Gray
- Health and Biomedical Informatics Centre, The University of Melbourne , Carlton, Australia
| | - Alysha De Livera
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia
| | - Chelsea Rae Brown
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia
| | - Sandra Leanne Neate
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia
| | - Emily Louise O'Kearney
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia
| | - Keryn Louise Taylor
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia
| | - William Bevens
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia
| | - Tracey Joy Weiland
- Neuroepidemiology Unit (NEU), Melbourne School of Population and Global Health, The University of Melbourne , Carlton, Australia
| |
Collapse
|
15
|
Gasteiger N, Fleming T, Day K. Converging perspectives of providers and student users on extending a patient portal into a university-based mental health service: A qualitative study. Internet Interv 2020; 19:100304. [PMID: 31993336 PMCID: PMC6976866 DOI: 10.1016/j.invent.2020.100304] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/17/2019] [Revised: 09/20/2019] [Accepted: 01/06/2020] [Indexed: 11/20/2022] Open
Abstract
BACKGROUND Patient portals have the potential to increase access to mental health services. However, a lack of research is available to guide practices on extending patient portals into mental health services. This study explored stakeholder (student service users' and health providers') expectations and perceptions of extending patient portals into a New Zealand university-based mental health service. MATERIALS AND METHODS This qualitative study explored the perspectives of 17 students and staff members at a university-based health and counselling service on an Internet-based patient portal through a software demonstration, two focus groups and 13 interviews. Data were analyzed thematically. RESULTS Staff and students perceived the patient portal as useful, easy to use and expected it to help make mental health care more accessible. Staff were most concerned with the portal's ability to support their triage processes and that it might enable students to 'counselor hop' (see multiple counselors). Staff recommended extension into services that do not require triage. Most students expected the portal to enhance patient-counselor contact and rapport, through continuity of care. Students were concerned with appointment waiting times, the stigmatization of poor mental health and their capacity to seek help. They considered the portal might assist with this. Students recommended extension into all services, including urgent appointments. After viewing findings from initial student and staff groups, staff concluded that extending a patient portal into their counseling services should be prioritized. CONCLUSION This research suggests that there is value in extending patient portals into mental health care, especially into low-risk services. Future research should explore opportunities to support triage and appointment-making processes for mental health services, via patient portals.
Collapse
Affiliation(s)
- Norina Gasteiger
- School of Population Health, Faculty of Medical and Health Sciences, University of Auckland, New Zealand
| | - Theresa Fleming
- School of Health, Victoria University of Wellington, Wellington, New Zealand
| | - Karen Day
- School of Population Health, Faculty of Medical and Health Sciences, University of Auckland, New Zealand
| |
Collapse
|
16
|
Karnoe A, Kayser L, Skovgaard L. Identification of Factors That Motivate People With Multiple Sclerosis to Participate in Digital Data Collection in Research: Sequential Mixed Methods Study. JMIR Hum Factors 2019; 6:e13295. [PMID: 31599738 PMCID: PMC6812479 DOI: 10.2196/13295] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2019] [Revised: 07/12/2019] [Accepted: 08/14/2019] [Indexed: 12/21/2022] Open
Abstract
Background Digital data collection has the potential to reduce participant burden in research projects that require extensive registrations from participants. To achieve this, a digital data collection tool needs to address potential barriers and motivations for participation. Objective This study aimed to identify factors that may affect motivation for participation and adoption of a digital data collection tool in a research project on nutrition and multiple sclerosis (MS). Methods The study was designed as a sequential mixed methods study with 3 phases. In phase 1, 15 semistructured interviews were conducted in a Danish population of individuals with MS. Interview guide frameworks were based on dimensions from the electronic health literacy framework and the Health Education Impact Questionnaire. Data from phase 1 were analyzed in a content analysis, and findings were used to inform the survey design in phase 2 that validates the results from the content analysis in a larger population. The survey consisted of 14 items, and it was sent to 1000 individuals with MS (response rate 42.5%). In phase 3, participants in 3 focus group interviews discussed how findings from phases 1 and 2 might affect motivation for participation and adoption of the digital tool. Results The following 3 categories related to barriers and incentives for participation were identified in the content analysis of the 15 individual interviews: (1) life with MS, (2) use of technology, and (3) participation and incentives. Phase 1 findings were tested in phase 2’s survey in a larger population (n=1000). The majority of participants were comfortable using smartphone technologies and participated actively on social media platforms. MS symptoms did cause limitations in the use of Web pages and apps when the given pages had screen clutter, too many colors, or too small buttons. Life with MS meant that most participants had to ration their energy levels. Support from family and friends was important to participants, but support could also come in the form of physical aids (walking aids and similar) and digital aids (reminders, calendar functions, and medication management). Factors that could discourage participation were particularly related to the time it would take every day. The biggest motivations for participation were to contribute to research in MS, to learn more about one’s own MS and what affects it, and to be able to exchange experiences with other people with MS. Conclusions MS causes limitations that put demands on tools developed for digital data collection. A digital data collection tool can increase chances of high adoption rates, but it needs to be supplemented with a clear and simple project design and continuous communication with participants. Motivational factors should be considered in both study design and the development of a digital data collection tool for research.
Collapse
Affiliation(s)
- Astrid Karnoe
- Department of Public Health, University of Copenhagen, Copenhagen, Denmark.,Danish Multiple Sclerosis Patient Society, Valby, Denmark
| | - Lars Kayser
- Department of Public Health, University of Copenhagen, Copenhagen, Denmark
| | | |
Collapse
|
17
|
Abd-alrazaq AA, Bewick BM, Farragher T, Gardner P. Factors that affect the use of electronic personal health records among patients: A systematic review. Int J Med Inform 2019; 126:164-175. [DOI: 10.1016/j.ijmedinf.2019.03.014] [Citation(s) in RCA: 61] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2018] [Revised: 12/14/2018] [Accepted: 03/21/2019] [Indexed: 12/14/2022]
|
18
|
Barclay K, Carruthers R, Traboulsee A, Bass AD, LaGanke C, Bertolotto A, Boster A, Celius EG, de Seze J, Cruz DD, Habek M, Lee JM, Limmroth V, Meuth SG, Oreja-Guevara C, Pagnotta P, Vos C, Ziemssen T, Baker DP, Wijmeersch BV. Best Practices for Long-Term Monitoring and Follow-Up of Alemtuzumab-Treated MS Patients in Real-World Clinical Settings. Front Neurol 2019; 10:253. [PMID: 30967831 PMCID: PMC6439479 DOI: 10.3389/fneur.2019.00253] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2018] [Accepted: 02/25/2019] [Indexed: 12/02/2022] Open
Abstract
Multiple sclerosis (MS) is a chronic autoimmune neurological disease that typically affects young adults, causing irreversible physical disability and cognitive impairment. Alemtuzumab, administered intravenously as 2 initial courses of 12 mg/day (5 consecutive days at baseline, and 3 consecutive days 12 months later), resulted in significantly greater improvements in clinical and MRI outcomes vs. subcutaneous interferon beta-1a over 2 years in patients with active relapsing-remitting MS (RRMS) who were either treatment-naive (CARE-MS I; NCT00530348) or had an inadequate response to prior therapy (CARE-MS II; NCT00548405). Efficacy with alemtuzumab was maintained over 7 years in subsequent extension studies (NCT00930553; NCT02255656), in the absence of continuous treatment and with a consistent safety profile. There is an increased incidence of autoimmune events in patients treated with alemtuzumab (mainly thyroid events, but also immune thrombocytopenia and nephropathy), which imparts a need for mandatory safety monitoring for 4 years following the last treatment. The risk management strategy for alemtuzumab-treated patients includes laboratory monitoring and a comprehensive patient education and support program that enables early detection and effective management of autoimmune events, yielding optimal outcomes for MS patients. Here we provide an overview of tools and techniques that have been implemented in real-world clinical settings to reduce the burden of monitoring for both patients and healthcare providers, including customized educational materials, the use of social media, and interactive online databases for managing healthcare data. Many practices are also enhancing patient outreach efforts through coordination with specialized nursing services and ancillary caregivers. The best practice recommendations for safety monitoring described in this article, based on experiences in real-world clinical settings, may enable early detection and management of autoimmune events, and help with implementation of monitoring requirements while maximizing the benefits of alemtuzumab treatment for MS patients.
Collapse
Affiliation(s)
| | | | | | - Ann D. Bass
- Neurology Center of San Antonio, San Antonio, TX, United States
| | | | | | - Aaron Boster
- OhioHealth Neurological Physicians, Columbus, OH, United States
| | - Elisabeth G. Celius
- Oslo University Hospital Ullevål and Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Jérôme de Seze
- Clinical Research Center (CIC), INSERM 1434, Strasbourg University, Strasbourg, France
| | | | - Mario Habek
- University of Zagreb, School of Medicine and University Medical Center, Zagreb, Croatia
| | - Jong-Mi Lee
- Stanford Healthcare, Palo Alto, CA, United States
| | - Volker Limmroth
- Klinik für Neurologie und Palliativmedizin, Cologne, Germany
| | - Sven G. Meuth
- Clinic of Neurology with Institute of Translational Neurology, University Hospital Müenster, Müenster, Germany
| | - Celia Oreja-Guevara
- El Instituto de Investigación Sanitaria del Hospital Clínico San Carlos, Hospital Clínico San Carlos, Madrid, Spain
| | | | - Cindy Vos
- Revalidatie & MS Centrum, Overpelt, Belgium
| | - Tjalf Ziemssen
- Center of Clinical Neuroscience, University Clinic Carl Gustav Carus, Dresden, Germany
| | | | | |
Collapse
|
19
|
Apolinário-Hagen J, Menzel M, Hennemann S, Salewski C. Acceptance of Mobile Health Apps for Disease Management Among People With Multiple Sclerosis: Web-Based Survey Study. JMIR Form Res 2018; 2:e11977. [PMID: 30684408 PMCID: PMC6334710 DOI: 10.2196/11977] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2018] [Revised: 10/24/2018] [Accepted: 11/22/2018] [Indexed: 01/19/2023] Open
Abstract
Background Mobile health (mHealth) apps might have the potential to promote self-management of people with multiple sclerosis (MS) in everyday life. However, the uptake of MS apps remains poor, and little is known about the facilitators and barriers for their efficient utilization, such as technology acceptance. Objective The aim of this study was to examine the acceptance of mHealth apps for disease management in the sense of behavioral intentions to use and explore determinants of utilization among people with MS based on the Unified Theory of Acceptance and Use of Technology (UTAUT). Methods Participants for this Web-based cross-sectional study were recruited throughout Germany with the support of regional MS associations and self-help groups. To identify determinants of intention to use MS apps, a measure based on the UTAUT was adapted with 4 key determinants (performance expectancy, effort expectancy, social influence, and facilitating conditions) and extended by Intolerance of Uncertainty (IU) and electronic health literacy. Potential influencing effects of both MS and computer self-efficacy (C-SE) as mediators and fatigue as a moderator were analyzed using Hayes’s PROCESS macro (SPSS version 3.0) for IBM SPSS version 24.0. Results A total of 98 participants (mean age 47.03 years, SD 10.17; 66/98, 67% female) with moderate fatigue levels completed the survey. Although most participants (91/98, 92%) were daily smartphone users, almost two-thirds (62/98, 63%) reported no experience with MS apps. Overall, the acceptance was moderate on average (mean 3.11, SD 1.31, minimum=1 and maximum=5), with lower scores among persons with no experience (P=.04) and higher scores among current users (P<.001). In multiple regression analysis (R2=63% variance explained), performance expectancy (beta=.41) and social influence (beta=.33) were identified as significant predictors of acceptance (all P<.001). C-SE was confirmed as a partial mediator in the relationship between IU and acceptance (indirect effect: B=−.095, 95% CI −0.227 to −0.01). Furthermore, a moderated mediation by C-SE was shown in the relationship between IU and behavioral intentions to use MS apps for low (95% CI −0.42 to −0.01) and moderate levels (95% CI −0.27 to −0.01) of fatigue. Conclusions Overall, this exploratory pilot study indicates for the first time that positive expectations about the helpfulness for self-management purposes and social support might be important factors to be considered for improving the acceptance of MS apps among smartphone users with MS. However, given some inconsistent findings, especially regarding the role of effort expectancy and IU and self-efficacy, the conceptual model needs replication with a larger sample of people with MS, varying more in fatigue levels, and a longitudinal assessment of the actual usage of MS apps predicted by acceptance in the sense of behavioral intentions to use.
Collapse
Affiliation(s)
| | - Mireille Menzel
- Department of Health Psychology, Faculty of Psychology, University of Hagen, Hagen, Germany
| | - Severin Hennemann
- Department of Clinical Psychology, Psychotherapy and Experimental Psychopathology, Institute of Psychology, University of Mainz, Mainz, Germany
| | - Christel Salewski
- Department of Health Psychology, Faculty of Psychology, University of Hagen, Hagen, Germany
| |
Collapse
|
20
|
Marziniak M, Brichetto G, Feys P, Meyding-Lamadé U, Vernon K, Meuth SG. The Use of Digital and Remote Communication Technologies as a Tool for Multiple Sclerosis Management: Narrative Review. JMIR Rehabil Assist Technol 2018; 5:e5. [PMID: 29691208 PMCID: PMC5941090 DOI: 10.2196/rehab.7805] [Citation(s) in RCA: 81] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2017] [Revised: 01/08/2018] [Accepted: 01/26/2018] [Indexed: 11/22/2022] Open
Abstract
Despite recent advances in multiple sclerosis (MS) care, many patients only infrequently access health care services, or are unable to access them easily, for reasons such as mobility restrictions, travel costs, consultation and treatment time constraints, and a lack of locally available MS expert services. Advances in mobile communications have led to the introduction of electronic health (eHealth) technologies, which are helping to improve both access to and the quality of health care services. As the Internet is now readily accessible through smart mobile devices, most people can take advantage of eHealth apps. The development of digital applications and remote communication technologies for patients with MS has increased rapidly in recent years. These apps are intended to complement traditional in-clinic approaches and can bring significant benefits to both patients with MS and health care providers (HCPs). For patients, such eHealth apps have been shown to improve outcomes and increase access to care, disease information, and support. These apps also help patients to participate actively in self-management, for example, by tracking adherence to treatment, changes in bladder and bowel habits, and activity and mood. For HCPs, MS eHealth solutions can simplify the multidisciplinary approaches needed to tailor MS management strategies to individual patients; facilitate remote monitoring of patient symptoms, adverse events, and outcomes; enable the efficient use of limited resources and clinic time; and potentially allow more timely intervention than is possible with scheduled face-to-face visits. These benefits are important because MS is a long-term, multifaceted chronic condition that requires ongoing monitoring, assessment, and management. We identified in the literature 28 eHealth solutions for patients with MS that fall within the four categories of screening and assessment, disease monitoring and self-management, treatment and rehabilitation, and advice and education. We review each solution, focusing on any clinical evidence supporting their use from prospective trials (including ASSESS MS, Deprexis, MSdialog, and the Multiple Sclerosis Performance Test) and consider the opportunities, barriers to adoption, and potential pitfalls of eHealth technologies in routine health care.
Collapse
Affiliation(s)
- Martin Marziniak
- Department of Neurology, Isar-Amper-Klinikum Munich-East, Haar, Germany
| | - Giampaolo Brichetto
- Scientific Research Area, Italian Multiple Sclerosis Foundation, Genova, Italy
| | - Peter Feys
- Rehabilitation Research Center, Biomedical Research Center, Faculty of Medicine and Life Sciences, Hasselt University, Diepenbeek, Belgium
| | | | - Karen Vernon
- Department of Neurology, Salford Royal National Health Service Foundation Trust, Salford, United Kingdom
| | - Sven G Meuth
- Department of Neurology, University of Münster, Münster, Germany
| |
Collapse
|
21
|
Fraccaro P, Vigo M, Balatsoukas P, Buchan IE, Peek N, van der Veer SN. The influence of patient portals on users' decision making is insufficiently investigated: A systematic methodological review. Int J Med Inform 2018; 111:100-111. [PMID: 29425621 DOI: 10.1016/j.ijmedinf.2017.12.028] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2017] [Revised: 10/25/2017] [Accepted: 12/30/2017] [Indexed: 12/26/2022]
Abstract
BACKGROUND Patient portals are considered valuable conduits for supporting patients' self-management. However, it is unknown why they often fail to impact on health care processes and outcomes. This may be due to a scarcity of robust studies focusing on the steps that are required to induce improvement: users need to effectively interact with the portal (step 1) in order to receive information (step 2), which might influence their decision-making (step 3). We aimed to explore this potential knowledge gap by investigating to what extent each step has been investigated for patient portals, and explore the methodological approaches used. METHODS We performed a systematic literature review using Coiera's information value chain as a guiding theoretical framework. We searched MEDLINE and Scopus by combining terms related to patient portals and evaluation methodologies. Two reviewers selected relevant papers through duplicate screening, and one extracted data from the included papers. RESULTS We included 115 articles. The large majority (n = 104) evaluated aspects related to interaction with patient portals (step 1). Usage was most often assessed (n = 61), mainly by analysing system interaction data (n = 50), with most authors considering participants as active users if they logged in at least once. Overall usability (n = 57) was commonly assessed through non-validated questionnaires (n = 44). Step 2 (information received) was investigated in 58 studies, primarily by analysing interaction data to evaluate usage of specific system functionalities (n = 34). Eleven studies explicitly assessed the influence of patient portals on patients' and clinicians' decisions (step 3). CONCLUSIONS Whereas interaction with patient portals has been extensively studied, their influence on users' decision-making remains under-investigated. Methodological approaches to evaluating usage and usability of portals showed room for improvement. To unlock the potential of patient portals, more (robust) research should focus on better understanding the complex process of how portals lead to improved health and care.
Collapse
Affiliation(s)
- Paolo Fraccaro
- Health eResearch Centre, Farr Institute of Health Informatics Research, UK; Centre for Health Informatics, Division of Informatics, Imaging and Data Sciences, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK.
| | - Markel Vigo
- School of Computer Science, University of Manchester, Manchester, UK
| | | | | | - Niels Peek
- Health eResearch Centre, Farr Institute of Health Informatics Research, UK; Centre for Health Informatics, Division of Informatics, Imaging and Data Sciences, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK; NIHR Greater Manchester Patient Safety Translational Research Centre, Manchester, UK
| | - Sabine N van der Veer
- Health eResearch Centre, Farr Institute of Health Informatics Research, UK; Centre for Health Informatics, Division of Informatics, Imaging and Data Sciences, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK
| |
Collapse
|
22
|
Perspectives from the Patient and the Healthcare Professional in Multiple Sclerosis: Social Media and Patient Education. Neurol Ther 2017; 7:23-36. [PMID: 29243028 PMCID: PMC5990508 DOI: 10.1007/s40120-017-0087-3] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/18/2017] [Indexed: 11/20/2022] Open
Abstract
A diagnosis of multiple sclerosis (MS) is life-altering. Because the course of MS is heterogeneous, patients may face uncertainty in terms of long-term physical and cognitive challenges, potential loss of employment, and the risk of social isolation. Patients often turn to the Internet and social media for information about MS and its management, and to seek out fellow patients and support groups. Here, we examine the use of social media and the Internet among patients with MS, considering its impact on patient education. We consider the access that these conduits provide not only to other patients with MS but also to a wealth of disease-related information online. These themes are further illustrated with first-hand experiences of the patient author and her physician. We also explore the impact of the Internet and social media on the education and support of patients with MS from the healthcare professional’s (HCP’s) perspective, including opportunities for HCPs to promote disease education among their patients, and the advantages that arise from patients being better informed about their disease. The rise of the Internet and social media has changed the patient experience, helping patients to support each other, to educate themselves proactively about their condition, and to participate more actively in decisions relating to disease management than perhaps was the case historically. Funding Novartis Pharmaceuticals Corporation.
Collapse
|
23
|
Alpert JM, Dyer KE, Lafata JE. Patient-centered communication in digital medical encounters. PATIENT EDUCATION AND COUNSELING 2017; 100:1852-1858. [PMID: 28522229 PMCID: PMC5573682 DOI: 10.1016/j.pec.2017.04.019] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/01/2016] [Revised: 03/13/2017] [Accepted: 04/28/2017] [Indexed: 05/09/2023]
Abstract
OBJECTIVE Patients are increasingly using the secure messaging function available through online patient portals to communicate with their health care providers, yet little is known about the characteristics of conversations that occur. The goal of this study is to describe the types of messages initiated by patients communicating via patient portals and to assess whether providers employ patient-centered strategies in their electronic responses. DESIGN A total of 193 messages from 58 message threads between patients and providers were collected during a one-week period in a large health care system. METHODS Content analysis of patient messages was conducted and deductive analysis of provider responses was employed for two types of patient-centered communication, provider use of supportive talk and partnership building. RESULTS Patients sent nearly double the number of messages compared to providers (65% versus 35%). Patient messages expressed concern, sought medical solutions and requested assistance with administrative tasks. Over half (53.4%) of provider replies did not contain language reflective of either partnership building or supportive talk. CONCLUSION Partnership building language and supportive talk occurred at lower rates than documented in the literature on in-person encounters. This may represent a lost opportunity to strengthen the patient-provider relationship. PRACTICE IMPLICATIONS As secure messaging is increasingly utilized as a form of patient-provider communication, it is important to understand how aspects of this communication channel, including the patient-centeredness of the language used by providers, impact patient-provider relationships and patient outcomes.
Collapse
Affiliation(s)
- Jordan M Alpert
- Department of Advertising, College of Journalism and Communications, University of Florida, United States.
| | - Karen E Dyer
- Center for the Study of Healthcare Innovation, Implementation & Policy (CSHIIP), VA Greater Los Angeles Healthcare System,United States
| | - Jennifer Elston Lafata
- UNC Lineberger Comprehensive Cancer Center and UNC Eshelman School of Pharmacy, The University of North Carolina-Chapel Hill, United States
| |
Collapse
|
24
|
Dorstyn D, Roberts R, Murphy G, Kneebone I, Craig A, Migliorini C. Online Resource to Promote Vocational Interests Among Job Seekers With Multiple Sclerosis: A Randomized Controlled Trial in Australia. Arch Phys Med Rehabil 2017; 99:272-280. [PMID: 28928026 DOI: 10.1016/j.apmr.2017.08.475] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2017] [Revised: 08/11/2017] [Accepted: 08/15/2017] [Indexed: 11/30/2022]
Abstract
OBJECTIVE To provide a preliminary evaluation of the effectiveness of an online resource for job seekers with multiple sclerosis (MS). DESIGN Randomized controlled design. SETTING Community-dwelling cohort. PARTICIPANTS Adults (N = 95) with relapsing-remitting or progressive MS were randomly assigned to one of two groups. Forty-five accessed an email delivered, 7 module resource, Work and MS, over a 4 week period. Waitlist control participants (n=50) were offered the opportunity to access Work and MS 4 weeks postenrollment. MAIN OUTCOME MEASURES Primary outcomes focused on vocational interests (My Vocational Situation Scale) and self-efficacy in job-seeking activities (Job-Procurement Self Efficacy Scale). Secondary outcomes focused on perceived workplace difficulties (Multiple Sclerosis Work Difficulties Questionnaire [MSWDQ]), optimism (Life Orientation Test - Revised), and mood (Patient Health Questionnaire-9). RESULTS Intention-to-treat analyses revealed pre-post gains: participants who accessed Work and MS reported improved confidence in their career goals (My Vocational Situation Scale g=.55; 95% confidence interval [CI], .14-.96; P=.008) and positively reappraised potential workplace difficulties (MSWDQ g range, .42-.47; P range, .023-.042). The effect on job self-efficacy was not significant, but changed in the expected direction (g=.17; 95% CI, -.23 to .57; P=.409). Completer data revealed larger, significant effect estimates (g range, .52-.64; P range, .009-.035). CONCLUSIONS Findings provide preliminary support for the utility of a job information resource, Work and MS, to augment existing employment services. The results also suggest the need to test employment-ready interventions in a larger study population. This might include the addition of online peer support to increase intervention compliance.
Collapse
Affiliation(s)
- Diana Dorstyn
- Faculty of Health and Medical Sciences, School of Psychology, University of Adelaide, Adelaide, SA, Australia.
| | - Rachel Roberts
- Faculty of Health and Medical Sciences, School of Psychology, University of Adelaide, Adelaide, SA, Australia
| | - Gregory Murphy
- School of Public Health, La Trobe University, Melbourne, VIC, Australia
| | - Ian Kneebone
- Discipline of Clinical Psychology, Graduate School of Health, University of Technology Sydney, NSW, Australia
| | - Ashley Craig
- John Walsh Center for Rehabilitation Research, Kolling Institute of Medical Research, Sydney Medical School-Northern, The University of Sydney, Sydney, NSW, Australia
| | - Christine Migliorini
- Department of Occupational Therapy, School of Primary Health Care, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
25
|
Showell C. Barriers to the use of personal health records by patients: a structured review. PeerJ 2017; 5:e3268. [PMID: 28462058 PMCID: PMC5410160 DOI: 10.7717/peerj.3268] [Citation(s) in RCA: 44] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2016] [Accepted: 04/03/2017] [Indexed: 12/20/2022] Open
Abstract
Introduction An increasing focus on personal electronic health records (PHRs) offers healthcare benefits for patients, particularly those in undeserved and marginalised populations, who are at risk of receiving less effective healthcare, and may have worse health outcomes. However, PHRs are likely to favour text, technical and health literate users, and be less suitable for disadvantaged patients. These concerns have prompted this review of the literature, which seeks evidence about barriers to the adoption and continued use of PHRs, the nature of the evidence for those barriers, and the stage of PHR implementation where particular barriers apply. Methods Searches in PubMed, Embase, CINAHL and ProQuest databases were used to retrieve articles published in English after 2003 in a refereed journal, or presented in a refereed conference or scientific meeting. After screening to remove items which were out of scope, the phase of the PHR implementation, the type of investigation, and PHR barriers were categorised using thematic coding. Results The search retrieved 395 items; screening identified 34 in-scope publications, which provided evidence of 21 identified barriers to patient adoption and continued use of PHRs, categorised here as Individual, Demographic, Capability, Health-related, PHR or Attitudinal factors. Barriers were identified in most phases of PHR implementation, and in most types of study. A secondary outcome identified that eleven of the publications may have introduced a bias by excluding participants who were less affluent, less capable, or marginalised. Conclusions PHR barriers can interfere with the decision to start using a PHR, with the adoption process, and with continued use, and the impact of particular barriers may vary at different phases of PHR adoption. The complex interrelationships which exist between many of the barriers is suggested in some publications, and emerges more clearly from this review. Many PHR barriers appear to be related to low socioeconomic status. A better understanding is needed of how the effect of barriers is manifested, how that effect can be countered, and how planning and implementation of PHR initiatives can make allowance for patient level barriers to PHR adoption and use, with appropriate actions to mitigate the effect of those barriers for more disadvantaged patients.
Collapse
Affiliation(s)
- Chris Showell
- eHealth Services Research Group, University of Tasmania, Australia
| |
Collapse
|
26
|
Crotty BH, Tamrat Y, Mostaghimi A, Safran C, Landon BE. Patient-to-physician messaging: volume nearly tripled as more patients joined system, but per capita rate plateaued. Health Aff (Millwood) 2016; 33:1817-22. [PMID: 25288428 DOI: 10.1377/hlthaff.2013.1145] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
Patients want to be able to communicate with their physicians by e-mail. However, physicians are often concerned about the impact that such communications will have on their time, productivity, and reimbursement. Typically, physicians are not reimbursed for time spent communicating with patients electronically. But under federal meaningful-use criteria for information technology, physicians can receive a modest incentive for such communications. Little is known about trends in secure e-mail messaging between physicians and patients. To understand these trends, we analyzed the volume of messages in a large academic health system's patient portal in the period 2001-10. At the end of 2010, 49,778 patients (22.7 percent of all patients seen within the system) had enrolled in the portal, and 36.9 percent of enrolled patients (8.4 percent of all patients) had sent at least one message to a physician. Physicians in the aggregate saw a near tripling of e-mail messages during the study period. However, the number of messages per hundred patients per month stabilized between 2005 and 2010, at an average of 18.9 messages. As physician reimbursement moves toward global payments, physicians' and patients' participation in secure messaging will likely increase, and electronic communication should be considered part of physicians' job descriptions.
Collapse
Affiliation(s)
- Bradley H Crotty
- Bradley H. Crotty is director of patient portals in the Division of Clinical Informatics, Beth Israel Deaconess Medical Center, and an instructor in medicine at Harvard Medical School, both in Boston, Massachusetts
| | - Yonas Tamrat
- Yonas Tamrat is a primary care internist at Johnson Health Center, in Lynchburg, Virginia
| | - Arash Mostaghimi
- Arash Mostaghimi is an instructor in dermatology at Brigham and Women's Hospital, in Boston
| | - Charles Safran
- Charles Safran is chief of the Division of Clinical Informatics, Beth Israel Deaconess Medical Center, and an associate professor of medicine at Harvard Medical School
| | - Bruce E Landon
- Bruce E. Landon is a professor of health care policy at Harvard Medical School
| |
Collapse
|
27
|
Thompson MJ, Reilly JD, Valdez RS. Work system barriers to patient, provider, and caregiver use of personal health records: A systematic review. APPLIED ERGONOMICS 2016; 54:218-242. [PMID: 26851482 DOI: 10.1016/j.apergo.2015.10.010] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2015] [Revised: 10/16/2015] [Accepted: 10/18/2015] [Indexed: 06/05/2023]
Abstract
OBJECTIVES This review applied a human factors/ergonomics (HF/E) paradigm to assess individual, work system/unit, organization, and external environment factors generating barriers to patient, provider, and informal caregiver personal health record (PHR) use. METHODS The literature search was conducted using five electronic databases for the timeframe January 2000 to October 2013, resulting in 4865 citations. Two authors independently coded included articles (n = 60). RESULTS Fifty-five, ten and five articles reported barriers to patient, provider and caregiver PHR use, respectively. Barriers centered around 20 subfactors. The most frequently noted were needs, biases, beliefs, and mood (n = 35) and technology functions and features (n = 32). CONCLUSIONS The HF/E paradigm was effective in framing the assessment of factors creating barriers to PHR use. Design efforts should address literacy, interoperability, access to health information, and secure messaging. A deeper understanding of the interactions between work systems and the role of organization and external environment factors is required.
Collapse
Affiliation(s)
- Morgan J Thompson
- Psychology Department, The College of William and Mary, Williamsburg, VA 23187, USA.
| | - Jeremiah D Reilly
- Department of Public Health Sciences, University of Virginia, P.O. Box 800717, Hospital West Complex, Charlottesville, VA 22908, USA.
| | - Rupa S Valdez
- Department of Public Health Sciences, University of Virginia, P.O. Box 800717, Hospital West Complex, Charlottesville, VA 22908, USA.
| |
Collapse
|
28
|
Kern R, Haase R, Eisele JC, Thomas K, Ziemssen T. Designing an Electronic Patient Management System for Multiple Sclerosis: Building a Next Generation Multiple Sclerosis Documentation System. Interact J Med Res 2016; 5:e2. [PMID: 26746977 PMCID: PMC4723723 DOI: 10.2196/ijmr.4549] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2015] [Revised: 08/20/2015] [Accepted: 09/22/2015] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Technologies like electronic health records or telemedicine devices support the rapid mediation of health information and clinical data independent of time and location between patients and their physicians as well as among health care professionals. Today, every part of the treatment process from diagnosis, treatment selection, and application to patient education and long-term care may be enhanced by a quality-assured implementation of health information technology (HIT) that also takes data security standards and concerns into account. In order to increase the level of effectively realized benefits of eHealth services, a user-driven needs assessment should ensure the inclusion of health care professional perspectives into the process of technology development as we did in the development process of the Multiple Sclerosis Documentation System 3D. After analyzing the use of information technology by patients suffering from multiple sclerosis, we focused on the needs of neurological health care professionals and their handling of health information technology. OBJECTIVE Therefore, we researched the status quo of eHealth adoption in neurological practices and clinics as well as health care professional opinions about potential benefits and requirements of eHealth services in the field of multiple sclerosis. METHODS We conducted a paper-and-pencil-based mail survey in 2013 by sending our questionnaire to 600 randomly chosen neurological practices in Germany. The questionnaire consisted of 24 items covering characteristics of participating neurological practices (4 items), the current use of network technology and the Internet in such neurological practices (5 items), physicians' attitudes toward the general and MS-related usefulness of eHealth systems (8 items) and toward the clinical documentation via electronic health records (4 items), and physicians' knowledge about the Multiple Sclerosis Documentation System (3 items). RESULTS From 600 mailed surveys, 74 completed surveys were returned. As much as 9 of the 10 practices were already connected to the Internet (67/74), but only 49% preferred a permanent access. The most common type of HIT infrastructure was a complete practice network with several access points. Considering data sharing with research registers, 43% opted for an online interface, whereas 58% decided on an offline method of data transmission. eHealth services were perceived as generally useful for physicians and nurses in neurological practices with highest capabilities for improvements in clinical documentation, data acquisition, diagnosis of specific MS symptoms, physician-patient communication, and patient education. Practices specialized in MS in comparison with other neurological practices presented an increased interest in online documentation. Among the participating centers, 91% welcomed the opportunity of a specific clinical documentation for MS and 87% showed great interest in an extended and more interconnected electronic documentation of MS patients. Clinical parameters (59/74) were most important in documentation, followed by symptomatic parameters like measures of fatigue or depression (53/74) and quality of life (47/74). CONCLUSIONS Physicians and nurses may significantly benefit from an electronically assisted documentation and patient management. Many aspects of patient documentation and education will be enhanced by eHealth services if the most informative measures are integrated in an easy-to-use and easily connectable approach. MS-specific eHealth services were highly appreciated, but the current level of adoption is still behind the level of interest in an extended and more interconnected electronic documentation of MS patients.
Collapse
Affiliation(s)
- Raimar Kern
- Multiple Sclerosis Center Dresden, Center of Clinical Neuroscience, Department of Neurology, University of Technology Dresden, Germany, Dresden, Germany
| | | | | | | | | |
Collapse
|
29
|
Irizarry T, DeVito Dabbs A, Curran CR. Patient Portals and Patient Engagement: A State of the Science Review. J Med Internet Res 2015; 17:e148. [PMID: 26104044 PMCID: PMC4526960 DOI: 10.2196/jmir.4255] [Citation(s) in RCA: 479] [Impact Index Per Article: 47.9] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2015] [Revised: 03/10/2015] [Accepted: 04/03/2015] [Indexed: 12/30/2022] Open
Abstract
Background Patient portals (ie, electronic personal health records tethered to institutional electronic health records) are recognized as a promising mechanism to support greater patient engagement, yet questions remain about how health care leaders, policy makers, and designers can encourage adoption of patient portals and what factors might contribute to sustained utilization. Objective The purposes of this state of the science review are to (1) present the definition, background, and how current literature addresses the encouragement and support of patient engagement through the patient portal, and (2) provide a summary of future directions for patient portal research and development to meaningfully impact patient engagement. Methods We reviewed literature from 2006 through 2014 in PubMed, Ovid Medline, and PsycInfo using the search terms “patient portal” OR “personal health record” OR “electronic personal health record”. Final inclusion criterion dictated that studies report on the patient experience and/or ways that patients may be supported to make competent health care decisions and act on those decisions using patient portal functionality. Results We found 120 studies that met the inclusion criteria. Based on the research questions, explicit and implicit aims of the studies, and related measures addressed, the studies were grouped into five major topics (patient adoption, provider endorsement, health literacy, usability, and utility). We discuss the findings and conclusions of studies that address the five topical areas. Conclusions Current research has demonstrated that patients’ interest and ability to use patient portals is strongly influenced by personal factors such age, ethnicity, education level, health literacy, health status, and role as a caregiver. Health care delivery factors, mainly provider endorsement and patient portal usability also contribute to patient’s ability to engage through and with the patient portal. Future directions of research should focus on identifying specific populations and contextual considerations that would benefit most from a greater degree of patient engagement through a patient portal. Ultimately, adoption by patients and endorsement by providers will come when existing patient portal features align with patients’ and providers’ information needs and functionality.
Collapse
Affiliation(s)
- Taya Irizarry
- School of Nursing, University of Pittsburgh, Pittsburgh, PA, United States.
| | | | | |
Collapse
|
30
|
Can patient portals reduce health disparities? A perspective from asthma. Ann Am Thorac Soc 2015; 11:608-12. [PMID: 24640983 DOI: 10.1513/annalsats.201401-032ps] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
Much asthma research directed at achieving health equity is focused on patient education for self-management. Although adults are more likely to die from asthma, most studies target children. With the advent of the electronic health record, patient portals potentially offer adult patients as well as children and their caretakers a resource for disease management education, facilitating communication with health care providers and improving patient access to health care. However, difficult, limited, or inconvenient access to these patient portals could increase health disparities, whereas features such as accompanying audio platforms, the use of multimedia, and the ability to communicate across language barriers and educational levels potentially could improve communication and reduce differences in health outcomes.
Collapse
|
31
|
Otte-Trojel T, de Bont A, van de Klundert J, Rundall TG. Characteristics of patient portals developed in the context of health information exchanges: early policy effects of incentives in the meaningful use program in the United States. J Med Internet Res 2014; 16:e258. [PMID: 25447837 PMCID: PMC4260079 DOI: 10.2196/jmir.3698] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2014] [Revised: 08/21/2014] [Accepted: 09/13/2014] [Indexed: 11/27/2022] Open
Abstract
BACKGROUND In 2014, the Centers for Medicare & Medicaid Services in the United States launched the second stage of its Electronic Health Record (EHR) Incentive Program, providing financial incentives to providers to meaningfully use their electronic health records to engage patients online. Patient portals are electronic means to engage patients by enabling secure access to personal medical records, communication with providers, various self-management tools, and administrative functionalities. Outcomes of patient portals have mainly been reported in large integrated health systems. This may now change as the EHR Incentive Program enables and supports the use of patient portals in other types of health systems. In this paper, we focus on Health Information Exchanges (HIE): entities that facilitate data exchange within networks of independent providers. OBJECTIVE In response to the EHR Incentive Program, some Health Information Exchanges in the United States are developing patient portals and offering them to their network of providers. Such patient portals hold high value for patients, especially in fragmented health system contexts, due to the portals' ability to integrate health information from an array of providers and give patients one access point to this information. Our aim was to report on the early effects of the EHR incentives on patient portal development by HIEs. Specifically, we describe the characteristics of these portals, identify factors affecting adoption by providers during the 2013-2014 time frame, and consider what may be the primary drivers of providers' adoption of patient portals in the future. METHODS We identified four HIEs that were developing patient portals as of spring 2014. We collected relevant documents and conducted interviews with six HIE leaders as well as two providers that were implementing the portals in their practices. We performed content analysis on these data to extract information pertinent to our study objectives. RESULTS Our findings suggest that there are two primary types of patient portals available to providers in HIEs: (1) portals linked to EHRs of individual providers or health systems and (2) HIE-sponsored portals that link information from multiple providers' EHRs. The decision of providers in the HIEs to adopt either one of these portals appears to be a trade-off between functionality, connectivity, and cost. Our findings also suggest that while the EHR Incentive Program is influencing these decisions, it may not be enough to drive adoption. Rather, patient demand for access to patient portals will be necessary to achieve widespread portal adoption and realization of potential benefits. CONCLUSIONS Optimizing patient value should be the main principle underlying policies intending to increase online patient engagement in the third stage of the EHR Incentive Program. We propose a number of features for the EHR Incentive Program that will enhance patient value and thereby support the growth and sustainability of patient portals provided by Health Information Exchanges.
Collapse
Affiliation(s)
- Terese Otte-Trojel
- Health Services Management & Organization, Institute of Health Policy & Management, Erasmus University Rotterdam, Rotterdam, Netherlands.
| | | | | | | |
Collapse
|
32
|
Otte-Trojel T, de Bont A, Rundall TG, van de Klundert J. How outcomes are achieved through patient portals: a realist review. J Am Med Inform Assoc 2014; 21:751-7. [PMID: 24503882 DOI: 10.1136/amiajnl-2013-002501] [Citation(s) in RCA: 107] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
OBJECTIVE To examine how patient portals contribute to health service delivery and patient outcomes. The specific aims were to examine how outcomes are produced, and how variations in outcomes can be explained. METHODS We used a realist review method, which aims to describe how 'an intervention works, for whom, and in what circumstances' by analyzing patterns between context, mechanism, and outcomes. We reviewed 32 evaluation studies of patient portals published since 2003. RESULTS The reviewed evaluations indicate that as a complement to existing health services, patient portals can lead to improvements in clinical outcomes, patient behavior, and experiences. Four different mechanisms are reported to yield the reported outcome improvements. These are patient insight into personal health information, activation of information, interpersonal continuity of care, and service convenience. The vast majority of evaluations were conducted in integrated health service networks in the USA, and we detected no substantial variation in outcomes across these networks. DISCUSSION AND CONCLUSIONS Patient portals may impact clinical outcomes and health service delivery through multiple mechanisms. Given the relative uniformity of evaluation contexts, we were not able to detect patterns in how patient portals work in different contexts. Nonetheless, it appears from the overwhelming proportion of patient portal evaluations coming from integrated health service networks, that these networks provide more fertile contexts for patient portals to be effective. To improve the understanding of how patient portals work, future evaluations of patient portals should capture information about mechanisms and context that influence their outcomes.
Collapse
Affiliation(s)
- Terese Otte-Trojel
- Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, The Netherlands
| | - Antoinette de Bont
- Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, The Netherlands
| | - Thomas G Rundall
- School of Public Health, University of California-Berkeley, Berkeley, California, USA
| | - Joris van de Klundert
- Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, The Netherlands
| |
Collapse
|
33
|
Jongen PJ, Sanders E, Zwanikken C, Koeman J, Visser LH, Koopmans P, Lehnick D. Adherence to monthly online self-assessments for short-term monitoring: a 1-year study in relapsing-remitting multiple sclerosis patients after start of disease modifying treatment. Patient Prefer Adherence 2013; 7:293-300. [PMID: 23589682 PMCID: PMC3625027 DOI: 10.2147/ppa.s40173] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND The participation of neurologists and patients in studies on the effectiveness and safety of newly authorized drugs in multiple sclerosis (MS) is insufficient. Monthly online self-assessments using patient-reported outcomes may help in short-term monitoring of neurological changes and side effects. OBJECTIVE Investigate in relapsing-remitting (RR) MS patients the adherence to monthly online self-assessments after the start of disease modifying treatment. METHODS Observational study in 39 neurological departments in The Netherlands. Patients starting glatiramer acetate treatment were instructed to complete online the Modified Fatigue Impact Scale 5-item version and the 8-item Leeds Multiple Sclerosis Quality of Life scale every month during 1 year (T0 toT12). RESULTS Sixty-three investigators included 163 analyzable patients. At T3, 148 (90.8%) patients had completed all questionnaires; at T6, 142 (87.1%); at T9, 133 (81.6%); and at T12, 123 (75.5%). Eight (4.9%) patients did not complete any questionnaire. Median values for inter-assessment intervals ranged from 32 to 34 days (first quartile [Q1] 30 days, third quartile [Q3] 41 days), and the final assessment was at 417 days (median: Q1 385 days, Q3 480 days). Forty-three (26.3%) patients completed the questionnaires at all time points (completion adherent) with their final assessment within 30 days after the scheduled T12 (interval adherent). Eighty (49.1%) patients were completion adherent, but not interval adherent. Forty (24.5%) patients were not completion adherent, as they discontinued assessments prematurely. Men were more interval adherent than women (47.5% vs 20.0%; P = 0.001). CONCLUSION The observation that three out of four (75.5%) RRMS patients completed two short questionnaires at all monthly time points during 1 year after the start of disease modifying treatment suggests that intensive online monitoring in this patient group is feasible. As only one in five (19.6%) patients adhered to the time intervals between self-assessments, measures are needed that improve the timely completion of questionnaires.
Collapse
Affiliation(s)
| | | | | | - Jan Koeman
- Admiraal de Ruyter Ziekenhuis, Vlissingen
| | | | | | | | | |
Collapse
|
34
|
Haase R, Schultheiss T, Kempcke R, Thomas K, Ziemssen T. Use and acceptance of electronic communication by patients with multiple sclerosis: a multicenter questionnaire study. J Med Internet Res 2012; 14:e135. [PMID: 23069209 PMCID: PMC3510727 DOI: 10.2196/jmir.2133] [Citation(s) in RCA: 60] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2012] [Revised: 06/18/2012] [Accepted: 08/08/2012] [Indexed: 01/01/2023] Open
Abstract
Background The number of multiple sclerosis (MS) information websites, online communities, and Web-based health education programs has been increasing. However, MS patients’ willingness to use new ways of communication, such as websites, mobile phone application, short message service, or email with their physician, remains unknown. Objectives We designed a questionnaire to evaluate the a priori use of electronic communication methods by MS patients and to assess their acceptance of such tools for communication with their health care providers. Methods We received complete data from 586 MS patients aged between 17 and 73 years. Respondents were surveyed in outpatient clinics across Germany using a novel paper-and-pencil questionnaire. In addition to demographics, the survey items queried frequency of use of, familiarity with, and comfort with using computers, websites, email, and mobile phones. Results About 90% of all MS patients used a personal computer (534/586) and the Internet (527/586) at least once a week, 87.0% (510/586) communicated by email, and 85.6% (488/570) communicated by mobile phone. When asked about their comfort with using electronic communication methods for communication with health care providers, 20.5% (120/586) accepted communication by mobile Internet application or short message service via mobile phone, 41.0% (240/586) by websites, 54.3% (318/586) by email service, and 67.8% (397/586) by at least one type of electronic communication. The level of a priori use was the best predictor for the acceptance of electronic communication with health care providers. Patients who reported already searching online for health information (odds ratio 2.4, P < .001) and who had already communicated with a physician through a website (odds ratio 3.3, P = .03) reported higher acceptance for Web-based communication. Patients who already scheduled appointments with their mobile phones (odds ratio 2.1, P = .002) were more likely to accept the use of mobile phone applications or short message service for communicating with their physician. Conclusions The majority of MS patients seen at specialist centers already use modern communication technology regularly. New forms of electronic communication appear to have high levels of acceptance for exchanging information about MS between patients and health care providers. Such methods should be integrated into eHealth services such as electronic health records and patient relationship management systems.
Collapse
Affiliation(s)
- Rocco Haase
- Multiple Sclerosis Centre Dresden, Department of Neurology, University of Technology Dresden, Dresden, Germany.
| | | | | | | | | |
Collapse
|
35
|
|
36
|
Jiang X, Boxwala AA, El-Kareh R, Kim J, Ohno-Machado L. A patient-driven adaptive prediction technique to improve personalized risk estimation for clinical decision support. J Am Med Inform Assoc 2012; 19:e137-44. [PMID: 22493049 PMCID: PMC3392846 DOI: 10.1136/amiajnl-2011-000751] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
Objective Competing tools are available online to assess the risk of developing certain conditions of interest, such as cardiovascular disease. While predictive models have been developed and validated on data from cohort studies, little attention has been paid to ensure the reliability of such predictions for individuals, which is critical for care decisions. The goal was to develop a patient-driven adaptive prediction technique to improve personalized risk estimation for clinical decision support. Material and methods A data-driven approach was proposed that utilizes individualized confidence intervals (CIs) to select the most ‘appropriate’ model from a pool of candidates to assess the individual patient's clinical condition. The method does not require access to the training dataset. This approach was compared with other strategies: the BEST model (the ideal model, which can only be achieved by access to data or knowledge of which population is most similar to the individual), CROSS model, and RANDOM model selection. Results When evaluated on clinical datasets, the approach significantly outperformed the CROSS model selection strategy in terms of discrimination (p<1e–14) and calibration (p<0.006). The method outperformed the RANDOM model selection strategy in terms of discrimination (p<1e–12), but the improvement did not achieve significance for calibration (p=0.1375). Limitations The CI may not always offer enough information to rank the reliability of predictions, and this evaluation was done using aggregation. If a particular individual is very different from those represented in a training set of existing models, the CI may be somewhat misleading. Conclusion This approach has the potential to offer more reliable predictions than those offered by other heuristics for disease risk estimation of individual patients.
Collapse
Affiliation(s)
- Xiaoqian Jiang
- Division of Biomedical Informatics, University of California at San Diego, La Jolla, California 92093-0728, USA.
| | | | | | | | | |
Collapse
|