Examining the role of patients’ experiences as a resource for choice and decision-making in health care: a creative, interdisciplinary mixed-method study in digital health

Investigating Patient Satisfaction Through Web-Based Reviews of Norwegian Dentists: Quantitative Study Using the Meaning Extraction Method

BACKGROUND

Challenging encounters in health care professions, including in dentistry, are relatively common. Challenging encounters can be defined as stressful or emotional situations involving patients that could impact both treatment outcomes and patients' experiences. Through written web-based reviews, patients can share their experiences with health care providers, and these posts can be a useful source for investigating patient satisfaction and their experiences of challenging encounters.

OBJECTIVE

This study aims to identify dominant themes from patient-written, web-based reviews of dentists and investigate how these themes are related to patient satisfaction with dental treatment.

METHODS

The study data consisted of 11,764 reviews written by dental patients, which included 1- to 5-star ratings on overall satisfaction and free-text comments. The free-text comments were analyzed using Linguistic Inquiry and Word Count software, and the meaning extraction method was used to group words into thematic categories. These themes were used as variables in a multilevel logistic regression analysis to predict patient satisfaction.

RESULTS

Eight themes emerged from the analyses, of which 6 (75%)-explanation (odds ratio [OR] 2.56, 95% CI 2.16-3.04; P<.001), assurance (OR 3.61, 95% CI 2.57-5.06; P<.001), performance assessment (OR 2.17, 95% CI 1.84-2.55; P<.001), professional advice (OR 1.81, 95% CI 1.55-2.13; P<.001), facilities (OR 1.78, 95% CI 1.08-2.91; P=.02), and recommendation (OR 1.31, 95% CI 1.12-1.53; P<.001)-increased the odds of high patient satisfaction. The remaining themes (2/8, 25%)-consequences of treatment need (OR 0.24, 95% CI 0.20-0.29; P<.001) and patient-centered care (OR 0.62, 95% CI 0.52-0.74; P<.001)-reduced the odds of high patient satisfaction.

CONCLUSIONS

The meaning extraction method is an interesting approach to explore patients' written accounts of encounters with dental health professionals. The experiences described by patients provide insight into key elements related to patient satisfaction that can be used in the education of dental health professionals and to improve the provision of dental health services.

Dietary Patterns and Their Associations with Symptom Levels Among People with Multiple Sclerosis: A Real-World Digital Study

INTRODUCTION

The objective of the study was to investigate long-term food intake patterns and establish possible associations between the inferred dietary habits and levels of reported symptoms among people with multiple sclerosis (MS) in Denmark.

METHODS

The present study was designed as a prospective cohort study. Participants were invited to register daily food intake and MS symptoms and were observed during a period of 100 days. Dropout and inclusion probabilities were addressed using generalized linear models. Dietary clusters were identified among 163 participants using hierarchical clustering on principal component scores. Associations between the dietary clusters and the levels of self-assessed MS symptoms were estimated using inverse probability weighting. Furthermore, the effect of a person's position on the first and second principal dietary component axis on symptom burden was investigated.

RESULTS

Three dietary clusters were identified: a Western dietary cluster, a plant-rich dietary cluster and a varied dietary cluster. Analyses further indicated a vegetables-fish-fruit-whole grain axis and a red-meat-processed-meat axis. The plant-rich dietary cluster showed reduction in symptom burden in nine pre-defined MS symptoms compared to the Western dietary cluster (between 19 and 90% reduction). This reduction was significant for pain and bladder dysfunction as well as across all nine symptoms (pooled p value = 0.012). Related to the two dietary axes, high intake of vegetables resulted in 32-74% reduction in symptom burden compared to low levels of vegetable intake. Across symptoms, this was significant (pooled p value = 0.015), also regarding walking difficulty and fatigue.

CONCLUSIONS

Three dietary clusters were identified. Compared to levels of self-assessed MS-related symptoms, and adjusted for potential confounders, the results suggested less symptom burden with increased intake of vegetables. Although the research design limits the possibilities of establishing causal inference, the results indicate that general guidelines for healthy diet may be relevant as a tool in coping with MS symptoms.

Validation of the German eHealth impact questionnaire for online health information users affected by multiple sclerosis

Background

Persons with multiple sclerosis (MS) are confronted by an overwhelming amount of online health information, which can be valuable but also vary in quality and aim. Therefore, it is of great importance for developers and providers of eHealth information to understand its impact on the users. The eHealth Impact Questionnaire (eHIQ) has been developed in the United Kingdom to measure the potential effects of health and experimental information websites. This contains user’s general attitudes towards using the internet to gain health information and attitudes towards a specific health related website. The self-complete questionnaire is divided into two independently administered and scored parts: the 11-item eHIQ part 1 and the 26-item eHIQ part 2. This study aimed to validate the psychometric properties of the German version of the eHealth Impact Questionnaire (eHIQ-G).

Methods

162 people with multiple sclerosis browsed one of two possible websites containing information on MS and completed an online survey. Internal consistency was assessed by Cronbach’s alpha and structural validity by Confirmatory Factor Analysis. Construct validity was examined by assessing correlations with the reference instruments eHealth Literacy Questionnaire and the General Self-Efficacy Scale measuring related, but dissimilar constructs. Moreover, we investigated the mean difference of the eHIQ-G score between the two websites. Data were analyzed using SPSS and AMOS software.

Results

The eHIQ-G subscales showed high internal consistency with Cronbach’s alpha from 0.833 to 0.885. The 2-factor model of eHIQ part 1 achieved acceptable levels of goodness-of-fit indices, whereas the fit for the 3-factor model of eHIQ part 2 was poor and likewise for the alternative modified models. The correlations with the reference instruments were 0.08–0.62 and as expected. Older age was related with lower eHIQ part 1 score, whereas no significant effect was found for education on eHIQ part 1. Although not significant, the website ‘AMSEL’ reached higher mean scores on eHIQ part 2.

Conclusions

The eHIQ-G has good internal consistency, and sufficient structural and construct validity. This instrument will facilitate the measurement of the potential impact of eHealth tools.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-01968-6.

Presenting scientifically-derived illness experiences online - Evaluation of the use of the DIPEx Germany website

OBJECTIVE

To evaluate the real-time usage of krankheitserfahrungen.de, a website providing scientifically collected and analyzed experiences of persons with various chronic illnesses.

METHODS

Web analytics of website use of www.krankheitserfahrungen.de in 2016. Qualitative content analysis of the 150 most and least opened video/audio clip titles in 2018-19.

RESULTS

In 2016, krankheitserfahrungen.de had 19,703 unique visits, of which 3925 were returning visits. Between new and returning visits, the latter were characterized by more actions and more time spent on the website. Thematic pages were clicked more often during new visits and person pages were more frequented during returning visits. In 2018-19, video/audio clip titles related to topics around uncertainties and/or decision making were most often clicked, whereas the least clicked clips dealt with topics like illness management, problem-solving, giving advice to others and emotionally difficult topics such as suffering, death and burden for the family.

CONCLUSION

A website with balanced, scientifically collected and analyzed patient experiences attracts a sufficient number of users and is used for further explorations.

PRACTICE IMPLICATIONS

Using multiple formats, broad topics and diverse personal experiences being accessible through themes or persons is necessary when a scientifically based website on patients' experiences is designed.

Development and evaluation of a website with patients experiences of multiple sclerosis: a mixed methods study

BACKGROUND

A variety of management options (e.g., disease-modifying therapy, lifestyle interventions, rehabilitation) are available for persons with relapsing-remitting multiple sclerosis (MS). Besides coping with the diagnosis, persons with MS have to make complex decisions, e.g., regarding disease-modifying therapies. In addition to factual information, reports of patient experiences may support other patients in their decision-making. Therefore, we developed a website presenting patient experiences illustrated by video, audio and text files. This study aimed to test the acceptability and usability of a website with patient experiences with MS.

METHODS

A mixed-methods approach was applied. A total of 69 participants visited the German "Patient Experiences with MS (PExMS)" website and among them, 50 persons with MS and 6 experts completed an online survey. In total, 18 participants took part in telephone interviews or focus groups. Data from the survey were analysed using descriptive statistics. Qualitative data were analysed using thematic analysis.

RESULTS

Both quantitative and qualitative responses suggest that the PExMS website was viewed positively by patients and experts. 94% of persons with MS agreed that the information was comprehensible and reliable. 54% felt encouraged to share their health problems with others after having studied the website. 74% claimed to use the website if they had to make a decision regarding their health. Qualitative responses deduced from the website fell into 5 key themes: (1) web design, appearance, and functionality, (2) content, (3) usability, (4) satisfaction, and (5) loyalty. The search for persons of similar age and with comparable experiences was a major driving force to navigate the website. The material on the website was perceived as diverse, covering both positive and negative experiences in daily living with MS. All participants greatly appreciated having access to other people's experiences online and judged the material on the website as particularly helpful in decision-making for disease-modifying therapies.

CONCLUSIONS

The findings suggest that the PExMS website might have the potential to be a useful source of audio-visual information for persons with MS. Given the lack of websites available to patients with experiential information, health care professionals may be encouraged to routinely inform patients about this website at regular appointments.

How do women interpret abortion information they find online?

OBJECTIVE

We sought to assess how women interpret the information they find online about the overall safety and risk of infertility associated with abortion and cesarean delivery (CD).

METHODS

We conducted an exploratory, prospective study tracking the internet searches of 100 reproductive-aged individuals who identify as women. We directed participants to search for information about either (1) whether surgical abortion or CD is safe or (2) the risk of infertility following surgical abortion or CD. Our data collection had 3 phases: baseline survey, directed internet search, and a postsearch survey. We analyzed participants' pre- and postsurvey responses using bivariate tests and analyzed within-subject changes. We evaluated the sites they visited based on expert ratings of site content based on trustworthiness and slant.

RESULTS

Women perceived abortion as safer and less likely to cause infertility after their web searches than before (70% perceived abortion in the United States as very/completely safe presearch vs 92% postsearch; p < 0.02). Women's perceptions about CD did not change. Participants sought information from web pages that experts largely deemed trustworthy and lacking in slant.

CONCLUSIONS

Women's perceptions about abortion safety and risk can be influenced by information they find online; perceptions about CD safety and risk may be less influenced by online information.

IMPLICATIONS

Disseminating high quality, user-friendly abortion information on highly ranked and easily findable websites can help women find evidence-based information and influence knowledge about abortion.

Impact of a multimedia website with patient experiences of multiple sclerosis (PExMS) on immunotherapy decision-making: study protocol for a pilot randomised controlled trial in a mixed-methods design

Background

A variety of management options (e.g. immunotherapies, lifestyle interventions, and rehabilitation) are available for people with relapsing-remitting multiple sclerosis (RRMS). Besides coping with the diagnosis, people with MS (pwMS) have to make complex decisions such as deciding about immunotherapies. In addition to factual information, reports of patient experiences (PEx) may support patients in decision-making. The added value of PEx in decision-making is not clear, and controlled studies are rare. Therefore, systematic methods are necessary to develop and analyse PEx. As there are no evaluated PEx for MS in Germany, we are currently creating a website presenting PEx structured according to topics and illustrated by video, audio, and text files. We aim to determine the feasibility of an intervention using PEx and evaluate whether PEx may help pwMS in their immunotherapy decision-making processes as a supplement to evidence-based information.

Methods

This project will follow the Medical Research Council framework for development and evaluation of complex interventions. After the development of a website with PEx, a randomised controlled pilot trial (pilot RCT) will be conducted in 2–3 MS centres, clinics, or rehabilitation centres including 55 pwMS and accompanied by a process evaluation. Patients with a RRMS diagnosis considering immunotherapy are eligible. The primary outcome is decision self-efficacy. Secondary outcomes include preparation for decision-making, decisional conflict, risk knowledge, confidence in active participation, affective forecasting, social support, and self-reported impact of eHealth on its users. Participants will be randomly assigned either to (i) an intervention group with 4 weeks access to an evidence-based patient information resource and the PExMS-website as an adjunct or to (ii) the control group with access to evidence-based information alone. A 6-member advisory panel involving representatives of pwMS, researchers, and neurologists, who accompany the whole project, will mentor this pilot RCT.

Discussion

The intervention was developed with systematic methods, created with active patient involvement and in critical appraisal by an expert advisory panel. The study is innovative as it contributes to the controversial evidence on the use of PEx in the context of evidence-based patient information.

Trial registration

ClinicalTrials.gov, NCT04236544

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-020-00749-0.

The Abortion Web Ecosystem: Cross-Sectional Analysis of Trustworthiness and Bias

Background

People use the internet as a primary source for learning about medical procedures and their associated safety profiles and risks. Although abortion is one of the most common procedures worldwide among women in their reproductive years, it is controversial and highly politicized. Substantial scientific evidence demonstrates that abortion is safe and does not increase a woman’s future risk for depressive disorders or infertility. The extent to which information found on the internet reflects these medical facts in a trustworthy and unbiased manner is not known.

Objective

The purpose of this study was to collate and describe the trustworthiness and political slant or bias of web-based information about abortion safety and risks of depression and infertility following abortion.

Methods

We performed a cross-sectional study of internet websites using 3 search topics: (1) is abortion safe?, (2) does abortion cause depression?, and (3) does abortion cause infertility? We used the Google Adwords tool to identify the search terms most associated with those topics and Google’s search engine to generate databases of websites related to each topic. We then classified and rated each website in terms of content slant (pro-choice, neutral, anti-choice), clarity of slant (obvious, in-between, or difficult/can’t tell), trustworthiness (rating scale of 1-5, 5=most trustworthy), type (forum, feature, scholarly article, resource page, news article, blog, or video), and top-level domain (.com, .net, .org, .edu, .gov, or international domain). We compared website characteristics by search topic (safety, depression, or infertility) using bivariate tests. We summarized trustworthiness using the median and IQR, and we used box-and-whisker plots to visually compare trustworthiness by slant and domain type.

Results

Our search methods yielded a total of 111, 120, and 85 unique sites for safety, depression, and infertility, respectively. Of all the sites (n=316), 57.3% (181/316) were neutral, 35.4% (112/316) were anti-choice, and 7.3% (23/316) were pro-choice. The median trustworthiness score was 2.7 (IQR 1.7-3.7), which did not differ significantly across topics (P=.409). Anti-choice sites were less trustworthy (median score 1.3, IQR 1.0-1.7) than neutral (median score 3.3, IQR 2.7-4.0) and pro-choice (median score 3.7, IQR 3.3-4.3) sites. Anti-choice sites were also more likely to have slant clarity that was “difficult to tell” (41/112, 36.6%) compared with neutral (25/181, 13.8%) or pro-choice (4/23, 17.4%; P<.001) sites. A negative search term used for the topic of safety (eg, “risks”) produced sites with lower trustworthiness scores than search terms with the word “safety” (median score 1.7 versus 3.7, respectively; P<.001).

Conclusions

People seeking information about the safety and potential risks of abortion are likely to encounter a substantial amount of untrustworthy and slanted/biased abortion information. Anti-choice sites are prevalent, often difficult to identify as anti-choice, and less trustworthy than neutral or pro-choice sites. Web searches may lead the public to believe abortion is riskier than it is.

Polyphonic perspectives on health and care: Reflections from two decades of the DIPEx project

In this article we consider how an online resource that publishes the findings and video, audio and written extracts from narrative interview studies has developed as an international collaboration, currently including 14 countries worldwide. In the two decades since the initiative was founded, the robust, national qualitative studies for DIPEx International have branched out from patient information and support to learning and teaching, insights and service improvement and cross-national comparisons. Embracing the challenge to reflect plural discourses of illness, health and care in societies that appear increasingly polarised, the DIPEx collaboration presents polyphonic perspectives that stand as potential counters to reductive dualities. As a result the collaboration has established a collection of unique, international resources that can be leveraged to promote understanding and learning from people's experiences of illness and care.

In-depth statistical analysis of the use of a website providing patients' narratives on lifestyle change when living with chronic back pain or coronary heart disease

OBJECTIVE

To investigate the use of lebensstil-aendern.de ("lifestyle change"), a website providing peer narratives of experiences with successful lifestyle change, and to analyze whether peer model characteristics, clip content, and media type have an influence on the number of visitors, dwell time, and exit rates.

METHODS

An in-depth statistical analysis of website use with multilevel regression analyses.

RESULTS

In two years, lebensstil-aendern.de attracted 12,844 visitors. The in-depth statistical analysis of usage rates demonstrated that audio clips were less popular than video or text-only clips, longer clips attracted more visitors, and clips by younger and female interviewees were preferred. User preferences for clip content categories differed between heart and back pain patients. Clips about stress management drew the smallest numbers of visitors in both indication modules.

CONCLUSIONS

Patients are interested in the experiences of others. Because the quality of information for user-generated content is generally low, healthcare providers should include quality-assured patient narratives in their interventions. User preferences for content, medium, and peer characteristics need to be taken into account.

PRACTICE IMPLICATIONS

If healthcare providers decide to include patient experiences in their websites, they should plan their intervention according to the different needs and preferences of users.

Employing the arts for knowledge production and translation: Visualizing new possibilities for women speaking up about safety concerns in maternity

OBJECTIVES

This project used animated film to translate research findings into accessible health information aimed at enabling women to speak up and secure professional help for serious safety concerns during pregnancy and after birth. We tested as proof of concept our use of the arts both as product (knowledge production) and process (enabling involvement).

BACKGROUND

Emergencies during pregnancy and birth, while unusual, can develop rapidly and unexpectedly, with catastrophic consequences. Women's tacit knowledge of changes in their condition is an important resource to aid early detection, but women can worry about the legitimacy of their concerns and struggle to get these taken seriously by staff.

DESIGN

Arts-based knowledge translation. A user group of women who had experienced complications in the perinatal period (n = 34) helped us develop and pilot test the animation. Obstetricians and midwives (15), clinical leads (3) and user group representatives (8) helped with the design and testing.

FINDINGS

The consultation process, script and storyboard enabled active interaction with the evidence, meaningful engagement with stakeholders and new understandings about securing help for perinatal complications. The method enabled us to address gender stereotypes and social norms about speaking up and embed a social script for women within the animation, to help structure their help seeking. While for some women, there was an emotional burden, the majority were glad to have been part of the animation's development and felt it had enabled their voices to be heard.

CONCLUSION

This project has demonstrated the benefits of arts-science collaborations for meaningful co-production and effective translation of research evidence.

A novel experience-based internet intervention for smoking cessation: feasibility randomised controlled trial

Background

The internet is frequently used to share experiences of health and illness, but this phenomenon has not been harnessed as an intervention to achieve health behaviour change. The aim of this study was to determine the feasibility of a randomised trial assessing the effects of a novel, experience-based website as a smoking cessation intervention. The secondary aim was to measure the potential impact on smoking behaviour of both the intervention and a comparator website.

Methods

A feasibility randomised controlled single-blind trial assessed a novel, experience-based website containing personal accounts of quitting smoking as a cessation intervention, and a comparator website providing factual information. Feasibility measures including recruitment, and usage of the interventions were recorded, and the following participant-reported outcomes were also measured: Smoking Abstinence Self-Efficacy Questionnaire, the single-item Motivation to Stop Scale, self-reported abstinence, quit attempts and health status outcomes. Eligible smokers from two English regions were entered into the trial and given access to their allocated website for two weeks.

Results

Eighty-seven smokers were randomised, 65 completed follow-up (75 %). Median usage was 15 min for the intervention, and 5 min for the comparator (range 0.5–213 min). Median logins for both sites was 2 (range 1–20). All participant-reported outcomes were similar between groups.

Conclusions

It was technically feasible to deliver a novel intervention harnessing the online sharing of personal experiences as a tool for smoking cessation, but recruitment was slow and actual use was relatively low, with attrition from the trial. Future work needs to maximize engagement and to understand how best to assess the value of such interventions in everyday use, rather than as an isolated ‘dose of information’.

Trial registration

ISRCTN29549695 DOI 10.1186/ISRCTN29549695. Registered 17/05/2013.