A comparison of three methods to generate a conceptual understanding of a disease based on the patients' perspective

Insights Into the Patient Experience of Hormone Therapy for Early Breast Cancer Treatment Using Patient Forum Discussions and Natural Language Processing

PURPOSE

Understanding the real-world experience of patients with early breast cancer (eBC) is imperative for optimizing outcomes and evolving patient care. However, there is a lack of patient-level data, hindering clinical development. This social listening study was performed to understand patient insights into symptoms and impacts of hormone therapy (HT) for eBC using posts from patient forums on breastcancer.org to inform future clinical research.

METHODS

Natural language processing (NLP) and machine learning techniques were used to identify themes related to eBC from a sample of 500,000 posts. After relevant data selection, 362,074 eBC posts were retained for further analysis of symptoms and impacts related to HT, as well as insights into symptom severity, pain locations, and symptom management using exercise and yoga.

RESULTS

Overall, 32 symptoms and nine impacts had significant associations with ≥one HT. Hot flush (relative risk [RR], 6.70 [95% CI, 3.36 to 13.36]), arthralgia (RR, 6.67 [95% CI, 3.53 to 12.59]), weight increased (RR, 4.83 [95% CI, 3.20 to 7.28]), mood swings (RR, 7.36 [95% CI, 5.75 to 9.42]), insomnia (RR, 4.76 [95% CI, 3.14 to 7.22]), and depression (RR, 3.05 [95% CI, 1.71 to 5.44]) demonstrated the strongest associations. Severe headache, dizziness, back pain, and muscle spasms showed significant associations with ≥one HT despite their low overall prevalence in eBC posts.

CONCLUSION

The social listening approach allowed the identification of real-world insights from posts specific to eBC HT from a large-scale online breast cancer forum that captured experiences from a uniquely diverse group of patients. Using NLP has a potential to scale analysis of patient feedback and reveal actionable insights into patient experiences of treatment that can inform the development of future therapies and improve the care of patients with eBC.

Patient listening on social media for patient-focused drug development: a synthesis of considerations from patients, industry and regulators

Patients, life science industry and regulatory authorities are united in their goal to reduce the disease burden of patients by closing remaining unmet needs. Patients have, however, not always been systematically and consistently involved in the drug development process. Recognizing this gap, regulatory bodies worldwide have initiated patient-focused drug development (PFDD) initiatives to foster a more systematic involvement of patients in the drug development process and to ensure that outcomes measured in clinical trials are truly relevant to patients and represent significant improvements to their quality of life. As a source of real-world evidence (RWE), social media has been consistently shown to capture the first-hand, spontaneous and unfiltered disease and treatment experience of patients and is acknowledged as a valid method for generating patient experience data by the Food and Drug Administration (FDA). While social media listening (SML) methods are increasingly applied to many diseases and use cases, a significant piece of uncertainty remains on how evidence derived from social media can be used in the drug development process and how it can impact regulatory decision making, including legal and ethical aspects. In this policy paper, we review the perspectives of three key stakeholder groups on the role of SML in drug development, namely patients, life science companies and regulators. We also carry out a systematic review of current practices and use cases for SML and, in particular, highlight benefits and drawbacks for the use of SML as a way to identify unmet needs of patients. While we find that the stakeholders are strongly aligned regarding the potential of social media for PFDD, we identify key areas in which regulatory guidance is needed to reduce uncertainty regarding the impact of SML as a source of patient experience data that has impact on regulatory decision making.

Identifying and developing strategies for implementation of a guided internet- and mobile-based infant sleep intervention in well-baby and community mental health clinics using group concept mapping

BACKGROUND

This study aimed to identify strategies for the implementation of a guided internet- and mobile-based intervention (IMI) for infant sleep problems ("Sleep Well, Little Sweetheart") in well-baby and community mental health clinics.

STUDY DESIGN

We used group concept mapping, a two-phased mixed methods approach, conducted as a two-day workshop in each clinic. We recruited 20 participants from four clinics and collected sorting and rating data for implementation strategies based on the Expert Recommendations for Implementing Change taxonomy and brainstorming sessions. Data were analyzed using descriptive statistics, multidimensional scaling, and hierarchical cluster analysis to create cluster maps, laddergrams, and Go-Zone graphs. Participants were presented with the results and discussed and interpreted the findings at each of the clinics in spring 2022.

RESULTS

Participants identified 10 clusters of strategies, of which Training, Embedding and Coherence, User Involvement and Participation, and Clinician Support and Implementation Counseling were rated as most important and feasible. Economy and Funding and Interactive and Interdisciplinary Collaboration were rated significantly lower on importance and feasibility compared to many of the clusters (all ps < 0.05). There was a correlation between the importance and feasibility ratings (r =.62, p =.004).

CONCLUSIONS

The use of group concept mapping made it possible to efficiently examine well-baby and community clinics' perspectives on complex issues, and to acquire specific knowledge to allow for the planning and prioritization of strategies for implementation. These results suggest areas of priority for the implementation of IMIs related to infant sleep problems.

TRIAL REGISTRATION

The study was pre-registered at Open Science Framework ( www.osf.io/emct8 ).

Exploring the Perspectives of Patients Living With Lupus: Retrospective Social Listening Study

BACKGROUND

Systemic lupus erythematosus (SLE) is a chronic autoimmune inflammatory disease affecting various organs with a wide range of clinical manifestations. Cutaneous lupus erythematosus (CLE) can manifest as a feature of SLE or an independent skin ailment. Health-related quality of life (HRQoL) is frequently compromised in individuals living with lupus. Understanding patients' perspectives when living with a disease is crucial for effectively meeting their unmet needs. Social listening is a promising new method that can provide insights into the experiences of patients living with their disease (lupus) and leverage these insights to inform drug development strategies for addressing their unmet needs.

OBJECTIVE

The objective of this study is to explore the experience of patients living with SLE and CLE, including their disease and treatment experiences, HRQoL, and unmet needs, as discussed in web-based social media platforms such as blogs and forums.

METHODS

A retrospective exploratory social listening study was conducted across 13 publicly available English-language social media platforms from October 2019 to January 2022. Data were processed using natural language processing and knowledge graph tagging technology to clean, format, anonymize, and annotate them algorithmically before feeding them to Pharos, a Semalytix proprietary data visualization and analysis platform, for further analysis. Pharos was used to generate descriptive data statistics, providing insights into the magnitude of individual patient experience variables, their differences in the magnitude of variables, and the associations between algorithmically tagged variables.

RESULTS

A total of 45,554 posts from 3834 individuals who were algorithmically identified as patients with lupus were included in this study. Among them, 1925 (authoring 5636 posts) and 106 (authoring 243 posts) patients were identified as having SLE and CLE, respectively. Patients frequently mentioned various symptoms in relation to SLE and CLE including pain, fatigue, and rashes; pain and fatigue were identified as the main drivers of HRQoL impairment. The most affected aspects of HRQoL included "mobility," "cognitive capabilities," "recreation and leisure," and "sleep and rest." Existing pharmacological interventions poorly managed the most burdensome symptoms of lupus. Conversely, nonpharmacological treatments, such as exercise and meditation, were frequently associated with HRQoL improvement.

CONCLUSIONS

Patients with lupus reported a complex interplay of symptoms and HRQoL aspects that negatively influenced one another. This study demonstrates that social listening is an effective method to gather insights into patients' experiences, preferences, and unmet needs, which can be considered during the drug development process to develop effective therapies and improve disease management.

Development and validation of a psoriasis treatment acceptability measure through group concept mapping

BACKGROUND

Psoriasis is a common autoimmune dermatologic condition which has a pronounced negative impact on patient quality of life and disease burden. Currently, there are a number of treatments available for psoriasis, with differences in efficacy, mechanism of action, mode of administration, adverse effects, and tolerability. However, a reliable, validated patient-reported instrument to address patient expectations and of psoriasis treatment has not been developed. This project was undertaken with the aim of developing a fit-for-purpose self-reported instrument to inform patient expectations and preferences of psoriasis treatments.

METHODS

Two studies, both utilizing qualitative and quantitative methods, were conducted in patients within the entire spectrum of psoriasis severity. In Study 1, a group concept mapping (GCM) exercise was conducted with dermatologists and moderate-to-severe psoriasis patients to identify concepts important in the treatment of psoriasis. In Study 2, a preliminary Treatment Acceptability Questionnaire (TAQ) was developed using GCM-derived concepts from Studies 1 and 2, followed by cognitive debriefing (CD) telephone interviews of the preliminary TAQ. In Study 2, another GCM exercise was conducted with mild and newly diagnosed psoriasis patients. Psychometric analyses were performed on the TAQ to evaluate validity and reliability.

RESULTS

The Study 1 GCM exercise generated 43 concepts from moderate-to-severe psoriasis patients (n = 20) and dermatologists (n = 10). In Study 2, 37 GCM concepts were generated from mild and newly diagnosed psoriasis patients (n = 20). From the 2 GCM exercises, 28 concepts were selected to form the preliminary TAQ; CD interviews indicated strong understanding and relevance of TAQ items among patients with disease ranging from mild to severe. The final TAQ consisted of 20 items; psychometric analysis demonstrated strong validity and reliability of the TAQ.

CONCLUSIONS

The TAQ is a novel psychometrically validated patient-reported instrument to inform healthcare providers of patients' expectations of and preferences for treatment of their psoriasis and can help in shared decision making between patients and physicians.

Individual Differences in the Patient Experience of Relapsing Multiple Sclerosis (RMS): A Multi-Country Qualitative Exploration of Drivers of Treatment Preferences Among People Living with RMS

AIMS

The aim of this study was to explore the experiences, values and preferences of people living with relapsing multiple sclerosis (PLwRMS) focusing on their treatments and what drives their treatment preferences.

METHODS

In-depth, semi-structured, qualitative telephone interviews were conducted using a purposive sampling approach with 72 PLwRMS and 12 health care professionals (HCPs, MS specialist neurologists and nurses) from the United Kingdom, United States, Australia and Canada. Concept elicitation questioning was used to elicit PLwRMS' attitudes, beliefs and preferences towards features of disease-modifying treatments. Interviews with HCPs were conducted to inform on HCPs' experiences of treating PLwRMS. Responses were audio recorded and transcribed verbatim and then subjected to thematic analysis.

RESULTS

Participants discussed numerous concepts that were important to them when making treatment decisions. Levels of importance participants placed on each concept, as well as reasons underpinning importance, varied substantially. The concepts with the greatest variability in terms of how much PLwRMS found them to be important in their decision-making process were mode of administration, speed of treatment effect, impact on reproduction and parenthood, impact on work and social life, patient engagement in decision making, and cost of treatment to the participant. Findings also demonstrated high variability in what participants described as their ideal treatment and the most important features a treatment should have. HCP findings provided clinical context for the treatment decision-making process and supported patient findings.

CONCLUSIONS

Building upon previous stated preference research, this study highlighted the importance of qualitative research in understanding what drives patient preferences. Characterized by the heterogeneity of the RMS patient experience, findings indicate the nature of treatment decisions in RMS to be highly individualized, and the subjective relative importance placed on different treatment factors by PLwRMS to vary. Such qualitative patient preference evidence could offer valuable and supplementary insights, alongside quantitative data, to inform decision making related to RMS treatment.

Comparison of Literature Review, Social Media Listening, and Qualitative Interview Research Methods in Generating Patient-Reported Symptom and Functional Impact Concepts of Presbyopia

INTRODUCTION

To compare the insights obtained about the experience of individuals with presbyopia (age-related impaired near vision) across three different sources of qualitative data: a structured targeted literature review, a social media listening (SML) review, and qualitative concept elicitation (CE) interviews with individuals with presbyopia and healthcare professionals (HCPs). The number of concepts identified, depth of data, cost and time implications, and value of the patient insights generated were explored and compared for each method.

METHODS

Keyword searches in bibliographic databases and review of abstracts identified 120 relevant publications; in-depth targeted literature review of the qualitative studies identified key symptoms/functioning concepts. SML was conducted using publicly accessible social media sources with focus on ophthalmologic diseases using a pre-defined search string. Relevant posts from individuals with presbyopia (n = 270) were analysed and key concepts identified. Semi-structured CE interviews were conducted with individuals with presbyopia (US n = 30, Germany n = 10, France n = 10), and HCPs (US = 3, France n = 2, Germany n = 1, Japan n = 1) who were experienced in treating presbyopia. Verbatim transcripts were coded using thematic analysis. A conceptual model summarised concepts identified across sources RESULTS: Out of the total of 158 concepts identified across the three sources, qualitative CE interviews yielded the highest number of concepts (n = 151/158, 96%), with SML yielding a third of the concepts (n = 51/158, 32%) and the literature review yielding the fewest concepts (n = 33/158, 21%). Qualitative CE interviews provided greater depth of data than SML and literature reviews. SML and literature reviews were less costly and quicker to run than qualitative CE interviews and also were less burdensome for participants.

CONCLUSION

Qualitative CE interviews are considered the gold standard in providing greater depth of understanding of the patient experience, and more robust data. However, research requirements, budget, and available time should be considered when choosing the most appropriate research method. More time and cost-effective SML and literature review methods can be used to supplement qualitative CE interview data and provide early identification of measurement concepts. More research and regulatory guidance into less traditional qualitative methods, however, are needed to increase the value of SML and literature review data.

A Social Media Listening Study to Understand the Unmet Needs and Quality of Life in Adult and Pediatric Amblyopia Patients

INTRODUCTION

Amblyopia is an important cause of monocular vision impairment worldwide, and it negatively impacts patients' quality of life (QoL). Understanding patients' perspectives may help to optimize treatment outcomes and improve treatment adherence.

METHODS

This was a non-interventional, retrospective analysis of social media data available in the public domain posted by patients and caregivers on selected social media channels (Twitter®, forums, blogs, and news) from 12 countries between July 2018 and June 2020.

RESULTS

Approximately 2662 conversations relevant to the research objective were analyzed. The patient journey for adults and children was constructed based on the conversations. Eyeglasses, eye patches, contact lenses, and vision exercises were the common treatment options for amblyopia. Patients also reported vision improvement with emerging technologies such as digital therapeutics. Amblyopia and its treatment had a negative impact on QoL, and increased caregiver burden. Insurance coverage, long appointment waiting times, and recurring expenses of treatment options were reported as barriers to treatment. Non-compliance, switching between treatment options or technology, or discontinuation of treatment options was found to emanate from various issues including no improvement of the condition, discomfort with the treatment option, bullying, dissatisfaction with healthcare professional (HCP) recommendation, cost of treatment/issues with insurance coverage, side effects, and/or other unspecified reasons. The need for regular eye examinations, better diagnostic tests, awareness of the disease, awareness amongst HCPs about treatment options, and the need for better health insurance coverage policies emerged as unmet needs.

CONCLUSION

This social media listening study generated insights on patients with amblyopia and their caregivers regarding the patient journey, treatment options, reasons for non-compliance, reasons for switching HCPs, barriers to treatment, and unmet needs. Further qualitative research is required to validate the findings.

Living with a left ventricular assist device: Capturing recipients experiences using group concept mapping software

Background

Left ventricular assist device (LVAD) implantation significantly impacts on a recipient’s symptoms and quality of life. Capturing their experiences and post implant journey is an important part of clinical practice, research and device design evolution. Patient reported outcome measures (PROMs) are a useful tool for capturing that experience. However, patient reported outcome measures need to reflect recipients’ experiences. Discussions with a patient partner group found that none of the frequently used cardiology PROMs captured their unique experiences.

Aims

To capture the experiences and important issues for LVAD recipients. Develop a conceptual map of domains and items that should be reflected in patient reported outcomes.

Methods

Group concept mapping (GCM) web-based software was used to remotely capture and structure recipients’ experiences across a wide geographical area. GCM is a semi-quantitative mixed method consisting of 3 stages: item generation, item sorting and rating (importance, relevance and frequency). Patient partners were involved in all aspects of the study design and development.

Results

18 LVAD recipients consented to take part. 101 statements were generated and multi-dimensional scaling, and hierarchical cluster analysis identified 9 clusters. Cluster themes included: Activities, Partner/family support, Travel, Mental wellbeing, Equipment and clothing, Physical and cognitive limitations, LVAD Restrictions, LVAD Challenges and positive impact of the LVAD (LVAD Positives). LVAD Positives were scored highest across all the rating variables, e.g., frequency (2.85), relevance (2.44) and importance (2.21). Other domains rated high for importance included physical and cognitive limitations (2.19), LVAD restrictions (2.11), Partner/family support (2.02), and Equipment and clothing (2.01).

Conclusion

Online GCM software facilitated the inclusion of geographically dispersed recipients and provided useful insights into the experiences of LVAD recipients. The conceptual framework identifies important domains and items that should be prioritised and included in patient reported outcomes in future research, LVAD design evolution, and clinical practice.

Quality of life (QoL) for people with primary sclerosing cholangitis (PSC): a pragmatic strategy for identifying relevant QoL issues for rare disease

BACKGROUND

Primary sclerosing cholangitis (PSC) is a rare incurable disease of the bile ducts and liver which can significantly impair quality of life (QoL). No existing QoL tools are entirely suitable for people living with PSC (PwPSC). We aimed to develop a measure of QoL for PwPSC in the UK, beginning by identifying relevant QoL issues. This paper describes our approach to this first stage, and discusses related benefits and limitations.

METHODS

Scientific consensus on how to reliably stage PSC is lacking, due to its rarity and heterogeneity. We initially hypothesised four categories for PSC severity. After beginning the study, these were revised to six. For such a rare disease, the study could not recruit sufficient participants in each of these categories, particularly the more severe, in the time available. We therefore modified the design, adapting standard methodology for identifying potentially relevant issues. We started by conducting a thematic analysis of data from a previous survey of PwPSC, and extracting QoL issues from a literature review of QoL questionnaires of relevance to PwPSC. We then conducted group and individual interviews with PwPSC and clinicians, investigating the relevance, importance, phrasing, and breadth of coverage of issues identified. We also explored the validity of our hypothesised categories for disease severity.

RESULTS

We identified 1,052 potentially relevant QoL issues from the survey and literature review and took 396 of these forwards for discussion with 28 PwPSC. We found 168/396 issues were considered relevant by ≥ 60% of these participants. We then discussed this subset of 168 issues with 11 clinicians. PSC and clinician participants identified some problematic phrasing with 19 issues, due to potential upset (n = 12) or problems with understanding (n = 7). We included one new issue from those suggested.

CONCLUSION

We identified a range of QoL issues relevant to PwPSC, with a good breadth of coverage, although lacking an in-depth understanding of the PSC experience. Our strategy effectively identified relevant QoL issues for people living with this rare condition, for which there is no consensus on stratifying for its severity. This strategy should however be considered specific to such circumstances, not a general recommendation for an alternative approach.

Social Media Listening to Understand the Lived Experience of Individuals in Europe With Metastatic Breast Cancer: A Systematic Search and Content Analysis Study

Background

Despite a wealth of real-world data on metastatic breast cancer (mBC), insights into the lived experience are lacking. This study aimed to explore how the lived experience of mBC is described on social media.

Methods

A predefined search string identified posts relevant to the lived experience of mBC from Twitter, patient forums, and blogs across 14 European countries. The final data set was analyzed using content analysis.

Results

A total of 76,456 conversations were identified between November 1, 2018, and November 30, 2020. Twitter was the most commonly used social media platform across all 76,456 conversations from the raw data set (n = 61,165; 80%). Automated and manual relevancy checks followed by a final random sampling filter identified 820 conversations for content analysis. The majority of data from the raw data set was generated from the United Kingdom (n = 31,346; 41%). From this final data set, 61% of posts were authored by patients, 15% by friends and/or family members of patients, and 14% by caregivers. A total of 686 conversations described the patient journey (n = 686/820; 84%); 64% of these (n = 439) concerned breast cancer treatment, with approximately 40% of discussions regarding diagnosis and tests (n = 274/686) and less than 20% of discussions surrounding disease management (n = 123/686; 18%). Key themes relating to a lack of effective treatment, prolonged survival and associated quality of life, debilitating consequences of side effects, and the social impacts of living with mBC were identified.

Conclusions

The findings from this study provided an insight into the lived experience of mBC. While retrospective data collection inherently limits the amount of demographic or clinical information that can be obtained from the population sample, social media listening studies offer training to healthcare professionals in communication, the importance of quality of life, organization of healthcare, and even the design of clinical trials. As new targeted therapies are gradually incorporated into clinical practice, innovative technologies, such as social media listening, have the potential to support regulatory procedures and drug toxicity monitoring, as well as provide the patient voice in the regulation of new and existing medicines.

Applications of quantitative social media listening to patient-centric drug development

Social media listening has been increasingly acknowledged as a tool with applications in many stages of the drug development process. These applications were created to meet the need for patient-centric therapies that are fit-for-purpose and meaningful to patients. Such applications, however, require the leverage of new quantitative approaches and analytical methods that draw from developments in artificial intelligence and real-world data (RWD) analysis. Here, we review the state-of-the-art in quantitative social media listening (QSML) methods applied to drug discovery from the perspective of the pharmaceutical industry.

Understanding the Lived Experience of Patients with Melanoma: Real-World Evidence Generated through a European Social Media Listening Analysis (Preprint)

Background

Cutaneous melanoma is an aggressive malignancy that is proposed to account for 90% of skin cancer–related mortality. Individuals with melanoma experience both physical and psychological impacts associated with their diagnosis and treatment. Health-related information is being increasingly accessed and shared by stakeholders on social media platforms.

Objective

This study aimed to assess how individuals living with melanoma across 14 European countries use social media to discuss their needs and provide their perceptions of the disease.

Methods

Social media sources including Twitter, forums, and blogs were searched using predefined search strings of keywords relating to melanoma. Manual and automated relevancy approaches filtered the extracted data for content that provided patient-centric insights. This contextualized data was then mined for insightful concepts around the symptoms, diagnosis, treatment, impacts, and lived experiences of melanoma.

Results

A total of 182,400 posts related to melanoma were identified between November 2018 and November 2020. Following exclusion of irrelevant posts and using random sampling methodology, 864 posts were identified as relevant to the study objectives. Of the social media channels included, Twitter was the most commonly used, followed by forums and blogs. Most posts originated from the United Kingdom (n=328, 38%) and Spain (n=138, 16%). Of the relevant posts, 62% (n=536) were categorized as originating from individuals with melanoma. The most frequently discussed melanoma-related topics were treatment (436/792, 55%), diagnosis and tests (261/792, 33%), and remission (190/792, 24%). The majority of treatment discussions were about surgery (292/436, 67%), followed by immunotherapy (52/436, 12%). In total, 255 posts discussed the impacts of melanoma, which included emotional burden (n=179, 70%), physical impacts (n=61, 24%), effects on social life (n=43, 17%), and financial impacts (n=10, 4%).

Conclusions

Findings from this study highlight how melanoma stakeholders discuss key concepts associated with the condition on social media, adding to the conceptual model of the patient journey. This social media listening approach is a powerful tool for exploring melanoma stakeholder perspectives, providing insights that can be used to corroborate existing data and inform future studies.

A Neural Network Approach for Understanding Patient Experiences of Chronic Obstructive Pulmonary Disease (COPD): Retrospective, Cross-sectional Study of Social Media Content

Background

The abundance of online content contributed by patients is a rich source of insight about the lived experience of disease. Patients share disease experiences with other members of the patient and caregiver community and do so using their own lexicon of words and phrases. This lexicon and the topics that are communicated using words and phrases belonging to the lexicon help us better understand disease burden. Insights from social media may ultimately guide clinical development in ways that ensure that future treatments are fit for purpose from the patient’s perspective.

Objective

We sought insights into the patient experience of chronic obstructive pulmonary disease (COPD) by analyzing a substantial corpus of social media content. The corpus was sufficiently large to make manual review and manual coding all but impossible to perform in a consistent and systematic fashion. Advanced analytics were applied to the corpus content in the search for associations between symptoms and impacts across the entire text corpus.

Methods

We conducted a retrospective, cross-sectional study of 5663 posts sourced from open blogs and online forum posts published by COPD patients between February 2016 and August 2019. We applied a novel neural network approach to identify a lexicon of community words and phrases used by patients to describe their symptoms. We used this lexicon to explore the relationship between COPD symptoms and disease-related impacts.

Results

We identified a diverse lexicon of community words and phrases for COPD symptoms, including gasping, wheezy, mucus-y, and muck. These symptoms were mentioned in association with specific words and phrases for disease impact such as frightening, breathing discomfort, and difficulty exercising. Furthermore, we found an association between mucus hypersecretion and moderate disease severity, which distinguished mucus from the other main COPD symptoms, namely breathlessness and cough.

Conclusions

We demonstrated the potential of neural networks and advanced analytics to gain patient-focused insights about how each distinct COPD symptom contributes to the burden of chronic and acute respiratory illness. Using a neural network approach, we identified words and phrases for COPD symptoms that were specific to the patient community. Identifying patterns in the association between symptoms and impacts deepened our understanding of the patient experience of COPD. This approach can be readily applied to other disease areas.

A Patient-Centered Conceptual Model of Symptoms and Their Impact in Early Parkinson's Disease: A Qualitative Study

Background:

Individuals with Parkinson’s disease (PD) develop a significant disease burden over time that contributes to a progressive decline in health-related quality of life. There is a paucity of qualitative research to understand symptoms and impacts in individuals with early-stage PD (i.e., Hoehn and Yahr stage 1–2 and ≤2 years since diagnosis).

Objective:

The collection of qualitative data to inform the selection of clinical outcome assessments for clinical trials is advocated by regulators. This patient-centered, multistage study sought to create a conceptual model of symptoms and their impact for individuals with early-stage PD.

Methods:

Symptoms and impacts of PD were gathered from a literature review of qualitative research, a quantitative social media listening analysis, and qualitative patient concept elicitation interviews (n = 35). Clinical experts provided input to validate and finalize the concepts.

Results:

The final conceptual model consisted of 27 symptoms categorized into ‘motor’ or ‘non-motor’ domains, and 39 impacts divided into five domains. Most frequently reported symptoms in early-stage PD were ‘tremors’ (89%), ‘stiffness and rigidity’, and ‘fatigue’ (69%, both). Most frequently reported impacts included ‘anxiety’ (74%), ‘eating and drinking’ (71%), followed by ‘exercise/sport’ and ‘relationship with family/family life’ (66%, both).

Conclusion:

This study provides initial insights relating to the symptom and impact burden of early-stage PD patients. The conceptual model can be used to help researchers to develop and select optimal patient-centered outcomes to measure treatment benefit in clinical trials. These findings could inform future qualitative research and the development of outcomes specifically for early-stage PD patients.

Construction of a conceptual framework for assessment of health-related quality of life in calves with respiratory disease

Bovine respiratory disease (BRD) is one of the most prevalent diseases affecting beef and dairy calves worldwide, with implications for lifetime productivity, antimicrobial use and animal welfare. Our objective was to construct a conceptual framework for assessment of health-related quality of life (HRQL) in calves with respiratory disease, based on indicators suitable for direct pen-side visual observation. Health-related quality of life measures aim to evaluate the subjective experience of the animal rather than any related pathology. A conceptual framework graphically represents the concepts to be measured and the potential relationships between them. A multistage, mixed method approach involving diverse data sources, collection methods and stakeholders was applied to promote comprehensiveness, understanding and validity of findings. A scoping review was conducted to identify, characterize and collate evidence of behavioural indicators of BRD. The indicators identified were mapped against the principal attributes of five prominent animal welfare assessment frameworks to appraise their correspondence with different characterizations of the dimensions of welfare. Forty-two semi-structured, individual, qualitative interviews with a purposeful sample of experienced veterinarians and stockpersons from UK, USA and Canada elicited in-depth descriptions of the visual observations of HRQL they make in diagnosing and assessing the response to treatment of calves with BRD. Verbatim interview transcripts were examined using inductive thematic analysis. Respondents provided insights and understanding of indicators of HRQL in BRD such as interaction with feed source, hair coat condition, specific characteristics of eye appearance, eye contact, rumen fill and stretching (pandiculation). In an on-farm pilot study to assess the value of potential HRQL behavioural indicators, there was a moderate positive correlation between behaviour and clinical scores (r_s = 0.59) across the 5 days preceding veterinary treatment for BRD. Interestingly, the behaviours evaluated were observed a median of 1.0 (interquartile range: 1.0-3.5) days before clinical indicators used in the scoring system. The proposed conceptual framework for assessment of HRQL features 23 putative indicators of HRQL distributed across two interrelated domains - clinical signs and behavioural expressions of emotional well-being. It has potential applications to inform the development of new HRQL measures such as structured questionnaires and automated sensor technologies.

A qualitative exploration of the patient experience of erosive and non-erosive hand osteoarthritis

BACKGROUND

Many patients with hand osteoarthritis (HOA) experience reduced health-related quality of life. This study sought to better understand the disease and treatment experience of individuals with HOA, explore any differences in experiences between erosive and non-erosive HOA sub-types, and evaluate content validity of the Michigan Hand Outcomes Questionnaire (MHQ) in HOA.

METHODS

Thirty subjects from the United States (n = 15 erosive HOA; n = 15 non-erosive HOA) participated in semi-structured interviews: concept elicitation explored symptoms/impacts important to patients; cognitive interviews assessed understanding and relevance of the MHQ. A sub-sample participated in real-time data capture (RTDC) activities via a smartphone/tablet app over 7 days. Verbatim transcripts were coded using Atlas.ti software and thematically analyzed. Concept saturation and MHQ content validity were evaluated.

RESULTS

Most participants reported experiencing pain, swelling and stiffness, symptoms that most commonly had a direct impact on physical functioning. Substantial impacts on activities of daily living, emotional functioning, sleep and work were also reported. RTDC findings corroborated concept elicitation findings. There were no notable differences between erosive and non-erosive HOA, except nodules were reported more frequently in erosive disease. Most participants used analgesic treatments, but effects were short-lived. Pain was the symptom most frequently reported as most bothersome and important to treat. Concept saturation was achieved. MHQ items and instructions were well understood and relevant to most participants; stiffness and swelling were reported as important symptoms not included in the MHQ.

CONCLUSIONS

This study characterizes key symptoms of HOA which are burdensome for patients and not well controlled by current therapies, highlighting an unmet treatment need. Although the study is limited by a small sample size that may not be representative of the broader erosive and non-erosive HOA population, concept saturation was achieved, and our findings suggest that disease experience is similar for patients with erosive and non-erosive HOA. Evaluation of stiffness and swelling items in conjunction with the MHQ may enhance relevance and improve measurement precision to assess important domains of HQRoL in an HOA population.

Recruitment strategies and geographic representativeness for patient survey studies in rare diseases: Experience from the living with myeloproliferative neoplasms patient survey

Background

Recruitment of individuals with rare diseases for studies of real-world patient-reported outcomes is limited by small base populations. Myeloproliferative neoplasms (MPNs) are a group of rare, chronic, hematologic malignancies. In this study, recruitment strategies and geographic representativeness from the Living with MPNs survey are reported.

Methods

The Living with MPNs online cross-sectional survey was conducted between April and November 2016. Individuals 18 to 70 years of age living in the United States and diagnosed with an MPN were eligible to participate. Recruitment approaches included direct contact via emails and postcards; posts on MPN-focused social media and patient advocacy websites; postcard mailings to doctors’ offices; and advertisements on medical websites, Google, and Facebook. Geographic representativeness was assessed based on the number of survey respondents living in each state or the District of Columbia and by the number of survey respondents per 10 million residents.

Results

A total of 904 respondents with MPNs completed the survey. The recruitment method yielding the greatest number of respondents was advertisements on MPN-focused social media (47.6% of respondents), followed by emails (35.1%) and postcards (13.9%) sent through MPN advocacy groups. Home state information was provided by 775 respondents from 46 states (range of respondents per state, 1–89). The number of respondents per 10 million residents in the 46 states with respondents ranged from 12.1 to 52.7.

Conclusions

Recruitment using social media and communications through patient groups and advocacy organizations are effective in obtaining geographically representative samples of individuals with MPNs in the United States. These approaches may also be effective in other rare diseases.

Social Media Listening to Understand the Lived Experience of Presbyopia: Systematic Search and Content Analysis Study

BACKGROUND

Presbyopia is defined as the age-related deterioration of near vision over time which is experienced in over 80% of people aged 40 years or older. Individuals with presbyopia have difficulty with tasks that rely on near vision. It is not currently possible to stop or reverse the aging process that causes presbyopia; generally, it is corrected with glasses, contact lenses, surgery, or the use of a magnifying glass.

OBJECTIVE

This study aimed to explore how individuals used social media to describe their experience of presbyopia with regard to the symptoms experienced and the impacts of presbyopia on their quality of life.

METHODS

Social media sources including Twitter, forums, blogs, and news outlets were searched using a predefined search string relating to symptoms and impacts of presbyopia. The data that were downloaded, based on the keywords, underwent manual review to identify relevant data points. Relevant posts were further manually analyzed through a process of data tagging, categorization, and clustering. Key themes relating to symptoms, impacts, treatment, and lived experiences were identified.

RESULTS

A total of 4456 social media posts related to presbyopia were identified between May 2017 and August 2017. Using a random sampling methodology, we selected 2229 (50.0%) posts for manual review, with 1470 (65.9%) of these 2229 posts identified as relevant to the study objectives. Twitter was the most commonly used channel for discussions on presbyopia compared to forums and blogs. The majority of relevant posts originated in Spain (559/1470, 38.0%) and the United States (426/1470, 29.0%). Of the relevant posts, 270/1470 (18.4%) were categorized as posts written by individuals who have presbyopia, of which 37 of the 270 posts (13.7%) discussed symptoms. On social media, individuals with presbyopia most frequently reported experiencing difficulty reading small print (24/37, 64.9%), difficulty focusing on near objects (15/37, 40.5%), eye strain (12/37, 32.4%), headaches (9/37, 24.3%), and blurred vision (8/37, 21.6%). 81 of the 270 posts (30.0%) discussed impacts of presbyopia-emotional burden (57/81, 70.4%), functional or daily living impacts (46/81, 56.8%), such as difficulty reading (46/81, 56.8%) and using electronic devices (21/81, 25.9%), and impacts on work (3/81, 3.7%).

CONCLUSIONS

Findings from this social media listening study provided insight into how people with presbyopia discuss their condition online and highlight the impact of presbyopia on individuals' quality of life. The social media listening methodology can be used to generate insights into the lived experience of a condition, but it is recommended that this research be combined with prospective qualitative research for added rigor and for confirmation of the relevance of the findings.

Using a digital patient powered research network to identify outcomes of importance to patients with multiple myeloma

Background

Social media platforms give patients a voice by allowing them to discuss their health and connect with others. These unfiltered and genuine reports offer direct access to what matters most to patients. Exploring the patient-reported outcomes discussed in these platforms reveal clinical insights and behavioral patterns of the real-world patient journey. This research study reviewed health-related quality of life (HRQoL) concepts reported by patients with multiple myeloma (MM).

Methods

Data were obtained using the Belong.life patient-powered research network (PPRN) using social media listening methods. The analysis cohort consisted of adults diagnosed with MM who signed into the Belong.life platform by June 2018. Natural language processing and medical neural networks were utilized to extract text data to mine and scan for concepts using programmed algorithms. The textual review of the data was conducted on two levels: the over-arching concept of interest (broad symptom and impact classification) and the more specific symptom and impacts report. Concepts were analyzed descriptively and summarized by age, gender, context of report, and stage of disease/treatment journey.

Results

Two hundred thirty patients with MM from the United States (52%), Israel (42%), Canada (3%), and 3% from Egypt, France, Greece, India, United Kingdom, and Australia were identified. A total of 57% were female and at account registration the median age was 57 years. A total of 126 patients had evaluable text data to search concepts being discussed. The PPRN platform identified 93% of the concepts from the conceptual model developed based on prior literature review. The most commonly reported symptoms were neuropathy, tiredness, nausea, back pain, fatigue, and bone pain. Back pain appeared as the most prominent symptom early in the disease and sometimes occurred prior to MM diagnosis. Tiredness, nausea, fatigue, and bone pain were frequently reported after MM diagnosis, with the start of treatment.

Conclusion

Patient-oriented social media platforms, such as Belong.life, can capture and contribute to a holistic vision of concepts surrounding patients’ HRQoL. The ability to understand when a certain debilitating symptom appeared and to which sub-population of patients may allow for a personalized approach to treatment, improving adherence and quality of care as well as increasing patient well-being.

Outcome measures based on digital health technology sensor data: data- and patient-centric approaches

Digital health technology tools (DHTT) are technologies such as apps, smartphones, and wearables that remotely acquire health-related information from individuals. They have the potential advantages of objectivity and sensitivity of measurement, richness of high-frequency sensor data, and opportunity for passive collection of health-related data. Thus, DHTTs promise to provide patient phenotyping at an order of granularity several times greater than is possible with traditional clinical research tools. While the conceptual development of novel DHTTs is keeping pace with technological and analytical advancements, an as yet unaddressed gap is how to develop robust and meaningful outcome measures based on sensor data. Here, we describe two roadmaps which were developed to generate outcome measures based on DHTT data: one using a data-centric approach and the second a patient-centric approach. The data-centric approach to develop digital outcome measures summarizes those sensor features maximally sensitive to the concept of interest, exemplified with the quantification of disease progression. The patient-centric approach summarizes those sensor features that are optimally relevant to patients' functioning in everyday life. Both roadmaps are exemplified for use in tracking disease progression in observational and clinical interventional studies, and with a DHTT designed to evaluate motor symptom severity and symptom experience in Parkinson's disease. Use cases other than disease progression (e.g., case-finding) are considered summarily. DHTT research requires methods to summarize sensor data into meaningful outcome measures. It is hoped that the concepts outlined here will encourage a scientific discourse and eventual consensus on the creation of novel digital outcome measures for both basic clinical research and clinical drug development.

Identification of Patient Needs and Preferences in Pigmented Villonodular Synovitis (PVNS) Using a Qualitative Online Bulletin Board Study

Introduction

Pigmented villonodular synovitis (PVNS), also known as giant-cell tumour of the tendon sheath (GCTT), is a rare, benign proliferative tumour affecting the inner lining of synovial joints and tendon sheets. Information on treatment needs of PVNS patients to inform drug development is currently scarce. We conducted an exploratory qualitative study with PVNS patients to generate insights into the objective and emotional aspects related to their medical journey and experiences of living with this disease.

Methods

A 4-day study using an online bulletin board (OBB), an asynchronous, online qualitative research platform, was conducted with patients recruited via physician referral who underwent screening questions to ensure eligibility for the study and willingness to participate. The discussion was moderated, was structured and allowed open answers in response to other participants’ posts.

Results

Eleven patients (4 from the USA, 4 from the UK and 3 from Canada; 45% female), aged 28–57 years, suffering from PVNS for 2–27 years participated in the study. Key patient insights from the study were: (1) pain was the topmost, spontaneous thought that the participants associated with PVNS, constituting a significant emotional and psychological burden; (2) surgery (arthroscopy) did not completely ameliorate symptoms associated with PVNS, as the relapse rate was high in these patients; (3) PVNS has a substantial negative financial impact on patients, their families and the healthcare system; (4) orthopaedic specialists/surgeons predominantly managed PVNS, as surgery is currently the only therapeutic option.

Conclusion

PVNS patients expressed an urgent need for a medical drug treatment, which can reduce pain, avoid relapses and provide an alternative to surgery, the current standard of care.

Electronic Supplementary Material

The online version of this article (10.1007/s12325-020-01364-4) contains supplementary material, which is available to authorized users.

Using Social Media to Uncover Treatment Experiences and Decisions in Patients With Acute Myeloid Leukemia or Myelodysplastic Syndrome Who Are Ineligible for Intensive Chemotherapy: Patient-Centric Qualitative Data Analysis

Background

Until recently, treatment options were limited for patients with acute myeloid leukemia and myelodysplastic syndrome (AML and MDS) who are ineligible for intensive chemotherapy. Owing to the condition’s rapid progression, it is difficult to identify what is most important to patients when making treatment decisions. Patients’ needs can be better addressed by gaining a deeper understanding of their perspectives, which is valuable in the decision-making process. The Food and Drug Administration recently encouraged the use of social media as a tool to gain insight on patients’ perspectives regarding symptoms experienced and the impacts of their disease.

Objective

This study aimed to use disease-specific social media posts by patients with AML or MDS who are ineligible for intensive chemotherapy and their caregivers to capture factors they feel are most important, and to provide current evidence to inform and characterize these perspectives.

Methods

Posts by patients with AML or MDS and their caregivers were extracted from publicly available discussions on 3 large AML- or MDS–specific sites. These posts were manually reviewed to only include patients who are ineligible for intensive chemotherapy. A total of 1443 posts from 220 AML patients/caregivers and 2733 posts from 127 MDS patients/caregivers met the study inclusion criteria. A qualitative data analysis (QDA) of a sample of 85 patients’/caregivers’ posts was conducted to identify themes, and a targeted QDA of posts from 79 users focused on treatment decision discussions. Posts were manually reviewed, and relevant text segments were coded and grouped into categories and overall themes.

Results

Eighty-six percent (73/85) of users in the overall QDA had relevant information about the key objectives. The most commonly discussed treatment experience theme was the humanistic burden of AML or MDS in terms of emotional/physical impact and impact on family (86%, 63/73 of users), followed by treatment decisions (56%, 41/73) and unmet needs (50%, 37/73). In the QDA of treatment decisions, 60 posts from 45 users contained relevant information. Patients commonly reported the desire to reach specific milestones, including birthdays and weddings. They wished for a better quality of life over quantity of life, did not want the risk of suffering from side effects, and expressed a clear preference to be at home rather than in a hospital or care home.

Conclusions

This study was a novel application of disease-specific social media. It highlighted experiences in the current treatment of AML and MDS, including information gaps, patient/caregiver uncertainty, and the importance of understanding patients’/caregivers’ goals and opinions. A clear finding from this research was the importance of reaching certain personal life goals and being at home with family and friends. The analysis showed that patients/caregivers face additional challenges, including humanistic impacts and a lack of information regarding treatment options.

An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments

Establishing meaningful change thresholds for Clinical Outcome Assessments (COA) is critical for score interpretation. While anchor- and distribution-based statistical methods are well-established, qualitative approaches are less frequently used. This commentary summarizes and expands on a symposium presented at the International Society for Quality of Life Research (ISOQOL) 2017 annual conference, which provided an overview of qualitative methods that can be used to support understanding of meaningful change thresholds on COAs. Further published literature and additional examples from multiple disease areas which have also qualitatively explored the concept of meaningful change are presented.Semi-structured interviews conducted independently from a clinical trial, exit interviews conducted in the context of a clinical trial, focus groups, vignettes and the Delphi panel method can be used to obtain data regarding meaningful change thresholds, with advantages and disadvantages to each method. Semi-structured interviews using concept elicitation (CE) or cognitive debriefing (CD) methods conducted independently from a clinical trial can be an efficient way to gain in-depth patient/caregiver insights. However, there can be challenges with reconciling heterogeneous data across diverse samples and in interpreting the qualitative insights in the context of quantitative score changes. Semi-structured qualitative interviews using CE/CD methods embedded as exit interviews in a clinical trial context with patients/caregivers can provide insights which can augment quantitative findings based on analysis of clinical trial data. However, there are logistical challenges relating to embedding the interviews in a clinical trial.Focus groups and the Delphi panel method can be valuable for reaching consensus regarding meaningful change thresholds; however, for face-to-face interactions, social desirability bias can affect responses. Finally, using vignettes and taking a mixed methods approach can aid in achieving consensus on the minimum score change endorsed by respondents as a meaningful improvement/decrement. However, the approach can be cognitively challenging for participants and reaching a consensus is not guaranteed.Anchor- and distribution- based methods remain critical in establishing responder definitions. Nonetheless, qualitative data has the potential to provide complementary support that a certain level of change on the target COA, which has been statistically supported, is truly important and meaningful for the target population.

Understanding Patient Preferences and Unmet Needs in Non-alcoholic Steatohepatitis (NASH): Insights from a Qualitative Online Bulletin Board Study

Introduction

The aim of this work was to understand how patients with non-alcoholic steatohepatitis (NASH) perceive their disease, unmet needs, and expectations regarding future treatment through online bulletin board (OBB) qualitative research.

Methods

OBB is an asynchronous online qualitative market research tool that provides an open forum for interactive discussion among participants. Patients with NASH were recruited via physician referral and completed a screener questionnaire to ensure their eligibility and willingness to participate. A trained moderator managed the discussion that allowed open answers and responses to other participants’ posts. Patient responses were analyzed using a combination of different qualitative analytical tools.

Results

The OBB ran for 4 days and included 16 patients (n = 8, UK; n = 8, US) with NASH (fibrosis stages F1–F3) and comorbidities including diabetes/prediabetes (n = 9) and obesity (n = 12). The key insights were (1) patients with NASH have a poor understanding of the disease, its progression, and management—they feel a lack of adequate educational support from their physicians; (2) diagnosis of NASH is incidental in most cases, mainly because patients fail to spontaneously associate their signs or symptoms with their liver condition; (3) comorbidities (obesity and diabetes) are more concerning to patients than NASH; and (4) patients perceive that NASH impacts their social life and work performance in more advanced stages.

Conclusions

This OBB provided valuable patient insights into NASH disease perception and management and revealed unmet need areas. In light of no approved therapies, these patient insights can inform early drug development strategies and stakeholder discussions on NASH.

Funding

Novartis Pharma AG, Basel.

Electronic supplementary material

The online version of this article (10.1007/s12325-018-0856-0) contains supplementary material, which is available to authorized users.

The power of the group: comparison of interviews and group concept mapping for identifying patient-important outcomes of care

BACKGROUND

Data are limited regarding how to effectively and efficiently identify patient priorities for research or clinical care. Our goal was to compare the comprehensiveness and efficiency of group concept mapping (GCM), a group participatory method, to interviews for identifying patient goals when seeking care.

METHODS

We engaged patients with moderately- to poorly-controlled diabetes mellitus in either GCM or an individual interview. The primary outcome was the comprehensiveness of GCM brainstorming (the first stage of GCM) as compared to interviews for eliciting patient-important outcomes (PIOs) related to seeking care. Secondary outcomes included 1) comprehensiveness of GCM brainstorming and interviews compared to a master list of PIOs and 2) efficiency of GCM brainstorming, the entire GCM process and interviews.

RESULTS

We engaged 89 interview participants and 52 GCM participants (across 3 iterations of GCM) to identify outcomes most important to patients when making decisions related to diabetes management. We identified 26 PIOs in interviews, 33 PIOs in the first GCM brainstorming session, and 38 PIOs across all three GCM brainstorming sessions. The initial GCM brainstorming session identified 77% (20/26) of interview PIOs, and all 3 GCM brainstorming sessions combined identified 88% (23/26). When comparing GCM brainstorming and interviews to the master list of PIOs, the initial GCM brainstorming sessions identified 80% (33/41), all 3 GCM brainstorming sessions identified 93% (38/41) and interviews identified 63% (26/41) of all PIOs. Compared to interviews, GCM brainstorming required less research team time, more patient time, and had a lowest cost. The entire GCM process still required less research team time than interviews, though required more patient time and had a higher cost than interviews.

CONCLUSIONS

GCM brainstorming is a powerful tool for effectively and efficiently identifying PIOs in certain scenarios, though it does not provide the breadth and depth of individual interviews or the higher level conceptual organization of the complete process of GCM. Selection of the optimal method for patient engagement should include consideration of multiple factors including depth of patient input desired, research team expertise, resources, and the population to be engaged.

TRIAL REGISTRATION

Registered on ClinicalTrials.gov , NCT02792777. Registration information submitted 6/2/2016, with the registration first posted on the ClinicalTrials.gov website 6/8/2016. Data collection began on 4/29/2016.

Incorporating patients' perspectives into the initial stages of core outcome set development: a rapid review of qualitative studies of type 2 diabetes

Conducting systematic reviews of qualitative studies to incorporate patient perspectives within the early stages of core outcome set (COS) development can be resource intensive. We aimed to identify an expedited approach to be used as part of the wider COS development process. Specifically, we undertook a rapid review of qualitative studies of patients' views and experiences of type 2 diabetes. We searched MEDLINE from inception to June 2017 to identify studies reporting qualitative empirical findings of perspectives of people with type 2 diabetes. Qualitative methodological filters were used to minimize irrelevant references. Drawing on content analysis, data synthesis involved identifying text in eligible studies relevant to outcomes of type 2 diabetes and interpreting and categorizing this according to the 38 core domains of the Core Outcome Measures in Effectiveness Trials taxonomy. Of 146 studies screened, 26 were included. Four hundred and fifty-eight outcomes were derived from the included studies. In comparison to the outcomes extracted from clinical trials, more life impact outcomes were derived from the qualitative studies, but fewer physiological/clinical outcomes. Outcomes relating to 'mortality/survival' and 'role functioning' were more prevalent in studies conducted in low/middle-income countries. This rapid review and synthesis of qualitative studies identified outcomes that had not previously been identified by a systematic review of clinical trials. It also identified differences in the types of outcomes given prominence to in the clinical trials and qualitative literatures. Incorporating qualitative evidence on patient perspectives from the outset of the COS development process can help to ensure outcomes that matter to patients are not overlooked. Our method provides a pragmatic and resource-efficient way to do this. For those developing international COS, our method has potential for incorporating the perspectives of patients from diverse countries in the early stages of COS development.