Can we use social media to support content validity of patient-reported outcome instruments in medical product development?

Insights Into the Patient Experience of Hormone Therapy for Early Breast Cancer Treatment Using Patient Forum Discussions and Natural Language Processing

PURPOSE

Understanding the real-world experience of patients with early breast cancer (eBC) is imperative for optimizing outcomes and evolving patient care. However, there is a lack of patient-level data, hindering clinical development. This social listening study was performed to understand patient insights into symptoms and impacts of hormone therapy (HT) for eBC using posts from patient forums on breastcancer.org to inform future clinical research.

METHODS

Natural language processing (NLP) and machine learning techniques were used to identify themes related to eBC from a sample of 500,000 posts. After relevant data selection, 362,074 eBC posts were retained for further analysis of symptoms and impacts related to HT, as well as insights into symptom severity, pain locations, and symptom management using exercise and yoga.

RESULTS

Overall, 32 symptoms and nine impacts had significant associations with ≥one HT. Hot flush (relative risk [RR], 6.70 [95% CI, 3.36 to 13.36]), arthralgia (RR, 6.67 [95% CI, 3.53 to 12.59]), weight increased (RR, 4.83 [95% CI, 3.20 to 7.28]), mood swings (RR, 7.36 [95% CI, 5.75 to 9.42]), insomnia (RR, 4.76 [95% CI, 3.14 to 7.22]), and depression (RR, 3.05 [95% CI, 1.71 to 5.44]) demonstrated the strongest associations. Severe headache, dizziness, back pain, and muscle spasms showed significant associations with ≥one HT despite their low overall prevalence in eBC posts.

CONCLUSION

The social listening approach allowed the identification of real-world insights from posts specific to eBC HT from a large-scale online breast cancer forum that captured experiences from a uniquely diverse group of patients. Using NLP has a potential to scale analysis of patient feedback and reveal actionable insights into patient experiences of treatment that can inform the development of future therapies and improve the care of patients with eBC.

Associations Between Patient-Reported Outcome Measures of Physical and Psychological Functioning and Willingness to Share Social Media Data for Research Among Adolescents With a Chronic Rheumatic Disease: Cross-Sectional Survey

Background

Social media data may augment understanding of the disease and treatment experiences and quality of life of youth with chronic medical conditions. Little is known about the willingness to share social media data for health research among youth with chronic medical conditions and the differences in health status between sharing and nonsharing youth with chronic medical conditions.

Objective

We aimed to evaluate the associations between patient-reported measures of disease symptoms and functioning and the willingness to share social media data.

Methods

Between February 2018 and August 2019, during routine clinic visits, survey data about social media use and the willingness to share social media data (dependent variable) were collected from adolescents in a national rheumatic disease registry. Survey data were analyzed with patient-reported measures of disease symptoms and functioning and a clinical measure of disease activity, which were collected through a parent study. We used descriptive statistics and multivariate logistic regression to compare patient-reported outcomes between youth with chronic medical conditions who opted to share social media data and those who did not opt to share such data.

Results

Among 112 youths, (age: mean 16.1, SD 1.6 y; female: n=72, 64.3%), 83 (74.1%) agreed to share social media data. Female participants were more likely to share (P=.04). In all, 49 (43.8%) and 28 (25%) participants viewed and posted about rheumatic disease, respectively. Compared to nonsharers, sharers reported lower mobility (T-score: mean 49.0, SD 9.4 vs mean 53.9, SD 8.9; P=.02) and more pain interference (T-score: mean 45.7, SD 8.8 vs mean 40.4, SD 8.0; P=.005), fatigue (T-score: mean 49.1, SD 11.0 vs mean 39.7, SD 9.7; P<.001), depression (T-score: mean 48.1, SD 8.9 vs mean 42.2, SD 8.4; P=.003), and anxiety (T-score: mean 45.2, SD 9.3 vs mean 38.5, SD 7.0; P<.001). In regression analyses adjusted for age, sex, study site, and Physician Global Assessment score, each 1-unit increase in symptoms was associated with greater odds of willingness to share social media data, for measures of pain interference (Adjusted Odds Ratio [AOR] 1.07, 95% CI 1.001-1.14), fatigue (AOR 1.08, 95% CI 1.03-1.13), depression (AOR 1.07, 95% CI 1.01-1.13), and anxiety (AOR 1.10, 95% CI 1.03-1.18).

Conclusions

High percentages of youth with rheumatic diseases used and were willing to share their social media data for research. Sharers reported worse symptoms and functioning compared to those of nonsharers. Social media may offer a potent information source and engagement pathway for youth with rheumatic diseases, but differences between sharing and nonsharing youth merit consideration when designing studies and evaluating social media-derived findings.

Microvascular Decompression and Trigeminal Neuralgia: Patient Sentiment Analysis Using Natural Language Processing

OBJECTIVE

Microvascular decompression (MVD) as a treatment for trigeminal neuralgia (TGN) has high success rate but is associated with risks of complication. This study analyzes Twitter to provide insights into discussions surrounding MVD for patients with TGN.

METHODS

A Twitter search performed in April 2022 yielded 491 tweets from 426 accounts. Tweets and accounts were classified thematically, and descriptive statistics were used for various social media metrics. Using a natural language processing machine learning algorithm, sentiment analysis (SA) was performed to evaluate patient perspectives before and after surgery, and a multivariate regression model was used to identify predictors of higher engagement metrics (likes, retweets, quote tweets, replies).

RESULTS

Most accounts were patients, caregivers, and other members of the public (70%). The most encountered themes were research (47%) and personal experiences (33.4%). SA of tweets about patient experiences showed that 40.2% of tweets were positive, 31.1% were neutral and 28.7% were negative. Negative tweets decreased significantly in postoperative tweets and mostly discussed complications or failure of surgery (63%). On multivariate analysis, only inclusion of media (photo or video) in a Tweet was associated with higher engagement metrics.

CONCLUSIONS

This study provides a comprehensive review of Twitter use discussing MVD in TGN and is the first to assess patient satisfaction after treatment using SA. The data presented on patient perspectives on social media could help physicians establish direct lines of communication with patients, fostering a more patient-focused care.

Using Patient Blogs on Social Media to Assess the Content Validity of Patient-Reported Outcome Measures: Qualitative Analysis of Patient-Written Blogs

BACKGROUND

Patient-reported outcome measures (PROMs) are questionnaires that measure patient outcomes related to quality of life, health, and functioning, and are increasingly used to assess important outcomes from the patient's perspective. For PROMs to contribute to better health and better care, it is vital that their content validity be adequate. This requires patient involvement in various steps of PROM development. PROM developers not only recognize the benefits of patient involvement but also report difficulties in recruiting patients and experience patient involvement as time-consuming, logistically challenging, and expensive.

OBJECTIVE

This study seeks to explore different strategies for disclosing the experiential knowledge of patients, namely through analyzing patient stories on the web and social media. The research questions are as follows: (1) how do bloggers living with a disease experience their health-related quality of life? (2) How are these experiences reflected in the domains and items of PROMs related to their disease?

METHODS

First, a qualitative analysis of blogs written by patients was performed. Second, subthemes and underlying codes resulting from this qualitative analysis were systematically compared with the domains and items in PROMs for the respective diseases that the bloggers write about. Blogs were identified via the Google search engine between December 2019 and May 2021.

RESULTS

Bloggers describe a wide range of experiences regarding their physical functioning and health; mental well-being; social network and support; daily life, education, work, and leisure; coping; and self-management. Bloggers also write about their positive and negative experiences with health care delivery, the organization of health care, and health care professionals. In general, patients' experiences as described in blogs were reflected in the domains and items of the PROMs related to their disease. However, except for diabetes mellitus, in all the sets of PROMs, potentially missing topics could be identified. Similarly, with the exception of Parkinson disease, all PROMs address issues that patients did not write about in their blogs and that might therefore be redundant.

CONCLUSIONS

Web-based patient stories in the form of blogs reveal how people living with a certain disease experience their health-related quality of life. These stories enable analyses of patients' experiences that can be used to assess the content validity of PROMs. This can be a useful step for researchers who are looking for sets of measuring instruments that match their purposes.

Comparison of Literature Review, Social Media Listening, and Qualitative Interview Research Methods in Generating Patient-Reported Symptom and Functional Impact Concepts of Presbyopia

INTRODUCTION

To compare the insights obtained about the experience of individuals with presbyopia (age-related impaired near vision) across three different sources of qualitative data: a structured targeted literature review, a social media listening (SML) review, and qualitative concept elicitation (CE) interviews with individuals with presbyopia and healthcare professionals (HCPs). The number of concepts identified, depth of data, cost and time implications, and value of the patient insights generated were explored and compared for each method.

METHODS

Keyword searches in bibliographic databases and review of abstracts identified 120 relevant publications; in-depth targeted literature review of the qualitative studies identified key symptoms/functioning concepts. SML was conducted using publicly accessible social media sources with focus on ophthalmologic diseases using a pre-defined search string. Relevant posts from individuals with presbyopia (n = 270) were analysed and key concepts identified. Semi-structured CE interviews were conducted with individuals with presbyopia (US n = 30, Germany n = 10, France n = 10), and HCPs (US = 3, France n = 2, Germany n = 1, Japan n = 1) who were experienced in treating presbyopia. Verbatim transcripts were coded using thematic analysis. A conceptual model summarised concepts identified across sources RESULTS: Out of the total of 158 concepts identified across the three sources, qualitative CE interviews yielded the highest number of concepts (n = 151/158, 96%), with SML yielding a third of the concepts (n = 51/158, 32%) and the literature review yielding the fewest concepts (n = 33/158, 21%). Qualitative CE interviews provided greater depth of data than SML and literature reviews. SML and literature reviews were less costly and quicker to run than qualitative CE interviews and also were less burdensome for participants.

CONCLUSION

Qualitative CE interviews are considered the gold standard in providing greater depth of understanding of the patient experience, and more robust data. However, research requirements, budget, and available time should be considered when choosing the most appropriate research method. More time and cost-effective SML and literature review methods can be used to supplement qualitative CE interview data and provide early identification of measurement concepts. More research and regulatory guidance into less traditional qualitative methods, however, are needed to increase the value of SML and literature review data.

Performance of the Cough and Sputum Assessment Questionnaire (CASA-Q) in COPD: Evidence from Clinical and Online Patient Interaction Studies

Introduction

Patient perception of the burden of chronic bronchitis symptoms in chronic obstructive pulmonary disease (COPD) can be assessed using patient-reported outcome measures (PROMs). The Cough and Sputum Assessment Questionnaire (CASA-Q) was developed and tested for this purpose. This study reviewed the performance of the CASA-Q in published online studies and tested a novel approach to complement traditional methods of qualitative content validation.

Methods

A targeted literature search was performed to identify published clinical studies of COPD using the CASA-Q as an endpoint. The performance of the questionnaire was examined in relation to other study endpoints, including clinical and functional measurements and other PROMs. Assessment of the content validity of the CASA-Q was carried out by comparing the content and structure of the questionnaire with published qualitative patient data from previously conducted online social media listening (SML) and online bulletin board (OBB) studies.

Results

In the interventional clinical trials, CASA-Q change scores were consistent with study objectives and other endpoints, including FEV₁ and other PROMs. Two observational studies showed cross-sectional correlations with other PROMs like the St.-George's Respiratory Questionnaire (SGRQ) and COPD assessment test (CAT) scores. Qualitative data from the SML and OBB patient studies were consistent with the content and structure of the CASA-Q, supporting the content validity of the measure.

Conclusion

Results suggest that the CASA-Q is appropriately responsive to changes in cough and sputum symptoms and clinical impact in trials of COPD. The mapping of qualitative findings from online SML and OBB studies to CASA-Q domains and items confirm the content validity of the instrument. These results suggest the CASA-Q can be a valuable tool for evaluating treatment effect in COPD trials.

Quality of life (QoL) for people with primary sclerosing cholangitis (PSC): a pragmatic strategy for identifying relevant QoL issues for rare disease

BACKGROUND

Primary sclerosing cholangitis (PSC) is a rare incurable disease of the bile ducts and liver which can significantly impair quality of life (QoL). No existing QoL tools are entirely suitable for people living with PSC (PwPSC). We aimed to develop a measure of QoL for PwPSC in the UK, beginning by identifying relevant QoL issues. This paper describes our approach to this first stage, and discusses related benefits and limitations.

METHODS

Scientific consensus on how to reliably stage PSC is lacking, due to its rarity and heterogeneity. We initially hypothesised four categories for PSC severity. After beginning the study, these were revised to six. For such a rare disease, the study could not recruit sufficient participants in each of these categories, particularly the more severe, in the time available. We therefore modified the design, adapting standard methodology for identifying potentially relevant issues. We started by conducting a thematic analysis of data from a previous survey of PwPSC, and extracting QoL issues from a literature review of QoL questionnaires of relevance to PwPSC. We then conducted group and individual interviews with PwPSC and clinicians, investigating the relevance, importance, phrasing, and breadth of coverage of issues identified. We also explored the validity of our hypothesised categories for disease severity.

RESULTS

We identified 1,052 potentially relevant QoL issues from the survey and literature review and took 396 of these forwards for discussion with 28 PwPSC. We found 168/396 issues were considered relevant by ≥ 60% of these participants. We then discussed this subset of 168 issues with 11 clinicians. PSC and clinician participants identified some problematic phrasing with 19 issues, due to potential upset (n = 12) or problems with understanding (n = 7). We included one new issue from those suggested.

CONCLUSION

We identified a range of QoL issues relevant to PwPSC, with a good breadth of coverage, although lacking an in-depth understanding of the PSC experience. Our strategy effectively identified relevant QoL issues for people living with this rare condition, for which there is no consensus on stratifying for its severity. This strategy should however be considered specific to such circumstances, not a general recommendation for an alternative approach.

Validation of an instrument for perceived factors affecting fruit and vegetable intake based on Pender's health promotion model

Increasing fruit and vegetable (F&V) intake has a protective role against chronic conditions such as cardiovascular disease, cancer and diabetes. The present study aimed to validate an instrument for measuring the perception of effective factors on consumption behaviour of F&V based on Pender's health promotion model (HPM).This cross-sectional validation survey has consisted of five steps: literature review in order to plan and develop an instrument, face validity assessment, content validity assessment, reliability assessment and construct validity assessment with the cooperation of experts in health education, nutritionists and the target group (government employees). In the present study, reliability and validity of constructs were determined through Cronbach's alpha and exploratory factor analysis, respectively, in SPSS 22. The mean impact score was acceptable for 96·42 % of items in face validity. The mean scores of content validity ratio (CVR), content validity index (CVI) and reliability were 0·92, 0·97 and 0·96, respectively. According to the principal component analysis with varimax rotation, 104 items were identified in 15 factors contributing to 61·17 % of the model cumulative variance. Given the favourable scores of the research instrument in face validity, content validity and reliability as well as its ability to predict the extracted factors from the model, it can be used as a suitable instrument in future studies.

Patient-Centered Insights on Treatment Decision Making and Living with Acute Myeloid Leukemia and Other Hematologic Cancers

Expectations relating to treatment and survival, and factors influencing treatment decisions are not well understood in adult patients with acute myeloid leukemia. This study analyzed combined findings from a targeted literature review with patient-reported information shared on YouTube to further understand patient perspectives in hematologic cancers and, in particular, acute myeloid leukemia. The targeted literature review included articles concerning patient (aged ≥ 18 years) experiences or perspectives in acute myeloid leukemia or other hematologic cancers. YouTube video selection criteria included patients (aged ≥ 60 years) with self-reported acute myeloid leukemia. In total, 26 articles (13 acute myeloid leukemia-specific and 14 other hematologic cancers, with one relevant to both populations) and 28 videos pertaining to ten unique patients/caregivers were identified. Key concepts reported by patients included the perceived value of survival for achieving personal and/or life milestones, the emotional/psychological distress of their diagnosis, and the uncertainties about life expectancy/prognosis. Effective therapies that could potentially delay progression and extend life were of great importance to patients; however, these were considered in terms of quality-of-life impact and disruption to daily life. Many patients expressed concerns regarding the lack of treatment options, the possibility of side effects, and how their diagnosis and treatment would affect relationships, daily lives, and ability to complete certain tasks. Both data sources yielded valuable and rich information on the patient experience and perceptions of hematologic cancers, in particular for acute myeloid leukemia, and its treatments. Further understanding of these insights could aid discussions between clinicians, patients, and their caregivers regarding treatment decisions, highlight outcomes of importance to patients in clinical studies, and ultimately, inform patient-focused drug development and evaluation.

Recruitment strategies and geographic representativeness for patient survey studies in rare diseases: Experience from the living with myeloproliferative neoplasms patient survey

Background

Recruitment of individuals with rare diseases for studies of real-world patient-reported outcomes is limited by small base populations. Myeloproliferative neoplasms (MPNs) are a group of rare, chronic, hematologic malignancies. In this study, recruitment strategies and geographic representativeness from the Living with MPNs survey are reported.

Methods

The Living with MPNs online cross-sectional survey was conducted between April and November 2016. Individuals 18 to 70 years of age living in the United States and diagnosed with an MPN were eligible to participate. Recruitment approaches included direct contact via emails and postcards; posts on MPN-focused social media and patient advocacy websites; postcard mailings to doctors’ offices; and advertisements on medical websites, Google, and Facebook. Geographic representativeness was assessed based on the number of survey respondents living in each state or the District of Columbia and by the number of survey respondents per 10 million residents.

Results

A total of 904 respondents with MPNs completed the survey. The recruitment method yielding the greatest number of respondents was advertisements on MPN-focused social media (47.6% of respondents), followed by emails (35.1%) and postcards (13.9%) sent through MPN advocacy groups. Home state information was provided by 775 respondents from 46 states (range of respondents per state, 1–89). The number of respondents per 10 million residents in the 46 states with respondents ranged from 12.1 to 52.7.

Conclusions

Recruitment using social media and communications through patient groups and advocacy organizations are effective in obtaining geographically representative samples of individuals with MPNs in the United States. These approaches may also be effective in other rare diseases.

Pharmacology and social media: Potentials and biases of web forums for drug mention analysis-case study of France

The aim of this study is to analyze drug mentions in web forums to evaluate the utility of this data source for drug post-marketing studies. We automatically annotated over 60 million posts extracted from 21 French web forums. Drug mentions detected in this corpus were matched to drug names in a French drug database (Theriaque^®). Our analysis showed that a high proportion of the most frequent drug mentions in the selected web forums correspond to drugs that are usually prescribed to young women, such as combined oral contraceptives. The most mentioned drugs in our corpus correlated weakly to the most prescribed drugs in France but seemed to be influenced by events widely reported in traditional media. In this article, we conclude that web forums have high potential for post-marketing drug-related studies, such as pharmacovigilance, and observation of drug utilization. However, the bias related to forum selection and the corresponding population representativeness should always be taken into account.

The gap between knowledge and undergoing colorectal cancer screening using the Health Belief Model: A national survey

BACKGROUND/AIMS

Colorectal cancer (CRC) is a public health issue, and before the initiation of a national cancer screening program, there is a need to examine the acceptance of the public to undergo CRC screening and explore potential barriers.

MATERIALS AND METHODS

A nationwide survey was conducted using an electronic platform to collect demographic variables and using the Health Belief Model to assess attitudes and behavior of participants as well as the knowledge about and intent to undergo CRC screening. At the end of the survey, participants from Riyadh were invited to get screened for CRC.

RESULTS

Responses from 5720 individuals covering all the 13 jurisdictions of Saudi Arabia were collected. Males represented 71.53% of the respondents; the mean age was 43.28 years and 15.24% had already undergone CRC screening using various methods, mostly colonoscopy (72.73%). The mean knowledge score was 11.05 (standard deviation 4.4, range 1-23), with no difference between genders, jurisdictions of the Kingdom, between those who expressed interest in screening and those who did not, and between those who accepted the invitation to undergo CRC screening and those who did not. Participants displayed positive attitudes toward both CRC screening and colonoscopy as a screening tool, and 73% expressed willingness to undergo screening. On multivariate analysis, male gender was the only factor associated with a higher probability of accepting screening, whereas neither knowledge nor willingness to undergo screening predicted accepting the invitation to screening.

CONCLUSION

Although the majority of participants were willing to undergo screening, no significant correlation between knowledge and willingness to undergo screening were predictors of screening uptake. Other areas that could be targeted in the promotion of CRC screening uptake to bridge the gap between "knowing" and "doing" should be explored.

A comparison of three methods to generate a conceptual understanding of a disease based on the patients' perspective

Background

The Food and Drug Administration patient-reported outcome (PRO) guidance provides standards for PRO development, but these standards bring scientific and logistical challenges which can result in a lengthy and expensive instrument development process. Thus, more pragmatic methods are needed alongside traditional approaches.

Methods

Partnering with the National Ankylosing Spondylitis (AS) Society, we compared three methods for eliciting patient experiences: 1) concept elicitation (CE) interviews with 12 individuals with AS, 2) “group concept mapping” (GCM) with 16 individuals with AS, 3) a social media review (SMR) of AS online chatrooms. Three conceptual models were developed and compared to explore data breadth/depth, as well as the practicalities and patient-centeredness.

Results

Overlap in concepts was observed between conceptual models; 35% of symptoms were identified by all methods. The SMR approach identified the most concepts (n = 23), followed by CE interviews (n = 18), and GCM (n = 15). Eight symptoms were uniquely identified using GCM and SMR. Eliciting in-depth data was challenging for SMR as detail was not always provided. Insight into the relationships between symptoms was obtained as a “concept map” in GCM, via effective probing within interviews, and through the subject’s descriptions in SMR. Practical investment varied; CE interviews were the most resource intensive, whereas SMR was the least. Individuals in GCM and CE interviews reported high engagement.

Conclusions

Primary CE interviews achieved the greatest depth in conceptual understanding of patient experience; however, novel methods (GCM, SMR) provide complementary approaches for identifying measurement concepts. Each method has strengths and weaknesses and should be selected based on specific research objectives.

Electronic supplementary material

The online version of this article (10.1186/s41687-017-0013-6) contains supplementary material, which is available to authorized users.

Advantages and limitations of online communities of patients for research on health products

The way patients and their caregivers share information on various online platforms about health topics and their own experiential knowledge presents new potential environments for research, particularly as concerns health products. The information provided individually and voluntarily by patients who are members of these online communities is a new resource for identifying and understanding precisely how health products are used, assessing their effectiveness, quantifying potential adverse effects in real-life situations, detecting subtle signs that are significant for experts in pharmacovigilance and addiction studies, and developing new assessment tools to help form new working hypotheses. How patients freely express their experiences and feelings and the reality of what they share also opens the way for societal research into health products, a field that is still under-explored. Well-established regulations govern research into health products, which uses resources and methodologies that have changed little over the years. However, the development of online communities of patients presents new possibilities in this field. The challenge we face today is defining their place among traditional research techniques. This place cannot be accepted by all stakeholders unless we first establish a firm understanding of the advantages, limitations, and constraints of these communities. The round table on this topic endeavoured to: explore these issues and develop a better understanding of the phenomenon and the different varieties of online communities and networks for patients; identify possible advantages, special features, and methodological, regulatory, and ethical limitations that researchers currently face; and finally, to put forward the first recommendations in this growing field of research.

Social media use among young rheumatologists and basic scientists: results of an international survey by the Emerging EULAR Network (EMEUNET)

OBJECTIVES

To explore perceptions, barriers and patterns of social media (SM) use among rheumatology fellows and basic scientists.

METHODS

An online survey was disseminated via Twitter, Facebook and by email to members of the Emerging European League Against Rheumatism Network. Questions focused on general demographics, frequency and types of SM use, reasons and barriers to SM use.

RESULTS

Of 233 respondents (47 countries), 72% were aged 30-39 years, 66% female. 83% were active users of at least one SM platform and 71% were using SM professionally. The majority used SM for communicating with friends/colleagues (79%), news updates (76%), entertainment (69%), clinical (50%) and research (48%) updates. Facebook was the dominant platform used (91%). SM was reported to be used for information (81%); for expanding professional networks (76%); new resources (59%); learning new skills (47%) and establishing a professional online presence (46%). 30% of non-SM users justified not using SM due to lack of knowledge.

CONCLUSIONS

There was a substantial use of SM by rheumatologists and basic scientists for social and professional reasons. The survey highlights a need for providing learning resources and increasing awareness of the use of SM. This could enhance communication, participation and collaborative work, enabling its more widespread use in a professional manner.

Exploring Concordance of Patient-Reported Information on PatientsLikeMe and Medical Claims Data at the Patient Level

Background

With the emergence of data generated by patient-powered research networks, it is informative to characterize their correspondence with health care system-generated data.

Objectives

This study explored the linking of 2 disparate sources of real-world data: patient-reported data from a patient-powered research network (PatientsLikeMe) and insurance claims.

Methods

Active patients within the PatientsLikeMe community, residing in the United States, aged 18 years or older, with a self-reported diagnosis of multiple sclerosis or Parkinson’s disease (PD) were invited to participate during a 2-week period in December 2014. Patient-reported data were anonymously matched and compared to IMS Health medical and pharmacy claims data with dates of service between December 2009 and December 2014. Patient-level match (identity), diagnosis, and usage of disease-modifying therapies (DMTs) were compared between data sources.

Results

Among 603 consenting patients, 94% had at least 1 record in the IMS Health dataset; of these, there was 93% agreement rate for multiple sclerosis diagnosis. Concordance on the use of any treatment was 59%, and agreement on reports of specific treatment usage (within an imputed 5-year period) ranged from 73.5% to 100%.

Conclusions

It is possible to match patient identities between the 2 data sources, and the high concordance at multiple levels suggests that the matching process was accurate. Likewise, the high degree of concordance suggests that these patients were able to accurately self-report their diagnosis and, to a lesser degree, their treatment usage. Further studies of linked data types are warranted to evaluate the use of enriched datasets to generate novel insights.

Concept Elicitation Within Patient-Powered Research Networks: A Feasibility Study in Chronic Lymphocytic Leukemia

OBJECTIVES

To explore the feasibility of using social media-based patient networks to gather qualitative data on patient-reported outcome (PRO) concepts relevant to chronic lymphocytic leukemia (CLL).

METHODS

Between August and November 2013, US-residing members of the PatientsLikeMe online CLL patient community completed open-ended web-based surveys designed to elicit descriptions of CLL symptoms, impacts, and treatment-related perceptions. Qualitative telephone follow-up interviews were conducted with a subsample of respondents. Survey responses and interview transcripts were coded for qualitative analysis using Atlas.ti.

RESULTS

Fifty survey responses were included in the analyses. Participants were age 60.5 ± 6.9 years, 54% female, and 96% white. When surveyed, 20% were receiving current treatment, 16% were in remission, and 64% were treatment-naïve. Among respondents, 369 descriptions of CLL symptoms were coded. Fatigue-related symptoms were expressed most frequently, with 54% reporting "fatigue," "tiredness," or both in their responses. These concepts were followed by night sweats (38%), swollen lymph nodes (32%), and frequent infections (28%). Among impacts of CLL, worry and fear (66% of respondents), depressed feelings (52%), and work limitations (50%) were noted most frequently.

CONCLUSIONS

Survey results identified constitutional symptoms of CLL included in existing PRO instruments and the literature. Although the findings suggest that qualitative data obtained through social media applications can be potentially useful in supporting concept identification for newly developed PRO instruments, they also indicate that online approaches alone may not be sufficient to achieve efficient and exhaustive concept elicitation. Further research is needed to identify whether the results can support content validity in the same way as established qualitative research methods.