The Abortion Web Ecosystem: Cross-Sectional Analysis of Trustworthiness and Bias

Accuracy, Quality, and Misinformation of YouTube Abortion Procedural Videos: Cross-Sectional Study

BACKGROUND

The internet is often the first source patients turn to for medical information. YouTube is a commonly used internet-based resource for patients seeking to learn about medical procedures, including their risks, benefits, and safety profile. Abortion is a common yet polarizing medical procedure. People interested in obtaining an abortion are likely to use the internet to learn more about abortion procedures and may encounter misinformed and biased information. This is troubling as information found on the internet can significantly alter perceptions and understanding of these procedures. There is no current research that evaluates the accuracy, quality, and misinformation of instructional abortion videos available to patients.

OBJECTIVE

The purpose of this study was to assess if any given video can deliver accurate and quality information about this topic in an unbiased manner and to assess the level of factually incorrect, distorted, or medically irrelevant information in any given video.

METHODS

Procedural methods of abortion were queried on YouTube on August 22, 2022. The videos were screened with strict exclusion criteria. Videos were categorized into "video slants" based on the language and attitudes expressed in each video. Video accuracy was calculated using the Surgical Curriculum in Obstetrics and Gynecology (SCOG) checklist for each corresponding procedure. Video quality was calculated using the Laparoscopic Surgery Video Educational Guidelines (LAP-VEGaS) criteria. The level of misinformation was assessed with the evidence-based Anti-Choice Rubric, which scores the amount of factually incorrect, distorted, or medically irrelevant information in each video.

RESULTS

A total of 32 videos were analyzed and categorized into 3 "video slant" groups: neutral (n=23, 72%), antichoice (n=4, 12%), and prochoice (n=5, 16%). Using the SCOG checklist, neutral videos had the highest median accuracy (45.9%), followed by antichoice videos (24.6%) and prochoice videos (18.5%). None of the videos met the LAP-VEGaS quality control criteria, (score>11, indicating adequate quality). Neutral videos had a median score of 8.8 out of 18, with antichoice videos scoring 10.75 and prochoice videos scoring 6.2. Using the Anti-Choice Rubric, neutral videos mentioned only 1 factually incorrect piece of information. Antichoice videos mentioned 12 factually incorrect pieces of information, 8 distortions, and 3 medically irrelevant pieces of information. Prochoice videos did not mention any of the 3 themes.

CONCLUSIONS

Using the SCOG checklist, the accuracy of instructional videos were inconsistent across the 3 identified "video slants." Using LAP-VEGaS criteria, the quality of educational videos were also inconsistent across the 3 "video slants." Prochoice videos had the lowest level of misinformation, with no mentions of any of the 3 themes. Antichoice videos had the highest levels of misinformation, with mentions in all 3 themes. Health care professionals should consider this when counseling patients who may watch YouTube videos for information regarding abortion procedures.

Public perceptions of abortion complications

BACKGROUND

Misinformation contributes to the perception that abortion has substantial health risks, despite the known safety of medication and aspiration abortion. We lack detailed information about which health risks the public believes are most likely.

OBJECTIVE

This study aimed to describe public perception of short- and long-term risks of abortion.

STUDY DESIGN

We conducted a cross-sectional survey of US residents aged ≥18 years using Amazon Mechanical Turk (MTurk). We collected information regarding participant demographics, reproductive history, political views, and position on abortion restrictions. We provided participants with a list of 9 short-term and 15 long-term possible complications and asked them to indicate whether they occurred never (0%), very rarely (<1%), rarely (1%-5%), occasionally (5%-20%), or frequently (>20%) following abortion. We used descriptive statistics to understand our population demographics and to capture the perceived incidence of all complications. We created a binary indicator of answering all risk estimates incorrectly vs at least 1 estimate correctly, separately for all long-term possible complications, and the 2 short-term risks of infection and bleeding. We determined the proportion of individuals who responded incorrectly to all questions in each category and used multivariable logistic regression to identify factors associated with incorrect perceptions about the risks of abortion.

RESULTS

For all listed complications, participant (N=1057) estimates of risk were higher than the known incidence. For both short-term risks of bleeding and infection, over 40% of participants reported that these outcomes occur occasionally or frequently. Similarly, for both long-term risks of depression and anxiety, over 60% of respondents reported that these outcomes occur occasionally or frequently after abortion. Participants reported that possible complications known to not be associated with abortion, including hair loss, future pregnancy complications, breast cancer, and cosmetic disfigurement, occurred at least rarely. Nearly one-quarter of participants responded that death occurs occasionally or frequently (in over 5% of abortions), and 79% of participants responded that breast cancer can result from abortion. One-quarter (24.9%) of participants incorrectly overestimated both short-term outcomes of infection and bleeding, whereas 19.5% answered all long-term complication questions incorrectly, including outcomes that never occur. On multivariable analyses, we identified that the participants most likely to incorrectly identify risks of abortion identified as Asian or Black race/ethnicity, were from rural communities, or believed that abortion should have more legal restrictions.

CONCLUSION

The public perceives abortion to be much riskier than it actually is. This information can be used to develop targeted clinical and public health efforts to disseminate the true risks of abortion.

Fear of procedure and pain in individuals considering abortion: A qualitative study

OBJECTIVES

To explore concerns about procedural abortion and abortion-related pain in a cohort searching for abortion online.

METHODS

The Google Ads Abortion Access Study was a national longitudinal cohort study that recruited people searching for abortion online. Participants completed a baseline demographic survey and a follow-up survey four weeks later evaluating barriers and facilitators to abortion. This qualitative study utilized thematic analysis to produce a descriptive narrative based on overarching themes about procedural abortion and abortion-related pain.

RESULTS

There were 57 separate mentions from 45 participants regarding procedural abortion or abortion-related pain. We identified two main themes: 1) concerns about the procedure (with subthemes, fear of procedural abortion, comparison to medication abortion, lack of sedation) and 2) abortion-related pain (with subthemes fear of abortion-related pain, experiences of pain, fear of complications and cost-barriers to pain control).

CONCLUSIONS

This study highlights the need for improved anticipatory guidance and accessible resources to assuage potential fears and misconceptions regarding abortion.

PRACTICE IMPLIACTIONS

Abortion resources, particularly online, should provide accurate and unbiased information about abortion methods and pain to help patients feel more prepared. Providers should be aware of potential concerns surrounding procedural abortion and pain when counseling patients presenting for care.

Exploring Google Searches for Out-of-Clinic Medication Abortion in the United States During 2020: Infodemiology Approach Using Multiple Samples

Background

As access barriers to in-person abortion care increase due to legal restrictions and COVID-19-related disruptions, individuals may be turning to the internet for information and services on out-of-clinic medication abortions. Google searches allow us to explore timely population-level interest in this topic and assess its implications.

Objective

We examined the extent to which people searched for out-of-clinic medication abortions in the United States in 2020 through 3 initial search terms: home abortion, self abortion, and buy abortion pill online.

Methods

Using the Google Trends website, we estimated the relative search index (RSI)-a comparative measure of search popularity-for each initial search term and determined trends and its peak value between January 1, 2020, and January 1, 2021. RSI scores also helped to identify the 10 states where these searches were most popular. We developed a master list of top search queries for each of the initial search terms using the Google Trends application programming interface (API). We estimated the relative search volume (RSV)-the search volume of each query relative to other associated terms-for each of the top queries using the Google Health Trends API. We calculated average RSIs and RSVs from multiple samples to account for low-frequency data. Using the Custom Search API, we determined the top webpages presented to people searching for each of the initial search terms, contextualizing the information found when searching them on Google.

Results

Searches for home abortion had average RSIs that were 3 times higher than self abortion and almost 4 times higher than buy abortion pill online. Interest in home abortion peaked in November 2020, during the third pandemic wave, at a time when providers could dispense medication abortion using telemedicine and by mail. Home abortion was most frequently queried by searching for Planned Parenthood, abortion pill, and abortion clinic, presumably denoting varying degrees of clinical support. Consistently lower search popularity for self abortion and buy abortion pill online reflect less population interest in mostly or completely self-managed out-of-clinic abortions. We observed the highest interest for home abortion and self abortion in states hostile to abortion, suggesting that state restrictions encourage these online searches. Top webpages provided limited evidence-based clinical content on self-management of abortions, and several antiabortion sites presented health-related disinformation.

Conclusions

During the pandemic in the United States, there has been considerably more interest in home abortions than in minimally or nonclinically supported self-abortions. While our study was mainly descriptive, showing how infrequent abortion-related search data can be analyzed through multiple resampling, future studies should explore correlations between the keywords denoting interest in out-of-clinic abortion and abortion care measures and test models that allow for improved monitoring and surveillance of abortion concerns in our rapidly evolving policy context.

Gynecology Meets Big Data in the Disruptive Innovation Medical Era: State-of-Art and Future Prospects

Tremendous scientific and technological achievements have been revolutionizing the current medical era, changing the way in which physicians practice their profession and deliver healthcare provisions. This is due to the convergence of various advancements related to digitalization and the use of information and communication technologies (ICTs)—ranging from the internet of things (IoT) and the internet of medical things (IoMT) to the fields of robotics, virtual and augmented reality, and massively parallel and cloud computing. Further progress has been made in the fields of addictive manufacturing and three-dimensional (3D) printing, sophisticated statistical tools such as big data visualization and analytics (BDVA) and artificial intelligence (AI), the use of mobile and smartphone applications (apps), remote monitoring and wearable sensors, and e-learning, among others. Within this new conceptual framework, big data represents a massive set of data characterized by different properties and features. These can be categorized both from a quantitative and qualitative standpoint, and include data generated from wet-lab and microarrays (molecular big data), databases and registries (clinical/computational big data), imaging techniques (such as radiomics, imaging big data) and web searches (the so-called infodemiology, digital big data). The present review aims to show how big and smart data can revolutionize gynecology by shedding light on female reproductive health, both in terms of physiology and pathophysiology. More specifically, they appear to have potential uses in the field of gynecology to increase its accuracy and precision, stratify patients, provide opportunities for personalized treatment options rather than delivering a package of “one-size-fits-it-all” healthcare management provisions, and enhance its effectiveness at each stage (health promotion, prevention, diagnosis, prognosis, and therapeutics).

Factors Associated With Perceived Trust of False Abortion Websites: Cross-sectional Online Survey

Background

Most patients use the internet to search for health information. While there is a vast repository of searchable information online, much of the content is unregulated and therefore potentially incorrect, conflicting, or confusing. Abortion information online is particularly prone to being inaccurate as antichoice websites publish purposefully misleading information in formats that appear as neutral resources. To understand how antichoice websites appear neutral, we need to understand the specific website features of antichoice websites that impart an impression of trustworthiness.

Objective

We sought to identify the characteristics of false or misleading abortion websites that make these websites appear trustworthy to the public.

Methods

We conducted a cross-sectional study using Amazon’s Mechanical Turk platform. We used validated questionnaires to ask participants to rate 11 antichoice websites and one neutral website identified by experts, focusing on website content, creators, and design. We collected sociodemographic data and participant views on abortion. We used a composite measure of “mean overall trust” as our primary outcome. Using correlation matrices, we determined which website characteristics were most associated with mean overall trust. Finally, we used linear regression to identify participant characteristics associated with overall trust.

Results

Our analytic sample included 498 participants aged from 22 to 70 years, and 50.1% (247/493) identified as female. Across 11 antichoice websites, creator confidence (“I believe that the creators of this website are honest and trustworthy”) had the highest correlation coefficient (strongest relationship) with mean overall trust (coefficient=0.70). Professional appearance (coefficient=0.59), look and feel (coefficient=0.59), perception that the information is created by experts (coefficient=0.59), association with a trustworthy organization (coefficient=0.58), valued features and functionalities (coefficient=0.54), and interactive capabilities (coefficient=0.52) all demonstrated strong relationships with mean overall trust. At the individual level, prochoice leaning was associated with higher overall trust of the neutral website (B=−0.43, 95% CI −0.87 to 0.01) and lower mean overall trust of the antichoice websites (B=0.52, 95% CI 0.05 to 0.99).

Conclusions

The mean overall trust of antichoice websites is most associated with design characteristics and perceived trustworthiness of website creators. Those who believe that access to abortion should be limited are more likely to have higher mean overall trust for antichoice websites.

How do women interpret abortion information they find online?

OBJECTIVE

We sought to assess how women interpret the information they find online about the overall safety and risk of infertility associated with abortion and cesarean delivery (CD).

METHODS

We conducted an exploratory, prospective study tracking the internet searches of 100 reproductive-aged individuals who identify as women. We directed participants to search for information about either (1) whether surgical abortion or CD is safe or (2) the risk of infertility following surgical abortion or CD. Our data collection had 3 phases: baseline survey, directed internet search, and a postsearch survey. We analyzed participants' pre- and postsurvey responses using bivariate tests and analyzed within-subject changes. We evaluated the sites they visited based on expert ratings of site content based on trustworthiness and slant.

RESULTS

Women perceived abortion as safer and less likely to cause infertility after their web searches than before (70% perceived abortion in the United States as very/completely safe presearch vs 92% postsearch; p < 0.02). Women's perceptions about CD did not change. Participants sought information from web pages that experts largely deemed trustworthy and lacking in slant.

CONCLUSIONS

Women's perceptions about abortion safety and risk can be influenced by information they find online; perceptions about CD safety and risk may be less influenced by online information.

IMPLICATIONS

Disseminating high quality, user-friendly abortion information on highly ranked and easily findable websites can help women find evidence-based information and influence knowledge about abortion.