Sources in science: who can we trust?

Frequency distribution of journalistic attention for scientific studies and scientific sources: An input-output analysis

Based on the decision-theoretical conditions underlying the selection of events for news coverage in science journalism, this article uses a novel input-output analysis to investigate which of the more than eight million scientific study results published between August 2014 and July 2018 have been selected by global journalism to a relevant degree. We are interested in two different structures in the media coverage of scientific results. Firstly, the structure of sources that journalists use, i.e. scientific journals, and secondly, the congruence of the journalistic selection of single results. Previous research suggests that the selection of sources and results follows a certain heavy-tailed distribution, a power law. Mathematically, this distribution can be described with a function of the form C*x^-α. We argue that the exponent of such power law distributions can potentially be an indicator to describe selectivity in journalism on a high aggregation level. In our input-output analysis, we look for such patterns in the coverage of all scientific results published in the database Scopus over four years. To get an estimate of the coverage of these results, we use data from the altmetrics provider Altmetric, more precisely their Mainstream-Media-Score (MSM-Score). Based on exploratory analyses, we define papers with a score of 50 or above as Social Impact Papers (SIPs). Over our study period, we identified 5,833 SIPs published in 1,236 journals. For both the distribution of the source selection and the distribution of the selection of single results, an exponentially truncated power law is a better fit than the power law, mostly because we find a steeper decline in the tail of the distributions.

Constructing the ‘Gay Gene’ in the News: Optimism and Skepticism in the US and British Press

In the 1990s the discovery of a ‘gay gene’ was widely reported in the news media, often as front-page stories. Focusing on the print media presentation of Dean Hamer’s 1993 and 1995 scientific papers reporting finding a genetic marker for homosexuality, we examine how these studies were framed in a selected sample of US and British newspapers and news magazines. We found disparate constructions of the ‘gay gene’ in each press culture. The US press reported Hamer’s study as good science and treated it with ‘cautious optimism’ while the British press reported the research as ‘the perils of the gay gene.’ We discuss how these studies received such widespread attention and the sources and implications of the variant images of the ‘gay gene’ in the news.

Bevacizumab for advanced breast cancer: hope, hype, and hundreds of headlines

On February 22, 2008, the Food and Drug Administration granted accelerated approval for the use of bevacizumab (Avastin) in metastatic breast cancer. Based on subsequent clinical trials, this approval was revoked on November 18, 2011. In this study, we categorize and analyze the newspaper reports related to bevacizumab's use in advanced breast cancer. Methods. Using the Factiva media database, we reviewed all newspaper reports published in North America from January 4, 2002, to January 4, 2013, containing the words "breast cancer" and "Avastin," or "bevacizumab." Articles were classified as pre-approval (January 4, 2002-February 21, 2008), approval (February 22, 2008-November 17, 2011), or post-approval loss (November 18, 2011-January 4, 2013). Information regarding benefits, side effects, costs, interviewees, and article tone and theme were abstracted from each article by two independent reviewers. Differences among the three study phases were compared using the chi square analysis. Results. A total of 359 articles met study inclusion criteria. The number of reports having a positive headline tone and/or positive article tone declined with each study period. The proportion of articles discussing side effects and financial costs increased, whereas those discussing efficacy decreased with each study period. Drug representatives were most likely to be quoted in newspaper articles prior to bevacizumab's approval. Conclusion. Media reports are a common source of medical information for patients, practitioners, and policy makers. We observed substantial fluidity of media reports over time.

Characteristics of medical research news reported on front pages of newspapers

BACKGROUND

The placement of medical research news on a newspaper's front page is intended to gain the public's attention, so it is important to understand the source of the news in terms of research maturity and evidence level.

METHODOLOGY/PRINCIPAL FINDINGS

We searched LexisNexis to identify medical research reported on front pages of major newspapers published from January 1, 2000 to December 31, 2002. We used MEDLINE and Google Scholar to find journal articles corresponding to the research, and determined their evidence level. Of 734 front-page medical research stories identified, 417 (57%) referred to mature research published in peer-reviewed journals. The remaining 317 stories referred to preliminary findings presented at scientific or press meetings; 144 (45%) of those stories mentioned studies that later matured (i.e. were published in journals within 3 years after news coverage). The evidence-level distribution of the 515 journal articles quoted in news stories reporting on mature research (3% level I, 21% level II, 42% level III, 4% level IV, and 31% level V) differed from that of the 170 reports of preliminary research that later matured (1%, 19%, 35%, 12%, and 33%, respectively; chi-square test, P = .0009). No news stories indicated evidence level. Fewer than 1 in 5 news stories reporting preliminary findings acknowledged the preliminary nature of their content.

CONCLUSIONS/SIGNIFICANCE

Only 57% of front-page stories reporting on medical research are based on mature research, which tends to have a higher evidence level than research with preliminary findings. Medical research news should be clearly referenced and state the evidence level and limitations to inform the public of the maturity and quality of the source.

Disparity between popular (Internet) and scientific illness concepts of carpal tunnel syndrome causation

PURPOSE

To determine whether there are notable disparities between popular (Internet) and scientific (Index Medicus) theories of carpal tunnel syndrome (CTS) causation.

METHODS

Reports from 3 sources were evaluated with regard to support for etiological theories of CTS: 1) patient-oriented information on CTS from the Internet, 2) recent physician-oriented information on CTS from medical journals indexed on Index Medicus, and 3) articles addressing the etiology of CTS from the 1997 National Institute for Occupational Safety and Health report. Multiple logistic regression analyses evaluated differences in etiological theories from the 3 sources.

RESULTS

Internet sites implicated vitamin B(6) deficiency, tenosynovitis, and typing or computer use as causes for idiopathic CTS considerably more often and genetic predisposition considerably less often than recent Index Medicus scientific reports and reports reviewed by the National Institute for Occupational Safety and Health.

CONCLUSIONS

There are notable disparities between popular (Internet) and scientific (Index Medicus) theories of CTS causation.

An analysis of media coverage on the prevention and early detection of CKD in Australia

News media raise public awareness about health and can influence public policy agenda. Recently, nephrologists have sought to make prevention and early detection of chronic kidney disease (CKD) a health care priority. We assessed the extent and manner in which Australian television news and newspapers cover CKD prevention or early detection. Electronic news databases for print media and television programs were searched (May 2005 to March 2007) for items referring to CKD prevention or early detection. We analyzed all relevant items for spokespeople, main news frame, focus of responsibility, proposed solutions, and trigger/reason for publication. Of 2,439 newspaper articles and 10,430 television broadcasts retrieved, only 214 articles (8.77%) and 7 broadcasts (0.06%) were eligible. Kidney transplantation dominated CKD-related news. Lay person or high-profile advocates were virtually absent. Risks of cardiovascular disease and mortality conferred by CKD were not emphasized by news reports; instead, CKD received peripheral mention as a secondary consequence of diabetes or obesity. Few reports cited the economic consequences of CKD. The media focused on lifestyle causes and solutions, whereas nonlifestyle causes and screening and prevention strategies were rarely mentioned. Kidney health professionals need to actively engage with the media in efforts to amplify desired messages on CKD prevention or early detection. Medical journals, research institutions, universities, hospitals, and advocacy groups should issue press releases that highlight newsworthy aspects of this topic. Extending news media coverage can help exert an influence on health policies and agenda setting and increase public awareness to improve prevention and early detection of CKD.

Deconstructing media coverage of trastuzumab (Herceptin): an analysis of national newspaper coverage

OBJECTIVE

To explore and critically describe the content and main narratives of UK national daily newspaper coverage of trastuzumab (Herceptin).

DESIGN

We used the NewsBank database to search eight national daily newspapers, and their Sunday equivalents, retrospectively from 19 February 2006 back to the earliest mention of trastuzumab or Herceptin (19 May 1998). Setting UK national newspapers.

MAIN OUTCOME MEASURES

To be eligible for inclusion, articles had to contain at least three sentences about trastuzumab. Articles that focused on the financial performance of companies associated with the drug were excluded from the analysis. For each included article, we extracted bibliographic details and data, and independently rated the reporting slant towards trastuzumab and, where relevant, the reporting slant towards access to treatment.

RESULTS

We identified 361 articles that met the study inclusion criteria. The proprietary name of Herceptin was always used, with only eight articles mentioning the generic alternative. 294/361 included articles (81.5%) were rated as being positive towards trastuzumab, the remainder rated as neutral. Access to trastuzumab treatment was the main narrative running across included articles and reports of individual patients seeking treatment featured prominently throughout. In 208/361 of included articles (57%) the reporting slant towards access to trastuzumab treatment was rated as negative. 178/361 of included articles (49.3%) mentioned licensing, but rarely mentioned that licensing processes can only occur when the manufacturer applies for a licence. Only a minority of articles mentioned that the drug had to be licensed before it could be subject to the NICE approval process.

CONCLUSIONS

Newspaper coverage of trastuzumab has been characterized by uncritical reporting. Journalists (and consumers) should be more questioning when confronted with information about new drugs and of the motives of those who seek to set the news agenda.

Risk communication for public health emergencies

This review defines crisis risk communication, traces its origins to a number of applied fields, and then shows how basic principles have become incorporated into emergency preparedness and risk communication for public health. Literature from four different disciplines that inform crisis risk communications are reviewed. These are (a) environmental risk communication, (b) disaster management, (c) health promotion and communication, and (d) media and communication studies. Current curricula and training materials are briefly reviewed. Although this literature review suggests much progress has been made to incorporate and disseminate crisis risk communication principles into public health practice, and case studies suggest that public health workers have gained skills and experience, this emerging field still lacks in-depth evaluation of the effectiveness of event-specific crisis risk communication efforts.

Media reporting of tenofovir trials in Cambodia and Cameroon

BACKGROUND

Two planned trials of pre-exposure prophylaxis tenofovir in Cambodia and Cameroon to prevent HIV infection in high-risk populations were closed due to activist pressure on host country governments. The international news media contributed substantially as the primary source of knowledge transfer regarding the trials. We aimed to characterize the nature of reporting, specifically focusing on the issues identified by media reports regarding each trial.

METHODS

With the aid of an information specialist, we searched 3 electronic media databases, 5 electronic medical databases and extensively searched the Internet. In addition we contacted stakeholder groups. We included media reports addressing the trial closures, the reasons for the trial closures, and who was interviewed. We extracted data using content analysis independently, in duplicate.

RESULTS

We included 24 reports on the Cambodian trial closure and 13 reports on the Cameroon trial closure. One academic news account incorrectly reported that it was an HIV vaccine trial that closed early. The primary reasons cited for the Cambodian trial closure were: a lack of medical insurance for trial related injuries (71%); human rights considerations (71%); study protocol concerns (46%); general suspicions regarding trial location (37%) and inadequate prevention counseling (29%). The primary reasons cited for the Cameroon trial closure were: inadequate access to care for seroconverters (69%); participants not sufficiently informed of risks (69%); inadequate number of staff (46%); participants being exploited (46%) and an unethical study design (38%). Only 3/23 (13%) reports acknowledged interviewing research personnel regarding the Cambodian trial, while 4/13 (30.8%) reports interviewed researchers involved in the Cameroon trial.

CONCLUSION

Our review indicates that the issues addressed and validity of the media reports of these trials is highly variable. Given the potential impact of the media in formulation of health policy related to HIV, efforts are needed to effectively engage the media during periods of controversy in the HIV/AIDS epidemic.

Scientists' and science writers' experiences reporting genetic discoveries: toward an ethic of trust in science journalism

PURPOSE

To describe the relationship between scientists and science writers and their experiences with media reporting of genetic discoveries.

METHODS

This study included individual interviews with 15 scientists who specialize in genetics and 22 science writers who have covered their stories and a qualitative analysis of the data.

RESULTS

Scientists and science writers place an equally high priority on accuracy of media reports. They agree on what makes genetics stories newsworthy and the particular challenges in reporting genetic discoveries (i.e., poor public understanding of genetics, the association of genetics with eugenics, and the lack of immediately apparent applications of genetic discoveries to human health). The relationship between scientists and bona fide science writers is largely positive. Scientists tend to trust, respect, and be receptive to science writers. Both scientists and science writers acknowledge that trust is an essential component of a good interview. Science writers report a fair degree of autonomy with respect to the relationship they have with their editors.

CONCLUSION

To the degree that trust facilitates the access that science writers have to scientists, as well as higher quality interviews between scientists and science writers, trust might also contribute to higher quality media reporting. Therefore, scientists and science writers have an ethical obligation to foster trusting relationships with each other. Future research should systematically explore ways to cultivate such relationships and assess their impact on the quality of science journalism.

The commercialisation of medical and scientific reporting

Commercial influences on research results can in turn lead to "hype" in science and medicine news stories

Reporting medical information: effects of press releases and newsworthiness on medical journal articles' visibility in the news media

BACKGROUND

Characteristics defining newsworthiness of journal articles appearing in JAMA and NEJM were examined to determine if they affect visibility in the news media. It was also hypothesized that press releases affected the amount of news coverage of a journal article due to the fact that the most newsworthy journal articles are selected for press releases.

METHODS

Journal articles (N = 95) were coded for characteristics believed to describe the "newsworthiness" of journal articles. Quantity of news coverage of the journal articles was estimated using the LEXIS-NEXIS database. Bivariate associations were examined using one-way analysis of variance, and multivariate analyses utilized OLS regression.

RESULTS

Characteristics of the newsworthiness of medical journal articles predicted their visibility in newspapers. The issuing of press releases also predicted newspaper coverage. However, press releases predicted newspaper coverage largely because more newsworthy journal articles had accompanying press releases rather than because the press release itself was influential.

CONCLUSIONS

Journalists report on medical information that is topical, stratifies risk based on demographic and lifestyle variables, and has lifestyle rather than medical implications. Medical journals issue press releases for articles that possess the characteristics journalists are looking for, thereby further highlighting their importance.

Basic estimate of needs for training in evidence-based medicine in Slovakia

This study reports the findings of the first survey of the knowledge and needs for training in evidence based medicine (EBM) of health-care workers in Slovakia. This study was primarily qualitative and based on a triangular approach, which included: analysis of the situation in pre- and postgraduate education in Slovakia aimed at estimating needs in EBM and critical appraisal skills (CAS) training; analysis of questionnaires distributed in a sample of medical doctors and university educated public health workers undergoing postgraduate training; and focus group discussions. The findings revealed a real gap in knowledge in EBM and CAS in Slovakia and identified several areas as the focus for intervention. The results showed also some important behavioural and cultural aspects, including low individual responsibility for education; tendency to delegate responsibility to authorities (experts, top management, Ministry of Health); and persistence of the state paternalistic type of education. Concludes that managers planning to implement EBM in Slovakia should therefore consider a broader behavioural and cultural context for change, not just introduction of a training EBM module.

[Media impact of the SESPAS (Spanish Public Health Association) 2000 report]]

OBJECTIVE

To measure the mediatic effect of different communication strategies used in public health advocacy. More specifically, to compare the effectiveness of the World Wide Web as a tool to attract the attention of journalists, with other more traditional formulas.

METHODS

For the Spanish Public Health Association (SESPAS) Report 2000, two types of media strategies to communicate the report contents were programmed: a) traditional and passive strategies, centred in approaching journalists through press releases and press conferences around the SESPAS meeting (November 15-20 1999); b) interactive strategies, since August 15 to December 30, focused towards attracting health journalists to the non-embargoed, full text SESPAS report launched in a web site. To facilitate the web page use, we wrote a letter, in the first week of August, to all the members of the Spanish Health Communicators Association giving them the URL and the website map. In parallel, a monitoring system of the media impact was established from August to December 99, covering 250 magazines and 70 newspapers, in order to locate and recover all the stories about the SESPAS report for further analysis.

RESULTS

Sixty-six stories were recovered; they were published in 32 press media from 24 provinces with an advertising value of 18,243,873 Ptas. As a whole, smaller circulation rate papers published more stories than larger ones. During five months, the SESPAS report was present in the press agenda, even though stories were not distributed homogeneously over time. Information concentrated around three moments: the first one, a week after our summer mailing; the second one, in the occasion of the publication of a story about the increase in traffic accidents in El País, and the third one during the SESPAS meeting. There were significant differences among those stories published from the traditional strategies of communication and those published from the interactive ones, the latter being more diverse, with more contributions of the journalists and tackling a wider range of issues.

CONCLUSIONS

The combination of traditional and alternative communication strategies was a effective option. Unlike previous experiences in this occasion, with the network aid, the presence of SESPAS in media was not punctual around the Congress, but maintained during five months. The results and the obtained experience of this research can be useful for future public health advocacy interventions in Spain.

[News about cancer in the press]

BACKGROUND

News on health and health care are increasingly common in the mass media, and cancer is one of the most prominent topic among these news due to its health impact.

MATERIAL AND METHODS

All news published in major newspapers in Catalonia, Spain between April to December 1996 were analysed, together with items from science and health supplements general information and science journals. Types of cancer-related topics, sources of information, the importance of cancer in the news item and the theme of the piece were analysed.

RESULTS

During the period analysed, 974 news items were published which dealt with cancer. Of these, cancer was the principal topic in 53.5% of the items published in the national press, and 63.4% of the items published in the regional press. Cancer was the subject of an editorial comment on only four occasions. The source of information was mentioned in 64.8% of the items, and mean number of sources was 1.6. Political institutions were the most frequent source of information in newspapers, while science and health supplements and other magazines tended to cite scientific and health care institutions, as well as scientific journals. Basic research was the most common topic for news (30.3%) in science and health supplements while risk and environmental factors (29.6%) were the most common topics in magazines; environmental and technological risk factors (18,6%) and conflicts with health administrative bodies (16%) were the most frequent topics in the newspapers.

CONCLUSION

News about risk factors and their prevention as well as technological and environmental factors related to cancer were among the most important topics published in the general press and magazines, together with conflicts with administrative bodies. Informations related to new therapies were a less frequent topic. Scientific journals have an important role as an information source for mass media together with political and scientific institutions.

An uneasy relationship: the tensions between medicine and the media

The enduring tensions between medicine and the media are largely due to the different perspectives of biomedical scientists and journalists, as this final essay in the series on medicine and the media underscores. These tensions arise because of perceived differences in defining science news, conflicts over styles of science reporting, and most of all disagreement about the role of the media. In the 1990s, scientists are especially concerned by media messages that question their credibility. Since scientists and journalists depend on each other in the communication of science and the shaping of the public meaning of science and medicine, the tensions are likely to increase.