Skip to main content

Can you trust health news?

John Swartzberg, clinical professor emeritus, public health | March 16, 2015

Reporting health news isn’t easy, especially when journalists have short deadlines and limited space to parse research that’s frequently complex, nuanced, and laced with caveats. On top of that, there’s often the temptation — for scientists, press offices, and reporters — to oversimplify and oversell research findings to get more attention. I notice this more and more in health news these days.

Recently two analyses of news stories about health and medicine caught my eye. The researchers gave many, if not most, of the stories failing grades and identified some all-too-common pitfalls.

wellness180cThe first analysis, published in JAMA Internal Medicine in summer 2014, judged nearly 1,900 media reports published in the U.S. since 2006 about new drugs, medical devices, screening tests, and procedures. It graded most reports as unsatisfactory in how they discussed the benefits and harms of the interventions, their costs, and the quality of the evidence. Among the faults it found in most news reports:

  • Potential benefits were exaggerated; harms were minimized or ignored.
  • They relied on a single source, often a press release.
  • Benefits were expressed only in terms of “relative risk” and thus sounded more dramatic than they would have had “absolute risk” been reported. The researchers gave as an example a news report that stated that aspirin reduced the risk of stroke in women by 24 percent—but that left out the less-impressive fact that this worked out to two fewer strokes per 1,000 women over six years. (We report relative risk on Berkeley Wellness only when we judge the absolute risk to be substantial enough to justify doing so.)
  • The reports focused on observational studies, but didn’t attempt to explain the limitations of such research. As we often point out, such studies find only associations and cannot prove cause and effect.
  • They relied on positive anecdotes from patients and doctors.
  • Coverage of expensive new technologies was “fawning,” with little or no discussion of their cost or their effectiveness compared with existing alternatives.

Not just the reporters’ fault

The second analysis, published in the journal BMJ in December 2014, concluded that much of the misinformation and exaggeration found in health-related news stories can be traced back to press releases, which are the “dominant link between academia and the media.” Of course, that’s not a good excuse for reporters, since they shouldn’t rely on press releases, at least not without making sure they match up with what the studies actually found.

The researchers looked at 462 press releases from 20 leading British universities in 2011. They found that more than one-third contained exaggerated statements not found in the published studies, and that these were likely to end up in news stories. There were three main types of distortions: extrapolating the results of animal research to humans, making causal statements based on observational results, and giving advice not found in the studies.

So it’s the fault of academic press officers? Not quite, since researchers usually get to review the releases about their studies. “The blame — if it can be meaningfully apportioned — lies mainly with the increasing culture of university competition and self-promotion, interacting with the increasing pressures on journalists to do more with less time,” the authors concluded.

Crossposted from Berkeley Wellness.

Comments to “Can you trust health news?

  1. Excellent points. When it comes to health news, or any news for that matter, the first thing I look at is the source. Second, if the “news” has no references (preferably with links) then I become highly suspicious. I own a health, wellness, and nutrition news blog and I always ensure our content makes no false claims and we always site all references with links back to the source. Thank you for providing this information.

  2. It depends on whether to trust health news or not. Some might true and some might not. Internet is booming so there is plenty of information available on a single condition. You can just read if for knowledge purpose but do not apply or use that in real life without taking advice from specializing health professional.

  3. Reporting health news or expressing opinion on health related articles are one the most complex branch of the news reporting because more than enough health research reports flow in on a daily basis and sometimes it is up to the reporter to select authenticated work without any prior experience in the field, which in turns leads to misguided reporting. Two reports compared here are the fine example of misleading health reports. But as a reader it is our responsibility to do proper research on such reports before taking steps on them.

    According to the BMJ analysis, it is clear that most of the time reporters rely on press releases and press releases plays a vital link between the academia and media. But it is the responsibility of the reporters to do background research on these releases before publishing a report, because lots of us takes those unresearched advices seriously and if something goes wrong there is no one to blame.

    The author made it clear in the end that it is not the reporter’s fault too, because of they have to deliver more in less time which leads to unstudied report publication.

    • This article states a clear case on not believeing current news reports, rather when in question the resolve is to research yourself utilizing confirmed study resources.

Comments are closed.