5. Watch Out For Junk News

Health News Review is a website published by Gary Schwitzer that is dedicated to improving the accuracy of news stories about medical treatments, tests, products and procedures and helping consumers evaluate the evidence for and against new ideas in health care. To this end, the foundation established a set of ten criteria to apply to medical stories reported in the popular media in order to evaluate their accuracy, balance, and completeness. Editor-at-Large for MedPage Today, George Lundberg MD, refers to these criteria as “10 Rules to Expose Medical Junk News” and argues that, “While [Schwitzer’s] approach cannot prevent fraud, liars, and fabricators, a careful use of his criteria can help the reader filter out what is likely to be real junk, or even worse, harmful.” In an environment of medical hype, I’d have to agree.

Check out “The Rules” and consider how they may be used to evaluate a news story about one of the most sensationalized and divisive topics in the breast cancer world: screening mammograms.

Rules for Medical Reporting:

  1. How available is the treatment/test/product/procedure to the likely reader/viewer/listener at the time of the report?
  2. What is the cost or charge for the test/treatment/product or procedure mentioned in the story? To the patient? The insurance company? The government?
  3. Is there evidence of disease mongering in the story? Does it oversell or exaggerate a condition or create unwarranted fear?
  4. Does the story seem to grasp and convey the quality of the evidence supporting the basis for the study?
  5. Does the article provide appropriate balance about harms that might be caused by the treatment/test/product/procedure that constitutes the basis for the story?
  6. Does the story establish the true novelty of the approach? Much that is purported to be new, really is not.
  7. How does the story frame the relative quantitative value of a new treatment, test, product, or procedure and place the benefits in context with others, especially dealing with absolute and relative values?
  8. Did the author and editor of the medical news story rely solely or largely on a press release or did they also seek and quote other sources?
  9. Was there an independent source and were any possible conflicts of interests of sources disclosed in the article?
  10. Does the story provide the context of treatment/test/product/procedure other than those that are being reported?

Health News Review goes into detail about how to use each of these criteria to evaluate health news. For instance, a story that uses disease mongering (#3) may present spurious statistics, exaggerate human consequences, or present “worst-case” scenarios as if they represented everyone with the condition. A story that is unsatisfactory in providing balanced coverage of harms (#5) may fail to mention, quantify, or describe the severity of potential harms or side effects, or it may rely on an investigator’s comment or anecdotal evidence of safety.

How do the criteria work with an actual news story?

Consider a story from Reuters (June 28, 2011), “Benefit of Mammograms Even Greater Than Thought.” The story reported on the results of a long-term Swedish study that compared women who were invited for routine screening and compared their outcomes to those who were not invited for routine screening but still received usual care. The study found a significant reduction in mortality 29 years after women received their first mammogram. At first glance it appears to be confirmation that routine screening significantly reduces death from breast cancer. However, Health News Review considered the story to be confusing, biased, and incomplete. When applying the ten criteria for medical reporting the short-comings are clear.

Health News Review rated the story as satisfactory on only three of the criteria: (#3) Avoiding disease-mongering, (#6) establishing the novelty of approach, and (#8) not relying solely on a press release for story content. However, the story was unsatisfactory on each of the remaining criteria: (#2) giving no cost information, (#4) omitting a discussion of the study limitations and quality of evidence, (#5) failing to provide a balanced review of the benefits and harms, (#7) failing to contextualize the quantitative data, (#9) lacking an independent perspective, and (#10) failing to provide a greater context for the approach, particularly in light of the findings from the U.S. Preventive Services Task Force. Health News Review stated further that,

“The available evidence on the utility of screening mammograms is conflicting and complex and this story muddies the waters even more by largely ignoring the discussion of harms associated with mammography and introducing a suggested screening schedule, which this study was not even designed to address. In addition, the story line about the mammography debate is not, “Does screening save lives or not?” Rather, it is, “Is it worth it for an individual woman to be screened, when for some (e.g. 40-50 year olds), the benefit is quite small?” The U.S. Preventive Services Task Force did not say that screening did not reduce mortality. It said that for some women, the trade-off between that benefit and the potential harms is a close call and should be weighed by the woman and her physician.”

Taking the story at face value would give a false impression of the study results and their contribution to the body of research on screening. Given the ongoing debate about the role of screening for all women and the ongoing concern about how women might make definitive decisions about when, and how often, to get screened in the face of it, the story has the potential to do more harm than good.

Apply “The Rules” & Avoid Junk News.

For more consciousness raising essays, check out “30 Days of Breast Cancer Awareness.”

Be Sociable, Share!

"women urged to get screened because it might save their lives. But that’s only 1 possible outcome, and it’s the least likely one" @cragcrest cutt.ly/jei8WJr

“Pink Ribbon Blues”

Paperback includes a new Introduction on fundraising controversies and a color insert with images of, and reactions to, the pinking of breast cancer (2012).

Praise » 

Flyer »

Press Release »

Hardback Cover »

Paperback Cover »

Request Review Copies »

Order the Paperback »


"Seeing clearly through the pink haze" Toronto Sun

*Sad face*: Being happy does not help you live longer" New Scientist

How should we address breast cancer when norms continually change? The Guardian

Your Fun 'No Bra Day' Photos Are Overshadowing Terminal Breast Cancer Patients Broadly

Backlash against “pinkwashing” of breast cancer awareness campaigns BMJ

Breast Cancer to Rise 50 Percent by 2030? Hey, Not So Fast! Health News Review

Breast Cancer: The Flaws in the Cause iafrica.com

How to Make the Biggest Impact With Your Breast Cancer Donations Money

The Very Pink, Very Controversial Business of Breast Cancer Awareness Racked

NFL, Pink Ribbons Not Enough to Win over Women CNN

3 Questions We Need to Answer for Breast Cancer Awareness Month Chronicle of Philanthropy

The problem with National Breast Cancer Awareness Month Women's Health Magazine

Pink Ribbon Envy: Living with an Uncool Cancer The Nib

A Year After Bombings, Some Say 'Boston Strong' Has Gone Overboard NPR, All Things Considered

Canadian Mammogram Study KCRW, NPR Affiliate

Time to Debunk the Mammography Myth CNN

Breast Cancer: Awareness, Activism & Pinkwashing NPR Charlotte

Buying Pink Al Jazeera's The Stream Watch »

The Pink Backlash Orlando Sentinel

Why Jolie's Test Costs So Much CNN

Preventative Mastectomies: Disease and Deception BlogTalkRadio

Angelina Jolie and the 'Breast Cancer Gene' KCRW

Our Feel-Good War on Breast Cancer The New York Times Magazine.

The Story Behind the Pink Ribbon Campaign Sisters Talk Radio

WISH Interview Women's International Summit for Health

Making Cancer About The Patient, Not The Body Part CBS Pittsburgh

Sexy breast cancer campaigns anger many patients USA Today

The perils of pink The Daily

Komen pink campaign creates breast-cancer blues for some Dallas Morning News

A yellow flag for the NFL's pink New York Daily

Gayle Sulik named #7 in SharecareNow’s Top 10 Online Influencers in Breast Cancer

Breast cancer cancer causes so easily derailed Philly Inquirer

Komen Charity Under Microscope for Funding, Science Reuters

The Fight Against Cancer - And Abortion? Salon.com

Susan G. Komen For the Cure defunds Planned Parenthood. In Deep with Angie Coiro

Amid Breast Cancer Month, Is there Pink Fatigue? NPR's All Things Considered

How is Breast Cancer Culture Undermining Women's Health? America’s Radio News Network

Pink Ribbon Culture and Breast Cancer The Kojo Nnamdi Show

The Big Business of Breast Cancer
Marie Claire

Does Breast Cancer Awareness Month Crowd Out Other Diseases? Slate

Pink Inc. Has Many Starting to See Red The Sacramento Bee

Get Your Pink Off Ottawa Citizen

Komen Pink Ribbons Raise Green and Questions USA Today