Here we go again. Headlines across America blaring lines like, “Coffee may reduce stroke risk.”
It was a big study, but an observational study. Not a trial. Not an experiment. And, as we say so many times on this website that you could almost join along with the chorus, observational studies have inherent limitations that should always be mentioned in stories. They can’t prove cause and effect. They can show a strong statistical association, but they can’t prove cause and effect. So you can’t prove benefit or risk reduction. And stories should say that.
“The problem with this type of study is that there are too many factors unaccounted for and association does not prove causality, said Dr. Larry B. Goldstein, director of the Duke Stroke Center at Duke University Medical Center.
“Subjects were asked about their past coffee consumption in a questionnaire and then followed over time. There is no way to know if they changed their behavior,” Goldstein said.
And, he noted, there was no control for medication use or other potential but unmeasured factors.
“The study is restricted to a Scandinavian population, and it is not clear, even if there is a relationship, that it would be present in more diverse populations. I think that it can be concluded, at least in this population, that there was not an increased risk of stroke among coffee drinkers,” he said.”
When you don’t explain the limitations of observational studies — and/or when you imply that cause and effect has been established — you lose credibility with some readers. And you should. Read more »
We’re delighted to see that USA Today, Reuters, and WebMD were among the news organizations that included what an editorial writer said about an observational study linking ibuprofen use with fewer cases of Parkinson’s disease. All three news organizations used some version of what editorial writer Dr. James Bower of the Mayo Clinic wrote or said:
“Whenever in epidemiology you find an association, that does not mean causation.”
“An association does not prove causation.”
“There could be other explanations for the ibuprofen-Parkinson’s connection.”
Kudos to those news organizations. And some praise goes to the journal Neurology for publishing Dr. Bower’s editorial to accompany the study. His piece is entitled, “Is the answer for Parkinson disease already in the medicine cabinet? Unfortunately not.”
And unfortunately not all news organizations got that message. Because many don’t read the journals, so they certainly never get to the editorials. Instead, they rewrite quick hits off a wire service story. As a result, we end up with some of the following:
A FoxNews.com story was particularly deaf to Bower’s caveat, stating: “That bottle of ibuprofen in your medicine cabinet is more powerful than you may think.”
A CBSNews.com story never addressed the observational study limitation, instead whimsically writing: “Pop a pill to prevent Parkinson’s disease? A new study says it’s possible, and the pill in question isn’t some experimental marvel that’s still years away from drugstore shelves. It’s plain old ibuprofen.”Read more »
“Earlier this week, NBC’s “Dateline” devoted an entire hour on Sunday evening to allow the actress Suzanne Somers to express her rather unconventional beliefs about cancer.
It is not the first time a major media outlet has given air time to Ms. Somers, whose journey into the medical realm has been featured on a variety of news programs, talk shows and entertainment channels. A few years ago, Oprah Winfrey invited Ms. Somers on her show to share the secrets behind her youthful appearance — a complex regimen of unregulated hormone creams and some 60 vitamins and supplements.
But is it entirely outrageous that respected media organizations continue to give the “Three’s Company” sitcom star a platform to dispense medical advice? Not really, in a world in which celebrities have become among the most recognizable spokespeople — and sometimes experts — about various diseases.
…
…patients — especially those who want to explore every possible avenue — have the right to know that there are unorthodox cancer therapies that some people believe are helpful.
But not without several caveats, and that is where Ms. Somers, and many of those in the media who discuss her books and views, have failed. Ms. Somers says she is promoting hope, but false hope benefits no one.
Many people with end-stage cancer are, understandably, desperate, and thus potentially vulnerable to a sales pitch — even an expensive one. But here is a case when an informed patient may truly be a wiser patient. Perhaps if doctors were more willing to address the fact that these nontraditional treatments exist, and share what we do and don’t know about their effectiveness, an actress like Ms. Somers would have less influence, and science would override celebrity.”
There’s been quite an online response to Dr. Lerner’s blog post. One reader wrote, succinctly:
I was very sad and quite angry after watching a powerful video this weekend entitled “The Faces of Medical Error: From Tears to Transparency.” It’s the story of Michael Skolnik. His mother, Patty, gave me the video when I met her recently. Michael had what may have been unnecessary brain surgery in 2001 and died three years later.
The Skolniks worked on this video as part of an educational campaign on medical error, and they created an organization now named Citizens for Patient Safety. Here’s a trailer to the video:
You can also watch a Today Show segment that profiled the Skolniks from a few years ago:
While much of the message is about medical errors and malpractice, the Skolniks also promote a message of the “critical need for shared decision-making.” In fact, I met Patty at a shared decision-making conference.
If you haven’t heard Michael Skolnik’s story, you should. And if you’re like me, you’ll need a tissue box close by for the sadness, and something else to help with the ensuing anger.
Thanks to Patty Skolnik for sharing the story and the video with me.
One of the things that makes evaluating medical evidence difficult is knowing whether what’s being published actually reflects reality. Are the studies we read a good representation of scientific truth, or are they full of cherry-picked data that help sell drugs or skew policy decisions?
That question may sound like that of a paranoiac, but rest assured, it’s not. Researchers have worried about a “positive publication bias” for decades. The idea is that studies showing an effect of a particular drug or procedure are more likely to be published. In 2008, for example, a group of researchers published a New England Journal of Medicine study showing that nearly all — or 94 percent — of published studies of antidepressants used by the FDA to make approval decisions had positive results. But the researchers found that when the FDA included unpublished studies, only about half — or 51 percent — were positive.
A PLoS Medicine study published that same year found similar results for studies long after drugs were approved: Less than half — 43 percent — of studies used by the FDA to approve 90 drugs were published within five years of approval. It was those with positive results that were more likely in journals.
All of that can leave the impression that something may work better than it really does. And there is at least one powerful incentive for journals to publish positive studies: Drug and device makers are much more likely to buy reprints of such reports. Such reprints are highly lucrative for journals. Read more »
It’s no secret that doctors are disappointed with the way that the U.S. healthcare system is evolving. Most feel helpless about improving their work conditions or solving technical problems in patient care. Fortunately one young medical student was undeterred by the mountain of disappointment carried by his senior clinician mentors…
I am proud to be a part of the American Resident Project an initiative that promotes the writing of medical students residents and new physicians as they explore ideas for transforming American health care delivery. I recently had the opportunity to interview three of the writing fellows about how to…
I m often asked to do book reviews on my blog and I rarely agree to them. This is because it takes me a long time to read a book and then if I don t enjoy it I figure the author would rather me remain silent than publish my…
When I was in medical school I read Samuel Shem s House Of God as a right of passage. At the time I found it to be a cynical yet eerily accurate portrayal of the underbelly of academic medicine. I gained comfort from its gallows humor and it made me…
I am hesitant to review diet books because they are so often a tangled mess of fact and fiction. Teasing out their truth from falsehood is about as exhausting as delousing a long-haired elementary school student. However after being approached by the authors’ PR agency with the promise of a…
