Better Health: Smart Health Commentary Better Health (TM): smart health commentary

Article Comments (1)

How Effective Are Antidepressants?

Antidepressant drugs have been getting a bad rap in the media. I’ll just give 3 examples:

  • On the Today show, prominent medical expert :-) Tom Cruise told us Brooke Shields shouldn’t have taken these drugs for her postpartum depression.
  • In Natural News, “Health Ranger” Mike Adams accused pharmaceutical companies and the FDA of covering up negative information about antidepressants, saying it would be considered criminal activity in any other industry.
  • And an article in Newsweek said  “Studies suggest that the popular drugs are no more effective than a placebo. In fact, they may be worse.”

Yet psychiatrists are convinced that antidepressants work and are still routinely prescribing them for their patients. Is it all a Big Pharma plot? Who ya gonna believe? Inquiring minds want to know:

  • Are antidepressants more effective than placebo?
  • Has the efficacy of antidepressants been exaggerated?
  • Is psychotherapy a better treatment choice?

The science-based answers to the first two questions are clearly “Yes.” The best answer to the third question is “It depends.”

In 2008, Erick Turner and four colleagues published an article in The New England Journal of Medicine (NEJM) entitled “Selective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy.” The FDA is able to make sure that drug companies don’t pick and choose which trials, and which outcomes within those trials, get seen. Using clinical trial data from the FDA as a gold standard, Turner, et. al. examined how these same trials were reported in published journal articles, They found that:

…according to the published literature, the results of nearly all of the trials of antidepressants were positive. In contrast, FDA analysis of the trial data showed that roughly half of the trials had positive results.

And some of the negative trials were published with a “spin” that made them appear positive. The data did show that each drug was superior to placebo, but the true magnitude of that superiority was less than a diligent literature review would indicate. They warned that

By altering the apparent risk–benefit ratio of drugs, selective publication can lead doctors to make inappropriate prescribing decisions that may not be in the best interest of their patients and, thus, the public health.

Irving Kirsch has been outspoken about antidepressants’ alleged lack of efficacy. In a controversial meta-analysis published in 1998, he found that placebos provided approximately 75% of the improvement provided by active drug. He suggested that the other 25% is debatable and could be due to an enhanced placebo response when patients experience side effects that convince them they are getting an active drug. In a further study in 2002, he “questioned the clinical significance of antidepressants.”

Kirsch recently looked at the FDA data for 4 of the 12 drugs that Turner examined. In spite of the smaller sample, where Turner found an effect size of 0.31, Kirsch got 0.32. So they got almost exactly the same result. But it was their interpretations of that result that were very different. Kirsch concluded that antidepressants are ineffective, while Turner found that the drugs were indeed superior to placebo. As the figure below shows, each drug’s effect size was positive. Also, none of the confidence intervals overlapped zero. This means that, while there is some probability that the true effect size is zero, meaning that antidepressants and placebo are equal in efficacy, that probability is negligibly small.

The discrepancy between Turner’s and Kirsch’s interpretations hinges on what these effect size numbers mean in terms of clinical significance,. Values of 0.2, 0.5, and 0.8 were once proposed as small, medium, and large effect sizes, respectively. The psychologist who proposed these landmarks admitted that he had picked them arbitrarily and that they had “no more reliable a basis than my own intuition.” Later, without providing any justification, the UK’s National Institute for Health and Clinical Excellence (NICE) decided to turn the 0.5 landmark (why not the 0.2 or the 0.8 value?) into a one-size-fits-all cut-off for clinical significance. In an editorial published in the British Medical Journal (BMJ), Turner explains with an elegant metaphor: journal articles had sold us a glass of juice advertised to contain 0.41 liters (0.41 being the effect size Turner, et al. derived from the journal articles); but the truth was that the “glass” of efficacy contained only 0.31 liters. Because these amounts were lower than the (arbitrary) 0.5 liter cut-off, NICE standards (and Kirsch) consider the glass to be empty. Turner correctly concludes that the glass is far from full, but it is also far from empty. He also points out that patients’ responses are not all-or-none and that partial responses can be meaningful.

Incidentally, NICE is no longer using the 0.5 effect size cutoff.

If we followed Kirsch’s interpretation and rejected antidepressants, how would we treat depression? Psychotherapy avoids the side effects of drugs, but it has its own drawbacks: it is expensive, time-consuming, and variable in quality. How effective is psychotherapy? Psychotherapy trials also suffer from publication bias, just like antidepressant drugs. And when one weeds out low quality studies, psychotherapy has an effect size of only 0.22, lower than the value for antidepressants reported by Kirsch himself. So if we reject any treatment below the (arbitrary) 0.5 cutoff, when a mental health care provider is faced with a patient in need of help, is he or she to do nothing at all?

I don’t doubt that antidepressants have sometimes been over-prescribed and used inappropriately for lesser levels of depression where they are less effective or even ineffective, but this is probably true for psychotherapy, as well. On the other hand, it has been estimated that only about half of depressed patients are getting any kind of treatment. Severe depression is a life-threatening disease. A recent study showed that antidepressants reduced the risk of suicide by 20% in the long term. The risk/benefit ratios are still not clear cut for either form of treatment.

Once more, science fails to give us the black-and-white answers we crave. And once again we are reminded that we can’t rely on the media for accurate, nuanced information about medical science.

For his assistance in preparing this article and for providing the figure, I want to thank Erick Turner, M.D., Department of Psychiatry, Oregon Health and Science University; Staff Psychiatrist, Portland Veterans Affairs Medical Center; Former reviewer, FDA.

*This blog post was originally published at Science-Based Medicine*


You may also like these posts

Read comments »


One Response to “How Effective Are Antidepressants?”

  1. Sherry Reynolds @cascadia says:

    One of the key lessons from Dr Turner’s article in the New England Journal of Medicine was to warn us that journal reviewed articles aren’t the gold standard many doctors were taught they were.

    In his study on anti-depressants journal articles indicated that “94% of the trials were positive, meaning that the drug was statistically superior to placebo with a P value of less than .05. On the other hand, if you go by the FDA reviews, you see that the true proportion of positive trials is 51%. That’s quite different. Nearly 100% dropped to essentially 50-50.” That is huge.. Below is a link to a great interview by Dr. Turner that highlights the story behind his article and the challenges in getting it published as well as some great charts that highlight the difference between FDA data and journal published article data.

    http://sciencewatch.com/inter/aut/2009/09-may/09mayTurner/

    Science may not give us either or answers in this case but Pharma (the largest funder of medical journals and physician conferences) and the media are clearly skewing the data even further. If advertising didn’t influence providers behavior I am very sure they would stop doing it. It also explains pharma’s push into both the EHR market as well as their recent purchases of HIE. What is their goal?

    It is also very obvious that drug companies rarely if ever fund studies into the effectiveness of non-pharmaceutical interventions like counseling, diet and exercise, social support, etc which in many cases are just as effective (for both minor and moderate depression). Very few anti-depressant trials are for more then 12 weeks and yet we often have people on them for a few years and it reminds me of the dangers of other FDA approved medication like DES..

    For those that are to young to knw about the DES scandal in the 70′s they the research for years that DES had no efficacy in preventing miscarriages but we continue to prescribe it to millions of pregnant women until their daughters started to develop vaginal cancer as adolescents. Now some 50 years later the mom’s have higher rates of breast cancer (40%) and it appears the rates of breast cancer in the DES daughters are up 200% (to 1 in 4) but drug companies continued to sell it in Europe for years after it was pulled in the US.

    On the other hand headlines blaring a 200% increase in autism (true 2% to 4%) among children born to women who took SSRI’s in the year prior to their pregnancy raises real questions on the other side in how the lay media can over-exaggerate risks based on a study as well

Return to article »

Latest Interviews

IDEA Labs: Medical Students Take The Lead In Healthcare Innovation

It’s no secret that doctors are disappointed with the way that the U.S. healthcare system is evolving. Most feel helpless about improving their work conditions or solving technical problems in patient care. Fortunately one young medical student was undeterred by the mountain of disappointment carried by his senior clinician mentors…

Read more »

How To Be A Successful Patient: Young Doctors Offer Some Advice

I am proud to be a part of the American Resident Project an initiative that promotes the writing of medical students residents and new physicians as they explore ideas for transforming American health care delivery. I recently had the opportunity to interview three of the writing fellows about how to…

Read more »

See all interviews »

Latest Cartoon

See all cartoons »

Latest Book Reviews

Book Review: Is Empathy Learned By Faking It Till It’s Real?

I m often asked to do book reviews on my blog and I rarely agree to them. This is because it takes me a long time to read a book and then if I don t enjoy it I figure the author would rather me remain silent than publish my…

Read more »

The Spirit Of The Place: Samuel Shem’s New Book May Depress You

When I was in medical school I read Samuel Shem s House Of God as a right of passage. At the time I found it to be a cynical yet eerily accurate portrayal of the underbelly of academic medicine. I gained comfort from its gallows humor and it made me…

Read more »

Eat To Save Your Life: Another Half-True Diet Book

I am hesitant to review diet books because they are so often a tangled mess of fact and fiction. Teasing out their truth from falsehood is about as exhausting as delousing a long-haired elementary school student. However after being approached by the authors’ PR agency with the promise of a…

Read more »

See all book reviews »