Better Health: Smart Health Commentary Better Health (TM): smart health commentary

Article Comments

The Dartmouth Atlas Debate: Careful Consideration Needed

The worst-kept secret in journalism circles recently was that the New York Times was planning an article critical of the Dartmouth Atlas. Among the main points in the article:

• “The mistaken belief that the Dartmouth research proves that cheaper care is better care is widespread.”

• “The atlas’s hospital rankings do not take into account care that prolongs or improves lives.”

• “Even Dartmouth’s claims about which hospitals and regions are cheapest may be suspect.”

• “Failing to make basic data adjustments undermines the geographic variations the atlas purports to show.”

The Times has also published the correspondence it had with the Dartmouth team about methodology questions.

The Dartmouth team challenges each of these criticisms. The team says the Times made at least five factual errors and several misrepresentations. They write:

“What is truly unfortunate is that the Times missed an opportunity to help educate the American public about what our research actually shows — or about the breadth of agreement about what our findings mean for health care reform.”

Oddly, the Times called the Atlas researchers “a once obscure research group at Dartmouth College.” I guess if you consider “once obscure” as 20 years ago, you might be right. Putting that phrase in the first sentence opened the discussion on a questionable note.

The Times is correct in stating that “the debate about the Dartmouth work is important.”

But as Merrill Goozner wrote on his blog:

“…as is often the case in journalism, the attempt to reduce complex realities into a single-factor analysis that can be summarized in a headline or a single “why this story is important” paragraph can leave a mistaken impression. Regional variation in Medicare spending is one indicator of gross overutilization. Something is happening when a hospital in McAllen, Texas does twice as many knee implants per Medicare beneficiary as a hospital in Rochester, Minnesota.

But that by itself tells us nothing about why that overutilization occurs. Greedy doctors or hospitals working in a fee-for-service system are part of the problem. Cost shifting due to high levels of uninsurance and illness severity also may account for some or even much of those differences. And, as the Times report points out, quality differentials have to be taken into account.

The pushback by Dartmouth defenders has already begun. Columbia University professor Andrew Gelman on his blog suggests the reporters need a lesson in statistics. My complaint with today’s story comes from an entirely different angle. Higher quality care lowers costs, it doesn’t raise costs.”

Thoughtful people should read a lot about the criticism and the countering comments from Dartmouth. This is not something that can be absorbed in a headline, in a nut graf, or in a quickie talk-show segment.

Also see: NYT Dartmouth Atlas criticism falls flat with many bloggers.

(Disclosure: I worked at Dartmouth throughout the 90s, right down the hall from many of these Atlas researchers. I consider many of them my friends. My work is currently supported by the Foundation for Informed Medical Decision Making, one of whose co-founders was Dr. Jack Wennberg of Dartmouth, whose work was the basis for the Atlas project.)

*This blog post was originally published at Gary Schwitzer's HealthNewsReview Blog*


You may also like these posts

Read comments »


Comments are closed.

Return to article »

Latest Interviews

IDEA Labs: Medical Students Take The Lead In Healthcare Innovation

It’s no secret that doctors are disappointed with the way that the U.S. healthcare system is evolving. Most feel helpless about improving their work conditions or solving technical problems in patient care. Fortunately one young medical student was undeterred by the mountain of disappointment carried by his senior clinician mentors…

Read more »

How To Be A Successful Patient: Young Doctors Offer Some Advice

I am proud to be a part of the American Resident Project an initiative that promotes the writing of medical students residents and new physicians as they explore ideas for transforming American health care delivery. I recently had the opportunity to interview three of the writing fellows about how to…

Read more »

See all interviews »

Latest Cartoon

See all cartoons »

Latest Book Reviews

Book Review: Is Empathy Learned By Faking It Till It’s Real?

I m often asked to do book reviews on my blog and I rarely agree to them. This is because it takes me a long time to read a book and then if I don t enjoy it I figure the author would rather me remain silent than publish my…

Read more »

The Spirit Of The Place: Samuel Shem’s New Book May Depress You

When I was in medical school I read Samuel Shem s House Of God as a right of passage. At the time I found it to be a cynical yet eerily accurate portrayal of the underbelly of academic medicine. I gained comfort from its gallows humor and it made me…

Read more »

Eat To Save Your Life: Another Half-True Diet Book

I am hesitant to review diet books because they are so often a tangled mess of fact and fiction. Teasing out their truth from falsehood is about as exhausting as delousing a long-haired elementary school student. However after being approached by the authors’ PR agency with the promise of a…

Read more »

See all book reviews »