Better Health: Smart Health Commentary Better Health (TM): smart health commentary

Article Comments (1)

How Reliable Is Health Information On The Web?

Recently some Science-Based Medicine (SBM) colleagues (David Gorski, Kimball Atwood, Harriet Hall, Rachel Dunlop) and I gave two workshops on how to find reliable health information on the Web. As part of my research for this talk I came across this recent and interesting study that I would like to expand upon further: Quality and Content of Internet-Based Information for Ten Common Orthopaedic Sports Medicine Diagnoses.

The fact that the article focuses on orthopedic diagnoses is probably not relevant to the point of the article itself, which was to assess the accuracy of health information on the Web. They looked at 10 orthopedic diagnoses and searched on them using Google and Yahoo, and then chose the top results. They ultimately evaluated 154 different sites with multiple reviewers for quality of content and also for their HON rating.

For background, the HON rating comes from an independent organization, the Heath on the Net Foundation, that rates health care sites on a number of criteria. These include assessment of how authoritative the sources are, the level of transparency, and if opinions expressed are justified with evidence and references. While generally reasonable, the HON assessment does not necessarily involve a thorough assessment of the quality of the science on a given website, and many sites with what I would consider dubious information have earned the HON seal of approval.

Among other things, this new study evaluated how scientifically accurate health information on the websites they reviewed was, and also compared them to their HON ratings. They divided the websites evaluated into various types -– non-profit, academic, commercial, and individually run. What they found was that the quality of information was significantly better on non-profit and academic sites than on commercial and individually run sites. This is not surprising –- commercial sites are likely to be compromised by a desire to advertise or sell product. But “commercial” also refers to sites that monetize content –- not necessarily selling products, but simply providing content as their product in order to sell advertising. This includes sites such as WebMD.

It is also not surprising that individual sites also scored relatively low on average. An individually run site is only as good as the individual running it, so there is bound to be a great deal of variability. Also, individuals are more likely to make mistakes or have missing information than groups.

Non-profit and academic sites are more likely to have editorial policies that emphasize quality and integrity of content. But also they are more likely to have some vetting process for information. At SBM (a non-profit site) for example, we carefully guard our editorial integrity and also provide some layer of editorial oversight.

But the study also provides reason to be cautious, even about the best sites. They rated quality of information on a 100-point scale and found a range of 45 to 61 percent. So even the best sites had a mediocre score. This is likely due to the fact that health information is complex and rapidly changing. Nothing short of a thorough editorial and peer-review process is likely to generate both reliable and thorough up-to-date information. This study is therefore reason for all providers of health information on the net to raise their game. There is definitely room for improvement.

The study also found that having the HON seal of approval did significantly correlate with higher quality and integrity scores. So the code does mean something, even if it is still not a guarantee of science-based content.

Conclusion

Further study of health information on the Net is warranted as the results of this one study argue for caution. For providers it suggests we need to improve our filters and editorial process to improve the quality of our content. For consumers the results suggest that non-profit and academic health information websites are most reliable, while commercial and individual sites should be viewed with caution.

But further I would suggest to consumers of health information on the Net that no single website or article should ever be relied upon for information. The best way to get a thorough and accurate treatment of a health topic is to look at multiple websites. Try to determine what the consensus of opinion and information is, and be very wary of outliers. This is generally good advice for any research, not just health information.

*This blog post was originally published at Science-Based Medicine*


You may also like these posts

Read comments »


One Response to “How Reliable Is Health Information On The Web?”

  1. Insulin resistance treatment says:

    Your website give me very effective information. I want to say thanks to those peoples who contribute to this post. thanks.

Return to article »

Latest Interviews

IDEA Labs: Medical Students Take The Lead In Healthcare Innovation

It’s no secret that doctors are disappointed with the way that the U.S. healthcare system is evolving. Most feel helpless about improving their work conditions or solving technical problems in patient care. Fortunately one young medical student was undeterred by the mountain of disappointment carried by his senior clinician mentors…

Read more »

How To Be A Successful Patient: Young Doctors Offer Some Advice

I am proud to be a part of the American Resident Project an initiative that promotes the writing of medical students residents and new physicians as they explore ideas for transforming American health care delivery. I recently had the opportunity to interview three of the writing fellows about how to…

Read more »

See all interviews »

Latest Cartoon

See all cartoons »

Latest Book Reviews

Book Review: Is Empathy Learned By Faking It Till It’s Real?

I m often asked to do book reviews on my blog and I rarely agree to them. This is because it takes me a long time to read a book and then if I don t enjoy it I figure the author would rather me remain silent than publish my…

Read more »

The Spirit Of The Place: Samuel Shem’s New Book May Depress You

When I was in medical school I read Samuel Shem s House Of God as a right of passage. At the time I found it to be a cynical yet eerily accurate portrayal of the underbelly of academic medicine. I gained comfort from its gallows humor and it made me…

Read more »

Eat To Save Your Life: Another Half-True Diet Book

I am hesitant to review diet books because they are so often a tangled mess of fact and fiction. Teasing out their truth from falsehood is about as exhausting as delousing a long-haired elementary school student. However after being approached by the authors’ PR agency with the promise of a…

Read more »

See all book reviews »