A purportedly serious publication in a serious forum that was published this week has given rise to a bunch of breathless CAM-related headlines in my news feed. CAM being Complementary and Alternative Therapies.
I presume that this is what the authors and their employer wanted, as the supposed good news story is in fact one of the most blatant examples of quackacademic confabulation I have seen in ages. By this I mean that all is not what it appears with this review.
Firstly, the article in question was not prepared as an original research article. This is important, as some of the headlines seem to claim this is “new evidence”.
Look at the table of contents in the journal. It is part of a “CME Credit” symposium. This is an exercise where the editor invites summary articles on behalf of the journal from experts in a field to create what is supposed to be an uncontroversial and impartial review of the state of consensus opinion based on the literature in any given field.
Busy doctors read the review and complete some questions, then claim the learning time for their professional development. I am responsible for a lot of this sort of thing in my professional life, so I know that they are not always peer reviewed and can sometimes go off the rails if the expert panel is not carefully chosen. They are most definitely not considered a means of introducing new findings.
The article is apparently the first in a “Pain Medicine Symposium” to be offered over several editions of the journal. I would have expected to see a few names I recognised from the American Academy of Pain Medicine or the International Association for the Study of Pain, or maybe even the American Pain Society among the authors. But did I?
Nope.
They all came from the National Centre for Complementary and Integrative Health (NCCIH). The lead author is an epidemiologist, and the co-authors include a naturopath with publications about echinacea and colds, a chiropractor (who at least has published about yoga and pain), a cardiologist who works in the regulatory affairs part of NCCIH and a statistician. Not exactly representative of mainstream opinion within the specialty of pain medicine I would submit.
Not to worry, I thought. There might be something to learn so let’s dive in. They start out reasonably enough sketching out some basic facts about the huge societal impact of persistent pain in the United States, which is similar to most countries. They nominate a few selected treatments: acupuncture, spinal manipulation, massage, meditation, “natural product supplements” and yoga, Tai Chi and qigong which all get lumped together, though they are in fact wildly different in practice and contradictory in theoretical concept.
After then setting out a few plausible-sounding excuses for what follows, which constitute the barest academic fig leaf to cover their sectarian belief systems, they also go on to specifically exclude cancer pain from their review. Why? I can guess. Even sincerely deluded cranks have some vestiges of conscience and wouldn’t stoop to taking advantage of cancer patients. (Or would they?)
Having cherry-picked the topics and modalities that have thrown up the most randomly positive studies over the years, they then set out a steady stream of mostly negative studies which they somehow conclude support their argument that there is some useful clinical evidence for some of the therapies.
The Science Based Medicine blog has set out an excellent critique of the methods and results of the review. But the authors would not have gotten this paper published even in an invited slot without the mandatory disclaimers about the shortcomings of the studies. These are worth looking at in detail. First:
The trial samples tend to be white, female, and older, with very few, if any, minority group participants; as such, the generalizability of the findings to the breadth of patients seen by primary care physicians in the United States is still unresolved.
Ummm, I can resolve it. They aren’t at all generalizable, since the world does not consist entirely of elderly white female people. Next caveat:
Often, the trials reviewed were small, with fewer than 100 total participants. Small trials are prone to more variability and to false-negative results.