Skip to main content

If You Want to Practice Evidence Based Medicine then… Use the Evidence

Travelling on a train to Scotland, all for the first time:


Clinical researcher says: "Look the cows in Scotland are black!".
Physicist replies: "No. Some of the cows in Scotland are black"
Mathematician says:  "No, actually in Scotland there is at least one cow black on one side"

I’ve written about folic acid, homocysteine and various clinical trials of nutrients in the past. I just want to revisit it briefly because I think there are some seriously wrong messages emerging from the conclusions. For an excellent comment on evidence based recommendations see Colby Vorland.

Homocysteine (Hcy) is associated with CVD, may or may not be causal but the evidence is good (Wald et al, BMJ, 2002). Folic acid (Vitamin B9) in reasonable amounts will lower homocysteine  but clinical trials have been carried out, mostly showing not much benefit as far a CVD is concerned. A recent meta-analysis of 8 trials (total 37,485 individuals) seems to confirm this: “Dietary supplementation with folic acid to lower homocysteine levels had no significant effects within 5 years on cardiovascular events”.

BUT… all the studies were in ill people (mean age 65yrs), 7/8 with heart disease or stroke and 1 study on patients with kidney disease:
Capture

So a fair conclusion is that people who have already had a heart attack, stroke or some other sort of vascular disease may not benefit from homocysteine lowering – e.g. there was no reduction in second heart attacks, at least over the short term (mean 5 yrs).
Pity, but not so unexpected, after all vitamins are not medicines to be used when one becomes ill at 65 years old – vitamins are for life.
There are also several possibilities why Hcy lowering had apparently no effect on the patients, and also Wald et al point out that aspirin use may mask the effect of homocysteine lowering – it was interesting to see that they felt the need to underline what should be obvious:
“The fact that most of the trials included patients with pre-existing cardiovascular disease leaves open the possibility that folic acid has a useful role in the primary prevention of ischaemic heart disease, where aspirin is generally not used, but not in secondary prevention, where it is routine.”

So what do Clarke et al conclude? It’s starts off OK:
“The present meta-analysis has demonstrated that lowering homocysteine levels by an average of 25% (about 3 µmol/L) for an average of 5 years has no significant effect on the incidence of major vascular events during the scheduled treatment period.”
(They just missed out the aged ill patients bit)

They go on to discuss how observational and epidemiological studies associate homocysteine with cardiovascular disease and stroke (but do not point out that these studies were in the general population, not a diseased subset) and finally:
“One-third of adults in the United States and one-quarter of those in the United Kingdom report taking daily multivitamin supplements containing folic acid. The present meta-analysis, however, found no evidence that routine use of folic acid for 5 years has any material effect on cardiovascular or non cardiovascular events in the North American and European populations studied.”

These are two sentences from different contexts entirely – the results of the meta-analysis apply only to the study group and have NO bearing on the folic acid and homocysteine as far as primary prevention is concerned. The reviewers really should not have let that pass.

There is also a commentary on this article in the same issue which goes even further in the wrong direction. It begins discussing the role of vitamins in health and prevention then discusses the impact of the meta-analysis:
  • Clarke and colleagues definitively answers most of the questions about the efficacy of B-vitamin therapy.
  • There were no trends toward benefit  in any of the primary outcomes overall or in the prespecified subgroups
  • This is a cautionary tale for all who are searching for therapies to prevent disease in the general population.
But as the commentary says there is a “strong scientific rationale” for Hcy lowering and “consistent observational data from high quality cohort studies with more than 10 years of prospective follow-up confirmed the outcomes suggested by hypotheses arising from laboratory and animal data.”
This all remains true and has not been touched by any of the clinical trials but the author goes on:
“However, randomized trials of vitamin therapy with folate, vitamin B6, vitamin B12…demonstrated that none of these therapies are effective for preventing cardiovascular disease…in the general population.”
This is simply not true, the trials did not study the general population and have NO relevance at all for primary prevention. There’s more:
 
“As trusted counselors with an ethical mandate to first do no harm, we physicians should keep this history in mind as we advise our patients about the risks and benefits of dietary supplements… Vitamins taken in excess of the dose required to prevent deficiency states have not improved  not improved our patients’ health and may harm them. We should recommend therapies to prevent disease in healthy patients only when randomized trials unequivocally demonstrate that net benefits outweigh net harms, and we should continue to emphasize the importance of a nutritious diet, regular physical activity, and no smoking as the best ways to optimize health.”

Couple of things: a) to not recommend is also a recommendation and b) how does the author know about the benefits of physical activity & nutritious diet and possible harms of smoking? All the evidence is from epidemiology and observation – they have not been confirmed by randomized trials!
Maybe the cows in Scotland are black.

Clarke R, Halsey J, Lewington S, Lonn E, Armitage J, Manson JE, Bønaa KH, Spence JD, Nygård O, Jamison R, Gaziano JM, Guarino P, Bennett D, Mir F, Peto R, Collins R, & B-Vitamin Treatment Trialists' Collaboration (2010). Effects of lowering homocysteine levels with B vitamins on cardiovascular disease, cancer, and cause-specific mortality: Meta-analysis of 8 randomized trials involving 37 485 individuals. Archives of internal medicine, 170 (18), 1622-31 PMID: 20937919

Comments

Popular posts from this blog

Genetic testing and potential harm: DTC or trust me I’m a doctor?

Recently at a couple of conferences ( European Human Genetics conference and Consumer Genetics Conf ) there have been various speakers questioning DTC genetics and calling for all health related personal genetics to be delivered through medical practitioners. I argued in the past that unregulated tests delivered through practitioners actually have the potential for more harm, not less. By coincidence last week some discrepancies in a DTC and a via MD test were pointed out to me – and they seem topical. Breast feeding has many benefits one of which appears to be increased IQ scores – however not all studies agree, some indicating that results may be confounded by maternal intelligence (see Wikipedia ). Sometimes inconsistencies in associating an action with an outcome can be resolved by looking at genetic variation (which tends to increase the error bars when not accounted for). So in 2007 some headlines were made when a study was published by Caspi’s group ( PNAS, open access )

FDA – Personal Genetics: Is it safe? It’s a marathon, man…

It’s nearly 10 years now and still there is no clarity about the position of personal genetics in the regulatory framework. Maybe that’s going to change soon with the FDA activity and the recently published HGC Principles . It would be good to get it settled one way or another, the uncertainly doesn’t help anyone except those who exploit it to exploit the gullible. Some elements: DTC vs. DTMD (via physician) – I will argue that DTMD is actually higher risk and needs closer scrutiny Is it medicine? I think this question is a waste of time, it will not be resolved, the definition is too broad, medicine is practised everywhere by everyone - if I take my son’s temperature, put a plaster on a cut or administer medication I am practising medicine. What is the FDA duty bound to do and what will they decide? No regulation – more or less the current situation Tight regulation – medium/high risk requiring pre market approval (PMA) Somewhere in between

Personal Genetics has a Family History of getting beaten up

Over the last few days personal genetics has come in for a bit of a bashing, first it was knocked out by family history then it was clearly nailed into the coffin by traditional risk factors . Also have a look at Genesherpa’s blog for some more putting the boot in here and here . Update: Nov 12th, here is the 23andMe blog on the subject But what is behind the hype and the headlines? In this post I will look at family history and deal with EGAPP in the next. The latest attack was sparked by a press release of some work presented at the ASHG. We don’t know too much because all we have is an abstract and a video but we have enough. FH was compared to the Navigenics genetic profile (PGS). From the abstract “None of the 3 hereditary prostate cancer subjects were assessed as high risk on PGS. Based on FHRA, 10 subjects had hereditary breast cancer risk and PGS only identified 1 as high risk (K=0.12). None of the 9 hereditary colon cancer subjects were high risk on PGS.”