And while we're on the subject of clinical trials, and the headaches associated with them, this is a neat little article over at Slate on the subject. Darshak Sanghavi from UMass does a good job of explaining the surrogate-endpoints problem in clinical results, relating it to reality TV:
. . .In the federal Multimodal Treatment Study, hundreds of kids with ADHD, whose families were desperate enough to enroll them in a randomized study, entered a well-funded and highly supervised National Institute for Mental Health program complete with specialized therapy, regular evaluation by developmental experts, and careful drug prescription—a setup that's about as realistic as a date on The Bachelor. Within that very unusual, closely monitored environment, as reported in 1999, stimulant medications caused modest improvement after about a year. In response, use of these products surged nationwide, and Ritalin and its peers became household brands. But in March, the researchers described what happened after the lights went out. In their subsequent years in the real world, the drug-treated kids ultimately ended up no better off than the others.
Epidemiologists call this the problem of "surrogate endpoints," and it's no surprise to fans of reality television. Garnering the greatest number of text-messaging votes after a brief performance doesn't always mean you'll be a successful pop star; winning the final rose after an on-air courtship doesn't mean you'll have a happy marriage; and getting higher scores on a simple rating scale of attention-deficit symptoms doesn't mean you'll later succeed in school. In medicine, this problem happens all the time.
He doesn't shy away from some of the big surrogates in the clinical world, the biggest of which are cholesterol levels. That one, as he says, is at least considered a validated marker (with some relation to real-world mortality and morbidity), but there's plenty of room to argue about that, too. Ask Gary Taubes
, who has a lot of provocative things to say about the whole low-fat idea. And if that one is still worth arguing over, what about the less validated endpoints?
In the end, I agree with Sanghavi that we really don't have any good alternatives yet. The real endpoints, in most cases, just take too long to measure. No one can finance a twenty-year clinical trial, and no one would put up with one even if it were feasible. We're stuck with what we have, and we just have to make it work the best we can.
1. Hap on May 14, 2009 8:49 AM writes...
I think there's a dropped italic tag in the above quote.
Permalink to Comment2. barry on May 14, 2009 11:45 AM writes...
In the cancer field, various surrogate endpoints (e.g.stopping tumor growth) have been used and have often not correlated with reduced mortality.
Permalink to CommentAlas, a clinical study run to delta mortality has its own problems. There is a bias towards patients whose life expectancy is short (to contain the costs of the study in both time and dollars). Because cancers accumulate mutations over time, a drug tried in this population may fail although it might be efficacious--even life-saving--in patients with less advanced cancers
3. Still Scared of Dinosuars on May 15, 2009 4:21 PM writes...
One important thing about cholesterol and other surrogates I consider "real" surrogate endpoints is that they are often used as treatment goals in the real world.
This doesn't mean they are therefore good endpoints, however. It just means that when arguing whether a potential surrogate endpoint is suitable as a primary for approval I just ask, "Can we convince MD's to treat patients this way?" on the assupmtion that the results are strong enough. If the answer isn't an emphatic "Yes!" then I argue it's not a surrogate, it's just an endpoint...and there's no reason to bring it up as one to the ultimate arbiters, the regulators.
Permalink to Comment