Corante

About this Author
Derek Lowe
Derek Lowe, an Arkansan by birth, got his BA from Hendrix College and his PhD in organic chemistry from Duke before spending time in Germany on a Humboldt Fellowship on his post-doc. He's worked for several major pharmaceutical companies since 1989 on drug discovery projects against schizophrenia, Alzheimer's, diabetes, osteoporosis and other diseases. To contact Derek email him directly: derekb.lowe@gmail.com Twitter: Dereklowe

Chemistry and Drug Data: Drugbank
Emolecules
ChemSpider
Chempedia Lab
Synthetic Pages
Organic Chemistry Portal
PubChem
Not Voodoo
DailyMed
Druglib
Clinicaltrials.gov

Chemistry and Pharma Blogs:
Org Prep Daily
The Haystack
MedChem Buzz
Kilomentor
On Pharma
A New Merck, Reviewed
Liberal Arts Chemistry
One in Ten Thousand
Electron Pusher
Periodic Tabloid
All Things Metathesis
C&E News Blog
Propter Doc
Chemiotics II
The Chemical Notebook
Chemical Space
Noel O'Blog
In Vivo Blog
Terra Sigilatta
Chirality
BBSRC/Douglas Kell
ChemBark
Drug Discovery Opinion
Realizations in Biostatistics
Chemjobber
Pharmalot
WSJ Health Blog
ChemSpider Blog
Pharmagossip
Med-Chemist
Organic Chem - Education & Industry
Useful Chemistry
Chiral Jones
Pharma Strategy Blog
No Name No Slogan
Practical Fragments
SimBioSys
The Curious Wavefunction
Natural Product Man
Totally Synthetic
Fragment Literature
The F- Blog
Chemistry World Blog
Synthetic Nature
Chemistry Blog
Synthesizing Ideas
Carbon-Based Curiosities
Experimental Error
Business|Bytes|Genes|Molecules
Eye on FDA
Sigma-Aldrich ChemBlogs
Chemical Forums
Depth-First
Symyx Blog
P212121
ChemCafe
Sceptical Chymist
Lamentations on Chemistry
Computational Organic Chemistry
Mining Drugs
Henry Rzepa


Science Blogs and News:
Bad Science
The Loom
Uncertain Principles
Fierce Biotech
Blogs for Industry
Omics! Omics!
Young Female Scientist
Notional Slurry
Nobel Intent
SciTech Daily
Science Blog
FuturePundit
Aetiology
Gene Expression (I)
Gene Expression (II)
Sciencebase
Pharyngula
Adventures in Ethics and Science
Transterrestrial Musings
Slashdot Science
A Scientist's Life
Speculist
Cosmic Variance
The Capsule
Zeroth Order Approximation
Biology News Net


Medical Blogs
Med Tech Sentinel
DB's Medical Rants
Science-Based Medicine
GruntDoc
The Health Care Blog
Respectful Insolence
Black Triangle
Diabetes Mine


Economics and Business
Marginal Revolution
Arnold Kling
The Volokh Conspiracy
Knowledge Problem
The Stalwart


Politics / Current Events
Virginia Postrel
Tinkerty Tonk
Instapundit
Megan McArdle
Mickey Kaus
Colby Cosh
Alien Corn
No Watermelons


Belles Lettres
Two Blowhards
Critical Mass
Arts and Letters Daily
God of the Machine
Armavirumque
About Last Night
In the Pipeline: Don't miss Derek Lowe's excellent commentary on drug discovery and the pharma industry in general at In the Pipeline

In the Pipeline

« Things I Won't Work With: Frisky Perchlorates | Main | That Fount of Information We Call ASCO »

May 31, 2006

As Merck Caroms Off Another Tree

Email This Entry

Posted by Derek

You have to figure that Merck is getting tired of restating and re-explaining its Vioxx numbers. I certainly am. The only people who aren't fed up with it, I'm sure, are the hordes of lawyers for the plaintiffs. They're munching popcorn and waving pom-poms as Merck staggers around in circles.

The latest episode is a statistical mixup of the APPROVe trial, which I last wrote about here. In the NEJM publication of the results and in Merck's submission of the data to the FDA, they mention using log(time) as a variable in their primary statistical method. But they report statistical tests in the paper which used a model with plain old linear time as a variable. Merck says that "The results of diagnostic steps specified in that data analysis plan indicate that the linear test is an appropriate method to assess changes in the relative risk over time", although they'd surely rather not have to backtrack and make that argument.

This issue affects the measurement of the change in relative risk over time, not the magnitude of the risk itself. Merck's taking pains to point out that the overall magnitude of those relative risks were described correctly. That's fine, I guess, as far as it goes. The problem is, Merck has already been making a big deal out of that change in risk with time, namely that patients weren't at risk unless they'd been taking Vioxx for at least 18 months. So this is, unfortunately for them, a relevant issue.

What's the difference come to? For the difference between risk levels before and after the 18-month threshold, Merck reported a p-value of 0.01 using linear time, but if you run the method the way it's actually outlined in the paper (log time), you get p = 0.07, which is certainly worse. In fact, in my experience, you start losing your audience at p values of 0.03 or 0.05, and that's what seems to be happening. When Merck says that this error does not affect the conclusions of the study, they're only partly correct. What it affects are the believability of the conclusions, and once again, the revision makes things look worse for them.

Honestly, guys. What's with you these days?

Comments (3) + TrackBacks (0) | Category: Cardiovascular Disease


COMMENTS

1. MTK on June 1, 2006 9:46 AM writes...

Hhhmmm. Interesting. Using Merck's own "not statistically significant" defense, this means that the increased risk is the same whether you used it for 18 months or not, correct? (Someone help here) If so, that throws a spanner into the works doesn't it. They can't rightly use the not statistically significant argument when it helps them, then toss it away when it doesn't. Juries will see throw that charade.

Permalink to Comment

2. LNT on June 1, 2006 9:57 AM writes...

Wow -- it just seems to be getting worse and worse for Merck.

What do you think the ultimate outcome of all this will be? If the floodgates open for short-term users of Vioxx, do you think that the company will be able to survive? Once the damages start hitting the tens of billions of dollars, that's a serious chunk out of the market cap of the company (currently sitting at $73 billion).
I'm just glad not to be a scientist at Merck right now. But I have a (bad) feeling that this situation will impact the whole pharmaceutical sector, not just Merck.

Permalink to Comment

3. JSinger on June 2, 2006 4:25 PM writes...

But they report statistical tests in the paper which used a model with plain old linear time as a variable.

I'd say that's suspicious right there -- when have you ever heard of a statistician passing up the chance to log-transform something?

Permalink to Comment

POST A COMMENT




Remember Me?



EMAIL THIS ENTRY TO A FRIEND

Email this entry to:

Your email address:

Message (optional):




RELATED ENTRIES
Academia and Industry, Suing Each Other
Let's Start Off the Meeting With An Ad, OK?
The Academic-Industrial Collaboration in Drug Discovery Panel: Today
Glass Structure, Atom by Atom
How the Andrulis Paper Got Published
AstraZeneca in Waltham
Fluorine NMR: Why Not?
AstraZeneca Layoffs and Closings