About this Author
DBL%20Hendrix%20small.png College chemistry, 1983

Derek Lowe The 2002 Model

Dbl%20new%20portrait%20B%26W.png After 10 years of blogging. . .

Derek Lowe, an Arkansan by birth, got his BA from Hendrix College and his PhD in organic chemistry from Duke before spending time in Germany on a Humboldt Fellowship on his post-doc. He's worked for several major pharmaceutical companies since 1989 on drug discovery projects against schizophrenia, Alzheimer's, diabetes, osteoporosis and other diseases. To contact Derek email him directly: Twitter: Dereklowe

Chemistry and Drug Data: Drugbank
Chempedia Lab
Synthetic Pages
Organic Chemistry Portal
Not Voodoo

Chemistry and Pharma Blogs:
Org Prep Daily
The Haystack
A New Merck, Reviewed
Liberal Arts Chemistry
Electron Pusher
All Things Metathesis
C&E News Blogs
Chemiotics II
Chemical Space
Noel O'Blog
In Vivo Blog
Terra Sigilatta
BBSRC/Douglas Kell
Realizations in Biostatistics
ChemSpider Blog
Organic Chem - Education & Industry
Pharma Strategy Blog
No Name No Slogan
Practical Fragments
The Curious Wavefunction
Natural Product Man
Fragment Literature
Chemistry World Blog
Synthetic Nature
Chemistry Blog
Synthesizing Ideas
Eye on FDA
Chemical Forums
Symyx Blog
Sceptical Chymist
Lamentations on Chemistry
Computational Organic Chemistry
Mining Drugs
Henry Rzepa

Science Blogs and News:
Bad Science
The Loom
Uncertain Principles
Fierce Biotech
Blogs for Industry
Omics! Omics!
Young Female Scientist
Notional Slurry
Nobel Intent
SciTech Daily
Science Blog
Gene Expression (I)
Gene Expression (II)
Adventures in Ethics and Science
Transterrestrial Musings
Slashdot Science
Cosmic Variance
Biology News Net

Medical Blogs
DB's Medical Rants
Science-Based Medicine
Respectful Insolence
Diabetes Mine

Economics and Business
Marginal Revolution
The Volokh Conspiracy
Knowledge Problem

Politics / Current Events
Virginia Postrel
Belmont Club
Mickey Kaus

Belles Lettres
Uncouth Reflections
Arts and Letters Daily
In the Pipeline: Don't miss Derek Lowe's excellent commentary on drug discovery and the pharma industry in general at In the Pipeline

In the Pipeline

« Measure for Mismeasure | Main | Kicking the Dinosaur's Tail - Again »

September 28, 2004

Rank and Yank?

Email This Entry

Posted by Derek

I don't usually miss my Monday posts, but time has been short recently. My car, the Rapacious Pharmamobile, has finally given up its last, and I need to replace it quickly so I can drive to work and help rake up the excess profits. In case you're wondering, the R. Pharmamobile was a 1989 Honda with 180,000 miles on it, which should give you some idea of the riches we enjoy.

To follow up on the last post, here are some other thoughts on performance rankings of scientists, also adapted from my old Lagniappe site. (I'll dust some of these off from time to time to get them into the categorized archives here.)

". . .there's another problem with employee rankings, one that doesn't just apply to research organizations. I first came across a statement of it while reading Bill James, who showed how it applies to baseball teams when they decide whether to bring in some veteran player to hold down a position or go with someone from triple-A. It's an over-reliance on normal distribution. (Here's a discussion of the idea.)

People have this mental picture of the classic bell curve - bulging middle, sloping down to the sides as it tails off to the few stars on the right, the few destructive losers on the left. In a departmental performance evaluation, you end up with most people getting "Meets Expectations" or the equivalent, some that rank higher, a few that rank lower. In my experience (two large drug companies,) most of the raw evaluations come back as "Meets" or higher, and it's rare that folks get initially ranked on the low end. That gets changed as the whole department comes into focus, though, because there's often this feeling that you have to rank some people low, in the same way that there have to be some star performers.

But here's the key: the performance ranking in any organization that is free to hire and fire its own employees will not fit a normal distribution. Why should it? A normal distribution is what you'd expect from a random sample, and I'll assume that most businesses don't hire or retain their employees at random. No, what you have is most likely the far right-hand side of a much larger distribution, the performance ratings of all the people you could have possibly hired for those positions.

One big factor that keeps things from being normally distributed is the entry barrier into a technical field. For the most part, you can't be stupefyingly incompetent and get a degree from a reasonably good research group at a reasonably good school, or be a total bozo and get in the door for a job interview with a decent resume and give a competent-sounding seminar. The total washouts are mostly gone by the time you place an ad in C&E News. Any of them that do send you resumes have a tougher time getting hired, and any of them that you actually hire have a tougher time being retained.

Another factor that bends the distribution is that people are actively trying to improve their rankings from year to year (well, at least some of them are.) No one's striving to slide down the list, that's for sure. The data points of a random sample aren't being told where they landed last time and given incentives to shift to the right.

So I'd say that a realistic batch of performance rankings has a majority at a "Meets Expectations" level, and the remainder stretching out toward the higher rankings. There really shouldn't be many "Below Expectations" people at all, because the whole point of a ranking like that is that they either shape up, or you ship them out.

This also points out the folly of the Jack Welch "rank 'em and yank 'em" style of performance review. You know, find your bottom 10% and fire them all. Other companies that have tried this technique (Ford, to pick a notable example) have found that it mostly sows fear and discord. And I'm sure it did at GE, too, truth be told (although some CEOs swear by it.)

The "bottom 10%" is basically identical to the 60 or 70% of your employees that are doing just fine, minus a few people having a bad review period (a different set each time,) and minus a few genuine losers. If you seriously try to fire this illusory bottom tier, you end up having to make arbitrary, meaningless distinctions on five-page HR forms in order to distinguish them. Find the real losers and heave them out, absolutely. But don't draw a ridiculous line in the sand and then jerk people around because of it. A really good manager should be able to fire someone without hiding behind a bad policy.

Comments (1) + TrackBacks (0) | Category: Business and Markets


1. SteveSC on September 29, 2004 1:42 PM writes...

I agree with the concept of non-random selection of employees creating a bulge in the 'meets expectations' zone (essentially a left skewed distribution with a mean to the right of the average mean). A similar concept was just posted on Newmark's Door. But I am not sure we should throw out the rankings just yet.

Let's take a small company of 100 people operating in a very small 'economy' of 20,000 people where exactly 5% (1,000 people) are qualified to work for the company. The company thus employs 10% of the available qualified people. If the company's skill distribution mirrors the population, about 70 people will be 'meets expectations', perhaps 20 will be 'exceeds expectations', and 10 will be stars.

But of the 900 qualified people NOT employed by the company, there are 180 who 'exceed expectations' and 90 who are stars. Wouldn't a company that tries to replace some of the 70 'meets expectations' with more skilled people be in a better position than the company that doesn't (and is at risk for losing its stars also)? And assuming these skills are not innate, wouldn't the pursuit of better skills motivate current employees to perform better?

Of course this depends on HR actually being able to measure critical skills, employees understand what exactly is being measured and have some control over their performance, efforts at employee development precede firing, etc. How it is operationalized is key.

Theoretically, theory conquers practice. In practice, it doesn't.

Permalink to Comment


Email this entry to:

Your email address:

Message (optional):

The Last Post
The GSK Layoffs Continue, By Proxy
The Move is Nigh
Another Alzheimer's IPO
Cutbacks at C&E News
Sanofi Pays to Get Back Into Oncology
An Irresponsible Statement About Curing Cancer
Oliver Sacks on Turning Back to Chemistry