19 abr 2009

Suppose there was a concern whose employees had to produce two kinds of products: widgets and squidgets. Each employee was supposed to devote about 2/5 of effort to widgets, and 2/5 of effort to squidgets, and 1/5 of effort to miscellaneous administrative tasks.

Everyone pretty much made an equal number of widgets according to a regularly scheduled plan. Some were better widgeters than others, that is true, but nobody didn't do widgets. With the squidgets, however, there was a very wide distribution in results. Some produced almost none at all; some produced them in huge quantities, sometimes several magnitudes greater than the average.

Since excellent squidgeters were also doing their share of widgeting, they would tend to work a little longer and harder. They might also have to spend their own personal money for squidget supplies and for traveling, since squidgeting often involved work outside the office. Sometimes you had to spend extra time just applying for special squidget funds, given out competitively--even though everyone, theoretically, was supposed to be squidgetting 40% of the time.

So here's the question. What would a fair weighting of widgets and squidgets look like? What would it mean to treat them equally in an evaluation process? How do we compare widgets, judged mostly on a qualtitative scale, with squidgets, where distinctions are more likely to show up as much larger differences of quantity? Is it really possible to treat them equally?

If they were really treated equally, then that would entail a huge bias in favor of squidgets. People who only produce widgets, with little or no squidgets, would be seen as only doing 60% of their jobs. Those with both squidgets and widgets would always come out ahead, even if their widgets were a little less excellent.

On the other hand, this approach would quickly lead to a complaint about "too much emphasis on squidgets." To place more weight on widgets, by the same token, would involve overvaluing small differences on a qualitative scale, in contrast to the much larger absolute differences on the squidgeting scale. One worker might have four or five squidgets in a year that someone else had zero or one.

Of course, we could have philosophical discussions about whether widgets or squidgets are really more valuable. Remember, though, that the institution already has assigned them a value of 40% each, in this particular thought-experiment. We could say that that widgets are really more important. After all--they have to get done before we even think about squidgets. But technically each worker is responsible for devoting 40% of effort to squidgets too.

7 comentarios:

Phaedrus dijo...

Jonathan, we need you to write an "Animal Farm" about academia.

Judy Roitman dijo...

Thought experiment my left foot. Glad you're producing all these high quality sqidgets. Mine at times seem to turn into squdgets.

Thomas dijo...

There is an important difference between this allegory and animal farm. There was nothing disturbing about "the very idea" that society could be described as a farm and people could be recast as farm animals. That was simply a literary device, not itself a point in the story. There is something immediately disconcerting, however, about the notion that academia is "like" factory production, only different.

I hope that's your point, Jonathan. Many academics think there are two tasks: teaching and writing. Two products: graduates and publications. And there is a very practical sense in which that is true. But the factory-production metaphor can be taken too far, (as you have here).

There is another version of this problem actually: academics are supposed to produce and distribute knowledge. Writing produces knowledge (i.e., makes your peers smarter) and teaching (including popularizing) distributes it to society. I'm sure this model can be rendered as absurd as the previous one.

I feel a blog post of my own coming on.

Jonathan dijo...

I don't think that analogy is all that disturbing (or meant to be)! The point was to show that the way we judge these two things leads to inherent problems. Even if squidgets were only 20%, someone doing no squidgets at all would have to be judged lower than someone who was excellent in this dimension--assuming the difference in widgets was relatively marginal.

mongibeddu dijo...

Classic!

But I think there's a typo here:

How do we compare widgets, judged mostly on a quantitative scale, with squidgets, where distinctions are more likely to show up as much larger differences of quantity?One of those quantities should be a quality, right? And it's "qualitative scale" for widgets below.

Although, when you look closely at the widgets and squidgets...eh, why am I bothering? That's an administrative task, and I'm not getting any widget-relief, so to hell with it.

Jonathan dijo...

Fixed. Thanks for the keen eye.

Judy Roitman dijo...

Well there is this Differential Allocation of Effort thing if somebody is only doing, say, widgets, or very little besides the dreaded Miscellaneous Administrative Tasks (MAT). There are all kinds of ways to cook the books, also all kinds of ways to adapt to people's situations...