Thursday, December 16, 2010
From Inside Higher Ed:
In a phrase: look for outliers. It’s really about spotting the folks who are badly trailing the rest of the pack. Putting much weight on the difference between the lower middle and the upper middle is missing the point. There’s considerable normal variation, and all kinds of irrelevancies can push one instructor slightly above or below another. But when the same few names show up at the bottom of the list semester after semester, it’s difficult to write that off to random variations.
That’s where comments are useful. Some comments suggest ideological or cultural antipathy at work; those discredit themselves. (About once a year I get a student complaining that his professor is gay, and wanting to know what I’m going to do about it. “What would you suggest?” usually ends the discussion.) But some comments are actually revealing. I tend to discount references to “arrogance” or “full of himself,” but I take seriously comments like “he takes two months to grade papers” or “he’s incredibly disorganized.” When clusters of students make the same basic comment, there’s usually at least a conversation to be had.
Some professors like to say that student evaluations shouldn’t exist, or at least shouldn’t count for anything. I have to disagree. When a dean does a class observation, she observes one class meeting. Things like “speed of grading” simply won’t show on the radar, and of course, anyone can have an uncharacteristically good or bad day. But students see every day, so things that might seem inconsequential (or be entirely invisible) in a single moment take on their full significance.
You can read the rest here.