Gary Olson's article, "How Not to Evaluate Your Department Head" (
http://chronicle.com/jobs/news/2008/07/2008071801c.htm) requests factual, detailed descriptions of a chair's weaknesses in annual reviews in order to be "heard" by the dean. I understand Olson's point and applaud his intent.
However, our chair reviews are shared word for word with the chair. Someone who is especially problematic (the kind of person likely to draw the vitriol that Olson describes, at least from more than one faculty member) may also, likely, be untrustworthy. In my last chair review, I felt that I had to be much more general than I would have liked in order to remain anonymous; I don't trust my chair not to penalize me for negative review comments. Details would have revealed clearly who the review author was.
I have shared my views in a cordial, respectful way with this chair and with an associate dean, and on one occasion with the dean, and nothing seems to have changed as a result. I know from conversation that several other faculty members have independently reached the same conclusions I have, so I'm not alone. This chair is the only person on our campus for whom I have highly negative reviews - so it's not that I'm a generic troublemaker.
I would welcome Gary Olson's (or other forumites') suggestions for writing helpful negative reviews under these circumstances.