Thanks for the feedback. I actually have a question for you guys:
I am thinking of changing the website to instead of asking to write a post, to basically asking to answer simple questions with "yes" or "no" answers, rating your advisor from 1 to 10 in some qualities and maybe even choosing some adjectives that describe you advisor from checkboxes. Do you think you would be more inclined to rate your advisor?
Thanks a lot for all the feedback
Rating scales might be better, especially if they focused on working/advising styles rather than whether you like the person or not. Then you could assess fit for yourself.
But you still run into a serious issue of anonymity. Most faculty in my grad department only had a few students each, so the timing of your ratings would make it fairly easy to identify a few suspects. However, if the students were rating mostly on objective dimensions and not free to personally attack the profs and describe bad interactions, it would be less obvious who was writing it.
A more neutral but potentially quite informative approach would be to collect data about: numbers of advisees, number of graduate degrees completed (and which degrees), time to degree for those people, and placements.
I mention time to degree because there was someone in my old master's department who was absolutely notorious as an advisor because very often his incredibly well-prepared grad students just never
quite seemed to be able to finish. He always had just a few more books they
really needed to take a quick look at before they took comps/finished and defended the prospectus/finished and defended the thesis or dissertation. He is a fabulous and well-respected scholar and an outstanding human being, but the independence and drive required to actually finish a degree under him is considerable.
Stuff like this is important to know, but without the appearance of nastiness or dismissal of scholarly capabilities and overall mentoring abilities.