As the semester comes to an end at campuses across the country, students are taking advantage of their opportunity to critique the instructors who will, in the coming days, be issuing their final course grades. In a perfect world — in fact, in the world in which many of us once lived — the instructor evaluation would serve as an important tool for seeking student feedback on, for example, the organization of the syllabus, the amount of time devoted to one topic versus another, the effectiveness of new pedagogical techniques, the use of instructional technology, or even the readability of a new textbook or laboratory manual. Many years ago when I was a faculty member, I actually used to look forward to reading my students’ comments, which were generally thoughtful, informative, and helpful to me in designing my course for the next semester. Sure, there was an occasional nasty comment, but comments that ranked me somewhere near God could be ignored as easily as those that put me somewhere beneath the Devil.
Then came administrative efforts to demonstrate an improved institutional focus on teacher quality. As institutions came under fire for being too focused on faculty research rather than undergraduate instruction, as U.S. News rankings became the primary tool by which presidents are evaluated, as policy makers began to focus on student retention and graduation rates, and as colleges and universities pushed the price of an education to the level once reserved for home ownership, colleges and universities adopted the student-as-consumer model, and the instructor evaluation took on the role of customer satisfaction survey. In other words, it no longer mattered whether or not the instructor actually both forced and helped the student learn how to balance a chemical equation or speak a difficult foreign language. Instead, the focus switched to whether or not the student, as a consumer, “liked” the experience.
Students know how to act as consumers. Look through your own evaluations to see how many times the students comment about whether or not they liked you, your class, the text, and the assigned readings as opposed to whether or not they found you to be well organized, knowledgeable about the topic, able to engage the students in a meaningful dialogue, available to answer student questions outside of class, open to a variety of opinions, rigorous but fair in your grading practices, and encouraging of the student to question his or her own notions and assumptions about what is right or how things work. Even if you ask the question in such a way as to encourage the student to rate your skill and rigor, how many times does their bubble score or written comment reflect, instead, whether or not they liked you or whether or not your class was fun? For this generation of students who are accustomed to getting their news from comedians rather than serious journalists — and for whom educational theorists had transformed their K-12 experience into one of edutainment — they may not even know how to evaluate anything other than whether or not your class made them feel good, or made them laugh, or helped the time pass by quickly, or didn’t interrupt their social life too much (could they keep up with their texting and Facebook dialogues while sitting through your lectures?).
Even during my years in academe, which ended a decade ago, I saw professor behaviors starting to change in order to ensure the highest possible student-evaluation scores — which were increasingly becoming the focus of administrative decisions about things like teaching awards, promotions, office space, and in some places (though not research institutions) tenure decisions. I saw professors behave as though teaching were a popularity contest rather than a serious profession. The inclusion of Far Side cartoons in teaching materials reached an all time high — we need to entertain them — and the rigor of courses began to decline – they won’t “like” us if our exams are challenging.
I actually witnessed a colleague turn a biology laboratory into a cake decorating session because she thought it would be fun for students. Sure, they might learn how to draw a cartoon version of a mitochondria with pink frosting, but will that help them understand how the mitochondria functions or its role in providing energy to the cell? Is this really college-level work? The instructor said that it was college-level work for these students because they were, after all, education majors and because the students were more likely to learn if they were having fun. This colleague was once a high-school teacher who worshiped in the church of 1980’s K-12 educational theory (you know, the same theories that gave us new, new math and whole language, which robbed generations of students of computational ability and … well … literacy). But students were having fun and that was all that mattered.
The problem with the student-as-consumer model is that it presumes education to be a commodity or a service that can be purchased. In reality, though, paying tuition will do no more toward making one learned than buying a gym membership on January 1st will do toward making one thin. Yet somehow we empower students, through the instructor evaluation among other things, to believe that education is something that they buy and that the instructor manufactures or imparts upon them. Yes, teachers have a responsibility to teach — I never bought into that guide on the side crap — but do students understand that they have a responsibility to learn or that learning takes a lot of time and hard work?
For those administrators who really want a deeper understanding of instructor quality, there are other — better — ways of monitoring this information. First of all, pay attention to valid student complaints. If students year after year complain that a professor is always late to class, or misses important deadlines, or can’t speak English well enough to explain difficult concepts and algorithms, then respond to those complaints. Take the time to follow up with both graduates and dropouts of your institution for some period of time after they leave your campus (yes, survey response rates will be low, but institutions do have an obligation to follow-up with a statistically significant, random sample of former students to evaluate the quality of the education received once the students are at a point where they can more rationally reflect upon the experience. (The week before final exams is not one that encourages particularly rational reflection.)
When possible, ask the instructors who teach higher-level courses to evaluate how well prepared your former students are to take on more challenging work. I depended on the nursing faculty to help me evaluate my effectiveness in teaching anatomy and physiology, and I also walked across campus to ask my former students for feedback, once they were well into their nursing, physical therapy, physician assistant, or occupational therapy programs. I can’t tell you how many students told me that they had hated me for making them learn this or that while in my class, or that they hated my essay questions that forced them to explain what they knew rather than allowing them to select the best answer, but how grateful they are now that they are in a clinical setting and frequently put on the spot by patients and clinical professors who ask them to explain difficult concepts or justify their diagnosis or care plan.
My sense is that administrators spend a lot of time focusing on the difference between a professor who receives a 4.2 and one who receives a 4.5 – while there really is no difference, we all know that the people who score in this range can be easily manipulated to work harder since these are the people who really want to be good in the first place — while doing little to address the real problems associated with faculty who earn lower scores. This is especially the case if the low scorer is already tenured, if he or she is bringing in a lot of research dollars, or if he or she belongs to a group that is underrepresented among the faculty. For example, a female engineering professor may be treated differently by the administration than a female psychology professor.
It is time that we help our students understand what it means to be a scholar. They know what it means to be a consumer, but we need to teach them how to be a learner. We shouldn’t be shocked that they behave as consumers given that we lure them to our campuses with fancy marketing brochures that make vast promises about amenities and travel opportunities and focus little attention on learning opportunities. But at some point in the process, we need to teach them how to learn. One way to get started would be to structure instructor evaluations in a way that helps the student understand the role of the instructor, which is not to spoon-feed, to entertain, or to reduce rigor, but instead to lead, to motivate, to challenge, and to help the student question his or her own beliefs, assumptions, attitudes, and knowledge.
There are lots of unintended consequences of the student-as-consumer model that dominates higher education. Perhaps most tragic is the perception among graduates that as it was once their professor’s job to entertain, to provide clear and detailed instructions, to reduce expectations, to make every day fun, and to value what they think and feel over what they know and can do, it is now their boss’s job. Bosses, however, tend to expect employees to figure things out on their own, to be self-motivated, and to work hard whether or not the work is fun. While professors might benefit from high evaluations when they make class fun and easy, they are robbing students of an important opportunity to learn those very skills and attitudes that will make the difference between success and failure in a tight job market.


14 Responses to Teacher Evaluations
goxewu - December 18, 2009 at 12:58 pm
Would Ms. Auer Jones be open to the possibility that, as the power of student evaluations compels professors, to too great a degree, to skew their teaching to get “good” evaluations, so the power of “outcomes assessment” likewise skews professors’ teaching to get a “good” OA score?Further, if the model of students as “customizers” is debilitating to good teaching, what about the model of dept. chairman or college dean as OA overseer?
ex_ag - December 18, 2009 at 3:25 pm
Thank you for the blunt and honest appraisal of teacher evaluations. And thank you for discarding the student-as-consumer model.I have said, for a very long time, that if we are to adopt the consumer model, we should at least do so correctly.Who is the consumer for a university’s product? It’s not the student. It’s their future employer. They are the ones who will decide if your product (graduates) have value or not. If we HAVE to adopt this model, then let’s cater to that future employer and create a product (and, yes, in this analogy students are only the raw material we use to make our products) that they will want.Too many people think that, just because the student pays the tuition, they are the consumer. But that’s why the consumer model is flawed for the university. Universities are the only place where the raw material (rather than the consumer) actually pays the cost of manufacturing.
dajones - December 18, 2009 at 3:40 pm
Goxewu – I am as skeptical of outcomes assessments as I am of teacher evaluations.
goxewu - December 19, 2009 at 8:06 am
Nice, stand-the-problem-on-its-head point by ex_ag. The question follows, though: “What kind of ‘product’ does the consumer (those future employers) want from the university?” Obedient cogs in the corporate wheel? Ethics-less technocrats who’ll help maximize quick profits? And how often does the university have to re-tool its assembly line for its “product” in order to match the rapidly changing demands of that “consumer”? If professors don’t pander to student evaluations in their teaching, and they don’t “teach to the test” in OA, they can’t stomach teaching to turn their students into corporate cogs, and they can’t change teaching gears fast enough to keep abreast of the changing demands (“No more automotive engineers this decade, please, and a lot of bailout economists instead”) of the university’s “customer,” what’s supposed to guide their teaching? The ideal of producing well-informed, critical, literate citizens with a big-picture knowledge of their surrounding culture? Who in this world of the corporation as a university’s “customer” is going to want to pay for that?
chuckkle - December 20, 2009 at 1:57 pm
Evaluation can and should be thought of in a variety of ways. At one school where I taught, the form for the student senate’s “favorite teacher” award was adapted by the admin to university wide faculty and course standardized evaluation form when it was set up. For some time I was able to generate my own form which included questions such as “how many hours a week did you put in on the course?” and “how much of the reading did you do?” When evaluating a course we should also have a realistic measure of the student’s involvement and commitment. For some a course may be a key gateway to advanced courses, or others it may be a convenient pass-fail filler which the student expects only a C. For some the key criteria may be the time the course is offered to fit in with work and family obligations.Chuck Kleinhans
amnirov - December 20, 2009 at 7:02 pm
The best way to address the tendency for faculty, especially adjunct faculty, to teach to the evaluation is to rework the thing to remove any possible popularity or personality based questions. Make the evaluation as quantitative as possible: how many times was the professor late to class? what percentage of the class text book was assigned? how many class periods did it take to return graded work? and so on… if the questions are serious, competent measures of how well a faculty member performs on the job, well, then the good teachers have nothing to fear from disgruntled undergraduates, and the poor teachers will shake in terror.
eacowan - December 30, 2009 at 3:02 pm
Today’s clueless, corporate-befuddled administrators cannot fathom that the students are there for the faculty, not the faculty for the students. Students are, first of all, probationers who are there to demonstrate to the *professor’s* satisfaction that they have learned the assigned material. The students are not there to be entertained, to be stroked, to be told how “wonderful” they are, etc. etc. They are there to learn. Learning is something the students do. The professor cannot do that for them. The extent to which they learn the assigned material is not a measure of the professor’s so-called “teaching effectiveness,” a non-existent entity. There is only the learning effectiveness of the student, something very few seem able to demonstrate in recent years. And that is so mainly because that is how they have been “brought up” by the public schools to expect to be entertained, stroked, complimented. For today’s academe, the student-as-customer model shows an ever-downward path away from academic excellence. –E.A.C.
11186108 - December 30, 2009 at 3:32 pm
Is it an “evaluation”? I hate using that term, as it implies a serious effort – defined in Wikipedia (that invaluable reference :-) as a “systematic determination of merit, worth, and significance of something or someone using criteria against a set of standards.”Is that *really* what students do? (I’m sure that a few do, I’m also sure it’s a small minority.)Let’s call this “student rating” or something clearer, e.g. “student popularity rating”.
g8briel - December 30, 2009 at 3:51 pm
“The extent to which they learn the assigned material is not a measure of the professor’s so-called “teaching effectiveness,” a non-existent entity. There is only the learning effectiveness of the student . . .” –eacowanIf teaching effectiveness is a non-existent entity then there is no point in having an instructor. You might as well park the students in front of a book and tell them to exercise their learning effectiveness while riffling through the pages. It sounds as if you are proposing that all teachers are virtually the same and if learning fails to occur in the classroom it can only be the student’s fault. Clearly this is not the case. Some teachers are more effective at teaching than others; that is teaching effectiveness for you. I think that Diane Auer Jones makes a good case as to why teaching evaluations are problematic. However, there is no point in engaging in curmudgeonly griping and picking on the 80s public school generation (as a member of that generation I’m not sure where this idea that the teachers sat around coddling and entertaining us came from– I’m not saying they were necessarily good teachers, but that’s a conversation for elsewhere). Education has changed. The top-down educational hierarchy is increasingly obsolete, and good riddance. Having more dialog with students, including feedback on the effectiveness of your teaching, is a good thing. Catering to their every whim and desire because they are giving this feedback is a whole other thing. There is a middle path here, and I think taking that would be better than taking some reactionary path where a professor pontificates and the students are expected to be compliant sponges.
goldstei - December 30, 2009 at 5:03 pm
I don’t really think students are any different now than they have been for time immemorial–and I speak as a student who, in the 1960s, read thousands of evaluations and edited two published 300-page student teacher/course evaluations at the U. of Illinois (Urbana). The main problem is with evaluations which are completely quantitative and computer-scored, as they are useless for providing information about why students feel as they do, but easy to “utilize” by both the administration and faculty (for promotion/retention/tenure decisions). Faculty should insist on evaluations that are either entirely or substantially open-ended–and should also insist on similar, regular, evaluations of administrators (currently the faculty and students are regularly–and in my opinion quite reasonably–evaluated for every course, while administrators are evaluated, if at all, only by each other). This is not meant as any form of retaliation, but rather reflects that we all need to be regularly evaluated (as do our corporate titans and our elected officials).
reinking - December 30, 2009 at 6:38 pm
Two points:1. There is research that speaks to the validity and reliability of course/teaching evaluations. I don’t have references handy, but, as I recall, the research is not particularly supportive. Further, in my experience, the expertise on tests and measurement available on most campuses, is rarely tapped in the development or interpretation of these, often high stakes, assessments.2. Shifting the focus of a university education from students as consumers to students as future employees employ the same economic metaphor. Using economic metaphors to characterize a university education neglects a more fundamental goal: to prepare an informed, thoughtful, critical, democratic citizenry.
rbannist - January 1, 2010 at 5:27 pm
Diane Auer Jones makes some very lucid points on the evaluation of teaching and student expectations. Surely, the goal of education should be that professors conduct themselves effectively in a highly professional and compassionate manner.The goal of effective education should be for the never ending pursuit of knowledge — that learning is a lifelong pursuit. The tendency to put things in terms of “student as consumer” or as merely job preparation, that there is a vocational component in all of post-seoncdary misses the boat.Studying philosophy, the fine arts, classical literature, and other aethestic or more purely intellectual domains might not seem directly valuable for career develoopment, but all academic endeavors regardless of discipline should encourage critical thinking, in-depth research skills, and the ability to see the subject matter from various points of view.These values are what I believe are implicit in Ms. Jones’ critique of the status quo.One must think that in way too many settings, today’s post secondary insitutions are failing whether caving in to the consumerism impulses or pressure to stress vocational development. Likewise, given academia has become so overwhelmingly supportive of the so-called progressive political agenda where traditional values and conservative agendas are treataed as taboo not as a welcome worthy point-ot-view to debate, such a reality makes developing true critical thinking meaningless. A good professor regardless of his or her political perspective can put that agenda on the side for the sake of examining all sides of issues, play devil’s advocate, and help guide students to understand material where they can develop their values having considered the widest spectrum of options possible.Sadly, the values of the traditional liberal arts education are being devalued tremendously when taachers try to be hip or try to cater their instrution to have observable metrics that relate directly to vocational skills.Ms. Jones should be encouraged to continue to stimulate this discussion.
raymond_j_ritchie - January 2, 2010 at 12:54 am
Some very interesting material here. I agree with the majority who think that treating “students as consummers” is asking for trouble. Students are paying for the opportunity to gain a higher education. It is perfectly correct that they should expect to get a quality education but whether they found it amusing or not is not relevant. You are trying to give a student enough knowledge to survive in a very indifferent world where everyone is replaceable. My experience of student evaluation forms is not good. They are used by senior academics and admins as a weapon to bang you over the head with. Their agenda that does not include your welfare or a desire to help you improve your teaching. One of the deadliest questions is “How well did your lecturer relate to the students?”, the most ignored is “Did your lecturer understand the material they were teaching?”
tekton - January 2, 2010 at 5:37 pm
Feedback from students who have received instruction from me for four months can be useful to me in improving my teaching, and I welcome thought-out and constructive comments from them. But faculty should reject the use of numerical scores by administration in promotion/tenure decisions. If students have real complaints about the quality of instruction, they know how to contact the department chair and the appropriate Dean (it seems they’re much more aware of these avenues than when I was a student). Otherwise, ratings and comments should be just between students and their professors.With regard to numerical ratings, “what gets measured gets managed.” By virtue of providing these numbers to administrators, faculty promote the use of the numbers for management purposes. Faculty should use their collective clout, such as it is, to reduce administrative dependence on these ratings. If the administration requires evidence of teaching effectiveness, faculty should lobby for alternative and more-accurate measures. Peer evaluations, either by other members of one’s department or others in the institution, may be one such alternative.