• Tuesday, February 14, 2012

Previous

Next

Student Evaluations, Grade Inflation, and Declining Student Effort

June 19, 2010, 2:00 pm

The Chronicle‘s Susannah Tully has brought my attention to a great article in the prestigious Journal of Political Economy by Scott Carrell and James West dealing with professorial approaches to teaching, student evaluations and student performance. It seems professors who do more than teach the basic bare-bones knowledge and are in some sense more rigorous tend to get poorer student evaluations (no surprise there). The less rigorous professors even get good performances out of their students in the courses taught but those students subsequently, in follow up courses, do poorer than the more rigorous professors who do more than teach to the standardized test. Sounds reasonable to me.

This got me thinking more about student evaluations and some other evidence. Specifically, I would note that student evaluations began to become popular during the 1960s and early 1970s as a common evaluation tool for faculty. I would also note that most of the great grade inflation in America has occurred since evaluations began, with national grade point averages probably rising from the 2.5 or 2.6 range in about 1960 to well over 3.0 today (admittedly, this is based on limited but I believe likely correct evidence). Professors to some extent can “buy” good evaluations by giving high grades, so the evaluation process is probably a major factor in grade inflation.

So what? What difference does it really make if the average grade is a B- or C+ instead of a B or B+? This is where another working paper of the National Bureau of Economic Research comes in. Philip Babcock and Mindy Marks present evidence in Working Paper 15954 that in 1961, the average student spent 40 hours a week engaged in their studies—attending class and studying. By 2003, this had declined by nearly one-third to 27 hours weekly.

One advantage of getting old is that you gain some historical perspective, and I have been in higher education for over a half of century and believe that Babcock and Marks are right. Students do less reading, less studying, even less attending class than two generations ago. Why? They don’t have to do more. With relatively little work they can get relatively high grades—say a B or even better. And student evaluations are one factor in explaining the underlying grade inflation problem. Go to the campusbuddy.com Web site and see for yourself evidence on the grade-inflation phenomenon. The colleges of education, which in my judgment should be put out of business (topic for another blog), are the worst offenders, but the problem is pretty universal.

College is getting more expensive all the time—and students are consuming less of it per year as measured by time usage. The cost of college per hour spent in studying is rising a good deal faster than what tuition data alone suggest. Why should the public subsidize mostly middle-class kids working perhaps 900 hours a year (half the average of American workers) on their studies?

What to do? We could move to reduce the impact of student evaluations, or even eliminate them. One reason for their existence—to convey knowledge to students about professor—is usually met separately by other means, such as the RateMyProfessors.com Web site. Alternatively, colleges could by mandate or the use of financial incentives encourage faculty to become more rigorous in their grading. If state subsidies started to vary inversely in size with grade-point averages, state schools would quickly reduce grade inflation. In any case, we need more research into WHY students today are working less. But I would bet a few bucks that grade inflation and student evalauations are part of the answer.

 

This entry was posted in Uncategorized. Bookmark the permalink.

  • Print
  • Comment (60)

60 Responses to Student Evaluations, Grade Inflation, and Declining Student Effort

mchakravarty - June 21, 2010 at 6:27 am

A rather succinctly laid out viewpoint.While agreeing with this line of thought, I am of the opinion that the issue of Grade inflation and declining student work effort is also due to a significant decline in the quality of teachers.In most professional courses, the faculty are now more preoccupied with publishing research work and attracting funds rather than to pursue teaching and training as their primary preoccupation. This would aptly explain why students are spending more time away from the classrooms. There is no stimulus there. Gone are the days when faculty were the foundations of knowledge and possessed a strong sense of discipline and strength of character. They were the leaders of the future world. This phenomenon is a rarity now.Far from being an intimidating figure endowed with a rich and varied source of knowledge and wisdom, today’s Professors are experts only in a very limited sense and are also substantially disinterested in teaching since this is not rewarded at all.The universities need to seriously scrutinize their institutional goals and revert to preeminence of teaching as axiomatic.To conclude, get good teachers, pay and support them well and they will infuse their students with a sense of commitment, interest and the issue of assessment will automatically correct itself. We have over the past three decades also become quite preoccupied with psychometrics of assessment quite forgetting that asessment only follows teaching and learning in the trinity of education. Unless more time and interest is invested in teaching, the issue of assessment will never be valid however objective and reliable the instrument of measurement might be and we shall be unfortunately putting the cart before the horse and the present trend well supports this fact.Manoj Chakravarty, M.D.

eacowan - June 21, 2010 at 6:54 am

There will be no change until administrators actively support faculty in the maintaining of university-level academic standards. In my experience, and in that of many of my colleagues, administrators allow students to complain about faculty without presenting any evidence whatever to back up their complaints. Such unfounded complaints are accepted by administrators with wide-eyed credulity, and the professor is always bullied into lowering standards. Real university-level standards are regarded by administrators as “bad for business,” interfering with their precious student retention and graduation rates. I know: This is one reason that I am now retired from academe. And the reality is that students cannot bring themselves to perform at the real university level. (There is one and only one such university level.) Departmental chairs will scowl at the offending professor and say, “We’re not Harvard.” And…? My guess is that such administrators chafed and struggled to obtain their degrees and blamed their professors for this “suffering”. And these people feel that they want to protect their students from any similar “suffering”.”If it doesn’t hurt, it won’t stick.” –E.A.C.

tejackso - June 21, 2010 at 7:13 am

I’m not sure how legit it is simply to compare student statistics from the 60s, or even 70s, to student statistics now. My students (at a very non-elite universiity) can’t spend anything like 40 hours a week studying because they nearly all have to spend 20-40 hours a week working in order to be at school at all. And then they want to graduate in (what used to be) the usual 4 years, so of course they try to take 15+ hour loads too. I’m betting this was not the case with most students before the immense democratization of higher ed that has occurred in the past decades. It may not be the case in elite schools today?But even with this state of affairs it’s possible to be demanding and rigorous and still get good evals. It all depends on whether you’re willing to take the extra trouble to figure out *how* to be demanding and also keep the students on your side. In my experience this does not require touchy-feely, education as new-age therapy kinds of approaches. It’s much more like what I imagine being a coach is like. An athlete doesn’t typically resent a coach for being demanding everyday all the time, because the athlete can plainly see that the coach has the athlete’s success and well-being in mind. This can be true in the college classroom too, but it takes extra thinking (at least in non-elite schools) about the nature of being a student and the nature of being a teacher and the nature of the learning that’s supposed to be going on.tony e. jackson

fullprof99 - June 21, 2010 at 7:36 am

Another factor that would help explain grade inflation is the use of plus and minus grades–supposedly to convey more precise information but really muddying the grading system. If there were only five grades there would be much less tendency to “grade up” via plusses. I suspect we would reverse a good deal of inflation if we returned to this scale:A = Excellent.B = Good.C = Average or Acceptable.D = Marginal but passing.E or F = Not Acceptable.This is really about as discriminating as one can be. Add in plus and minus grades and you suddenly have thirteen possible grades rather than five, and I don’t think that on reflection anyone honestly can believe it is possible to grade that precisely. Instead the grades slide up the scale and you get inflation.This system of course would be hardest on the real “B” student (who now is always hoping for a “B+” or “A-”) but would be more honest. Probably the only way to do this would be by a nationwide agreement. It would have to be all or nothing. No plus or minus grades on any assignments or for final course grades.

fullprof99 - June 21, 2010 at 8:15 am

eacowan, I would say that many students can perform at the real university “C” or “B” level but may want to get a grade that says they have done better than that. Also, I don’t think it is just administrators who have “chafed and struggled to obtain their degrees and blamed their professors for this ‘suffering.’” I also see professors who really weren’t smart enough to earn their Ph.D. degress and do the job of a professor. Honest grading might have stopped them at the M.A. level and made life more pleasant for those of us who have had to deal with their marginal competence in the classroom and elsewhere–or to deny them reappointment or tenure, a very nasty business. Such people might well have been quite successful in other occupations or at other levels but are wrongly encouraged (if only by inflated grades) that they can succeed in academia. My department runs a very successful M.A. program aimed largely at secondary teachers. These people are for the most part hardworking in M.A. classes and highly effective in their own classrooms, but I would say that no more than one in ten could be Ph.D. material. (And fewer of the really qualified are interested in going on to that level, though some of our “B” and level students wrongly think they will get Ph.D. degrees.)

tribblek - June 21, 2010 at 9:12 am

While I completely agree with the trends this article points out, my belief is that student evals and grade inflation are both symptoms of the victimization of our culture. I am fond of saying (of the K-12 world) that “it’s not our schools that are failing our kids… it’s our society that is failing our schools.”A strong sense of entitlement, lack of work ethic, and instant gratification have all been learned by our kids. How has this happened? That is what I want to know.

goldenrae9 - June 21, 2010 at 9:18 am

Although I find inherent merit to this opinion piece, I also agree with some of the criticisms of the commentators.Students have a larger burden to bear with added responsibilities such as the growing necessity of undergraduate research and standardized exams for graduate schools (MCAT prep is often equivalent to a 3 credit course on its own merit).I do find that there are plenty of colleagues who can’t teach. I don’t find means of 45 on an exam to be demonstrative of anything other than the professor failing to teach their students what they wanted them to learn. One of the biggest impressions I had from a freshman year Into Biology course was low mean on a test and the professor taking responsibility for creating an exam that wasn’t appropriate for the material taught. The mean on prior and subsequent exams were in the 70s–that average C.I am known for teaching rigorous courses and being popular. But I also had training in curriculum building and pedagogy. It is not impossible to do both and I do find that universities are often lacking in preparing the PhD for life in the classroom.

maxwellaustin - June 21, 2010 at 9:31 am

One other factor in grade inflation in recent decades is the extension of course withdrawal deadlines. The elimination of course withdrawal quotas likely plays a major part as well. For example, my institution allows students to withdraw from a course with as little as 3 weeks left in the semester, allowing the students to drop courses merely because their likely final grade will not be a B or higher. It is routine to examine student transcripts here and find students with cumulative GPAs of 3.3 or higher, but who have withdrawn from 10 or more courses in their educational career.

cold_feet - June 21, 2010 at 9:32 am

It does seem that, in the past 10 years or so, students expect college credit for high school (or even middle school) level work. Much contributes to the problem and there have always been differences in expectations at different schools. However, better work and more effort must be required if degrees are to be worth anything at all. I taught graduate students whose writing was worse than might be expected of Sophomores. How did they gget into graduate school? Moreover, how did they ever finish?

rentedname - June 21, 2010 at 10:05 am

Perhaps we could eliminate grade inflation simply by eliminating grades. Grading is not a very precise way of measuring how well students do in a course. Consider #4′s proposal, to make it more acceptable by making it even less precise. Institutions are already moving toward a criterion-referenced model in which we evaluate student performance against descriptions of the skills and knowledge students should evince at a course’s end, relative to course learning objectives. We normally see numbers assigned to each progressive level of mastery of outcomes (e.g., 0-5). However, one might as readily assign letters. So to mirror #4 above:A = Describe what skills that includes.B = Describe what skills that includes.C = Describe what skills that includes.D = Describe what skills that includes.E = Describe what skills that includes.F = Describe what skills that includes.One might also audit faculty evaluations by third-partiers or perhaps even have somone other than the faculty member evaluate student work against this system.Imagine if we switched to such a system. If one saw grades increasing over time, would not the conclusion be that students are achieving more? I am less concerned with number of hours per week studying than with improving student learning and achievement. Normally the two go hand in hand, but why focus, as Vedder does, on inputs like hours studying? Why not focus on what grades should measure, which is achievement?

fullprof99 - June 21, 2010 at 10:17 am

rentedname, I was not proposing “to make [grading] more acceptable by making it even less precise” but rather to make grading reflect what actually could be evaluated. That is, to maie it more realistic. As I mentioned, a simple ABCDE scale likely would help reverse grade inflation, and I doubt that it would be more acceptable to many students whose GPAs likely would fall to such more realistic levels.maxwell, good point about easier withdrawals possibly affecting GPA.

fortysomethingprof - June 21, 2010 at 10:37 am

Three comments.First, commentator # 9 wrote, “I don’t find means of 45 on an exam to be demonstrative of anything other than the professor failing to teach their students what they wanted them to learn.”This comment reflects a serious confusion between teaching and learning. The professor might have taught his or her students well. But perhaps the professor does not have a winning personality. Or, heaven forbid, maybe the professor has an Asian accent.Professors have a clear responsibility to set a standard of rigor at a level that they believe is right for the subject they are teaching. It is NOT the job of the professor to write exams that are easy enough that the mean will be 75-80 regardless of how little students prepare. Yet that is what many do, and that is the primary cause of grade inflation.Second, following up on the first comment, there might be several reasons why professors aim to give their students higher grades. (1) To improve their anonymous teaching evaluations which are considerations for tenure and promotion.(2) To make sure that students at their university are not placed at a disadvantage for graduate school, medical school, etc.(3) To minimize the grumbling, constant trolling for points, and vicious ad hominem attacks on web sites like “Rate My Professor”, so-called “serious conversations” with the Dean, or the condescension of professors who get higher teaching evaluations and enjoy flaunting it.Third, the amount of time spent studying is easy to measure by a simple poll. But what about the quality of that studying? During an hour of studying, how often did the student answer his phone or text a friend? Was the TV on? Are they able to read a couple of pages of a textbook at a time without “taking a break”, and are they able to grasp concepts from that reading, or just transfer phrases to flash cards?Fourth, a couple of commentators pointed out that students often have to work to put themselves through school. I sympathize. But does that mean that the baseline expectation for studying should be lowered so that anyone, no matter what their extracurricular obligations, can graduate “cum laude” with a bachelor’s degree? It seems rather obvious that someone who is able to devote all of his or her time to studies should perform better. That playing field will never be level, nor should it be.Finally, I have to comment on “This is not Harvard.” Students will say, “My professor thinks he is teaching at Harvard.” Well, trust me, no I don’t. First of all I’m perfectly aware that I’m not talented enough to be at Harvard. Moreover, if students at Middle State University want to compete with Harvard graduates for the jobs that are out there, they need to work _harder_ than the kids at Harvard. Fortunately, many students (and professors) do take that attitude and it shows in their academic achievements and in their careers. The problem is that the kids are Harvard ard there because they are accustomed to working hard, and they have developed the skills necessary to build quality into their study time, and by the time one is in college those skills can be very hard to learn.

profmomof1 - June 21, 2010 at 10:38 am

I agree with #8. It’s extraordinarily rare that I give out an F, or even a D, because students who are on track to receive those grades withdraw at the last minute to avoid it. As a faculty member I have little incentive to worry about grade distributions or spend more time being more “rigorous” because the administration at my university has stated outright that the measure of “quality” for faculty job performance is number of peer-reviewed publications, federal grants, and external research awards. Caring about teaching quality is only lip service here.

fortysomethingprof - June 21, 2010 at 10:39 am

One more thing. Each grade should be accompanied by a ranking. You got a B in English 322, but your rank was 30/40. That speaks volumes about how the professor grades and it adds valuable context to the transcript.

fortysomethingprof - June 21, 2010 at 10:44 am

Oops I said that Commentator #9 wrote something when it was really Commentator #7. Maybe what we need here is a real blog. Or maybe I just need to wake up. :)

11223140 - June 21, 2010 at 10:48 am

Interesting how in the first 12 comments only the third commenter chose to address one obvious issue here. The 1960′s/1970′s comparative data offered in the article is from an era where college costs, as a percentage of family income, were a fraction of the same costs/family income percentage today. Thus, it was not nearly as necessary for students to be working back then the same number of hours many now are working in order to be enrolled in higher education at all. Also, back in that rosey era of federal student aid, the ratio of aid offered was roughly 75% grant aid, 25% loan aid. That ratio is now fully reversed. If you take the time to speak with a variety of current students, many working a huge number of hours just to meet their tuition and living expenses, PLUS enjoying financial aid packages that feature massive student loan debt relative to their need-based grant funding, it might help you to better understand the “academic effort” that you do (or perhaps do not see) flowing from their performance in your classrooms. Interesting topic to chew on, perhaps, but please, place it within a realistic, comparative context.

11301218 - June 21, 2010 at 12:16 pm

It is true that getting old gives you a perspective. I wasa student in the 60′s. For students of the male gender (whowere much more numerous then), pursuing a degree was a wayof avoiding the draft. That was real motivation when youconsider the alternative. GPA’s on the average lower werethan today. Fear of poor performance was always present.You did not find male students on academicprobation or suspension. You were either in good standingor in the Army. Plus, there were additional factors — suchas the post-Sputnik push on science, math, and engineering.You cannot earn a degree in these areas in 27 hours a weekof study, including time in class and labs. Students areavoiding science and math in droves.

ikant - June 21, 2010 at 12:25 pm

Not precisely on topic, but I just want to note that the use of Harvard to illustrate what rigorous teaching and grading should look like is way off-base. The grade inflation at Harvard is well-known, as is the coddling that undergraduates receive during their education. So, you know, maybe we should find our exemplars elsewhere.

marka - June 21, 2010 at 12:40 pm

Two points:1. I worked thru college in 4 years in the 70s, and I wasn’t alone. My daughter is now a junior in college, and has worked part-time as well, expecting to graduate in 4 years. My wife didn’t work thru college – her dad paid for it all – and she wasn’t keen on our daughter working … . I don’t know what the ratio is now, but I’m not convinced kids work more for $ to put themselves thru school than previous generations.2. Elephant in the room — more & more people now attend college, as a percentage of population. We ^want^ to believe that we are all created equal in all things, and that we should all get equal results — a desire elevated in the 60s with the Great Society, when LBJ et al converted equal opportunity to equal results. Fact is, although we may be equal in our ‘right’ to opportunity (and in God’s eyes), we ^aren’t^ all equal in abilities (no one argues this in the athletic arena; why argue it in academics?), and we shouldn’t expect equal results. Much grading used to be on a curve — the top 10%, and so on — so that a certain percentage was expected to fail, and the vast majority were ‘average’ (median). More or less a bell curve. Now it is social promotion. Just because you are ‘white,’ ‘black,’ female, or … you name it … doesn’t mean you should perform equallly well in all categories. There is a wide distribution of talents, interests, opportunities, etc. We are trying to validate a desire for everyone to be ‘equal,’ by reverse measurement — we’ll call us all equal via grading, even tho’ we know some are more equal than others. Therein lies our problem … grades are used for a completely different purpose now: to validate our desires (and bolster false self-esteem), not to sort & shift into percentiles, from whence we ‘tracked’ students (college track, shop track, mommy track, etc.)

psyc132 - June 21, 2010 at 12:47 pm

There are a lot of great comments on this issue. In addition to all the really relevant points already highlighted, I wonder whether there is also too much on an emphasis on all comers going to college, no matter their level of emotional maturity, intelligence, life experience, or interest. I have had numerous students, who, when I meet with them to dicuss their poor class performance, freely admit that they have no real desire to be at college and/or don’t really know what they want to do with their lives. Many parents expect (and sometimes demand) that their children will attend and graduate college right out of high school. I can’t help but think that this myopic fixation on an immediate attainment of a four-year college degree without consideration of whether it best serves the career/life goals of the student (a) exacerbates grade inflation, (b) contributes to a sense of entitlement on the part of students and parents and (c) ultimately devalues the worth and purpose of a college degree.

jenny_franklin - June 21, 2010 at 2:48 pm

The last time I looked it was up to faculty as “the academy” of record to set the content and challenge level of curricula and student ratings were never a recommended primary or sole source for evaluating whether the challenge level of a course was appropriate. Even a dumbed down course can be taught relatively well or poorly. In reality, looking at ratings at our institution, once various sources of known systematic variation are accounted for (e.g., academic discipline, course level, class size, etc.) the factor representing teaching effectiveness was essentially unrelated to perceived difficulty/workload. If anything, courses perceived as more challenging (setting aside “difficulty” related to suboptimal instruction) get slightly higher ratings.

monteverdi - June 21, 2010 at 2:49 pm

I agree with many of the points made by Richard Vedder. Before I return to these, I do feel it is relevant to note a political agenda as well. Google Richard Vedder coupled with Wal-Mart as well as with Tobacco Institute as well as with SourceWatch. This point made, some commentary on the issues he raises follows:1. I recall my first teaching assignment in Spring 1971 when student evaluations were a kind of student tool to advise peers about which classes to take and which to avoid- friendly advice although “Buyer Beware”2. This has evolved, unfortunately, into an administrative device. I recall a Dean who loved seeing evaluations to two decimal places coupled with graphs, etc. Other versions involve “minimum tolerable” numbers (for tenure? for avoiding further explication? for merit?)3. As a former department chair and a college dean, I have read literally thousands of these evaluations and student comments. It may come as a surprise to many, but the attempts by students tend to me overwhelmingly constructive. This said, it is also very clear that smaller, upper-division courses are more highly rated than large lower division courses and high grades (“customer satisfaction”) creates higher student evaluations. There are certainly many demeaning comments that must be stoically endured.4. I take at face value Professor Vedder’s comparison of student hours spent in-class PLUS out-of-class work: 40 hours/week (1961) and 27 hours/week (2003). These numbers are actually far more alarming than they appear. If one assumes 16-18 hours/week in actual class time during 1961 as well as 2003, study/preparation time has declined from 22-24 hours to 9-11 hours. That is very alarming and I am convinced this comparison is quite valid based upon surveys I have seen about how students budget their time each week.5. Only two bloggers seemed to note how many students have been forced to work at part-time (even full-time) jobs to pay for college. Yet this is a very serious issue and the major cause is not to support a “lifestyle” but to pay for increased costs. I worked during college but found that if my hours exceeded 12/week during the academic year it was negatively impacting my studies. Where are these increasing costs coming from? Certainly, the changing nature of what is demanded of colleges (far more remediation, far more accomodation for disabilities) than in the 1960s- but one result has been more open access and greater opportunity for those previously denied. In the 1960s there were few accomodations for a smart student with cerebral palsy wishing to major in chemistry. Rapidly rising health costs and (for publicly-funded colleges) declining State contributions have required increases in tuition. Let us not forget that at most universities, sports programs are net money losers yet are demanded by students, parents, alumni and local fans. Similarly, if a university is heavily subsidizing research- that can play a role.6. Still, there is no escaping the point that “customer satisfaction” is increasingly becoming dogma at many colleges and universities that will be battling for a declining population base of students. There is no question that our “customers” feel (and are) empowered by these student evaluations and that these in turn place pressure on faculty to reduce standards. The “For-Profit” institutions such as University of Phoenix add to the competition for “customers.”I suspect that it will take a crisis of some sort to reverse the trends Professor Vedder addresses. I frequently review applications from foreign universities and find that grade inflation does not appear to be a major factor (yet) in Asia, for example. The crisis will come when it becomes clear that the downward pressure on our expectations of students and the upward pressure on grades (“customer” expectations) cause our degrees to be worth much less than they claim.Art Greenberg, Durham, NH

athlwulf - June 21, 2010 at 2:51 pm

Interesting viewpoint, and certainly mainstream, however, I would disagree on a few points. First, student evaluations began being used as evaluative instruments in 1918 according to the literature and was in widespread use by the 1930s. Second, the major event that the author is overlooking in his theory is the introduction of the GI bill which allowed a huge segment of the population to enter college that, under the pre-WWII higher education system, would never have been eligible either financially or academically. Third, though I do not have specific citations (*yet*) grade inflation and watering down the curriculum is more of a result of an expanding middle class, increased interest in college as a place for vocational and non-traditional training, and an effort during the 60s and 70s of major corporations to divest themselves of internal training programs and requiring college degrees instead. Simply put, in the first part of last century, college was a place for academic advancement with a primary emphasis in humanities and sciences. In the latter half, the idea of college expanded and a significant and growing population was introduced into the system that would never have considered or been required to have any college prior to the social and economic changes in post world war two society.

anonscribe - June 21, 2010 at 3:43 pm

perhaps some of these comments already covered this, but there is another way to interpret the decline in hours spent studying/working on coursework: a rise in efficiency.in 1960, there was no internet, no digital library, no word processing. now, students can locate an article in thirty seconds that would have taken them 5-10 minutes to find in a library–if the library had it–back in 1960. i’d also imagine the average typing speed of a contemporary student outpaces a student in 1960. you also don’t have to transcribe a type-written paper from a handwritten paper or re-type a ten page paper because you screwed up a sentence, etc. perhaps students are learning more, or the same, as students did in 1960 but in 1/2 the time. if we want to make students study more, then Vedder’s suggestions would work: grade harder and assign more work. assuming the subjective “intensity” of their studying hasn’t increased–even if the amount learned has–then forcing greater studying time seems like a good idea. but, these studies alone don’t demonstrate that students are learning less–just that they’re spending less time studying.perhaps students are better at gathering and categorizing information now than they were in 1960 but are less able to critically analyze the information they gather? part of this isn’t entirely students’ fault: what would your average college student have to learn–on top of their coursework–to function in the social environment of 2010? even extremely hard-working, bright folks find it hard to deal with the data overload of an IT culture.

waytooold - June 21, 2010 at 4:14 pm

This is more than interesting, and certainly makes sense. Another issue has to do with many university faculty who are not “regular” faculty, but on a lecture status. For these individuals, with no required publication, the only basis of “judgement” is the student evaluation. And I know from direct discussion with these faculty memebers that the evals are almost a matter of life and death…at least a bit a job security. (ps, I just signed up, and wanted to add this comment…I haven’t read the above yet, and my comment may be redundant….I’ll find out shortly: and finally, it’s good to know that it’s my hard nose grading that accounts for some of the student comments)

jpredington - June 21, 2010 at 5:06 pm

Another elephant in the room – financial aid, particularly institutional “merit” discounts that are often tied to a 3.0 average, thereby making every grade below a B a de facto vote on the worthiness of the student for a significant chunk of their institutional financial aid. Until the “car salesmanship” component of tuition discounting is eliminated, there is even more institutional pressure on faculty to grant not just passing grades, but high passing grades.

lotsoquestions - June 21, 2010 at 5:56 pm

It was presumably also less likely twenty years ago that a Mommy would find you — even going so far as to locate your home phone number — and harangue you because Junior got a B, which simply isn’t acceptable since “we’re applying to law school.” (No need to ask who the “we” is here.)

commserver - June 21, 2010 at 6:07 pm

I want to give 2 perspectives on this issue.The 1st is personal. Until recently I was adjunct at CC. I tried to have standards and yet be fair. I curved to reflect what I considered to be the rigor of the material. Those students who applied themselves get good grades while those who don’t get average grades. I was recently let go after 7 years teaching business statistics because the chairperson said that my evaluations were decreasing and not what they should be. I was even told of student who complained of getting C+ even though missing a test (wanted a B). The chair decided to change the grade. I said the chair could change the grade without my consent.The 2nd is about my daughter. She just finished her 1st year at Williams College. She found out that getting A wasn’t easy. In her Organic Chemistry course the prof gave tests on material not covered in class or reflected in the homework. She had 85+ average which was better than most of her class. She only got B in the course. This trend was seen in other courses. Even though she had best average in those courses the best she could do was either B+ or A-.

gadget - June 21, 2010 at 7:33 pm

Reflecting the first comment by commserver:When I attended college in the 1970s, virtually all my professors were ambitious fulltimers seeking tenure. Their drive and knowledge was impressive and exciting.Now I work in a community college as an adjunct. We teach most of the contact hours for students. Largely, our performance is judged based on good student evaluations and no student complaints. I learned well from my own instructors, but a demanding curriculum and giving most students a C grade (like I had when I was in college) is a guarantee of no future employment because evaluations will go down and student complaints will go up. Yes, there are people in college now who never would have gone in the 1950s, tuition costs are much higher than they were in my day, and family incomes have stagnated at what they were in the early 70s in real dollars so students have to work more hours to stay in school. But the education system is also to blame. By relying on adjuncts to do most teaching, especially at the freshman and sophomore level, then judging adjuncts based on student likability evaluations and no hassle for administrators, we are feeding grade inflation.

raymond_j_ritchie - June 21, 2010 at 9:34 pm

I did my undergraduate & PhD in Australia in the 1970s. Much of what the article says and what correspondents say equally apply to here. I think undergraduate standards have declined and marks have been inflated. The dead hand of successive governments who confuse training with education carry a lot of the blame. There are two culprits:(#1) Race-to-the-bottom economic rationalism has forced contact hours to decline by about 25%. There are many science subjects which are very difficult to learn by reading a book. For me Biochemistry and Molecular Biology come to mind. What about engineering?(#2) Students now work on AVERAGE about 20 hours per week during semester time. Conservatives think that is great but it has a dark side. Students turn up on campus only for compulsory things such as tutorials and practicals. After the first weeks of a course you never have more than 1/3 to 1/2 of the students at a lecture. Lack of time shows in their reports and exams and skills level.My personal experience of Student Evaluations are that they are used by Heads-of-School to bang you over the head with if you try and be too intellectual with the students.

mbelvadi - June 21, 2010 at 10:17 pm

I’d like to bring up one more enormous elephant in the room. In this thread and others on this site, I constantly hear two fundamentally contradictory positions that people are trying to talk about without acknowledging the contradiction:1. that it is appropriate that the local faculty of each institution have complete control over the curriculum at every level of specificity (eg in exquisite detail the content of “Biology 101″) – everyone in the US seems to accept this as the most sacred of sacred cows2. that grades/GPA be somehow uniform in meaning across institutions (so that, for instance, a graduate program or employer can use them for quantitative comparison of candidates/applicants) – if you don’t accept this, then this entire article and most of the comments that follow are completely devoid of any point whatsoever.Am I the only person in higher ed who sees that it is absolutely impossible to reconcile these two positions? Sometimes I feel like I am.Those who are seriously concerned about the role of the US higher ed undergrad system for preparing US citizens to compete in the global marketplace of high paying jobs need to take a careful and OPEN-MINDED (c.f. “sacred cow” above) look at the system in India both of secondary and post-secondary education, and how the use of nationally-standardized high stakes testing and rigidly defined curriculum is producing graduates who are routinely outcompeting US youth.

jvknapp - June 21, 2010 at 11:35 pm

Grade Inflation and working to pay tuition, R & B –While we have all noticed the amount of time that students are spending on studying is less than when “we were in school,” the reason for that has as much to do with rising tuition costs and declining state support as it does lack of individual rigor. For every dollar in school-attending costs that the state doesn’t supply, state-school students (most of them) have to work more hours to pay for necessities. More work time, less study time, and hence the student pressure on faculty to get more (a better grade) for less (academic time). The high cost of low grades could mean loss of student loans and certainly scholarships. So, when the various states reduce their own support for higher education, blame the grade inflation on the “budget savings” they think they are creating; it’s a bogus savings.JVK

fortysomethingprof - June 22, 2010 at 1:44 am

Commserver (28) said about her daughter, “In her Organic Chemistry course the prof gave tests on material not covered in class or reflected in the homework.” Oh yes, that is one of the most common complaints that we hear on our evaluations. “His / her tests are nothing like the homework.” Or “he / she asks questions that come from out of the blue sky,” or “I get B’s and C’s but I feel like a really understand the material.”One question … was the material on the exam *in the textbook*? Many students assume, incorrectly, that if something is not covered in class, then it can be safely skipped when reading the textbook. Chemistry is a subject where there are things you can pick up from the textbook pretty easily, and other things where you cannot do that at all, you need them explained to you by a professional. Your daughter’s professor is probably doing his or her job by selecting those things for lecture coverage that are the most conceptually challenging and leaving the easy stuff for her to glean from the textbook.Organic chemistry is not a subject where you just regurgitate “the material.” Time to get rid of the flash cards. Organic chemistry is a subject where you are expected to digest abstract concepts and then apply those concepts to solve problems that you have never seen before (i.e., similar to the homework but only if you can grasp that similarity). Some students can rise to that, others cannot. That is why Organic Chemistry is one of the best courses for determining who should and who should not go to medical school, because medicine is very much the same way — everything is both similar and different, and it’s up to the doctor to determine which is important for a given condition.

nordicexpat - June 22, 2010 at 2:29 am

“Alternatively, colleges could by mandate or the use of financial incentives encourage faculty to become more rigorous in their grading.”If Vedder would reread the actual article he refers to, he would learn that teachers who got higher evals from their students in this study did not give easier grades to their students. Grading was done collectively, so an individual teacher could not be more or less rigourous than their peers. The students of teachers who got higher evaluations legitimately got higher grades in the courses — that is, they performed better than the students of teachers who got lower grades. The question is not really about teaching evaluations — this is a bit of a red herring, I believe — other than, in this particular case, student evaluations actually correlated pretty well on how well students learned the material given the method of assessment for the class. (Whether that method accurately reflects learning is another matter). The study is interesting, but it raises more questions than it answers. Did students give their teachers higher evaluations because their teachers explained exactly what they were doing, why they were doing it, and what the positive results would be? Did students perform better on the contemporaneous course because their teachers were “teaching to the test” or because they actually did learn more? Did those who performed better in the follow-up course actually retain more information from the previous course, or did they increase their effort to make up for a poorer grade from the previous one? etc. etc. etc. I think the problem with most discussions about the validity of teaching evaluations is most people have already made up their mind about them, and then don’t even bother thinking about the issues actually raised by a study.

generally_academic - June 22, 2010 at 5:00 am

Using RateMyProfessor is total b#lls##t. I work at a small college, know most of my colleagues, and know many students. Checked the RMP site, and a majority of the comments are either outright lies or half-truths designed to make the poster seem a beset-upon angel. The site is, therefore, worse than a waste to anyone investigating my college. What garbage. (And I’m one of the ones who got good comments!)

tuxthepenguin - June 22, 2010 at 9:01 am

There are two problems with the current system.1. There is a desire to run universities as a business. Thus revenue generation is king. Good teaching evaluations = higher revenue (that’s the belief, whether or not it is true, I do not know). There is a nearly universal view that the more entertaining a class, the better the educational experience. Put in those terms, few would agree with me, but it summarizes reality. Making students work for their grade tends to reduce the entertainment value.2. Most of the costs of relaxed standards are paid by businesses and alumni, not the students who fill out the evaluation forms. “I thought that a top student from university X would perform well, but boy, was I ever wrong! Biggest waste of time since I started the business.”"I see you have a degree from university X. Graduates of that school aren’t worth a darn. Not even the ones with a 4.0 GPA.”The mistake is that university administrators apply the model of a shoe store when that model doesn’t really work.

juniper29 - June 22, 2010 at 9:49 am

I concur with commentator 31. Grades mean nothing unless there is an objective standard. What if professional associations (APA,the American Sociological Association etc.) were to set and grade exams based on a syllabus distributed to the Universities? A proportion of the students’ tuition fees could be given to the professional associations for doing this. Then teaching evaluations could be abolished altogether. The best teachers would simply be those whose students scored highest in the exams. And the best Universities would easily be identifiable, much like the elite highschools that are known for their ability to groom their students for the top universities. University administrators might then think twice about dumping their students in massive lecture classes with computer-graded MC quizzes and a textbook that more closely resembles The Oprah magazine. Rate my professor? Kiss my A**!

haroldfs - June 22, 2010 at 10:43 am

My experience with this confirms the findings on the pernicious effect of student ratings. I taught a less-commonly taught language (Tamil) which always had low enrollments, and the administrators were always pushing me to up my enrollments, the measure of which somehow turned into capital for them. Higher enrollments, more value. But to up my enrollments I would have had to inflate grades, and I did not agree to do this. Similarly, in my lecture classes, I always required research papers, rather than exams, and this also tended to undercut my enrollments–as soon as the first version of a paper was due, students started dropping the course. This was a no-win situation, but I was not going to compromise my principles. H. Schiffman

redplum - June 22, 2010 at 11:15 am

“The less rigorous professors even get good performances out of their students in the courses taught but those students subsequently, in follow up courses, do poorer than the more rigorous professors who do more than teach to the standardized test.”What an awful sentence. Grammatically incorrect, confusing, and painfully clumsy. An unpolished but much clearer version would look something like this:Less rigorous professors get good performances out of students in their own classes, but those same students go on to perform poorly in later courses. For more rigorous professors, who do more than teach to the standardized test, the reverse is true: students don’t perform as well in their classes, but go on to perform better in subsequent courses.

btuberville - June 22, 2010 at 11:49 am

This comment is probably reflective of several before me, but here goes anyway:The underlying problem that I see is a mentality that students are now “customers” and that higher education (or education as a whole) is a commodity – which lends itself more readily to “Customer Satisfaction Surveys” (which student evaluations were actually called on one campus) and the idea that “The customer is always right” (which various students over the past 14 years have reminded me – right after demanding As and Bs for barely passable work). If our goal is to maintain the rigor we claim we offer in the classroom, then the occasional disgruntled student comment will not be given much credence; however, if our goal is increased retention at any cost, then our teaching and our grading will be affected by the fear of verbal retribution.

maxwellaustin - June 22, 2010 at 12:37 pm

The more I read these comments, and those appended to other articles dealing with grade inflation, the more it becomes clear that pedagogical approaches to this issue only get us so far. Many of the more recent comments above have touched upon a key issue: increased work hours for many students in the face of rising college costs. Others have described the pressures that adjuncts face when grading students because of the lack of job security among contingent faculty. Administrators and faculty have reams of data indicating the link between the social/structural environment from which students come and their academic performance in the classroom. Yet when many of these same administrators evaluate teachers and faculty from kindergarden through graduate school, this outside context is ignored and the faculty member is supposed to turn into a Horatio Alger, a rugged individualist heroically laboring to promote learning (or just student satisfaction) with diminished structural and institutional support. Accordingly, I will be taking future advice from the pedagogical experts and the Ed.Ds with increasing amounts of salt.

citizenwhy - June 22, 2010 at 1:05 pm

I find it hard to believe that elite colleges are failing to work their students harder. How can a student do a decent senior thesis without previously taking learning seriously?There are a lot of OK colleges out there that attract bright students. Given how they are “taught,” it would be easy for these bright students to game the system, work minimally and do well.These middle of the road, OK colleges do not require a senior thesis or other rigorous proof of learning. These colleges provide numerous clubs, encourage large amounts of community service, and encourage or require internships. Their graduates do pretty well, many rising to some sort of prominence. At these OK colleges students take many survey courses, and most course grades are based on a few tests, with many or all of the questions provided by the textbook publisher. There may or may not be a brief research paper or a project/case/presentation in these courses. But the professor’s goals, in most cases, is efficiency: a minimum amount of time spent grading, reading/evaluating/observing student work, and providing some specific feedback.Yes, the college “teaching” (not learning) system described above is easily made subject to efficiency on the part of the student as well as the professor: minimum study and preparation, maximum recreation or career preparation outside the class room, and maximum output (grades) for the minimum input.

citizenwhy - June 22, 2010 at 1:22 pm

Ah yes, the student as “customer” instead of learner or even client. Let’s substitute “client” for “customer,” since the term “client” implies that some sort of mutual concern for truth and value.So who is the professor’s client, primary and secondary? Well the primary client traditionally would be the professor’s field of learning/scholarship. The professor “contracts” to produce students who will have at least a solid knowledge of his/her field of learning. This would, of course, require rigorous work from the students, the intensity depending on the course level. The professor’s secondary client is the student. The professor contracts to enlighten (and sometimes inspire) the student on an important field of human learning and achievement. Then there is a third client: society. Here society is best served by turning out learners who know and respect how scholarship and knowledge “add value” to society. And graduates who are prepared to continually learn and add value to others with their knowledge and skills. Treating the student as a customer does not necessarily interfere with a student’s career ambitions, but it encourages the student to shrink even further into the role of busy, perhaps competent, but ignorant consumer and salary serf.

fortysomethingprof - June 22, 2010 at 3:56 pm

Responding to commentator No. 37, who asked whether professional societies could come up with syllabi and standardized exams.Here it is …American Chemical Society Examinations Institutehttp://chemexams.chem.iastate.edu/

dschrader - June 22, 2010 at 4:15 pm

I have no doubt that grade inflation exists. I am even more certain that students now are required to do less work in their courses than were students in the 1960s, simply based on the number of pages that I was expected to read for a class and the number of pages my students expect to read for a class. I am, however, curious about the comparisons between average grades in the 1960s and average grades today. There are two issues that seem to me to skew the comparisons. First, during the Viet Nam war period there was strong pressure on male students to be enrolled “full time.” Hence dropping courses would have placed deferments at risk. Second, students now can drop course much later in the semester than they could forty or fifty years ago. Students now can frequently drop course very late in the semester if they think they will get a bad grade. In the 1960s and early 1970s registrars usually had much earlier deadlines for dropping grades, and hence bad grades that would have counted then don’t count now because the course are painlessly dropped. Is there any way of adjusting data for those factors?

joelkline - June 23, 2010 at 1:22 pm

I find these arguments and counter-arguments in this space interesting and productive. Despite limited interactivity, this message board really adds to the conversation.FWIW, I tried to summarize many of the questions an arguments presented here in a mindmap:http://www.slideshare.net/joelkline/grade-inflation-commentary-4586715Many of the “conversations” that occur on CHE boards are more valuable for providing perspective than certain conferences, seminars, and conventions.

myemail568 - June 23, 2010 at 2:34 pm

This article seems like a over-simplification of a complex issue. I don’t think student evals and grades are perfectly tied to each other… and I think students do less work in school due to competing demands for their time… internet, TV, work. Nice try though…

tyche - June 23, 2010 at 4:03 pm

Nowadays, student evaluations are a political rather than an academic tool and, unfortunately, they promote corruption and lack of integrity in academia. Using arguments of poor performance, Deans and Chairs at my state university use student evaluations to terminate those professors (lectures or tenure track) who they dislike. Complaining students represent more workload for those administrators, so the solution is to get rid of the professor based on strong arguments such as: “This is not an Ivy League!” “He is not helping our students.” “This professor does not fit.” “We want our students to succeed.” Success is a passing grade regardless of the quality and quantity of the work the student accomplished.This kind of university hardly uses those evaluations for discussion on how to address better teaching, how to address the lack of respect for the new generations of diverse faculty, or how to address the skills students lack as global citizens. If an unwanted professor has “bad” student evaluations, and she/he is not liked, he will lose his/her position, regardless of how good a professor she/he is. If she/he is wanted, then administrators will interpret “bad” evaluations in a more benign light. It depends on who the professor is, who the students are, who the administrators are, and what kind of university is. Only one comment mentioned the issues of ethnicity and linguistic racism that some students exhibit towards Asian faculty. We have not mentioned questions of gender, sexual orientation, age, religion, race, age or national origin.

tyche - June 23, 2010 at 4:14 pm

I agree with jvknapp and btuberville in that there is an economic dimension to this issue: budget issues, different economic times, and a consumerist model of education. I like btuberville definition that student evaluations are “Customer Satisfaction Surveys.” At least in my university they are.I also like the comment by citizenwhy in the sense that some “teaching” universities are not learning universities. Probably some of the self-claimed “Learning centered” universities emphasize this title because students center on learning how to best complain to push for grades they did not earn, while faculty centers in learning how to compromise their principles to keep their jobs. And unaccountable administrators have found one more perfect tool to sustain their kingdoms/queendoms of compliant professors who will lead unprepared students to the road of success and inflated grades for their inflated egos. What kind of citizens are we creating?

gadget - June 23, 2010 at 5:18 pm

I feel compelled to add another note. Over the years I have used student evaluations to improve my work in the classroom. I take the evaluations seriously. I am frustrated by the lack of student work, but I went to a public elite and now I teach at a community college. I forget all the students who didn’t do well at my alma mater: the partiers, the scofflaws, the ones who spent their time socializing, etc. My friends were people like me. So if I make comparisons, I must accept that memory is selective and there may not have been a golden age. After all, when I was an undergraduate, our older professors lamented that we were nothing like the serious, deicated, well behaved and respectful, students of the 1950s and 1960s!

gadget - June 23, 2010 at 5:19 pm

Correction:that we were nothing like the serious, dedicated, well behaved and respectful, students of the 1950s and 1960s!

juniper29 - June 23, 2010 at 9:11 pm

Commentator 48 also makes a good point. “student evaluations are political.” To this I would add that they certainly allow adminstrators, Deans and Chairs to shift responsiblity for learning to the individual instructor. The responsibility for learning, however, should surely be with everyone from the library, to the bookstore, to the admissions office, to the planning of programs, to the physical state of the classroom, to scheduling and even to the quality of the other students in the class.Smaller classes, for example, are often evaluated much more favorably than larger ones. Yet the instructor doesn’t normally have choice in the size of the class. I’ve yet to see a student evaluation that takes into account the broader learning environment (e.g. “the Chemistry department offered a comprehensive set of courses,” the “the class size was optimal for learning,” “the other students in the class made useful contributions” “the classroom was clean and all the audio visual equipment worked well” etc.It would be interesting to see if university administrators would still be as enthusiastic about student evaluations if, indeed, they were the ones being evaluated.

crankycat - June 24, 2010 at 5:34 am

You want to really get scared? Some of the same “customer service” mentality occurs here at a midwestern MEDICAL SCHOOL. And you can’t believe some of the whining we see on course evaluations. Who knew med school was “hard”?

ellenhunt - June 28, 2010 at 2:46 pm

Based on teaching medical students, I am quite frightened of what we are creating in medicine. I know that many of the students are cheating their way through medicine and this is becoming a kind of norm, mostly ignored so that it won’t become a blight on the escutcheon of the med school. Far too many medical students are in it because they consider it a license to make lots of money. And since the great secret of quack medicine is that most of the time you can do virtually anything and the patient will survive, our “cheating doctors” do just fine. In other words, I think we are churning out a generation of quack doctors (or a generation with a huge percentage of quacks).

joechill - June 28, 2010 at 3:11 pm

The real problem with student evaluations is that administrators use them as nearly the sole means of evaluating their faculty. If administrators wanted to improve teaching and instruction, they would facilitate faculty mentorship, collaboration, and peer observations. It’s always useful to gauge student opinion of a course, but they should not be the only voice. The administrators are the truly lazy ones in this equation.

hnturnbow - June 28, 2010 at 4:21 pm

I assume some of the “blame” for lack of student motivation, dropping standards, etc, must be placed on high schools. I am a fairly new adjunct instructor teaching at various colleges, and and am continually amazed by the general lack of competency I am faced with. Why were these students allowed to graduate from high school when they cannot even write a coherent sentence, much less an actual paper? An alarming number of 18-21 year-olds seem to be completely unfamiliar with the very concept of “being a student” – they don’t take notes, don’t read (or sometimes even purchase) the textbook, have no idea how to do simple research without plagiarizing from the internet…yet they fully expect to pass the class just by showing up! I can only assume that they developed these habits in high school, and “did fine,” i.e. they got through in 4 years, and now they are bringing that mediocrity to the university level. As an art historian, I have no training in teaching 9th-grade English, but that is what I end up having to use precious class time for, if I don’t want to read 35 “F” papers. What is going on????

echomikeromeo - June 28, 2010 at 4:26 pm

Re: citizenwhy’s comment (no. 42) on elite colleges:I attend an elite college where seniors are required to write a thesis. Most of them are b.s., written at the last minute (some overnight) with little evidence of original thinking or research. Professors have multiple thesis students to advise on top of their own research, graduate students, and undergrad and grad teaching; students would probably rather be playing sports or doing extracurricular activities or hanging out or drinking. I say all this with the knowledge that my own thesis will probably be crap, too; an undergraduate thesis requirement is by no means an indication of the students’ ability to *write* theses. Given that over half the theses at my school receive A-range grades, it’s pretty easy to tell that we’re just getting rewarded for quantity (80-page minimum in some departments), not quality.Also, while grades are inflated everywhere, our grades are higher and more inflated than those at most public universities. I don’t think the students of elite colleges (myself included) reflect much except the extreme privilege that got us there in the first place, and that now ensures that we get generous need-based aid and so don’t have to work 20 or 30 or more hours a week like some of my friends at public universities do. I’ll say one thing, though: our professors know that we exist. I hear stories from my friends at large publics who say that they’ve had maybe one instructor, if that, who knows their name, much less knows them well enough to write a letter of recommendation, or to confide in/ask for advice. I wonder if some of those low evals could be due to the fact that the system, *as well as* the attitude of the Youth of Today, encourages students to feel as alienated from and dehumanized by their higher ed experience as possible. If students feel as if college is a product, and they relate to their professors’ lectures like TV programs, I wonder if it might be because the system that they are in does not encourage them to think that getting to know their professors is a possibility–even if, among their hundreds of students, their professors even had time to say hi. If the quality of our work, our ambition, or our effort does not set my classmates and I apart at our elite college, what does is that I am not only encouraged to go to my professors’ office hours and talk about both my academic work and my life (I’m considering grad school), I’m *expected* to in order to get that thesis written.I used to believe all this grade inflation stuff was all of us students’ fault for not working hard enough. But I am increasingly coming to believe that it is the fault of the corporatization and depersonalization of the higher education system that screws over not just contingent faculty, but also the students who don’t have the opportunity to go to an elite college, and perpetuates the gap between those who can and those who can’t.

maggie2b - June 29, 2010 at 9:46 am

Exactly so! So happy to see the situation laid out so efficiently and convincingly.

maggie2b - June 29, 2010 at 9:47 am

Just to clarify–it is Vedder’s essay itself I am affirming.

slenjules - June 30, 2010 at 2:01 pm

Dr Chakravarty (comment #1),You have absolutely assessed the situation correctly, in my opinion. I find it interesting that no one else has directly followed your line of thinking here. Research is important to higher education but not more so than teaching.