When higher-ed administrators, trustees, accreditors, foundation officers, and the news media talk about assessing student learning, two voices are often conspicuously missing.
One is the voice of students themselves. (That’s not our topic today.)
The other is scholarly societies. The disciplinary associations in biology, political science, and history—to take just three examples—have well-established, large-scale programs aimed at assessing and improving the quality of instruction in their fields. Most disciplinary groups also publish journals dedicated to teaching and learning.
Not all of those discipline-level projects are great. Some are much better than others. The point here is simply that the projects exist, and that they reach thousands of faculty members every year. But they’re often weirdly ignored in national conversations about college quality.
Take, for example, the white paper on regional accreditors that we described here yesterday.
That paper ends with this statement: “While the accreditors may be major drivers for assessment, it would be far better for institutions themselves, as part of their cultures, to drive student-learning-outcomes assessment—to create a space for quality improvement independent of the pressures for accountability.”
Many faculty members would read that passage and raise their hands and say, “None of the above, please.” They don’t trust accreditation-driven assessment programs because they’re afraid that such projects would involve standardized tests and/or jargon-filled departmental reports that have little to do with what they’re actually trying to teach. And the idea of a local, college-level “culture of quality improvement” doesn’t sound much more appetizing.
But many of those same faculty members do trust their own disciplinary associations. A chemistry professor who cringes when her provost wheels in a quality-improvement consultant might be perfectly happy to spend hours talking with other chemistry instructors around the country about how to redesign labs and lectures.
That kind of discipline-level trust plays a role in this week’s Chronicle article about two departments’ efforts to improve the assessment of student learning.
The two projects—at Villanova’s college of engineering and Swarthmore’s classics department—aren’t so extraordinary in and of themselves. They’re part of the normal background hum of instructional change that goes on almost everywhere. But they’re interesting because, in both cases, they’ve been driven by national disciplinary conversations about how to understand and assess student learning. Neither department has acted because a regional accreditor or provost is breathing down its neck. (In this space tomorrow, we’ll look at the new Villanova engineering program in more detail.)
So should disciplinary associations play a bigger role in guaranteeing the quality of college instruction? Something like that already happens in engineering, where the specialized accrediting body known as ABET (whose annual meeting gets under way today in Baltimore) assesses departments using learning-outcome criteria that are developed by national committees of scholars and practicing engineers.
But in the humanities and social sciences there is (for perfectly legitimate reasons) much less consensus about what students should learn. It’s hard to imagine the Modern Language Association’s coming up with a learning-outcome list that is anywhere near as concrete and prescriptive as ABET’s lists. We aren’t likely to see ABET-style specialized accreditation in most undergraduate fields.
Even without full-blown specialized accreditation, however, the disciplinary associations could surely play a larger role in the national debate about student learning. One venue where that might happen is the Lumina Foundation for Education’s Tuning USA project, which has brought together faculty members from diverse institutions to construct basic lists of what students in particular fields should be expected to learn. The Tuning project is now almost two years old, and next month The Chronicle will take a look at its progress.


Experts explore the quality and assessment of higher education.
5 Responses to In Student-Learning Debate, Some Forgotten Voices
ellenschrecker - October 28, 2010 at 5:21 pm
It’s about time — to hear some faculty voices in this discussion. Who else but faculty members know what students should be learning in their particular fields? After all, we are the folks in the classroom trenches who actually understand how the students are (or are not) learning. I’m glad to see that the CHE is finally waking up to the realization that it’s mighty hard to improve higher education (or even to maintain its standards) without bringing the faculty on board.
dboyles - October 28, 2010 at 6:01 pm
Perhaps the real story is not that disciplinary discussions have been left out, but that they may have actually served as unacknowledged models for some accreditors if not the assessment movement. The American Chemical Society has long had standardized examinations that a professor may opt to give for final examinations to assess percentile rankings of various chemistry classes against national norms. Similarly the American Chemical Society has not only research journals but the Journal of Chemical Education published since 1924. The ACS additionally approves chemistry programs and authorizes ACS certification of chemistry graduates from those programs. For all that if not because of all that, I must indicate that in my experience chemistry faculty, particularly at the level of freshman chemistry, are not infrequently under pressure by local administrations and staff (as are some freshman mathematics and physics faculty) and become institutional scapegoats for issues surrounding student retention. Chemistry student opinion surveys of faculty are generally recognized to be at odds with those other faculty scores on the same campus (see the Kansas State IDEA Technical Report Number 13, “Disciplinary Differences in Student Ratings,” http://www.theideacenter.org/sites/default/files/techreport-13_0.pdf ). Holding to standards has its price in many more ways than merely creating educated students, and is often an uphill battle all the way around. I know many chemistry professors who have either left their institutions or the teaching profession altogether. The problem seems greater in smaller programs; larger programs fortunately provide greater support by number of chemistry faculty who may collectively assert themselves against onslaughts against their subject matter and teaching methods.
For ACS program approval guidelines see http://portal.acs.org/portal/fileFetch/C/WPCP_008491/pdf/WPCP_008491.pdf
dboyles - October 28, 2010 at 6:19 pm
Followup verbatim from “Disciplinary Difference in Student Ratings”–
“Chemistry teachers were rated well-below average on all five of the teaching approaches assessed by the IDEA student rating form; the learning atmosphere, as assessed by the IDEA items describing teaching methods, had few of the attributes normally associated with effective instruction.
The teaching challenge in chemistry appears to be a considerable one. On average, students were poorly motivated to take the class (J) and found chemistry classes to be more difficult than those in any other discipline (H). These findings, coupled with an average amount of reading (F) and well-above average amount of other work (G) may account for the high effort put forth in these classes (I).
Global ratings (L, M, N) were all well below average. These disappointing outcomes probably reflect a combination of factors – a non-facilitative learning environment, poorly motivated students, and a difficult, academically challenging discipline.”
Remarkable, indeed, that the faculty and their courses of one of the most successful contributors to modern society in terms of economics (eg.,manufacturing and overall GDP) stand out from the crowd. Are the faculties really THAT bad nationwide? Highly doubtful. Perhaps the vagaries of student opinion against the even-keel gold standard of admittedly content-rich and irrefutable facts inherent to chemistry education held over the decades have something to tell those of us within higher education that is symptomatic of the magnitude of the decline in authority and leadership in the classroom to which all-too-many disciplines, their faculties, administrations, and staff merely contribute.
sibyl - October 29, 2010 at 3:07 pm
@ellenschrecker
I agree that faculty must be the deciders. What I find mystifying is why faculty didn’t initiate this kind of response sooner. Why didn’t faculty say to regional accreditors, “We’re following ACS or ABET guidelines for assessing learning; we think those are good enough, and we dare you to say otherwise.” Instead faculty hoped assessment would go away — rather than acknowledging that it’s part of their disciplinary practices, and using that to deflect the worst excesses of the movement. I am not smart enough to know whether such a strategy would have been more effective than resistance, but I wonder.
wlgoffe - October 29, 2010 at 4:10 pm
I believe that you left out the discipline that has done the most of any discipline to better learn how their students learn (or don’t) and then, as a result, improve instruction. That discipline is physics. Here’s some elements:
– Numerous assessments to assess student learning in a wide
variety of courses:
http://www.ncsu.edu/per/TestInfo.html
– papers with 1,000 citations on student learning and how
to teach better: http://se.cersp.com/yjzy/UploadFiles_5449/200607/20060705142003187.pdf
and http://web.mit.edu/rsi/www/2005/misc/minipaper/papers/Hake.pdf
– leaders from leading universities deeply involved in physics
education research: http://www.laspau.harvard.edu/idia/mecesup/readings/Eric_Mazur/Mazur_52364.pdf , http://vodpod.com/watch/2777267-confessions-of-a-converted-lecturer-eric-mazur and http://www.cwsei.ubc.ca/resources/files/Wieman-Change_Sept-Oct_2007.pdf (the author of the 1st two is a chaired professor at Harvard; the author of the last one is a Nobel Laureate and is current deputy science adviser to the President).
A great place to start one’s investigation of this work is http://www.compadre.org/per/ .