• Monday, May 28, 2012

Previous

Next

Cronon’s Whirlwind

March 30, 2011, 10:24 am

Last week Stephan Thompson, deputy executive director of the Wisconsin Republican Party, filed an Open Records Law request asking the University of Wisconsin to turn over copies of e-mails from William J. Cronon, a tenured professor of environmental history. The request appears to have been prompted by Professor Cronon’s political activism. On March 15, Cronon published a long blog post titled “Who’s Really Behind Recent Republican Legislation in Wisconsin and Elsewhere? (Hint: It Didn’t Start Here).”

And on March 21 he published “Wisconsin’s Radical Break” as an op-ed in The New York Times. Both the blog post and the op-ed criticized Wisconsin governor Scott Walker and conservatives in general. The response from the Wisconsin Republican Party has been widely interpreted as a political reprisal, and I see no reason to disagree. Peter Schmidt’s account in the Chronicle aptly summarizes this dimension of the matter.

The request to see some of Cronon’s e-mail, however, has also been decried by the American Association of University Professors and the American Historical Association, for which Cronon is president-elect. The AAUP, writing to University of Wisconsin chancellor Carolyn A. (“Biddy”) Martin, agreed with Cronon that this is “an obvious assault on academic freedom.” The AHA calls “on public-spirited individuals and organizations to join us in denouncing this assault on academic freedom.”

This claim about the danger to Cronon’s academic freedom strikes me as more doubtful. His ability to engage in research in his field and teach within the area of his expertise would not in any obvious way be impaired by the university turning over any e-mails he may have written on the handful of subjects covered by the Open Records Law request (Republican, Scott Walker, recall, collective bargaining, AFSCME, WEAC, rally, union, Alberta Darling, Randy Hopper, Dan Kapanke, Rob Cowles, Scott Fitzgerald, Sheila Harsdorf, Luther Olsen, Glenn Grothman, Mary Lazich, Jeff Fitzgerald, Marty Beil, or Mary Bell). To be clear, the request applies only to Cronon’s university e-mail, and is based on the premise that he may, as a state employee, have misused his access to public resources.

Petty? Yes, the Wisconsin Republican Party might have been better advised not to strain after so small a victory, but poor political calculation is not the same thing as violating academic freedom.

The larger context here is that Professor Cronon took a partisan political stand—as he is entitled to do as a citizen. But that entitlement does not extend to his using the perquisites of his position as a state employee to advance his political interests. Politicians and public officials routinely face indictments and dismissals for more extreme forms of such conduct and academic freedom can be no legitimate shield from equal enforcement of the law. Faculty members at public universities are as subject to that law as tax-collectors, justices of the peace, policemen and firemen.

I don’t know of any evidence that Professor Cronon did in fact violate any laws. It may be that the Wisconsin Republican Party is simply fishing. If so, its action is further unwelcome, not as a violation of academic freedom, but as a demonstration of small-mindedness. The better way for the Wisconsin Republican Party to answer a critic is by answering his arguments on their merits.

If Professor Cronon were in jeopardy of losing his job for what he wrote on his personal blog or published in the Times, I would agree with the AAUP and the AHA. Academic freedom in that case would be at risk. He faces no such risk. Separating the ostensible motive of the Wisconsin Republican Party (i.e. political reprisal for his public writings) from its chosen tactic (the Open Records Law request) may seem a fine distinction, but it is a necessary one. It’s necessary because the doctrine of academic freedom will lose legitimacy if it is allowed to become an excuse for breaking the law.

The Cronon affair has prompted widespread commentary, including articles by Paul Krugman, Jonathan Tobin, KC Johnson, and Mitchell Langbert, and an editorial in the Times. Some of this is hyperventilating. Krugman, for example, compares the e-mail request to “the ongoing smear campaign against climate science,” and asserts that there is a “clear chilling effect when scholars know that they may face witch hunts whenever they say things the G.O.P. doesn’t like.”

What’s needed is some level-headedness and clarity about what academic freedom can and cannot protect. Unfortunately higher education’s traditional watchdog for academic freedom, the AAUP, has recently mislaid its once sturdy understanding of this key concept. The AAUP’s recent pronouncements on academic freedom have served mainly as a rationale for further left-wing-inspired politicization of the university. As a result it is unable to offer trustworthy guidance in a case where a university has been served with a legitimate legal request.

I regret that Stephan Thompson filed this request, but Professor Cronon’s umbrage, the AAUP’s ire, the AHA’s distress, and Krugman’s shivers distract from the real point. Professors who sow the political wind reap the political whirlwind.

This entry was posted in Uncategorized and tagged , , , , , , , , , , . Bookmark the permalink.

  • Print
  • Comment
  • pak152

    “It may be that the Wisconsin Republican Party is simply fishing. If so, its action is further unwelcome, not as a violation of academic freedom, but as a demonstration of small-mindedness”

    just as small minded as the newspaper in Alaska that used FOIA request to prove that Sarah Palin has not been a life-long fisher or hunter
    http://www.theawl.com/2011/03/sarah-palins-history-lifelong-unlicensed-hunter-and-fisher

    I would be much more concerned about what has taken place in the current administration regarding the review of FOI requests
    http://bit.ly/g7fIqs

  • electronicmuse

    Profs should maintain a “gmail” or other private email account, where ostensibly, trumped-up justifications for intrusions into private lives cannot be justified on such flimsy grounds. Of course, this apparent necessity reduces the community shared via campus email threads, but that’s the price we evidently must pay as our country tilts more and more toward facism.

    Home of the Brave, and Land of the Free (until you exercise that freedom!) “Academic” freedom isn’t the issue here, it’s freedom in general. In theory, email should be as inviolate as snail-mail, but “oops,” the so-called “Patriot” Act allows un-constrained political access to that too, doesn’t it?

    “Reaping what you sow” in this case is a thoroughly bankrupt notion that should be tattered by a loud chorus of condemnation from the academic community.

  • whitakal

    Peter, amid the blogging bloviation and hypertext hyperventilation that a portion of the professoriate revels in, perhaps a return to the challenge of the duel would have a salutary effect? Emails are so effete.

  • patrick_murtha

    The first practical takeaway here is that no sensible academic of whatever political persuasion will ever again use their university email account for any but the most narrow of official purposes. Next, they will not even use a university-provided computer to access their private email accounts, as that could at some point be held against them, and of course the websites they visit can be monitored on the university’s network. Some professors will decide to not even use their offices, which could easily be wiretapped. Who is to say that classroom sessions won’t all be captured on camera and reviewed for objectionable content? Indeed, I have heard that this is already happening in some places.

    Elsewhere in the Chronicle this week, there has been talk of professors getting chummy with students through postings on Facebook and Twitter that contain personal as well as academic information. You can be sure that all this stuff will be monitored, too, and since it is being used for communications between professors and students that can scarcely be considered outside the university’s “business,” the fact of its being on private accounts will probably not ultimately protect any of it. The professors who try to engage students through social media may be cutting-edge, but they are also opening themselves to all sorts of problems, and I think that their activities of this kind, though well-intentioned, are inadvisable. Professors should have internalized the concept by now that any but the most narrow of class-related contact with students, even graduate students, is a bad idea for one’s professional health. And Lord knows that people all over the professional map are being fired (or not hired) because of Facebook and Twitter postings.

    The only protection, and even it may not be enough, is to present as blank a face to the world as possible. To the extent that your personality and opinions are “content,” someone will surely object to that content.

    Well, it’s all a triumph of something, I guess, although not of any academics or broader society that I want to be a part of.

  • softshellcrab

    Good article, and quite fair.

    The Executive Director of the Wisconsin Republicans is a partisan political person. So what? There’s nothing wrong with that. And of course he seeks the emails for political purposes, that’s the type of thing that heads of state party organizations do. Ths isn’t the government doing it.

    Before liberal Democrat academicians cry about this, remember it was liberal Democrats who led the way post-Watergate in the 70′s and 80′s to ram through the FOIA and other open records laws, to allow their heros in the media and liberal watchdog groups to demand information to shed light on things they wanted to see investigated. Hey, it cuts both ways. Didn’t you realize it could equally be used by those who disagree with you?

    I don’t like vindictive stuff either, and this FOIA request smacks of it. I don’t see anything wrong with Prof. Cronon posting his views (views that I strongly disagree with), even if he did it using university email. Really, so what? But stuff like this is what political operatives do. Look at the guy who camped out next to Sarah Palin’s house, or the guy who made the fake call to Governor Walker,or the heckling of conservatives who come to speak on campuses. I really think the liberals to my mind tend to be more vindictive. But that aside, this seems vindictive and silly, but the kind of thing that political operatives on both sides do. I don’t like it, but it was Democrats and liberal activists who pushed for these open records laws and they can hardly complain now.

  • jamesebryan

    Often I find myself thinking a bit differently than Dr. Wood, but I have to admit that here I have to agree with most of his argument. I have not read the pro-Cronon writings he cites, and so cannot address his interpretation of them, but I think he is quite accurate in his general thesis. As to Patrick Murtha’s concerns, I think an instructor would be on much stronger ground to defend his or her outside-the-classroom-personal contact with students as a matter of civil liberties than his or her use of public resources for political purposes as a matter of civil liberties, because the former pertains more to their freedom as a citizen and the latter pertains more to their responsibilities as a public servant. The problem with slippery-slope arguments is that any regulation of activity can conceivably be taken to extremes, but avoiding that through no regulation at all leads to anarchy. I don’t know how many instances there have been of public university professors acting as direct political operatives while on the job, but there have certainly been plenty of other public employees caught using the people’s resources to pursue inappropriate partisan goals, so we do need regulation of some sort in this area.

  • olmsted

    Well said.

  • emwhitephd

    It is curious that Wood and the comments all assume that Cronon is partisan, some kind of wild liberal. But if you read the documents, you see how careful he is to point out that he is pursuing information as a historian, that he is not a partisan politician. The very quest for and publication of information has thus, typically, become some kind of lefty trick to the far right, an attack on conservative values, to those pursuing that agenda, and hence is appropriately to be punished by loyal Republicans. It calls up the statement by (probably) Karl Rove that his party in effect creates reality, without regard to so-called facts. If that is not an attack on academic freedom, it is hard to imagine a more dangerous one.

  • nacrandell

    There is a difference between using the FOIA to research and investigate, and if it is used to intimidate and harass. And, it is easy to copy and paste inaccurate information on numerous sites. It’s a bit more difficult however, to objectively analyze, understand and present an argument.

    As to the suggestion that the “liberal Democrats who led the way post-Watergate in the 70′s and 80′s to ram through the FOIA and other open records laws, to allow their heroes in the media and liberal watchdog groups to demand information to shed light on things they wanted to see investigated…”
    1) The United States the Freedom of Information Act was signed into law by President Lyndon B. Johnson on July 4, 1966 and a young Congressman from Illinois endorsed it. His name was Donald Rumsfeld.
    2) In the 80′s, I seem to remember a Republican president, House and Senate being in the majority.
    3) Rush Limbaugh has been spewing ‘liberal media’ for 30 years, yet the media is a business. During McCarthy’s tirade in the 50′s there was fear of CBS losing business if ‘See It Now’ confronted his indecent actions.

    The professor may have used his university computer and email, or used his university email account through his computer to actively promote his political ideals. He may have used one of the above and simply mentioned a current political action and his views. He may have responded to an email sent to his university account. He me not have used the computer and email account at all. The questions is whose motives are hidden:
    1) Did the professor secretly use university property to advance his political agenda?, and/or
    2) Are the FOI request secretly being used to silence opposing views?

    If his use of university property is found to be a misuse of government property, he likely will be asked to resign or fired, but what happens if his use of university property is found to be within the normal bounds of use?

  • machimon

    Pretty disgusting. I blogged about the effort to intimidate Cronon, and indeed, all academics who comment on important issues of the day.
    http://machimon.wordpress.com/2011/03/28/cronon-the-odd-case-of-historian-bashing/

  • mnscu01

    Coach Summit’s commitment, courage and determination will assist in overcoming the onset of this condition.  She has demonstrated all of these over the years and is sure to continue to do so.  Once again, Summit will be a model for others, especially women in the profession.

  • http://www.facebook.com/people/Lee-Holler/100000408403438 Lee Holler

    You have done so much for women and for basketball.  God Bless-

  • thenomad

    It seems to me that international student mobility isn’t nessesarily slowing but that the patterns of where they go may be shifting.  While the UK, for example, may see a slowing of international students due to visa restrictions, they may also see a slowing due to increased tuition, and I’d be interested to learn if there are any implications for UK nationals who may be less likely to now attend post-secondary institutions due to the rising costs as well.

    As a staff member in the international student recruitment unit of my university in Canada, we definitely hear the argument that international students are taking up spaces in classes that would otherwise be reserved for Canadian students.  The only support for this argument is a statistical one, in that our entrance averages are based on a combination of the number of spaces available, the average scores achieved by all applicants to a program in the previous year, and the normal uptake of admissions offers.  The distribution of GPAs, not surprisingly, waivers very little from year to year, perhaps a percentage point or two one way or the other at most.  International student applications have the ability, certainly, to skew the averages higher if one can assume that the majority of such applicants are high achievers, but the more likely case, statistically speaking, is that the higher the volume of applications, the more normalised a distribution becomes, not necessarily skewed.  As a result, any student who meets our minimum average is guaranteed to get in, regardless of that student being Canadian or international, and as 22280998 states, international students are often more likely to study in programs that local students tend not to.  I’ve never heard of a case at our university, which has no international or domestic student quotas, where a Canadian student lost a spot because an international student got it.  The only reason any student loses a spot is that they don’t meet the minimum requirement.

    In addition, our labour market will continue to require us to attract international students because as a nation with stagnant birth rates and increasing ages of others, we continue to experience labour shortages in all types of fields, from professional to labour positions, and as long as there are people who continue to want to immigrate here, I can’t forsee any change in Canada receiving international students, regardless of any protests Canadians may have.

  • kohai

    Making international students pay the full cost of their undergraduate tuition at a publicly funded institution, emphasizing undergraduate, is a no brainer. At the graduate level it gets a little more muddled I think.

  • http://www.facebook.com/nikiv2012 Niki Velazquez

    I found this commentary interesting and i am just beginning to learn about international education.   What types of degrees are being sought by international students? Are they being accepted into program/majors in which nationals are unable to meet the requirements and this is why so many international students are taking their “space”?
    Niki

  • burger1376

    You are flat out wrong, and your argument smells of liberal propaganda.  

    International students don’t flood areas that would otherwise not have been filled.  The problem is that most qualifications for international students are far lower than that of American students.  It is far more difficult for an American to get into an MIT engineering program than a Chinese student.  Examples: the American needs high scores, high test scores, work experience, volunteer experience, sports, art, etc, etc.  The Chinese student needs a test score.  Not an English test score, but a math test score.  If that was all that was required of American student, Americans could compete more.  All they would have to do is copy Chinese students and sit in their rooms studying maths for a decade or more.  

    On top of this, because international students flood these programs, the result is that Americans don’t want to do them.  It is a stereotype that Indians and Chinese will outperform Americans when that is simply not true and there are no real measurements to prove it.  So, Americans, with these biased perceptions, decide on other fields.  Lets not forget that some other fields like finance, life sciences, social sciences, and economics also use a lot of maths.  American students can easily outperform in these areas.  Assuming they don’t perform well in engineering or hard sciences is just naive and ignorant.  

    As well, international students flooding these programs actually downgrade the jobs that result from studying in these programs.  When US companies are more interested in hiring an Indian or Chinese because of the perception that they are “better”, why would a white American go into a career where their skin color would go against them.  

    Lets not forget that most international students are accepted simply because they have money and they bring “diversity” to US universities.  

    As for the article’s assumption that there is “hostility” towards international students in the US, that is just ridiculous.  The hostility comes from Americans Universities and so-called scholars who continuously attack Americans in education.  Americans are far more qualified than most people in any other country in the world.  The attacks on us are causing a backlash.  But the hostilities didn’t start with us.  It started with the discriminatory US higher education system that hates Americans.  

  • burger1376

    As an opponent to the current acceptance levels of international students, I have some issue with your comment.  Most of us who oppose the current situation, especially in the USA, don’t mind international students paying the same as national students.  We don’t even mind if they get scholarships (although some might argue against me on that). What we are tired of is international students getting places in top US universities when they are hardly qualified.  Like I said in another post above, an Americans student needs high test scores, high class scores, work experience, volunteer experience, sports, art, music, etc.  International students, for the most part, just need to be international, have a different skin color, or a simple test score.  Most international students in the US are less qualified than American students, but the liberal argument for diversity leads to discrimination against Americans.  

  • kohai

    International students parents did not pay any taxes that support publically funded institutions so therefore they should pay the full cost of their tuition.
    As for those complain that they are taking up spaces from more qualified domestic candidates, which I really wasn’t commenting on at all, why don’t those same institutions apply the same standards to foreign sudents and charge them the full cost of tuition.  Sounds like the solution to the unqualified student problem.  But remember, money talks.

  • repphd

    I am a marketing person so perhaps I might look at this a bit differently.

    1.  OK Tom good title and good introduction  you got us hooked, my guess is you will get lots of comments.  I don’t  know if you actually took Marketing 101 in college, but you are practicing it.
    2.  As a marketer with a psychological bent I look at this whole issue of replication from an external validity perspective.  One of the problems we have in our field and others in the social sciences I try to read is it is difficult to get replications published.  I have done some scaling work in my career and have learned, sometimes with pain, the value of checking out the external validity of a scale based on multiple uses before I try and borrow it for my use.  While we can often find mutliple uses of a scale and the reports on how it works, we see less opportunities for replication of basic internal validity findings of specific construct relationships.  Replications only occur when we  add something to  the mix; straight replication seems to rarely be published.
    3.  So I applaud Dr. Nosek for  his creative way of approaching the replication problem, really thinking outside of the box.

  • willismg

    Despite the tone of the article, this is an excellent area for study, and not only for psychology.  There are many areas of engineering and even physics where papers are being published based on the “predictions” of essentially unverified, and highly tunable, computer models that could do with a look-see.  

    The argument about psychology possibly being harmed as a reason to desist is pretty humorous.  Oh wait, they *really* feel that way in Psychology departments?

    One final piece of snark, which I don’t really mean as snark.  Psychology may indeed be a valid field of study.  But I would stop short of calling it “science”.  I would also go as far as to say that maybe part of the problem is that in their zeal to be labeled as a science, psychologists may be using techniques that are valid for investigating the physical world but that are inappropriate for assessing the state of something as variable as people’s feelings or reactions to stimuli. 

    In the physical world, the implicit assumption is that if you do the same thing, the same result should occur.  And this should be true whether you do it, or anybody else does it, 1 time, or 1000000 times. I don’t know about the rest of you, but I can react differently to the same stimulus between morning and afternoon.

  • pflady

    If this undertaking involved any vertebrates other than humans, it would probably wouldn’t be allowed by institutional animal care and use committees.  It would be deemed a waste of animal subjects.  Too bad.

  • http://www.facebook.com/profile.php?id=1940380 Stephanie Seiler

    How is a field that uses the scientific method not science?

  • willismg

    Using the scientific method doesn’t make something science.  Using the scientific method is only appropriate if the thing you’re studying has aspects that can be uncovered by using the scientific method.  If the thing you’re studying isn’t consistent with the underlying presumptions of the use of the scientific method, then the scientific method is not something that should be applied.  And any results obtained thereby are suspect.

    This all sounds more confusing than it is in my head…(maybe I need a psychologist..)  One way of thinking about it is that the scientific method assumes that there is no “memory” of past activities when an experiment is performed on an object.  If I do the same thing, under the same conditions to the same object, I should get the same result.  Or if I do the same thing under the same conditions to an exact duplicate of the original object, I should get the same result.  I would say that this disqualifies its use on any object with consciousness since you can never regain the same conditions on an object, nor can you have exact duplicates of two objects with consciousness.

  • fdhorowitz

    Many years ago, when Boyd McCandless was appointed editor of the then new APA journal, Developmental Psychology, and invited me to join its editorial board, I suggested that one of the criteria for accepting a research article should be whether or not the author(s) had replicated the results in a second study.  It was deemed impractical. Nevertheless,I have always thought that some evidence of the replication of results prior to publication would have advanced our science considerably.  Frances Degen Horowitz

  • http://adrianoesch.wordpress.com/ adrianoesch

    not if it takes 20 attempts (studies) until you get a positiv and then this one gets published.

  • kenneymp

    This song will now be stuck in my mind all day! ;-0)

  • http://adrianoesch.wordpress.com/ adrianoesch

    as bghansel already pointed out, the problem is not the methods, the topic, the researchers or whatever. the real problem in my view is that we still rely uniquely on gatekeepers to publish. the real bias is coming from the journals publishing only a percentage of all the studies. its not appropriate. why isnt it already common to publish first to something like arxiv.org befor you submit your paper at a journal? journals shoulnt be GATEKEEPER but CURATORS!

  • easydoesit

    @willismg: Even in the “hard” sciences (physics, chemistry, etc.) there is no expectation that the results will be the same each time. That’s why those fields use models that *estimate* the true value and that also provide various indices of error in the estimate (standard errors). Granted, their estimates are more precise and farther along as a science than in psychology, but that doesn’t make the use of the scientific method by psychologists any less scientific. Science is a process not an outcome.

  • eelalien

    In my field (education), I have typically found that conducting longitudinal studies is the preferred method of gathering data and validating results for research when seeking publication. When the social sciences are involved, single studies are often simply snapshots of a particular set of characteristics for a specific group at that time. If results differ with changing group composition over 3-5 years, it provides a much broader data base from which to extract results, and derive appropriate conclusions.

  • willismg

     For Mr. Doesit,  Yes there is scatter around some expected value in physical experiments, but if one is sufficiently careful, one can minimize this and see clear answers.  In psychology, one is in fact measuring reactions of a conscious entity which alters itself with each application of the experiment.  Indeed, depending on how perverse or puckish one is feeling on any given day, or depending on whether or not it’s raining outside, the same person can be in a different mood and react differently.  The billiard ball has no such ability to change the outcome of any experiment performed upon it.  Science is indeed about the process but if one wants to apply a process, one should ensure that the process, with all its built-in limitations, is able to achieve what is desired.

    In my view, the scientific process has no hope of teasing out whatever it is that makes us do the things we do when somebody prods us.  The fact that I can exercise control over my own conscious entity (my brain) means that the underlying assumptions of the scientific method have been violated.

    Again, I’m not saying that psychology isn’t worthy of study.  I’m merely saying that the application of an inappropriate process in that study might be part of the problem with any lack of reproducibility in the field.  If only they weren’t so damned insecure about the nature of their field, maybe somebody could figure out a more appropriate process for psychology than the scientific method.

  • morrisville

     This is precisely the reason why psychology departments are self-conscious: we’re dismissed as “not a science” by people who don’t understand how psychological experiments are conducted. Most studies are replicated on new samples of respondents, for example. Personally, I applaud the replication project. If the results don’t stand up to solid replication, that’s important information. Had psychology been the first field to be selected by a team of non-psychologists, however, I would have been suspicious of motivations. Let’s also see this expanded to other fields!

  • easydoesit

    Tom: Would you please elaborate on the basis for your assertion: “If it turns out that a sizable percentage (a quarter? half?) of the results published in these three top psychology journals can’t be replicated, it’s not going to reflect well on the field or on the researchers whose papers didn’t pass the test. 

    Your prediction about the *perception* of nonreplicated studies may be true, but do you think that perception would be well founded when there are a variety of valid reasons for nonreplication to occur?

  • refranck

    A most interesting article, and also interesting comments.  I’d like to pick up some threads in the comments by tdr75, bghansel, adrianoesch, and fdhorowitz.
     
    Seems the incentives are obvious.  To get tenure, one must get published.  To get published, one must have positive results — despite the persuasive case for negative results also being valuable.

    Hence, there is a clear motivation to make the subjects behave in the manner desired by the one running the experiment (my paraphrase of a comment by B.F. Skinner).
     
    If the status quo is unsatisfactory, I’d offer the following modest proposal for improving it.  Universally adopt the following principle:  Reproducing others’ work “counts” (in some real sense) for promotion and tenure – with, of course, confirming results counting the same as negative results.
     
     

  • MajorRetard

    I agree. Medicine is not a science. Nor is so-called “neuroscience”, nor is quantum mechanics. 

  • jk_comments

     then they would unfortunately learn the wrong thing: alpha=0.05 means that if there is no true effect in a population (that means absolutely no effect) and given some information about variation, sampling error alone will create a significant effect with p=0.05 based on sample observations. As “exactly no effect inte population” is for most experiments a false assumption, p=0.05 does not refer to any real-world probability. For replications the situation is even worse: here you have to calculate the power of the study which you can only do if you know the true effect size. Conservative analyses suggest that many studies in psychology are heavily underpowered, though. You might well expect a higher proportion of non-replications based on power-problems alone, but you cannot calculate the probability.

  • bernardjsmith

    I think those who want to dismiss the social sciences including psychology as outside of  science are invoking an incredibly scientistic approach to the scientific method. In the hard sciences the objects of our inquiry are PERCEIVED as acting as if they themselves are not engaged in sense making but that is not always (ever?) the case in the social sciences. Not only are we sometimes engaged in ignoring and controlling the sense making activities of others, sometimes we actively dismiss the sense making activities of those we study and at other times in other fields and disciplines we work to try to understand the sense made by others. In my own field (sociology) some of us are even engaged in understanding our own sense making. In any event when we work with sense making subjects and when we treat ourselves as constructors of meaning and not simply as reporters and readers of texts written by nature we can still do science but our subjects are rich, intricate, and very complex.
    And those in the social sciences would seem to adopt incredibly scientistic approaches when they invoke the same kind of accounts (of literal causality and the like) as those in the hard sciences. It is the coroner who “causes” the suicide, the hospital committee that “creates” the medical error, the CDC that makes us “obese” – a very different way of thinking about “causality” than the ways that physicists and biologists think about causality.
     

  • rpm13

    I have never been a fan of exact replication because conceptual replication with extension adds more value for about the same effort. Science is cumulative and self-correcting in the normal course of events. Still it’s quite possible that standard research methods have become biased toward positive findings and I applaud the empirical approach and massive effort that I found at the Reproducibility Project website. My prediction is that we will end up with some reforms of standard practice which older social psychologists might find reminiscent of the Greenwald era at the Journal of Personality and Social Psychology. One concern is that too many areas of study (e.g., longitudinal studies, small group experiments) won’t pass the project’s feasibility test for replication.

  • http://twitter.com/muswellbrook muswellbrook

    pffft. This will just confirm that most psych studies are underpowered. Average beta of psychology studies is about 0.52. Thus, I expect they will replicate something less than 50% of the published works. No big deal if you understand stats. Nothing to see here that a careful meta-analysis of power in the same journals wouldn’t demonstrate (at most, the replication project will provide more reason to report effect sizes in studies, rather than only p-values).

    see this youtube for why replicability is not related to p, but beta! http://chronicle.com/blogs/percolator/is-psychology-about-to-come-undone/29045

  • arrive2__net

    Sciences that want to get it right have to be ready to be tested, or go bust. I say good idea, Nosek.

    I think a lot of people are assuming that there will be some major failure to replicate, but of course the results aren’t in yet. As Nosek suggested, a failure to replicate in this context could reflect a fault in the original research, or in the replication. 

    It appears that many of the replications may have to be done on a shoestring, and I wonder if that could affect the accuracy of the outcomes.

    Psychology is the human institution through which we try to understand the human mind and human behavior, and psychology is not afraid to ask the big questions here. It is a great thing for the field to establish a lack of fear of such challenges.     

    Bart Schuster
    OnlineGraduateSchool.tripod.com/All.htm
    Twitter.com/arrive2_net

  • masdev_seu

    What’s to say he won’t just fake his results just so he doesn’t make psychologists look bad. That’s probably his whole reason for doing this project. He’s just gonna make all the research he checks seem real on purpose.

  • Dan Kahan

    drjoes56– p = 0.05 does not imply 1 in 20 studies will fail to be replicated. In fact, it doesn’t imply anything about what the non-replication rate will be; for that you need a type 2 error standard, not a type 1 standard, which is what p < 0.05 is.

    Consider this simple point: If a study rejects the null hypothesis at p = 0.05, the likelihood that it will generate a result that rejects the null hypothesis at p = 0.05 when repeated is … 50%. What should happen only 1 time in 19 is a finding of null or nill (or whatever is considered null/nill as a practical matter; that's what you figure out when you develop a type 2 standard). The conservatism reflected in the covention of "p < 0.05" *contemplates* that there won't be replication or won't be anytime soon or soon enough to make it safe to invite someone to believe something unless one is really really sure. But once you have a "finding" that rejects the null at any specified level of significance, then anything that one finds thereafter that *isn't* null/nill *no matter what the p-value of that result is* is a corroboration of the original finding rejecting the null.

    My point isn't that there aren't a lot of published studies that reflect specious or spurious results. It's only that there will be lots of specious or spurious findings of "nonreplication" if people don't actually know what they are supposed to be looking for.

    I'm sure Nosek *does* know what to look for, & hope that he is able to make sure that those in the project do too,

  • http://www.facebook.com/vulcanchick Caitlin Data Parker

    As a psychology researcher, I cannot express how excited I am about this. We absolutely need this to be going on. 

    Hopefully, similar undertakings will occur for biomedical research, and folks will turn their eyes on the natural sciences as well – I know from experience that they share this problem with us, though fortunately it seems it is not to the same degree. 

    We have a responsibility as scientists to hold ourselves and our colleagues to a far higher standard than we have.

  • drmhp

    Are we not concerned about the quality of the replications? I am familiar with the content of these journals – some of the studies undoubtedly feature unique samples and experimental/applied settings that would take considerable time to effectively replicate. The author of this post isn’t clear on when this initiative began, but if it is to be completed by the Fall it would seem to be a pretty ambitious timeframe for producing quality replications of this many studies. Even given the fact that this appears to operate as an open collaborative effort…

  • willismg

     My experience has been that almost any field that uses the word “science” in its title doesn’t really have much to do with science…  Political Science, Computer Science, Social Science, etc….

    Extending the definition of “science” so that the original intent is derided as being too scientistic (is that a word?) is tantamount to claiming that “when I use a word it means exactly what I say it does.”  (Apologies to Lewis Carroll).

  • bscmath78

    Back in 1993 Nalini Amabady and Robert Rosenthal published this paper on how 6 second SILENT video clips of instructors teaching allowed Psychology students to evaluate Psychology instructors with a statistically significant relationship to the evaluations done by students who actually attended the whole course.

    http://faculty.fortlewis.edu/burke_b/Senior/BLINK%20replication/teacherthinslicing.pdf

    The paper gained some fame by being referenced in the bestseller “Blink” by Malcolm Gladwell.

  • bscmath78

    In a lot of fields, 95% of what is published is not worth reading.  Face it, if it wasn’t worth attempting to replicate by a separate team, it wasn’t worth doing in the first place, let alone publishing it.

    This is a facet of the way “publish or perish” has worked out.  It was already seen as a serious problem way back in 1964 in a popular science book published by Life Magazine. 

    “The Scientist,” by Henry Margenau and David Bergamini:

    “Antidotes for a flood 

    While some scientists see automation as their last-ditch hope for coping with the mounting flood of words, others argue that the best way to control the output is to cut it down. In many universities and industries, promotions hinge, in part, on the sheer bulk of a scholar’s published papers. The pressure to ‘publish or perish’ clutters scientific literature with items of small consequence masquerading under pretentious titles. Authors of scientific papers, say the reformers, must learn to police their own productivity, and scholarly reviewers — who traditionally do not attack another man’s work unless it contains actual errors— should go further, praising genuine contributions and puncturing empty ones.”

    “Plus ça change, plus c’est la même chose”
    “The more things change, the more they stay the same.”

    - Alphonse Karr, in 1849

    And why have things not improved in the years since 1964 and instead worsened? 

    We might look to: 

    “Cui bono?”
    “To whose profit?”

    - Cicero

  • Defenestrator

    I love how the article says that this effort is about protecting psychology as a science and not tearing it down, and then the headline just completely ignores that stated motivation and the “stay on message” advice.

  • Bernecky

    What’s the condition of a group of individuals every one of whom has come to expect others, outsiders, to pony up for re-examinations of conclusions…because those conclusions have no use, serve no purpose, and will otherwise never be tested or even known to exist?

    The pursuit (psychology) *might* have something going for it if the experiments were assigned, similarly to the way experiments are assigned to those who engage in real science (or an art that results in either life or death): medicine.  

    What if everybody’s funding depended upon someone’s discovering a link between 9/11 and Iraq, so that there’d exist evidence in favor of the war (if not in favor of a brain in every body that’s held down a chair in Congress since 9/11), which war has taken the lives of thousands of individuals…a couple of whom, if they weren’t exactly pulling for psychology, may’ve been willing to feed a few psychologists.

  • panacea

    I didn’t think he was snarky, and he pointed out that failure to replicate does not mean either fraud, deceit or anything unethical.  Sometimes bias is unconscious.  Sometimes flukes happen.

    Difficulty in replicating results can be as informative as the original result itself, and is an important part of the checks and balances of scientific research.

  • http://twitter.com/rogerskyy Kyle Rogers

    Not a fan of the direction the comments took. I think double checking work is always important and if someone has the time to do that then more power to them. With anything there are going to be different outcomes whether it be a cancer research study or psychology but it’s important to get the information right. So I say bring it on mass peer review!

  • nelsonpreacher

    This is no surprised, every research must be verifiable to check if the claim is true or not. Just like the recent research on coffee. Some says it lowers your blood flow in your brain others say it stimulates your brain. But to say that psychology as a science is to come undone is preposterous.

  • 5768

    Measurements can be accurate and not precise, precise and not accurate, both accurate and precise, or neither accurate nor precise.

    How can anyone discover “true stuff” in the event trials are merely reproducible?

    Most of us in the physical sciences know that science itself runs amuk when it claims to establish “absolute” truth no matter how reproducible our trials.

    Determining outright fraud is one thing, but I sense aspirations to (physical) scientism by this Reproducibility Project which itself appears to labor under false premises.

  • 22067030

    This is an entirely different barrel of fish.  The “publish or perish” rule results in a lot of papers that practically no one reads and have little effect other than cluttering up libraries (and not even that now that we have online subscriptions) and getting people tenure.

    On the other hand, the papers that had an effect in climate science were widely read and had a major effect.  Whether you dislike current trends in climate science or not, it would be very silly to dismiss the controversial papers in climate science as vita padding.

    GLMcColm

  • calgrad

    “Not the least of which is the possibility that something important to the outcome was unrecognized and unmeasured in the original study — and that unmeasured factor was not common in the population of the replication study.”

    Isn’t this just a longer way of saying that the original study, if it asserted there was a connection between some cause and some effect, was wrong?

    I’m a sociologist, not a psychologist, but don’t psychology papers usually have the form “We did X, we observed Y, and we conclude Z”.  If somebody else does X and doesn’t not observe Y, then Z has been _disproved_ if the second study was done properly.

    Yes, there might be a confounding effect.  Yes, much can be learned this way.  But the conclusion of the original study is now known to be wrong.

  • bscmath78

    For some of my previous critiques of “Academically Adrift” and CLA please see posts starting here:

    http://chronicle.com/article/Academically-Adrift-The/130743/#comment-437779649

    http://chronicle.com/blogs/innovations/richard-vedder-on-the-ills-of-higher-education/28716#comment-156293507
    http://chronicle.com/blogs/innovations/the-revolution-of-rising-expectations/28804#comment-164271291
    http://chronicle.com/blogs/brainstorm/rigor-in-the-business-school-guest-post-jason-fertig/32657#comment-157246585
    http://chronicle.com/article/The-Self-Exam-That-Higher/128543/#comment-282472182
    http://chronicle.com/blogs/innovations/too-much-for-too-little/30220#comment-297275019
    http://chronicle.com/article/Academically-Adrift-a/126371/#comment-156687418
     
    For related material please see posts starting here:

    http://chronicle.com/blogs/headcount/a-president-urges-his-peers-to-reclaim-the-conversation-about-liberal-arts-colleges/29908#comment-493736701

    http://chronicle.com/blogs/innovations/campus-cfos-are-right/29787#comment-246226619
    http://chronicle.com/article/A-Perfect-Storm-in/126451/#comment-154352120
    http://chronicle.com/blogs/onhiring/politics-is-killing-us/29663#comment-334191983
    http://chronicle.com/article/44-Billion-Ought-to-Buy-Some/126812/#comment-168648719
    http://chronicle.com/blogs/innovations/pell-mell/28873#comment-167608793
    http://chronicle.com/blogs/brainstorm/against-relevance/38096#comment-284724578
    http://chronicle.com/blogs/innovations/the-university-of-stonehenge-part-2-of-3/30451#comment-323063660

    Please note that the above threads include other posts by me on other aspects.

  • bscmath78

    For evidence that in 1976 Berkeley statistics students were intellectually superior to most of the statistics TAs that were inflicted upon them:

    http://chronicle.com/article/Negotiators-Reach-an-Impasse/131534/#comment-496668008

    For the parallels between SAT/ACT based admissions and Tryon’s “maze-bright” rats:
    http://chronicle.com/article/Harvard-by-Lottery/131322/#comment-484775851

    For an illustration of how poor a predictor of college GPA that SAT can be, even with a SAT Math range of 300 to 800, for a single year, at a single 4 year university, for all Computer Science majors for 3 semesters, see the subthread starting here:
    http://chronicle.com/article/Harvard-by-Lottery/131322/#comment-483721868 

    SAT Verbal was worthless. SAT Math predicted 6%, while High School Math marks predicted 19% of the cumulative GPA.

    For an illustration of the parallels between NCLB and the Revised Code of 1862:
    http://chronicle.com/blogs/innovations/5th-avenue-percussions/30953#comment-372249648

    For an example of how college seems to cause loss of civic knowledge, at least according to the ISI’s tests, please see this subthread:
    http://chronicle.com/article/College-at-Risk/130893/#comment-450329553

    For reasons why ed schools should not be trusted, see various comments starting here:
    http://chronicle.com/article/Negotiators-Reach-an-Impasse/131534/#comment-496611616

    For my critique of the misuse of medical admissions statistics to promote the Humanities:
    http://chronicle.com/article/The-Liberal-Arts-as-Guideposts/130475/#comment-430281277 
    http://chronicle.com/article/The-Liberal-Arts-as-Guideposts/130475/#comment-430829706

    These might all be examples of why some results are not tested or replicated. People aren’t interested in the answer or don’t want the answer. It gives the impression that if something provides an undesirable answer it best that no one know about it or that it be vigorously spun to support a particular agenda.

  • bscmath78

    For some of my “Inconvient Truths” including: 

    Inconvenient Truth #15: Many Vocal Professors Study and Learn Little About Student Studying and Learning

    Inconvenient Truth #13: College has never been about academic studying and learning for 90+% of students. See my comments starting here:

    http://chronicle.com/blogs/innovations/12-inconvenient-truths-about-american-higher-education/31282#comment-413784773

    Some other inconvient information:

    http://chronicle.com/blogs/worldwise/the-future-of-british-higher-education/29203#comment-458227785
    http://chronicle.com/blogs/worldwise/britain-threatens-its-economic-future-by-cutting-university-support/28897#comment-367658953

    http://chronicle.com/blogs/brainstorm/is-history-bunk/41263#comment-362465102
    http://chronicle.com/blogs/brainstorm/is-history-bunk/41263#comment-361952058
    http://chronicle.com/article/Millennials-Are-More/131175/#comment-466161828
    http://chronicle.com/article/Eric-Kandels-Visions/131095/#comment-463468438

    http://chronicle.com/blogs/innovations/supersizing-obamas-higher-education-agenda-part-1-of-8/31632#comment-444791785
    http://chronicle.com/article/The-RiseFall-of-the/131036/#comment-458034609

    Attempts to dispell myths about Virtue:
    http://chronicle.com/blogs/innovations/higher-educations-increasing-disdain-for-virtue/31505#comment-433095518

    Attempts to dispell myths about STEM:

    http://chronicle.com/blogs/brainstorm/the-grad-school-decline/44759#comment-464356252

    http://chronicle.com/article/Work-Life-Balance-Is-Out-of/131111/#comment-462878291
    http://chronicle.com/article/Work-Life-Balance-Is-Out-of/131111/#comment-462905084

    http://chronicle.com/article/White-HouseUniversities/130699/#comment-433240406
    http://chronicle.com/blogs/percolator/re-engineering-engineering-education-to-retain-students/28745#comment-444960976

    GI Bill and education:

    http://chronicle.com/blogs/innovations/no-don%e2%80%99t-idolize-dropouts-but-dont-idolize-graduates-either/31795#comment-454701614

  • bscmath78
  • bscmath78
  • http://www.facebook.com/profile.php?id=829027695 Erin Rey McMichael

    As a social psychology grad student, I see nothing wrong with this. If someone is willing to replicate a study, I say kudos to them. As long as they replicate it exactly the way the original author intended the experiment to be run. The “sad” part that Dr. George Curious mentioned might be that they are targeting social psychology. Sure, that makes me a bit sad too. All research disciplines should be targeted. But alas, as tdr75 mentions, if your research is ethical and sound, why worry? 

  • http://www.facebook.com/profile.php?id=829027695 Erin Rey McMichael

     ”it is joyous news that psychologists recognize that their papers are in large measure worthless.” OUCH. :(

  • undrgrndgirl

    i hope they go after the pharma journals next!

  • undrgrndgirl

    and sometimes researchers ARE deceitful.

  • http://pulse.yahoo.com/_2MPNLYZORRKBGUHNUHBEJ64F7Q Mikio067

    Most psychology is a load…we all know that; and most psychologists only support “new” ideas in the subject that are politically correct, because, hey, many of them are affiliated with the local college or university, and they aren’t about to bite the hand the feeds them (you know…grant money and all that).  It’s all garbage.

  • BenGladden

    Bravo to Professor Nosek. I have always considered Psychology to be a pseudo science that is heavily influenced by political correctness and group think.

    Take, for instance, recent studies that indicate that anyone opposed to homosexuality are latent homosexuals themselves. Poppycock!

    “Homophobia” is a contrived word to ridicule and bully anyone opposed to normalization of homosexuality in forms such as gay marriage, because a phobia is an irrational fear and opposition to homosexuality is neither a fear nor irrational. Regardless of what recent biased studies have shown.

  • BenGladden

    The nature of Psychology make “exact” replication impossible. Psychology is not an exact science.

  • CrazyHungarian

    “Psychology is not an exact science.” therefore should have read: “Psychology is not a science but an area of study, like philosophy and anthropology”; that’s why it ends in -ology.

  • BenGladden

    Tell that to the many people, including many psychologists, who think or act like it is a science.

  • http://www.facebook.com/people/Ron-Watson/100000138336774 Ron Watson

    Science is in deep trouble.  Too much politics and PC too little actual science being done.  It is good to see that some scientists have realized that they must begin to police themselves.

  • http://www.facebook.com/profile.php?id=100003668961870 Suibne Geilt

    Psychology, Ed. Psychology, Social Psychology, the entire profession and its contents are utter fictional nonsense. It’s a literature course and has had horrible impacts on all spheres of American life based on air. Get rid of the Psychologists and the the Political Scientists for the same reason.
    suibne

  • http://www.facebook.com/profile.php?id=100003668961870 Suibne Geilt

    think of the effects of the scientific method on say……….writing a song……or cooking. We are dealing with the human PSYCHE here. The problem has never changed regarding the mind.
    These guys are one step removed from high priests of cult ritual. I am being nice.
    suibne

  • JohnnyTwoDog

    If Psychologists have not been reproducing results of studies to confirm findings then it is not a science, it’s philosophy. No other science passes of findings that cannot or have not been reproduced as fact. Except for “climate change” science. But that is also a philosophy, not a science.

    Tree rings and tea leaves, the stuff of fortune tellers, not scientists.

  • http://pulse.yahoo.com/_EULJSGCOKLISJJZU44IZ52RBLM john

    Double speak alert!

  • Alan Wizntzer

    Psychology is not now nor has it ever been a science. Really, the idea is laughable. I could write more, but what is there to say? Psychology, especially in its attempt to explain human behavior and treat aberrant behavior, is nothing more than the philosophical musings of academics and would be gurus. 

  • http://pulse.yahoo.com/_YFC6ZXFKQ7BNPCEQN6OAEFATYA RobertB

    “sad”?  Why is any emotion involved whatsoever?  The emotion that drives genuine scientists is the passion to discover the truth.  

  • http://pulse.yahoo.com/_YFC6ZXFKQ7BNPCEQN6OAEFATYA RobertB

    Anyone who doubts the results of his study will be free to replicate it. 

  • http://pulse.yahoo.com/_YFC6ZXFKQ7BNPCEQN6OAEFATYA RobertB

    Science is not self-correcting if there is not continuous replication.  I had assumed that all published studies were routinely subject to replication attempts .. to learn that minimal verification exercise is controversial has me pretty much discounting EVERYTHING coming out of the field of psychology.  

  • http://pulse.yahoo.com/_YFC6ZXFKQ7BNPCEQN6OAEFATYA RobertB

    If there are a variety of valid reasons for nonreplication to occur, then why would anyone waste any time actually reading these studies and journals?   Perhaps the bar should be raised for publication so that the wheat is not lost in the chaff?  What good is new knowledge if no one knows it? 

  • http://pulse.yahoo.com/_YFC6ZXFKQ7BNPCEQN6OAEFATYA RobertB

    So if a psychologist harms a patient using knowledge based on unreplicatable studies, is he off the hook because he acted on knowledge that was published?  How can anyone possibly not be alarmed at the possibility that studies that deal with health and well being are not heavily vetted?  There were Congressional hearings over the possibility that the published outcomes of game shows and published rankings of popular songs on the radio were false – how can there not be hearings on something that actually matters?!

  • http://pulse.yahoo.com/_TW5ODE565VM7Q6PGMER7VAWR6M Sturdley

    Gee.  Next, they’ll be suggesting “reproducibility studies” in climate science…  Where will it end?

  • johndburger

    This is not unique to psychology, most of the “hard” sciences have the same problem.  The article notes that only 6 of 53 landmark cancer studies could be replicated in a recent effort.  This is a major problem with science in general.

  • johndburger

    This would be great, just like world peace.  The “incentive system” in many fields includes patents, venture capital for startups, textbook authorship, etc.  Nobody gets any of that for negative results.

  • KevinRonaldLohse

    Where it ends atm – in the courts.

  • http://twitter.com/weeal36 Alan Underwood

    Interesting and great thing for the scientific method