• Monday, May 28, 2012

Previous

Next

Doubts About Digital

August 11, 2010, 9:51 am

Here’s an important story in the New York Times about the academic benefits of digital tools, with the headline “Computers at Home: Educational Hope vs. Teenage Reality.” And here is a story in Science Daily with a similar theme under the title “College Undergrads Study Ineffectively on Computers, Study Finds: Students Transfer Bad Study Habits from Paper to Screen.”

Both pieces report the findings of studies indicating that, so far, laptops and other devices fall well short of the promises of digital learning. In the Science Daily story, researchers found that when students use computers, they don’t improve their study habits (and their academic performance). Instead, they transfer bad habits to the new tools. This is an important finding because it casts doubt on one of the central claims made for digitalizing schools and classrooms. People advocate it because they say that the new tools encourage students to do research, compose papers, communicate with peers, and read texts in ways that are more challenging, invigorating, and effective. This report suggests that the lesser habits are more resistant to improvement than the claim assumes. Indeed, it seems to me, digital tools make those bad habits (such as lightly skimming texts that should be read closely, composing sentences and paragraphs too quickly, assembling information without integrating it, etc.) easier to implement. Cutting-and-pasting only accelerates the writing process. Google searches let students bypass the labor of evaluating sources (they think the top results are the best). And so on.

The Times story has a troubling summary at the beginning:

“Economists are trying to measure a home computer’s educational impact on schoolchildren in low-income households. Taking widely varying routes, they are arriving at similar conclusions: little or no educational benefit is found. Worse, computers seem to have further separated children in low-income households, whose test scores often decline after the machine arrives, from their more privileged counterparts.”

It then reviews several studies that show computers at home and in classrooms produce little or no benefit for the users (in some cases, one sees a decline). One of the studies cited is a 2009 report from the Texas Center for Educational Research on the state’s “Technology Immersion Pilot,” an initiative to surround students in selected middle schools with technology and assess the results. In The Dumbest Generation, I summarized one evaluation that appeared in April 2006, which stated, “There were no statistically significant effects of immersion in the first year on either reading or mathematics achievement.”

Here is what the 2009 report concluded. While there was some improvement in technological literacy and disciplinary problems, “Across four evaluation years, there was no evidence linking Technology Immersion with student self-directed learning or their general satisfaction with schoolwork.”

In math and reading, some positives showed up, but disappointingly so:

“Technology Immersion had no statistically significant effect on TAKS reading achievement for Cohort 2 (eighth graders) or Cohort 3 (seventh graders)—however, for Cohort 1 (ninth graders), there was a marginally significant and positive sustaining effect of Technology Immersion on students’ TAK reading scores.”

And:

“Technology Immersion had a statistically significant effect on TAKS mathematics achievement for Cohort 2 (eighth graders) and Cohort 3 (seventh graders). For Cohort 1 (ninth graders), the sustaining effect of immersion on TAKS mathematics scores was positive but not by a statistically significant margin. After controlling for student and school poverty, estimated yearly TAKS mathematics growth rates.”

Do a cost accounting. With such meager academic results and such high costs for programs like this one, we should temper our enthusiasm for e-learning. Couldn’t we get similar results with less-costly forms of instruction such as after-school tutorials, summer programs, and other people-based initiatives?

This entry was posted in Books. Bookmark the permalink.

  • Print
  • Comment (33)

33 Responses to Doubts About Digital

redweather - August 11, 2010 at 8:08 pm

Many of my students have laptops. They tend to play with them. They are toys.So many people have bought into the idea that computers will make learning exciting. But students will still have reading and writing to do and tests to take whether they have a laptop or not. There is no way around that. And that is the problem.In order for learning to be exciting, students have to want to learn. Students who want to learn don’t even need a textbook, let alone a laptop. Heck, as much as I hate to admit this because I’m a teacher, they don’t even need a good teacher all the time.

mbelvadi - August 12, 2010 at 7:03 am

I find your interpretation of the results rather interesting. By your own report, the technology improved reading scores for 1 out of 3 cohorts, math scores for 2 out of 3, and technological literacy throughout. Given how important technological literacy is to employment in almost any white collar job, and useful even in blue collar ones (eg if you decide to become a self-employed plumber, and need to keep your own business records), I don’t see why you are minimizing the importance of these findings. Instead you emphasize that it didn’t increase “their general satisfaction with schoolwork” which probably wasn’t one of the major goals in the first place.Efficacy aside, I would definitely question whether the kind of “people-based initiatives” you suggest would actually be less costly – you might not have noticed, but in the US, labor is the most expensive input to pretty much every product and service, with the exception of advanced medical equipment. You can give a poor kid a netbook computer for about $300 today – it would cost at least that much for a summer’s tutoring, and at the end he’d still have the netbook to keep using.

flowney - August 12, 2010 at 8:29 am

The potential transformative effects of computer use on faculty and students has been widely touted and broadly misunderstood. Recall that faculty, too, were to be reinvigorated as we recast our yellowed lecture notes into new media forms.Where many implementations have failed is in not providing sufficient support and assistance to teachers and students taking up technology in an educational setting. This is the “teachable moment” where bad habits of mind may be replaced with better ones. We simply have not attended to this need as we should, possibly because this is far more challenging than creating purchase orders and having tech staffs issue hardware and software.Although there is a small proportion of faculty who find technology intrinsically interesting such that they will pursue it without regard to the rewards and punishments that might be involved, most faculty need much more than that. Recognizing the effective use of technology in teaching in Promotion and Tenure decisions would be a good place to start but that alone is not enough. We have to actually provide to faculty the ways and means of mastering today’s technologies for instructional and research purposes.We should do as well for students. Left to their own devices, they will use the strategies for learning that they brought with them. It’s our job to improve on that and we simply haven’t been attending to it in the same ways we work on reading, writing and other basic academic skills. The use of digital technologies must be considered a basic academic skill and incorporated into the curriculum appropriately.

dank48 - August 12, 2010 at 8:48 am

Computers can be useful for learning; they are after all general-purpose machines. But like any tool, they can be used well or otherwise. The $300 netbook computer could be highly useful or a waste of three Cs, depending on how well it’s integrated into the learning process and on how well the user uses it. People have been looking for a royal road to learning for some time now, and technology does have its attractions. Fifty years ago language labs were going to help produce a generation of multilingual world citizens or something. They may still be around, for all I know, but the current situation in FL enrollments doesn’t seem encouraging.There’s no panacea. The key elements are still the student and the teacher, in that order; my guess would be that the third most important factor is parental involvement, books in the home, etc. Does anyone expect that a Kindle in the home will ever be a predictor of success?

english_ivy - August 12, 2010 at 9:09 am

The essence of this conclusion about technology is that the nature of learning and teaching is still remains fundamentally unchanged despite the sudden rise and ubiquity of computing technology.The great learning tool of previous generations, time, was thought to have been made outdated by technology.It has not.Then as now the stupid people are the one’s who don’t read books and journals. Then as now the stupid people are the one’s who don’t spend time thinking.Then as now bad teachers are the one’s who try to find shortcuts or who just don’t have enough time to do it right (because they teach too large of a class or too many classes).

redweather - August 12, 2010 at 10:13 am

Then as now the stupid people are the one’s who don’t read books and journals. Then as now the stupid people are the one’s who don’t spend time thinking.Then as now bad teachers are the one’s who try to find shortcuts or who just don’t have enough time to do it right (because they teach too large of a class or too many classes).Then as now, indeed!

markbauerlein - August 12, 2010 at 10:43 am

You aren’t disappointed by the findings, mbelvadi? Note the word “marginally.” Consider, too, the costs for technology in light of the meager improvements. Remember that a tech specialist in a high school costs a lot more than a writing tutor.

cmorrissey - August 12, 2010 at 11:09 am

“Do a cost accounting” is the key message in Mark Bauerlein’s commentary. In addition to the dearth of empirical research on”elearning” assessment, ROI on educational IT investments is almost non-existent. This will change dramatically as budget pressures will force an examination of this important topic.

dank48 - August 12, 2010 at 11:42 am

Freeman Dyson made an interesting point about the US space program, up to and including Apollo and post-Apollo. He points out that the Apollo program (including, as I understand it, the Mercury and Gemini “lead-ups” to Apollo) cost roughly ten times as much as the unmanned probes to Mercury and Venus and to Mars, and roughly a hundred times as much as sounding rockets to explore the upper atmosphere and loft short-term observatories. The scientific results of the programs were inversely related to the costs. That is, the cheap Aerobee sounding rockets delivered, not just more bang for the buck, but more bang period, than the moon landings. (Dramatic effect on the public is another matter entirely.)”Hi-tech” doesn’t automatically mean great results; “gee-whiz” may come down to nothing more than Cheez Whiz (not to disparage that fine product). Having a spiffy onyx and jade chess set hasn’t improved my game.

betterschools - August 12, 2010 at 11:55 am

Examining and objectively evaluating the merit of specific tools purported to increase the effectiveness of teaching is rational and professional. Much of the tone here is of that nature.There is a larger issue, one that runs beneath some perspectives taken here.It is irrational and unprofessional to cash one’s professorial paycheck while ignoring the contributions of the last 50 years of learning sciences (brain, cognitive, pedagogical), measurement sciences, and technology to our ability to teach. I’m not suggesting that all methods, techniques, tools, or bags of tricks work for all teaching contexts. Neither am I suggesting that we are obligated to adopt or even try every one of them. I am speaking about what we have learned about learning and evaluating performance. We should be ashamed of the fact that most of us still teach from a 1900′s play book, proudly displaying our ignorance of the relevant sciences (sometimes while teaching the very sciences) while robbing our students of the benefits of more effective and more efficient learning experiences.

goxewu - August 12, 2010 at 11:58 am

Maybe then as now the stupid people are the ones who repeatedly put an apostrophe where it’s not appropriate, with or without a computer.Also, a tech specialist in a high school can help a lot more people per day than a writing tutor. Or perhaps Prof. Bauerlein would like to hand-deliver to each of us a typewritten-on-paper copy of his current post.

cwinton - August 12, 2010 at 11:59 am

Face it, educators (or at least some of them) are mesmerized by technology because based on their own experience they can see how it can make so many tasks easier. They leap to the conclusion that technology will allow learners to bypass the kinds of things they themselves had to get past. Unfortunately, they forget that some of those seemingly tortuous efforts they themselves had gone through provided the experiential base necessary to actually benefit from the technology. Technology can, and should, be a wonderful educational supplement, but as long as we regard it as a substitute for things more fundamental (hands on, trial and error, build from scratch, etc) we won’t see any gains. Merely putting technology (or books for that matter) in someone’s hands is not going to have any measureable impact.As for cost accounting, I suggest that we also need a cost accounting for the huge cost of all the cost accounting we have been indulging in in recent years and which is a major factor contributing to the rising cost of education.

dank48 - August 12, 2010 at 12:10 pm

Hear, hear, Cwinton. Peter Drucker: “It’s worth knowing what it costs us to do business. It’s also worth knowing what it costs us to find out what it costs us to do business.”

jwjulius - August 12, 2010 at 12:30 pm

Well said, @flowney (#3). I would like Prof. Bauerlein to be more specific in his references than “People advocate [digitalizing schools and classrooms] because they say that the new tools encourage students …” Which “people” say this? Shills for technology manufacturers and overly optimistic technological determinists? The issue is not the technology itself, it’s the design of the learning environment. It should not come as a surprise to find marginal impacts and cost inefficiencies when throwing technology into an environment where little is done to change teaching and learning practices.Technologies provide affordances that enable different approaches to learning a la @betterschool’s comment #10; most obviously (but not exclusively) in situations such as mega-classes and online learning. Techno-advocates (or skeptics) do not advance the conversation when they ignore the larger issue: facilitating the change in systems and individuals needed to make education more successful.

umbrarchist - August 12, 2010 at 1:33 pm

And what about Vero Beach High School in Floridahttp://www.cris.com/~faben1/section1.shtmlHow was that so successful but we never hear about it but netbooks that should be more powerful than what was used in 1987..

markbauerlein - August 12, 2010 at 1:41 pm

Fair point, julius, but the issue for me is that school systems have pressed forward in “facilitating the change in systems and individuals needed to make education more successful” without determining in advance just how successful this and that change will be. As for the people over-selling the technology as better suited to today’s “learners,” I have a whole chapter quoting them at length in Dumbest Gen, and they range from researchers to foundation heads to popular journalists.

betterschools - August 12, 2010 at 2:01 pm

I agree that there is too much ready/fire/aim implementation but some seem to go to the other extreme.The standard of “[Not] facilitating the change in systems and individuals needed to make education more successful” without determining in advance just how successful this and that change will be” is unscientific. It conveys the underlying contributions to why we still teach in such old-fashioned ways. Managed field experimentation is essential to progress and it is the nature of investigation that the outcome is not knowable in advance. A failed or partially failed experiment convey as much and typically more information than a successful one. I think it is our responsibility to experiment in a way consistent with our resources. Adopt what works and leave the rest behind. Move on. Set continuous improvement goals. How many of us do that in a measured and managed way?

ndkaneb - August 12, 2010 at 3:27 pm

I’m struck by the fact that no one here seems to be discussing the home environment in which the computer is placed. If the adults in the household know of nothing to do with a computer than play games, then the children will have a much harder time developing good, technologically supported study habits, and it should be no surprise that the gap widens between them and their more privileged classmates. I was struck a few years ago when the parent of one of the earliest Head Start participants was interviewed. She remembered being instructed to read the newspaper each day with her child on her lap so that the child could watch her mother reading. I wonder how many of those parents had to pick up the habit of reading the newspaper each day in order to provide that model for the kids?If we want to place computers in the homes to help lower income children, we need to stop treating it as an either/or option with the “people-based” initiatives Bauerlein suggests. In particular, we need to broaden the scope of such initiatives to include the whole family in the practices of lifelong learning. Given the exigencies of adult life, that will need to include e-learning in the mix.

umbrarchist - August 12, 2010 at 8:28 pm

We are supposed to pay attention to the opinions of economists? It’s 41 years after the Moon landing and they don’t talk about the planned obsolescence of automobiles. I have a Linux book from 2001 that mentions PO in relation to computer software.By the way, double-entry accounting is 700 years old. Economists haven’t suggested that it be mandatory in high school. Why not? Can’t netbooks more powerful than 1980 mainframes handle accounting?I think we have a problem with our real objectives in education. Do we want competent individualists who can decide upon and pursue their own objectives or do we want GOOD EMPLOYEES.http://www.gutenberg.org/files/20919/20919-h/20919-h.htm.

willynilly - August 12, 2010 at 9:22 pm

Bauerlein has always written/spoken ill of technology in education, as well as any other “outside the box” teaching practices. He will always try to shoot holes in any research supportive of these new technologies/practices/theories that are continually in various phases of experimentation. Expect Bauerlein to always conclude such essays with a strong pitch to continue the traditional “people-based teaching initiatives”. He does so because he is patently aware of how easily he might be replaced from his now cushy gig at Emory, if any of these new practices succeed.

redweather - August 12, 2010 at 10:14 pm

Using computers is an “outside the box” teaching practice? Maybe twenty years ago it was. You have it in for Mark, for some reason, and you’ve made that clear on more than one occasion. It clouds your view of the issues.

markbauerlein - August 13, 2010 at 9:40 am

Yes, ndkaneb, the home is crucial, and, sad to say, all too many parents regard the laptop the same way they regard the TV set–a babysitter. And while betterschools is right to highlight innovations in teaching, keeping some component of “old-fashioned” methods in the school day might prove helpful in assessing the benefits of those innovations.

jwjulius - August 13, 2010 at 11:44 am

I agree with you, Prof. Bauerlein, regarding the importance of old-fashioned methods (I placed this quote at the outset of my dissertation on faculty development for effective teaching with technology: “Most ideas about teaching are not new, but not everyone knows the old ideas.” Euclid, c. 300 B.C.E.)So, I’d be interested to hear more specifics. I’ll join with you in decrying poorly planned, poorly supported technology programs that simply throw tech at a problem hoping it will magically provide a solution. But I do believe that there are challenges in education today in which approaches involving technology are potentially the best. For me, these challenges are to bring some of the best methods of the past (cf Socrates, Dewey) into situations that Socrates, Dewey, et al. may not have routinely dealt with: highly diverse students, very large classes, learners at a distance from their classmates and instructors, instant access to abundant (good & bad) information, etc.Prof. Bauerlein, would you comment on your favorite instructional methods, and whether you think there are situations in which those methods might be enhanced through thoughtful uses of technology?

betterschools - August 13, 2010 at 12:54 pm

I am at a loss to comprehend the extreme conservatism displayed by so many among the professoriate. “‘Most ideas about teaching (sub: physics, psychology, communications, medicine, dentistry, printing, transportation, nutrition . . .) are not new, but not everyone knows the old ideas.’”I would wager that those among us who still teach under the 1900′s model would run for the hills of second opinion if we observed this kind of reluctance to incorporate the findings of science into one’s practice in our personal physician. I have a pilot friend who thinks aircraft have gone downhill since the invention of tricycle gear and flaps. He has an excuse; he is 91.Is there anyone reading these posts who seriously believes that the last 50 years of brain and cognitive psychological research, and the measurement sciences, have produced nothing to improve the efficiency and effectiveness of our teaching? Did we stop learning and growing with Euclid? I have made these observations in other venues. Among those who disagree, I get two kinds of comments: (a) “What brain and cognitive sciences are you talking about?” and, more predictably, (b) “The old methods work perfectly fine, why should I change?”Again, in medicine and teaching and pretty much everywhere else, there are some methodologies that worked well in 300 BCE or 1900 and remain best practice today . . . but they are precious few.

markbauerlein - August 13, 2010 at 12:56 pm

Here’s my general take, julius. I think experiments in educational technology should continue with all dispatch, but that schools should retain a small, but critical portion of the day for instruction in “slow reading” and non-digitally-assisted research–for instance, 45 minutes of old-fashioned exegesis in which teacher and students have a text in front of them, in print form, and they plod through it sentence by sentence with commentary and discussion.

jwjulius - August 13, 2010 at 4:19 pm

@betterschools I’m not sure we’re that far apart. My argument is that the *best* educational approaches of the past (eg frequent feedback, active and social learning, attending to connecting new concepts with prior knowledge, accounting for the experience and needs of the individual learner, contextualizing problems in authentic situations, encouraging metacognition/reflection) are largely validated by the research. The inertia of ~500 years of medieval lecture/recitation and ~100 years of industrial model schooling make it difficult to put these into practice for many teachers.Prof. Bauerlein, the director of the teaching center at my institution likes to use exactly your suggestion (he calls it “close reading”) as an example of a better use of PowerPoint. With selected passages on the screen in a large classroom, using highlighting features, instructors are more assured that students are able to follow along, without having to worry whether they have forgotten their text or have not located the correct paragraph. With clickers, an instructor could seed discussions in a large classroom by asking no-right-answer questions and displaying the results before asking students to turn to their neighbors. In an ideal situation – small class, prepared and motivated learners – the technology would be silly. But most of us aren’t working with the ideal.

simonj55 - August 13, 2010 at 5:07 pm

Well-said, Redweather. In fact, university education does not necessarily hinge on “good teachers,” understood, at least, not in the sense of those that receive the most accolades from undergrads. Much of what the learning specialists say is a waste of time; the most important element in learning is eagerness to learn. Eager students can challenge the teacher to reveal what he/she knows, and that can’t be too difficult.

betterschools - August 13, 2010 at 5:57 pm

@jwjulius,Thanks for the clarification and additional response. Looking at your list of examples, I agree that we may have no material differences. An aside, I would add to your list a construct I call problem-based horizontal learning, an efficient process that well run organizations employ every day. Explaining it is for another venue but, if well done, it can compress the time-to-proficiency considerably while producing more transferable learning.As you note, “The inertia of ~500 years of medieval lecture/recitation and ~100 years of industrial model schooling make it difficult to put these into practice for many teachers” perhaps you can comment on why you and your colleagues think this is so and what solutions you have in mind. One conjecture is that many professors still see (or want to see) higher education in its 1900′s version serving a small number of smart, rich and generally highly motivated students who held very different views toward institutions and authority figures. This conjecture may be an explanation for their conservatism but how is is possible to be both intelligent and to fail to see the obvious transformation of higher education into the large mass markets that presently define it? Whatever the cause, this dimness of vision does not speak well for the modern professoriate. What you say about the unwillingness of those who teach to keep pace with scientific advancements is not a significant problem for physicians, psychologists, or any other profession of which I am aware. Perhaps a better explanation for the problem is to be found in the “management” structures of higher education, structures which permit the professoriate to remain ignorant if it so chooses. Physicians, etc. would quickly lose their jobs were they to remain ignorant of modern findings.

jcisneros - August 17, 2010 at 9:18 am

Technology is a tool, not a magic bullet.Utilized properly, technology supports learning. Utilized improperly it is a distraction.E-learning has great potential like previous advancements in the tools used for learning. But, I feel compelled to point out that using the technology in your classroom does not address key factors such as desire to learn, the knowledge to use the tools the best advantage, and study habits. Learning at the university level is all about time management and knowing how to utilize the tools given in the environment.A university may have a terrific library with both physical copies of books and the amazing array of electronic resources. But if the students do not know how to utilize these resources they lie fallow and underutilized.~JC

markbauerlein - August 17, 2010 at 2:26 pm

I wouldn’t call the methods I single out “1900s models.” They go back a lot farther than that.

umbrarchist - August 27, 2010 at 6:34 pm

{{{ E-learning has great potential like previous advancements in the tools used for learning. But, I feel compelled to point out that using the technology in your classroom does not address key factors such as desire to learn, the knowledge to use the tools the best advantage, and study habits. Learning at the university level is all about time management and knowing how to utilize the tools given in the environment. }}}And if the classroom is killing the desire to learn.Computers are na option like nothing that has existed before so all comparisons are irrelevant. With 160 gigabyte hard drives the internet is potentially irrelevant if the right material is loaded on the computer.100 gigabytes is equivalent to 100,000 500 page books. Download Celestia to see what a mere 35 million bytes can do..

umbrarchist - December 19, 2010 at 2:59 pm

I bought a $99 CVS Sylvania.

It is about equal to a 1997 desktop. It won’t run today’s BLOATED software but it is GREAT if the user understands its limitations. If the limitations are not acceptable then spend 200 more dollars and carry a heavier machine around.

It needs more software that is EFFICIENT.

But an 8 gig SD Card can hold from 400 to more than 16,000 books depending on the format and size. It makes a great book reader.

umbrarchist - December 19, 2010 at 3:02 pm

I forgot to mention, that post and this were done from the $99 CVS computer.