EducationWorld is pleased to present this blog post shared on the EducationWorld Community by Anne O'Brien of Learning First Alliance. In this article, O'Brien reviews helpful advice on examining the credibility of educational research.
Who can you trust about educational technology?
So asked Richard Rose in September’s issue of School Administrator. He argues that research on educational technology should be approached with skepticism for a number of reasons. For example, money plays a big role in this research: Interested parties, including technology providers, nonprofits and even unions, often directly or indirectly benefit from research showing results for a particular product.
There is also a lack of consensus within the research–one can find research that supports almost any position. In addition, there is bias introduced by the “publication strainer” (publications prefer research that supports their platform of doctrines) and author timidity and pragmatism (not wanting to waste time on research that isn’t published, busy authors submit what they know publications want).
In reading this piece, it struck me that it could have been written about any aspect of education. While the motivation of technology companies may be different than the motivation of those pushing vouchers, charter schools, alternative certification programs, particular reading programs or any other educational products or policies, it is widely acknowledged that much education research–for the reasons Rose cites and others–is substandard.
But as Rose acknowledges, not all educational technology research (which I would change to "not all education research") is “tainted by vested interest or too insipid to bother with.” There is good research out there–you (whether you are a practitioner, parent, policymaker or other) just need to know how to look for it.
In a recent article in American Educator based on his new book, Dan Willingham offers a four-step approach for those who haven’t taken years of statistics courses and/or don’t have the time to comprehensively review the research. Use these steps to help determine whether a policy, program or other educational resource is evidence-based and worth adopting.
For each “scientific” claim regarding a new curriculum, program or strategy you are investigating, he recommends that you:
Willingham admits that this system is imperfect and “not a substitute for a thoughtful evaluation by a knowledgeable scientist.” Still, for those who are charged with making decisions in education–be they about technology, curriculum, governance or anything else–it is a starting point to ensure that education research is neither given too much weight nor ignored completely.
After all, to truly advance education both for our nation and for each child, we have to avoid accepting at face value the easy, politically popular claims that a particular strategy is "evidence-based."
Copyright © 2012 Education World