Your Source for Learning
Technology, Strategy, and News
    [Forgot Password?]
ARTICLES      
RSS feed RSS feed

Once Again, Games Can and Do Teach!

“The evidence is clear that games can and do teach. We also know that online learning and lectures often do not teach. In the end, it is not the vehicle delivering the instruction that makes the difference, it’s the design.”

In a recent article by Ruth Clark in Learning Solutions Magazine, titled “Why Games Don’t Teach,” she makes the claim that “games don’t teach.” She goes on to say, “Not that games can’t teach, but that advocating games as a main or even frequent instructional strategy is misleading.” There are a number of claims and statements Clark makes that deserve further attention.

Research findings: games teach

Contrary to Clark’s assertion, there is solid research and overwhelmingly compelling evidence that games can and do teach a variety of subjects effectively. In fact, there is a rapidly growing body of empirical evidence that repudiates Clark’s claim. Let’s look at just a few pieces of this evidence.

In a paper titled “Does Game-based Learning Work? Results From Three Recent Studies,” the author, Richard Blunt of the Advanced Distributed Learning (ADL) group, reported on three causal-comparative exploratory studies. ADL, founded in 1997, works with business and university groups to develop consensus around standards for training software as well as associated training services purchased by federal agencies.

ADL reported on studies that examined the difference in academic achievement among students who did and did not use video games for learning. Researchers added three different video games to approximately half the classes of freshman introduction to business and technology courses, third-year economics courses, and third-year management courses. All courses imposed identical testing situations, while data collected included game use, test scores, gender, ethnicity, and age. Analytic methods testing game-use effectiveness included ANOVA, chi-squared, and t-tests.

The findings indicated that the mean scores of students in classes using the game were significantly higher than those of students in classes that did not. There were no significant differences between genders, yet both genders scored significantly higher with game play. There were no significant differences between ethnicities, yet all ethnic groups scored significantly higher with game play. Students 40 years and under scored significantly higher with game play, while students 41 and older did not. Blunt further indicates that “these studies add definitive research in the area of game-based learning. The DoD now has studies proving the efficacy of digital game-based learning and how it can improve learning.”

While three studies indicating learning from games is a start, and already debunks the myth that “games don’t teach,” one could make an argument that it is hardly a foundation for making the assertion that games teach. True, but this is not the only research indicating games are effective teachers.

Connolly, et al. (2011) looked at more studies and reached the same conclusion. They conducted a meta-analysis (study of studies) by reviewing 129 papers reporting evidence related to the impacts and outcomes of computer games and serious games with respect to learning and engagement. The majority of the studies reviewed—121 (94 percent)—reported quantitative data, with eight (six percent) reporting qualitative data. One strong conclusion they reached was that the most “frequently occurring outcomes and impacts were knowledge acquisition/content understanding and affective and motivational outcomes.” Certainly, knowledge acquisition and content understanding are learning—learning from games.

In the two meta-analysis papers Clark reports on, both authors indicated that games teach (see comments on original article). These findings from Blunt, Connolly, et al., Hays, Sitzmann, and others support the argument that games teach and positively impact motivation. This isn’t looking at one isolated study. It is looking at over a hundred studies both qualitative and quantitative, from different meta-analysis studies and individual studies. The evidence is clear and compelling.

So the statement “games don’t teach” is simply not supported by the evidence. The preponderance of evidence is that games can and do teach. Now does every game teach? No. Neither does every lecture or every online course.

Games also have the additional benefit of changing behavior. See research studies outlined in “Can a Video Game Make Someone Nice? T

Subscribe or log in to read the full article.
You can log in using your eLearning Guild username and password.


(53)
I appreciate this article

Comments

Login or subscribe to comment

Karl, thank you for presenting a research-based rebuttal to the previous article. There IS evidence that games can (and do) teach, and as with any learning experience, design is the key to efficacy.
Hi Karl,

Thanks for referencing my research from 2007. It was the first quantitative study on game-based learning that I know of. The original research was done six years ago and now there is a plethora of research supporting the efficacy of GBL. I think you make a lot of great points and your taxonomy is a step forward. Yet, in Ruth Clark's defense, I agree that there is not yet a widely accepted taxonomy of game functions/characteristics/genres that can be used to design great game-based learning. I would like to see such a taxonomy as it relates to Bloom's updated (Anderson 2001) taxonomy. I, for one, would like to see something like that to help instructional designers understand and create better GBL/Serious Games/Simulations.

Thanks,
Rick
Rick,
Thanks for the comment and your research in this area. There have been other studies but, unfortunately, many are trapped behind pay-walls so I wanted to make a study available so other could draw conclusions and your study is perfect.

I agree that a game taxonomy would be helpful, I think one problem with that approach is that games aren't "clean" it is really hard, for example, to seperate the characters in a story from the story itself. So the question becomes, which adds the learning value, having characters or having a story and, if you have both, is the value multiplied?

I do understand the need but the basis for such a taxonomy is going to have to be a work in progress until research progresses more in this area.

The good news is we do know games teach and we know they teach difficult to learn topic quite well.

Thanks for the comment,
Karl
Karl's comments echo his most recent book about gamification. I agree with his main point, that games offer unique affordances, but it seems unnecessary to say that "games teach." That's a bit like saying pots cook, or cars drive.

It might be better to say that games provide well-endowed platforms or situations for learning. I think this would be in line with perspectives of experts like Csikszentmihalyi, Ericsson and Sutton-Smith.

If revised the statement is accepted, does that then mean the game is teaching? In my view, no, it doesn't. It means that the student is learning and the game is providing a variety of supports to optimize learning experience.

So if the game is not teaching, who is? Karl in his book and most of us would agree, the designer and SME are teaching albeit in a way that Ruth might not recognize.
"Students 40 years and under scored significantly higher with game play, while students 41 and older did not." Why? Does the necessity of learning to play games make it worthwhile only for those who already know basic gaming rules?
Or is it that the younger group required more knowledge acquisition that the older group already had and gaming would not help with higher levels of learning?
@knlistman: Careful reading of the study reveals the researchers' explanation: "Although not a finding, of particular note within the Age groups is the 41-50 without game students scored significantly higher than the 18-20 without game students. Also, although the 41-50 with game students was not significantly lower than the 41-50 without game students, it was, however lower. This anecdotal
evidence reinforces the perception that older age groups learns better through parochial “tell-test” methods they grew up with than through technology-enhanced environments." However, as a learner considerably older than 41 myself, I can assure you that it is dangerous to generalize that comment -- the n in the study was small, the evidence was anecdotal, and not all of us older learners do better with "tell-test". More study is needed, and I think the researchers would agree with that.
THANK YOU for this important rebuttal. You beat my post to the punch as I also wrote one and planned to publish next week.

I highly value Dr. Clark's contributions to the field of learning. I think she missed the mark and did some harm with her post with the provocative title, "Why Games Don't Teach." I was quite surprised that Dr. Clark ignored Blunt's research as it is quite compelling. I was further surprised by her interpretation of Hays' research. Finally, I was surprised she ignored the taxonomy presented not only in your most recent book, The Gamification of Learning and Instruction but also in your 2007 book, Gadgets, Games and Gizmos for Learning (pp. 46-73).

My suspicion is that perhaps Dr. Clark wanted to re-direct people to the wealth of research that exists? Perhaps she hoped to encourage those who are jumping onto the games/gamificaiton bandwagon in recent months to stop and explore the wealth of research available - and make discerning choices about the most appropriate game types or gamification techniques rather than just assuming any game will teach?

I personally am happy to share results of games we've produced. In 25+ years as a practitioner I can say that games have been far more effective as learning tools than other formats - and that whether people realize it or not, they often do use game elements in their instruction - because they recognize those elements as effective. This usage is not new; however, by explicitly focusing on what makes that usage work well, we can increase the appropriate usage of such elements and maximize the learning experience.
To Bill1: As one of the researchers Karl mentioned, I absolutely agree with you that more research is needed. We need to develop a much better understanding of exactly what aspects/mechanics/functionalities in what kinds (genres) of games can "teach" exactly what for who. (Sorry for the run-on sentence) I would love to see a consensus-built, research-based detailed taxonomy fore designing learning games.

Thanks,
Rick Blunt
All the studies quoted in this article seem to compare game-based learning (GBL) to traditional lectures and then conclude that GBL is more efficient than lectures. Guess what, anything is better than lectures so what does that prove?

What I still need to see is a comparison of how GBL compares to other moderns learning methodologies such as online branching scenarios or virtual 3D simulations. After all, games are nothing more that gamified versions of these training tools. The real question should be: What is the added value of gamification of learning tools?

On the other side of the argument, Cognitive Evaluation Theory experiments show that extrinsic rewards (money, gifts, public recognition) negatively impact intrinsic motivation (eg. learning). Do people complete learning games just for the rewards (points, levels, badges) or because they want to learn more?

Should learning be fun? Of course, but we shall not sacrifice efficiency for the sake of fun. I'm not saying that GBL is worthless but I believe we can probably get the same level of engagement with well designed interactive content which does not distract the learner from the primary objective: learning.

Related Articles

Ask trainers to define what they mean by the term “game” and you will likely hear a mix of features or examples. The problem is that many things that could be called a game do not necessarily lead to learning. A leader in the field of instructional technology takes on the question: Is it right to advocate games as a main or frequent instructional strategy?
Recent research challenges the assumption that games are not an appropriate channel for learning. By focusing on delivering the necessary experience, designers can produce meaningful, engaging eLearning as games. Here are guidelines to effective mechanics, story, aesthetics, and technology selection that support contextualized practice, invitation to action, and self-assessment of decisions.
If you’re up to the challenge, Karl Kapp’s latest book offers best practices, design considerations, and pragmatic recommendations that will surely change the way you think about enhancing your learning initiatives through the use of games.