Badges for Learning
Recently, I’ve been thinking a lot about using badging systems to support student learning. There is great potential for using badging systems to add a game layer to learning in the traditional classroom, thereby increasing student engagement and learning outcomes.
Last year at SxSWi, Seth Priebatsch from SCVNGR gave a keynote (video) about adding a game layer on top of the world. If you don’t have much time, I’d recommend skipping to the part about game mechanics and engagement in education which starts at 10:30. Seth’s talk sparked a number of ideas for me, one of which grew to be our proposal Game Dynamics in the Classroom: Badges to Improve Student Engagement and Learning in Large Lecture Courses for the Digital Media + Learning Research Competition.
The gist (straight from our proposal):
The goal of this project is to create and evaluate a badging system for learning in order to increase college student academic engagement and improve class attendance and academic performance. We hypothesize that we can improve college student academic outcomes by combining Location Based Services (LBS) with a badging system employing game dynamics and integrating it in an educationally-relevant way in a large-lecture course at The University of Florida.
I’m really excited that we were able to partner with SCVNGR to develop a badging system for this project. If the project gets funded, we’ll use an experimental design to evaluate the impact of integrating our badging system and related game dynamics into large lecture courses. As outcomes, we’ll measure differences in student engagement, attendance, and academic performance between the experimental group and the control group. Here are our methods:
Research design
Before the semester begins, university students registered for a large-lecture introductory course will be randomly assigned to either a control section or an experimental section. Both the control and experimental sections will be taught by the same instructor and will follow the same schedule in the presentation of course material. Each section will contain at least 200 students for a total of 400 participants. The Institutional Review Board for the Protection of Human Subjects will approve research proceduresExperimental Section
Students in the experimental section will use their Android or iOS devices to engage in academic challenges in order to earn badges. Students will check in to the classroom after indicated class sessions. Once they check in, they will be presented with a challenge that involves answering five questions about that day’s lecture, developed in consultation with the course instructor. Students will receive a point for each question they answer correctly. They will also receive points for checking in to the class location, posting pictures of their notes, and posting questions about the day’s lecture. Additionally, students will receive points towards badges by participating in relevant challenges outside of class, including “social check-ins” with a study group, visiting a professor/TA’s office or supplementary instruction session, or checking into the tutoring center.When a student accumulates a pre-determined amount of points, she or he will receive a badge. Students may earn one badge for each week of the course. At the end of the semester, students will receive course extra credit based on the number of badges they have earned.
Control Section
Students in the control section will have the opportunity to answer the same questions as the experimental group; however, these questions will be presented as quizzes using TurningTechnologies ResponseWare. ResponseWare allows students to submit answers by using either their mobile phones or their laptop computers. The quizzes will include the same content and be administered at the same time as the experimental group. Control group students will also be able to complete the other challenges, but they will be presented as extra credit opportunities accompanied by manual tracking methods and a traditional scoring rubric equivalent to the badge system.
You can read the entire proposal here. I’d love to hear your thoughts on this project. Please feel free to leave a comment below or on the proposal page at the DML site.
The truth about Facebook and grades infographic
I’m very excited that yet another graphic designer has taken me up on my offer to work with me on creating a graphic that accurately represents the results of one of my research papers. This one is based on my paper Too much face and not enough books: The relationship between multiple indices of Facebook use and academic performance published in Computers in Human Behavior.
I really would love to see this become a trend– infographics that are as much info as they are graphics. Elsewhere, I picked apart an infographic reporting some of my research on Facebook. I also lamented how it would be nice to see an infographic that included a more balanced approach to research findings (including limitations). Lucky for me, graphic designers read my blog. The first infographic based on my research did a great job summarizing the findings of my recent Facebook and student engagement paper.
I’ve got some ideas for infographics based on recent data that I’ll be working on in the near future. What data would you like to see represented in an infographic? Please leave your suggestions in the comments below.
Facebook and student engagement infographic
As you may recall, a while ago I posted a call to graphic artists to work with me on creating an infographic that accurately represents the results of a research paper. Thanks to Ed Cabellon and his team at the the Rondileau Campus Center at Bridgewater State University, we have this infographic based on my paper The relationship between frequency of Facebook use, participation in Facebook activities, and student engagement published in Computers & Education. Special thanks to the designer, Becca Light.
[Edit 10/5/11]: A number of people have been asking if they can use this graphic. The answer is– of course you can! This infographic is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License which means that you can post it to your own site, share, or adapt the graphic as long as you’re not using it for commercial purposes and as long as you reference the source. You may also be interested in a higher resolution jpeg [6.2M] or a PDF version suitable for printing [~1M]
[Edit 10/12/11]: Thanks to Sandra Cortesi and Kristi Grande who noticed that the graphic representing the mean number of times students checked Facebook was missing one student at the computer. I have linked to the revised infographic (the updated version is also available as a higher resolution jpeg [6.2M] or a PDF version suitable for printing [~1M]).
Texting and using Facebook while studying related to lower GPAs
This week, Shelia Cotten and I will present a paper on multitasking at the Oxford Internet Institute’s A Decade in Internet Time Symposium on the Dynamics of the Internet and Society.
We have posted the draft of the paper here. Please note that the paper is in draft form and it has yet to be peer reviewed. Therefore, we’d love it if those of you reading this would act as peer reviewers and provide us feedback about the paper. We’ll incorporate any feedback before we submit the paper for publication in an academic journal. We are particular interested in your thoughts about our interpretation of the results. Please feel free to share your feedback in the comments below or to email me directly at rey (period) junco at gmail. We’ll acknowledge any feedback we use in the paper.
Using hierarchical linear regression (N = 1,839) with gender, ethnicity, parental education level, high school GPA, and Internet skills as control variables, we found that frequency of sending text messages and using Facebook while doing schoolwork were negatively related to overall GPA. However, frequency of using email while doing schoolwork was positively related to GPA.
The finding that using Facebook and texting while doing schoolwork was negatively related to GPA was congruent with previous research on multitasking however, the finding that using email while doing schoolwork wasn’t. We theorize that the reason for this discrepancy is because of how the technologies are used– students use Facebook and texting socially with their peers while they use email to communicate with faculty and university staff. Therefore, we propose that social activities will lead to more negative outcomes while academic activities will lead to more positive ones.
As with my recent study of Facebook use and engagement, these data are cross sectional and correlational and while it’s intriguing to think that multitasking causes students to have lower grades, it is equally likely that students who have lower GPAs happen to spend more time multitasking. There is more than likely an extraneous causal variable related to both multitasking and student academic achievement that we have yet to measure. We’ll examine this more in future research.
#NoFailWhale: Tweet More, Drop Out Less – SxSWi 2012
Last year, I gave a solo talk at SxSWi where I presented data on how Twitter can be used to improve student engagement and grades.
For next year, I’ve proposed a solo talk entitled #NoFailWhale: Tweet More, Drop Out Less. I’ll present brand new data on how Twitter can be used to improve understanding of course content and to reduce college dropout rates. Since I’ve just finished collecting some of the data, there’s still more neat stuff to be analyzed. For instance, I’m going to evaluate how compliance with a Twitter intervention affects retention of course content (you might think it’s a straightforward relationship, but I’ve got some preliminary data to show that it isn’t).
I’m also going to be pulling together data across studies to come up with the beginnings of best practices in using Twitter in higher education.
If you think this is a cool idea, please vote for my panel by clicking here (you’ll need to sign up for an account – it’s quick and painless and SxSW won’t spam you). I’d love to hear your thoughts about the talk – please leave comments on the proposal page and I’ll make sure to address those comments during my talk.
While you’re at it, please vote for the core conversation being proposed by my friends and colleagues, Liz Gross and Ed Cabellon. See you at SxSWi 2012!
Time spent on Facebook is related to involvement in campus activities
These findings are from my latest paper “The relationship between frequency of Facebook use, participation in Facebook activities, and student engagement“ to be published in an upcoming issue of Computers and Education. I asked students to estimate (using a few different indices) their frequency of using Facebook and what they did while on Facebook and then related those frequencies to engagement outcomes. This study is unique in that it’s the first one to connect what students do on Facebook to outcomes. Other studies of Facebook use and academic outcomes have used non-continuous measures of time spent. As some of you know, that’s one of my research pet peeves– truncating your variance before the fact.
On to the results– using hierarchical linear regression (N = 2,368) with gender, ethnicity, and parental education level as control variables, I found that time spent on Facebook was a significant positive predictor of time spent in campus activities.
Although time spent on Facebook was a significant positive predictor, it wasn’t the strongest predictor of time spent in campus activities. In fact, it was the weakest predictor. The strongest positive predictors, in order of strength (with strongest first), were:
- Creating or RSVPing to events on Facebook
- Commenting
- Viewing Photos
- Average time spent on Facebook per day
There were also negative predictors of time spent in campus activities. In order of strength, they were:
- Posting photos
- Checking up on friends (or what students call “stalking,” “creeping,” or “lurking”)
- Playing games on Facebook (as an aside, I’m so happy to have data showing that Farmville and Mafia Wars are “bad”
)
First semester students and sophomores spend more time on Facebook
Lately, I’ve spent quite a bit of time analyzing data we collected in the Fall of 2010. While I was conducting a completely unrelated analysis, I noticed differences in the mean time spent on Facebook by students in different classes so I thought I’d take a closer look.
I ran an analysis of covariance (ANCOVA) with student class rank as the independent variable, self-reported average minutes per day spent on Facebook as the dependent variable, and gender, ethnicity, and highest parental education level as covariates (N=2,346). For post hoc tests, I used the least significant difference (LSD) correction. The reason I chose to control for gender, ethnicity, and parental education level is because there’s plenty of research to show that these background variables are quantitatively and qualitatively related to technology use. If you’re not familiar with research on the digital divide, I highly recommend you read this paper on variation in Internet skills among youth.
Here’s what I found:
- First semester students (FF) spent as much time as sophomores (SO) on Facebook.
- First semester students (FF) and sophomores (SO) spent more time on Facebook than Juniors (JR).
- Juniors (JR) spent more time on Facebook than both Seniors (SR) and first year students not in their first semester (FR).

These results can be summarized by the following equation:
FF = SO > JR > SR =FR
So, first semester students and sophomores spent more time on Facebook than any other group. I’ve got my own thoughts about why this might be, but I’d love to hear what you think. Please share your ideas in the comments below.
“Is Twitter Hurting Your Grades?” Infographic
Two weeks ago I posted my thoughts and additional research evidence in response to the “Is Social Media Ruining Students?” infographic. I’ve often hoped that someone would create an infographic that used my data but that also didn’t jump to sensational conclusions. Looks like someone did just that– this infographic uses data from our Twitter study. What I’d really love to see is an infographic that summarizes an academic paper– that is, not only represents the interesting findings, but also the limitations. There’s only one way to do that: by teaming the artist up with the researcher.
I’ve got the data, do you have the skills? Drop me a line.

Over the last year, I’ve conducted or collaborated on a number of studies examining the use of social media in the classroom. One thing has been clear from our observations in those studies: when given the choice of a number of social technologies to use as part of a course, students will overwhelmingly choose Facebook. This week, I finished analyzing new data showing this to be the case.





