Evaluation of Evidence-Based Practices in Online Learning

A Meta-Analysis and Review of Online Learning Studies

Each of you please answer the following questions on the class wiki as indicated, although I want you to “talk/collaborate” with one another in the class as you answer these questions.

1.      What were the measures used in this study?

In this report, analysts contrasted an online to a face-to-face condition,  measured student learning outcomes, and calculated an effect size. The meta-analysis found that students in an online learning class preformed better than those receiving face-to-face instruction. The study also looked at contrasting different versions of online learning, which explored online learning with and without elements such as video, online quizzes, assigned groups, or guidance for online activities. The overall goal of this study is to provide research-based guidance to policy makers, administrators, and educators for implementing online learning for K-12 education.

2.      How did the researchers define “better”?

The first use of "better" is found in the abstract; "The meta-analysis found that, on average, students in online learning conditions performed modestly better than those receiving face-to-face instruction"  (ix). This is showing an effect size of +0.20 for learning outcomes for students who engaged in online learning exceeded those of face-to-face instruction. The performance of students in this study shows that students performed better than their peers in conventional classrooms.

3.      How did the researchers define “performance?

Researchers use "performance" to see how well student outcomes are in online instructions compared to face-to-face instruction. They also use "performance" when talking about assessments (writing assessments, multiple choice tests).