Skip to Main content Skip to Navigation
Conference papers

Does peer grading work? How to implement and improve it? Comparing instructor and peer assessment in MOOC GdP

Rémi Bachelet 1, * Drissa Zongo 1 Aline Bourelle 1
* Corresponding author
Abstract : Large scale peer assessment is arguably the most critical innovation required for development of MOOCs. Its core principle is to involve students in the evaluation and feedback process of correcting assignments. However, it has been criticized for being less rigorous than instructor assessment, too demanding on students and not reliable or fair due to student biases. This paper is drawn from data and practical hands-on experience from MOOC GdP2, in which assignments were both graded by instructors and by peers. Using data from 4650 papers, each graded by 3-5 peers and by an instructor, we test hypotheses and discuss a series of questions: How to train MOOC students to grade their peers? Is peer grading as accurate as instructor grading? What data pre-processing is to be used prior to testing hypotheses on peer grading? Which grading algorithm is best for processing peer-produced data? Is anonymity in peer assessment preferable to increased student interaction? We also present the improved peer grading systems we implemented in MOOC GdP 3 and 4 thanks to this research.
Complete list of metadatas

Cited literature [4 references]  Display  Hide  Download

https://halshs.archives-ouvertes.fr/halshs-01146710
Contributor : Rémi Bachelet <>
Submitted on : Tuesday, May 12, 2015 - 5:40:28 PM
Last modification on : Tuesday, September 17, 2019 - 9:40:14 AM
Long-term archiving on: : Monday, September 14, 2015 - 11:31:38 PM

File

Emoocs2015 - Does peer grading...
Files produced by the author(s)

Identifiers

  • HAL Id : halshs-01146710, version 2

Collections

Citation

Rémi Bachelet, Drissa Zongo, Aline Bourelle. Does peer grading work? How to implement and improve it? Comparing instructor and peer assessment in MOOC GdP. European MOOCs Stakeholders Summit 2015, May 2015, Mons, Belgium. ⟨halshs-01146710v2⟩

Share

Metrics

Record views

1156

Files downloads

1763