Does peer grading work? How to implement and improve it? Comparing instructor and peer assessment in MOOC GdP

Rémi Bachelet 1, * Drissa Zongo 1 Aline Bourelle 1
* Auteur correspondant
Abstract : Large scale peer assessment is arguably the most critical innovation required for development of MOOCs. Its core principle is to involve students in the evaluation and feedback process of correcting assignments. However, it has been criticized for being less rigorous than instructor assessment, too demanding on students and not reliable or fair due to student biases. This paper is drawn from data and practical hands-on experience from MOOC GdP2, in which assignments were both graded by instructors and by peers. Using data from 4650 papers, each graded by 3-5 peers and by an instructor, we test hypotheses and discuss a series of questions: How to train MOOC students to grade their peers? Is peer grading as accurate as instructor grading? What data pre-processing is to be used prior to testing hypotheses on peer grading? Which grading algorithm is best for processing peer-produced data? Is anonymity in peer assessment preferable to increased student interaction? We also present the improved peer grading systems we implemented in MOOC GdP 3 and 4 thanks to this research.
Type de document :
Communication dans un congrès
European MOOCs Stakeholders Summit 2015, May 2015, Mons, Belgium. Proceedings of the Research Track
Liste complète des métadonnées

Littérature citée [4 références]  Voir  Masquer  Télécharger

https://halshs.archives-ouvertes.fr/halshs-01146710
Contributeur : Rémi Bachelet <>
Soumis le : mardi 12 mai 2015 - 17:40:28
Dernière modification le : jeudi 14 mai 2015 - 01:10:13
Document(s) archivé(s) le : lundi 14 septembre 2015 - 23:31:38

Fichier

Emoocs2015 - Does peer grading...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : halshs-01146710, version 2

Collections

Citation

Rémi Bachelet, Drissa Zongo, Aline Bourelle. Does peer grading work? How to implement and improve it? Comparing instructor and peer assessment in MOOC GdP. European MOOCs Stakeholders Summit 2015, May 2015, Mons, Belgium. Proceedings of the Research Track. 〈halshs-01146710v2〉

Partager

Métriques

Consultations de
la notice

627

Téléchargements du document

838