The importance of gaze and gesture in interactive mulitmodal explanation.

Kristine Lund (1)

1 ICAR - Interactions, Corpus, Apprentissages, Représentations

The objective of this research is twofold. Firstly, we argue that gaze and gesture play an essential part in interactive explanation and that it is thus a multimodal phenomenon. Two corpora are analyzed: (1) a group of teacher novices and experts and (2) a student teacher dyad, both of whom construct explanations of students' reasoning after viewing videos of student dyads who are solving physics problems. We illustrate
roles of gaze in explanations constructed within a group and roles of gesture in explanation constructed within a dyad. Secondly, we show how the analysis of such knowledge-rich empirical data pinpoints particular difficulties in designing human-computer interfaces that can support explanation between humans, or a fortiori, that can support explanation between a human and a computer.

Mots clés: Collaboration; Computer-mediated human interaction; Interactive explanation; Gaze; Gesture; Multimodal<br />communication

Domaines: Linguistique; Education

Kristine Lund. The importance of gaze and gesture in interactive mulitmodal explanation.. International Journal of Language Resources and Evaluation, 2007, 41 (3-4), pp.289-303. ⟨10.1007/s10579-007-9058-0⟩. ⟨halshs-00373412⟩