Referring to Objects Through Sub-Contexts in Multimodal Human-Computer Interaction

Frédéric Landragin (1) , Laurent Romary (1)

1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component

There is no one-to-one relation between referential terms and types of access to the referents (referring modes) in multimodal human-computer interaction. We propose a classification of referring modes implying sub-contexts. We describe in detail the nature of these contextual subsets and we show their importance for each type of referring action. Then we define a relation between terms and modes, and we deduce a list of disambiguation principles for the computation of referential terms in order to identify the correct referring mode, the correct sub-context, and the correct referent.

Mots clés: Referring modes; multimodality; co-verbal gesture; determiners

Domaines: Linguistique; Sciences de l'information et de la communication; Informatique; Linguistique

Frédéric Landragin, Laurent Romary. Referring to Objects Through Sub-Contexts in Multimodal Human-Computer Interaction. Seventh Workshop on the Semantics and Pragmatics of Dialogue (DiaBruck'03), Sep 2003, Saarbrücken, Germany. pp.67-74. ⟨halshs-00136514⟩