Relevance and Perceptual Constraints in Multimodal Referring Actions

Frédéric Landragin 1 Antonella De Angeli 1 Frédéric Wolff 1 Patrice Lopez 1 Laurent Romary 1
1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In this chapter we present a first attempt to score the relevance of multimodal referring expressions within a task oriented environment. It is based upon the application of the ecological approach to multimodal system design, which in particular implies that perception has to play a central role in the understanding of a demonstrative gesture. Experimental results are presented, together with the scores obtained by combining the linguistic characteristic of the referring expression and the properties of the corresponding gestures (if any). Even if the calculus that we present is limited to contextual effects and has to be refined, it seems to be already suited to validate our approach regarding the importance of group salience and access type in the choice of a referring mode.
Keywords : Reference to objects Perception Relevance Theory
Type de document :
Chapitre d'ouvrage
Information Sharing: Reference and Presupposition in Language Generation and Interpretation, CSLI Publications, pp.395-413, 2002
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger
https://halshs.archives-ouvertes.fr/halshs-00112841
Contributeur : Frédéric Landragin <>
Soumis le : jeudi 9 novembre 2006 - 19:15:36
Dernière modification le : jeudi 11 janvier 2018 - 06:19:48
Document(s) archivé(s) le : mardi 6 avril 2010 - 22:06:25

Fichier

chapter.pdf

Identifiants

  • HAL Id : halshs-00112841, version 1

Collections

INRIA | LORIA | UNIV-LORRAINE

Citation

Frédéric Landragin, Antonella De Angeli, Frédéric Wolff, Patrice Lopez, Laurent Romary. Relevance and Perceptual Constraints in Multimodal Referring Actions. Information Sharing: Reference and Presupposition in Language Generation and Interpretation, CSLI Publications, pp.395-413, 2002. 〈halshs-00112841〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

384

Téléchargements de fichiers

223

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD