Visual lip information supports auditory word segmentation

Antje Strauß 1, * Christophe Savariaux 2, 3 Sonia Kandel 4 Jean-Luc Schwartz 1
* Auteur correspondant
1 GIPSA-PCMD - PCMD
GIPSA-DPC - Département Parole et Cognition
2 GIPSA-Services - GIPSA-Services
GIPSA-lab - Grenoble Images Parole Signal Automatique
3 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
4 GIPSA-VSLD - VSLD
GIPSA-DPC - Département Parole et Cognition
Abstract : Word segmentation is one of the initial processes that needs to be solved when acquiring the first or learning a second language. Acoustic cues like the fundamental frequency and segment durations have been shown to facilitate the detection of word boundaries. The role of visual speech and in particular of lip movements in word segmentation is still rather unknown. In French, liaisons, e.g. between determiner and noun, often pose a problem of several segmentation possibilities (e.g., the sequence /lafiS/ with liaison ("l’affiche") means the poster whereas without liaison ("la fiche") it means the file.). Here, we use 17 ambiguous French sequences with and without liaison. They were presented in carrier sentences either with clear acoustic cues for the first or the second segmentation possibility or with ambiguous acoustic cues. The three audio conditions were combined with lip movements hyper-articulating either the first or the second segmentation possibility in order to observe the influence of visual information on segmentation. The participants had to indicate as quickly as possible which of the two versions they understood (e.g., "l’affiche" or "la fiche"?). Results show that lip information indeed biases the word segmentation decision. These data provide important implications for audiovisual integration processes.
Type de document :
Poster
FAAVSP 2015, Sep 2015, Vienna, Austria
Liste complète des métadonnées

https://halshs.archives-ouvertes.fr/halshs-01298351
Contributeur : Antje Strauss <>
Soumis le : mardi 5 avril 2016 - 17:49:12
Dernière modification le : lundi 9 avril 2018 - 12:22:50
Document(s) archivé(s) le : mercredi 6 juillet 2016 - 15:40:19

Fichier

Strauss_AVSP2015.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : halshs-01298351, version 1

Citation

Antje Strauß, Christophe Savariaux, Sonia Kandel, Jean-Luc Schwartz. Visual lip information supports auditory word segmentation. FAAVSP 2015, Sep 2015, Vienna, Austria. 〈halshs-01298351〉

Partager

Métriques

Consultations de la notice

408

Téléchargements de fichiers

112