Silent vs Vocalized Articulation for a Portable Ultrasound-Based Silent Speech Interface

Victoria-M. Florescu (1) , Lise Crevier-Buchman (2, 3) , Bruce Denby (1) , Thomas Hueber (4) , Antonia Colazo-Simon (2) , Claire Pillot-Loiseau (2) , Pierre Roussel (1) , Cédric Gendrot (2) , Sophie Quattrocchi (2)

1 SIGMA - Laboratoire Signaux, Modèles et Apprentissage Statistique
2 LPP - LPP - Laboratoire de Phonétique et Phonologie - UMR 7018
3 Voice & Speech lab
4 GIPSA-MAGIC - GIPSA - Machines parlantes, Gestes oro-faciaux, Interaction Face-à-face, Communication augmentée

Silent Speech Interfaces have been proposed for communication in silent conditions or as a new means of restoring the voice of persons who have undergone a laryngectomy. To operate such a device, the user must articulate silently. Isolated word recognition tests performed with fixed and portable ultrasound based silent speech interface equipment show that systems trained on vocalized speech exhibit reduced performance when tested on silent articulation, but that training with silently articulated speech allows to recover much of this loss.

Mots clés: silent speech interface; ultrasound; articulation

Domaines: Linguistique

Victoria-M. Florescu, Lise Crevier-Buchman, Bruce Denby, Thomas Hueber, Antonia Colazo-Simon, et al.. Silent vs Vocalized Articulation for a Portable Ultrasound-Based Silent Speech Interface. Interspeech 2010 - 11th Annual Conference of the International Speech Communication Association, Sep 2010, Makuhari, Japan. pp.450-453, ⟨10.21437/Interspeech.2010-195⟩. ⟨halshs-00683750⟩