An educational platform to capture, visualize and analyze rare singing

P Chawah (1) , T Fux (1) , Martine Adda-Decker (1) , A Amelot (1) , N Audibert (1) , B Denby (2) , G Dreyfus (2) , A Jaumard-Hakoun (2) , C Pillot-Loiseau (1) , P Roussel (2) , M Stone (3) , K Xu (2) , L Buchman (1)

1 LPP - LPP - Laboratoire de Phonétique et Phonologie - UMR 7018
2 SIGMA - Laboratoire Signaux, Modèles et Apprentissage Statistique
3 VTVL - Vocal Tract Visualization Lab [Baltimore]

This paper presents an early version of an open extendable research and educational platform to support users in learning and mastering the different types of rare-singing. The platform is interfaced with a portable helmet to synchronously capture multiple signals during singing in a non-laboratory environment. Collected signals reflect articulatory movements and induced vibrations. The platform consists of four main modules: i) a capture and recording module, ii) a data replay (post processing) module, iii) an acoustic auto adaptation learning module, iv) and a 3D visualization sensory motor learning module. Our demo will focus on the first two modules. The system has been tested on two rare endangered singing musical styles, the Corsican " Cantu in Paghjella " , and the Byzantine hymns from Mount Athos, Greece. The versatility of the approach is further demonstrated by capturing a contemporary singing style known as " Human Beat Box. "

Mots clés: ultrasound sensor; singing analysis; synchronous data capturing; i-Treasures project; Index Terms: education platform

Domaines: Linguistique

P Chawah, T Fux, Martine Adda-Decker, A Amelot, N Audibert, et al.. An educational platform to capture, visualize and analyze rare singing. ISCA, INTERSPEECH 2014: Show & Tell Contribution., Sep 2014, Singapour, Singapore. pp.2128-2129. ⟨halshs-01070124⟩