Acoustic-based fluency classification using LSTM-Attention with computationally-cheap data augmentation for an adaptive voicebot - IMT Atlantique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Acoustic-based fluency classification using LSTM-Attention with computationally-cheap data augmentation for an adaptive voicebot

Résumé

Most voicebots still ignore, nowadays, user fluency level, although recognizing it would allow to give answers to adaptation issues, according to the language level of the interlocutor. Towards to such an end, this paper proposes a fluency classification model using a small audio dataset. We extract various features such as Mel-frequency cepstral coefficients (MFCC) from the audio. Using recent classification models, such as CNN-LSTM-Attention and Wav2vec 2.0, we propose fluency classification models through three usual categories (Low, Intermediate and High). Furthermore, we demonstrate that simple data augmentation methods can improve classification accuracy. We employ several simple data augmentation techniques, such as speed and pitch scale variation. This augmentation multiplies by 6 the number of training samples when applied only to original samples, and by 32 when also applied to augmented samples.
Fichier principal
Vignette du fichier
Acoustic-based_fluency_classification_using_LSTM-attention_with_computationally-cheap_data_augmentation_for_an_adaptive_voicebot.pdf (323.52 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04105008 , version 1 (24-05-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04105008 , version 1

Citer

Papa Séga Wade, Mihai Andries, Ioannis Kanellos, Thierry Moudenc. Acoustic-based fluency classification using LSTM-Attention with computationally-cheap data augmentation for an adaptive voicebot. 2023. ⟨hal-04105008⟩
117 Consultations
101 Téléchargements

Partager

Gmail Facebook X LinkedIn More