Acoustic-based fluency classification using LSTM-Attention with computationally-cheap data augmentation for an adaptive voicebot - IMT Atlantique Access content directly
Preprints, Working Papers, ... Year : 2023

Acoustic-based fluency classification using LSTM-Attention with computationally-cheap data augmentation for an adaptive voicebot

Abstract

Most voicebots still ignore, nowadays, user fluency level, although recognizing it would allow to give answers to adaptation issues, according to the language level of the interlocutor. Towards to such an end, this paper proposes a fluency classification model using a small audio dataset. We extract various features such as Mel-frequency cepstral coefficients (MFCC) from the audio. Using recent classification models, such as CNN-LSTM-Attention and Wav2vec 2.0, we propose fluency classification models through three usual categories (Low, Intermediate and High). Furthermore, we demonstrate that simple data augmentation methods can improve classification accuracy. We employ several simple data augmentation techniques, such as speed and pitch scale variation. This augmentation multiplies by 6 the number of training samples when applied only to original samples, and by 32 when also applied to augmented samples.
Fichier principal
Vignette du fichier
Acoustic-based_fluency_classification_using_LSTM-attention_with_computationally-cheap_data_augmentation_for_an_adaptive_voicebot.pdf (323.52 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Licence : CC BY - Attribution

Dates and versions

hal-04105008 , version 1 (24-05-2023)

Licence

Attribution

Identifiers

  • HAL Id : hal-04105008 , version 1

Cite

Papa Séga Wade, Mihai Andries, Ioannis Kanellos, Thierry Moudenc. Acoustic-based fluency classification using LSTM-Attention with computationally-cheap data augmentation for an adaptive voicebot. 2023. ⟨hal-04105008⟩
115 View
97 Download

Share

Gmail Facebook X LinkedIn More