Local Mixup: Interpolation of closest input signals to prevent manifold intrusion - IMT Atlantique
Article Dans Une Revue Signal Processing Année : 2024

Local Mixup: Interpolation of closest input signals to prevent manifold intrusion

Résumé

In Machine Learning, Mixup is a data-dependent regularization technique that consists in creating virtual samples by linearly interpolating input signals and their associated outputs. It has been shown to significantly improve accuracy on standard datasets, in particular in the field of vision. However, authors have pointed out that Mixup can produce out-of-distribution virtual samples and even contradictions in the augmented training set, potentially resulting in adversarial effects. In this paper, we introduce Local Mixup in which distant input samples are weighted down when computing the loss. In constrained settings we demonstrate that Local Mixup can create a trade-off between bias and variance, with the extreme cases reducing to vanilla training and classical Mixup. Using standardized computer vision benchmarks, we also show that Local Mixup can improve test accuracy.
Fichier principal
Vignette du fichier
1-s2.0-S0165168424000148-main.pdf (729.8 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence

Dates et versions

hal-04591752 , version 1 (29-05-2024)

Licence

Identifiants

Citer

Raphael Baena, Lucas Drumetz, Vincent Gripon. Local Mixup: Interpolation of closest input signals to prevent manifold intrusion. Signal Processing, 2024, 219, pp.109395. ⟨10.1016/j.sigpro.2024.109395⟩. ⟨hal-04591752⟩
33 Consultations
53 Téléchargements

Altmetric

Partager

More