Adversary-Resilient Distributed Estimation using Intermittent and Heterogeneous Data with Application to Network Tomography - IMT Atlantique
Pré-Publication, Document De Travail Année : 2024

Adversary-Resilient Distributed Estimation using Intermittent and Heterogeneous Data with Application to Network Tomography

Résumé

Robustness to adversarial attacks in online distributed learning within a single parameter server and multiple worker node framework is a critical research area. Traditional methods for this setup achieve resilience through a two-step process in each iteration. First, all worker nodes synchronize to compute and communicate identical quantities, such as gradients at a shared point, to the server. Then, the server uses a robust aggregate of these quantities---obtained via techniques like the median or trimmed mean---to update its solution estimate. However, this approach falls short in applications like network tomography, where the measurements across different nodes are sporadic and heterogeneous. A novel two-timescale algorithm was recently proposed to deal with such scenarios. In this study, we establish that its convergence rate is \(O(1/\sqrt{n})\), which is optimal for non-strongly convex optimization. Separately, due to the sporadic nature of data, it is inevitable that this rate expression degrades when more honest agents are incorporated into the system. For a fixed number of adversaries, our work reveals that this degradation is of order $O(\sqrt{N}),$ where $N$ is the number of worker nodes. Lastly, we demonstrate the applicability of this algorithm and our theoretical results to network tomography.
Fichier principal
Vignette du fichier
Network_Tomography_with_Adversaries.pdf (527.77 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04584407 , version 1 (23-05-2024)

Identifiants

  • HAL Id : hal-04584407 , version 1

Citer

Gugan Thoppe, Mihir Dhankshiru, Nibedita Roy, Alexandre Reiffers-Masson, Naman Naman, et al.. Adversary-Resilient Distributed Estimation using Intermittent and Heterogeneous Data with Application to Network Tomography. 2024. ⟨hal-04584407⟩
39 Consultations
111 Téléchargements

Partager

More