DABS-Storm: A Data-Aware Approach for Elastic Stream Processing - Archive ouverte HAL Access content directly
Journal Articles Transactions on Large-Scale Data- and Knowledge-Centered Systems Year : 2019

DABS-Storm: A Data-Aware Approach for Elastic Stream Processing

(1) , (1) , (1) , (2, 3) , (4, 5, 6)
1
2
3
4
5
6

Abstract

In the last decade, stream processing has become a very active research domain motivated by the growing number of stream-based applications. These applications make use of continuous queries, which are processed by a stream processing engine (SPE) to generate timely results given the ephemeral input data. Variations of input data streams, in terms of both volume and distribution of values, have a large impact on computational resource requirements. Dynamic and Automatic Balanced Scaling for Storm (DABS-Storm) is an original solution for handling dynamic adaptation of continuous queries processing according to evolution of input stream properties, while controlling the system stability. Both fluctuations in data volume and distribution of values within data streams are handled by DABS-Storm to adjust the resources usage that best meets processing needs. To achieve this goal, the DABS-Storm holistic approach combines a proactive auto-parallelization algorithm with a latency-aware load balancing strategy.
Fichier principal
Vignette du fichier
AS-OSG.pdf (2.34 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01951682 , version 1 (11-12-2018)

Identifiers

Cite

Roland Kotto-Kombi, Nicolas Lumineau, Philippe Lamarre, Nicoló Rivetti, Yann Busnel. DABS-Storm: A Data-Aware Approach for Elastic Stream Processing. Transactions on Large-Scale Data- and Knowledge-Centered Systems, 2019, 40, pp.58--93. ⟨10.1007/978-3-662-58664-8_3⟩. ⟨hal-01951682⟩
439 View
575 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More