Rights statement: The final publication is available at Springer via http://dx.doi.org/[insert DOI]
Accepted author manuscript, 4.77 MB, PDF document
Available under license: CC BY-NC: Creative Commons Attribution-NonCommercial 4.0 International License
Final published version
Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review
Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review
}
TY - GEN
T1 - Parallel computing TEDA for high frequency streaming data clustering
AU - Gu, Xiaowei
AU - Angelov, Plamen Parvanov
AU - Gutierrez, German
AU - Iglesias, Jose Antonio
AU - Sanchi, Araceli
PY - 2016/10/23
Y1 - 2016/10/23
N2 - In this paper, a novel online clustering approach called Parallel_TEDA is introduced for processing high frequency streaming data. This newly proposed approach is developed within the recently introduced TEDA theory and inherits all advantages from it. In the proposed approach, a number of data stream processors are involved, which collaborate with each other efficiently to achieve parallel computation as well as a much higher processing speed. A fusion center is involved to gather the key information from the processors which work on chunks of the whole data stream and generate the overall output. The quality of the generated clusters is being monitored within the data processors all the time and stale clusters are being removed to ensure the correctness and timeliness of the overall clustering results. This, in turn, gives the proposed approach a stronger ability of handling shifts/drifts that may take place in live data streams. The numerical experiments performed with the proposed new approach Parallel_TEDA on benchmark datasets present higher performance and faster processing speed when compared with the alternative well-known approaches. The processing speed has been demonstrated to fall exponentially with more data processors involved. This new online clustering approach is very suitable and promising for real-time high frequency streaming processing and data analytics.
AB - In this paper, a novel online clustering approach called Parallel_TEDA is introduced for processing high frequency streaming data. This newly proposed approach is developed within the recently introduced TEDA theory and inherits all advantages from it. In the proposed approach, a number of data stream processors are involved, which collaborate with each other efficiently to achieve parallel computation as well as a much higher processing speed. A fusion center is involved to gather the key information from the processors which work on chunks of the whole data stream and generate the overall output. The quality of the generated clusters is being monitored within the data processors all the time and stale clusters are being removed to ensure the correctness and timeliness of the overall clustering results. This, in turn, gives the proposed approach a stronger ability of handling shifts/drifts that may take place in live data streams. The numerical experiments performed with the proposed new approach Parallel_TEDA on benchmark datasets present higher performance and faster processing speed when compared with the alternative well-known approaches. The processing speed has been demonstrated to fall exponentially with more data processors involved. This new online clustering approach is very suitable and promising for real-time high frequency streaming processing and data analytics.
U2 - 10.1007/978-3-319-47898-2_25
DO - 10.1007/978-3-319-47898-2_25
M3 - Conference contribution/Paper
SN - 9783319478975
SP - 238
EP - 253
BT - Advances in Big Data
A2 - Angelov, Plamen
A2 - Manolopoulos, Yannis
A2 - Iliadis, Lazaros
A2 - Roy, Asim
A2 - Vellasco, Marley
PB - Springer
CY - Cham
T2 - 2nd International Neural Network Society Conference on Big Data, INNS 2016
Y2 - 23 October 2016 through 25 October 2016
ER -