Home > Research > Publications & Outputs > Handling drifts and shifts in on-line data stre...
View graph of relations

Handling drifts and shifts in on-line data streams with evolving fuzzy systems.

Research output: Contribution to journalJournal articlepeer-review

Published

Standard

Handling drifts and shifts in on-line data streams with evolving fuzzy systems. / Lughofer, Edwin; Angelov, Plamen.

In: Applied Soft Computing, Vol. 11, No. 2, 03.2011, p. 2057-2068.

Research output: Contribution to journalJournal articlepeer-review

Harvard

APA

Vancouver

Author

Lughofer, Edwin ; Angelov, Plamen. / Handling drifts and shifts in on-line data streams with evolving fuzzy systems. In: Applied Soft Computing. 2011 ; Vol. 11, No. 2. pp. 2057-2068.

Bibtex

@article{73e8bd63c613484f830a456ee667196e,
title = "Handling drifts and shifts in on-line data streams with evolving fuzzy systems.",
abstract = "In this paper, we present new approaches to handling drift and shift in on-line data streams with the help of evolving fuzzy systems (EFS), which are characterized by the fact that their structure (rule base and parameters) is not xed and not pre-determined, but is extracted from data streams on-line and in an incremental manner. When dealing with so-called drifts and shifts in data streams, one needs to take into account 1) automatic detection of drifts and shifts, and 2) automatic reaction to the drifts and shifts. This is important to avoid interruptions in the learning process and downtrends in predictive accuracy. To address the rst problem, we propose an approach based on the concept fuzzy rule age. The second problem is addressed by including gradual forgetting of 1.) antecedent parts and 2.) consequent parameters. The latter can be achieved by including a forgetting factor in the recursive local learning process of the parameters, whose value is automatically extracted based on the intensity of the shift/drift. For addressing the former problem, we introduce two alternative methods: one is based on the evolving density-based clustering (eClustering) used to form the antecedents in the eTS approach; the other is based on the automatic adaptation of the learning rate of the evolving vector quantization (eVQ) method used to form the antecedent in the FLEXFIS approach. The paper concludes with an empirical evaluation of the impact of the proposed approaches in (on-line) real-world data sets in which drifts and shifts occur.",
keywords = "drifts and shifts in data streams, evolving fuzzy systems, eTS, FLEXFIS, detection and reaction to drifts and shifts, age of a cluster/fuzzy rule, gradual forgetting",
author = "Edwin Lughofer and Plamen Angelov",
year = "2011",
month = mar,
doi = "10.1016/j.asoc.2010.07.003",
language = "English",
volume = "11",
pages = "2057--2068",
journal = "Applied Soft Computing",
issn = "1568-4946",
publisher = "Elsevier Science B.V.",
number = "2",

}

RIS

TY - JOUR

T1 - Handling drifts and shifts in on-line data streams with evolving fuzzy systems.

AU - Lughofer, Edwin

AU - Angelov, Plamen

PY - 2011/3

Y1 - 2011/3

N2 - In this paper, we present new approaches to handling drift and shift in on-line data streams with the help of evolving fuzzy systems (EFS), which are characterized by the fact that their structure (rule base and parameters) is not xed and not pre-determined, but is extracted from data streams on-line and in an incremental manner. When dealing with so-called drifts and shifts in data streams, one needs to take into account 1) automatic detection of drifts and shifts, and 2) automatic reaction to the drifts and shifts. This is important to avoid interruptions in the learning process and downtrends in predictive accuracy. To address the rst problem, we propose an approach based on the concept fuzzy rule age. The second problem is addressed by including gradual forgetting of 1.) antecedent parts and 2.) consequent parameters. The latter can be achieved by including a forgetting factor in the recursive local learning process of the parameters, whose value is automatically extracted based on the intensity of the shift/drift. For addressing the former problem, we introduce two alternative methods: one is based on the evolving density-based clustering (eClustering) used to form the antecedents in the eTS approach; the other is based on the automatic adaptation of the learning rate of the evolving vector quantization (eVQ) method used to form the antecedent in the FLEXFIS approach. The paper concludes with an empirical evaluation of the impact of the proposed approaches in (on-line) real-world data sets in which drifts and shifts occur.

AB - In this paper, we present new approaches to handling drift and shift in on-line data streams with the help of evolving fuzzy systems (EFS), which are characterized by the fact that their structure (rule base and parameters) is not xed and not pre-determined, but is extracted from data streams on-line and in an incremental manner. When dealing with so-called drifts and shifts in data streams, one needs to take into account 1) automatic detection of drifts and shifts, and 2) automatic reaction to the drifts and shifts. This is important to avoid interruptions in the learning process and downtrends in predictive accuracy. To address the rst problem, we propose an approach based on the concept fuzzy rule age. The second problem is addressed by including gradual forgetting of 1.) antecedent parts and 2.) consequent parameters. The latter can be achieved by including a forgetting factor in the recursive local learning process of the parameters, whose value is automatically extracted based on the intensity of the shift/drift. For addressing the former problem, we introduce two alternative methods: one is based on the evolving density-based clustering (eClustering) used to form the antecedents in the eTS approach; the other is based on the automatic adaptation of the learning rate of the evolving vector quantization (eVQ) method used to form the antecedent in the FLEXFIS approach. The paper concludes with an empirical evaluation of the impact of the proposed approaches in (on-line) real-world data sets in which drifts and shifts occur.

KW - drifts and shifts in data streams

KW - evolving fuzzy systems

KW - eTS

KW - FLEXFIS

KW - detection and reaction to drifts and shifts

KW - age of a cluster/fuzzy rule

KW - gradual forgetting

U2 - 10.1016/j.asoc.2010.07.003

DO - 10.1016/j.asoc.2010.07.003

M3 - Journal article

VL - 11

SP - 2057

EP - 2068

JO - Applied Soft Computing

JF - Applied Soft Computing

SN - 1568-4946

IS - 2

ER -