TY - JOUR

T1 - Flow classification by histograms: or how to go on safari in the internet.

AU - Salamatian, Kave

AU - Emilion, Richard

AU - Soule, Augustin

AU - Taft, Nina

N1 - This paper develops a classification method classifying BGP Internet flows into a small set of homogeneous classes. The main innovation of this paper was to develop a new classification method based on modeling flow histograms using Dirichlet Mixture Processes for random distributions. We presented an inference based on Simulated Annealing Expectation Maximization algorithm. The classification method was developed in the context of network flow classification however but had impact also in other areas of statistics such as Financial analysis as it enabled to classify different investment portfolio based on the contents. RAE_import_type : Journal article RAE_uoa_type : Computer Science and Informatics

PY - 2004/6

Y1 - 2004/6

N2 - In order to control and manage highly aggregated Internet traffic flows efficiently, we need to be able to categorize flows into distinct classes and to be knowledgeable about the different behavior of flows belonging to these classes. In this paper we consider the problem of classifying BGP level prefix flows into a small set of homogeneous classes. We argue that using the entire distributional properties of flows can have significant benefits in terms of quality in the derived classification. We propose a method based on modeling flow histograms using Dirichlet Mixture Processes for random distributions. We present an inference procedure based on the Simulated Annealing Expectation Maximization algorithm that estimates all the model parameters as well as flow membership probabilities - the probability that a flow belongs to any given class. One of our key contributions is a new method for Internet flow classification. We show that our method is powerful in that it is capable of examining macroscopic flows while simultaneously making fine distinctions between different traffic classes. We demonstrate that our scheme can address issues with flows being close to class boundaries and the inherent dynamic behaviour of Internet flows.

AB - In order to control and manage highly aggregated Internet traffic flows efficiently, we need to be able to categorize flows into distinct classes and to be knowledgeable about the different behavior of flows belonging to these classes. In this paper we consider the problem of classifying BGP level prefix flows into a small set of homogeneous classes. We argue that using the entire distributional properties of flows can have significant benefits in terms of quality in the derived classification. We propose a method based on modeling flow histograms using Dirichlet Mixture Processes for random distributions. We present an inference procedure based on the Simulated Annealing Expectation Maximization algorithm that estimates all the model parameters as well as flow membership probabilities - the probability that a flow belongs to any given class. One of our key contributions is a new method for Internet flow classification. We show that our method is powerful in that it is capable of examining macroscopic flows while simultaneously making fine distinctions between different traffic classes. We demonstrate that our scheme can address issues with flows being close to class boundaries and the inherent dynamic behaviour of Internet flows.

U2 - 10.1145/1012888.1005696

DO - 10.1145/1012888.1005696

M3 - Journal article

VL - 32

SP - 49

EP - 60

JO - ACM SIGMETRICS Performance Evaluation Review

JF - ACM SIGMETRICS Performance Evaluation Review

IS - 1

ER -