Algorithms and estimators for summarization of unaggregated data streams
Patent
Overview
Overview
abstract
The invention relates to streaming algorithms useful for obtaining summaries over unaggregated packet streams and for providing unbiased estimators for characteristics, such as, the amount of traffic that belongs to a specified subpopulation of flows. Packets are sampled from a packet stream and aggregated into flows and counted by implementation of: (a) Adaptive Sampled NetFlow (ANF), and adjusted weight (AA NF ) of a flow (f) is calculated as follows: AA NF (f)=i(f)/p; i(f) being the number of packets counted for a flow f, and p being the sampling rate at end of a measurement period; or (b) Adaptive Sample-and-Hold (ASH), and adjusted weight (AA SH ) of a flow (f) is calculated as follows: AA SH (f)=i(f)+(1p)/p; i(f) being the number of packets counted for a flow f, and p being the sampling rate at end of a measurement period.
