Loading page…
Why exact counting breaks when every distinct key costs memory per slice and per day, and the sketches that count in fixed memory with a known, one-directional error: Bloom filters for membership (sizing, over-filling, deletes, LSM reads, Akamai's cache-on-second-hit, a dedup gate that loses nothing), HyperLogLog for distinct counts (registers, error, HLL++, merging, Redis and BigQuery), Count-Min for frequencies, Misra-Gries and Space-Saving for top-k over minute panes, and where each sits in the week's pipeline.
Previously, on Day 5, you built the query layer: partitions, rollups and caches.