19 Commits (3f49ab190e6b80c540271826d732d251526a0aa7)

Author	SHA1	Message	Date
Jacob Marble	2dc2b97fb9	tsdb/index: Add Bytes() methods (#9794)	2018-05-04 08:47:05 -07:00
Jacob Marble	63f0eee472	HLL++: estimate memory footprint bytes	2018-04-24 09:28:25 -07:00
Mark Rushakoff	426a9a0b8b	Use math/bits exclusively instead of go-bits ... We won't be rolling back to pre-Go1.9, so prefer the standard library over a dependency that provides backwards compatibility.	2018-03-15 12:03:24 -07:00
Edd Robinson	e5c8fd9dc5	Ensure nil sketches never returned	2018-02-09 15:29:42 +00:00
Edd Robinson	0d164f3164	WIP - tsi integration sketches	2018-02-07 14:52:13 -07:00
Edd Robinson	544329380f	Add empty series sketches back to tsi1 index ... This commit adds initial empty sketches back to the tsi1 index, as well as ensuring that ephemeral sketches in the index `LogFile` are updated accordingly. The commit also adds a test that verifies that the merged sketches at the store level produce the correct results under writes, deletions and re-opening of the store. This commit does not provide working sketches for post-compaction on the tsi1 index.	2018-02-07 14:52:13 -07:00
Edd Robinson	a174f65595	use math/bits in HLL implementation	2017-09-26 12:51:08 +01:00
Seif Lotfy	4cb01c1768	change beta constants for the hll cardinality bias estimator	2017-06-30 07:47:16 -07:00
Seif Lotfy	643b2eb30c	Switch to LogLog-Beta Cardinality estimation ... The new algorithm uses only one formula and needs no additional bias corrections for the entire range of cardinalities, therefore, it is more efficient and simpler to implement. Our simulations show that the accuracy provided by the new algorithm is as good as or better than the accuracy provided by either of HyperLogLog or HyperLogLog++. The sparse representation was kept in to provide better low cardinality accuracy. However the linear counting and range estimations are replaced.	2017-06-20 15:25:01 +02:00
Ben Johnson	623ff67221	Fix HLL variableLengthList size decoding.	2017-05-19 11:44:25 -06:00
Edd Robinson	1c4ecb12c1	Don't panic on nil engine	2017-03-22 10:07:29 -06:00
Stuart Carnie	0ebbfb8f77	hll: skip recalc of sparseSet if tmpSet is empty ... ``` benchmark old ns/op new ns/op delta BenchmarkSet_Count/set_size_1000-8 38095 28.3 -99.93% BenchmarkSet_Count/set_size_5000-8 152052 30.1 -99.98% BenchmarkSet_Count/set_size_10000-8 50953 54978 +7.90% BenchmarkSet_Count/set_size_50000-8 32495 31222 -3.92% BenchmarkSet_Count/set_size_1000000-8 32603 30800 -5.53% benchmark old allocs new allocs delta BenchmarkSet_Count/set_size_1000-8 4 0 -100.00% BenchmarkSet_Count/set_size_5000-8 4 0 -100.00% BenchmarkSet_Count/set_size_10000-8 0 0 +0.00% BenchmarkSet_Count/set_size_50000-8 0 0 +0.00% BenchmarkSet_Count/set_size_1000000-8 0 0 +0.00% benchmark old bytes new bytes delta BenchmarkSet_Count/set_size_1000-8 16496 0 -100.00% BenchmarkSet_Count/set_size_5000-8 16497 0 -100.00% BenchmarkSet_Count/set_size_10000-8 0 0 +0.00% BenchmarkSet_Count/set_size_50000-8 0 0 +0.00% BenchmarkSet_Count/set_size_1000000-8 0 0 +0.00% ```	2017-01-31 08:51:05 -07:00
Edd Robinson	ab94c1b743	Fixes #7882	2017-01-30 19:12:24 +00:00
Edd Robinson	695adafc00	Add measurement sketches	2017-01-05 10:15:37 -07:00
Edd Robinson	1339c7b146	Initialise HLL with error	2017-01-05 10:15:37 -07:00
Ben Johnson	cb93f10120	Remove per-shard in-memory index.	2017-01-05 10:11:09 -07:00
Edd Robinson	e2c3b52ca4	Adds a custom HyperLogLog++ implementation	2017-01-05 10:00:14 -07:00
Edd Robinson	bd8dd9a291	Sketches working	2017-01-05 09:54:04 -07:00
Edd Robinson	d19fbf5ab4	Wire in HLL estimator	2017-01-05 09:54:03 -07:00