Commit Graph

9 Commits (0ae0bd6e2eb6eeeb97b67bc8c96ad6b158ce28f5)

Author SHA1 Message Date
Edd Robinson a2fd8dd4ed Cleanup pkg package 2018-01-21 12:08:25 -08:00
Edd Robinson 2fd82645d8 Don't run test in race mode 2017-12-15 22:19:25 +00:00
Edd Robinson 1028818ba6 Perf boost with some bit twiddling 2017-09-22 17:59:39 +01:00
Edd Robinson 5b7fc517fa Improve performance of TSI bloom filter
This commit replaces the previous hashing algorithm used by the pkg.Filter with
one based on xxhash. Further, taking from the hashing literature, we can
represent k hashes with only two hash function, where previously Filter was using
four.

Further, unlike `murmur3`, `xxhash` is allocation-free, so allocations have
dramatically reduced when inserting and checking for hashes.
2017-09-22 17:59:39 +01:00
Edd Robinson fe960b0f3a Add benchmarks for bloom filter 2017-09-22 17:59:32 +01:00
Ben Johnson a40b2bb210 Simplify bloom filter invalidation. 2017-09-11 15:29:26 -06:00
Jason Wilder 4009223fb6 Avoid allocating murmur3.Hash too frequently
These hashes were getting allocate very frequently with high cardinality
datasets.  This allows them to be re-used.
2017-09-11 15:26:24 -06:00
Ben Johnson 1975940f76
intermediate compaction commit 2017-05-23 08:42:25 -06:00
Ben Johnson 48a06432df
Add tsi1 bloom filter. 2017-05-23 08:41:31 -06:00