848ca48225
fix(tsdb): Revert "fix: remove some unsafe marshalling to reduce risk of segfault"
...
This reverts commit 30dab03310
2020-04-13 13:22:22 -06:00
30dab03310
fix: remove some unsafe marshalling to reduce risk of segfault
...
We were seing segfaults in Roaring bitmaps sometimes, under very
high load with networked drives. This may reduce risk of segfault by
forcing marshalling to copy the data.
2020-03-11 13:47:29 -04:00
88d006a18c
Remove TSI1 HLL sketches from heap.
...
This commit removes the HLL sketches on each `tsi1.LogFile` and
`tsi1.IndexFile` and instead caches the data at the `tsi1.Index`
level. This reduces the heap size significantly for servers with
many TSI-enabled shards.
2018-09-12 08:48:40 -06:00
5612511a8f
Use roaring.Bitmap.FromBuffer(), remove memory alignment.
2018-07-30 13:42:13 +00:00
fdfd038401
Add roaring bitmaps to TSI index files.
2018-07-24 17:59:23 +01:00
979d790154
Implement bitset iterator
2018-07-05 09:01:22 -06:00
2dc2b97fb9
tsdb/index: Add Bytes() methods ( #9794 )
2018-05-04 08:47:05 -07:00
10a7ffb647
Check for errors from binary.Uvarint when reading TSI logs ( #9705 )
...
* Check for errors from binary.Uvarint when reading TSI logs
* also check len(parsed) == len(input)
* wrap binary.Uvarint
* make uvarint() more generally useful/used
2018-04-12 09:59:56 -07:00
42c3adeffc
simplify packages under tsdb
2018-01-21 09:41:27 -08:00
030fdc7966
Remove unused code/cleanup index packages
2018-01-20 13:56:28 +00:00
1c4ab05c7e
Add fast TSI MeasurementHasSeries() check.
2018-01-15 12:00:30 +00:00
f6835632e7
Merge master into branch
2017-12-08 17:11:07 +00:00
ca09f18e65
intermediate: tsdb compile
2017-11-29 11:20:18 -07:00
a5af19fc06
Address PR feedback
2017-11-17 12:43:48 +00:00
ede3fcf98e
intermediate
2017-11-15 16:09:25 -07:00
ba4c9e0317
Merge remote-tracking branch 'upstream/master' into er-tsi-index-part
2017-11-14 16:14:13 -07:00
8b18cc4456
Optimize deletes in tsi
...
The DropSeries code path ended up creating a MeasurementSeriesIterator
for each dropped series, this was too expensive just to see if a
series exists.
This adds a HasSeries func and fixes and issue where TSI files were
compacted while an iterator was still in use causing a panic.
2017-11-13 12:35:38 -07:00
328bffd658
Convert series ids to 64-bits.
2017-11-09 09:26:06 -07:00
7259589241
intermediate
2017-11-09 09:18:33 -07:00
48b48a8927
intermediate
2017-11-09 09:13:46 -07:00
2524df3405
Convert tsi1 series keys to uint32.
2017-05-23 09:48:13 -06:00
57eeae03fc
Add note about SeriesIDs() limitation.
2017-05-23 08:42:25 -06:00
f3e08c5871
Delta encode tag and measurement block series data.
2017-05-23 08:41:31 -06:00
489c89bea4
Add tsi support tooling.
2017-05-08 11:00:15 -06:00
1e9fa7bc2c
Fix 32-bit rhh implementation.
2017-03-21 11:44:13 -06:00
70efc70abe
Reduce lock contention, fix rhh lookup.
2017-03-17 09:44:11 -06:00
ab238251f4
Refactor measurement sketches
2017-02-01 14:56:35 +00:00
05bbda2c0a
Fix measurement block sketches.
2017-02-01 07:40:00 -07:00
f43b0f7ec9
Fix series & measurement deletion.
2017-01-12 09:29:40 -07:00
352817e8c4
Convert 32-bit offsets to 64-bit.
2017-01-11 08:58:10 -07:00
9b1e8215e0
Remove dictionary encoding, add bulk series insertion.
2017-01-05 10:17:11 -07:00
0f9b2bfe6a
Fix tests
2017-01-05 10:16:15 -07:00
695adafc00
Add measurement sketches
2017-01-05 10:15:37 -07:00
745b1973a8
tsi compaction
2017-01-05 10:15:37 -07:00
5965610de6
Refactoring tsi tombstoning.
2017-01-05 10:14:02 -07:00
2b864c72c5
Refactor MeasurementBlockTrailer read/write.
2017-01-05 10:11:10 -07:00
a812502ea3
reintegrating in-memory index
2017-01-05 10:07:35 -07:00
Ben Johnson
docmerlin (j. Emrys Landivar)
Jacob Marble
Edd Robinson
Jason Wilder