Ben Johnson
48a06432df
Add tsi1 bloom filter.
2017-05-23 08:41:31 -06:00
Ben Johnson
489c89bea4
Add tsi support tooling.
2017-05-08 11:00:15 -06:00
Jason Wilder
40ec85aacd
Fix lock contention in LogFile.SeriesWithBuffer
...
Under high write load, the check for each series was done sequentially
which caused a lot of CPU time to acquire/release the RLock on LogFile.
This switches the code to check multiple series at once under an RLock
similar to the chang for inmem.
2017-04-20 12:28:42 -06:00
Ben Johnson
bf49b176f5
Partition tsi1 series index.
2017-04-04 09:46:04 -06:00
Ben Johnson
85c1ae4dd4
Remove sort.Slice
2017-03-21 12:33:05 -06:00
Ben Johnson
5cf41adcb8
Optimize tsi1 write path.
...
Removes sorted series list in log, uses a buffer for HasSeries(),
and prepends a length for series key encoding.
2017-03-21 08:44:35 -06:00
Ben Johnson
70efc70abe
Reduce lock contention, fix rhh lookup.
2017-03-17 09:44:11 -06:00
Ben Johnson
1807772388
Fix tsi tests.
2017-03-15 11:23:58 -06:00
Ben Johnson
d23f2971c3
Refactor TagBlockEncoder.
2017-03-10 10:08:16 -07:00
Ben Johnson
7ee0b9bb28
Rewrite SeriesBlockEncoder.
2017-02-16 09:39:51 -07:00
Edd Robinson
7749bc1c67
Store sorted series in logFile
2017-02-13 17:03:42 +00:00
Edd Robinson
c2bbc18e4b
Reduce repeated string allocations
2017-02-09 11:23:23 +00:00
Edd Robinson
21e821e5f9
Reduce memory footprint by pre-allocating
2017-02-08 18:49:03 +00:00
Ben Johnson
d6fedcacd5
Refactor tsi.LogFile compaction.
2017-02-08 09:00:08 -07:00
Ben Johnson
c4e9430de3
Recover after partial tsi log file write.
2017-02-07 10:02:31 -07:00
Ben Johnson
d91e6eabac
Add max-values-per-tag to inmem index.
2017-02-06 11:14:13 -07:00
Ben Johnson
57f44d5f0c
Include index in snapshot.
2017-02-01 14:19:42 -07:00
Edd Robinson
ffced9b538
Move sketch merging into File
2017-02-01 15:33:30 +00:00
Edd Robinson
ab238251f4
Refactor measurement sketches
2017-02-01 14:56:35 +00:00
Ben Johnson
05bbda2c0a
Fix measurement block sketches.
2017-02-01 07:40:00 -07:00
Ben Johnson
86e908c384
Remove debug println().
2017-01-31 09:24:58 -07:00
Ben Johnson
f4a4d1e196
Fix series sketches.
2017-01-31 08:47:18 -07:00
Jason Wilder
2ae9406c1d
Reincorporate memory leak fix
...
7832 got lost during a rebase/merge. This reincorporate the fix
for the in-memory index as well as tsi.
2017-01-24 20:13:48 -07:00
Ben Johnson
047c21f4d9
Merge remote-tracking branch 'upstream/master' into tsi
2017-01-24 09:28:58 -07:00
Ben Johnson
f43b0f7ec9
Fix series & measurement deletion.
2017-01-12 09:29:40 -07:00
Ben Johnson
352817e8c4
Convert 32-bit offsets to 64-bit.
2017-01-11 08:58:10 -07:00
Ben Johnson
64c7715243
Rebase fixes.
2017-01-09 10:10:12 -07:00
Ben Johnson
d1f1e19591
Fixing rebase.
2017-01-06 09:31:25 -07:00
Ben Johnson
1003db0067
Add active log file tracking, time-based compaction.
2017-01-05 10:17:12 -07:00
Ben Johnson
c1c98223ec
Fix and optimize tsi1 FileSet.
2017-01-05 10:17:12 -07:00
Ben Johnson
31e74d809b
Add tsi FileSet.
2017-01-05 10:17:11 -07:00
Ben Johnson
dcd2a771b0
Optimizing tsi compaction.
2017-01-05 10:17:11 -07:00
Ben Johnson
1ce99e797f
Use series map in tsi1.LogFile.
2017-01-05 10:17:11 -07:00
Ben Johnson
9b1e8215e0
Remove dictionary encoding, add bulk series insertion.
2017-01-05 10:17:11 -07:00
Ben Johnson
5f7654173e
Add locking to sketch merge.
2017-01-05 10:17:11 -07:00
Edd Robinson
0f9b2bfe6a
Fix tests
2017-01-05 10:16:15 -07:00
Edd Robinson
4ccb8dbab1
Move series count check to shard
2017-01-05 10:16:13 -07:00
Edd Robinson
0cb74eedbf
Add log file (WAL) sketches
2017-01-05 10:15:38 -07:00
Ben Johnson
745b1973a8
tsi compaction
2017-01-05 10:15:37 -07:00
Ben Johnson
9f8b206b51
Fix measurement system queries.
2017-01-05 10:15:34 -07:00
Ben Johnson
5965610de6
Refactoring tsi tombstoning.
2017-01-05 10:14:02 -07:00
Ben Johnson
e7940cc556
Add tsi1 series system iterator.
2017-01-05 10:14:00 -07:00
Ben Johnson
87f4e0ec0a
Add regex support in tsi1.
2017-01-05 10:12:29 -07:00
Ben Johnson
d13afa8f47
Iterator refactoring
2017-01-05 10:11:49 -07:00
Jason Wilder
2b96c5d4d0
Set Tags on entry
...
These were lost when reloading from the index. Fixes queries not
returning any data.
2017-01-05 10:11:12 -07:00
Jason Wilder
a6490920fd
Fix reslicing indices
...
The slicing was backwards causing the buffer to grow indefinitely
and filling the disks on writes.
2017-01-05 10:11:12 -07:00
Jason Wilder
59864226b7
Add RWMutex to LogFile
...
Fixes concurrent map access panic
2017-01-05 10:11:12 -07:00
Ben Johnson
a812502ea3
reintegrating in-memory index
2017-01-05 10:07:35 -07:00