e2f9413c8a
count slice memory use with len, not cap
2018-05-10 11:33:52 -07:00
87d73d405c
tsdb/SeriesFile: remove unused function param
2018-05-04 11:22:12 -07:00
2dc2b97fb9
tsdb/index: Add Bytes() methods ( #9794 )
2018-05-04 08:47:05 -07:00
10a7ffb647
Check for errors from binary.Uvarint when reading TSI logs ( #9705 )
...
* Check for errors from binary.Uvarint when reading TSI logs
* also check len(parsed) == len(input)
* wrap binary.Uvarint
* make uvarint() more generally useful/used
2018-04-12 09:59:56 -07:00
a6741aaf6c
Simplify tsi1/log_file.go according to megacheck
2018-03-09 11:00:46 -06:00
8e62e8d3bd
Fix TSI log file recovery.
2018-03-05 14:49:12 -07:00
567a35d364
Fix panic on tsi1 log replay of deleted series.
2018-02-28 08:06:30 -07:00
ed9c0576d4
Add series sketches, fix tombstones in index files.
2018-02-07 14:52:13 -07:00
0d164f3164
WIP - tsi integration sketches
2018-02-07 14:52:13 -07:00
544329380f
Add empty series sketches back to tsi1 index
...
This commit adds initial empty sketches back to the tsi1 index, as well
as ensuring that ephemeral sketches in the index `LogFile` are updated
accordingly.
The commit also adds a test that verifies that the merged sketches at
the store level produce the correct results under writes, deletions and
re-opening of the store.
This commit does not provide working sketches for post-compaction on the
tsi1 index.
2018-02-07 14:52:13 -07:00
20d429c62b
Use cached tags when applying series entries
2018-01-30 16:02:50 -07:00
a6d11585b3
Add TSI compaction interruption.
2018-01-30 10:34:17 -07:00
0652effb78
Interrupt TSI & Series File Compactions
2018-01-30 10:34:17 -07:00
030fdc7966
Remove unused code/cleanup index packages
2018-01-20 13:56:28 +00:00
5f9d53b586
Fix LogEntry.UnmarshalBinary() short buffer check.
2018-01-16 13:14:26 -07:00
1c4ab05c7e
Add fast TSI MeasurementHasSeries() check.
2018-01-15 12:00:30 +00:00
9a15130a4c
Persist TSI tombstones.
2018-01-15 12:00:30 +00:00
e610e7c21d
Track undeleted series IDs per-shard with inmem
...
This commit adds a bitset into each shard's in-memory index, to be used to
track undeleted series ids. Currently tsi1 support is not implemented.
When new series are added to the shard, the series id is added
to the bitset. When series are deleted from the shard, the series
ids are removed from the bitset.
Becasue each shard shares the same inmem index reference, the bitset
is stored in the `ShardIndex`, which is local to each shard, and then
different references are passed into the shared `Index` object, depending
on which shard is writing the series.
2018-01-11 01:01:54 +00:00
e6f3aa107a
Move SeriesSet to tsdb.SeriesIDSet
2018-01-11 01:01:54 +00:00
f73a710320
More insight into assertion
2018-01-04 16:23:50 +00:00
31c50532db
Add series existence check in tsi1.
2018-01-03 12:20:35 -07:00
3900c948a2
Fix requested changes.
2018-01-03 10:04:12 -07:00
37803d6803
Fixed 'tests' pkg.
2017-12-07 08:33:47 -07:00
ca09f18e65
intermediate: tsdb compile
2017-11-29 11:20:18 -07:00
ede3fcf98e
intermediate
2017-11-15 16:09:25 -07:00
ba4c9e0317
Merge remote-tracking branch 'upstream/master' into er-tsi-index-part
2017-11-14 16:14:13 -07:00
8b18cc4456
Optimize deletes in tsi
...
The DropSeries code path ended up creating a MeasurementSeriesIterator
for each dropped series, this was too expensive just to see if a
series exists.
This adds a HasSeries func and fixes and issue where TSI files were
compacted while an iterator was still in use causing a panic.
2017-11-13 12:35:38 -07:00
16d1f4309b
Extract MeasurementSeriesKeysByExprIterator
2017-11-13 09:02:10 -07:00
9756a29678
import fix
2017-11-13 08:54:32 -07:00
e278af2b18
intermediate
2017-11-09 09:30:19 -07:00
d3cd750509
Refactor series file tombstoning.
2017-11-09 09:30:19 -07:00
3034d3fb54
intermediate
2017-11-09 09:30:19 -07:00
49218fd3bd
Fix issue with series being added to log file
2017-11-09 09:28:37 -07:00
328bffd658
Convert series ids to 64-bits.
2017-11-09 09:26:06 -07:00
08e459357a
Fix tsi race conditions.
2017-11-09 09:18:33 -07:00
f223153078
Initial working version of series file.
2017-11-09 09:18:33 -07:00
e05d4fdeeb
intermediate
2017-11-09 09:18:33 -07:00
9ad2b53881
intermediate
2017-11-09 09:18:33 -07:00
7259589241
intermediate
2017-11-09 09:18:33 -07:00
48b48a8927
intermediate
2017-11-09 09:13:46 -07:00
f3d45ba301
influxdata/influxdb/influxql -> influxdata/influxql
2017-10-30 14:40:26 -07:00
5a77238f30
Sort & validate TSI key value insertion.
2017-10-23 10:46:01 -06:00
a5a2957567
Reduce allocation in log_file
2017-09-11 15:29:25 -06:00
a9e89ede75
Reduce lock contenton on Index
...
Stat and Size are read-only and can take an RLock.
2017-09-11 15:26:25 -06:00
547db32d01
Fix tsi go vet issues.
2017-05-23 13:42:38 -06:00
2524df3405
Convert tsi1 series keys to uint32.
2017-05-23 09:48:13 -06:00
e7f39c06ab
Refactor TSI1 compaction.
2017-05-23 08:42:25 -06:00
1975940f76
intermediate compaction commit
2017-05-23 08:42:25 -06:00
48a06432df
Add tsi1 bloom filter.
2017-05-23 08:41:31 -06:00
489c89bea4
Add tsi support tooling.
2017-05-08 11:00:15 -06:00
Jacob Marble
Jonathan A. Sternberg
Ben Johnson
Edd Robinson
Jason Wilder
Stuart Carnie