davidby-influx
f762346ecc
fix: add paths to tsi log and index file errors ( #23557 ) ( #23562 )
...
Add paths to various TSI errors on opening and unmarshaling files
to help poinpoint the corrupt files.
Closes https://github.com/influxdata/influxdb/issues/23556
(cherry picked from commit 25cea95beb
)
closes https://github.com/influxdata/influxdb/issues/23558
2022-07-19 15:45:42 -07:00
Stuart Carnie
dee8977d2c
chore: move v2/v1/tsdb → v2/tsdb
2020-08-26 10:46:47 -07:00
Mark Rushakoff
f2898d1992
Wipe out workspace in preparation for v2 merge
...
"Knock knock."
"Who's there?"
"InfluxDB Veet."
...
2019-01-11 10:38:50 -08:00
Edd Robinson
7d00a45ebf
Don't allocate when reading tombstone SeriesID set
2018-09-18 15:58:38 -07:00
Ben Johnson
88d006a18c
Remove TSI1 HLL sketches from heap.
...
This commit removes the HLL sketches on each `tsi1.LogFile` and
`tsi1.IndexFile` and instead caches the data at the `tsi1.Index`
level. This reduces the heap size significantly for servers with
many TSI-enabled shards.
2018-09-12 08:48:40 -06:00
Ben Johnson
80d01325f8
Refactor file set tag value iterators to support series sets & tombstones.
2018-07-26 23:48:27 +01:00
Ben Johnson
fdfd038401
Add roaring bitmaps to TSI index files.
2018-07-24 17:59:23 +01:00
Jacob Marble
2dc2b97fb9
tsdb/index: Add Bytes() methods ( #9794 )
2018-05-04 08:47:05 -07:00
Ben Johnson
ed9c0576d4
Add series sketches, fix tombstones in index files.
2018-02-07 14:52:13 -07:00
Edd Robinson
0d164f3164
WIP - tsi integration sketches
2018-02-07 14:52:13 -07:00
Edd Robinson
544329380f
Add empty series sketches back to tsi1 index
...
This commit adds initial empty sketches back to the tsi1 index, as well
as ensuring that ephemeral sketches in the index `LogFile` are updated
accordingly.
The commit also adds a test that verifies that the merged sketches at
the store level produce the correct results under writes, deletions and
re-opening of the store.
This commit does not provide working sketches for post-compaction on the
tsi1 index.
2018-02-07 14:52:13 -07:00
Edd Robinson
030fdc7966
Remove unused code/cleanup index packages
2018-01-20 13:56:28 +00:00
Jason Wilder
a88ac031de
Fix MeasurementHasSeries returning incorrect value
...
If all the series in a measurement were tombstone, MeasurementHasSeries
would return true because the ok var was re-used from a prior check
earlier in the func. This caused it to be true all the time unless
the measurment was actually tombstoned.
2018-01-18 13:05:04 -07:00
Ben Johnson
1c4ab05c7e
Add fast TSI MeasurementHasSeries() check.
2018-01-15 12:00:30 +00:00
Ben Johnson
9a15130a4c
Persist TSI tombstones.
2018-01-15 12:00:30 +00:00
Ben Johnson
ac4dc91c64
Partition series file.
2018-01-10 08:33:25 -07:00
Ben Johnson
ca09f18e65
intermediate: tsdb compile
2017-11-29 11:20:18 -07:00
Ben Johnson
ede3fcf98e
intermediate
2017-11-15 16:09:25 -07:00
Ben Johnson
ba4c9e0317
Merge remote-tracking branch 'upstream/master' into er-tsi-index-part
2017-11-14 16:14:13 -07:00
Jason Wilder
16d1f4309b
Extract MeasurementSeriesKeysByExprIterator
2017-11-13 09:02:10 -07:00
Ben Johnson
d3cd750509
Refactor series file tombstoning.
2017-11-09 09:30:19 -07:00
Ben Johnson
919f99f34d
Fixing tests.
2017-11-09 09:30:19 -07:00
Ben Johnson
f223153078
Initial working version of series file.
2017-11-09 09:18:33 -07:00
Ben Johnson
e05d4fdeeb
intermediate
2017-11-09 09:18:33 -07:00
Ben Johnson
7259589241
intermediate
2017-11-09 09:18:33 -07:00
Ben Johnson
48b48a8927
intermediate
2017-11-09 09:13:46 -07:00
Ben Johnson
e7f39c06ab
Refactor TSI1 compaction.
2017-05-23 08:42:25 -06:00
Ben Johnson
1975940f76
intermediate compaction commit
2017-05-23 08:42:25 -06:00
Ben Johnson
f3e08c5871
Delta encode tag and measurement block series data.
2017-05-23 08:41:31 -06:00
Ben Johnson
489c89bea4
Add tsi support tooling.
2017-05-08 11:00:15 -06:00
Jason Wilder
40ec85aacd
Fix lock contention in LogFile.SeriesWithBuffer
...
Under high write load, the check for each series was done sequentially
which caused a lot of CPU time to acquire/release the RLock on LogFile.
This switches the code to check multiple series at once under an RLock
similar to the chang for inmem.
2017-04-20 12:28:42 -06:00
Ben Johnson
5cf41adcb8
Optimize tsi1 write path.
...
Removes sorted series list in log, uses a buffer for HasSeries(),
and prepends a length for series key encoding.
2017-03-21 08:44:35 -06:00
Ben Johnson
7e6f33ef48
TSI1 Index file compaction.
2017-02-15 08:44:22 -07:00
Ben Johnson
57f44d5f0c
Include index in snapshot.
2017-02-01 14:19:42 -07:00
Edd Robinson
ffced9b538
Move sketch merging into File
2017-02-01 15:33:30 +00:00
Ben Johnson
c1c98223ec
Fix and optimize tsi1 FileSet.
2017-01-05 10:17:12 -07:00
Ben Johnson
31e74d809b
Add tsi FileSet.
2017-01-05 10:17:11 -07:00
Ben Johnson
9b1e8215e0
Remove dictionary encoding, add bulk series insertion.
2017-01-05 10:17:11 -07:00
Edd Robinson
4ccb8dbab1
Move series count check to shard
2017-01-05 10:16:13 -07:00
Ben Johnson
745b1973a8
tsi compaction
2017-01-05 10:15:37 -07:00
Ben Johnson
9f8b206b51
Fix measurement system queries.
2017-01-05 10:15:34 -07:00
Ben Johnson
5965610de6
Refactoring tsi tombstoning.
2017-01-05 10:14:02 -07:00
Ben Johnson
87f4e0ec0a
Add regex support in tsi1.
2017-01-05 10:12:29 -07:00
Ben Johnson
d13afa8f47
Iterator refactoring
2017-01-05 10:11:49 -07:00
Ben Johnson
a812502ea3
reintegrating in-memory index
2017-01-05 10:07:35 -07:00