davidby-influx
d3db48e93d
fix: fully clean up partially opened TSI ( #23430 )
...
When one partition in a TSI fails to open, all previously opened
partitions should be cleaned up, and remaining partitions
should not be opened
closes https://github.com/influxdata/influxdb/issues/23427
2022-06-10 11:31:29 -07:00
Tristan Su
108e2600b3
fix(tsi): clean up FileSet fields ( #18961 )
2021-07-12 10:42:38 -04:00
Sam Arnold
17b9ea8723
feat: Add WITH KEY to show tag keys ( #20793 )
...
* fix: Change from RewriteExpr to PartitionExpr
Also remove some dead code
* feat: WITH KEY implementation
* feat: query rewriting for WITH KEY in SHOW TAG KEYS
2021-02-25 08:38:29 -05:00
Edd Robinson
cac4c8956c
fix(tsi1): index defect with negated equality filters
...
Fixes #15859
This commit fixes a defect in the TSI index where a filter using the
negated equality operator would result in no matching series being
returned for series stored within the `IndexFile` portions of the index.
The root cause of this was due to missing legacy-handling code in the
index for this particular iterator.
2019-11-12 15:10:42 +00:00
Ben Johnson
88d006a18c
Remove TSI1 HLL sketches from heap.
...
This commit removes the HLL sketches on each `tsi1.LogFile` and
`tsi1.IndexFile` and instead caches the data at the `tsi1.Index`
level. This reduces the heap size significantly for servers with
many TSI-enabled shards.
2018-09-12 08:48:40 -06:00
Ben Johnson
80d01325f8
Refactor file set tag value iterators to support series sets & tombstones.
2018-07-26 23:48:27 +01:00
Ben Johnson
fdfd038401
Add roaring bitmaps to TSI index files.
2018-07-24 17:59:23 +01:00
Ben Johnson
979d790154
Implement bitset iterator
2018-07-05 09:01:22 -06:00
Jacob Marble
3f2ff742c0
Remove unused 'database' field
2018-05-18 09:22:43 -07:00
Jacob Marble
2dc2b97fb9
tsdb/index: Add Bytes() methods ( #9794 )
2018-05-04 08:47:05 -07:00
Edd Robinson
544329380f
Add empty series sketches back to tsi1 index
...
This commit adds initial empty sketches back to the tsi1 index, as well
as ensuring that ephemeral sketches in the index `LogFile` are updated
accordingly.
The commit also adds a test that verifies that the merged sketches at
the store level produce the correct results under writes, deletions and
re-opening of the store.
This commit does not provide working sketches for post-compaction on the
tsi1 index.
2018-02-07 14:52:13 -07:00
Ben Johnson
1c4ab05c7e
Add fast TSI MeasurementHasSeries() check.
2018-01-15 12:00:30 +00:00
Ben Johnson
9a15130a4c
Persist TSI tombstones.
2018-01-15 12:00:30 +00:00
Edd Robinson
289d1f8d44
Allow iterators to return if shard is closing
2017-12-15 00:46:43 +00:00
Edd Robinson
f6835632e7
Merge master into branch
2017-12-08 17:11:07 +00:00
Ben Johnson
493c1ed0d1
inmem tests passing.
2017-12-05 10:49:58 -07:00
Ben Johnson
e0df47d54f
Fixing up tests.
2017-12-02 16:52:34 -07:00
Ben Johnson
ca09f18e65
intermediate: tsdb compile
2017-11-29 11:20:18 -07:00
Edd Robinson
38e0dd695f
Allow concurrent access to Engine Index
2017-11-28 15:57:03 +00:00
Edd Robinson
368420c670
Fix test due to index changes
2017-11-28 15:57:02 +00:00
Edd Robinson
12a2ff7fac
Add support for TSI shard streaming and shard size
...
This commit firstly ensures that a shard's size on disk is accurately
reported when using the tsi1 index, by including the on-disk size of the
tsi1 index in the calculation.
Secondly, this commit add support for shard streaming/copying when using
the tsi1 index. Prior to this, a tsi1 index would not be correctly
restored when streaming shards.
2017-11-28 15:57:02 +00:00
Ben Johnson
cc22134d8f
Merge branch 'er-tsi-index-part' of https://github.com/influxdata/influxdb into er-tsi-index-part
2017-11-27 07:52:39 -07:00
Ben Johnson
01491ca4f4
intermediate
2017-11-27 07:52:18 -07:00
Edd Robinson
4831545830
Add PR typo/doc changes
2017-11-27 14:05:30 +00:00
Edd Robinson
a5af19fc06
Address PR feedback
2017-11-17 12:43:48 +00:00
Edd Robinson
bff69f7a82
Refactor inmem implementation
2017-11-17 11:06:43 +00:00
Edd Robinson
25f0fedd6f
Fix MeasurementNamesByExpr in tsi1
2017-11-17 11:06:43 +00:00
Edd Robinson
6851db3fc9
Add FGA support to SHOW MEASUREMENTS
2017-11-17 11:06:43 +00:00
Edd Robinson
8acab9b5ac
Fix existing bug where database was empty
2017-11-17 11:06:43 +00:00
Ben Johnson
ede3fcf98e
intermediate
2017-11-15 16:09:25 -07:00
Ben Johnson
ba4c9e0317
Merge remote-tracking branch 'upstream/master' into er-tsi-index-part
2017-11-14 16:14:13 -07:00
Jason Wilder
16d1f4309b
Extract MeasurementSeriesKeysByExprIterator
2017-11-13 09:02:10 -07:00
Ben Johnson
d3cd750509
Refactor series file tombstoning.
2017-11-09 09:30:19 -07:00
Ben Johnson
919f99f34d
Fixing tests.
2017-11-09 09:30:19 -07:00
Ben Johnson
f223153078
Initial working version of series file.
2017-11-09 09:18:33 -07:00
Ben Johnson
e05d4fdeeb
intermediate
2017-11-09 09:18:33 -07:00
Ben Johnson
7259589241
intermediate
2017-11-09 09:18:33 -07:00
Ben Johnson
48b48a8927
intermediate
2017-11-09 09:13:46 -07:00
Ben Johnson
156f25ac23
Improve SHOW TAG KEYS performance.
2017-11-07 10:59:19 -07:00
Stuart Carnie
f3d45ba301
influxdata/influxdb/influxql -> influxdata/influxql
2017-10-30 14:40:26 -07:00
Ben Johnson
49c1fca036
Handle nil MeasurementIterator.
2017-10-26 11:25:46 -06:00
Joe LeGasse
1443b22379
auth: add series auth to 'show tag values'
2017-09-27 20:01:18 -04:00
Edd Robinson
44691847e9
Merge branch 'master' into er-8678-tsi1-where
2017-09-22 16:54:49 +01:00
Jason Wilder
d5d9f9acfe
Remove debug line
2017-09-11 15:31:28 -06:00
Ben Johnson
ee4d3c7b3d
Invalidate all bloom filters.
2017-09-11 15:29:26 -06:00
Ben Johnson
3c2487b97a
Clean up tsi bloom filter invalidation.
2017-09-11 15:29:26 -06:00
Ben Johnson
6af936ee61
Fix bloom filter invalidation.
2017-09-11 15:29:26 -06:00
Ben Johnson
a40b2bb210
Simplify bloom filter invalidation.
2017-09-11 15:29:26 -06:00
Ben Johnson
0ec2736f23
Incrementally rebuild tsi bloom filters.
2017-09-11 15:29:25 -06:00
Jonathan A. Sternberg
697759613c
Remove time comparisons from the inner sections of the storage engine
2017-08-16 16:51:13 -05:00