bb7a27e5ed
refactor: use proper sets during delete predicate collection
...
We no longer need hacky pointer tricks to de-duplicate delete predicates
when collecting them for catalog checkpoints. This was once required
when the delete predicates didn't implement `Eq` and `Hash` but now it's
all way easier.
2021-10-05 10:37:34 +02:00
28ccf2a8c3
refactor: `TransactionHandle::delete_predicate` cannot fail
2021-10-05 09:41:46 +02:00
0a83379e23
Merge pull request #2723 from influxdata/crepererum/in_mem_expr_part4
...
refactor: remove unused fields from `DeletePredicate` and remove intermediate `ParseDeletePredicate`
2021-10-05 07:37:31 +00:00
1d18758075
refactor: fold `ParseDeletePredicate` into `DeletePredicate`
...
There is no reason to have yet another intermediate type. This also
makes the intermediate parsing functions private.
2021-10-05 09:29:25 +02:00
10c1a72402
refactor: remove unused fields from `DeletePredicate`
2021-10-05 09:29:24 +02:00
80c4ba959d
test: add negative tests for delete hhtp endpoints
2021-10-04 21:19:10 -04:00
ff8e037971
feat: handle delete response
2021-10-04 20:37:53 -04:00
d10d8e8a45
Merge pull request #2725 from influxdata/ntran/stop_inlcusive
...
fix: make stop time inclusive
2021-10-04 19:06:03 +00:00
1856d7184c
fix: make stop time inclusive
2021-10-04 14:14:16 -04:00
8e9dd22753
Merge pull request #2721 from influxdata/ntran/default_delete
...
test: turn on tests of delete all
2021-10-04 17:07:41 +00:00
5ad858524f
Merge branch 'main' into ntran/default_delete
2021-10-04 16:58:48 +00:00
64cd0cb3ce
chore: cleanup
2021-10-04 12:43:35 -04:00
00818de4e6
Merge pull request #2720 from influxdata/crepererum/in_mem_expr_part3
...
chore: enable linting for `predicate` crate
2021-10-04 16:40:07 +00:00
018c5bd1e3
Merge branch 'main' into crepererum/in_mem_expr_part3
2021-10-04 16:31:49 +00:00
ba96b20b1f
test: turn on tests of delete all
2021-10-04 12:28:49 -04:00
0dbeac47bf
Merge pull request #2716 from influxdata/crepererum/issue2633a
...
refactor: make `ChunkOrder` non-zero
2021-10-04 15:59:24 +00:00
150e7c222f
chore: enable linting for `predicate` crate
2021-10-04 17:58:40 +02:00
f6fc148fe5
Merge branch 'main' into crepererum/issue2633a
2021-10-04 15:50:48 +00:00
742a1065a1
feat: don't auto-increment background worker now ( #2719 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-04 15:50:09 +00:00
97881079e8
refactor: make `ChunkOrder` non-zero
...
This will make it easier to handle missing values.
Helps with #2633 .
2021-10-04 17:49:12 +02:00
57ed72cd40
Merge pull request #2715 from influxdata/crepererum/in_mem_expr_part2
...
refactor: introduce `DeletePredicate`
2021-10-04 15:06:54 +00:00
d8dddc358f
fix: typo in error message
...
Co-authored-by: Nga Tran <ntran@influxdata.com>
2021-10-04 16:56:43 +02:00
75ac6e8646
refactor: make `DeletePredicate::range` non-optional
2021-10-04 16:36:20 +02:00
d1835a3eee
fix: doc links
2021-10-04 16:36:20 +02:00
5a5a929b9e
refactor: introduce `DeletePredicate`
...
`DeletePredicate` is a simpler version of `Predicate` that is based on
IOx `DeleteExpr` instead of the full-blown DataFusion `Expr`. This will
allow us to do a couple of things (in follow-up changes):
- Order and de-duplicate delete predicates
- Normalize predicates
- Infallible serialization
- Smaller memory footprint
Note that this change only affects delete expressions. Query expressions
that are supported via the API are not changed. The query subsystem also
still uses the full-featured expressions/predicates (delete
expressions/predicates are converted to the more powerful DataFusion
version on-the-fly).
2021-10-04 16:36:20 +02:00
97fd506b4e
Merge pull request #2705 from influxdata/dependabot/cargo/arrow-flight-5.5.0
...
chore(deps): bump arrow-flight from 5.4.0 to 5.5.0
2021-10-04 13:47:31 +00:00
7a6f381e69
chore(deps): bump arrow-flight from 5.4.0 to 5.5.0
...
Bumps [arrow-flight](https://github.com/apache/arrow-rs ) from 5.4.0 to 5.5.0.
- [Release notes](https://github.com/apache/arrow-rs/releases )
- [Changelog](https://github.com/apache/arrow-rs/blob/5.5.0/CHANGELOG.md )
- [Commits](https://github.com/apache/arrow-rs/compare/5.4.0...5.5.0 )
---
updated-dependencies:
- dependency-name: arrow-flight
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 13:27:26 +00:00
b0d8b679be
Merge pull request #2709 from influxdata/dependabot/cargo/arrow-5.5.0
...
chore(deps): bump arrow from 5.4.0 to 5.5.0
2021-10-04 13:19:23 +00:00
181145eca1
Merge branch 'main' into dependabot/cargo/arrow-5.5.0
2021-10-04 13:10:42 +00:00
04f5dc6b28
Merge pull request #2708 from influxdata/dependabot/cargo/parquet-5.5.0
...
chore(deps): bump parquet from 5.4.0 to 5.5.0
2021-10-04 12:05:17 +00:00
7ab10daa19
Merge branch 'main' into dependabot/cargo/arrow-5.5.0
2021-10-04 12:58:29 +01:00
f8c72d611c
Merge branch 'main' into dependabot/cargo/parquet-5.5.0
2021-10-04 12:56:54 +01:00
d0384f60d0
test: update server tests
2021-10-04 12:39:35 +01:00
9cc6b18205
refactor: simplify delete_predicate_preservation test ( #2714 )
2021-10-04 11:38:03 +00:00
e72f7e958c
test: update expected results
2021-10-04 12:20:21 +01:00
6d9205d87c
chore(deps): bump parquet from 5.4.0 to 5.5.0
...
Bumps [parquet](https://github.com/apache/arrow-rs ) from 5.4.0 to 5.5.0.
- [Release notes](https://github.com/apache/arrow-rs/releases )
- [Changelog](https://github.com/apache/arrow-rs/blob/5.5.0/CHANGELOG.md )
- [Commits](https://github.com/apache/arrow-rs/compare/5.4.0...5.5.0 )
---
updated-dependencies:
- dependency-name: parquet
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 12:15:11 +01:00
e8eab2cc97
feat: allow compaction and persistence to retun no chunk ( #2664 ) ( #2700 )
...
* feat: allow compaction and persistence to retun no chunk (#2664 )
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-04 10:54:47 +00:00
01de3fb42b
Merge pull request #2711 from influxdata/crepererum/fix_http_delete_test
...
test: fix flaky `influxdb_ioxd::http::tests::test_delete`
2021-10-04 10:37:59 +00:00
62e0fccd28
Merge branch 'main' into crepererum/fix_http_delete_test
2021-10-04 10:29:23 +00:00
d1f5209869
chore(deps): bump arrow from 5.4.0 to 5.5.0
...
Bumps [arrow](https://github.com/apache/arrow-rs ) from 5.4.0 to 5.5.0.
- [Release notes](https://github.com/apache/arrow-rs/releases )
- [Changelog](https://github.com/apache/arrow-rs/blob/5.5.0/CHANGELOG.md )
- [Commits](https://github.com/apache/arrow-rs/compare/5.4.0...5.5.0 )
---
updated-dependencies:
- dependency-name: arrow
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:55:38 +00:00
4e9f21ed05
Merge pull request #2622 from influxdata/crepererum/in_mem_expr_part1
...
refactor: use dedicated in-memory `Expr` type during IO
2021-10-04 08:53:57 +00:00
5060bf71fe
Merge branch 'main' into crepererum/in_mem_expr_part1
2021-10-04 08:45:50 +00:00
51246e3c8d
docs: remove outdated comment
2021-10-04 10:44:30 +02:00
95315590c0
Merge pull request #2710 from influxdata/dependabot/cargo/ouroboros-0.12.0
...
chore(deps): bump ouroboros from 0.11.1 to 0.12.0
2021-10-04 08:41:22 +00:00
bd39fae99d
test: fix flaky `influxdb_ioxd::http::tests::test_delete`
2021-10-04 10:40:40 +02:00
ec0f256ad7
refactor: `Expr` => `DeleteExpr`
2021-10-04 10:28:09 +02:00
425ecebf9d
chore(deps): bump ouroboros from 0.11.1 to 0.12.0
...
Bumps [ouroboros](https://github.com/joshua-maros/ouroboros ) from 0.11.1 to 0.12.0.
- [Release notes](https://github.com/joshua-maros/ouroboros/releases )
- [Commits](https://github.com/joshua-maros/ouroboros/commits )
---
updated-dependencies:
- dependency-name: ouroboros
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:25:32 +00:00
846db0f1ff
Merge pull request #2704 from influxdata/dependabot/cargo/prometheus-0.13.0
...
chore(deps): bump prometheus from 0.12.0 to 0.13.0
2021-10-04 08:18:49 +00:00
b33e1386e0
chore(deps): bump prometheus from 0.12.0 to 0.13.0
...
Bumps [prometheus](https://github.com/tikv/rust-prometheus ) from 0.12.0 to 0.13.0.
- [Release notes](https://github.com/tikv/rust-prometheus/releases )
- [Changelog](https://github.com/tikv/rust-prometheus/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tikv/rust-prometheus/compare/v0.12.0...v0.13.0 )
---
updated-dependencies:
- dependency-name: prometheus
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:10:07 +00:00
150f34e08b
Merge pull request #2706 from influxdata/dependabot/cargo/smallvec-1.7.0
...
chore(deps): bump smallvec from 1.6.1 to 1.7.0
2021-10-04 08:06:53 +00:00
Marco Neumann
kodiakhq[bot]
Nga Tran
Raphael Taylor-Davies
dependabot[bot]
Edd Robinson