Commit Graph

5266 Commits (1718b55283a5abcbe00b460f975ca69087e9ad50)

Author SHA1 Message Date
Marco Neumann 1d18758075 refactor: fold `ParseDeletePredicate` into `DeletePredicate`
There is no reason to have yet another intermediate type. This also
makes the intermediate parsing functions private.
2021-10-05 09:29:25 +02:00
Marco Neumann 10c1a72402 refactor: remove unused fields from `DeletePredicate` 2021-10-05 09:29:24 +02:00
Nga Tran 80c4ba959d test: add negative tests for delete hhtp endpoints 2021-10-04 21:19:10 -04:00
Nga Tran ff8e037971 feat: handle delete response 2021-10-04 20:37:53 -04:00
kodiakhq[bot] d10d8e8a45
Merge pull request #2725 from influxdata/ntran/stop_inlcusive
fix: make stop time inclusive
2021-10-04 19:06:03 +00:00
Nga Tran 1856d7184c fix: make stop time inclusive 2021-10-04 14:14:16 -04:00
kodiakhq[bot] 8e9dd22753
Merge pull request #2721 from influxdata/ntran/default_delete
test: turn on tests of delete all
2021-10-04 17:07:41 +00:00
kodiakhq[bot] 5ad858524f
Merge branch 'main' into ntran/default_delete 2021-10-04 16:58:48 +00:00
Nga Tran 64cd0cb3ce chore: cleanup 2021-10-04 12:43:35 -04:00
kodiakhq[bot] 00818de4e6
Merge pull request #2720 from influxdata/crepererum/in_mem_expr_part3
chore: enable linting for `predicate` crate
2021-10-04 16:40:07 +00:00
kodiakhq[bot] 018c5bd1e3
Merge branch 'main' into crepererum/in_mem_expr_part3 2021-10-04 16:31:49 +00:00
Nga Tran ba96b20b1f test: turn on tests of delete all 2021-10-04 12:28:49 -04:00
kodiakhq[bot] 0dbeac47bf
Merge pull request #2716 from influxdata/crepererum/issue2633a
refactor: make `ChunkOrder` non-zero
2021-10-04 15:59:24 +00:00
Marco Neumann 150e7c222f chore: enable linting for `predicate` crate 2021-10-04 17:58:40 +02:00
kodiakhq[bot] f6fc148fe5
Merge branch 'main' into crepererum/issue2633a 2021-10-04 15:50:48 +00:00
Raphael Taylor-Davies 742a1065a1
feat: don't auto-increment background worker now (#2719)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-04 15:50:09 +00:00
Marco Neumann 97881079e8 refactor: make `ChunkOrder` non-zero
This will make it easier to handle missing values.

Helps with #2633.
2021-10-04 17:49:12 +02:00
kodiakhq[bot] 57ed72cd40
Merge pull request #2715 from influxdata/crepererum/in_mem_expr_part2
refactor: introduce `DeletePredicate`
2021-10-04 15:06:54 +00:00
Marco Neumann d8dddc358f
fix: typo in error message
Co-authored-by: Nga Tran <ntran@influxdata.com>
2021-10-04 16:56:43 +02:00
Marco Neumann 75ac6e8646 refactor: make `DeletePredicate::range` non-optional 2021-10-04 16:36:20 +02:00
Marco Neumann d1835a3eee fix: doc links 2021-10-04 16:36:20 +02:00
Marco Neumann 5a5a929b9e refactor: introduce `DeletePredicate`
`DeletePredicate` is a simpler version of `Predicate` that is based on
IOx `DeleteExpr` instead of the full-blown DataFusion `Expr`. This will
allow us to do a couple of things (in follow-up changes):

- Order and de-duplicate delete predicates
- Normalize predicates
- Infallible serialization
- Smaller memory footprint

Note that this change only affects delete expressions. Query expressions
that are supported via the API are not changed. The query subsystem also
still uses the full-featured expressions/predicates (delete
expressions/predicates are converted to the more powerful DataFusion
version on-the-fly).
2021-10-04 16:36:20 +02:00
kodiakhq[bot] 97fd506b4e
Merge pull request #2705 from influxdata/dependabot/cargo/arrow-flight-5.5.0
chore(deps): bump arrow-flight from 5.4.0 to 5.5.0
2021-10-04 13:47:31 +00:00
dependabot[bot] 7a6f381e69
chore(deps): bump arrow-flight from 5.4.0 to 5.5.0
Bumps [arrow-flight](https://github.com/apache/arrow-rs) from 5.4.0 to 5.5.0.
- [Release notes](https://github.com/apache/arrow-rs/releases)
- [Changelog](https://github.com/apache/arrow-rs/blob/5.5.0/CHANGELOG.md)
- [Commits](https://github.com/apache/arrow-rs/compare/5.4.0...5.5.0)

---
updated-dependencies:
- dependency-name: arrow-flight
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 13:27:26 +00:00
kodiakhq[bot] b0d8b679be
Merge pull request #2709 from influxdata/dependabot/cargo/arrow-5.5.0
chore(deps): bump arrow from 5.4.0 to 5.5.0
2021-10-04 13:19:23 +00:00
kodiakhq[bot] 181145eca1
Merge branch 'main' into dependabot/cargo/arrow-5.5.0 2021-10-04 13:10:42 +00:00
kodiakhq[bot] 04f5dc6b28
Merge pull request #2708 from influxdata/dependabot/cargo/parquet-5.5.0
chore(deps): bump parquet from 5.4.0 to 5.5.0
2021-10-04 12:05:17 +00:00
Edd Robinson 7ab10daa19
Merge branch 'main' into dependabot/cargo/arrow-5.5.0 2021-10-04 12:58:29 +01:00
Edd Robinson f8c72d611c
Merge branch 'main' into dependabot/cargo/parquet-5.5.0 2021-10-04 12:56:54 +01:00
Edd Robinson d0384f60d0 test: update server tests 2021-10-04 12:39:35 +01:00
Raphael Taylor-Davies 9cc6b18205
refactor: simplify delete_predicate_preservation test (#2714) 2021-10-04 11:38:03 +00:00
Edd Robinson e72f7e958c test: update expected results 2021-10-04 12:20:21 +01:00
dependabot[bot] 6d9205d87c chore(deps): bump parquet from 5.4.0 to 5.5.0
Bumps [parquet](https://github.com/apache/arrow-rs) from 5.4.0 to 5.5.0.
- [Release notes](https://github.com/apache/arrow-rs/releases)
- [Changelog](https://github.com/apache/arrow-rs/blob/5.5.0/CHANGELOG.md)
- [Commits](https://github.com/apache/arrow-rs/compare/5.4.0...5.5.0)

---
updated-dependencies:
- dependency-name: parquet
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 12:15:11 +01:00
Raphael Taylor-Davies e8eab2cc97
feat: allow compaction and persistence to retun no chunk (#2664) (#2700)
* feat: allow compaction and persistence to retun no chunk (#2664)

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-04 10:54:47 +00:00
kodiakhq[bot] 01de3fb42b
Merge pull request #2711 from influxdata/crepererum/fix_http_delete_test
test: fix flaky `influxdb_ioxd::http::tests::test_delete`
2021-10-04 10:37:59 +00:00
kodiakhq[bot] 62e0fccd28
Merge branch 'main' into crepererum/fix_http_delete_test 2021-10-04 10:29:23 +00:00
dependabot[bot] d1f5209869
chore(deps): bump arrow from 5.4.0 to 5.5.0
Bumps [arrow](https://github.com/apache/arrow-rs) from 5.4.0 to 5.5.0.
- [Release notes](https://github.com/apache/arrow-rs/releases)
- [Changelog](https://github.com/apache/arrow-rs/blob/5.5.0/CHANGELOG.md)
- [Commits](https://github.com/apache/arrow-rs/compare/5.4.0...5.5.0)

---
updated-dependencies:
- dependency-name: arrow
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:55:38 +00:00
kodiakhq[bot] 4e9f21ed05
Merge pull request #2622 from influxdata/crepererum/in_mem_expr_part1
refactor: use dedicated in-memory `Expr` type during IO
2021-10-04 08:53:57 +00:00
kodiakhq[bot] 5060bf71fe
Merge branch 'main' into crepererum/in_mem_expr_part1 2021-10-04 08:45:50 +00:00
Marco Neumann 51246e3c8d docs: remove outdated comment 2021-10-04 10:44:30 +02:00
kodiakhq[bot] 95315590c0
Merge pull request #2710 from influxdata/dependabot/cargo/ouroboros-0.12.0
chore(deps): bump ouroboros from 0.11.1 to 0.12.0
2021-10-04 08:41:22 +00:00
Marco Neumann bd39fae99d test: fix flaky `influxdb_ioxd::http::tests::test_delete` 2021-10-04 10:40:40 +02:00
Marco Neumann ec0f256ad7 refactor: `Expr` => `DeleteExpr` 2021-10-04 10:28:09 +02:00
dependabot[bot] 425ecebf9d
chore(deps): bump ouroboros from 0.11.1 to 0.12.0
Bumps [ouroboros](https://github.com/joshua-maros/ouroboros) from 0.11.1 to 0.12.0.
- [Release notes](https://github.com/joshua-maros/ouroboros/releases)
- [Commits](https://github.com/joshua-maros/ouroboros/commits)

---
updated-dependencies:
- dependency-name: ouroboros
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:25:32 +00:00
kodiakhq[bot] 846db0f1ff
Merge pull request #2704 from influxdata/dependabot/cargo/prometheus-0.13.0
chore(deps): bump prometheus from 0.12.0 to 0.13.0
2021-10-04 08:18:49 +00:00
dependabot[bot] b33e1386e0
chore(deps): bump prometheus from 0.12.0 to 0.13.0
Bumps [prometheus](https://github.com/tikv/rust-prometheus) from 0.12.0 to 0.13.0.
- [Release notes](https://github.com/tikv/rust-prometheus/releases)
- [Changelog](https://github.com/tikv/rust-prometheus/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tikv/rust-prometheus/compare/v0.12.0...v0.13.0)

---
updated-dependencies:
- dependency-name: prometheus
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:10:07 +00:00
kodiakhq[bot] 150f34e08b
Merge pull request #2706 from influxdata/dependabot/cargo/smallvec-1.7.0
chore(deps): bump smallvec from 1.6.1 to 1.7.0
2021-10-04 08:06:53 +00:00
Marco Neumann a0bbbdb197 refactor: use dedicated in-memory `Expr` type during IO
Place a dedicated `Expr` type between datafusion and protobuf. While
this type is currently only used during serialization, it will be used
within `Predicate` in a follow-up change to enable de-duplication of
predicates and avoid the double parsing of datafusion expressions (we
are already somewhat parsing them when we check for valid delete
predicates).

This change looks larger than it is. In practice it just separates the
conversion "datafusion => protobuf" into "datafusion => IOx => protobuf"
and "protobuf => datafusion" into "protobuf => IOx => datafusion". So
(apart from the error types) this is functionally the same.
2021-10-04 09:59:14 +02:00
dependabot[bot] 8893b483a3
chore(deps): bump smallvec from 1.6.1 to 1.7.0
Bumps [smallvec](https://github.com/servo/rust-smallvec) from 1.6.1 to 1.7.0.
- [Release notes](https://github.com/servo/rust-smallvec/releases)
- [Commits](https://github.com/servo/rust-smallvec/compare/v1.6.1...v1.7.0)

---
updated-dependencies:
- dependency-name: smallvec
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 07:57:00 +00:00
kodiakhq[bot] aa4001e8b8
Merge pull request #2707 from influxdata/dependabot/cargo/cloud-storage-0.10.3
chore(deps): bump cloud-storage from 0.10.2 to 0.10.3
2021-10-04 07:55:19 +00:00