Commit Graph

5292 Commits (06c2c23322294cf168f70fb03b488c1b8306e928)

Author SHA1 Message Date
kodiakhq[bot] fe61a4a868
Merge pull request #2628 from influxdata/crepererum/move_delete_predicate_persistence
refactor: move delete predicate persistence into background job
2021-10-06 06:14:05 +00:00
Marco Neumann d322069dd4 refactor: move delete predicate persistence into background job 2021-10-06 08:05:38 +02:00
Nga Tran 055e69439d test: fix auto created tests 2021-10-05 18:11:27 -04:00
Nga Tran aa64daca86 feat: dDisable using statistics to query data if there are soft deleted rows 2021-10-05 17:52:32 -04:00
Raphael Taylor-Davies a647865e1a
revert: "build: pin smallvec" (#2740)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-05 19:23:00 +00:00
Andrew Lamb 785a62c114
fix: include all group tags, not just group_keys in GroupFrame response (#2741)
* fix: include all group tags, not just group_keys in GroupFrame response

* docs: fix test comments, add doc strings for group_description_to_frames

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-05 19:08:04 +00:00
kodiakhq[bot] 5177e69514
Merge pull request #2742 from influxdata/ntran/delete_cleanup
chore: clean up dead code
2021-10-05 17:49:35 +00:00
Nga Tran eebbb9a165 chore: clea up dead code 2021-10-05 13:08:40 -04:00
kodiakhq[bot] ad60d73657
Merge pull request #2730 from influxdata/crepererum/in_mem_expr_part5
refactor: delete predicate clean-ups
2021-10-05 16:30:32 +00:00
kodiakhq[bot] d72a494198
Merge branch 'main' into crepererum/in_mem_expr_part5 2021-10-05 16:20:24 +00:00
Raphael Taylor-Davies d0929e3a34
feat: persist no chunks (#2712) (#2718)
* feat: persist no chunks (#2712)

* fix: persist partition

* fix: chunk ordering test

* chore: fix logical conflict

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-05 15:18:35 +00:00
Raphael Taylor-Davies 2a584420b3
refactor: make data_types optional dependency (#2739)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-05 15:07:45 +00:00
Andrew Lamb bf73bba1dc
fix: Return `_field` and `_measurement` tags correctly for read_group (#2736)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-05 14:56:41 +00:00
kodiakhq[bot] f8fd61e2c3
Merge pull request #2737 from influxdata/dom/pin-smallvec
build: pin smallvec
2021-10-05 14:42:01 +00:00
kodiakhq[bot] c9e030e901
Merge branch 'main' into dom/pin-smallvec 2021-10-05 14:32:18 +00:00
Dom 5abc55406d build: pin smallvec
Pin the smallvec version until the rest of the ecosystem catches up.

Fixes https://github.com/influxdata/influxdb_iox/issues/2735.
2021-10-05 16:27:00 +02:00
kodiakhq[bot] e525d75c9a
Merge pull request #2728 from influxdata/ntran/response
feat: handle delete responses
2021-10-05 14:23:14 +00:00
kodiakhq[bot] d92544f142
Merge branch 'main' into ntran/response 2021-10-05 14:13:47 +00:00
Nga Tran 825ddaa34c chore: merge main to branch 2021-10-05 10:12:17 -04:00
kodiakhq[bot] d50f41c427
Merge pull request #2733 from influxdata/dom/cloneable-iox-client-builder
refactor: derive Clone for IOx client builder
2021-10-05 13:57:38 +00:00
Dom 53e49156d6 refactor: derive Clone for IOx client builder
Allows an IOx client builder (with its associated configuration) to be
cloned.
2021-10-05 15:44:57 +02:00
kodiakhq[bot] 08d69d3da7
Merge pull request #2732 from influxdata/crepererum/bytes_for_txn_uuids
refactor: use protobuf bytes for transaction UUIDs
2021-10-05 11:07:22 +00:00
Marco Neumann b8aa4c33ce refactor: use protobuf bytes for transaction UUIDs 2021-10-05 12:27:48 +02:00
Marco Neumann bb7a27e5ed refactor: use proper sets during delete predicate collection
We no longer need hacky pointer tricks to de-duplicate delete predicates
when collecting them for catalog checkpoints. This was once required
when the delete predicates didn't implement `Eq` and `Hash` but now it's
all way easier.
2021-10-05 10:37:34 +02:00
Marco Neumann 28ccf2a8c3 refactor: `TransactionHandle::delete_predicate` cannot fail 2021-10-05 09:41:46 +02:00
kodiakhq[bot] 0a83379e23
Merge pull request #2723 from influxdata/crepererum/in_mem_expr_part4
refactor: remove unused fields from `DeletePredicate` and remove intermediate `ParseDeletePredicate`
2021-10-05 07:37:31 +00:00
Marco Neumann 1d18758075 refactor: fold `ParseDeletePredicate` into `DeletePredicate`
There is no reason to have yet another intermediate type. This also
makes the intermediate parsing functions private.
2021-10-05 09:29:25 +02:00
Marco Neumann 10c1a72402 refactor: remove unused fields from `DeletePredicate` 2021-10-05 09:29:24 +02:00
Nga Tran 80c4ba959d test: add negative tests for delete hhtp endpoints 2021-10-04 21:19:10 -04:00
Nga Tran ff8e037971 feat: handle delete response 2021-10-04 20:37:53 -04:00
kodiakhq[bot] d10d8e8a45
Merge pull request #2725 from influxdata/ntran/stop_inlcusive
fix: make stop time inclusive
2021-10-04 19:06:03 +00:00
Nga Tran 1856d7184c fix: make stop time inclusive 2021-10-04 14:14:16 -04:00
kodiakhq[bot] 8e9dd22753
Merge pull request #2721 from influxdata/ntran/default_delete
test: turn on tests of delete all
2021-10-04 17:07:41 +00:00
kodiakhq[bot] 5ad858524f
Merge branch 'main' into ntran/default_delete 2021-10-04 16:58:48 +00:00
Nga Tran 64cd0cb3ce chore: cleanup 2021-10-04 12:43:35 -04:00
kodiakhq[bot] 00818de4e6
Merge pull request #2720 from influxdata/crepererum/in_mem_expr_part3
chore: enable linting for `predicate` crate
2021-10-04 16:40:07 +00:00
kodiakhq[bot] 018c5bd1e3
Merge branch 'main' into crepererum/in_mem_expr_part3 2021-10-04 16:31:49 +00:00
Nga Tran ba96b20b1f test: turn on tests of delete all 2021-10-04 12:28:49 -04:00
kodiakhq[bot] 0dbeac47bf
Merge pull request #2716 from influxdata/crepererum/issue2633a
refactor: make `ChunkOrder` non-zero
2021-10-04 15:59:24 +00:00
Marco Neumann 150e7c222f chore: enable linting for `predicate` crate 2021-10-04 17:58:40 +02:00
kodiakhq[bot] f6fc148fe5
Merge branch 'main' into crepererum/issue2633a 2021-10-04 15:50:48 +00:00
Raphael Taylor-Davies 742a1065a1
feat: don't auto-increment background worker now (#2719)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-04 15:50:09 +00:00
Marco Neumann 97881079e8 refactor: make `ChunkOrder` non-zero
This will make it easier to handle missing values.

Helps with #2633.
2021-10-04 17:49:12 +02:00
kodiakhq[bot] 57ed72cd40
Merge pull request #2715 from influxdata/crepererum/in_mem_expr_part2
refactor: introduce `DeletePredicate`
2021-10-04 15:06:54 +00:00
Marco Neumann d8dddc358f
fix: typo in error message
Co-authored-by: Nga Tran <ntran@influxdata.com>
2021-10-04 16:56:43 +02:00
Marco Neumann 75ac6e8646 refactor: make `DeletePredicate::range` non-optional 2021-10-04 16:36:20 +02:00
Marco Neumann d1835a3eee fix: doc links 2021-10-04 16:36:20 +02:00
Marco Neumann 5a5a929b9e refactor: introduce `DeletePredicate`
`DeletePredicate` is a simpler version of `Predicate` that is based on
IOx `DeleteExpr` instead of the full-blown DataFusion `Expr`. This will
allow us to do a couple of things (in follow-up changes):

- Order and de-duplicate delete predicates
- Normalize predicates
- Infallible serialization
- Smaller memory footprint

Note that this change only affects delete expressions. Query expressions
that are supported via the API are not changed. The query subsystem also
still uses the full-featured expressions/predicates (delete
expressions/predicates are converted to the more powerful DataFusion
version on-the-fly).
2021-10-04 16:36:20 +02:00
kodiakhq[bot] 97fd506b4e
Merge pull request #2705 from influxdata/dependabot/cargo/arrow-flight-5.5.0
chore(deps): bump arrow-flight from 5.4.0 to 5.5.0
2021-10-04 13:47:31 +00:00
dependabot[bot] 7a6f381e69
chore(deps): bump arrow-flight from 5.4.0 to 5.5.0
Bumps [arrow-flight](https://github.com/apache/arrow-rs) from 5.4.0 to 5.5.0.
- [Release notes](https://github.com/apache/arrow-rs/releases)
- [Changelog](https://github.com/apache/arrow-rs/blob/5.5.0/CHANGELOG.md)
- [Commits](https://github.com/apache/arrow-rs/compare/5.4.0...5.5.0)

---
updated-dependencies:
- dependency-name: arrow-flight
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 13:27:26 +00:00