9cc6b18205
refactor: simplify delete_predicate_preservation test ( #2714 )
2021-10-04 11:38:03 +00:00
e8eab2cc97
feat: allow compaction and persistence to retun no chunk ( #2664 ) ( #2700 )
...
* feat: allow compaction and persistence to retun no chunk (#2664 )
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-10-04 10:54:47 +00:00
01de3fb42b
Merge pull request #2711 from influxdata/crepererum/fix_http_delete_test
...
test: fix flaky `influxdb_ioxd::http::tests::test_delete`
2021-10-04 10:37:59 +00:00
62e0fccd28
Merge branch 'main' into crepererum/fix_http_delete_test
2021-10-04 10:29:23 +00:00
4e9f21ed05
Merge pull request #2622 from influxdata/crepererum/in_mem_expr_part1
...
refactor: use dedicated in-memory `Expr` type during IO
2021-10-04 08:53:57 +00:00
5060bf71fe
Merge branch 'main' into crepererum/in_mem_expr_part1
2021-10-04 08:45:50 +00:00
51246e3c8d
docs: remove outdated comment
2021-10-04 10:44:30 +02:00
95315590c0
Merge pull request #2710 from influxdata/dependabot/cargo/ouroboros-0.12.0
...
chore(deps): bump ouroboros from 0.11.1 to 0.12.0
2021-10-04 08:41:22 +00:00
bd39fae99d
test: fix flaky `influxdb_ioxd::http::tests::test_delete`
2021-10-04 10:40:40 +02:00
ec0f256ad7
refactor: `Expr` => `DeleteExpr`
2021-10-04 10:28:09 +02:00
425ecebf9d
chore(deps): bump ouroboros from 0.11.1 to 0.12.0
...
Bumps [ouroboros](https://github.com/joshua-maros/ouroboros ) from 0.11.1 to 0.12.0.
- [Release notes](https://github.com/joshua-maros/ouroboros/releases )
- [Commits](https://github.com/joshua-maros/ouroboros/commits )
---
updated-dependencies:
- dependency-name: ouroboros
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:25:32 +00:00
846db0f1ff
Merge pull request #2704 from influxdata/dependabot/cargo/prometheus-0.13.0
...
chore(deps): bump prometheus from 0.12.0 to 0.13.0
2021-10-04 08:18:49 +00:00
b33e1386e0
chore(deps): bump prometheus from 0.12.0 to 0.13.0
...
Bumps [prometheus](https://github.com/tikv/rust-prometheus ) from 0.12.0 to 0.13.0.
- [Release notes](https://github.com/tikv/rust-prometheus/releases )
- [Changelog](https://github.com/tikv/rust-prometheus/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tikv/rust-prometheus/compare/v0.12.0...v0.13.0 )
---
updated-dependencies:
- dependency-name: prometheus
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 08:10:07 +00:00
150f34e08b
Merge pull request #2706 from influxdata/dependabot/cargo/smallvec-1.7.0
...
chore(deps): bump smallvec from 1.6.1 to 1.7.0
2021-10-04 08:06:53 +00:00
a0bbbdb197
refactor: use dedicated in-memory `Expr` type during IO
...
Place a dedicated `Expr` type between datafusion and protobuf. While
this type is currently only used during serialization, it will be used
within `Predicate` in a follow-up change to enable de-duplication of
predicates and avoid the double parsing of datafusion expressions (we
are already somewhat parsing them when we check for valid delete
predicates).
This change looks larger than it is. In practice it just separates the
conversion "datafusion => protobuf" into "datafusion => IOx => protobuf"
and "protobuf => datafusion" into "protobuf => IOx => datafusion". So
(apart from the error types) this is functionally the same.
2021-10-04 09:59:14 +02:00
8893b483a3
chore(deps): bump smallvec from 1.6.1 to 1.7.0
...
Bumps [smallvec](https://github.com/servo/rust-smallvec ) from 1.6.1 to 1.7.0.
- [Release notes](https://github.com/servo/rust-smallvec/releases )
- [Commits](https://github.com/servo/rust-smallvec/compare/v1.6.1...v1.7.0 )
---
updated-dependencies:
- dependency-name: smallvec
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 07:57:00 +00:00
aa4001e8b8
Merge pull request #2707 from influxdata/dependabot/cargo/cloud-storage-0.10.3
...
chore(deps): bump cloud-storage from 0.10.2 to 0.10.3
2021-10-04 07:55:19 +00:00
44d7479db1
chore(deps): bump cloud-storage from 0.10.2 to 0.10.3
...
Bumps [cloud-storage](https://github.com/ThouCheese/cloud-storage-rs ) from 0.10.2 to 0.10.3.
- [Release notes](https://github.com/ThouCheese/cloud-storage-rs/releases )
- [Changelog](https://github.com/ThouCheese/cloud-storage-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ThouCheese/cloud-storage-rs/commits )
---
updated-dependencies:
- dependency-name: cloud-storage
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 01:43:09 +00:00
e48b783ec2
Merge pull request #2699 from influxdata/ntran/delete_endpoint
...
feat: support http delete endpoints
2021-10-01 20:46:02 +00:00
154dd4460e
refactor: address review comments
2021-10-01 16:37:22 -04:00
bd22c73b8a
chore: Merge branch 'main' into ntran/delete_endpoint
2021-10-01 13:33:39 -04:00
134fb96b26
feat: add UInt64 support for gRPC query results ( #2701 )
2021-10-01 17:18:32 +00:00
a20da48168
refactor: cleanup
2021-10-01 12:29:01 -04:00
ee94e9038a
test: finalize codin up delete http endpoints and end-to-end tests
2021-10-01 12:15:00 -04:00
97052c9915
Merge pull request #2686 from influxdata/client-custom-connector
...
feat: Allow iox clients to specify connector
2021-10-01 09:03:07 +00:00
399d67e6b0
feat: Allow iox clients to specify connector
...
This allows to implement custom transports for iox clients (such as socks5 proxies, see #2683 ).
2021-10-01 10:52:41 +02:00
1134e4337b
Merge pull request #2685 from influxdata/fix-nix
...
fix: Fix RUSTSEC-2021-0119
2021-10-01 08:06:54 +00:00
a1f91207b3
fix: Fix RUSTSEC-2021-0119
...
Update `nix` dependency which includes a fix for RUSTSEC-2021-0119
2021-10-01 09:08:47 +02:00
53a45d89b7
feat: support HTTP Delete Endpoints
2021-09-30 18:09:17 -04:00
b402423e9e
feat: remove move lifecycle action ( #2674 )
...
* feat: remove move_chunk lifecycle action
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 16:58:05 +00:00
105b63b2af
test: use integer in predicates ( #2673 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 10:46:03 +00:00
7316f3407a
fix: Reduce log noise when no files are deleted ( #2671 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 08:55:30 +00:00
826d50f14a
chore: update tracing and logging docs ( #2657 )
...
* chore: update tracing and logging docs
* chore: review feedback
* chore: add log-format to basic usage section
2021-09-30 08:46:23 +00:00
db22b4bf60
chore: expand protobuf documentation ( #2659 )
...
* chore: expand protobuf documentation
* chore: review feedback
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-29 21:22:03 +00:00
8647e40b55
Merge pull request #2661 from influxdata/er/fix/read_buffer/pred_validate
...
fix: fallback to DataFusion predicates if unable to execute on RUB
2021-09-29 21:12:22 +00:00
c2deb9ece8
Merge branch 'main' into er/fix/read_buffer/pred_validate
2021-09-29 22:02:18 +01:00
49c46fef66
chore: suppress RUSTSEC-2021-0116, RUSTSEC-2021-0117 and RUSTSEC-2021-0118 ( #2669 )
...
* chore: suppress RUSTSEC-2021-0117 and RUSTSEC-2021-0118
* chore: suppress RUSTSEC-2021-0116
* fix: Update .cargo/audit.toml
* fix: Update .cargo/audit.toml
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-09-29 19:15:53 +00:00
c10f3258da
Merge branch 'main' into er/fix/read_buffer/pred_validate
2021-09-29 17:15:27 +01:00
b38f16201c
refactor: remove spurious warning ( #2662 )
2021-09-29 15:50:26 +00:00
003f72ba00
Merge branch 'main' into er/fix/read_buffer/pred_validate
2021-09-29 14:50:12 +01:00
620021dd68
Merge pull request #2656 from influxdata/ntran/all_soft_deleted
...
test: more tests that includes the repro of 2546
2021-09-29 13:48:57 +00:00
a52b86e070
fix: fallback to no predicate if it can't be validated
...
Closes : #1603
If a predicate cannot be executed against a read buffer chunk because of schema conflicts then fall back to applying no predicate and let the query engine apply predicates in the Filter step of the plan.
2021-09-29 14:42:56 +01:00
8b458e2c2b
feat: add API for validating a predicate against a chunk:
2021-09-29 14:42:42 +01:00
ac63f1c6cb
Merge branch 'main' into ntran/all_soft_deleted
2021-09-29 13:39:53 +00:00
0a3ca90809
refactor: only validate same types
2021-09-29 14:39:43 +01:00
963796662f
Merge pull request #2625 from influxdata/cn/s3-retry
...
fix: Retry S3 requests that fail with 5xx and remove streaming put API that wasn't used
2021-09-29 12:27:40 +00:00
fb0e6ad5b1
docs: Document the s3_request generics and how they fit together
2021-09-29 08:19:33 -04:00
2b9612a033
fix: Remove some of the futures in futures layers
...
I think the FuturesRetry crate needed this, but we're no longer using
the crate so we can get rid of some of the complexity.
2021-09-29 08:19:33 -04:00
ad1405dcdf
fix: Reduce number of AWS S3 request retries from 10 to 3
2021-09-29 08:19:32 -04:00
5857edb19a
fix: cloud_storage crate returns a different error type in this case
2021-09-29 08:19:32 -04:00
Raphael Taylor-Davies
kodiakhq[bot]
Marco Neumann
dependabot[bot]
Nga Tran
Andrew Lamb
Marko Mikulicic
Edd Robinson
Carol (Nichols || Goulding)