Commit Graph

5367 Commits (45c2c261682785de339678c89c3c720c49d66479)

Author SHA1 Message Date
kodiakhq[bot] aa4001e8b8
Merge pull request #2707 from influxdata/dependabot/cargo/cloud-storage-0.10.3
chore(deps): bump cloud-storage from 0.10.2 to 0.10.3
2021-10-04 07:55:19 +00:00
dependabot[bot] 44d7479db1
chore(deps): bump cloud-storage from 0.10.2 to 0.10.3
Bumps [cloud-storage](https://github.com/ThouCheese/cloud-storage-rs) from 0.10.2 to 0.10.3.
- [Release notes](https://github.com/ThouCheese/cloud-storage-rs/releases)
- [Changelog](https://github.com/ThouCheese/cloud-storage-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ThouCheese/cloud-storage-rs/commits)

---
updated-dependencies:
- dependency-name: cloud-storage
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-10-04 01:43:09 +00:00
kodiakhq[bot] e48b783ec2
Merge pull request #2699 from influxdata/ntran/delete_endpoint
feat: support http delete endpoints
2021-10-01 20:46:02 +00:00
Nga Tran 154dd4460e refactor: address review comments 2021-10-01 16:37:22 -04:00
Nga Tran bd22c73b8a chore: Merge branch 'main' into ntran/delete_endpoint 2021-10-01 13:33:39 -04:00
Andrew Lamb 134fb96b26
feat: add UInt64 support for gRPC query results (#2701) 2021-10-01 17:18:32 +00:00
Nga Tran a20da48168 refactor: cleanup 2021-10-01 12:29:01 -04:00
Nga Tran ee94e9038a test: finalize codin up delete http endpoints and end-to-end tests 2021-10-01 12:15:00 -04:00
kodiakhq[bot] 97052c9915
Merge pull request #2686 from influxdata/client-custom-connector
feat: Allow iox clients to specify connector
2021-10-01 09:03:07 +00:00
Marko Mikulicic 399d67e6b0
feat: Allow iox clients to specify connector
This allows to implement custom transports for iox clients (such as socks5 proxies, see #2683).
2021-10-01 10:52:41 +02:00
kodiakhq[bot] 1134e4337b
Merge pull request #2685 from influxdata/fix-nix
fix: Fix RUSTSEC-2021-0119
2021-10-01 08:06:54 +00:00
Marko Mikulicic a1f91207b3
fix: Fix RUSTSEC-2021-0119
Update `nix` dependency which includes a fix for RUSTSEC-2021-0119
2021-10-01 09:08:47 +02:00
Nga Tran 53a45d89b7 feat: support HTTP Delete Endpoints 2021-09-30 18:09:17 -04:00
Raphael Taylor-Davies b402423e9e
feat: remove move lifecycle action (#2674)
* feat: remove move_chunk lifecycle action

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 16:58:05 +00:00
Nga Tran 105b63b2af
test: use integer in predicates (#2673)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 10:46:03 +00:00
Andrew Lamb 7316f3407a
fix: Reduce log noise when no files are deleted (#2671)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 08:55:30 +00:00
Raphael Taylor-Davies 826d50f14a
chore: update tracing and logging docs (#2657)
* chore: update tracing and logging docs

* chore: review feedback

* chore: add log-format to basic usage section
2021-09-30 08:46:23 +00:00
Raphael Taylor-Davies db22b4bf60
chore: expand protobuf documentation (#2659)
* chore: expand protobuf documentation

* chore: review feedback

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-29 21:22:03 +00:00
kodiakhq[bot] 8647e40b55
Merge pull request #2661 from influxdata/er/fix/read_buffer/pred_validate
fix: fallback to DataFusion predicates if unable to execute on RUB
2021-09-29 21:12:22 +00:00
Edd Robinson c2deb9ece8
Merge branch 'main' into er/fix/read_buffer/pred_validate 2021-09-29 22:02:18 +01:00
Raphael Taylor-Davies 49c46fef66
chore: suppress RUSTSEC-2021-0116, RUSTSEC-2021-0117 and RUSTSEC-2021-0118 (#2669)
* chore: suppress RUSTSEC-2021-0117 and RUSTSEC-2021-0118

* chore: suppress RUSTSEC-2021-0116

* fix: Update .cargo/audit.toml

* fix:  Update .cargo/audit.toml

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-09-29 19:15:53 +00:00
Edd Robinson c10f3258da
Merge branch 'main' into er/fix/read_buffer/pred_validate 2021-09-29 17:15:27 +01:00
Andrew Lamb b38f16201c
refactor: remove spurious warning (#2662) 2021-09-29 15:50:26 +00:00
Edd Robinson 003f72ba00
Merge branch 'main' into er/fix/read_buffer/pred_validate 2021-09-29 14:50:12 +01:00
kodiakhq[bot] 620021dd68
Merge pull request #2656 from influxdata/ntran/all_soft_deleted
test: more tests that includes the repro of 2546
2021-09-29 13:48:57 +00:00
Edd Robinson a52b86e070 fix: fallback to no predicate if it can't be validated
Closes: #1603

If a predicate cannot be executed against a read buffer chunk because of schema conflicts then fall back to applying no predicate and let the query engine apply predicates in the Filter step of the plan.
2021-09-29 14:42:56 +01:00
Edd Robinson 8b458e2c2b feat: add API for validating a predicate against a chunk: 2021-09-29 14:42:42 +01:00
kodiakhq[bot] ac63f1c6cb
Merge branch 'main' into ntran/all_soft_deleted 2021-09-29 13:39:53 +00:00
Edd Robinson 0a3ca90809 refactor: only validate same types 2021-09-29 14:39:43 +01:00
kodiakhq[bot] 963796662f
Merge pull request #2625 from influxdata/cn/s3-retry
fix: Retry S3 requests that fail with 5xx and remove streaming put API that wasn't used
2021-09-29 12:27:40 +00:00
Carol (Nichols || Goulding) fb0e6ad5b1 docs: Document the s3_request generics and how they fit together 2021-09-29 08:19:33 -04:00
Carol (Nichols || Goulding) 2b9612a033 fix: Remove some of the futures in futures layers
I think the FuturesRetry crate needed this, but we're no longer using
the crate so we can get rid of some of the complexity.
2021-09-29 08:19:33 -04:00
Carol (Nichols || Goulding) ad1405dcdf fix: Reduce number of AWS S3 request retries from 10 to 3 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 5857edb19a fix: cloud_storage crate returns a different error type in this case 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 92583aee82 fix: Remove streaming API since we're not streaming anyway 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) edd6c12e93 fix: Add logging when retrying AWS requests 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) ea4cb9a6c1 refactor: Extract the maximum number of retries into a documented public constant 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 9cf343db08 refactor: Use loop instead of futures_retry 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 9cdccae49d fix: Actually do the exponential part of exponential backoff 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) d69472e114 refactor: Use s3_request in s3 delete 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) d05528bcfd refactor: Use s3_request for put requests
Which meant we also needed to change the byte stream to be a closure
that can generate a byte stream
2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) dd3b405727 fix: Only retry s3 requests if error is 500 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 936fba24b9 refactor: Make s3_request generic over the return type 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 5c78b7d5ae refactor: Extract an s3_request method that handles retries 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) fd3a027ca8 refactor: Use the extracted aws list function in list_with_delimiter 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) a1a8bc01bf refactor: Extract a method just to stream aws list requests 2021-09-29 08:19:32 -04:00
Andrew Lamb 451135ac31
fix: remove unused imports in proto (#2654)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-29 08:42:32 +00:00
Nga Tran 3cfea6e83f refactor: add comment 2021-09-28 17:44:49 -04:00
Nga Tran 2837aae479 test: more tests that inlcude the repro of 2546 2021-09-28 17:42:23 -04:00
Andrew Lamb 2db56a0332
chore: Make query logging a bit less verbose (#2655)
* chore: Make query logging a bit less verbose

* fix: remove unused use
2021-09-28 20:58:37 +00:00