Commit Graph

5160 Commits (8e9dd227534f57e607c7d6b89fad055bde6e02fe)

Author SHA1 Message Date
Nga Tran ee94e9038a test: finalize codin up delete http endpoints and end-to-end tests 2021-10-01 12:15:00 -04:00
kodiakhq[bot] 97052c9915
Merge pull request #2686 from influxdata/client-custom-connector
feat: Allow iox clients to specify connector
2021-10-01 09:03:07 +00:00
Marko Mikulicic 399d67e6b0
feat: Allow iox clients to specify connector
This allows to implement custom transports for iox clients (such as socks5 proxies, see #2683).
2021-10-01 10:52:41 +02:00
kodiakhq[bot] 1134e4337b
Merge pull request #2685 from influxdata/fix-nix
fix: Fix RUSTSEC-2021-0119
2021-10-01 08:06:54 +00:00
Marko Mikulicic a1f91207b3
fix: Fix RUSTSEC-2021-0119
Update `nix` dependency which includes a fix for RUSTSEC-2021-0119
2021-10-01 09:08:47 +02:00
Nga Tran 53a45d89b7 feat: support HTTP Delete Endpoints 2021-09-30 18:09:17 -04:00
Raphael Taylor-Davies b402423e9e
feat: remove move lifecycle action (#2674)
* feat: remove move_chunk lifecycle action

* chore: review feedback

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 16:58:05 +00:00
Nga Tran 105b63b2af
test: use integer in predicates (#2673)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 10:46:03 +00:00
Andrew Lamb 7316f3407a
fix: Reduce log noise when no files are deleted (#2671)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-30 08:55:30 +00:00
Raphael Taylor-Davies 826d50f14a
chore: update tracing and logging docs (#2657)
* chore: update tracing and logging docs

* chore: review feedback

* chore: add log-format to basic usage section
2021-09-30 08:46:23 +00:00
Raphael Taylor-Davies db22b4bf60
chore: expand protobuf documentation (#2659)
* chore: expand protobuf documentation

* chore: review feedback

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-29 21:22:03 +00:00
kodiakhq[bot] 8647e40b55
Merge pull request #2661 from influxdata/er/fix/read_buffer/pred_validate
fix: fallback to DataFusion predicates if unable to execute on RUB
2021-09-29 21:12:22 +00:00
Edd Robinson c2deb9ece8
Merge branch 'main' into er/fix/read_buffer/pred_validate 2021-09-29 22:02:18 +01:00
Raphael Taylor-Davies 49c46fef66
chore: suppress RUSTSEC-2021-0116, RUSTSEC-2021-0117 and RUSTSEC-2021-0118 (#2669)
* chore: suppress RUSTSEC-2021-0117 and RUSTSEC-2021-0118

* chore: suppress RUSTSEC-2021-0116

* fix: Update .cargo/audit.toml

* fix:  Update .cargo/audit.toml

Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-09-29 19:15:53 +00:00
Edd Robinson c10f3258da
Merge branch 'main' into er/fix/read_buffer/pred_validate 2021-09-29 17:15:27 +01:00
Andrew Lamb b38f16201c
refactor: remove spurious warning (#2662) 2021-09-29 15:50:26 +00:00
Edd Robinson 003f72ba00
Merge branch 'main' into er/fix/read_buffer/pred_validate 2021-09-29 14:50:12 +01:00
kodiakhq[bot] 620021dd68
Merge pull request #2656 from influxdata/ntran/all_soft_deleted
test: more tests that includes the repro of 2546
2021-09-29 13:48:57 +00:00
Edd Robinson a52b86e070 fix: fallback to no predicate if it can't be validated
Closes: #1603

If a predicate cannot be executed against a read buffer chunk because of schema conflicts then fall back to applying no predicate and let the query engine apply predicates in the Filter step of the plan.
2021-09-29 14:42:56 +01:00
Edd Robinson 8b458e2c2b feat: add API for validating a predicate against a chunk: 2021-09-29 14:42:42 +01:00
kodiakhq[bot] ac63f1c6cb
Merge branch 'main' into ntran/all_soft_deleted 2021-09-29 13:39:53 +00:00
Edd Robinson 0a3ca90809 refactor: only validate same types 2021-09-29 14:39:43 +01:00
kodiakhq[bot] 963796662f
Merge pull request #2625 from influxdata/cn/s3-retry
fix: Retry S3 requests that fail with 5xx and remove streaming put API that wasn't used
2021-09-29 12:27:40 +00:00
Carol (Nichols || Goulding) fb0e6ad5b1 docs: Document the s3_request generics and how they fit together 2021-09-29 08:19:33 -04:00
Carol (Nichols || Goulding) 2b9612a033 fix: Remove some of the futures in futures layers
I think the FuturesRetry crate needed this, but we're no longer using
the crate so we can get rid of some of the complexity.
2021-09-29 08:19:33 -04:00
Carol (Nichols || Goulding) ad1405dcdf fix: Reduce number of AWS S3 request retries from 10 to 3 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 5857edb19a fix: cloud_storage crate returns a different error type in this case 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 92583aee82 fix: Remove streaming API since we're not streaming anyway 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) edd6c12e93 fix: Add logging when retrying AWS requests 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) ea4cb9a6c1 refactor: Extract the maximum number of retries into a documented public constant 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 9cf343db08 refactor: Use loop instead of futures_retry 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 9cdccae49d fix: Actually do the exponential part of exponential backoff 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) d69472e114 refactor: Use s3_request in s3 delete 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) d05528bcfd refactor: Use s3_request for put requests
Which meant we also needed to change the byte stream to be a closure
that can generate a byte stream
2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) dd3b405727 fix: Only retry s3 requests if error is 500 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 936fba24b9 refactor: Make s3_request generic over the return type 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) 5c78b7d5ae refactor: Extract an s3_request method that handles retries 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) fd3a027ca8 refactor: Use the extracted aws list function in list_with_delimiter 2021-09-29 08:19:32 -04:00
Carol (Nichols || Goulding) a1a8bc01bf refactor: Extract a method just to stream aws list requests 2021-09-29 08:19:32 -04:00
Andrew Lamb 451135ac31
fix: remove unused imports in proto (#2654)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-29 08:42:32 +00:00
Nga Tran 3cfea6e83f refactor: add comment 2021-09-28 17:44:49 -04:00
Nga Tran 2837aae479 test: more tests that inlcude the repro of 2546 2021-09-28 17:42:23 -04:00
Andrew Lamb 2db56a0332
chore: Make query logging a bit less verbose (#2655)
* chore: Make query logging a bit less verbose

* fix: remove unused use
2021-09-28 20:58:37 +00:00
kodiakhq[bot] 619d95492a
Merge pull request #2651 from influxdata/ntran/chunk_types
refactor: exhaust delete test scenarios (except multi partitions)
2021-09-28 19:00:26 +00:00
kodiakhq[bot] 0beab3e7e1
Merge branch 'main' into ntran/chunk_types 2021-09-28 18:52:01 +00:00
Nga Tran d7af1b8290 refactor: exhaust delete test scenarios 2021-09-28 12:31:46 -04:00
Raphael Taylor-Davies 86cee568d5
feat: use upstream pbjson (#2650)
* feat: use upstream pbjson

* chore: fmt
2021-09-28 16:29:26 +00:00
Raphael Taylor-Davies daa2ec2f4c
revert: "fix: Revert "feat: remove routerify (#2586)" (#2623)" (#2649)
This reverts commit 18941fcbff.
2021-09-28 14:42:17 +00:00
Raphael Taylor-Davies 46363c7893
feat: remove http tokio-tracing spans (#2648) 2021-09-28 12:49:59 +00:00
kodiakhq[bot] 029b8f6184
Merge pull request #2646 from influxdata/dependabot/cargo/libc-0.2.103
chore(deps): bump libc from 0.2.102 to 0.2.103
2021-09-28 08:25:08 +00:00