02893e598c
chore: Update datafusion and upgrade arrow/parquet/arrow-flight to 13 ( #4516 )
...
* chore: Tool for automating arrow version update
* chore: Update datafusion and arrow/parquet/arrow-flight
* fix: update for changes in Arrow API
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-05 00:21:02 +00:00
590a71010d
chore(deps): Bump serde_json from 1.0.80 to 1.0.81 ( #4514 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.80 to 1.0.81.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.80...v1.0.81 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-04 14:10:35 +00:00
c05383bbf5
chore(deps): Bump serde_json from 1.0.79 to 1.0.80 ( #4501 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.79 to 1.0.80.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.79...v1.0.80 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-02 15:33:47 +00:00
e09157e81a
Merge branch 'main' into cn/bye-og-grpc-client
2022-05-02 14:54:54 +00:00
e3adff2281
chore(deps): Bump console-subscriber from 0.1.4 to 0.1.5 ( #4503 )
...
Bumps [console-subscriber](https://github.com/tokio-rs/console ) from 0.1.4 to 0.1.5.
- [Release notes](https://github.com/tokio-rs/console/releases )
- [Commits](https://github.com/tokio-rs/console/compare/console-subscriber-v0.1.4...console-subscriber-v0.1.5 )
---
updated-dependencies:
- dependency-name: console-subscriber
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-02 14:19:11 +00:00
c59eaada5a
chore(deps): Bump thiserror from 1.0.30 to 1.0.31 ( #4498 )
...
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.30 to 1.0.31.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.30...1.0.31 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-05-02 13:43:45 +00:00
dd3147c2ec
fix: allow `--grpc-bind` and `--api-bind` args in all-in-one mode ( #4494 )
...
* fix: allow `--grpc-bind` and `--api-bind` args in all-in-one mode
* fix: shutdown compactor more quickly on cancel
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-05-01 20:20:16 +00:00
a4443e4c31
fix: Remove OG gRPC client code and APIs
2022-04-29 16:29:49 -04:00
8e21d062fb
fix: Remove use of OG list databases from sql observer mode
...
Fixes #4478 .
2022-04-29 14:33:48 -04:00
ede51d2529
fix: Remove OG 'show databases' command in the SQL REPL
...
Connects to #4478 .
2022-04-29 14:33:22 -04:00
bc77f87ea9
feat: port influxrpc read_group and read_window_aggregate e2e test to NG ( #4464 )
...
port more
2022-04-29 16:13:32 +00:00
bb7910f689
fix: Remove influxdb_iox unused dev deps
2022-04-29 10:32:40 -04:00
e5cbee9fa8
fix: Delete OG end-to-end tests
2022-04-29 10:32:21 -04:00
6381ea60bb
chore: port remaining read_filter influxrpc tests to NG ( #4383 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-29 14:06:50 +00:00
0a20086a58
feat: expose catalog timeouts via CLI/env ( #4472 )
...
This is useful for local instances that run against a prod system,
because port forwarding can lead to long connection delays.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-29 11:14:15 +00:00
ed1ad858c0
chore: add some logging to flaky end to end test ( #4465 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-29 11:06:06 +00:00
01a6cf1c2a
chore(deps): Bump http from 0.2.6 to 0.2.7 ( #4470 )
...
Bumps [http](https://github.com/hyperium/http ) from 0.2.6 to 0.2.7.
- [Release notes](https://github.com/hyperium/http/releases )
- [Changelog](https://github.com/hyperium/http/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/http/compare/v0.2.6...v0.2.7 )
---
updated-dependencies:
- dependency-name: http
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-29 09:56:48 +00:00
8e48fcd620
feat: add remote pull partition ( #4433 )
...
Add lookup of partitions by table id to catalog.
Add API to catalog to return partitions by table id.
Add to client to return partitions by table id.
Add CLI to pull remote schema, partition, and parquet files into a local catalog and object store.
2022-04-28 21:04:27 +00:00
63df3ceb6f
feat: share server processes in end to end test ( #4387 )
...
* feat: share server processes in end to end test
* fix: Apply suggestions from code review
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-28 17:51:14 +00:00
5c89e7b952
fix: Remove max catalog connection config from all-in-one mode
2022-04-28 09:29:03 -04:00
a024e07147
fix: Small corrections to some comments
2022-04-28 09:29:02 -04:00
df1afa3481
feat: Log what kind of server in startup/shutdown logs
2022-04-28 09:29:02 -04:00
d6d50f83c2
feat: Set different catalog config defaults for all-in-one mode
...
Connects to #4399 .
If `--catalog-dsn` is specified, use that Postgres catalog. If
`--catalog-dsn` is not specified, use an in-memory catalog.
2022-04-28 09:29:02 -04:00
941dd12dd1
feat: Set different write buffer config defaults for all-in-one mode
...
Connects to #4399 .
Only file-based write buffer is supported. If `--data-dir` is specified,
store it there, otherwise store it in a temp directory to be ephemeral
2022-04-28 09:29:02 -04:00
0cfd16263c
refactor: Change run_config to logging_config
...
The only spot this method is used actually wants the logging config
2022-04-28 09:29:01 -04:00
06342f9ed8
feat: Set different ingester defaults for all-in-one mode
...
Connects to #4399 .
Manually flatten the arguments to set different defaults, not allow
setting the partition min/max, but still allow customization of the
other arguments.
2022-04-28 09:29:01 -04:00
246af0c3ca
test: remove hard-coded metric count
...
Prior to this commit, adding any metric to the catalog (and only the
catalog) would cause the end_to_end_ng_cases::metrics::test_metrics test
to fail due to asserting an exact number of metrics observed.
This commit changes the check condition to a more permisive >= rather
than ==.
2022-04-28 11:28:48 +01:00
420c306caa
chore(deps): Bump tokio from 1.17.0 to 1.18.0 ( #4453 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.17.0 to 1.18.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.17.0...tokio-1.18.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-28 08:21:17 +00:00
a195973cfb
chore(deps): Bump clap from 3.1.11 to 3.1.12 ( #4406 )
...
* chore(deps): Bump clap from 3.1.11 to 3.1.12
Bumps [clap](https://github.com/clap-rs/clap ) from 3.1.11 to 3.1.12.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v3.1.11...v3.1.12 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix: Update tests now that the clap crossed-streams bug has been fixed
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Carol (Nichols || Goulding) <carol.nichols@gmail.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-27 17:43:55 +00:00
bea4556749
chore: Ignore flaky OG end to end test ( #4441 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-27 15:17:46 +00:00
fb777e7e51
feat(router2): configurable max HTTP requests
...
Adds a CLI / env configuration option controlling the maximum number of
simultaneous HTTP requests in the router.
2022-04-26 11:13:25 +01:00
4b47d723b1
refactor: Rename time to iox_time ( #4416 )
...
Signed-off-by: hi-rustin <rustin.liu@gmail.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-26 00:19:59 +00:00
e3caf24954
feat: Rewrite the NG end-to-end metrics test ( #4404 )
...
* refactor: Expose data generation tool for wider use
* feat: Add a step for retrieving the server metrics
* refactor: Copy the OG end-to-end metrics test to NG
* feat: Rewrite the NG end-to-end metrics test
This is still broken because the the row timestamp metrics don't exist
in NG.
* fix: Test metrics relevant to NG
* refactor: Move the data generator to the test helper crate
* refactor: Extract a ReadFilter request builder into the test helper crate
* refactor: Make test helper request builder able to build other gRPC requests
Co-authored-by: Carol (Nichols || Goulding) <carol.nichols@gmail.com>
2022-04-25 19:47:56 +00:00
86e8f05ed1
fix: make all catalog IDs 64bit ( #4418 )
...
Closes #4365 .
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-25 16:49:34 +00:00
f482286ac9
fix: Update function name that was fixed upstream
2022-04-25 11:04:37 -04:00
0bda66a01d
feat: Write end-to-end tests for the gRPC write API in NG
...
Fixes #3941 .
2022-04-25 09:46:13 -04:00
f92fa69c8c
fix: Typo in test helper method name ( #4402 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-22 20:21:30 +00:00
117569184e
feat: Port end-to-end logging test to NG ( #4400 )
...
* feat: Copy end-to-end logging test to NG
This was created with:
cp influxdb_iox/tests/end_to_end_cases/influxdb_ioxd.rs influxdb_iox/tests/end_to_end_ng_cases/logging.rs
* feat: Port logging test to NG end-to-end tests
And re-enable it, it was ignored.
* fix: Specify that an in-memory catalog should be used for the logging test
* fix: Check for gRPC instead of HTTP
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-22 18:05:43 +00:00
14cb2f5674
fix: less async shenanigans in end to end tests ( #4384 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-22 14:38:57 +00:00
ff902c40d2
chore: port debug end to end tests to NG ( #4393 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-22 14:30:09 +00:00
e8bfd7a537
chore(deps): Bump clap from 3.1.10 to 3.1.11 ( #4390 )
...
* chore(deps): Bump clap from 3.1.10 to 3.1.11
Bumps [clap](https://github.com/clap-rs/clap ) from 3.1.10 to 3.1.11.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v3.1.10...v3.1.11 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix: update tests for changes to clap
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-22 11:15:48 +00:00
c9c41f4aed
refactor: use `info!` rather `println!` in end to end tests ( #4380 )
...
* refactor: use `info!` rather `println!` in end to end tests
* chore: change from println to info in end_to_end_ng_cases too
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-22 10:01:20 +00:00
c0ed688043
refactor: Split influxrpc end to end tests into smaller modules ( #4382 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-22 07:53:45 +00:00
2087dad1f7
feat: Port tracing tests to NG end-to-end tests
2022-04-21 16:22:43 -04:00
02692751c7
feat: Copy end-to-end tracing tests to NG end-to-end tests
...
This doesn't compile at all, but this is a straight cp so should make it
a bit easier to see what has changed in the port in the next commit.
2022-04-21 16:20:34 -04:00
d41086ac7f
refactor: Move Connection in ServerFixture to make TestServer shareable ( #4381 )
...
* refactor: Move Connection in ServerFixture to make TestServer shareable
* fix: Update docstrings
* fix: restore panic on previous error
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-21 18:15:53 +00:00
abd005e0c2
refactor: Consolidate cluster creation in end to end tests ( #4373 )
2022-04-21 18:03:17 +00:00
cc9205024c
test: Begin porting influxrpc tests to ng end to end tests ( #4372 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-21 16:24:45 +00:00
2984578aac
chore: Update pprof, remove old versions of prost ( #4374 )
...
* chore: Upgrade pprof to 0.8
* chore: Update heappy
2022-04-21 10:52:23 +00:00
c05612935b
test: add end to end querier test with multiple ingesters ( #4309 )
...
* test: add a test with multiple ingesters
* docs: improve doc test
* refactor: Print out step number in StepTest
* fix: make timeout more explicit
* fix: add tests for merge_info
2022-04-20 11:56:41 +00:00
Andrew Lamb
dependabot[bot]
kodiakhq[bot]
Carol (Nichols || Goulding)
Marco Neumann
Paul Dix
Dom Dwyer
二手掉包工程师
Jake Goulding
Carol (Nichols || Goulding)