Fraser Savage
5735aae998
feat(cli): Add namespace delete command
...
This adds the CLI action to call the namespace soft-deletion
gRPC endpoint and an associated e2e CLI test.
2023-03-23 11:23:00 +00:00
Chunchun Ye
87708dc64a
feat(flightsql): Add filters to `GetTables` metadata endpoint ( #7289 )
...
* feat: add optional param to GetTables
* chore: add the third param to query plan
* feat: add table_types param
* chore: clippy
* test: add test cases with filters
* chore: update query to avoid SQL injection
* refactor: update where clause and cleanup
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-03-22 20:14:01 +00:00
Andrew Lamb
7f7d0b8d52
fix(flightsql): Send correct schema in GetFlightInfo for Queries ( #7283 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-03-22 13:58:44 +00:00
kodiakhq[bot]
18405a5919
Merge branch 'main' into cn/shard-tests
2023-03-22 13:36:27 +00:00
Andrew Lamb
779234eb20
chore(flightsql): Add tests that schema and data matches ( #7280 )
...
* fix(flightsql): Tests for matching schema in FligthSQL
* fix: Update influxdb_iox/tests/end_to_end_cases/flightsql.rs
2023-03-21 15:40:21 +00:00
Carol (Nichols || Goulding)
635b22b5a9
fix: Explicitly use memory catalog for invalid compactor CLI tests
...
To avoid the command picking up the catalog from your `.env`.
2023-03-20 16:40:46 -04:00
Carol (Nichols || Goulding)
d8bd185fa0
test: Add compactor shard e2e tests
2023-03-20 15:52:47 -04:00
Andrew Lamb
184565b552
feat(flightsql): Implement FlightSQL `GetSqlInfo` endpoint ( #7198 )
...
* feat(flightsql): Implement GetSqlInfo endpoint
* chore: Add some comments to clarify the tests intent
2023-03-20 19:34:18 +00:00
Andrew Lamb
795a79a7ad
feat(flightsql): Add `GetTables` metadata endpoint without filters ( #7238 )
...
* test: Add getTables jdbc_client example
* feat: add `CommandGetTables` in FlightSqlClient
* feat: add `CommandGetTables` in flightsql cmd and planner
* test: add e2e test for `CommandGetTables`
* chore: clippy
* chore: comment out the test with filters
* test: update jdbc test expected value for tables
---------
Co-authored-by: Chunchun <14298407+appletreeisyellow@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-03-20 19:20:13 +00:00
Carol (Nichols || Goulding)
528d83e989
test: Re-enable running compactor once in step tests
...
Putting back the test that I removed in
<https://github.com/influxdata/influxdb_iox/pull/6850 >
now that they can use `run compactor2 --compaction-process-once
--compaction-process-all-partitions`
thanks to <https://github.com/influxdata/influxdb_iox/pull/6886 >!
2023-03-20 13:20:43 -04:00
Andrew Lamb
2bc495b29e
feat(flightsql): Support `GetTableTypes` metadata API ( #7242 )
...
* feat(flightsql): Support `GetTableTypes` metadata API
* chore: comment about possible optimization
* chore: fix logical conflict
2023-03-17 13:12:23 +00:00
Andrew Lamb
3f0073807f
chore(flightsql): `insta`ize flightsql end to end tests ( #7236 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-03-16 14:41:49 +00:00
Andrew Lamb
c819d4f865
feat(flightsql): Implement `GetDbSchemas` metadata API ( #7213 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-03-16 10:13:51 +00:00
Andrew Lamb
6d6fd8f663
feat(flightsql): implement basic `CommandGetCatalogs` support ( #7212 )
...
* refactor: reduce redundancy in test
* chore: implement basic get_catalog support
* fix: clippy
2023-03-15 21:52:59 +00:00
Stuart Carnie
2ed5758ddb
feat: InfluxQL planner learns how to project multiple measurements ( #7063 )
...
* feat: Planner learns how to project multiple measurements
Closes #6896
* chore: Update test
* chore: PR feedback
2023-02-27 00:50:06 +00:00
Andrew Lamb
f93baf7693
chore: Update DataFusion and `arrow` / `arrow-flight` / `parquet` to `33.0.0` ( #7045 )
...
* chore: Update DataFusion and arrow/arrow-flight/parquet to 33.0.0
* fix: Update test output
* fix: update more test output
* fix: Update querier test output
* chore: Run cargo hakari tasks
* test: fix formatting
Fix formatting of batch pretty printing.
* test: fix formatting
Fix formatting of batch pretty printing.
* test: fix formatting for selector tests
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: Dom Dwyer <dom@itsallbroken.com>
Co-authored-by: Christopher Wolff <chris.wolff@influxdata.com>
2023-02-22 21:24:20 +00:00
Carol (Nichols || Goulding)
65ba208f88
fix: Remove shard_id from the Parquet File protobuf in the catalog service
2023-02-17 13:53:03 -05:00
Carol (Nichols || Goulding)
b11228c72e
test: Write an e2e test of namespace soft-deletion ( #7002 )
...
Co-authored-by: Dom <dom@itsallbroken.com>
2023-02-16 09:59:14 +00:00
Carol (Nichols || Goulding)
9e27709c84
test: Add an e2e test of just the ingester's API
2023-02-13 16:36:59 -05:00
Carol (Nichols || Goulding)
7b80b03b28
test: Test with multiple ingesters, like in production
2023-02-09 17:31:28 -05:00
Carol (Nichols || Goulding)
1794147b3c
fix: Only test querier panic logging; router2 and ingester2 now exit on panic
2023-02-09 13:56:07 -05:00
Carol (Nichols || Goulding)
b5464aa82e
fix: Remove test that compacts once for now
2023-02-09 13:56:07 -05:00
Carol (Nichols || Goulding)
38f8e18357
fix: Only run end-to-end tests against Kafkaless
2023-02-09 13:56:06 -05:00
Carol (Nichols || Goulding)
d7c59da46b
fix: Switch more tests over to the kafkaless architecture
2023-02-09 13:56:06 -05:00
Carol (Nichols || Goulding)
f1f475d552
fix: Remove compactor generate ( #6872 )
...
This debugging tool was more useful in previous situations where it was
harder to get real data as input for the compactor.
It's currently causing a flaky test that isn't worth investigating.
Fixes #6190 by making it moot.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-06 19:19:15 +00:00
Dom Dwyer
b8ec022ea6
test(e2e): HTTP error response
...
Ensure a HTTP error response contains a well-formed JSON structure
containing "code" and "message" fields (for backwards compatibility with
existing InfluxDB versions) and a correct "content-type" header.
2023-02-06 17:10:30 +01:00
Raphael Taylor-Davies
d3601a59f8
chore: update DataFusion, upgrade `arrow` `arrow-flight` and `parquet` to `32.0.0` ( #6756 )
...
* chore: update DataFusion
* fix: test
* chore: format
* chore: clippy
* chore: update arrow
* chore: arrow upgrade fallout
* chore: Run cargo hakari tasks
* chore: remove failing warm compaction test
* fix: flight error propagation
* chore: update parquet size
* fix: Update error message
* chore: Update parquet metadata test
---------
Co-authored-by: CircleCI[bot] <circleci@influxdata.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-06 11:35:39 +00:00
Carol (Nichols || Goulding)
ca8558e636
chore: Unnest test code out of the module and clean up long lines
2023-02-03 14:20:30 -05:00
Carol (Nichols || Goulding)
b17d1c0862
test: Port more query tests to kafkaless
2023-02-03 13:56:01 -05:00
Carol (Nichols || Goulding)
30fea67701
fix: Move variables within format strings. Thanks clippy!
...
Changes made automatically using `cargo clippy --fix`.
2023-02-03 13:06:17 -05:00
Carol (Nichols || Goulding)
b55e4ffa21
test: Port table_schema tests to end-to-end and get rid of query_tests ( #6828 )
...
* test: Port table_schema query_tests to end-to-end
* fix: Remove now outdated query_tests crate
---------
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-03 17:41:08 +00:00
Andrew Lamb
0d01306fd2
chore: port remote end to end tests to new write path ( #6838 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-03 15:33:49 +00:00
Andrew Lamb
b9ab09e944
chore: remove kafka full querier end to end tests ( #6834 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-03 15:25:24 +00:00
Andrew Lamb
ef98b8c348
chore: Port `influxrpc` end to end tests to new writepath ( #6839 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-03 14:58:18 +00:00
Andrew Lamb
05ca71f91f
chore: Remove old ingester end to end tests ( #6837 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-03 14:43:27 +00:00
Andrew Lamb
755d3586ea
chore: port cli end to end tests to kafkaless write path ( #6836 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-03 14:35:05 +00:00
Andrew Lamb
012c35bf3e
chore: Port flightsql end to end tests for new kafkaless writepath ( #6835 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-03 14:26:26 +00:00
Andrew Lamb
acc258e9aa
chore: Update influxql end to end tests to kafkaless write path ( #6833 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-02-03 14:11:55 +00:00
Stuart Carnie
63d0a77daf
feat: Updating to new services for all-in-one ( #6811 )
...
* feat: Updating to new services for all-in-one
* fix: Use correct shard id for ingester2
* fix: clippy
* fix: use wal directory
* fix: end to end tests
* fix: Update tracing cases for new ingest reality
* fix: update metrics test
* fix: Use rpc mode
---------
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2023-02-02 20:42:29 +00:00
Carol (Nichols || Goulding)
7590fa5aaa
fix: Change test data and predicates to get better coverage
...
These two tests weren't actually ensuring that the combination of these
predicates worked, because the tests would still pass if some of the
predicate parts were removed.
2023-02-01 11:09:10 -05:00
Carol (Nichols || Goulding)
072e228d35
test: Port tag_values query_tests to end-to-end tests
2023-02-01 10:26:03 -05:00
Carol (Nichols || Goulding)
629867c6ac
refactor: Start a new file for tag values tests; move the one existing test
2023-02-01 10:25:48 -05:00
Carol (Nichols || Goulding)
ff32a042b0
test: Port tag_keys query_tests to end-to-end tests ( #6760 )
...
* refactor: Start a new file for tag keys tests; move the one existing test
* test: Port tag_keys query_tests to end-to-end tests
---------
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
2023-01-31 14:05:22 +00:00
Carol (Nichols || Goulding)
d18d2c34e4
test: Port measurement_names/table_names query_tests to end-to-end tests ( #6757 )
...
* refactor: Start a new file for measurement names tests; move the one existing test
* fix: Pass on predicate when sending a measurement names request with GrpcRequestBuilder
* feat: Support literal integer queries too
* test: Port measurement_names/table_names query_tests to end-to-end tests
* fix: merge conflict error
---------
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-31 12:55:30 +00:00
Carol (Nichols || Goulding)
cff422b795
test: Port read_window_aggregate query_tests to end-to-end tests ( #6755 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-31 12:15:50 +00:00
Carol (Nichols || Goulding)
2254ee06b7
test: Port read_group query_tests to end-to-end tests ( #6743 )
...
* fix: Delete the read filter *file*; last PR only deleted the *contents*
* test: Port read_group query_tests to end-to-end tests
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-30 12:10:39 +00:00
Christopher M. Wolff
55257b46c9
chore: validate ingester URIs on querier CLI ( #6740 )
...
* chore: add validate for ingesters on querier CLI
* chore: fix typo and tests
* chore: clippy
* chore: review feedback
---------
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-27 21:13:52 +00:00
Andrew Lamb
4a6b4f78d2
refactor: Make some nicer methods on the GrpcRequestBuilder ( #6741 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2023-01-27 21:06:22 +00:00
Carol (Nichols || Goulding)
11233e3b3b
test: Translate the filter_on_value test using field ref ( #6734 )
2023-01-27 20:03:44 +00:00
Carol (Nichols || Goulding)
4f8dd072b3
fix: Translate a test with a predicate of a literal = literal
2023-01-27 10:28:43 -05:00