Commit Graph

6242 Commits (3900324d3393e91647888361fbac3a321c53c7fc)

Author SHA1 Message Date
Raphael Taylor-Davies a286960285
refactor: remove delete predicates from read filter interface (#3212)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-26 12:15:29 +00:00
kodiakhq[bot] f68cbb08ee
Merge pull request #3220 from influxdata/meta-script
feat: Add a simple script to decode the IOx metadata of a parquet file
2021-11-26 12:05:42 +00:00
Marco Neumann ad65687cba refactor: consolidate sharding implementation
Move sharding implementation from router to `dml` (where the types can
be consumed w/o cloning the data) and only support the new sharding
configs.

The old sharding configs will be removed soon.
2021-11-26 13:00:36 +01:00
kodiakhq[bot] 473ed75253
Merge branch 'main' into meta-script 2021-11-26 11:57:26 +00:00
kodiakhq[bot] f0ace30369
Merge pull request #3221 from influxdata/crepererum/remove_routing_from_database_mode_6
refactor: remove write buffer direction
2021-11-26 11:47:46 +00:00
Marco Neumann 7f2e4f4342 refactor: remove write buffer direction
The direction was required when a database could read or write from/to a
write buffer. Now it is clear from the usage context of a write buffer
context which of the two applications is meant (databases read, routers
write) so the direction flag is no longer required.
2021-11-26 12:38:40 +01:00
Marko Mikulicic 4b271fe162
feat: Add a simple script to decode the IOx metadata of a parquet file 2021-11-26 12:25:19 +01:00
kodiakhq[bot] 91e5cfd81a
Merge pull request #3219 from influxdata/crepererum/remove_routing_from_database_mode_5
refactor: remove write buffer producer logic from `Db`
2021-11-26 11:11:49 +00:00
Marco Neumann ac20fecf6f refactor: remove write buffer producer logic from `Db`
As a side effect, writing to database no longer requires `async`.

Closes #2243.
2021-11-26 12:02:27 +01:00
kodiakhq[bot] 00143315ac
Merge pull request #3217 from influxdata/crepererum/disallow_unsequenced_deletes
feat: disallow unsequenced deletes when reading from write buffer
2021-11-26 10:51:44 +00:00
kodiakhq[bot] e7a050c573
Merge branch 'main' into crepererum/disallow_unsequenced_deletes 2021-11-26 10:43:24 +00:00
kodiakhq[bot] b3f2de4876
Merge pull request #3215 from influxdata/crepererum/test-bench
feat: test bench
2021-11-26 10:43:10 +00:00
Marco Neumann 589b7ad3af fix: typo
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-11-26 11:40:41 +01:00
Marco Neumann e5bfa08910 feat: disallow unsequenced deletes when reading from write buffer
Similar to how writes to a databases that reads from a write buffer are
forbidden deletes should be rejected as well.
2021-11-26 11:40:08 +01:00
kodiakhq[bot] 262bbd5c47
Merge branch 'main' into crepererum/test-bench 2021-11-26 10:34:21 +00:00
kodiakhq[bot] cfba3651d7
Merge pull request #3218 from influxdata/crepererum/remove_routing_from_database_mode_4
refactor: remove connection manager and resolver from `Server`
2021-11-26 10:33:30 +00:00
Marco Neumann 22936abb23 refactor: remove connection manager and resolver from `Server` 2021-11-26 11:00:19 +01:00
kodiakhq[bot] 6d9d84ff29
Merge pull request #3207 from influxdata/crepererum/remove_routing_from_database_mode_3
refactor: remove write routing logic from `Server`
2021-11-26 09:45:39 +00:00
Marco Neumann e1b523333c feat: improve glue code 2021-11-26 10:22:15 +01:00
Marco Neumann c5f20769ad feat: improve glue and config handling 2021-11-26 10:09:31 +01:00
Marco Neumann 0e06026fbd refactor: remove write routing logic from `Server`
API users should use `Database` instead, there's no need any longer to mirror
this API in `Server`. Note that `Database` is better than `Db` in this
case, because the former can also check if we're writing from a write
buffer and can easily reject unsequenced writes. The `pub` modifiers
were adjusted to make it impossible to write through `Db` directly.
2021-11-26 09:26:43 +01:00
Marco Neumann 9cfca18b30
refactor: improve cp logic
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2021-11-26 08:25:29 +00:00
Marco Neumann f2f090bde7 feat: test bench 2021-11-25 18:14:40 +01:00
Raphael Taylor-Davies 1722704077
fix: don't project on schema metadata mismatch (#3213)
* fix: don't project on schema metadata mismatch

* chore: add test
2021-11-25 17:07:02 +00:00
kodiakhq[bot] 36bc6d63b5
Merge pull request #3206 from influxdata/crepererum/remove_routing_from_database_mode_2
refactor: clean up write buffer end2end tests
2021-11-25 14:34:16 +00:00
Marco Neumann c2a8baf824 refactor: clean up write buffer end2end tests
Remove the ones that are covered by `write_pb.rs` or that are obsolete
(i.e. rely on behavior that only exist in the legacy router code).
Migrate the remaining ones to use an actual router.
2021-11-25 14:18:37 +01:00
kodiakhq[bot] 524dfa8ce2
Merge pull request #3210 from influxdata/crepererum/user_router_in_perf
refactor: use new router mode in `perf.py`
2021-11-25 08:22:00 +00:00
kodiakhq[bot] 070a07481f
Merge branch 'main' into crepererum/user_router_in_perf 2021-11-25 08:12:26 +00:00
kodiakhq[bot] a9db30cdd0
Merge pull request #3208 from influxdata/er/fix/grpc_influxql_multiple_time
fix: ensure time column not returned
2021-11-24 18:30:28 +00:00
Marco Neumann 5532955437 refactor: use new router mode in `perf.py` 2021-11-24 19:02:28 +01:00
Edd Robinson 48dd1ae757 fix: ensure time column not returned 2021-11-24 16:23:43 +00:00
kodiakhq[bot] 5f883a96a6
Merge pull request #3204 from influxdata/crepererum/remove_routing_from_database_mode_1
refactor: prepare to remove router functionality from `server` crate
2021-11-24 14:23:57 +00:00
kodiakhq[bot] 6e1f86ca48
Merge branch 'main' into crepererum/remove_routing_from_database_mode_1 2021-11-24 14:15:36 +00:00
kodiakhq[bot] ebf8ebecb2
Merge pull request #3191 from influxdata/crepererum/issue3154_b
feat: HTTP delete support for router
2021-11-24 13:42:14 +00:00
kodiakhq[bot] fa0185118e
Merge branch 'main' into crepererum/issue3154_b 2021-11-24 13:33:30 +00:00
kodiakhq[bot] 7d6dfff9ab
Merge pull request #3180 from influxdata/crepererum/issue3179
fix: do not forget outputs of file-based write buffer
2021-11-24 13:33:00 +00:00
kodiakhq[bot] 9bece6808d
Merge branch 'main' into crepererum/issue3154_b 2021-11-24 13:29:45 +00:00
kodiakhq[bot] ebeafbfab4
Merge branch 'main' into crepererum/issue3179 2021-11-24 13:23:53 +00:00
kodiakhq[bot] c723d7d114
Merge pull request #3205 from influxdata/er/refactor/debug_responses
refactor: add debug logging for meta queries
2021-11-24 11:11:18 +00:00
Marco Neumann edf7becd20 fix: address review comments 2021-11-24 12:09:52 +01:00
Edd Robinson eca7798308
refactor: update influxdb_iox/src/influxdb_ioxd/server_type/database/rpc/storage/service.rs 2021-11-24 10:47:33 +00:00
Marco Neumann f75c12351d fix: do not forget outputs of file-based write buffer
The existing channel construction could lead to cases where streams
would consume messages, put them into the channel but then when the
stream gets dropped the message would be gone forever. So lets move from
a channel-based implementation to directly invoke the generator future,
so this buffering doesn't occur.

Fixes #3179.
2021-11-24 11:38:41 +01:00
Marco Neumann 3eb5d42fe7 fix: address review comments 2021-11-24 11:37:45 +01:00
Edd Robinson 311375bdac refactor: add debug logging for meta queries 2021-11-24 10:31:09 +00:00
Marco Neumann 539c08125b feat: HTTP delete support for router
Closes #3154.
2021-11-24 11:13:56 +01:00
Marco Neumann d3b1557dbc refactor: isolate and parametrize some management CLI tests 2021-11-24 11:12:22 +01:00
Marco Neumann cae8b8572d refactor: remove remote API from database node
We can easily bring it back in case we need it, but at the moment its
not required for database nodes to manage remotes.
2021-11-24 11:12:22 +01:00
Marco Neumann ed54100e60 refactor: convert `write_api` end2end tests to use new router mode 2021-11-24 11:12:22 +01:00
kodiakhq[bot] febc686583
Merge pull request #3203 from influxdata/crepererum/issue2980i
refactor: remove methods from `ManagementService` that were moved to `RemoteService`
2021-11-24 09:56:37 +00:00
Marco Neumann aa636eaed9 refactor: remove methods from `ManagementService` that were moved to `RemoteService`
Tests are covered by `remote_api.rs`.

Ref #2980.
2021-11-24 10:01:32 +01:00