Raphael Taylor-Davies
a286960285
refactor: remove delete predicates from read filter interface ( #3212 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-26 12:15:29 +00:00
kodiakhq[bot]
f68cbb08ee
Merge pull request #3220 from influxdata/meta-script
...
feat: Add a simple script to decode the IOx metadata of a parquet file
2021-11-26 12:05:42 +00:00
Marco Neumann
ad65687cba
refactor: consolidate sharding implementation
...
Move sharding implementation from router to `dml` (where the types can
be consumed w/o cloning the data) and only support the new sharding
configs.
The old sharding configs will be removed soon.
2021-11-26 13:00:36 +01:00
kodiakhq[bot]
473ed75253
Merge branch 'main' into meta-script
2021-11-26 11:57:26 +00:00
kodiakhq[bot]
f0ace30369
Merge pull request #3221 from influxdata/crepererum/remove_routing_from_database_mode_6
...
refactor: remove write buffer direction
2021-11-26 11:47:46 +00:00
Marco Neumann
7f2e4f4342
refactor: remove write buffer direction
...
The direction was required when a database could read or write from/to a
write buffer. Now it is clear from the usage context of a write buffer
context which of the two applications is meant (databases read, routers
write) so the direction flag is no longer required.
2021-11-26 12:38:40 +01:00
Marko Mikulicic
4b271fe162
feat: Add a simple script to decode the IOx metadata of a parquet file
2021-11-26 12:25:19 +01:00
kodiakhq[bot]
91e5cfd81a
Merge pull request #3219 from influxdata/crepererum/remove_routing_from_database_mode_5
...
refactor: remove write buffer producer logic from `Db`
2021-11-26 11:11:49 +00:00
Marco Neumann
ac20fecf6f
refactor: remove write buffer producer logic from `Db`
...
As a side effect, writing to database no longer requires `async`.
Closes #2243 .
2021-11-26 12:02:27 +01:00
kodiakhq[bot]
00143315ac
Merge pull request #3217 from influxdata/crepererum/disallow_unsequenced_deletes
...
feat: disallow unsequenced deletes when reading from write buffer
2021-11-26 10:51:44 +00:00
kodiakhq[bot]
e7a050c573
Merge branch 'main' into crepererum/disallow_unsequenced_deletes
2021-11-26 10:43:24 +00:00
kodiakhq[bot]
b3f2de4876
Merge pull request #3215 from influxdata/crepererum/test-bench
...
feat: test bench
2021-11-26 10:43:10 +00:00
Marco Neumann
589b7ad3af
fix: typo
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-11-26 11:40:41 +01:00
Marco Neumann
e5bfa08910
feat: disallow unsequenced deletes when reading from write buffer
...
Similar to how writes to a databases that reads from a write buffer are
forbidden deletes should be rejected as well.
2021-11-26 11:40:08 +01:00
kodiakhq[bot]
262bbd5c47
Merge branch 'main' into crepererum/test-bench
2021-11-26 10:34:21 +00:00
kodiakhq[bot]
cfba3651d7
Merge pull request #3218 from influxdata/crepererum/remove_routing_from_database_mode_4
...
refactor: remove connection manager and resolver from `Server`
2021-11-26 10:33:30 +00:00
Marco Neumann
22936abb23
refactor: remove connection manager and resolver from `Server`
2021-11-26 11:00:19 +01:00
kodiakhq[bot]
6d9d84ff29
Merge pull request #3207 from influxdata/crepererum/remove_routing_from_database_mode_3
...
refactor: remove write routing logic from `Server`
2021-11-26 09:45:39 +00:00
Marco Neumann
e1b523333c
feat: improve glue code
2021-11-26 10:22:15 +01:00
Marco Neumann
c5f20769ad
feat: improve glue and config handling
2021-11-26 10:09:31 +01:00
Marco Neumann
0e06026fbd
refactor: remove write routing logic from `Server`
...
API users should use `Database` instead, there's no need any longer to mirror
this API in `Server`. Note that `Database` is better than `Db` in this
case, because the former can also check if we're writing from a write
buffer and can easily reject unsequenced writes. The `pub` modifiers
were adjusted to make it impossible to write through `Db` directly.
2021-11-26 09:26:43 +01:00
Marco Neumann
9cfca18b30
refactor: improve cp logic
...
Co-authored-by: Marko Mikulicic <mkm@influxdata.com>
2021-11-26 08:25:29 +00:00
Marco Neumann
f2f090bde7
feat: test bench
2021-11-25 18:14:40 +01:00
Raphael Taylor-Davies
1722704077
fix: don't project on schema metadata mismatch ( #3213 )
...
* fix: don't project on schema metadata mismatch
* chore: add test
2021-11-25 17:07:02 +00:00
kodiakhq[bot]
36bc6d63b5
Merge pull request #3206 from influxdata/crepererum/remove_routing_from_database_mode_2
...
refactor: clean up write buffer end2end tests
2021-11-25 14:34:16 +00:00
Marco Neumann
c2a8baf824
refactor: clean up write buffer end2end tests
...
Remove the ones that are covered by `write_pb.rs` or that are obsolete
(i.e. rely on behavior that only exist in the legacy router code).
Migrate the remaining ones to use an actual router.
2021-11-25 14:18:37 +01:00
kodiakhq[bot]
524dfa8ce2
Merge pull request #3210 from influxdata/crepererum/user_router_in_perf
...
refactor: use new router mode in `perf.py`
2021-11-25 08:22:00 +00:00
kodiakhq[bot]
070a07481f
Merge branch 'main' into crepererum/user_router_in_perf
2021-11-25 08:12:26 +00:00
kodiakhq[bot]
a9db30cdd0
Merge pull request #3208 from influxdata/er/fix/grpc_influxql_multiple_time
...
fix: ensure time column not returned
2021-11-24 18:30:28 +00:00
Marco Neumann
5532955437
refactor: use new router mode in `perf.py`
2021-11-24 19:02:28 +01:00
Edd Robinson
48dd1ae757
fix: ensure time column not returned
2021-11-24 16:23:43 +00:00
kodiakhq[bot]
5f883a96a6
Merge pull request #3204 from influxdata/crepererum/remove_routing_from_database_mode_1
...
refactor: prepare to remove router functionality from `server` crate
2021-11-24 14:23:57 +00:00
kodiakhq[bot]
6e1f86ca48
Merge branch 'main' into crepererum/remove_routing_from_database_mode_1
2021-11-24 14:15:36 +00:00
kodiakhq[bot]
ebf8ebecb2
Merge pull request #3191 from influxdata/crepererum/issue3154_b
...
feat: HTTP delete support for router
2021-11-24 13:42:14 +00:00
kodiakhq[bot]
fa0185118e
Merge branch 'main' into crepererum/issue3154_b
2021-11-24 13:33:30 +00:00
kodiakhq[bot]
7d6dfff9ab
Merge pull request #3180 from influxdata/crepererum/issue3179
...
fix: do not forget outputs of file-based write buffer
2021-11-24 13:33:00 +00:00
kodiakhq[bot]
9bece6808d
Merge branch 'main' into crepererum/issue3154_b
2021-11-24 13:29:45 +00:00
kodiakhq[bot]
ebeafbfab4
Merge branch 'main' into crepererum/issue3179
2021-11-24 13:23:53 +00:00
kodiakhq[bot]
c723d7d114
Merge pull request #3205 from influxdata/er/refactor/debug_responses
...
refactor: add debug logging for meta queries
2021-11-24 11:11:18 +00:00
Marco Neumann
edf7becd20
fix: address review comments
2021-11-24 12:09:52 +01:00
Edd Robinson
eca7798308
refactor: update influxdb_iox/src/influxdb_ioxd/server_type/database/rpc/storage/service.rs
2021-11-24 10:47:33 +00:00
Marco Neumann
f75c12351d
fix: do not forget outputs of file-based write buffer
...
The existing channel construction could lead to cases where streams
would consume messages, put them into the channel but then when the
stream gets dropped the message would be gone forever. So lets move from
a channel-based implementation to directly invoke the generator future,
so this buffering doesn't occur.
Fixes #3179 .
2021-11-24 11:38:41 +01:00
Marco Neumann
3eb5d42fe7
fix: address review comments
2021-11-24 11:37:45 +01:00
Edd Robinson
311375bdac
refactor: add debug logging for meta queries
2021-11-24 10:31:09 +00:00
Marco Neumann
539c08125b
feat: HTTP delete support for router
...
Closes #3154 .
2021-11-24 11:13:56 +01:00
Marco Neumann
d3b1557dbc
refactor: isolate and parametrize some management CLI tests
2021-11-24 11:12:22 +01:00
Marco Neumann
cae8b8572d
refactor: remove remote API from database node
...
We can easily bring it back in case we need it, but at the moment its
not required for database nodes to manage remotes.
2021-11-24 11:12:22 +01:00
Marco Neumann
ed54100e60
refactor: convert `write_api` end2end tests to use new router mode
2021-11-24 11:12:22 +01:00
kodiakhq[bot]
febc686583
Merge pull request #3203 from influxdata/crepererum/issue2980i
...
refactor: remove methods from `ManagementService` that were moved to `RemoteService`
2021-11-24 09:56:37 +00:00
Marco Neumann
aa636eaed9
refactor: remove methods from `ManagementService` that were moved to `RemoteService`
...
Tests are covered by `remote_api.rs`.
Ref #2980 .
2021-11-24 10:01:32 +01:00