Raphael Taylor-Davies
f17b670fe9
refactor: cleanup gRPC client error handling ( #3251 ) ( #3277 )
...
* refactor: cleanup gRPC client error handling (#3251 )
* chore: review feedback
* chore: review feedback
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-02 20:56:58 +00:00
Marco Neumann
ad65687cba
refactor: consolidate sharding implementation
...
Move sharding implementation from router to `dml` (where the types can
be consumed w/o cloning the data) and only support the new sharding
configs.
The old sharding configs will be removed soon.
2021-11-26 13:00:36 +01:00
Marco Neumann
7f2e4f4342
refactor: remove write buffer direction
...
The direction was required when a database could read or write from/to a
write buffer. Now it is clear from the usage context of a write buffer
context which of the two applications is meant (databases read, routers
write) so the direction flag is no longer required.
2021-11-26 12:38:40 +01:00
Marco Neumann
5ecaa6d8a9
refactor: use serialized predicates instead of strings for gRPC deletes
...
IOx is the only consumer of this API so we might just use the serialized
form. Cloud2 uses the HTTP API which supports SQL-like predicates.
Fixes #3192 .
2021-11-24 09:30:32 +01:00
Marco Neumann
93cc79875a
refactor: simplify code
2021-11-23 15:39:53 +01:00
Marco Neumann
18cab1545c
test: improve test naming
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-11-23 15:39:53 +01:00
Marco Neumann
df19d67532
test: allow to specify `WriteBufferConfigFactory` when creating a test `RouterServer`
2021-11-23 15:39:53 +01:00
Marco Neumann
964411bdbb
feat: add delete support to router
2021-11-23 15:39:53 +01:00
Carol (Nichols || Goulding)
3ed9dfc4db
fix: Make all usages of cache_loader_async use the same features
2021-11-19 14:33:55 -05:00
Carol (Nichols || Goulding)
9fd4a560f5
feat: Results of running cargo hakari manage-deps
2021-11-19 09:21:57 -05:00
Raphael Taylor-Davies
8155747735
feat: add write buffer delete encoding ( #2731 ) ( #3127 )
...
* feat: add write buffer delete encoding (#2731 )
* chore: fix doc
* chore: review feedback
* chore: review feedback
* chore: fmt
* chore: review feedback
2021-11-17 16:12:19 +00:00
Marco Neumann
e6fdd79a0f
feat: emit Kafka stats as metrics instead of logs
...
This maps a subset of Kafka stats as metrics. The set can -- of course
-- be changed in the future depending on our needs.
Fixes #3100 .
2021-11-16 17:18:41 +01:00
Raphael Taylor-Davies
553e412226
refactor: DMLOperation write path ( #2731 ) ( #3121 )
...
* refactor: DMLOperation write path (#2731 )
* chore: fmt
* chore: review feedback
2021-11-16 12:42:19 +00:00
Raphael Taylor-Davies
6f268f8260
refactor: extract DML types ( #2731 ) ( #3084 )
...
* refactor: extract DML types (#2731 )
* chore: fmt
2021-11-11 12:34:07 +00:00
Marco Neumann
09239c4943
feat: improve testing interface for the `router` crate
2021-11-10 17:51:58 +01:00
Marco Neumann
ea2604b7b6
docs: explain write sink test
2021-11-08 14:09:33 +01:00
Marco Neumann
4130d508c0
docs: document write buffer variants
2021-11-08 14:09:33 +01:00
Marco Neumann
1d34ba0183
docs: explain router name argument
2021-11-08 14:09:33 +01:00
Marco Neumann
12c684b546
test: extend `test_write` test
2021-11-08 14:09:33 +01:00
Marco Neumann
dcc376456a
docs: explain iteration order in `Router`
2021-11-08 14:09:33 +01:00
Marco Neumann
6a090b785a
fix: use new `WriteMeta` constructor
2021-11-08 14:09:33 +01:00
Marco Neumann
b226d629c1
feat: router write logic
2021-11-08 14:09:33 +01:00
Marco Neumann
c745a0a94c
feat: impl write sinks logic for router
2021-11-08 14:09:33 +01:00
Marco Neumann
fc4ea71921
feat: `RouterServer::router`
2021-11-08 14:09:33 +01:00
Marco Neumann
9984e4d386
fix: debug msg
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-11-08 11:11:52 +01:00
Marco Neumann
7f6280305d
fix: `ConnectionPool::new` requires tokio
2021-11-08 11:11:52 +01:00
Marco Neumann
11f4a1dee8
feat: add connection management for router
2021-11-08 11:11:52 +01:00
Raphael Taylor-Davies
898567e221
feat: migrate server to DbWrite ( #2724 ) ( #3035 )
...
* feat: migrate server to DbWrite (#2724 )
* chore: print perf log output
* fix: don't suppress CI status code
* chore: review feedback
* fix: don't error on empty line protocol write payloads
* fix: test
* fix: test
2021-11-05 11:09:33 +00:00
Marco Neumann
92e6acaacd
feat: implement sharder for new router
2021-11-05 09:49:33 +01:00
Marco Neumann
78101eb52d
feat: implement `RemoteService` for new router mode
2021-11-04 15:35:05 +01:00
Marco Neumann
4840dc11cb
feat: add basic CRUD operations for router configs
2021-11-04 12:03:14 +01:00
Marco Neumann
a91e572b43
feat: implement basic router server type
...
This only implements the deployment service and nothing else yet.
2021-11-03 16:34:51 +01:00