801cf08be7
feat: auto-creation of sequencers by write buffer
...
For Kafka, that basically means that we create a topic if it doesn't
exist yet.
Closed #2455 .
Fixes #2189 .
2021-09-07 18:24:57 +02:00
d5662328b0
refactor: `n_sequencers` should be non-zero
2021-09-07 18:18:20 +02:00
dbe4bcff22
chore: merge main to branch
2021-09-07 10:54:59 -04:00
a4b0cbc0e7
feat: migrate jemalloc metrics to `metric` crate ( #2435 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-09-06 09:18:27 +00:00
9de3b79a90
refactor: more cleanup
2021-09-06 01:45:47 -04:00
de0bd80c3d
refactor: cleanup
2021-09-06 01:07:07 -04:00
d8b3208896
refactor: sstart building parser in the client side
2021-09-03 17:56:45 -04:00
2d41fd519f
Merge branch 'main' into cn/list-soft-deleted
2021-09-03 15:16:32 +00:00
3c968ac092
feat: correctly account MUB sizes
...
Fixes #1565 .
2021-09-03 09:15:49 +02:00
bbc0fcf4c0
refactor: cleanup
2021-09-02 17:21:55 -04:00
e2274a9f41
feat: parser for delete predicate
2021-09-02 17:02:05 -04:00
ce6030a3cb
feat: Wire list deleted databases through gRPC and CLI APIs
2021-09-02 15:48:07 -04:00
a63eb53ac5
feat: forward connection config to Kafka write buffer
2021-09-02 16:53:31 +02:00
ecf1f99ddb
refactor: more flexible writer buffer config
...
This allows:
- different types (instead of guessing through the connection URL)
- sequencer counts (not used yet but will be by #2455 )
- extensible configs (e.g. to configure Kafka in a more granular way,
not wired up yet)
- future extensions (since we use a message now instead of a single
string)
**BREAKING: This requires changes for deployed systems / existing DBs!**
2021-09-02 16:41:35 +02:00
4a863993ec
feat: "dump catalog" debug CLI
2021-09-02 08:08:20 +02:00
efcdc8e50f
feat: implement delete parser
2021-09-01 17:31:49 -04:00
e183ecb3e7
Merge branch 'main' into cn/list-but-not-deleted-databases
2021-09-01 13:03:09 +00:00
a4183de411
feat: more progress on the delete flow from grpc API to catalog chunks
2021-08-31 17:42:07 -04:00
79ad48ac3a
chore: rename "labels" to "attributes"
2021-08-31 11:31:15 +02:00
7e7855f727
test: avoid picking the same port twice under multi-threaded tests
2021-08-31 10:16:22 +02:00
69eae490ef
test: avoid picking the same port twice
2021-08-31 10:16:22 +02:00
e6afb844ff
test: use random free port for end2end tests
...
Fixes #786 .
Fixes #2403 .
2021-08-31 10:16:22 +02:00
3558e46cae
test: Check deleted databases are omitted from management API list
2021-08-30 14:14:32 -04:00
8dc375100a
feat: Wire database deletion through the CLI
...
Fixes #2432 .
2021-08-30 14:14:22 -04:00
e67624dd37
fix: Assert on which error getting a deleted database returns
2021-08-30 11:29:25 -04:00
e420fe13a4
test: Add delete database to the end-to-end tests
2021-08-30 10:49:19 -04:00
96b0026203
fix: make "persist partition" a bit more stable
...
- add longer wait times to tests
- exclude chunks that have active lifecycle actions early (instead of
failing the whole set)
- properly catch the "no chunks" case
Fixes #2434 .
2021-08-30 13:11:12 +02:00
2f49e47a23
feat: return DatabaseRules for ListDatabases request ( #2431 )
2021-08-28 10:53:24 +00:00
779b027271
feat: Store only the database rules sent by the client (do not store default values) ( #2430 )
...
* feat: add omit_default to protobuf definition
* feat: Persist only the client provided rules
* fix: Remove race conditions
* fix: merge confit
* refactor: do not use macro
* refactor: restore use of glob import
* fix: review comments
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-28 10:26:32 +00:00
499af57299
chore: merge mian to branch and resolve conflicts
2021-08-27 17:51:07 -04:00
589bb31497
fix: make error msg clearer
2021-08-27 15:49:16 +02:00
8591aac761
test: improve error checking
2021-08-27 15:16:13 +02:00
90c60fd181
feat: "persist partition" CLI
2021-08-27 15:16:13 +02:00
6625b3a768
feat: "persist partition" gRPC
2021-08-27 15:16:13 +02:00
bcd39e225c
feat: Management API for delete
2021-08-26 17:31:21 -04:00
7cf7fb02ed
refactor: Rename database ObjectStore state types to DatabaseObjectStore
2021-08-26 09:14:23 -04:00
6d0959fbc3
fix: Move IOx object store creation logic into Database state machine
2021-08-26 09:14:23 -04:00
18ba3b5c59
feat: Create database directories with a generation ID
2021-08-26 09:14:22 -04:00
1773bf5d37
feat: add storage client to influxdb_iox_client ( #2404 )
...
* feat: add storage client to influxdb_iox_client
* chore: fix type_url
* refactor: split storage into separate crate
* chore: fix doctest
* chore: review feedback
* chore: add generated_types cleanup ticket
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-26 10:30:59 +00:00
efa776bd03
feat: fix log crate output ( #2325 )
...
* feat: fix log crate output
* chore: fix doc
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-17 16:19:22 +00:00
ce35119633
test: fix test case relying on hard buffer limit
2021-08-17 16:53:45 +02:00
6847fa97cc
feat: drop partition CLI
2021-08-17 09:44:35 +02:00
fcf2bee443
feat: drop partition gRPC
2021-08-17 09:44:35 +02:00
6b907f94da
test: simplify `fixture_replay_broken`
2021-08-16 15:31:05 +02:00
53d325e8fc
test: end2end for skip replay
2021-08-16 13:47:56 +02:00
c959be2319
test: sort output of `list_chunks`
2021-08-16 13:47:07 +02:00
42d5f9f3a1
feat: skip replay via CLI
2021-08-16 13:47:07 +02:00
21ebdee5a1
feat: make kafka topic creation code reusable
2021-08-16 13:47:07 +02:00
0a065b4968
feat: set header on gRPC requests ( #2283 )
...
* feat: set header on gRPC requests
* feat: always insert header value
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-13 14:13:50 +00:00
2344c28f4e
feat: drain database jobs on shutdown ( #2239 )
...
* feat: drain database jobs on shutdown
* chore: fmt
* chore: review feedback
* chore: use join() not member directly
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-10 16:47:37 +00:00
Marco Neumann
Nga Tran
Raphael Taylor-Davies
kodiakhq[bot]
Carol (Nichols || Goulding)
Andrew Lamb