Nga Tran
efbfbb1a0b
feat: compact all object store chunks of a given partition
2021-12-08 16:06:03 -05:00
Andrew Lamb
c6a3765d76
feat: Add force flag to RebuildCatalog ( #3292 )
...
* feat: Add force flag to RebuildCatalog
* fix: small cleanups
* docs: Update comments and add WARNING
2021-12-08 15:36:07 +00:00
Marco Neumann
c17a6c10c1
feat: add `GetRouter` gRPC method
2021-12-08 13:45:55 +01:00
Raphael Taylor-Davies
b0e01edb86
fix: include pbjson code for storage package ( #3334 )
2021-12-08 11:58:09 +00:00
Andrew Lamb
1156a81567
feat: Add pbjson serialization for storage rpc ( #3324 )
...
* feat: Add pbjson serialization for storage rpc
* chore: update pbjson-build to 0.1.1
Co-authored-by: Raphael Taylor-Davies <r.taylordavies@googlemail.com>
2021-12-07 16:39:16 +00:00
Marco Neumann
d9e8bafeb3
fix: improve state machine for write buffer creation retries
2021-12-07 10:29:08 +01:00
kodiakhq[bot]
75cd1d24f4
Merge branch 'main' into ntran/grpc_compact_os_chunks
2021-12-07 03:26:06 +00:00
Nga Tran
3834435620
chore: Merge branch 'ntran/grpc_compact_os_chunks' of https://github.com/influxdata/influxdb_iox into ntran/grpc_compact_os_chunks
2021-12-06 12:06:22 -05:00
Nga Tran
d8ed8a3bf7
refactor: address review comments
2021-12-06 12:06:07 -05:00
Carol (Nichols || Goulding)
30c4da7ca7
fix: Be consistent with regex version range specification
2021-12-06 09:37:15 -05:00
Nga Tran
65660dace5
Merge branch 'main' into ntran/grpc_compact_os_chunks
2021-12-03 18:16:42 -05:00
Nga Tran
5f3706e0ee
feat: grpc call for copact object store chunks
2021-12-03 18:01:28 -05:00
Andrew Lamb
7dea2ef362
feat: Add force flag to ClaimDatabase ( #3284 )
...
* feat: Add force flag to ClaimDatabase
* fix: Update name of test
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* docs: Update influxdb_iox/tests/end_to_end_cases/management_cli.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-12-03 21:11:23 +00:00
Nga Tran
fa5b046b45
chore: cleanup
2021-12-02 14:59:47 -05:00
Nga Tran
ffc970a60f
feat: add to-be-create-chunk-id for compacting OS chunks in CatalogChunk
2021-12-02 14:49:06 -05:00
kodiakhq[bot]
e8edab0b43
Merge branch 'main' into ntran/compact_os_preserved_catalog
2021-12-01 18:26:33 +00:00
Raphael Taylor-Davies
94883cd33b
feat: decode error details payloads ( #3251 ) ( #3271 )
2021-12-01 15:30:59 +00:00
Raphael Taylor-Davies
9e45ce4121
feat: cleanup gRPC server errors ( #3251 ) ( #3265 )
...
* feat: add precondition violation enumeration (#3251 )
* chore: review feedback
2021-12-01 13:33:17 +00:00
Raphael Taylor-Davies
f1936f0b08
refactor: add resource type enumeration ( #3251 ) ( #3260 )
...
* refactor: add resource type enumeration (#3251 )
* chore: more error details
2021-12-01 10:26:12 +00:00
Nga Tran
6bb7a796e7
chore: Merge branch 'main' into ntran/compact_os_preserved_catalog
2021-11-30 16:55:38 -05:00
Nga Tran
e8034cdc53
refactor: handle delete predicates for compacting os
2021-11-30 16:45:04 -05:00
Raphael Taylor-Davies
1e515a1dec
feat: load RUB from object store ( #3224 ) ( #3250 )
2021-11-30 14:39:52 +00:00
Raphael Taylor-Davies
88acf3788e
feat: rebuild catalog ( #3225 ) ( #3253 )
...
* feat: rebuild catalog (#3225 )
* chore: fix doc
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-30 12:17:27 +00:00
Raphael Taylor-Davies
f165faf5bc
feat: support forcing persistence of partition irrespective of arrival time ( #3249 )
...
* feat: force persistence of partition irrespective of arrival time
* feat: expose to CLI
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 22:07:35 +00:00
kodiakhq[bot]
23dffefcf8
Merge branch 'main' into crepererum/remove_routing_from_database_mode_7
2021-11-29 11:38:12 +00:00
Raphael Taylor-Davies
197634ed50
feat: reload chunk back into read buffer ( #3209 ) ( #3216 )
...
* feat: reload chunk back into read buffer (#3209 )
* chore: fix logical conflict
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 11:34:55 +00:00
Marco Neumann
4e043ecb55
refactor: remove old routing / sharding config
...
This is superseded by the new router subsystem.
2021-11-29 12:33:48 +01:00
Raphael Taylor-Davies
0100bfef79
feat: error if persist_age_threshold less than late arrival ( #2005 ) ( #3228 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 10:21:12 +00:00
Marko Mikulicic
8fe2c64f5a
fix: Implement a dummy Storage.Offsets method
...
Closes https://github.com/influxdata/conductor/issues/766
2021-11-26 16:39:07 +01:00
Marco Neumann
7f2e4f4342
refactor: remove write buffer direction
...
The direction was required when a database could read or write from/to a
write buffer. Now it is clear from the usage context of a write buffer
context which of the two applications is meant (databases read, routers
write) so the direction flag is no longer required.
2021-11-26 12:38:40 +01:00
Marco Neumann
aa636eaed9
refactor: remove methods from `ManagementService` that were moved to `RemoteService`
...
Tests are covered by `remote_api.rs`.
Ref #2980 .
2021-11-24 10:01:32 +01:00
Marco Neumann
5ecaa6d8a9
refactor: use serialized predicates instead of strings for gRPC deletes
...
IOx is the only consumer of this API so we might just use the serialized
form. Cloud2 uses the HTTP API which supports SQL-like predicates.
Fixes #3192 .
2021-11-24 09:30:32 +01:00
Marco Neumann
dc6b44818d
refactor: remove methods from `ManagementService` that were moved to `DeploymentService`
...
Tests are covered by `deployment_api.rs`.
Ref #2980 .
2021-11-23 18:04:41 +01:00
Marco Neumann
2ef3ab8544
refactor: remove methods from `ManagementService` that were moved to `DeleteService`
...
Tests are covered by `delete_api.rs`.
Ref #2980 .
2021-11-23 16:40:00 +01:00
Edd Robinson
1dedfc6697
refactor: remove storage API from pbjson
2021-11-22 22:30:31 +00:00
Edd Robinson
824ed5f139
chore: clippy
2021-11-22 21:40:42 +00:00
Edd Robinson
dae79ac7ab
chore: fix build
2021-11-22 21:40:42 +00:00
Edd Robinson
f328f1bae5
chore: move read source
2021-11-22 21:40:42 +00:00
Edd Robinson
ddf96efc8a
chore: update storage RPC definitions
2021-11-22 21:40:41 +00:00
kodiakhq[bot]
d16a7759ca
Merge branch 'main' into cn/workspace-hack
2021-11-22 17:05:31 +00:00
Nga Tran
3b2e5c445b
chore: Merge branch 'main' into ntran/compact_os_framework
2021-11-19 16:18:24 -05:00
Carol (Nichols || Goulding)
9fd4a560f5
feat: Results of running cargo hakari manage-deps
2021-11-19 09:21:57 -05:00
Nga Tran
a5c04e5fe4
feat: framework for compact os chunks
2021-11-17 18:12:51 -05:00
Carol (Nichols || Goulding)
f69d37e9a8
fix: Remove database delete/restore entirely
2021-11-17 12:03:11 -05:00
Raphael Taylor-Davies
8155747735
feat: add write buffer delete encoding ( #2731 ) ( #3127 )
...
* feat: add write buffer delete encoding (#2731 )
* chore: fix doc
* chore: review feedback
* chore: review feedback
* chore: fmt
* chore: review feedback
2021-11-17 16:12:19 +00:00
Dom
da61966858
build: remove proc-macro2 pin ( #3137 )
...
Seems unused, builds without it!
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-17 13:55:39 +00:00
Carol (Nichols || Goulding)
bc11244828
feat: Rename database disown/adopt to release/claim ( #3111 )
...
* fix: Rename 'disown' to 'release' database
Connects to #3110
* fix: Rename 'adopt' to 'claim' database
Fixes #3110 .
2021-11-15 20:28:09 +00:00
kodiakhq[bot]
cc693a780e
Merge branch 'main' into cn+jpg/adopt
2021-11-15 19:22:07 +00:00
Raphael Taylor-Davies
3cd7d2eda2
refactor: improve usability of proto conversion traits ( #3109 )
...
* refactor: improve usability of proto conversion traits
* chore: review feedback
2021-11-15 16:10:29 +00:00
Jake Goulding
af28cfa2a6
feat: Add an adopt database API
...
Fixes #2679 .
2021-11-15 09:26:06 -05:00