7dea2ef362
feat: Add force flag to ClaimDatabase ( #3284 )
...
* feat: Add force flag to ClaimDatabase
* fix: Update name of test
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
* docs: Update influxdb_iox/tests/end_to_end_cases/management_cli.rs
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Carol (Nichols || Goulding) <193874+carols10cents@users.noreply.github.com>
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-12-03 21:11:23 +00:00
21f3306a3f
chore: Merge branch 'ntran/chunkid_catalogchunk' of https://github.com/influxdata/influxdb_iox into ntran/chunkid_catalogchunk
2021-12-03 10:02:36 -05:00
dd4e8884be
refactor: modify comments
2021-12-03 10:02:22 -05:00
0dffcad109
Merge branch 'main' into ntran/chunkid_catalogchunk
2021-12-03 14:21:04 +00:00
a03716cd06
chore: make the message clearer
2021-12-02 15:05:21 -05:00
ffc970a60f
feat: add to-be-create-chunk-id for compacting OS chunks in CatalogChunk
2021-12-02 14:49:06 -05:00
a08246e3c7
Merge branch 'main' into er/refactor/debug_rub_query
2021-12-02 19:42:46 +00:00
0683f851e9
fix: Derive Default instead of doing an equivalent manual impl
...
Identified by clippy. The impl did have `#[cfg(test)]` on it, but the
entire struct does too, so this is fine.
https://rust-lang.github.io/rust-clippy/master/index.html#derivable_impls
2021-12-02 11:52:02 -05:00
5d0fd1c603
fix: Allow dead code on fields that are now detected as never read
2021-12-02 11:52:01 -05:00
4a4e11f08b
refactor: adjust debug logging
2021-12-02 12:19:51 +00:00
f085af034e
refactor: not persist empty chunk resulting from deleting & deduplicating ( #3274 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-01 20:57:30 +00:00
e8edab0b43
Merge branch 'main' into ntran/compact_os_preserved_catalog
2021-12-01 18:26:33 +00:00
de54d2843c
chore: remove unused error
2021-12-01 13:24:12 -05:00
60807c2d95
refactor: address review comments
2021-12-01 13:11:17 -05:00
254d35a6c2
refactor: address review comment
2021-12-01 12:25:42 -05:00
878c59c0d2
chore: cleanup
2021-12-01 10:25:35 -05:00
1ac32f1d90
refactor: avoid lock gap while updating in-memory catalog
2021-12-01 10:24:58 -05:00
05064eba62
fix: don't error on delete to non-existent table ( #3259 ) ( #3263 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-12-01 00:40:05 +00:00
f53cdca010
feat: handling empty compacted stream
2021-11-30 18:13:36 -05:00
6bb7a796e7
chore: Merge branch 'main' into ntran/compact_os_preserved_catalog
2021-11-30 16:55:38 -05:00
e8034cdc53
refactor: handle delete predicates for compacting os
2021-11-30 16:45:04 -05:00
c161d1176a
refactor: cleanup Db write path error handling ( #3258 )
2021-11-30 15:05:02 +00:00
1e515a1dec
feat: load RUB from object store ( #3224 ) ( #3250 )
2021-11-30 14:39:52 +00:00
20da62eb87
chore: Update `arrow`, `arrow-flight`, and `parquet` to 6.3.0 ( #3254 )
...
* chore: Update `arrow`, `arrow-flight`, and `parquet` to 6.3.0
* fix: update metadata size
2021-11-30 12:30:17 +00:00
88acf3788e
feat: rebuild catalog ( #3225 ) ( #3253 )
...
* feat: rebuild catalog (#3225 )
* chore: fix doc
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-30 12:17:27 +00:00
7afc20142b
test: add tests that do actual compacting chunks
2021-11-29 22:59:34 -05:00
37c4bb402b
feat: update os compacted chunk in both in memory and preserved catalog
2021-11-29 15:17:00 -05:00
837e029ed8
refactor: cleanup database recovery ( #3225 ) ( #3245 )
...
* refactor: cleanup database recovery (#3225 )
* chore: fix errors
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 18:49:46 +00:00
0517adf752
feat: test interaction of write buffer and lifecycle ( #2811 ) ( #3211 )
...
* feat: test interaction of write buffer and lifecycle (#2811 )
* chore: more docs
2021-11-29 14:16:43 +00:00
23dffefcf8
Merge branch 'main' into crepererum/remove_routing_from_database_mode_7
2021-11-29 11:38:12 +00:00
197634ed50
feat: reload chunk back into read buffer ( #3209 ) ( #3216 )
...
* feat: reload chunk back into read buffer (#3209 )
* chore: fix logical conflict
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-29 11:34:55 +00:00
4e043ecb55
refactor: remove old routing / sharding config
...
This is superseded by the new router subsystem.
2021-11-29 12:33:48 +01:00
a286960285
refactor: remove delete predicates from read filter interface ( #3212 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-26 12:15:29 +00:00
7f2e4f4342
refactor: remove write buffer direction
...
The direction was required when a database could read or write from/to a
write buffer. Now it is clear from the usage context of a write buffer
context which of the two applications is meant (databases read, routers
write) so the direction flag is no longer required.
2021-11-26 12:38:40 +01:00
ac20fecf6f
refactor: remove write buffer producer logic from `Db`
...
As a side effect, writing to database no longer requires `async`.
Closes #2243 .
2021-11-26 12:02:27 +01:00
e5bfa08910
feat: disallow unsequenced deletes when reading from write buffer
...
Similar to how writes to a databases that reads from a write buffer are
forbidden deletes should be rejected as well.
2021-11-26 11:40:08 +01:00
22936abb23
refactor: remove connection manager and resolver from `Server`
2021-11-26 11:00:19 +01:00
0e06026fbd
refactor: remove write routing logic from `Server`
...
API users should use `Database` instead, there's no need any longer to mirror
this API in `Server`. Note that `Database` is better than `Db` in this
case, because the former can also check if we're writing from a write
buffer and can easily reject unsequenced writes. The `pub` modifiers
were adjusted to make it impossible to write through `Db` directly.
2021-11-26 09:26:43 +01:00
4e7e9f6fc9
chore: Merge branch 'ntran/compact_os_blocks' of https://github.com/influxdata/influxdb_iox into ntran/compact_os_blocks
2021-11-23 16:56:59 -05:00
b2b033f00c
chore: rerun fmt after merging
2021-11-23 16:56:38 -05:00
1d1622efa3
Merge branch 'main' into ntran/compact_os_blocks
2021-11-23 21:47:05 +00:00
ade7ea6cfb
chore: Merge branch 'ntran/compact_os_blocks' of https://github.com/influxdata/influxdb_iox into ntran/compact_os_blocks
2021-11-23 16:44:48 -05:00
a0fb6a4758
chore: cleanup
2021-11-23 16:44:30 -05:00
4fc09484ed
chore: Apply suggestions from code review
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-11-23 16:43:12 -05:00
4e28b4c43b
refactor: address review comments
2021-11-23 16:39:45 -05:00
e64ac10c40
refactor: address review comments and compute max checkpoints
2021-11-23 15:32:46 -05:00
42e3a41825
fix: flaky test_chunk_access_time ( #3197 ) ( #3200 )
...
* fix: flaky test_chunk_access_time (#3197 )
* chore: fix lint
Co-authored-by: Edd Robinson <me@edd.io>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-23 17:39:57 +00:00
bfa4bfe735
refactor: lifecycle observability cleanup ( #2286 ) ( #3189 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-11-23 15:42:24 +00:00
124f5bb4c5
chore: make comments clearer
2021-11-22 23:30:18 -05:00
8788dd6d39
chore: fix comment
2021-11-22 23:24:28 -05:00
Andrew Lamb
Nga Tran
kodiakhq[bot]
Edd Robinson
Carol (Nichols || Goulding)
Raphael Taylor-Davies
Marco Neumann