bf15e50ce7
Merge branch 'main' into crepererum/fix_checkpoint_ordering3
2021-08-09 12:27:20 +00:00
c2a660b11c
fix: error message typo
2021-08-09 14:26:07 +02:00
28a50a5104
fix: typo
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-08-09 14:24:53 +02:00
54a8fff328
feat: database initialization logging ( #2228 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-09 12:13:33 +00:00
559db4529d
refactor: Move DatabaseStore out of query crate ( #2219 )
...
* refactor: Move DatabaseStore out of query crate
* fix: doc links
2021-08-09 12:06:25 +00:00
92334a3747
docs: explain test intend
2021-08-09 13:26:31 +02:00
8235fb862b
test: extend db ckpt fold tests
2021-08-09 13:14:15 +02:00
a8ceb3f345
docs: expand docs on checkpoint ordering
2021-08-09 13:10:27 +02:00
8721c5fcd6
fix: improve error messages
2021-08-09 10:54:23 +02:00
ae93a1cb89
test: adjust replay tests
2021-08-09 10:54:23 +02:00
950286e5b7
feat: make replay planning work w/ unordered checkpoints
2021-08-09 10:54:23 +02:00
0d49fb0d61
feat: database checkpoint folding
2021-08-09 10:54:23 +02:00
a435a15d19
feat: impl `PartialOrd` for `PartitionCheckpoint`
2021-08-09 10:54:23 +02:00
3b9ac330c2
feat: impl `PartialOrd` for `OptionalMinMaxSequence`
2021-08-09 10:54:23 +02:00
08ac092cb1
Merge pull request #2226 from influxdata/crepererum/peristence_windows_hardening
...
refactor: harden peristence windows data structure
2021-08-09 08:52:13 +00:00
94ceef87c6
feat: ensure that min and max time in persistence windows are ordered
2021-08-09 10:33:24 +02:00
57bbae7e34
refactor: persistence windows row counts are non-zero
2021-08-09 10:33:24 +02:00
8f06652308
test: persistence window backwards clock panic
2021-08-09 10:33:24 +02:00
c957d8154f
feat: blocking Freezable ( #2224 )
...
* feat: blocking Freezable
* chore: test
2021-08-08 19:26:11 +00:00
1f450ef371
feat: add Database abstraction ( #2186 ) ( #2203 )
...
* feat: add Database abstraction
* chore: minor tweaks
* chore: remove redundant test fixture restart
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-08 17:14:23 +00:00
7191053899
docs: document Metrics
2021-08-06 17:12:00 -04:00
2afc7e56ae
docs: add writeup on how to use IOx server from source ( #2220 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-06 21:04:44 +00:00
d41b44d312
feat: use zstd compression when writing parquet files ( #2218 )
...
* feat: use ZSTD when writing parquet files
* fix: test
2021-08-06 18:45:55 +00:00
5d525cdc70
docs: Add note about what uses `ApplicationState` ( #2216 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-06 14:44:06 +00:00
82677d9510
feat: add `jaeger` and `otlp` features, default to off ( #2202 )
...
* feat: add jaeger and otlp flags
* chore: add jaeger and otlp features to CI test and deploy image
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-06 13:26:59 +00:00
fe229ae62d
Merge pull request #2205 from influxdata/crepererum/hotfix
...
fix: only warn when partition ckpt and DB ckpt mins are out-of-sync
2021-08-06 08:32:58 +00:00
ef9d8aa736
fix: improve warning wording
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-08-06 10:25:26 +02:00
4c79e3548e
test: do not rely on too many edge cases
2021-08-06 10:24:26 +02:00
882f89cecf
fix: only warn when partition ckpt and DB ckpt mins are out-of-sync
...
There are currently a few bugs and semi-understood edge cases that can
lead to this case. So instead of bailing out, just issue a warning.
2021-08-06 09:48:26 +02:00
a5e9bbc507
feat: impl `Display` for `OptionalMinMaxSequence`
2021-08-06 09:48:26 +02:00
4ffdb3d95d
test: drop-unpersisted is not required to trigger that bug
2021-08-06 09:48:26 +02:00
e69a159ad2
refactor: remove unused opentelemetry dependencies ( #2201 )
2021-08-05 16:20:22 +00:00
e92e94caad
chore: Update deps (including arrow 5.1.0, tonic -> 0.5, and prost 0.5) ( #2172 )
...
* chore: Update deps (including arrow 5.0.0 --> arrow 5.1.0)
* chore: update all the things
* refactor: Update serving readiness check due to change in Tonic API
* chore: update more deps
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-05 15:57:38 +00:00
9fc8141362
Merge pull request #2191 from influxdata/crepererum/fix_checkpoint_ordering2
...
test: regression test for #2185
2021-08-05 12:31:23 +00:00
bde2b2b5df
refactor: `Tick` -> `MakeWritesPersistable`
2021-08-05 14:21:36 +02:00
548145a70e
docs: state that `background_worker_now_override` is for testing only
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-08-05 14:08:24 +02:00
015d858f88
test: add failing regression test for #2185
...
We need a partition that is partially persisted for this.
This requires some rework for the time handling in `Db` to make it
mockable.
The remaining bits are test framework extensions.
2021-08-05 11:44:44 +02:00
748bbf6b3c
fix: check empty replay ranges as well during replay plan construction
2021-08-05 11:39:19 +02:00
e2df0eeb00
docs: Add replay diagram and notes to checkpoints and ReplayPlanner ( #2184 )
...
* docs: Add replay diagram and notes to persistence_windows
* docs: Apply suggestions from code review
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
* docs: review feedback
Co-authored-by: Marco Neumann <marco@crepererum.net>
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-04 18:27:50 +00:00
dd9beab166
feat: error database if no rules ( #2187 )
2021-08-04 11:58:59 +00:00
4375737ac1
Merge pull request #2150 from influxdata/crepererum/replay_entry_pruning
...
feat: prune sequence numbers during replay
2021-08-04 11:30:46 +00:00
60aee3e70c
refactor: avoid copying a sequence
2021-08-04 13:23:30 +02:00
1b2e331ec1
test: extend replay tests a bit
2021-08-04 13:23:30 +02:00
af1edcdcbb
fix: docstrings
...
Co-authored-by: Andrew Lamb <alamb@influxdata.com>
2021-08-04 13:23:30 +02:00
39f30fd0b6
test: make test queries easier to understand
2021-08-04 13:23:30 +02:00
567ef7e991
test: expland replay tests a bit
2021-08-04 13:23:30 +02:00
b868cd160e
docs: fix code comment about sequence ranges
2021-08-04 13:23:30 +02:00
ed70b73fd8
test: determistic concurreny for `TestDb`
2021-08-04 13:23:30 +02:00
a2bc97b923
feat: prune sequence numbers during replay
...
This only prunes entire sequence numbers, it does not (yet!) prune
individual rows for sequence numbers that are partially persisted.
2021-08-04 13:23:30 +02:00
7a18087044
feat: Log messages during database initialization ( #2180 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-08-04 11:04:41 +00:00
kodiakhq[bot]
Marco Neumann
Raphael Taylor-Davies
Andrew Lamb
Nga Tran