dd61266d90
Merge branch 'main' into crepererum/issue1725-b
2021-06-17 07:06:47 +00:00
cac54de5e1
Merge pull request #1724 from influxdata/pd-persistence-windows
...
feat: Add persistence windows ingestion tracking
2021-06-16 20:19:51 +00:00
ecfabe3408
chore: address PR feedback, changed closed persistence window to dequeue.
2021-06-16 15:28:37 -04:00
6bc4b383a4
chore: update based on PR feedback, add more comments
2021-06-16 15:28:37 -04:00
802ecacf61
feat: Add persistence windows ingestion tracking
...
This adds a new module, persistence_windows, to the mutable buffer crate. Later PRs will add this into the mutable buffer chunk where it can be used to track when the lifecycle for persistence should be triggered.
2021-06-16 15:28:37 -04:00
27e499a1dd
feat: instrumented, upgradeable RWLocks ( #1741 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-16 16:15:10 +00:00
9cb89c1542
Merge pull request #1742 from influxdata/logtracingsplit
...
chore: Split LoggingConfig out of TracingConfig
2021-06-16 15:15:16 +00:00
4adf3b5e52
chore: Split LoggingConfig out of TracingConfig
...
Client CLI utils only need LoggingConfig. Servers need also the TracingConfig
2021-06-16 16:07:57 +02:00
8c0831f410
Merge pull request #1738 from influxdata/betterdefaults
...
chore: Allow custom default log filter
2021-06-16 11:34:57 +00:00
58e1494ca2
chore: Allow custom default log level
...
This PR moves the definition of the `log_filter` default value from the `structopt` annotation
to the `trogging::Builder`. This allows users of `trogging` to define their own default value
for the log level.
2021-06-16 13:30:32 +02:00
87b2a1eaea
docs: add note about why we write parquets during transactions
2021-06-16 11:01:14 +02:00
e056d97cf6
test: always test transaction aborts
2021-06-16 11:01:14 +02:00
ec053f674c
feat: make DB catalog work w/ transaction aborts
2021-06-16 11:01:14 +02:00
caaf95c6ec
refactor: remove lock from `TestCatalogState`
2021-06-16 10:51:15 +02:00
c8c412f6fe
refactor: rework catalog state interface
...
This now allows not only for copy-based transaction handling but also
for eager exec and rollbacks. This will be useful to properly implement
transaction aborts for the "real" catalog.
2021-06-16 10:51:15 +02:00
2596de072e
feat: make sure DB catalog can correctly add and remove parquet files
...
Note that this does NOT yet allow it to correctly abort transactions.
2021-06-16 10:50:47 +02:00
e064a6bbba
test: add test suite for `CatalogState` impls
...
This makes it easier to check if `CatalogState` correctly implement all
features, including transaction aborting.
2021-06-16 10:50:47 +02:00
a429de4784
Merge pull request #1734 from influxdata/trogging-like-a-pro
...
feat: Factor out tracing/logging CLI options
2021-06-16 07:39:18 +00:00
760bcde3f0
feat: Factor out tracing/logging CLI options
...
This PR factors out the tracing/logging CLI optinos into the `trogging` utility crate,
so that multiple binaries from the IOx suite (such as conductor) can use the same (and quite complex)
logging/tracing configuration options (flags and env vars).
Closes influxdata/conductor#343
2021-06-16 00:54:11 +02:00
38d17a3093
chore: remove unused query dependency ( #1731 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-15 22:06:13 +00:00
2c8060160f
chore: update datafusion deps ( #1721 )
...
* chore: update datafusion deps
* chore: update deps
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-15 19:06:15 +00:00
bf54ab51f2
refactor: split lifecycle into separate crate ( #1730 )
2021-06-15 15:57:47 +00:00
f96e05d26a
refactor: traitify lifecycle policy ( #1729 )
...
* refactor: traitify lifecycle policy
* chore: docs
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-15 14:00:06 +00:00
e333cbbd4e
Merge pull request #1719 from influxdata/trogging
...
chore: Pull tracing+logging setup in its own crate
2021-06-15 13:08:47 +00:00
4dc338e1bc
Merge branch 'main' into trogging
2021-06-15 13:04:06 +00:00
bde35cf5be
chore: Pull tracing+logging setup in its own crate
...
1. so that it can be reused by other binaries (e.g. conductor)
2. so that it's faster to build when working on it.
2021-06-15 14:52:04 +02:00
b756e09904
refactor: Rename parquet_file::Chunk --> ParquetChunk ( #1722 )
...
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-15 11:21:49 +00:00
d5ddfa505b
Merge pull request #1727 from influxdata/crepererum/issue1595
...
feat: info-log server ID during init
2021-06-15 11:16:53 +00:00
09f2ae1616
Merge branch 'main' into crepererum/issue1595
2021-06-15 11:12:01 +00:00
64c815dd50
fix: bump catalog version ( #1726 )
...
This should have been done in #1714 . Also add a note so that future devs
might hopefully not forget. In any case though the code also works w/o
this bump, it's just that the error message is a bit less nice ("cannot
parse IOxMetadata" instead of "unsupported catalog version").
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-15 10:26:30 +00:00
5834671760
Merge pull request #1728 from influxdata/crepererum/issue1725-a
...
refactor: improve server background task logging
2021-06-15 09:11:01 +00:00
adc3a059ca
refactor: improve server background task logging
...
- rename `name` to `db_name`
- add `table_name` to error-detection logs
- use `Display` instead of `Debug` fmt for errors, which results in
nicer outputs and follows the rest of the stack
This is for #1725 .
2021-06-15 10:28:12 +02:00
dcfaa81969
feat: info-log server ID during init
...
Add a info log when the server ID is set. Because this is done where the
server ID is also stored, this automatically affects all ways to set it
(via CLI, via environment variable, via gRPC call).
Closes #1595 .
2021-06-15 10:09:53 +02:00
d9ca57e414
Merge pull request #1714 from influxdata/crepererum/issue1506
...
feat: remove path parsing functionality
2021-06-15 07:40:57 +00:00
19f684ee14
Merge branch 'main' into crepererum/issue1506
2021-06-15 07:36:49 +00:00
55fc5e564b
refactor: remove serverID and DB name args from catalog state
...
They are no longer required.
2021-06-15 09:35:41 +02:00
944a2f636e
Merge pull request #1723 from influxdata/alamb/rust_1.52.1
...
chore: update to rust 1.52.1 to avoid incremental complation panics
2021-06-14 23:20:05 +00:00
954ba2b115
chore: update to rust 1.52.1
2021-06-14 17:00:05 -04:00
dd422492e2
feat: sort order in schema ( #1357 ) ( #1667 )
...
* feat: sort order in schema (#1357 )
* chore: review feedback
* chore: review feedback
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-06-14 18:10:41 +00:00
8739331dc3
Merge pull request #1720 from influxdata/revert-1706-er/duplicate_keys
...
refactor: revert "refactor: read_filter debugging"
2021-06-14 17:05:47 +00:00
e2315f0016
refactor: revert reead_filter debugging
2021-06-14 17:54:21 +01:00
c2728cb47d
Merge pull request #1680 from influxdata/crepererum/1624
...
feat: expose server and DB init errors over gRPC
2021-06-14 15:39:45 +00:00
057c99d431
fix: tighten memory ordering
2021-06-14 17:34:57 +02:00
51f27de2ee
docs: fix typo
...
Co-authored-by: Raphael Taylor-Davies <1781103+tustvold@users.noreply.github.com>
2021-06-14 17:34:57 +02:00
14ba02ec87
feat: expose server and DB init errors over gRPC
...
Closes #1624 .
2021-06-14 17:34:57 +02:00
a449d5ef74
test: make some `server_fixture` functionality public
...
This is useful when you want to test a server boot-up with custom
configs.
2021-06-14 17:34:57 +02:00
2ea24b6467
feat: allow to fail initializing a single DB
...
- keep errors encountered during DB init
- treat failed DB inits as existing DBs
- effectively poison failed DBs (there is no way to recover except by
restarting the server, yet)
2021-06-14 17:34:57 +02:00
0b5552f131
refactor: ensure that DBs are reserved before doing expensive IO
2021-06-14 17:34:57 +02:00
233235365a
refactor: de-couple DB rules commit from name reservation
...
This allows us to put DBs in a controlled error state when we try to
load rules from a file but the rules are somewhat broken.
2021-06-14 17:34:57 +02:00
318af9b801
feat: keep error that occurred during server init
2021-06-14 17:34:57 +02:00
kodiakhq[bot]
Paul Dix
Raphael Taylor-Davies
Marko Mikulicic
Marco Neumann
Andrew Lamb
Andrew Lamb
Edd Robinson