0a20086a58
feat: expose catalog timeouts via CLI/env ( #4472 )
...
This is useful for local instances that run against a prod system,
because port forwarding can lead to long connection delays.
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-29 11:14:15 +00:00
5c89e7b952
fix: Remove max catalog connection config from all-in-one mode
2022-04-28 09:29:03 -04:00
ff268ace6d
fix: Add more docs on write buffer temp dir behavior
2022-04-28 09:29:02 -04:00
c93c26c503
fix: Add reference to TODO ticket
2022-04-28 09:29:02 -04:00
84683056db
feat: Add more logging for all-in-one mode to make it clearer what components are used
2022-04-28 09:29:02 -04:00
d6d50f83c2
feat: Set different catalog config defaults for all-in-one mode
...
Connects to #4399 .
If `--catalog-dsn` is specified, use that Postgres catalog. If
`--catalog-dsn` is not specified, use an in-memory catalog.
2022-04-28 09:29:02 -04:00
941dd12dd1
feat: Set different write buffer config defaults for all-in-one mode
...
Connects to #4399 .
Only file-based write buffer is supported. If `--data-dir` is specified,
store it there, otherwise store it in a temp directory to be ephemeral
2022-04-28 09:29:02 -04:00
0cfd16263c
refactor: Change run_config to logging_config
...
The only spot this method is used actually wants the logging config
2022-04-28 09:29:01 -04:00
4b47d723b1
refactor: Rename time to iox_time ( #4416 )
...
Signed-off-by: hi-rustin <rustin.liu@gmail.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-04-26 00:19:59 +00:00
ef1f252c6c
test: use random catalog schema name for NG end2end tests
...
Otherwise tests leak state to other tests or previous runs.
2022-04-13 17:24:42 +02:00
bd4566cbe0
fix: Do not specify a querier address by default ( #4289 )
2022-04-12 20:52:18 +00:00
3f5eab7648
feat: allow the querier to talk with multiple ingesters ( #4271 )
...
* refactor: Move querier config to clap_blocks
* refactor: Add tests
* refactor: allow multiple addresses
* refactor: Update to use multiple addresses
* fix: bow to clippy
* fix: docstring
* fix: error if address is repeated multiple times
* chore: Add error enum, plumb through
* fix: clippy
* refactor: improve Rust API
* fix: fix test
2022-04-11 18:49:49 +00:00
77ad4a7dad
feat: replace a compactor constant with an CLI config param ( #4204 )
2022-04-01 17:50:43 +00:00
04d961e70d
feat: wire up compactor scheduler and config ( #4139 )
...
Add configuration options for compactor for the max size of level 0 files and split percentage.
Add metrics for compaction to track the number of candidates, compactions, and durations.
Add functions to separate identifying partitions to compact from running compaction.
Make compaction run in smaller chunks, specifically per partition.
Update compaction to automatically promote level 0 files that are non-overlapping without waiting some period of time.
Closes #4120
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-03-30 17:45:24 +00:00
4f5321d19b
feat: add compactor configuration for kafka topic and sequencers ( #4107 )
2022-03-23 14:11:47 +00:00
5585dd3c21
refactor: switch to using DynObjectStore
...
Changes all consumers of the object store to use the dynamically
dispatched DynObjectStore type, instead of using a hardcoded concrete
implementation type.
2022-03-15 16:32:52 +00:00
1d5066c421
refactor: rename ObjectStore -> ObjectStoreImpl
...
Frees up the name for so we can use `dyn ObjectStore` throughout the
code instead of `ObjectStoreApi`.
2022-03-15 16:29:43 +00:00
9b3f946c10
feat: all in 1 IOx NG mode ( #3965 )
...
* feat: Add all_in_one mode
* fix: doc
* docs: fix truncated docs
* refactor: correctly identify PG connections
* refactor: resolve failed merge
Co-authored-by: Dom Dwyer <dom@itsallbroken.com>
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-03-15 16:28:37 +00:00
cc4875cca0
refactor: decouple ingester setup and creation logic from the config structs ( #4020 )
...
* refactor: decouple ingester setup and creation logic from the config structs
* fix: clippy
* refactor: remove comments
2022-03-11 19:25:50 +00:00
d2c0acdd46
refactor: Remove serving readiness gate ( #3986 )
...
* refactor: Remove serving_readiness
* fix: remove more
* fix: remove test
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-03-09 12:17:44 +00:00
80fb75d90b
feat: add a flag to enable per-partition tracing ( #3928 )
...
* feat: add a flag to enable per-partition tracing
* chore: rename constant
* feat: use BooleanFlag and cache result
2022-03-07 13:49:23 +00:00
cf0c238ae4
feat: allow unencrypted HTTP connections to AWS via flag ( #3916 )
...
This is required for the test bench.
2022-03-03 17:01:03 +00:00
d6afda0227
refactor: split `influxdb_ioxd`, `clap_blocks` and `serving_readiness` from influxdb_iox crate ( #3908 )
...
* refactor: split influxdb_ioxd, clap_blocks, and serving_readiness out of influxdb_iox
split out serving readiness, get compiling
* fix: hakari
* fix: hakari again
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-03-03 16:48:30 +00:00
Marco Neumann
Carol (Nichols || Goulding)
二手掉包工程师
Andrew Lamb
Nga Tran
Paul Dix
Dom Dwyer
Raphael Taylor-Davies