1bb4c08067
Changes the default ingester configuration to assign half the logical cores to datafusion for persist execution. Prior to this commit, datafusion always used 4 threads by default. In situations where the ingesters are configured with 4 logical cores or less, the periodic persist can start enough persist jobs to keep the 4 threads assigned to datafusion busy. Because there are enough threads to saturate all CPU cores, these CPU-heavy persist threads can impact write latency by stealing CPU time from the tokio runtime threads. This change assigns exactly half the threads to DF by default, ensuring there's always N/2 cores to service I/O heavy API requests. |
||
|---|---|---|
| .. | ||
| src | ||
| tests | ||
| Cargo.toml | ||
| build.rs | ||