Dom Dwyer c830a83105 feat(ingester2): hot partition persistence ... This PR uses the MutableBatch persist cost estimation added in #6425 to selectively mark "hot" partitions for persistence. This uses a (composable!) "post-write" observer that is invoked after each buffer call - this allows the HotPartitionPersister in this commit to inspect the cost of the partition after applying the write, and if it exceeds the configurable cost threshold, enqueue it for persistence (rotating the buffer within the partition in the process). Unlike ingester(1), this implementation prevents overrun - the application of the write that exceeds the cost limit, and enqueueing the partition for persistence is atomic.		2022-12-16 19:33:34 +01:00
..
src	feat(ingester2): hot partition persistence	2022-12-16 19:33:34 +01:00
Cargo.toml	feat(ingester2): run persistence task	2022-12-02 17:18:39 +01:00