influxdb/compactor
Nga Tran 1400bf99e4
refactor: split memory estimation into bytes to store and bytes to stream (#5845)
* refactor: split memory estimation into bytes to store and bytes to stream

* chore: cleanup

Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2022-10-12 16:59:51 +00:00
..
src refactor: split memory estimation into bytes to store and bytes to stream (#5845) 2022-10-12 16:59:51 +00:00
Cargo.toml chore: Update datafusion + `arrow`, `arrow-flight`, and `parquet` to 24.0.0.0 (#5792) 2022-10-12 16:19:14 +00:00
README.md docs: add consensus for the desired final output of the compactor (#5069) 2022-07-07 19:11:16 +00:00

README.md

After a partition of a table has not received any writes for some amount of time, the compactor will ensure it is stored in object store as N parquet files which:

  • have non overlapping time ranges
  • each does not exceed a size specified by config param max_desired_file_size_bytes.